Oct 31 17:26:30.175964 ip-10-0-138-17 systemd[1]: Starting Kubernetes Kubelet...
Oct 31 17:26:30.588306 ip-10-0-138-17 kubenswrapper[2572]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Oct 31 17:26:30.588306 ip-10-0-138-17 kubenswrapper[2572]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Oct 31 17:26:30.588306 ip-10-0-138-17 kubenswrapper[2572]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Oct 31 17:26:30.588306 ip-10-0-138-17 kubenswrapper[2572]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Oct 31 17:26:30.594842 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.594752    2572 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 31 17:26:30.594842 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.594840    2572 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 31 17:26:30.594842 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.594845    2572 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 31 17:26:30.594938 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.594849    2572 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 31 17:26:30.594938 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.594852    2572 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 31 17:26:30.594938 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.594855    2572 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 31 17:26:30.594938 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.594858    2572 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 31 17:26:30.594938 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.594862    2572 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 31 17:26:30.594938 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.594865    2572 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 31 17:26:30.594938 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.594868    2572 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 31 17:26:30.594938 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.594871    2572 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 31 17:26:30.594938 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.594875    2572 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 31 17:26:30.594938 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.594879    2572 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 31 17:26:30.594938 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.594883    2572 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 31 17:26:30.594938 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.594886    2572 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 31 17:26:30.594938 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.594889    2572 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 31 17:26:30.594938 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.594892    2572 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 31 17:26:30.594938 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.594895    2572 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 31 17:26:30.594938 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.594899    2572 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 31 17:26:30.594938 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.594901    2572 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 31 17:26:30.594938 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.594905    2572 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 31 17:26:30.594938 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.594907    2572 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 31 17:26:30.595380 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.594910    2572 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 31 17:26:30.595380 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.594913    2572 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 31 17:26:30.595380 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.594915    2572 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 31 17:26:30.595380 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.594918    2572 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 31 17:26:30.595380 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.594921    2572 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 31 17:26:30.595380 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.594923    2572 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 31 17:26:30.595380 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.594926    2572 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 31 17:26:30.595380 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.594929    2572 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 31 17:26:30.595380 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.594932    2572 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 31 17:26:30.595380 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.594934    2572 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 31 17:26:30.595380 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.594937    2572 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 31 17:26:30.595380 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.594940    2572 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 31 17:26:30.595380 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.594943    2572 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 31 17:26:30.595380 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.594946    2572 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 31 17:26:30.595380 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.594949    2572 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 31 17:26:30.595380 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.594952    2572 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 31 17:26:30.595380 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.594954    2572 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 31 17:26:30.595380 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.594957    2572 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 31 17:26:30.595380 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.594960    2572 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 31 17:26:30.595380 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.594962    2572 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 31 17:26:30.595864 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.594965    2572 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 31 17:26:30.595864 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.594967    2572 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 31 17:26:30.595864 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.594970    2572 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 31 17:26:30.595864 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.594972    2572 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 31 17:26:30.595864 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.594975    2572 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 31 17:26:30.595864 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.594977    2572 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 31 17:26:30.595864 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.594980    2572 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 31 17:26:30.595864 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.594983    2572 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 31 17:26:30.595864 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.594985    2572 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 31 17:26:30.595864 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.594988    2572 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 31 17:26:30.595864 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.594990    2572 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 31 17:26:30.595864 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.594993    2572 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 31 17:26:30.595864 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.594995    2572 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 31 17:26:30.595864 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.594999    2572 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 31 17:26:30.595864 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.595002    2572 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 31 17:26:30.595864 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.595005    2572 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 31 17:26:30.595864 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.595007    2572 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 31 17:26:30.595864 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.595010    2572 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 31 17:26:30.595864 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.595012    2572 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 31 17:26:30.596316 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.595015    2572 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 31 17:26:30.596316 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.595018    2572 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 31 17:26:30.596316 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.595020    2572 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 31 17:26:30.596316 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.595023    2572 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 31 17:26:30.596316 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.595026    2572 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 31 17:26:30.596316 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.595028    2572 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 31 17:26:30.596316 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.595031    2572 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 31 17:26:30.596316 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.595033    2572 feature_gate.go:386] unrecognized feature gate: Example
Oct 31 17:26:30.596316 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.595036    2572 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 31 17:26:30.596316 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.595038    2572 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 31 17:26:30.596316 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.595041    2572 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 31 17:26:30.596316 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.595043    2572 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 31 17:26:30.596316 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.595046    2572 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 31 17:26:30.596316 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.595048    2572 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 31 17:26:30.596316 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.595052    2572 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 31 17:26:30.596316 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.595054    2572 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 31 17:26:30.596316 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.595057    2572 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 31 17:26:30.596316 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.595062    2572 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 31 17:26:30.596316 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.595065    2572 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 31 17:26:30.596316 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.595068    2572 feature_gate.go:386] unrecognized feature gate: Example2
Oct 31 17:26:30.596803 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.595072    2572 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 31 17:26:30.596803 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.595074    2572 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 31 17:26:30.596803 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.595077    2572 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 31 17:26:30.596803 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.595080    2572 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 31 17:26:30.596803 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.595082    2572 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 31 17:26:30.596803 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.595085    2572 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 31 17:26:30.596803 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.595089    2572 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 31 17:26:30.596803 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.595092    2572 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 31 17:26:30.596803 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.595094    2572 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 31 17:26:30.596803 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.595098    2572 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 31 17:26:30.596803 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.595101    2572 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 31 17:26:30.596803 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.595103    2572 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 31 17:26:30.596803 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.595106    2572 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 31 17:26:30.596803 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.595109    2572 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 31 17:26:30.596803 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.595112    2572 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 31 17:26:30.596803 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.595115    2572 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 31 17:26:30.596803 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.595118    2572 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 31 17:26:30.596803 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.595121    2572 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 31 17:26:30.596803 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.595123    2572 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 31 17:26:30.596803 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.595126    2572 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 31 17:26:30.597305 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.595128    2572 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 31 17:26:30.597305 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.595131    2572 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 31 17:26:30.597305 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.595134    2572 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 31 17:26:30.597305 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.595136    2572 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 31 17:26:30.597305 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.595140    2572 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 31 17:26:30.597305 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.595984    2572 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 31 17:26:30.597305 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.595993    2572 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 31 17:26:30.597305 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.595997    2572 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 31 17:26:30.597305 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.596001    2572 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 31 17:26:30.597305 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.596005    2572 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 31 17:26:30.597305 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.596008    2572 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 31 17:26:30.597305 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.596011    2572 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 31 17:26:30.597305 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.596013    2572 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 31 17:26:30.597305 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.596016    2572 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 31 17:26:30.597305 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.596019    2572 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 31 17:26:30.597305 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.596022    2572 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 31 17:26:30.597305 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.596024    2572 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 31 17:26:30.597305 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.596027    2572 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 31 17:26:30.597305 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.596031    2572 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 31 17:26:30.597305 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.596034    2572 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 31 17:26:30.597802 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.596036    2572 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 31 17:26:30.597802 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.596039    2572 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 31 17:26:30.597802 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.596042    2572 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 31 17:26:30.597802 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.596044    2572 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 31 17:26:30.597802 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.596047    2572 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 31 17:26:30.597802 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.596050    2572 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 31 17:26:30.597802 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.596052    2572 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 31 17:26:30.597802 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.596055    2572 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 31 17:26:30.597802 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.596057    2572 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 31 17:26:30.597802 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.596060    2572 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 31 17:26:30.597802 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.596062    2572 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 31 17:26:30.597802 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.596065    2572 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 31 17:26:30.597802 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.596068    2572 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 31 17:26:30.597802 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.596072    2572 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 31 17:26:30.597802 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.596075    2572 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 31 17:26:30.597802 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.596077    2572 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 31 17:26:30.597802 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.596080    2572 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 31 17:26:30.597802 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.596082    2572 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 31 17:26:30.597802 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.596085    2572 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 31 17:26:30.597802 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.596088    2572 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 31 17:26:30.598276 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.596091    2572 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 31 17:26:30.598276 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.596093    2572 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 31 17:26:30.598276 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.596096    2572 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 31 17:26:30.598276 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.596099    2572 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 31 17:26:30.598276 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.596102    2572 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 31 17:26:30.598276 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.596104    2572 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 31 17:26:30.598276 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.596107    2572 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 31 17:26:30.598276 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.596109    2572 feature_gate.go:386] unrecognized feature gate: Example2
Oct 31 17:26:30.598276 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.596112    2572 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 31 17:26:30.598276 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.596115    2572 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 31 17:26:30.598276 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.596119    2572 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 31 17:26:30.598276 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.596122    2572 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 31 17:26:30.598276 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.596124    2572 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 31 17:26:30.598276 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.596127    2572 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 31 17:26:30.598276 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.596130    2572 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 31 17:26:30.598276 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.596132    2572 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 31 17:26:30.598276 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.596135    2572 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 31 17:26:30.598276 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.596137    2572 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 31 17:26:30.598276 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.596140    2572 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 31 17:26:30.598741 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.596143    2572 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 31 17:26:30.598741 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.596145    2572 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 31 17:26:30.598741 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.596148    2572 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 31 17:26:30.598741 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.596150    2572 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 31 17:26:30.598741 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.596153    2572 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 31 17:26:30.598741 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.596155    2572 feature_gate.go:386] unrecognized feature gate: Example
Oct 31 17:26:30.598741 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.596158    2572 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 31 17:26:30.598741 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.596161    2572 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 31 17:26:30.598741 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.596163    2572 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 31 17:26:30.598741 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.596166    2572 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 31 17:26:30.598741 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.596168    2572 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 31 17:26:30.598741 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.596171    2572 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 31 17:26:30.598741 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.596173    2572 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 31 17:26:30.598741 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.596176    2572 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 31 17:26:30.598741 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.596179    2572 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 31 17:26:30.598741 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.596182    2572 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 31 17:26:30.598741 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.596185    2572 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 31 17:26:30.598741 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.596187    2572 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 31 17:26:30.598741 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.596190    2572 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 31 17:26:30.599198 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.596192    2572 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 31 17:26:30.599198 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.596197    2572 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 31 17:26:30.599198 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.596200    2572 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 31 17:26:30.599198 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.596204    2572 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 31 17:26:30.599198 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.596207    2572 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 31 17:26:30.599198 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.596210    2572 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 31 17:26:30.599198 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.596213    2572 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 31 17:26:30.599198 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.596216    2572 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 31 17:26:30.599198 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.596218    2572 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 31 17:26:30.599198 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.596221    2572 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 31 17:26:30.599198 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.596223    2572 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 31 17:26:30.599198 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.596226    2572 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 31 17:26:30.599198 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.596230    2572 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 31 17:26:30.599198 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.596232    2572 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 31 17:26:30.599198 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.596235    2572 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 31 17:26:30.599198 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.596237    2572 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 31 17:26:30.599198 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.596239    2572 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 31 17:26:30.599198 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.596242    2572 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 31 17:26:30.599198 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.596244    2572 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 31 17:26:30.599665 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.596247    2572 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 31 17:26:30.599665 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.596250    2572 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 31 17:26:30.599665 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.596252    2572 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 31 17:26:30.599665 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.596254    2572 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 31 17:26:30.599665 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.596257    2572 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 31 17:26:30.599665 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.596259    2572 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 31 17:26:30.599665 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.596262    2572 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 31 17:26:30.599665 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.596265    2572 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 31 17:26:30.599665 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.596267    2572 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 31 17:26:30.599665 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.596270    2572 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 31 17:26:30.599665 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.596273    2572 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 31 17:26:30.599665 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.596276    2572 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 31 17:26:30.599665 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.596278    2572 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 31 17:26:30.599665 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.596281    2572 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 31 17:26:30.599665 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.596756    2572 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 31 17:26:30.599665 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.596762    2572 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 31 17:26:30.599665 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.596765    2572 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 31 17:26:30.599665 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.596768    2572 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 31 17:26:30.599665 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.596771    2572 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 31 17:26:30.599665 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.596774    2572 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 31 17:26:30.600145 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.596777    2572 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 31 17:26:30.600145 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.596779    2572 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 31 17:26:30.600145 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.596782    2572 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 31 17:26:30.600145 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.596785    2572 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 31 17:26:30.600145 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.596788    2572 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 31 17:26:30.600145 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.596790    2572 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 31 17:26:30.600145 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.596793    2572 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 31 17:26:30.600145 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.596796    2572 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 31 17:26:30.600145 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.596798    2572 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 31 17:26:30.600145 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.596801    2572 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 31 17:26:30.600145 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.596804    2572 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 31 17:26:30.600145 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.596806    2572 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 31 17:26:30.600145 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.596809    2572 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 31 17:26:30.600145 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.596812    2572 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 31 17:26:30.600145 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.596815    2572 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 31 17:26:30.600145 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.596817    2572 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 31 17:26:30.600145 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.596820    2572 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 31 17:26:30.600145 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.596822    2572 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 31 17:26:30.600145 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.596825    2572 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 31 17:26:30.600145 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.596828    2572 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 31 17:26:30.600621 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.596830    2572 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 31 17:26:30.600621 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.596833    2572 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 31 17:26:30.600621 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.596836    2572 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 31 17:26:30.600621 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.596839    2572 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 31 17:26:30.600621 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.596842    2572 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 31 17:26:30.600621 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.596844    2572 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 31 17:26:30.600621 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.596847    2572 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 31 17:26:30.600621 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.596849    2572 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 31 17:26:30.600621 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.596852    2572 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 31 17:26:30.600621 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.596855    2572 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 31 17:26:30.600621 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.596858    2572 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 31 17:26:30.600621 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.596860    2572 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 31 17:26:30.600621 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.596863    2572 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 31 17:26:30.600621 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.596865    2572 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 31 17:26:30.600621 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.596868    2572 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 31 17:26:30.600621 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.596872    2572 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 31 17:26:30.600621 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.596876    2572 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 31 17:26:30.600621 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.596879    2572 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 31 17:26:30.600621 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.596882    2572 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 31 17:26:30.601084 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.596886    2572 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 31 17:26:30.601084 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.596890    2572 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 31 17:26:30.601084 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.596893    2572 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 31 17:26:30.601084 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.596895    2572 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 31 17:26:30.601084 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.596898    2572 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 31 17:26:30.601084 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.596901    2572 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 31 17:26:30.601084 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.596903    2572 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 31 17:26:30.601084 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.596906    2572 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 31 17:26:30.601084 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.596908    2572 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 31 17:26:30.601084 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.596911    2572 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 31 17:26:30.601084 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.596913    2572 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 31 17:26:30.601084 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.596916    2572 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 31 17:26:30.601084 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.596918    2572 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 31 17:26:30.601084 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.596921    2572 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 31 17:26:30.601084 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.596924    2572 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 31 17:26:30.601084 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.596927    2572 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 31 17:26:30.601084 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.596930    2572 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 31 17:26:30.601084 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.596933    2572 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 31 17:26:30.601505 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.596935    2572 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 31 17:26:30.601505 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.596938    2572 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 31 17:26:30.601505 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.596940    2572 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 31 17:26:30.601505 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.596943    2572 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 31 17:26:30.601505 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.596947    2572 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 31 17:26:30.601505 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.596949    2572 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 31 17:26:30.601505 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.596952    2572 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 31 17:26:30.601505 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.596955    2572 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 31 17:26:30.601505 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.596957    2572 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 31 17:26:30.601505 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.596960    2572 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 31 17:26:30.601505 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.596962    2572 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 31 17:26:30.601505 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.596965    2572 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 31 17:26:30.601505 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.596967    2572 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 31 17:26:30.601505 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.596970    2572 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 31 17:26:30.601505 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.596972    2572 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 31 17:26:30.601505 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.596975    2572 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 31 17:26:30.601505 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.596977    2572 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 31 17:26:30.601505 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.596980    2572 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 31 17:26:30.601505 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.596982    2572 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 31 17:26:30.602011 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.596985    2572 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 31 17:26:30.602011 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.596988    2572 feature_gate.go:386] unrecognized feature gate: Example2
Oct 31 17:26:30.602011 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.596990    2572 feature_gate.go:386] unrecognized feature gate: Example
Oct 31 17:26:30.602011 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.596993    2572 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 31 17:26:30.602011 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.596995    2572 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 31 17:26:30.602011 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.596998    2572 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 31 17:26:30.602011 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.597000    2572 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 31 17:26:30.602011 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.597003    2572 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 31 17:26:30.602011 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.597008    2572 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 31 17:26:30.602011 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.597011    2572 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 31 17:26:30.602011 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.597014    2572 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 31 17:26:30.602011 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.597017    2572 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 31 17:26:30.602011 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.597019    2572 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 31 17:26:30.602011 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.597022    2572 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 31 17:26:30.602011 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.597024    2572 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 31 17:26:30.602011 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.597027    2572 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 31 17:26:30.602011 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.597030    2572 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 31 17:26:30.602011 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.597032    2572 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 31 17:26:30.602011 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.597035    2572 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 31 17:26:30.602011 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.597037    2572 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 31 17:26:30.602493 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.597040    2572 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 31 17:26:30.602493 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.597043    2572 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 31 17:26:30.602493 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.597046    2572 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 31 17:26:30.602493 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.597048    2572 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 31 17:26:30.602493 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:30.598109    2572 flags.go:64] FLAG: --address="0.0.0.0"
Oct 31 17:26:30.602493 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:30.598119    2572 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Oct 31 17:26:30.602493 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:30.598126    2572 flags.go:64] FLAG: --anonymous-auth="true"
Oct 31 17:26:30.602493 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:30.598131    2572 flags.go:64] FLAG: --application-metrics-count-limit="100"
Oct 31 17:26:30.602493 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:30.598136    2572 flags.go:64] FLAG: --authentication-token-webhook="false"
Oct 31 17:26:30.602493 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:30.598140    2572 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Oct 31 17:26:30.602493 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:30.598144    2572 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Oct 31 17:26:30.602493 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:30.598149    2572 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Oct 31 17:26:30.602493 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:30.598152    2572 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Oct 31 17:26:30.602493 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:30.598155    2572 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Oct 31 17:26:30.602493 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:30.598159    2572 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Oct 31 17:26:30.602493 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:30.598162    2572 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Oct 31 17:26:30.602493 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:30.598165    2572 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Oct 31 17:26:30.602493 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:30.598168    2572 flags.go:64] FLAG: --cgroup-root=""
Oct 31 17:26:30.602493 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:30.598171    2572 flags.go:64] FLAG: --cgroups-per-qos="true"
Oct 31 17:26:30.602493 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:30.598176    2572 flags.go:64] FLAG: --client-ca-file=""
Oct 31 17:26:30.602493 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:30.598180    2572 flags.go:64] FLAG: --cloud-provider="external"
Oct 31 17:26:30.602493 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:30.598184    2572 flags.go:64] FLAG: --cluster-dns="[]"
Oct 31 17:26:30.602493 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:30.598188    2572 flags.go:64] FLAG: --cluster-domain=""
Oct 31 17:26:30.603052 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:30.598191    2572 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Oct 31 17:26:30.603052 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:30.598194    2572 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Oct 31 17:26:30.603052 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:30.598197    2572 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Oct 31 17:26:30.603052 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:30.598201    2572 flags.go:64] FLAG: --container-log-max-files="5"
Oct 31 17:26:30.603052 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:30.598205    2572 flags.go:64] FLAG: --container-log-max-size="10Mi"
Oct 31 17:26:30.603052 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:30.598208    2572 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Oct 31 17:26:30.603052 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:30.598211    2572 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Oct 31 17:26:30.603052 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:30.598215    2572 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Oct 31 17:26:30.603052 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:30.598218    2572 flags.go:64] FLAG: --contention-profiling="false"
Oct 31 17:26:30.603052 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:30.598221    2572 flags.go:64] FLAG: --cpu-cfs-quota="true"
Oct 31 17:26:30.603052 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:30.598224    2572 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Oct 31 17:26:30.603052 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:30.598227    2572 flags.go:64] FLAG: --cpu-manager-policy="none"
Oct 31 17:26:30.603052 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:30.598230    2572 flags.go:64] FLAG: --cpu-manager-policy-options=""
Oct 31 17:26:30.603052 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:30.598234    2572 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Oct 31 17:26:30.603052 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:30.598237    2572 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Oct 31 17:26:30.603052 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:30.598240    2572 flags.go:64] FLAG: --enable-debugging-handlers="true"
Oct 31 17:26:30.603052 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:30.598244    2572 flags.go:64] FLAG: --enable-load-reader="false"
Oct 31 17:26:30.603052 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:30.598247    2572 flags.go:64] FLAG: --enable-server="true"
Oct 31 17:26:30.603052 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:30.598250    2572 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Oct 31 17:26:30.603052 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:30.598255    2572 flags.go:64] FLAG: --event-burst="100"
Oct 31 17:26:30.603052 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:30.598259    2572 flags.go:64] FLAG: --event-qps="50"
Oct 31 17:26:30.603052 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:30.598262    2572 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Oct 31 17:26:30.603052 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:30.598265    2572 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Oct 31 17:26:30.603052 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:30.598268    2572 flags.go:64] FLAG: --eviction-hard=""
Oct 31 17:26:30.603635 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:30.598272    2572 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Oct 31 17:26:30.603635 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:30.598275    2572 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Oct 31 17:26:30.603635 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:30.598278    2572 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Oct 31 17:26:30.603635 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:30.598281    2572 flags.go:64] FLAG: --eviction-soft=""
Oct 31 17:26:30.603635 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:30.598286    2572 flags.go:64] FLAG: --eviction-soft-grace-period=""
Oct 31 17:26:30.603635 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:30.598290    2572 flags.go:64] FLAG: --exit-on-lock-contention="false"
Oct 31 17:26:30.603635 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:30.598293    2572 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Oct 31 17:26:30.603635 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:30.598296    2572 flags.go:64] FLAG: --experimental-mounter-path=""
Oct 31 17:26:30.603635 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:30.598300    2572 flags.go:64] FLAG: --fail-cgroupv1="true"
Oct 31 17:26:30.603635 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:30.598302    2572 flags.go:64] FLAG: --fail-swap-on="true"
Oct 31 17:26:30.603635 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:30.598306    2572 flags.go:64] FLAG: --feature-gates=""
Oct 31 17:26:30.603635 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:30.598310    2572 flags.go:64] FLAG: --file-check-frequency="20s"
Oct 31 17:26:30.603635 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:30.598314    2572 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Oct 31 17:26:30.603635 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:30.598317    2572 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Oct 31 17:26:30.603635 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:30.598320    2572 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Oct 31 17:26:30.603635 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:30.598323    2572 flags.go:64] FLAG: --healthz-port="10248"
Oct 31 17:26:30.603635 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:30.598327    2572 flags.go:64] FLAG: --help="false"
Oct 31 17:26:30.603635 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:30.598330    2572 flags.go:64] FLAG: --hostname-override="ip-10-0-138-17.ec2.internal"
Oct 31 17:26:30.603635 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:30.598333    2572 flags.go:64] FLAG: --housekeeping-interval="10s"
Oct 31 17:26:30.603635 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:30.598336    2572 flags.go:64] FLAG: --http-check-frequency="20s"
Oct 31 17:26:30.603635 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:30.598339    2572 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Oct 31 17:26:30.603635 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:30.598342    2572 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Oct 31 17:26:30.603635 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:30.598346    2572 flags.go:64] FLAG: --image-gc-high-threshold="85"
Oct 31 17:26:30.604204 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:30.598348    2572 flags.go:64] FLAG: --image-gc-low-threshold="80"
Oct 31 17:26:30.604204 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:30.598351    2572 flags.go:64] FLAG: --image-service-endpoint=""
Oct 31 17:26:30.604204 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:30.598354    2572 flags.go:64] FLAG: --kernel-memcg-notification="false"
Oct 31 17:26:30.604204 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:30.598357    2572 flags.go:64] FLAG: --kube-api-burst="100"
Oct 31 17:26:30.604204 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:30.598360    2572 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Oct 31 17:26:30.604204 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:30.598363    2572 flags.go:64] FLAG: --kube-api-qps="50"
Oct 31 17:26:30.604204 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:30.598366    2572 flags.go:64] FLAG: --kube-reserved=""
Oct 31 17:26:30.604204 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:30.598369    2572 flags.go:64] FLAG: --kube-reserved-cgroup=""
Oct 31 17:26:30.604204 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:30.598372    2572 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Oct 31 17:26:30.604204 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:30.598375    2572 flags.go:64] FLAG: --kubelet-cgroups=""
Oct 31 17:26:30.604204 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:30.598378    2572 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Oct 31 17:26:30.604204 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:30.598380    2572 flags.go:64] FLAG: --lock-file=""
Oct 31 17:26:30.604204 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:30.598383    2572 flags.go:64] FLAG: --log-cadvisor-usage="false"
Oct 31 17:26:30.604204 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:30.598388    2572 flags.go:64] FLAG: --log-flush-frequency="5s"
Oct 31 17:26:30.604204 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:30.598391    2572 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Oct 31 17:26:30.604204 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:30.598396    2572 flags.go:64] FLAG: --log-json-split-stream="false"
Oct 31 17:26:30.604204 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:30.598399    2572 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Oct 31 17:26:30.604204 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:30.598402    2572 flags.go:64] FLAG: --log-text-split-stream="false"
Oct 31 17:26:30.604204 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:30.598405    2572 flags.go:64] FLAG: --logging-format="text"
Oct 31 17:26:30.604204 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:30.598408    2572 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Oct 31 17:26:30.604204 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:30.598414    2572 flags.go:64] FLAG: --make-iptables-util-chains="true"
Oct 31 17:26:30.604204 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:30.598417    2572 flags.go:64] FLAG: --manifest-url=""
Oct 31 17:26:30.604204 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:30.598420    2572 flags.go:64] FLAG: --manifest-url-header=""
Oct 31 17:26:30.604204 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:30.598425    2572 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Oct 31 17:26:30.604204 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:30.598428    2572 flags.go:64] FLAG: --max-open-files="1000000"
Oct 31 17:26:30.604829 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:30.598431    2572 flags.go:64] FLAG: --max-pods="110"
Oct 31 17:26:30.604829 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:30.598434    2572 flags.go:64] FLAG: --maximum-dead-containers="-1"
Oct 31 17:26:30.604829 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:30.598437    2572 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Oct 31 17:26:30.604829 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:30.598440    2572 flags.go:64] FLAG: --memory-manager-policy="None"
Oct 31 17:26:30.604829 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:30.598443    2572 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Oct 31 17:26:30.604829 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:30.598446    2572 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Oct 31 17:26:30.604829 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:30.598449    2572 flags.go:64] FLAG: --node-ip="0.0.0.0"
Oct 31 17:26:30.604829 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:30.598452    2572 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Oct 31 17:26:30.604829 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:30.598459    2572 flags.go:64] FLAG: --node-status-max-images="50"
Oct 31 17:26:30.604829 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:30.598462    2572 flags.go:64] FLAG: --node-status-update-frequency="10s"
Oct 31 17:26:30.604829 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:30.598465    2572 flags.go:64] FLAG: --oom-score-adj="-999"
Oct 31 17:26:30.604829 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:30.598468    2572 flags.go:64] FLAG: --pod-cidr=""
Oct 31 17:26:30.604829 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:30.598471    2572 flags.go:64] FLAG: --pod-manifest-path=""
Oct 31 17:26:30.604829 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:30.598473    2572 flags.go:64] FLAG: --pod-max-pids="-1"
Oct 31 17:26:30.604829 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:30.598477    2572 flags.go:64] FLAG: --pods-per-core="0"
Oct 31 17:26:30.604829 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:30.598480    2572 flags.go:64] FLAG: --port="10250"
Oct 31 17:26:30.604829 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:30.598482    2572 flags.go:64] FLAG: --protect-kernel-defaults="false"
Oct 31 17:26:30.604829 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:30.598485    2572 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-02d787b147d9ce028"
Oct 31 17:26:30.604829 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:30.598489    2572 flags.go:64] FLAG: --qos-reserved=""
Oct 31 17:26:30.604829 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:30.598492    2572 flags.go:64] FLAG: --read-only-port="10255"
Oct 31 17:26:30.604829 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:30.598496    2572 flags.go:64] FLAG: --register-node="true"
Oct 31 17:26:30.604829 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:30.598499    2572 flags.go:64] FLAG: --register-with-taints=""
Oct 31 17:26:30.604829 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:30.598503    2572 flags.go:64] FLAG: --registry-burst="10"
Oct 31 17:26:30.604829 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:30.598505    2572 flags.go:64] FLAG: --registry-qps="5"
Oct 31 17:26:30.604829 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:30.598508    2572 flags.go:64] FLAG: --reserved-cpus=""
Oct 31 17:26:30.604829 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:30.598511    2572 flags.go:64] FLAG: --reserved-memory=""
Oct 31 17:26:30.605840 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:30.598515    2572 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Oct 31 17:26:30.605840 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:30.598519    2572 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Oct 31 17:26:30.605840 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:30.598522    2572 flags.go:64] FLAG: --rotate-certificates="false"
Oct 31 17:26:30.605840 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:30.598525    2572 flags.go:64] FLAG: --rotate-server-certificates="false"
Oct 31 17:26:30.605840 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:30.598528    2572 flags.go:64] FLAG: --runonce="false"
Oct 31 17:26:30.605840 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:30.598568    2572 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Oct 31 17:26:30.605840 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:30.598574    2572 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Oct 31 17:26:30.605840 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:30.598580    2572 flags.go:64] FLAG: --seccomp-default="false"
Oct 31 17:26:30.605840 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:30.598583    2572 flags.go:64] FLAG: --serialize-image-pulls="true"
Oct 31 17:26:30.605840 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:30.598587    2572 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Oct 31 17:26:30.605840 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:30.598591    2572 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Oct 31 17:26:30.605840 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:30.598595    2572 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Oct 31 17:26:30.605840 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:30.598599    2572 flags.go:64] FLAG: --storage-driver-password="root"
Oct 31 17:26:30.605840 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:30.598602    2572 flags.go:64] FLAG: --storage-driver-secure="false"
Oct 31 17:26:30.605840 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:30.598605    2572 flags.go:64] FLAG: --storage-driver-table="stats"
Oct 31 17:26:30.605840 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:30.598608    2572 flags.go:64] FLAG: --storage-driver-user="root"
Oct 31 17:26:30.605840 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:30.598611    2572 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Oct 31 17:26:30.605840 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:30.598615    2572 flags.go:64] FLAG: --sync-frequency="1m0s"
Oct 31 17:26:30.605840 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:30.598618    2572 flags.go:64] FLAG: --system-cgroups=""
Oct 31 17:26:30.605840 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:30.598621    2572 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Oct 31 17:26:30.605840 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:30.598631    2572 flags.go:64] FLAG: --system-reserved-cgroup=""
Oct 31 17:26:30.605840 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:30.598634    2572 flags.go:64] FLAG: --tls-cert-file=""
Oct 31 17:26:30.605840 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:30.598638    2572 flags.go:64] FLAG: --tls-cipher-suites="[]"
Oct 31 17:26:30.605840 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:30.598655    2572 flags.go:64] FLAG: --tls-min-version=""
Oct 31 17:26:30.605840 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:30.598658    2572 flags.go:64] FLAG: --tls-private-key-file=""
Oct 31 17:26:30.606936 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:30.598661    2572 flags.go:64] FLAG: --topology-manager-policy="none"
Oct 31 17:26:30.606936 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:30.598664    2572 flags.go:64] FLAG: --topology-manager-policy-options=""
Oct 31 17:26:30.606936 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:30.598668    2572 flags.go:64] FLAG: --topology-manager-scope="container"
Oct 31 17:26:30.606936 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:30.598671    2572 flags.go:64] FLAG: --v="2"
Oct 31 17:26:30.606936 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:30.598682    2572 flags.go:64] FLAG: --version="false"
Oct 31 17:26:30.606936 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:30.598687    2572 flags.go:64] FLAG: --vmodule=""
Oct 31 17:26:30.606936 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:30.598691    2572 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Oct 31 17:26:30.606936 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:30.598694    2572 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Oct 31 17:26:30.606936 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.598844    2572 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 31 17:26:30.606936 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.598850    2572 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 31 17:26:30.606936 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.598854    2572 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 31 17:26:30.606936 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.598857    2572 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 31 17:26:30.606936 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.598860    2572 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 31 17:26:30.606936 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.598863    2572 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 31 17:26:30.606936 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.598867    2572 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 31 17:26:30.606936 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.598870    2572 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 31 17:26:30.606936 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.598872    2572 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 31 17:26:30.606936 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.598875    2572 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 31 17:26:30.606936 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.598878    2572 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 31 17:26:30.606936 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.598880    2572 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 31 17:26:30.606936 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.598883    2572 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 31 17:26:30.606936 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.598885    2572 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 31 17:26:30.607895 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.598888    2572 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 31 17:26:30.607895 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.598891    2572 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 31 17:26:30.607895 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.598893    2572 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 31 17:26:30.607895 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.598896    2572 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 31 17:26:30.607895 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.598898    2572 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 31 17:26:30.607895 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.598901    2572 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 31 17:26:30.607895 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.598904    2572 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 31 17:26:30.607895 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.598906    2572 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 31 17:26:30.607895 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.598909    2572 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 31 17:26:30.607895 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.598911    2572 feature_gate.go:386] unrecognized feature gate: Example2
Oct 31 17:26:30.607895 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.598914    2572 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 31 17:26:30.607895 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.598917    2572 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 31 17:26:30.607895 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.598920    2572 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 31 17:26:30.607895 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.598922    2572 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 31 17:26:30.607895 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.598925    2572 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 31 17:26:30.607895 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.598927    2572 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 31 17:26:30.607895 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.598930    2572 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 31 17:26:30.607895 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.598932    2572 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 31 17:26:30.607895 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.598935    2572 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 31 17:26:30.607895 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.598938    2572 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 31 17:26:30.608752 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.598940    2572 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 31 17:26:30.608752 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.598946    2572 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 31 17:26:30.608752 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.598949    2572 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 31 17:26:30.608752 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.598953    2572 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 31 17:26:30.608752 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.598958    2572 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 31 17:26:30.608752 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.598962    2572 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 31 17:26:30.608752 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.598964    2572 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 31 17:26:30.608752 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.598967    2572 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 31 17:26:30.608752 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.598970    2572 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 31 17:26:30.608752 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.598973    2572 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 31 17:26:30.608752 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.598975    2572 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 31 17:26:30.608752 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.598978    2572 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 31 17:26:30.608752 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.598980    2572 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 31 17:26:30.608752 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.598983    2572 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 31 17:26:30.608752 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.598986    2572 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 31 17:26:30.608752 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.598988    2572 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 31 17:26:30.608752 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.598991    2572 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 31 17:26:30.608752 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.598994    2572 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 31 17:26:30.608752 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.598996    2572 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 31 17:26:30.609582 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.598999    2572 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 31 17:26:30.609582 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.599002    2572 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 31 17:26:30.609582 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.599005    2572 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 31 17:26:30.609582 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.599007    2572 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 31 17:26:30.609582 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.599010    2572 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 31 17:26:30.609582 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.599013    2572 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 31 17:26:30.609582 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.599015    2572 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 31 17:26:30.609582 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.599018    2572 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 31 17:26:30.609582 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.599021    2572 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 31 17:26:30.609582 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.599023    2572 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 31 17:26:30.609582 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.599026    2572 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 31 17:26:30.609582 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.599028    2572 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 31 17:26:30.609582 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.599031    2572 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 31 17:26:30.609582 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.599034    2572 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 31 17:26:30.609582 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.599037    2572 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 31 17:26:30.609582 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.599043    2572 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 31 17:26:30.609582 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.599046    2572 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 31 17:26:30.609582 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.599049    2572 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 31 17:26:30.609582 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.599052    2572 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 31 17:26:30.610435 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.599055    2572 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 31 17:26:30.610435 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.599057    2572 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 31 17:26:30.610435 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.599060    2572 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 31 17:26:30.610435 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.599062    2572 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 31 17:26:30.610435 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.599065    2572 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 31 17:26:30.610435 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.599068    2572 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 31 17:26:30.610435 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.599071    2572 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 31 17:26:30.610435 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.599073    2572 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 31 17:26:30.610435 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.599076    2572 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 31 17:26:30.610435 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.599079    2572 feature_gate.go:386] unrecognized feature gate: Example
Oct 31 17:26:30.610435 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.599081    2572 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 31 17:26:30.610435 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.599084    2572 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 31 17:26:30.610435 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.599086    2572 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 31 17:26:30.610435 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.599089    2572 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 31 17:26:30.610435 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.599092    2572 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 31 17:26:30.610435 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.599094    2572 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 31 17:26:30.610435 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.599097    2572 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 31 17:26:30.610435 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.599099    2572 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 31 17:26:30.610435 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.599102    2572 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 31 17:26:30.610435 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.599104    2572 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 31 17:26:30.611110 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.599107    2572 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 31 17:26:30.611110 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.599109    2572 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 31 17:26:30.611110 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.599112    2572 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 31 17:26:30.611110 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.599114    2572 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 31 17:26:30.611110 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.599117    2572 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 31 17:26:30.611110 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.599120    2572 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 31 17:26:30.611110 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.599123    2572 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 31 17:26:30.611110 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.599128    2572 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 31 17:26:30.611110 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.599133    2572 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 31 17:26:30.611110 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.599137    2572 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 31 17:26:30.611110 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.599140    2572 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 31 17:26:30.611110 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.599143    2572 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 31 17:26:30.611110 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.599146    2572 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 31 17:26:30.611110 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.599148    2572 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 31 17:26:30.611110 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:30.599178    2572 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]}
Oct 31 17:26:30.611505 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.599216    2572 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 31 17:26:30.611505 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.599222    2572 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 31 17:26:30.611505 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.599225    2572 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 31 17:26:30.611505 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.599228    2572 feature_gate.go:386] unrecognized feature gate: Example
Oct 31 17:26:30.611505 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.599231    2572 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 31 17:26:30.611505 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.599234    2572 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 31 17:26:30.611505 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.599237    2572 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 31 17:26:30.611505 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.599239    2572 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 31 17:26:30.611505 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.599242    2572 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 31 17:26:30.611505 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.599245    2572 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 31 17:26:30.611505 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.599247    2572 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 31 17:26:30.611505 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.599250    2572 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 31 17:26:30.611505 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.599253    2572 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 31 17:26:30.611505 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.599255    2572 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 31 17:26:30.611505 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.599258    2572 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 31 17:26:30.611505 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.599260    2572 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 31 17:26:30.611505 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.599263    2572 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 31 17:26:30.611505 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.599266    2572 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 31 17:26:30.611505 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.599269    2572 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 31 17:26:30.611505 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.599271    2572 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 31 17:26:30.612330 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.599274    2572 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 31 17:26:30.612330 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.599278    2572 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 31 17:26:30.612330 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.599282    2572 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 31 17:26:30.612330 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.599285    2572 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 31 17:26:30.612330 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.599287    2572 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 31 17:26:30.612330 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.599292    2572 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 31 17:26:30.612330 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.599294    2572 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 31 17:26:30.612330 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.599299    2572 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 31 17:26:30.612330 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.599301    2572 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 31 17:26:30.612330 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.599304    2572 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 31 17:26:30.612330 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.599307    2572 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 31 17:26:30.612330 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.599309    2572 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 31 17:26:30.612330 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.599312    2572 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 31 17:26:30.612330 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.599315    2572 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 31 17:26:30.612330 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.599317    2572 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 31 17:26:30.612330 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.599320    2572 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 31 17:26:30.612330 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.599322    2572 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 31 17:26:30.612330 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.599325    2572 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 31 17:26:30.612330 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.599328    2572 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 31 17:26:30.613138 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.599330    2572 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 31 17:26:30.613138 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.599333    2572 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 31 17:26:30.613138 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.599335    2572 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 31 17:26:30.613138 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.599338    2572 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 31 17:26:30.613138 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.599341    2572 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 31 17:26:30.613138 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.599343    2572 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 31 17:26:30.613138 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.599346    2572 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 31 17:26:30.613138 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.599349    2572 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 31 17:26:30.613138 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.599351    2572 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 31 17:26:30.613138 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.599354    2572 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 31 17:26:30.613138 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.599356    2572 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 31 17:26:30.613138 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.599359    2572 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 31 17:26:30.613138 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.599361    2572 feature_gate.go:386] unrecognized feature gate: Example2
Oct 31 17:26:30.613138 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.599364    2572 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 31 17:26:30.613138 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.599367    2572 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 31 17:26:30.613138 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.599369    2572 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 31 17:26:30.613138 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.599372    2572 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 31 17:26:30.613138 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.599374    2572 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 31 17:26:30.613138 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.599378    2572 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 31 17:26:30.613138 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.599381    2572 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 31 17:26:30.613941 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.599383    2572 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 31 17:26:30.613941 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.599386    2572 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 31 17:26:30.613941 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.599389    2572 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 31 17:26:30.613941 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.599392    2572 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 31 17:26:30.613941 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.599394    2572 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 31 17:26:30.613941 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.599397    2572 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 31 17:26:30.613941 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.599401    2572 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 31 17:26:30.613941 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.599404    2572 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 31 17:26:30.613941 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.599408    2572 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 31 17:26:30.613941 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.599410    2572 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 31 17:26:30.613941 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.599413    2572 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 31 17:26:30.613941 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.599415    2572 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 31 17:26:30.613941 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.599418    2572 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 31 17:26:30.613941 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.599421    2572 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 31 17:26:30.613941 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.599423    2572 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 31 17:26:30.613941 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.599426    2572 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 31 17:26:30.613941 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.599428    2572 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 31 17:26:30.613941 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.599431    2572 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 31 17:26:30.613941 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.599434    2572 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 31 17:26:30.614760 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.599436    2572 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 31 17:26:30.614760 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.599439    2572 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 31 17:26:30.614760 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.599441    2572 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 31 17:26:30.614760 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.599444    2572 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 31 17:26:30.614760 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.599447    2572 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 31 17:26:30.614760 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.599450    2572 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 31 17:26:30.614760 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.599452    2572 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 31 17:26:30.614760 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.599455    2572 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 31 17:26:30.614760 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.599457    2572 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 31 17:26:30.614760 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.599460    2572 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 31 17:26:30.614760 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.599463    2572 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 31 17:26:30.614760 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.599467    2572 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 31 17:26:30.614760 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.599469    2572 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 31 17:26:30.614760 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.599472    2572 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 31 17:26:30.614760 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.599474    2572 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 31 17:26:30.614760 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.599486    2572 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 31 17:26:30.614760 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.599489    2572 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 31 17:26:30.614760 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.599491    2572 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 31 17:26:30.614760 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.599494    2572 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 31 17:26:30.615539 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.599497    2572 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 31 17:26:30.615539 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.599500    2572 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 31 17:26:30.615539 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.599504    2572 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 31 17:26:30.615539 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.599506    2572 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 31 17:26:30.615539 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.599509    2572 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 31 17:26:30.615539 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.599512    2572 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 31 17:26:30.615539 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.599514    2572 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 31 17:26:30.615539 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.599517    2572 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 31 17:26:30.615539 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.599519    2572 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 31 17:26:30.615539 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:30.608434    2572 server.go:525] "Kubelet version" kubeletVersion="v1.35.9"
Oct 31 17:26:30.615539 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:30.608456    2572 server.go:527] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Oct 31 17:26:30.615539 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:30.608477    2572 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Oct 31 17:26:30.615539 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:30.608484    2572 watchdog_linux.go:138] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Oct 31 17:26:30.615539 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.608598    2572 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 31 17:26:30.615539 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.608606    2572 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 31 17:26:30.615539 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.608611    2572 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 31 17:26:30.615539 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.608615    2572 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 31 17:26:30.615539 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.608620    2572 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 31 17:26:30.615539 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.608624    2572 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 31 17:26:30.615539 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.608628    2572 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 31 17:26:30.616139 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.608633    2572 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 31 17:26:30.616139 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.608637    2572 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 31 17:26:30.616139 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.608662    2572 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 31 17:26:30.616139 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.608668    2572 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 31 17:26:30.616139 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.608672    2572 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 31 17:26:30.616139 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.608676    2572 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 31 17:26:30.616139 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.608681    2572 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 31 17:26:30.616139 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.608685    2572 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 31 17:26:30.616139 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.608689    2572 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 31 17:26:30.616139 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.608693    2572 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 31 17:26:30.616139 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.608698    2572 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 31 17:26:30.616139 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.608702    2572 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 31 17:26:30.616139 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.608706    2572 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 31 17:26:30.616139 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.608710    2572 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 31 17:26:30.616139 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.608715    2572 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 31 17:26:30.616139 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.608720    2572 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 31 17:26:30.616139 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.608725    2572 feature_gate.go:386] unrecognized feature gate: Example
Oct 31 17:26:30.616139 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.608729    2572 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 31 17:26:30.616139 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.608734    2572 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 31 17:26:30.616139 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.608738    2572 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 31 17:26:30.616639 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.608745    2572 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 31 17:26:30.616639 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.608751    2572 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 31 17:26:30.616639 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.608766    2572 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 31 17:26:30.616639 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.608770    2572 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 31 17:26:30.616639 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.608774    2572 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 31 17:26:30.616639 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.608778    2572 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 31 17:26:30.616639 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.608783    2572 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 31 17:26:30.616639 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.608787    2572 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 31 17:26:30.616639 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.608792    2572 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 31 17:26:30.616639 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.608796    2572 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 31 17:26:30.616639 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.608800    2572 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 31 17:26:30.616639 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.608805    2572 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 31 17:26:30.616639 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.608810    2572 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 31 17:26:30.616639 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.608814    2572 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 31 17:26:30.616639 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.608818    2572 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 31 17:26:30.616639 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.608823    2572 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 31 17:26:30.616639 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.608827    2572 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 31 17:26:30.616639 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.608831    2572 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 31 17:26:30.616639 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.608836    2572 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 31 17:26:30.617114 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.608840    2572 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 31 17:26:30.617114 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.608844    2572 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 31 17:26:30.617114 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.608848    2572 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 31 17:26:30.617114 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.608853    2572 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 31 17:26:30.617114 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.608857    2572 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 31 17:26:30.617114 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.608861    2572 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 31 17:26:30.617114 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.608866    2572 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 31 17:26:30.617114 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.608870    2572 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 31 17:26:30.617114 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.608875    2572 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 31 17:26:30.617114 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.608879    2572 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 31 17:26:30.617114 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.608884    2572 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 31 17:26:30.617114 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.608889    2572 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 31 17:26:30.617114 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.608893    2572 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 31 17:26:30.617114 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.608898    2572 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 31 17:26:30.617114 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.608902    2572 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 31 17:26:30.617114 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.608906    2572 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 31 17:26:30.617114 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.608921    2572 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 31 17:26:30.617114 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.608925    2572 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 31 17:26:30.617114 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.608930    2572 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 31 17:26:30.617578 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.608934    2572 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 31 17:26:30.617578 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.608938    2572 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 31 17:26:30.617578 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.608943    2572 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 31 17:26:30.617578 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.608947    2572 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 31 17:26:30.617578 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.608951    2572 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 31 17:26:30.617578 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.608955    2572 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 31 17:26:30.617578 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.608960    2572 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 31 17:26:30.617578 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.608964    2572 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 31 17:26:30.617578 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.608968    2572 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 31 17:26:30.617578 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.608972    2572 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 31 17:26:30.617578 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.608976    2572 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 31 17:26:30.617578 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.608981    2572 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 31 17:26:30.617578 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.608993    2572 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 31 17:26:30.617578 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.608997    2572 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 31 17:26:30.617578 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.609001    2572 feature_gate.go:386] unrecognized feature gate: Example2
Oct 31 17:26:30.617578 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.609006    2572 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 31 17:26:30.617578 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.609010    2572 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 31 17:26:30.617578 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.609014    2572 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 31 17:26:30.617578 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.609018    2572 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 31 17:26:30.617578 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.609022    2572 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 31 17:26:30.618073 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.609026    2572 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 31 17:26:30.618073 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.609031    2572 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 31 17:26:30.618073 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.609035    2572 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 31 17:26:30.618073 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.609039    2572 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 31 17:26:30.618073 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.609044    2572 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 31 17:26:30.618073 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.609048    2572 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 31 17:26:30.618073 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.609053    2572 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 31 17:26:30.618073 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.609057    2572 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 31 17:26:30.618073 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.609064    2572 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 31 17:26:30.618073 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.609069    2572 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 31 17:26:30.618073 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.609082    2572 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 31 17:26:30.618073 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.609087    2572 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 31 17:26:30.618073 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.609091    2572 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 31 17:26:30.618073 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.609095    2572 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 31 17:26:30.618073 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.609100    2572 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 31 17:26:30.618073 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.609104    2572 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 31 17:26:30.618073 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.609108    2572 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 31 17:26:30.618073 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.609113    2572 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 31 17:26:30.618073 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.609117    2572 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 31 17:26:30.618073 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.609121    2572 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 31 17:26:30.618598 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.609125    2572 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 31 17:26:30.618598 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:30.609169    2572 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]}
Oct 31 17:26:30.618598 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.609476    2572 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 31 17:26:30.618598 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.609484    2572 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 31 17:26:30.618598 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.609489    2572 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 31 17:26:30.618598 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.609495    2572 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 31 17:26:30.618598 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.609500    2572 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 31 17:26:30.618598 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.609504    2572 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 31 17:26:30.618598 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.609509    2572 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 31 17:26:30.618598 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.609513    2572 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 31 17:26:30.618598 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.609518    2572 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 31 17:26:30.618598 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.609522    2572 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 31 17:26:30.618598 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.609526    2572 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 31 17:26:30.618598 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.609530    2572 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 31 17:26:30.618598 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.609535    2572 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 31 17:26:30.618598 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.609539    2572 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 31 17:26:30.619003 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.609543    2572 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 31 17:26:30.619003 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.609547    2572 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 31 17:26:30.619003 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.609552    2572 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 31 17:26:30.619003 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.609557    2572 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 31 17:26:30.619003 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.609561    2572 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 31 17:26:30.619003 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.609565    2572 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 31 17:26:30.619003 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.609569    2572 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 31 17:26:30.619003 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.609581    2572 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 31 17:26:30.619003 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.609585    2572 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 31 17:26:30.619003 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.609589    2572 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 31 17:26:30.619003 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.609594    2572 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 31 17:26:30.619003 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.609598    2572 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 31 17:26:30.619003 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.609602    2572 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 31 17:26:30.619003 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.609605    2572 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 31 17:26:30.619003 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.609610    2572 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 31 17:26:30.619003 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.609614    2572 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 31 17:26:30.619003 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.609618    2572 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 31 17:26:30.619003 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.609622    2572 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 31 17:26:30.619003 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.609627    2572 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 31 17:26:30.619455 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.609631    2572 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 31 17:26:30.619455 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.609635    2572 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 31 17:26:30.619455 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.609639    2572 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 31 17:26:30.619455 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.609659    2572 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 31 17:26:30.619455 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.609664    2572 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 31 17:26:30.619455 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.609668    2572 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 31 17:26:30.619455 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.609672    2572 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 31 17:26:30.619455 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.609676    2572 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 31 17:26:30.619455 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.609680    2572 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 31 17:26:30.619455 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.609684    2572 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 31 17:26:30.619455 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.609689    2572 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 31 17:26:30.619455 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.609693    2572 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 31 17:26:30.619455 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.609698    2572 feature_gate.go:386] unrecognized feature gate: Example2
Oct 31 17:26:30.619455 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.609702    2572 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 31 17:26:30.619455 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.609706    2572 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 31 17:26:30.619455 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.609710    2572 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 31 17:26:30.619455 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.609714    2572 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 31 17:26:30.619455 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.609719    2572 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 31 17:26:30.619455 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.609722    2572 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 31 17:26:30.619455 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.609729    2572 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 31 17:26:30.619954 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.609736    2572 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 31 17:26:30.619954 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.609750    2572 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 31 17:26:30.619954 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.609755    2572 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 31 17:26:30.619954 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.609759    2572 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 31 17:26:30.619954 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.609764    2572 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 31 17:26:30.619954 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.609768    2572 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 31 17:26:30.619954 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.609773    2572 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 31 17:26:30.619954 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.609777    2572 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 31 17:26:30.619954 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.609782    2572 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 31 17:26:30.619954 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.609786    2572 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 31 17:26:30.619954 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.609790    2572 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 31 17:26:30.619954 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.609794    2572 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 31 17:26:30.619954 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.609798    2572 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 31 17:26:30.619954 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.609803    2572 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 31 17:26:30.619954 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.609807    2572 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 31 17:26:30.619954 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.609812    2572 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 31 17:26:30.619954 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.609816    2572 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 31 17:26:30.619954 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.609821    2572 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 31 17:26:30.619954 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.609825    2572 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 31 17:26:30.620408 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.609829    2572 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 31 17:26:30.620408 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.609833    2572 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 31 17:26:30.620408 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.609838    2572 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 31 17:26:30.620408 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.609842    2572 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 31 17:26:30.620408 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.609846    2572 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 31 17:26:30.620408 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.609851    2572 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 31 17:26:30.620408 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.609855    2572 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 31 17:26:30.620408 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.609859    2572 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 31 17:26:30.620408 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.609863    2572 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 31 17:26:30.620408 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.609868    2572 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 31 17:26:30.620408 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.609872    2572 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 31 17:26:30.620408 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.609876    2572 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 31 17:26:30.620408 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.609880    2572 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 31 17:26:30.620408 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.609884    2572 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 31 17:26:30.620408 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.609889    2572 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 31 17:26:30.620408 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.609900    2572 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 31 17:26:30.620408 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.609905    2572 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 31 17:26:30.620408 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.609909    2572 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 31 17:26:30.620408 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.609914    2572 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 31 17:26:30.620408 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.609919    2572 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 31 17:26:30.620907 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.609923    2572 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 31 17:26:30.620907 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.609927    2572 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 31 17:26:30.620907 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.609932    2572 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 31 17:26:30.620907 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.609936    2572 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 31 17:26:30.620907 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.609940    2572 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 31 17:26:30.620907 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.609944    2572 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 31 17:26:30.620907 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.609948    2572 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 31 17:26:30.620907 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.609952    2572 feature_gate.go:386] unrecognized feature gate: Example
Oct 31 17:26:30.620907 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.609957    2572 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 31 17:26:30.620907 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.609961    2572 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 31 17:26:30.620907 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.609965    2572 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 31 17:26:30.620907 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.609973    2572 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 31 17:26:30.620907 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.609977    2572 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 31 17:26:30.620907 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.609981    2572 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 31 17:26:30.620907 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:30.610021    2572 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]}
Oct 31 17:26:30.620907 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.610089    2572 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 31 17:26:30.621272 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.610096    2572 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 31 17:26:30.621272 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.610100    2572 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 31 17:26:30.621272 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.610105    2572 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 31 17:26:30.621272 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.610109    2572 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 31 17:26:30.621272 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.610113    2572 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 31 17:26:30.621272 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.610117    2572 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 31 17:26:30.621272 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.610121    2572 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 31 17:26:30.621272 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.610126    2572 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 31 17:26:30.621272 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.610130    2572 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 31 17:26:30.621272 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.610134    2572 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 31 17:26:30.621272 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.610139    2572 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 31 17:26:30.621272 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.610143    2572 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 31 17:26:30.621272 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.610155    2572 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 31 17:26:30.621272 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.610159    2572 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 31 17:26:30.621272 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.610163    2572 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 31 17:26:30.621272 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.610167    2572 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 31 17:26:30.621272 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.610172    2572 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 31 17:26:30.621272 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.610176    2572 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 31 17:26:30.621272 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.610180    2572 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 31 17:26:30.621733 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.610185    2572 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 31 17:26:30.621733 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.610189    2572 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 31 17:26:30.621733 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.610194    2572 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 31 17:26:30.621733 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.610198    2572 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 31 17:26:30.621733 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.610202    2572 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 31 17:26:30.621733 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.610206    2572 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 31 17:26:30.621733 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.610211    2572 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 31 17:26:30.621733 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.610215    2572 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 31 17:26:30.621733 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.610221    2572 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 31 17:26:30.621733 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.610226    2572 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 31 17:26:30.621733 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.610230    2572 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 31 17:26:30.621733 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.610234    2572 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 31 17:26:30.621733 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.610238    2572 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 31 17:26:30.621733 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.610243    2572 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 31 17:26:30.621733 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.610247    2572 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 31 17:26:30.621733 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.610251    2572 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 31 17:26:30.621733 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.610256    2572 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 31 17:26:30.621733 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.610260    2572 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 31 17:26:30.621733 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.610264    2572 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 31 17:26:30.621733 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.610268    2572 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 31 17:26:30.622333 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.610273    2572 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 31 17:26:30.622333 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.610277    2572 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 31 17:26:30.622333 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.610281    2572 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 31 17:26:30.622333 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.610285    2572 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 31 17:26:30.622333 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.610289    2572 feature_gate.go:386] unrecognized feature gate: Example
Oct 31 17:26:30.622333 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.610293    2572 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 31 17:26:30.622333 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.610305    2572 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 31 17:26:30.622333 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.610310    2572 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 31 17:26:30.622333 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.610314    2572 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 31 17:26:30.622333 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.610319    2572 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 31 17:26:30.622333 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.610323    2572 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 31 17:26:30.622333 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.610327    2572 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 31 17:26:30.622333 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.610331    2572 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 31 17:26:30.622333 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.610336    2572 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 31 17:26:30.622333 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.610340    2572 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 31 17:26:30.622333 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.610344    2572 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 31 17:26:30.622333 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.610348    2572 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 31 17:26:30.622333 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.610352    2572 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 31 17:26:30.622333 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.610356    2572 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 31 17:26:30.622934 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.610361    2572 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 31 17:26:30.622934 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.610367    2572 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 31 17:26:30.622934 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.610371    2572 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 31 17:26:30.622934 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.610375    2572 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 31 17:26:30.622934 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.610379    2572 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 31 17:26:30.622934 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.610383    2572 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 31 17:26:30.622934 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.610387    2572 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 31 17:26:30.622934 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.610393    2572 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 31 17:26:30.622934 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.610397    2572 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 31 17:26:30.622934 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.610401    2572 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 31 17:26:30.622934 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.610406    2572 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 31 17:26:30.622934 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.610410    2572 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 31 17:26:30.622934 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.610414    2572 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 31 17:26:30.622934 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.610419    2572 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 31 17:26:30.622934 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.610423    2572 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 31 17:26:30.622934 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.610427    2572 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 31 17:26:30.622934 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.610431    2572 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 31 17:26:30.622934 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.610435    2572 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 31 17:26:30.622934 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.610440    2572 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 31 17:26:30.623387 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.610443    2572 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 31 17:26:30.623387 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.610455    2572 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 31 17:26:30.623387 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.610459    2572 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 31 17:26:30.623387 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.610464    2572 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 31 17:26:30.623387 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.610468    2572 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 31 17:26:30.623387 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.610472    2572 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 31 17:26:30.623387 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.610476    2572 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 31 17:26:30.623387 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.610480    2572 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 31 17:26:30.623387 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.610485    2572 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 31 17:26:30.623387 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.610497    2572 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 31 17:26:30.623387 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.610501    2572 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 31 17:26:30.623387 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.610505    2572 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 31 17:26:30.623387 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.610509    2572 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 31 17:26:30.623387 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.610513    2572 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 31 17:26:30.623387 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.610519    2572 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 31 17:26:30.623387 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.610523    2572 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 31 17:26:30.623387 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.610528    2572 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 31 17:26:30.623387 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.610532    2572 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 31 17:26:30.623387 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.610536    2572 feature_gate.go:386] unrecognized feature gate: Example2
Oct 31 17:26:30.623387 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.610541    2572 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 31 17:26:30.623387 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.610545    2572 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 31 17:26:30.624134 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.610549    2572 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 31 17:26:30.624134 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.610553    2572 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 31 17:26:30.624134 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.610557    2572 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 31 17:26:30.624134 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.610562    2572 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 31 17:26:30.624134 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.610568    2572 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 31 17:26:30.624134 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.610576    2572 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 31 17:26:30.624134 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:30.610582    2572 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 31 17:26:30.624134 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:30.610685    2572 server.go:957] "Client rotation is on, will bootstrap in background"
Oct 31 17:26:30.624134 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:30.616456    2572 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Oct 31 17:26:30.624134 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:30.617567    2572 server.go:1014] "Starting client certificate rotation"
Oct 31 17:26:30.624134 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:30.617669    2572 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Oct 31 17:26:30.624134 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:30.617703    2572 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Oct 31 17:26:30.624134 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:30.619939    2572 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Oct 31 17:26:30.624134 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:30.623900    2572 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Oct 31 17:26:30.635427 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:30.635410    2572 log.go:25] "Validated CRI v1 runtime API"
Oct 31 17:26:30.640008 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:30.639984    2572 log.go:25] "Validated CRI v1 image API"
Oct 31 17:26:30.640917 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:30.640880    2572 server.go:1424] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Oct 31 17:26:30.645503 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:30.645479    2572 fs.go:135] Filesystem UUIDs: map[18b527d9-dc0e-4e18-a390-d46635bb98a9:/dev/nvme0n1p3 3a904ed3-640b-4191-a938-896bd1aad0bf:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2]
Oct 31 17:26:30.645590 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:30.645501    2572 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:24 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:26 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:32 fsType:tmpfs blockSize:0} composefs_0-34:{mountpoint:/ major:0 minor:34 fsType:overlay blockSize:0}]
Oct 31 17:26:30.650920 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:30.650804    2572 manager.go:217] Machine: {Timestamp:2026-10-31 17:26:30.649323533 +0000 UTC m=+0.365181214 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099111 MemoryCapacity:33164328960 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2ab9df76a2e3169ad6668cd72c4ff8 SystemUUID:ec2ab9df-76a2-e316-9ad6-668cd72c4ff8 BootID:4342a198-8e47-449d-b470-fc4bf58703b3 Filesystems:[{Device:composefs_0-34 DeviceMajor:0 DeviceMinor:34 Capacity:6422528 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:32 Capacity:16582164480 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:24 Capacity:16582164480 Type:vfs Inodes:4048380 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:26 Capacity:6632865792 Type:vfs Inodes:819200 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ff:de:a1:6e:7f Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ff:de:a1:6e:7f Speed:0 Mtu:9001} {Name:ovs-system MacAddress:aa:05:aa:52:60:51 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164328960 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Oct 31 17:26:30.651545 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:30.651533    2572 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Oct 31 17:26:30.651678 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:30.651660    2572 manager.go:233] Version: {KernelVersion:5.14.0-687.60.1.el9_8.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.8.20261023-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Oct 31 17:26:30.654521 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:30.654500    2572 container_manager_linux.go:275] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Oct 31 17:26:30.654721 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:30.654523    2572 container_manager_linux.go:280] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-138-17.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"/system.slice","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{},"system-reserved-compressible":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Oct 31 17:26:30.654780 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:30.654724    2572 topology_manager.go:143] "Creating topology manager with none policy"
Oct 31 17:26:30.654780 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:30.654737    2572 container_manager_linux.go:311] "Creating device plugin manager"
Oct 31 17:26:30.654837 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:30.654783    2572 manager.go:144] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Oct 31 17:26:30.654837 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:30.654807    2572 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Oct 31 17:26:30.656050 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:30.656040    2572 container_manager_linux.go:320] "Creating Dynamic Resource Allocation (DRA) manager"
Oct 31 17:26:30.660290 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:30.660278    2572 state_mem.go:41] "Initialized" logger="CPUManager state memory"
Oct 31 17:26:30.660418 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:30.660408    2572 server.go:1235] "Using root directory" path="/var/lib/kubelet"
Oct 31 17:26:30.661250 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:30.661239    2572 kubelet.go:493] "Attempting to sync node with API server"
Oct 31 17:26:30.661284 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:30.661254    2572 kubelet.go:394] "Adding static pod path" path="/etc/kubernetes/manifests"
Oct 31 17:26:30.661284 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:30.661264    2572 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Oct 31 17:26:30.661284 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:30.661274    2572 kubelet.go:405] "Adding apiserver pod source"
Oct 31 17:26:30.661284 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:30.661282    2572 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Oct 31 17:26:30.661802 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:30.661784    2572 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Oct 31 17:26:30.666034 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:30.666012    2572 kuberuntime_manager.go:304] "Container runtime initialized" containerRuntime="cri-o" version="1.35.10-3.rhaos4.22.git9383502.el9" apiVersion="v1"
Oct 31 17:26:30.672682 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:30.672666    2572 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Oct 31 17:26:30.673599 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:30.673587    2572 kubelet.go:963] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Oct 31 17:26:30.673639 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:30.673617    2572 kubelet.go:990] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Oct 31 17:26:30.673800 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:30.673789    2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Oct 31 17:26:30.673843 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:30.673805    2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Oct 31 17:26:30.673843 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:30.673812    2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Oct 31 17:26:30.673843 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:30.673817    2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Oct 31 17:26:30.673843 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:30.673823    2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Oct 31 17:26:30.673843 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:30.673829    2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Oct 31 17:26:30.674575 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:30.674567    2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Oct 31 17:26:30.674603 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:30.674577    2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Oct 31 17:26:30.674603 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:30.674584    2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Oct 31 17:26:30.674603 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:30.674590    2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Oct 31 17:26:30.674603 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:30.674599    2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Oct 31 17:26:30.674742 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:30.674607    2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Oct 31 17:26:30.676192 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:30.676182    2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Oct 31 17:26:30.676230 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:30.676193    2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Oct 31 17:26:30.680103 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:30.680090    2572 server.go:1263] "Started kubelet"
Oct 31 17:26:30.680204 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:30.680171    2572 server.go:182] "Starting to listen" address="0.0.0.0" port=10250
Oct 31 17:26:30.680300 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:30.680255    2572 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Oct 31 17:26:30.680348 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:30.680324    2572 server_v1.go:49] "podresources" method="list" useActivePods=true
Oct 31 17:26:30.681492 ip-10-0-138-17 systemd[1]: Started Kubernetes Kubelet.
Oct 31 17:26:30.681813 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:30.681784    2572 server.go:254] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Oct 31 17:26:30.682944 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:30.682924    2572 server.go:317] "Adding debug handlers to kubelet server"
Oct 31 17:26:30.687516 ip-10-0-138-17 kubenswrapper[2572]: E1031 17:26:30.687499    2572 kubelet.go:1679] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Oct 31 17:26:30.688561 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:30.688538    2572 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Oct 31 17:26:30.689867 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:30.689850    2572 fs_resource_analyzer.go:69] "Starting FS ResourceAnalyzer"
Oct 31 17:26:30.690016 ip-10-0-138-17 kubenswrapper[2572]: E1031 17:26:30.689956    2572 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-138-17.ec2.internal\" not found"
Oct 31 17:26:30.691666 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:30.690634    2572 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Oct 31 17:26:30.691666 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:30.690636    2572 volume_manager.go:309] "The desired_state_of_world populator starts"
Oct 31 17:26:30.691666 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:30.690689    2572 volume_manager.go:311] "Starting Kubelet Volume Manager"
Oct 31 17:26:30.691666 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:30.690803    2572 reconstruct.go:97] "Volume reconstruction finished"
Oct 31 17:26:30.691666 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:30.690811    2572 reconciler.go:29] "Reconciler: start to sync state"
Oct 31 17:26:30.691666 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:30.690910    2572 factory.go:55] Registering systemd factory
Oct 31 17:26:30.691666 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:30.690923    2572 factory.go:223] Registration of the systemd container factory successfully
Oct 31 17:26:30.691666 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:30.691111    2572 factory.go:153] Registering CRI-O factory
Oct 31 17:26:30.691666 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:30.691135    2572 factory.go:223] Registration of the crio container factory successfully
Oct 31 17:26:30.691666 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:30.691175    2572 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Oct 31 17:26:30.691666 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:30.691212    2572 factory.go:103] Registering Raw factory
Oct 31 17:26:30.691666 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:30.691227    2572 manager.go:1199] Started watching for new ooms in manager
Oct 31 17:26:30.692525 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:30.692508    2572 manager.go:319] Starting recovery of all containers
Oct 31 17:26:30.708073 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:30.708018    2572 manager.go:324] Recovery completed
Oct 31 17:26:30.708881 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:30.708859    2572 reflector.go:446] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Oct 31 17:26:30.711797 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:30.711781    2572 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 31 17:26:30.713979 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:30.713952    2572 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-138-17.ec2.internal" event="NodeHasSufficientMemory"
Oct 31 17:26:30.713979 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:30.713981    2572 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-138-17.ec2.internal" event="NodeHasNoDiskPressure"
Oct 31 17:26:30.714109 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:30.713992    2572 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-138-17.ec2.internal" event="NodeHasSufficientPID"
Oct 31 17:26:30.714557 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:30.714543    2572 cpu_manager.go:226] "Starting" policy="none"
Oct 31 17:26:30.714557 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:30.714553    2572 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 31 17:26:30.714557 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:30.714554    2572 cpu_manager.go:227] "Reconciling" reconcilePeriod="10s"
Oct 31 17:26:30.714804 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:30.714575    2572 state_mem.go:41] "Initialized" logger="CPUManager state checkpoint.CPUManager state memory"
Oct 31 17:26:30.715268 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:30.715207    2572 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-138-17.ec2.internal" event="NodeHasSufficientMemory"
Oct 31 17:26:30.715268 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:30.715240    2572 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-138-17.ec2.internal" event="NodeHasNoDiskPressure"
Oct 31 17:26:30.715268 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:30.715253    2572 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-138-17.ec2.internal" event="NodeHasSufficientPID"
Oct 31 17:26:30.716584 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:30.716543    2572 policy_none.go:50] "Start"
Oct 31 17:26:30.716584 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:30.716560    2572 memory_manager.go:187] "Starting memorymanager" policy="None"
Oct 31 17:26:30.716584 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:30.716569    2572 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Oct 31 17:26:30.716956 ip-10-0-138-17 kubenswrapper[2572]: E1031 17:26:30.716933    2572 controller.go:201] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-138-17.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Oct 31 17:26:30.717086 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:30.716935    2572 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-138-17.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Oct 31 17:26:30.718061 ip-10-0-138-17 kubenswrapper[2572]: E1031 17:26:30.716928    2572 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-17.ec2.internal.18e3ad4582a936df  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-17.ec2.internal,UID:,APIVersion:v1,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-138-17.ec2.internal,},FirstTimestamp:2026-10-31 17:26:30.680065759 +0000 UTC m=+0.395923440,LastTimestamp:2026-10-31 17:26:30.680065759 +0000 UTC m=+0.395923440,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-17.ec2.internal,}"
Oct 31 17:26:30.718352 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:30.718340    2572 policy_none.go:44] "Start"
Oct 31 17:26:30.722462 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:30.722444    2572 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-pw548"
Oct 31 17:26:30.728545 ip-10-0-138-17 kubenswrapper[2572]: E1031 17:26:30.728522    2572 reflector.go:204] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.Service"
Oct 31 17:26:30.728904 ip-10-0-138-17 kubenswrapper[2572]: E1031 17:26:30.728880    2572 reflector.go:204] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-138-17.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.Node"
Oct 31 17:26:30.728984 ip-10-0-138-17 kubenswrapper[2572]: E1031 17:26:30.728925    2572 reflector.go:204] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.CSIDriver"
Oct 31 17:26:30.729562 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:30.729546    2572 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-pw548"
Oct 31 17:26:30.771459 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:30.750695    2572 node_container_manager_linux.go:130] "Enforcing system reserved compressible on cgroup" cgroupName="/system.slice" limits={"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"}
Oct 31 17:26:30.771459 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:30.753499    2572 manager.go:341] "Starting Device Plugin manager"
Oct 31 17:26:30.771459 ip-10-0-138-17 kubenswrapper[2572]: E1031 17:26:30.753524    2572 manager.go:525] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Oct 31 17:26:30.771459 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:30.753535    2572 server.go:87] "Starting device plugin registration server"
Oct 31 17:26:30.771459 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:30.753798    2572 eviction_manager.go:194] "Eviction manager: starting control loop"
Oct 31 17:26:30.771459 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:30.753810    2572 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Oct 31 17:26:30.771459 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:30.753903    2572 plugin_watcher.go:53] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Oct 31 17:26:30.771459 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:30.753972    2572 plugin_manager.go:119] "The desired_state_of_world populator (plugin watcher) starts"
Oct 31 17:26:30.771459 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:30.753981    2572 plugin_manager.go:121] "Starting Kubelet Plugin Manager"
Oct 31 17:26:30.771459 ip-10-0-138-17 kubenswrapper[2572]: E1031 17:26:30.754464    2572 eviction_manager.go:272] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Oct 31 17:26:30.771459 ip-10-0-138-17 kubenswrapper[2572]: E1031 17:26:30.754526    2572 eviction_manager.go:297] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-138-17.ec2.internal\" not found"
Oct 31 17:26:30.771459 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:30.760848    2572 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Oct 31 17:26:30.771459 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:30.761930    2572 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Oct 31 17:26:30.771459 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:30.761954    2572 status_manager.go:249] "Starting to sync pod status with apiserver"
Oct 31 17:26:30.771459 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:30.761973    2572 kubelet.go:2521] "Starting kubelet main sync loop"
Oct 31 17:26:30.771459 ip-10-0-138-17 kubenswrapper[2572]: E1031 17:26:30.762010    2572 kubelet.go:2545] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Oct 31 17:26:30.773930 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:30.773917    2572 reflector.go:446] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 31 17:26:30.854402 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:30.854213    2572 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 31 17:26:30.855511 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:30.855488    2572 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-138-17.ec2.internal" event="NodeHasSufficientMemory"
Oct 31 17:26:30.855611 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:30.855526    2572 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-138-17.ec2.internal" event="NodeHasNoDiskPressure"
Oct 31 17:26:30.855611 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:30.855541    2572 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-138-17.ec2.internal" event="NodeHasSufficientPID"
Oct 31 17:26:30.855611 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:30.855572    2572 kubelet_node_status.go:77] "Attempting to register node" node="ip-10-0-138-17.ec2.internal"
Oct 31 17:26:30.862361 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:30.862337    2572 kubelet.go:2608] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-17.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-138-17.ec2.internal"]
Oct 31 17:26:30.862411 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:30.862399    2572 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 31 17:26:30.863269 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:30.863255    2572 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-138-17.ec2.internal" event="NodeHasSufficientMemory"
Oct 31 17:26:30.863351 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:30.863283    2572 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-138-17.ec2.internal" event="NodeHasNoDiskPressure"
Oct 31 17:26:30.863351 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:30.863293    2572 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-138-17.ec2.internal" event="NodeHasSufficientPID"
Oct 31 17:26:30.865442 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:30.865430    2572 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 31 17:26:30.865602 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:30.865588    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-17.ec2.internal"
Oct 31 17:26:30.865712 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:30.865615    2572 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 31 17:26:30.866499 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:30.866483    2572 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-138-17.ec2.internal" event="NodeHasSufficientMemory"
Oct 31 17:26:30.866499 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:30.866498    2572 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-138-17.ec2.internal" event="NodeHasSufficientMemory"
Oct 31 17:26:30.866657 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:30.866509    2572 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-138-17.ec2.internal" event="NodeHasNoDiskPressure"
Oct 31 17:26:30.866657 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:30.866517    2572 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-138-17.ec2.internal" event="NodeHasNoDiskPressure"
Oct 31 17:26:30.866657 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:30.866521    2572 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-138-17.ec2.internal" event="NodeHasSufficientPID"
Oct 31 17:26:30.866657 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:30.866527    2572 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-138-17.ec2.internal" event="NodeHasSufficientPID"
Oct 31 17:26:30.868589 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:30.868575    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-17.ec2.internal"
Oct 31 17:26:30.868637 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:30.868600    2572 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 31 17:26:30.869466 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:30.869447    2572 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-138-17.ec2.internal" event="NodeHasSufficientMemory"
Oct 31 17:26:30.869523 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:30.869469    2572 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-138-17.ec2.internal" event="NodeHasNoDiskPressure"
Oct 31 17:26:30.869523 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:30.869478    2572 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-138-17.ec2.internal" event="NodeHasSufficientPID"
Oct 31 17:26:30.872891 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:30.872877    2572 kubelet_node_status.go:80] "Successfully registered node" node="ip-10-0-138-17.ec2.internal"
Oct 31 17:26:30.872944 ip-10-0-138-17 kubenswrapper[2572]: E1031 17:26:30.872897    2572 kubelet_node_status.go:524] "Error updating node status, will retry" err="error getting node \"ip-10-0-138-17.ec2.internal\": node \"ip-10-0-138-17.ec2.internal\" not found"
Oct 31 17:26:30.899083 ip-10-0-138-17 kubenswrapper[2572]: E1031 17:26:30.899066    2572 kubelet.go:3364] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-17.ec2.internal\" not found" node="ip-10-0-138-17.ec2.internal"
Oct 31 17:26:30.901906 ip-10-0-138-17 kubenswrapper[2572]: E1031 17:26:30.901889    2572 kubelet.go:3364] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-17.ec2.internal\" not found" node="ip-10-0-138-17.ec2.internal"
Oct 31 17:26:30.908981 ip-10-0-138-17 kubenswrapper[2572]: E1031 17:26:30.908967    2572 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-138-17.ec2.internal\" not found"
Oct 31 17:26:30.991900 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:30.991875    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/e2864fcc74b4907ea642d1f1fb68b712-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-17.ec2.internal\" (UID: \"e2864fcc74b4907ea642d1f1fb68b712\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-17.ec2.internal"
Oct 31 17:26:30.992014 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:30.991906    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e2864fcc74b4907ea642d1f1fb68b712-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-17.ec2.internal\" (UID: \"e2864fcc74b4907ea642d1f1fb68b712\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-17.ec2.internal"
Oct 31 17:26:30.992014 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:30.991929    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/4b3b7d414562a81671be0e69748417db-config\") pod \"kube-apiserver-proxy-ip-10-0-138-17.ec2.internal\" (UID: \"4b3b7d414562a81671be0e69748417db\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-17.ec2.internal"
Oct 31 17:26:31.009166 ip-10-0-138-17 kubenswrapper[2572]: E1031 17:26:31.009146    2572 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-138-17.ec2.internal\" not found"
Oct 31 17:26:31.092085 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:31.092061    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/e2864fcc74b4907ea642d1f1fb68b712-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-17.ec2.internal\" (UID: \"e2864fcc74b4907ea642d1f1fb68b712\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-17.ec2.internal"
Oct 31 17:26:31.092176 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:31.092105    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e2864fcc74b4907ea642d1f1fb68b712-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-17.ec2.internal\" (UID: \"e2864fcc74b4907ea642d1f1fb68b712\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-17.ec2.internal"
Oct 31 17:26:31.092176 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:31.092123    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/4b3b7d414562a81671be0e69748417db-config\") pod \"kube-apiserver-proxy-ip-10-0-138-17.ec2.internal\" (UID: \"4b3b7d414562a81671be0e69748417db\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-17.ec2.internal"
Oct 31 17:26:31.092176 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:31.092120    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/e2864fcc74b4907ea642d1f1fb68b712-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-17.ec2.internal\" (UID: \"e2864fcc74b4907ea642d1f1fb68b712\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-17.ec2.internal"
Oct 31 17:26:31.092176 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:31.092138    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e2864fcc74b4907ea642d1f1fb68b712-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-17.ec2.internal\" (UID: \"e2864fcc74b4907ea642d1f1fb68b712\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-17.ec2.internal"
Oct 31 17:26:31.092176 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:31.092168    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/4b3b7d414562a81671be0e69748417db-config\") pod \"kube-apiserver-proxy-ip-10-0-138-17.ec2.internal\" (UID: \"4b3b7d414562a81671be0e69748417db\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-17.ec2.internal"
Oct 31 17:26:31.109575 ip-10-0-138-17 kubenswrapper[2572]: E1031 17:26:31.109531    2572 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-138-17.ec2.internal\" not found"
Oct 31 17:26:31.204328 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:31.204287    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-17.ec2.internal"
Oct 31 17:26:31.206448 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:31.206434    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-17.ec2.internal"
Oct 31 17:26:31.210442 ip-10-0-138-17 kubenswrapper[2572]: E1031 17:26:31.210425    2572 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-138-17.ec2.internal\" not found"
Oct 31 17:26:31.311349 ip-10-0-138-17 kubenswrapper[2572]: E1031 17:26:31.311310    2572 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-138-17.ec2.internal\" not found"
Oct 31 17:26:31.411803 ip-10-0-138-17 kubenswrapper[2572]: E1031 17:26:31.411725    2572 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-138-17.ec2.internal\" not found"
Oct 31 17:26:31.511950 ip-10-0-138-17 kubenswrapper[2572]: E1031 17:26:31.511900    2572 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-138-17.ec2.internal\" not found"
Oct 31 17:26:31.612936 ip-10-0-138-17 kubenswrapper[2572]: E1031 17:26:31.612905    2572 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-138-17.ec2.internal\" not found"
Oct 31 17:26:31.618481 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:31.618462    2572 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Oct 31 17:26:31.618634 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:31.618615    2572 reflector.go:578] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:161: Unexpected watch close - watch lasted less than a second and no items received"
Oct 31 17:26:31.714055 ip-10-0-138-17 kubenswrapper[2572]: E1031 17:26:31.713991    2572 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-138-17.ec2.internal\" not found"
Oct 31 17:26:31.735231 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:31.735168    2572 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-10-30 17:21:31 +0000 UTC" deadline="2028-07-27 21:56:36.217263946 +0000 UTC"
Oct 31 17:26:31.735231 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:31.735222    2572 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15244h30m4.482044334s"
Oct 31 17:26:31.814128 ip-10-0-138-17 kubenswrapper[2572]: E1031 17:26:31.814086    2572 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-138-17.ec2.internal\" not found"
Oct 31 17:26:31.855481 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:31.855457    2572 reflector.go:446] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 31 17:26:31.879224 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:31.879190    2572 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b3b7d414562a81671be0e69748417db.slice/crio-bb0a00d4ae5cd9e352236bf7586fda56ae4091a154dba55bc35b663ed7bc06ce WatchSource:0}: Error finding container bb0a00d4ae5cd9e352236bf7586fda56ae4091a154dba55bc35b663ed7bc06ce: Status 404 returned error can't find the container with id bb0a00d4ae5cd9e352236bf7586fda56ae4091a154dba55bc35b663ed7bc06ce
Oct 31 17:26:31.880937 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:31.880096    2572 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode2864fcc74b4907ea642d1f1fb68b712.slice/crio-e58c6a3710855022ae8b11167e0001480ccb26ed614ee6d6105468766fa9f00f WatchSource:0}: Error finding container e58c6a3710855022ae8b11167e0001480ccb26ed614ee6d6105468766fa9f00f: Status 404 returned error can't find the container with id e58c6a3710855022ae8b11167e0001480ccb26ed614ee6d6105468766fa9f00f
Oct 31 17:26:31.886322 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:31.886301    2572 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Oct 31 17:26:31.890544 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:31.890525    2572 kubelet.go:3368] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-17.ec2.internal"
Oct 31 17:26:31.916224 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:31.916205    2572 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Oct 31 17:26:31.918647 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:31.918633    2572 kubelet.go:3368] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-17.ec2.internal"
Oct 31 17:26:31.934769 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:31.934750    2572 reflector.go:446] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 31 17:26:31.939686 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:31.939670    2572 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Oct 31 17:26:32.245035 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:32.245000    2572 reflector.go:446] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 31 17:26:32.599981 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:32.599899    2572 reflector.go:446] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 31 17:26:32.663247 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:32.663203    2572 apiserver.go:52] "Watching apiserver"
Oct 31 17:26:32.690194 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:32.690159    2572 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Oct 31 17:26:32.712812 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:32.708218    2572 reflector.go:446] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Oct 31 17:26:32.712812 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:32.708807    2572 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-target-pqs8z","kube-system/global-pull-secret-syncer-qgtf4","openshift-dns/node-resolver-x25tg","openshift-multus/multus-9zs6c","openshift-network-operator/iptables-alerter-h8jzv","kube-system/kube-apiserver-proxy-ip-10-0-138-17.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ldjrw","openshift-cluster-node-tuning-operator/tuned-zm6cj","openshift-multus/multus-additional-cni-plugins-swb7n","openshift-ovn-kubernetes/ovnkube-node-v8sbm","kube-system/konnectivity-agent-vghkb","openshift-image-registry/node-ca-lcz9q","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-17.ec2.internal","openshift-multus/network-metrics-daemon-7j59v"]
Oct 31 17:26:32.712812 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:32.711541    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ldjrw"
Oct 31 17:26:32.713974 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:32.713952    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-vghkb"
Oct 31 17:26:32.716551 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:32.716528    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-x25tg"
Oct 31 17:26:32.719531 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:32.719513    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-9zs6c"
Oct 31 17:26:32.722761 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:32.721908    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-h8jzv"
Oct 31 17:26:32.724185 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:32.724166    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7j59v"
Oct 31 17:26:32.724299 ip-10-0-138-17 kubenswrapper[2572]: E1031 17:26:32.724240    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7j59v" podUID="449efcb2-6707-4809-b869-1bb477f6e6ae"
Oct 31 17:26:32.727320 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:32.726831    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-swb7n"
Oct 31 17:26:32.728803 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:32.728525    2572 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Oct 31 17:26:32.728803 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:32.728549    2572 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Oct 31 17:26:32.728803 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:32.728639    2572 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-9gvm6\""
Oct 31 17:26:32.728803 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:32.728742    2572 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Oct 31 17:26:32.729135 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:32.729089    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-zm6cj"
Oct 31 17:26:32.729631 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:32.729582    2572 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Oct 31 17:26:32.730613 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:32.730594    2572 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Oct 31 17:26:32.730724 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:32.730709    2572 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent-dockercfg-k6pvq\""
Oct 31 17:26:32.735192 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:32.735164    2572 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Oct 31 17:26:32.738489 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:32.738471    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qgtf4"
Oct 31 17:26:32.738589 ip-10-0-138-17 kubenswrapper[2572]: E1031 17:26:32.738564    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qgtf4" podUID="9179e3c5-ef52-4445-aec0-779c3e99cb07"
Oct 31 17:26:32.741385 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:32.741360    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-v8sbm"
Oct 31 17:26:32.743088 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:32.743065    2572 reflector.go:446] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Oct 31 17:26:32.743205 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:32.743136    2572 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-hztnv"
Oct 31 17:26:32.745779 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:32.745757    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pqs8z"
Oct 31 17:26:32.745863 ip-10-0-138-17 kubenswrapper[2572]: E1031 17:26:32.745834    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pqs8z" podUID="5d30d9b6-0431-47f2-b06c-8a03d4f59b97"
Oct 31 17:26:32.749527 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:32.747944    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-lcz9q"
Oct 31 17:26:32.767904 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:32.767855    2572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-17.ec2.internal" event={"ID":"4b3b7d414562a81671be0e69748417db","Type":"ContainerStarted","Data":"bb0a00d4ae5cd9e352236bf7586fda56ae4091a154dba55bc35b663ed7bc06ce"}
Oct 31 17:26:32.769567 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:32.769538    2572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-17.ec2.internal" event={"ID":"e2864fcc74b4907ea642d1f1fb68b712","Type":"ContainerStarted","Data":"e58c6a3710855022ae8b11167e0001480ccb26ed614ee6d6105468766fa9f00f"}
Oct 31 17:26:32.792934 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:32.792910    2572 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Oct 31 17:26:32.802860 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:32.802832    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/27af0f99-138f-42ac-89b9-9dfc4a522483-etc-kubernetes\") pod \"multus-9zs6c\" (UID: \"27af0f99-138f-42ac-89b9-9dfc4a522483\") " pod="openshift-multus/multus-9zs6c"
Oct 31 17:26:32.802990 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:32.802876    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ghqc6\" (UniqueName: \"kubernetes.io/projected/b1e258da-4619-478c-895a-041aa7eeafb6-kube-api-access-ghqc6\") pod \"iptables-alerter-h8jzv\" (UID: \"b1e258da-4619-478c-895a-041aa7eeafb6\") " pod="openshift-network-operator/iptables-alerter-h8jzv"
Oct 31 17:26:32.802990 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:32.802905    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fe1c5f7c-fdfd-40b9-bc0f-4e018779ee2b-system-cni-dir\") pod \"multus-additional-cni-plugins-swb7n\" (UID: \"fe1c5f7c-fdfd-40b9-bc0f-4e018779ee2b\") " pod="openshift-multus/multus-additional-cni-plugins-swb7n"
Oct 31 17:26:32.802990 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:32.802971    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/0c8a8a3b-14dd-45c9-b8fb-baf967142fd6-etc-modprobe-d\") pod \"tuned-zm6cj\" (UID: \"0c8a8a3b-14dd-45c9-b8fb-baf967142fd6\") " pod="openshift-cluster-node-tuning-operator/tuned-zm6cj"
Oct 31 17:26:32.803157 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:32.803007    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6tqgx\" (UniqueName: \"kubernetes.io/projected/c915138c-9050-4958-b442-fee1aca9b002-kube-api-access-6tqgx\") pod \"node-ca-lcz9q\" (UID: \"c915138c-9050-4958-b442-fee1aca9b002\") " pod="openshift-image-registry/node-ca-lcz9q"
Oct 31 17:26:32.803157 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:32.803049    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/27af0f99-138f-42ac-89b9-9dfc4a522483-multus-cni-dir\") pod \"multus-9zs6c\" (UID: \"27af0f99-138f-42ac-89b9-9dfc4a522483\") " pod="openshift-multus/multus-9zs6c"
Oct 31 17:26:32.803157 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:32.803079    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/fe1c5f7c-fdfd-40b9-bc0f-4e018779ee2b-cnibin\") pod \"multus-additional-cni-plugins-swb7n\" (UID: \"fe1c5f7c-fdfd-40b9-bc0f-4e018779ee2b\") " pod="openshift-multus/multus-additional-cni-plugins-swb7n"
Oct 31 17:26:32.803157 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:32.803103    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0c8a8a3b-14dd-45c9-b8fb-baf967142fd6-sys\") pod \"tuned-zm6cj\" (UID: \"0c8a8a3b-14dd-45c9-b8fb-baf967142fd6\") " pod="openshift-cluster-node-tuning-operator/tuned-zm6cj"
Oct 31 17:26:32.803157 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:32.803127    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/27af0f99-138f-42ac-89b9-9dfc4a522483-host-var-lib-kubelet\") pod \"multus-9zs6c\" (UID: \"27af0f99-138f-42ac-89b9-9dfc4a522483\") " pod="openshift-multus/multus-9zs6c"
Oct 31 17:26:32.803409 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:32.803180    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/27af0f99-138f-42ac-89b9-9dfc4a522483-multus-daemon-config\") pod \"multus-9zs6c\" (UID: \"27af0f99-138f-42ac-89b9-9dfc4a522483\") " pod="openshift-multus/multus-9zs6c"
Oct 31 17:26:32.803409 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:32.803208    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b1e258da-4619-478c-895a-041aa7eeafb6-host-slash\") pod \"iptables-alerter-h8jzv\" (UID: \"b1e258da-4619-478c-895a-041aa7eeafb6\") " pod="openshift-network-operator/iptables-alerter-h8jzv"
Oct 31 17:26:32.803409 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:32.803235    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0c8a8a3b-14dd-45c9-b8fb-baf967142fd6-var-lib-kubelet\") pod \"tuned-zm6cj\" (UID: \"0c8a8a3b-14dd-45c9-b8fb-baf967142fd6\") " pod="openshift-cluster-node-tuning-operator/tuned-zm6cj"
Oct 31 17:26:32.803409 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:32.803272    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/27af0f99-138f-42ac-89b9-9dfc4a522483-hostroot\") pod \"multus-9zs6c\" (UID: \"27af0f99-138f-42ac-89b9-9dfc4a522483\") " pod="openshift-multus/multus-9zs6c"
Oct 31 17:26:32.803409 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:32.803297    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/fe1c5f7c-fdfd-40b9-bc0f-4e018779ee2b-cni-binary-copy\") pod \"multus-additional-cni-plugins-swb7n\" (UID: \"fe1c5f7c-fdfd-40b9-bc0f-4e018779ee2b\") " pod="openshift-multus/multus-additional-cni-plugins-swb7n"
Oct 31 17:26:32.803409 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:32.803323    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/0c8a8a3b-14dd-45c9-b8fb-baf967142fd6-etc-sysconfig\") pod \"tuned-zm6cj\" (UID: \"0c8a8a3b-14dd-45c9-b8fb-baf967142fd6\") " pod="openshift-cluster-node-tuning-operator/tuned-zm6cj"
Oct 31 17:26:32.803409 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:32.803398    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ef27850a-20b3-4876-8330-57e8954f1a79-ovnkube-config\") pod \"ovnkube-node-v8sbm\" (UID: \"ef27850a-20b3-4876-8330-57e8954f1a79\") " pod="openshift-ovn-kubernetes/ovnkube-node-v8sbm"
Oct 31 17:26:32.803820 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:32.803423    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/c915138c-9050-4958-b442-fee1aca9b002-serviceca\") pod \"node-ca-lcz9q\" (UID: \"c915138c-9050-4958-b442-fee1aca9b002\") " pod="openshift-image-registry/node-ca-lcz9q"
Oct 31 17:26:32.803820 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:32.803448    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/eaed4088-d322-48ab-af04-3c9efdea4e73-tmp-dir\") pod \"node-resolver-x25tg\" (UID: \"eaed4088-d322-48ab-af04-3c9efdea4e73\") " pod="openshift-dns/node-resolver-x25tg"
Oct 31 17:26:32.803820 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:32.803478    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/27af0f99-138f-42ac-89b9-9dfc4a522483-cni-binary-copy\") pod \"multus-9zs6c\" (UID: \"27af0f99-138f-42ac-89b9-9dfc4a522483\") " pod="openshift-multus/multus-9zs6c"
Oct 31 17:26:32.803820 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:32.803507    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c6ctd\" (UniqueName: \"kubernetes.io/projected/27af0f99-138f-42ac-89b9-9dfc4a522483-kube-api-access-c6ctd\") pod \"multus-9zs6c\" (UID: \"27af0f99-138f-42ac-89b9-9dfc4a522483\") " pod="openshift-multus/multus-9zs6c"
Oct 31 17:26:32.803820 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:32.803533    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/88be474b-fd0b-4784-8f1c-2dc0bdfb2792-socket-dir\") pod \"aws-ebs-csi-driver-node-ldjrw\" (UID: \"88be474b-fd0b-4784-8f1c-2dc0bdfb2792\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ldjrw"
Oct 31 17:26:32.803820 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:32.803557    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0c8a8a3b-14dd-45c9-b8fb-baf967142fd6-tmp\") pod \"tuned-zm6cj\" (UID: \"0c8a8a3b-14dd-45c9-b8fb-baf967142fd6\") " pod="openshift-cluster-node-tuning-operator/tuned-zm6cj"
Oct 31 17:26:32.803820 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:32.803582    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ef27850a-20b3-4876-8330-57e8954f1a79-host-kubelet\") pod \"ovnkube-node-v8sbm\" (UID: \"ef27850a-20b3-4876-8330-57e8954f1a79\") " pod="openshift-ovn-kubernetes/ovnkube-node-v8sbm"
Oct 31 17:26:32.803820 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:32.803606    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ef27850a-20b3-4876-8330-57e8954f1a79-var-lib-openvswitch\") pod \"ovnkube-node-v8sbm\" (UID: \"ef27850a-20b3-4876-8330-57e8954f1a79\") " pod="openshift-ovn-kubernetes/ovnkube-node-v8sbm"
Oct 31 17:26:32.803820 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:32.803641    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ef27850a-20b3-4876-8330-57e8954f1a79-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-v8sbm\" (UID: \"ef27850a-20b3-4876-8330-57e8954f1a79\") " pod="openshift-ovn-kubernetes/ovnkube-node-v8sbm"
Oct 31 17:26:32.803820 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:32.803681    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2ln8r\" (UniqueName: \"kubernetes.io/projected/88be474b-fd0b-4784-8f1c-2dc0bdfb2792-kube-api-access-2ln8r\") pod \"aws-ebs-csi-driver-node-ldjrw\" (UID: \"88be474b-fd0b-4784-8f1c-2dc0bdfb2792\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ldjrw"
Oct 31 17:26:32.803820 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:32.803733    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/27af0f99-138f-42ac-89b9-9dfc4a522483-host-run-netns\") pod \"multus-9zs6c\" (UID: \"27af0f99-138f-42ac-89b9-9dfc4a522483\") " pod="openshift-multus/multus-9zs6c"
Oct 31 17:26:32.803820 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:32.803767    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/88be474b-fd0b-4784-8f1c-2dc0bdfb2792-kubelet-dir\") pod \"aws-ebs-csi-driver-node-ldjrw\" (UID: \"88be474b-fd0b-4784-8f1c-2dc0bdfb2792\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ldjrw"
Oct 31 17:26:32.804470 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:32.803874    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/fe1c5f7c-fdfd-40b9-bc0f-4e018779ee2b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-swb7n\" (UID: \"fe1c5f7c-fdfd-40b9-bc0f-4e018779ee2b\") " pod="openshift-multus/multus-additional-cni-plugins-swb7n"
Oct 31 17:26:32.804470 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:32.803902    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/449efcb2-6707-4809-b869-1bb477f6e6ae-metrics-certs\") pod \"network-metrics-daemon-7j59v\" (UID: \"449efcb2-6707-4809-b869-1bb477f6e6ae\") " pod="openshift-multus/network-metrics-daemon-7j59v"
Oct 31 17:26:32.804470 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:32.803926    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0c8a8a3b-14dd-45c9-b8fb-baf967142fd6-host\") pod \"tuned-zm6cj\" (UID: \"0c8a8a3b-14dd-45c9-b8fb-baf967142fd6\") " pod="openshift-cluster-node-tuning-operator/tuned-zm6cj"
Oct 31 17:26:32.804470 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:32.803951    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/27af0f99-138f-42ac-89b9-9dfc4a522483-system-cni-dir\") pod \"multus-9zs6c\" (UID: \"27af0f99-138f-42ac-89b9-9dfc4a522483\") " pod="openshift-multus/multus-9zs6c"
Oct 31 17:26:32.804470 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:32.803976    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/27af0f99-138f-42ac-89b9-9dfc4a522483-host-var-lib-cni-bin\") pod \"multus-9zs6c\" (UID: \"27af0f99-138f-42ac-89b9-9dfc4a522483\") " pod="openshift-multus/multus-9zs6c"
Oct 31 17:26:32.804470 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:32.804002    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ef27850a-20b3-4876-8330-57e8954f1a79-ovnkube-script-lib\") pod \"ovnkube-node-v8sbm\" (UID: \"ef27850a-20b3-4876-8330-57e8954f1a79\") " pod="openshift-ovn-kubernetes/ovnkube-node-v8sbm"
Oct 31 17:26:32.804470 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:32.804027    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/9179e3c5-ef52-4445-aec0-779c3e99cb07-dbus\") pod \"global-pull-secret-syncer-qgtf4\" (UID: \"9179e3c5-ef52-4445-aec0-779c3e99cb07\") " pod="kube-system/global-pull-secret-syncer-qgtf4"
Oct 31 17:26:32.804470 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:32.804054    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/fe1c5f7c-fdfd-40b9-bc0f-4e018779ee2b-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-swb7n\" (UID: \"fe1c5f7c-fdfd-40b9-bc0f-4e018779ee2b\") " pod="openshift-multus/multus-additional-cni-plugins-swb7n"
Oct 31 17:26:32.804470 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:32.804116    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b2ncn\" (UniqueName: \"kubernetes.io/projected/fe1c5f7c-fdfd-40b9-bc0f-4e018779ee2b-kube-api-access-b2ncn\") pod \"multus-additional-cni-plugins-swb7n\" (UID: \"fe1c5f7c-fdfd-40b9-bc0f-4e018779ee2b\") " pod="openshift-multus/multus-additional-cni-plugins-swb7n"
Oct 31 17:26:32.804470 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:32.804147    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ef27850a-20b3-4876-8330-57e8954f1a79-systemd-units\") pod \"ovnkube-node-v8sbm\" (UID: \"ef27850a-20b3-4876-8330-57e8954f1a79\") " pod="openshift-ovn-kubernetes/ovnkube-node-v8sbm"
Oct 31 17:26:32.804470 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:32.804173    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ef27850a-20b3-4876-8330-57e8954f1a79-host-run-netns\") pod \"ovnkube-node-v8sbm\" (UID: \"ef27850a-20b3-4876-8330-57e8954f1a79\") " pod="openshift-ovn-kubernetes/ovnkube-node-v8sbm"
Oct 31 17:26:32.804470 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:32.804200    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/88be474b-fd0b-4784-8f1c-2dc0bdfb2792-device-dir\") pod \"aws-ebs-csi-driver-node-ldjrw\" (UID: \"88be474b-fd0b-4784-8f1c-2dc0bdfb2792\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ldjrw"
Oct 31 17:26:32.804470 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:32.804228    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/27af0f99-138f-42ac-89b9-9dfc4a522483-host-run-k8s-cni-cncf-io\") pod \"multus-9zs6c\" (UID: \"27af0f99-138f-42ac-89b9-9dfc4a522483\") " pod="openshift-multus/multus-9zs6c"
Oct 31 17:26:32.804470 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:32.804255    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0c8a8a3b-14dd-45c9-b8fb-baf967142fd6-etc-kubernetes\") pod \"tuned-zm6cj\" (UID: \"0c8a8a3b-14dd-45c9-b8fb-baf967142fd6\") " pod="openshift-cluster-node-tuning-operator/tuned-zm6cj"
Oct 31 17:26:32.804470 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:32.804280    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/0c8a8a3b-14dd-45c9-b8fb-baf967142fd6-etc-systemd\") pod \"tuned-zm6cj\" (UID: \"0c8a8a3b-14dd-45c9-b8fb-baf967142fd6\") " pod="openshift-cluster-node-tuning-operator/tuned-zm6cj"
Oct 31 17:26:32.804470 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:32.804309    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ef27850a-20b3-4876-8330-57e8954f1a79-run-openvswitch\") pod \"ovnkube-node-v8sbm\" (UID: \"ef27850a-20b3-4876-8330-57e8954f1a79\") " pod="openshift-ovn-kubernetes/ovnkube-node-v8sbm"
Oct 31 17:26:32.805293 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:32.804335    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ef27850a-20b3-4876-8330-57e8954f1a79-host-cni-netd\") pod \"ovnkube-node-v8sbm\" (UID: \"ef27850a-20b3-4876-8330-57e8954f1a79\") " pod="openshift-ovn-kubernetes/ovnkube-node-v8sbm"
Oct 31 17:26:32.805293 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:32.804362    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/b1e258da-4619-478c-895a-041aa7eeafb6-iptables-alerter-script\") pod \"iptables-alerter-h8jzv\" (UID: \"b1e258da-4619-478c-895a-041aa7eeafb6\") " pod="openshift-network-operator/iptables-alerter-h8jzv"
Oct 31 17:26:32.805293 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:32.804395    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/88be474b-fd0b-4784-8f1c-2dc0bdfb2792-sys-fs\") pod \"aws-ebs-csi-driver-node-ldjrw\" (UID: \"88be474b-fd0b-4784-8f1c-2dc0bdfb2792\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ldjrw"
Oct 31 17:26:32.805293 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:32.804423    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/27af0f99-138f-42ac-89b9-9dfc4a522483-host-var-lib-cni-multus\") pod \"multus-9zs6c\" (UID: \"27af0f99-138f-42ac-89b9-9dfc4a522483\") " pod="openshift-multus/multus-9zs6c"
Oct 31 17:26:32.805293 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:32.804483    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/27af0f99-138f-42ac-89b9-9dfc4a522483-multus-conf-dir\") pod \"multus-9zs6c\" (UID: \"27af0f99-138f-42ac-89b9-9dfc4a522483\") " pod="openshift-multus/multus-9zs6c"
Oct 31 17:26:32.805293 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:32.804511    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/27af0f99-138f-42ac-89b9-9dfc4a522483-host-run-multus-certs\") pod \"multus-9zs6c\" (UID: \"27af0f99-138f-42ac-89b9-9dfc4a522483\") " pod="openshift-multus/multus-9zs6c"
Oct 31 17:26:32.805293 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:32.804545    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/9179e3c5-ef52-4445-aec0-779c3e99cb07-kubelet-config\") pod \"global-pull-secret-syncer-qgtf4\" (UID: \"9179e3c5-ef52-4445-aec0-779c3e99cb07\") " pod="kube-system/global-pull-secret-syncer-qgtf4"
Oct 31 17:26:32.805293 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:32.804682    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/0c8a8a3b-14dd-45c9-b8fb-baf967142fd6-etc-sysctl-d\") pod \"tuned-zm6cj\" (UID: \"0c8a8a3b-14dd-45c9-b8fb-baf967142fd6\") " pod="openshift-cluster-node-tuning-operator/tuned-zm6cj"
Oct 31 17:26:32.805293 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:32.804710    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/0c8a8a3b-14dd-45c9-b8fb-baf967142fd6-run\") pod \"tuned-zm6cj\" (UID: \"0c8a8a3b-14dd-45c9-b8fb-baf967142fd6\") " pod="openshift-cluster-node-tuning-operator/tuned-zm6cj"
Oct 31 17:26:32.805293 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:32.804777    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h4fpf\" (UniqueName: \"kubernetes.io/projected/0c8a8a3b-14dd-45c9-b8fb-baf967142fd6-kube-api-access-h4fpf\") pod \"tuned-zm6cj\" (UID: \"0c8a8a3b-14dd-45c9-b8fb-baf967142fd6\") " pod="openshift-cluster-node-tuning-operator/tuned-zm6cj"
Oct 31 17:26:32.805293 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:32.804805    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/fe1c5f7c-fdfd-40b9-bc0f-4e018779ee2b-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-swb7n\" (UID: \"fe1c5f7c-fdfd-40b9-bc0f-4e018779ee2b\") " pod="openshift-multus/multus-additional-cni-plugins-swb7n"
Oct 31 17:26:32.805293 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:32.804841    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9179e3c5-ef52-4445-aec0-779c3e99cb07-original-pull-secret\") pod \"global-pull-secret-syncer-qgtf4\" (UID: \"9179e3c5-ef52-4445-aec0-779c3e99cb07\") " pod="kube-system/global-pull-secret-syncer-qgtf4"
Oct 31 17:26:32.805293 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:32.804905    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c915138c-9050-4958-b442-fee1aca9b002-host\") pod \"node-ca-lcz9q\" (UID: \"c915138c-9050-4958-b442-fee1aca9b002\") " pod="openshift-image-registry/node-ca-lcz9q"
Oct 31 17:26:32.805293 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:32.804956    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/88be474b-fd0b-4784-8f1c-2dc0bdfb2792-registration-dir\") pod \"aws-ebs-csi-driver-node-ldjrw\" (UID: \"88be474b-fd0b-4784-8f1c-2dc0bdfb2792\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ldjrw"
Oct 31 17:26:32.805293 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:32.805018    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/eaed4088-d322-48ab-af04-3c9efdea4e73-hosts-file\") pod \"node-resolver-x25tg\" (UID: \"eaed4088-d322-48ab-af04-3c9efdea4e73\") " pod="openshift-dns/node-resolver-x25tg"
Oct 31 17:26:32.805293 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:32.805049    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q9ctx\" (UniqueName: \"kubernetes.io/projected/eaed4088-d322-48ab-af04-3c9efdea4e73-kube-api-access-q9ctx\") pod \"node-resolver-x25tg\" (UID: \"eaed4088-d322-48ab-af04-3c9efdea4e73\") " pod="openshift-dns/node-resolver-x25tg"
Oct 31 17:26:32.806120 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:32.805088    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-96ckd\" (UniqueName: \"kubernetes.io/projected/5d30d9b6-0431-47f2-b06c-8a03d4f59b97-kube-api-access-96ckd\") pod \"network-check-target-pqs8z\" (UID: \"5d30d9b6-0431-47f2-b06c-8a03d4f59b97\") " pod="openshift-network-diagnostics/network-check-target-pqs8z"
Oct 31 17:26:32.806120 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:32.805115    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ef27850a-20b3-4876-8330-57e8954f1a79-host-slash\") pod \"ovnkube-node-v8sbm\" (UID: \"ef27850a-20b3-4876-8330-57e8954f1a79\") " pod="openshift-ovn-kubernetes/ovnkube-node-v8sbm"
Oct 31 17:26:32.806120 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:32.805141    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ef27850a-20b3-4876-8330-57e8954f1a79-run-systemd\") pod \"ovnkube-node-v8sbm\" (UID: \"ef27850a-20b3-4876-8330-57e8954f1a79\") " pod="openshift-ovn-kubernetes/ovnkube-node-v8sbm"
Oct 31 17:26:32.806120 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:32.805169    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ef27850a-20b3-4876-8330-57e8954f1a79-etc-openvswitch\") pod \"ovnkube-node-v8sbm\" (UID: \"ef27850a-20b3-4876-8330-57e8954f1a79\") " pod="openshift-ovn-kubernetes/ovnkube-node-v8sbm"
Oct 31 17:26:32.806120 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:32.805244    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ef27850a-20b3-4876-8330-57e8954f1a79-node-log\") pod \"ovnkube-node-v8sbm\" (UID: \"ef27850a-20b3-4876-8330-57e8954f1a79\") " pod="openshift-ovn-kubernetes/ovnkube-node-v8sbm"
Oct 31 17:26:32.806120 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:32.805273    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ef27850a-20b3-4876-8330-57e8954f1a79-log-socket\") pod \"ovnkube-node-v8sbm\" (UID: \"ef27850a-20b3-4876-8330-57e8954f1a79\") " pod="openshift-ovn-kubernetes/ovnkube-node-v8sbm"
Oct 31 17:26:32.806120 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:32.805305    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cq4kh\" (UniqueName: \"kubernetes.io/projected/449efcb2-6707-4809-b869-1bb477f6e6ae-kube-api-access-cq4kh\") pod \"network-metrics-daemon-7j59v\" (UID: \"449efcb2-6707-4809-b869-1bb477f6e6ae\") " pod="openshift-multus/network-metrics-daemon-7j59v"
Oct 31 17:26:32.806120 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:32.805332    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0c8a8a3b-14dd-45c9-b8fb-baf967142fd6-lib-modules\") pod \"tuned-zm6cj\" (UID: \"0c8a8a3b-14dd-45c9-b8fb-baf967142fd6\") " pod="openshift-cluster-node-tuning-operator/tuned-zm6cj"
Oct 31 17:26:32.806120 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:32.805367    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/0c8a8a3b-14dd-45c9-b8fb-baf967142fd6-etc-tuned\") pod \"tuned-zm6cj\" (UID: \"0c8a8a3b-14dd-45c9-b8fb-baf967142fd6\") " pod="openshift-cluster-node-tuning-operator/tuned-zm6cj"
Oct 31 17:26:32.806120 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:32.805395    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ef27850a-20b3-4876-8330-57e8954f1a79-host-run-ovn-kubernetes\") pod \"ovnkube-node-v8sbm\" (UID: \"ef27850a-20b3-4876-8330-57e8954f1a79\") " pod="openshift-ovn-kubernetes/ovnkube-node-v8sbm"
Oct 31 17:26:32.806120 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:32.805422    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/86312227-efeb-4196-ab2d-3b4b03e5c50f-agent-certs\") pod \"konnectivity-agent-vghkb\" (UID: \"86312227-efeb-4196-ab2d-3b4b03e5c50f\") " pod="kube-system/konnectivity-agent-vghkb"
Oct 31 17:26:32.806120 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:32.805452    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/86312227-efeb-4196-ab2d-3b4b03e5c50f-konnectivity-ca\") pod \"konnectivity-agent-vghkb\" (UID: \"86312227-efeb-4196-ab2d-3b4b03e5c50f\") " pod="kube-system/konnectivity-agent-vghkb"
Oct 31 17:26:32.806120 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:32.805523    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/27af0f99-138f-42ac-89b9-9dfc4a522483-cnibin\") pod \"multus-9zs6c\" (UID: \"27af0f99-138f-42ac-89b9-9dfc4a522483\") " pod="openshift-multus/multus-9zs6c"
Oct 31 17:26:32.806120 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:32.805552    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ef27850a-20b3-4876-8330-57e8954f1a79-ovn-node-metrics-cert\") pod \"ovnkube-node-v8sbm\" (UID: \"ef27850a-20b3-4876-8330-57e8954f1a79\") " pod="openshift-ovn-kubernetes/ovnkube-node-v8sbm"
Oct 31 17:26:32.806120 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:32.805581    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-69jvk\" (UniqueName: \"kubernetes.io/projected/ef27850a-20b3-4876-8330-57e8954f1a79-kube-api-access-69jvk\") pod \"ovnkube-node-v8sbm\" (UID: \"ef27850a-20b3-4876-8330-57e8954f1a79\") " pod="openshift-ovn-kubernetes/ovnkube-node-v8sbm"
Oct 31 17:26:32.806120 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:32.805608    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/0c8a8a3b-14dd-45c9-b8fb-baf967142fd6-etc-sysctl-conf\") pod \"tuned-zm6cj\" (UID: \"0c8a8a3b-14dd-45c9-b8fb-baf967142fd6\") " pod="openshift-cluster-node-tuning-operator/tuned-zm6cj"
Oct 31 17:26:32.806870 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:32.805633    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ef27850a-20b3-4876-8330-57e8954f1a79-run-ovn\") pod \"ovnkube-node-v8sbm\" (UID: \"ef27850a-20b3-4876-8330-57e8954f1a79\") " pod="openshift-ovn-kubernetes/ovnkube-node-v8sbm"
Oct 31 17:26:32.806870 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:32.805659    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ef27850a-20b3-4876-8330-57e8954f1a79-host-cni-bin\") pod \"ovnkube-node-v8sbm\" (UID: \"ef27850a-20b3-4876-8330-57e8954f1a79\") " pod="openshift-ovn-kubernetes/ovnkube-node-v8sbm"
Oct 31 17:26:32.806870 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:32.805704    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/88be474b-fd0b-4784-8f1c-2dc0bdfb2792-etc-selinux\") pod \"aws-ebs-csi-driver-node-ldjrw\" (UID: \"88be474b-fd0b-4784-8f1c-2dc0bdfb2792\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ldjrw"
Oct 31 17:26:32.806870 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:32.805735    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/27af0f99-138f-42ac-89b9-9dfc4a522483-multus-socket-dir-parent\") pod \"multus-9zs6c\" (UID: \"27af0f99-138f-42ac-89b9-9dfc4a522483\") " pod="openshift-multus/multus-9zs6c"
Oct 31 17:26:32.806870 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:32.805767    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ef27850a-20b3-4876-8330-57e8954f1a79-env-overrides\") pod \"ovnkube-node-v8sbm\" (UID: \"ef27850a-20b3-4876-8330-57e8954f1a79\") " pod="openshift-ovn-kubernetes/ovnkube-node-v8sbm"
Oct 31 17:26:32.838107 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:32.838083    2572 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Oct 31 17:26:32.838254 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:32.838133    2572 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Oct 31 17:26:32.838424 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:32.838403    2572 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Oct 31 17:26:32.838521 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:32.838504    2572 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Oct 31 17:26:32.838654 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:32.838592    2572 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-5bhk8\""
Oct 31 17:26:32.838758 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:32.838653    2572 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Oct 31 17:26:32.838758 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:32.838679    2572 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Oct 31 17:26:32.838880 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:32.838790    2572 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Oct 31 17:26:32.838880 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:32.838842    2572 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Oct 31 17:26:32.838880 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:32.838864    2572 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Oct 31 17:26:32.838880 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:32.838876    2572 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Oct 31 17:26:32.838880 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:32.838880    2572 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Oct 31 17:26:32.839160 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:32.838909    2572 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Oct 31 17:26:32.839160 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:32.838911    2572 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Oct 31 17:26:32.839160 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:32.838933    2572 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Oct 31 17:26:32.839160 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:32.838938    2572 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-vvnlg\""
Oct 31 17:26:32.839160 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:32.838951    2572 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Oct 31 17:26:32.839160 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:32.838957    2572 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-xbzzg\""
Oct 31 17:26:32.839160 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:32.838990    2572 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Oct 31 17:26:32.839160 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:32.838993    2572 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-node-identity-dockercfg-x4c5q\""
Oct 31 17:26:32.839160 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:32.839006    2572 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Oct 31 17:26:32.839160 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:32.839021    2572 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Oct 31 17:26:32.839160 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:32.839034    2572 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Oct 31 17:26:32.839160 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:32.839058    2572 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Oct 31 17:26:32.839160 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:32.839063    2572 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Oct 31 17:26:32.839160 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:32.839080    2572 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-8d7mp\""
Oct 31 17:26:32.840237 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:32.840215    2572 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-g2t4b\""
Oct 31 17:26:32.840324 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:32.840257    2572 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-zv4z8\""
Oct 31 17:26:32.906783 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:32.906713    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/eaed4088-d322-48ab-af04-3c9efdea4e73-hosts-file\") pod \"node-resolver-x25tg\" (UID: \"eaed4088-d322-48ab-af04-3c9efdea4e73\") " pod="openshift-dns/node-resolver-x25tg"
Oct 31 17:26:32.906783 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:32.906747    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q9ctx\" (UniqueName: \"kubernetes.io/projected/eaed4088-d322-48ab-af04-3c9efdea4e73-kube-api-access-q9ctx\") pod \"node-resolver-x25tg\" (UID: \"eaed4088-d322-48ab-af04-3c9efdea4e73\") " pod="openshift-dns/node-resolver-x25tg"
Oct 31 17:26:32.906783 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:32.906781    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-96ckd\" (UniqueName: \"kubernetes.io/projected/5d30d9b6-0431-47f2-b06c-8a03d4f59b97-kube-api-access-96ckd\") pod \"network-check-target-pqs8z\" (UID: \"5d30d9b6-0431-47f2-b06c-8a03d4f59b97\") " pod="openshift-network-diagnostics/network-check-target-pqs8z"
Oct 31 17:26:32.907033 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:32.906803    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ef27850a-20b3-4876-8330-57e8954f1a79-host-slash\") pod \"ovnkube-node-v8sbm\" (UID: \"ef27850a-20b3-4876-8330-57e8954f1a79\") " pod="openshift-ovn-kubernetes/ovnkube-node-v8sbm"
Oct 31 17:26:32.907033 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:32.906854    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ef27850a-20b3-4876-8330-57e8954f1a79-host-slash\") pod \"ovnkube-node-v8sbm\" (UID: \"ef27850a-20b3-4876-8330-57e8954f1a79\") " pod="openshift-ovn-kubernetes/ovnkube-node-v8sbm"
Oct 31 17:26:32.907033 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:32.906886    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/eaed4088-d322-48ab-af04-3c9efdea4e73-hosts-file\") pod \"node-resolver-x25tg\" (UID: \"eaed4088-d322-48ab-af04-3c9efdea4e73\") " pod="openshift-dns/node-resolver-x25tg"
Oct 31 17:26:32.907033 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:32.907021    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ef27850a-20b3-4876-8330-57e8954f1a79-run-systemd\") pod \"ovnkube-node-v8sbm\" (UID: \"ef27850a-20b3-4876-8330-57e8954f1a79\") " pod="openshift-ovn-kubernetes/ovnkube-node-v8sbm"
Oct 31 17:26:32.907194 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:32.907048    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ef27850a-20b3-4876-8330-57e8954f1a79-etc-openvswitch\") pod \"ovnkube-node-v8sbm\" (UID: \"ef27850a-20b3-4876-8330-57e8954f1a79\") " pod="openshift-ovn-kubernetes/ovnkube-node-v8sbm"
Oct 31 17:26:32.907194 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:32.907068    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ef27850a-20b3-4876-8330-57e8954f1a79-node-log\") pod \"ovnkube-node-v8sbm\" (UID: \"ef27850a-20b3-4876-8330-57e8954f1a79\") " pod="openshift-ovn-kubernetes/ovnkube-node-v8sbm"
Oct 31 17:26:32.907194 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:32.907093    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ef27850a-20b3-4876-8330-57e8954f1a79-log-socket\") pod \"ovnkube-node-v8sbm\" (UID: \"ef27850a-20b3-4876-8330-57e8954f1a79\") " pod="openshift-ovn-kubernetes/ovnkube-node-v8sbm"
Oct 31 17:26:32.907194 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:32.907116    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cq4kh\" (UniqueName: \"kubernetes.io/projected/449efcb2-6707-4809-b869-1bb477f6e6ae-kube-api-access-cq4kh\") pod \"network-metrics-daemon-7j59v\" (UID: \"449efcb2-6707-4809-b869-1bb477f6e6ae\") " pod="openshift-multus/network-metrics-daemon-7j59v"
Oct 31 17:26:32.907194 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:32.907132    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ef27850a-20b3-4876-8330-57e8954f1a79-etc-openvswitch\") pod \"ovnkube-node-v8sbm\" (UID: \"ef27850a-20b3-4876-8330-57e8954f1a79\") " pod="openshift-ovn-kubernetes/ovnkube-node-v8sbm"
Oct 31 17:26:32.907194 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:32.907158    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ef27850a-20b3-4876-8330-57e8954f1a79-node-log\") pod \"ovnkube-node-v8sbm\" (UID: \"ef27850a-20b3-4876-8330-57e8954f1a79\") " pod="openshift-ovn-kubernetes/ovnkube-node-v8sbm"
Oct 31 17:26:32.907194 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:32.907176    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ef27850a-20b3-4876-8330-57e8954f1a79-run-systemd\") pod \"ovnkube-node-v8sbm\" (UID: \"ef27850a-20b3-4876-8330-57e8954f1a79\") " pod="openshift-ovn-kubernetes/ovnkube-node-v8sbm"
Oct 31 17:26:32.907194 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:32.907186    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0c8a8a3b-14dd-45c9-b8fb-baf967142fd6-lib-modules\") pod \"tuned-zm6cj\" (UID: \"0c8a8a3b-14dd-45c9-b8fb-baf967142fd6\") " pod="openshift-cluster-node-tuning-operator/tuned-zm6cj"
Oct 31 17:26:32.907451 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:32.907211    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/0c8a8a3b-14dd-45c9-b8fb-baf967142fd6-etc-tuned\") pod \"tuned-zm6cj\" (UID: \"0c8a8a3b-14dd-45c9-b8fb-baf967142fd6\") " pod="openshift-cluster-node-tuning-operator/tuned-zm6cj"
Oct 31 17:26:32.907451 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:32.907229    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ef27850a-20b3-4876-8330-57e8954f1a79-host-run-ovn-kubernetes\") pod \"ovnkube-node-v8sbm\" (UID: \"ef27850a-20b3-4876-8330-57e8954f1a79\") " pod="openshift-ovn-kubernetes/ovnkube-node-v8sbm"
Oct 31 17:26:32.907451 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:32.907245    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/86312227-efeb-4196-ab2d-3b4b03e5c50f-agent-certs\") pod \"konnectivity-agent-vghkb\" (UID: \"86312227-efeb-4196-ab2d-3b4b03e5c50f\") " pod="kube-system/konnectivity-agent-vghkb"
Oct 31 17:26:32.907451 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:32.907279    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0c8a8a3b-14dd-45c9-b8fb-baf967142fd6-lib-modules\") pod \"tuned-zm6cj\" (UID: \"0c8a8a3b-14dd-45c9-b8fb-baf967142fd6\") " pod="openshift-cluster-node-tuning-operator/tuned-zm6cj"
Oct 31 17:26:32.907451 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:32.907290    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/86312227-efeb-4196-ab2d-3b4b03e5c50f-konnectivity-ca\") pod \"konnectivity-agent-vghkb\" (UID: \"86312227-efeb-4196-ab2d-3b4b03e5c50f\") " pod="kube-system/konnectivity-agent-vghkb"
Oct 31 17:26:32.907451 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:32.907310    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/27af0f99-138f-42ac-89b9-9dfc4a522483-cnibin\") pod \"multus-9zs6c\" (UID: \"27af0f99-138f-42ac-89b9-9dfc4a522483\") " pod="openshift-multus/multus-9zs6c"
Oct 31 17:26:32.907451 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:32.907327    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ef27850a-20b3-4876-8330-57e8954f1a79-ovn-node-metrics-cert\") pod \"ovnkube-node-v8sbm\" (UID: \"ef27850a-20b3-4876-8330-57e8954f1a79\") " pod="openshift-ovn-kubernetes/ovnkube-node-v8sbm"
Oct 31 17:26:32.907451 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:32.907351    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-69jvk\" (UniqueName: \"kubernetes.io/projected/ef27850a-20b3-4876-8330-57e8954f1a79-kube-api-access-69jvk\") pod \"ovnkube-node-v8sbm\" (UID: \"ef27850a-20b3-4876-8330-57e8954f1a79\") " pod="openshift-ovn-kubernetes/ovnkube-node-v8sbm"
Oct 31 17:26:32.907451 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:32.907375    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/0c8a8a3b-14dd-45c9-b8fb-baf967142fd6-etc-sysctl-conf\") pod \"tuned-zm6cj\" (UID: \"0c8a8a3b-14dd-45c9-b8fb-baf967142fd6\") " pod="openshift-cluster-node-tuning-operator/tuned-zm6cj"
Oct 31 17:26:32.907451 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:32.907391    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ef27850a-20b3-4876-8330-57e8954f1a79-run-ovn\") pod \"ovnkube-node-v8sbm\" (UID: \"ef27850a-20b3-4876-8330-57e8954f1a79\") " pod="openshift-ovn-kubernetes/ovnkube-node-v8sbm"
Oct 31 17:26:32.907451 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:32.907410    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ef27850a-20b3-4876-8330-57e8954f1a79-host-cni-bin\") pod \"ovnkube-node-v8sbm\" (UID: \"ef27850a-20b3-4876-8330-57e8954f1a79\") " pod="openshift-ovn-kubernetes/ovnkube-node-v8sbm"
Oct 31 17:26:32.907451 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:32.907435    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/88be474b-fd0b-4784-8f1c-2dc0bdfb2792-etc-selinux\") pod \"aws-ebs-csi-driver-node-ldjrw\" (UID: \"88be474b-fd0b-4784-8f1c-2dc0bdfb2792\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ldjrw"
Oct 31 17:26:32.907923 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:32.907462    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/27af0f99-138f-42ac-89b9-9dfc4a522483-multus-socket-dir-parent\") pod \"multus-9zs6c\" (UID: \"27af0f99-138f-42ac-89b9-9dfc4a522483\") " pod="openshift-multus/multus-9zs6c"
Oct 31 17:26:32.907923 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:32.907482    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ef27850a-20b3-4876-8330-57e8954f1a79-env-overrides\") pod \"ovnkube-node-v8sbm\" (UID: \"ef27850a-20b3-4876-8330-57e8954f1a79\") " pod="openshift-ovn-kubernetes/ovnkube-node-v8sbm"
Oct 31 17:26:32.907923 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:32.907498    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/27af0f99-138f-42ac-89b9-9dfc4a522483-etc-kubernetes\") pod \"multus-9zs6c\" (UID: \"27af0f99-138f-42ac-89b9-9dfc4a522483\") " pod="openshift-multus/multus-9zs6c"
Oct 31 17:26:32.907923 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:32.907185    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ef27850a-20b3-4876-8330-57e8954f1a79-log-socket\") pod \"ovnkube-node-v8sbm\" (UID: \"ef27850a-20b3-4876-8330-57e8954f1a79\") " pod="openshift-ovn-kubernetes/ovnkube-node-v8sbm"
Oct 31 17:26:32.907923 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:32.907519    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ghqc6\" (UniqueName: \"kubernetes.io/projected/b1e258da-4619-478c-895a-041aa7eeafb6-kube-api-access-ghqc6\") pod \"iptables-alerter-h8jzv\" (UID: \"b1e258da-4619-478c-895a-041aa7eeafb6\") " pod="openshift-network-operator/iptables-alerter-h8jzv"
Oct 31 17:26:32.907923 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:32.907540    2572 swap_util.go:78] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Oct 31 17:26:32.907923 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:32.907570    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fe1c5f7c-fdfd-40b9-bc0f-4e018779ee2b-system-cni-dir\") pod \"multus-additional-cni-plugins-swb7n\" (UID: \"fe1c5f7c-fdfd-40b9-bc0f-4e018779ee2b\") " pod="openshift-multus/multus-additional-cni-plugins-swb7n"
Oct 31 17:26:32.907923 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:32.907599    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/0c8a8a3b-14dd-45c9-b8fb-baf967142fd6-etc-modprobe-d\") pod \"tuned-zm6cj\" (UID: \"0c8a8a3b-14dd-45c9-b8fb-baf967142fd6\") " pod="openshift-cluster-node-tuning-operator/tuned-zm6cj"
Oct 31 17:26:32.907923 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:32.907629    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6tqgx\" (UniqueName: \"kubernetes.io/projected/c915138c-9050-4958-b442-fee1aca9b002-kube-api-access-6tqgx\") pod \"node-ca-lcz9q\" (UID: \"c915138c-9050-4958-b442-fee1aca9b002\") " pod="openshift-image-registry/node-ca-lcz9q"
Oct 31 17:26:32.907923 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:32.907687    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/27af0f99-138f-42ac-89b9-9dfc4a522483-multus-cni-dir\") pod \"multus-9zs6c\" (UID: \"27af0f99-138f-42ac-89b9-9dfc4a522483\") " pod="openshift-multus/multus-9zs6c"
Oct 31 17:26:32.907923 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:32.907713    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/fe1c5f7c-fdfd-40b9-bc0f-4e018779ee2b-cnibin\") pod \"multus-additional-cni-plugins-swb7n\" (UID: \"fe1c5f7c-fdfd-40b9-bc0f-4e018779ee2b\") " pod="openshift-multus/multus-additional-cni-plugins-swb7n"
Oct 31 17:26:32.907923 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:32.907746    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0c8a8a3b-14dd-45c9-b8fb-baf967142fd6-sys\") pod \"tuned-zm6cj\" (UID: \"0c8a8a3b-14dd-45c9-b8fb-baf967142fd6\") " pod="openshift-cluster-node-tuning-operator/tuned-zm6cj"
Oct 31 17:26:32.907923 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:32.907783    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/27af0f99-138f-42ac-89b9-9dfc4a522483-host-var-lib-kubelet\") pod \"multus-9zs6c\" (UID: \"27af0f99-138f-42ac-89b9-9dfc4a522483\") " pod="openshift-multus/multus-9zs6c"
Oct 31 17:26:32.907923 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:32.907794    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/27af0f99-138f-42ac-89b9-9dfc4a522483-cnibin\") pod \"multus-9zs6c\" (UID: \"27af0f99-138f-42ac-89b9-9dfc4a522483\") " pod="openshift-multus/multus-9zs6c"
Oct 31 17:26:32.907923 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:32.907810    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/27af0f99-138f-42ac-89b9-9dfc4a522483-multus-daemon-config\") pod \"multus-9zs6c\" (UID: \"27af0f99-138f-42ac-89b9-9dfc4a522483\") " pod="openshift-multus/multus-9zs6c"
Oct 31 17:26:32.907923 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:32.907829    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/0c8a8a3b-14dd-45c9-b8fb-baf967142fd6-etc-modprobe-d\") pod \"tuned-zm6cj\" (UID: \"0c8a8a3b-14dd-45c9-b8fb-baf967142fd6\") " pod="openshift-cluster-node-tuning-operator/tuned-zm6cj"
Oct 31 17:26:32.908587 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:32.908021    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/27af0f99-138f-42ac-89b9-9dfc4a522483-multus-cni-dir\") pod \"multus-9zs6c\" (UID: \"27af0f99-138f-42ac-89b9-9dfc4a522483\") " pod="openshift-multus/multus-9zs6c"
Oct 31 17:26:32.908587 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:32.908076    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/fe1c5f7c-fdfd-40b9-bc0f-4e018779ee2b-cnibin\") pod \"multus-additional-cni-plugins-swb7n\" (UID: \"fe1c5f7c-fdfd-40b9-bc0f-4e018779ee2b\") " pod="openshift-multus/multus-additional-cni-plugins-swb7n"
Oct 31 17:26:32.908587 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:32.908117    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fe1c5f7c-fdfd-40b9-bc0f-4e018779ee2b-system-cni-dir\") pod \"multus-additional-cni-plugins-swb7n\" (UID: \"fe1c5f7c-fdfd-40b9-bc0f-4e018779ee2b\") " pod="openshift-multus/multus-additional-cni-plugins-swb7n"
Oct 31 17:26:32.908587 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:32.908129    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0c8a8a3b-14dd-45c9-b8fb-baf967142fd6-sys\") pod \"tuned-zm6cj\" (UID: \"0c8a8a3b-14dd-45c9-b8fb-baf967142fd6\") " pod="openshift-cluster-node-tuning-operator/tuned-zm6cj"
Oct 31 17:26:32.908587 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:32.908167    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/27af0f99-138f-42ac-89b9-9dfc4a522483-host-var-lib-kubelet\") pod \"multus-9zs6c\" (UID: \"27af0f99-138f-42ac-89b9-9dfc4a522483\") " pod="openshift-multus/multus-9zs6c"
Oct 31 17:26:32.908863 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:32.908622    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ef27850a-20b3-4876-8330-57e8954f1a79-host-run-ovn-kubernetes\") pod \"ovnkube-node-v8sbm\" (UID: \"ef27850a-20b3-4876-8330-57e8954f1a79\") " pod="openshift-ovn-kubernetes/ovnkube-node-v8sbm"
Oct 31 17:26:32.908863 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:32.908694    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/27af0f99-138f-42ac-89b9-9dfc4a522483-multus-socket-dir-parent\") pod \"multus-9zs6c\" (UID: \"27af0f99-138f-42ac-89b9-9dfc4a522483\") " pod="openshift-multus/multus-9zs6c"
Oct 31 17:26:32.908863 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:32.908754    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/27af0f99-138f-42ac-89b9-9dfc4a522483-etc-kubernetes\") pod \"multus-9zs6c\" (UID: \"27af0f99-138f-42ac-89b9-9dfc4a522483\") " pod="openshift-multus/multus-9zs6c"
Oct 31 17:26:32.908863 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:32.908817    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b1e258da-4619-478c-895a-041aa7eeafb6-host-slash\") pod \"iptables-alerter-h8jzv\" (UID: \"b1e258da-4619-478c-895a-041aa7eeafb6\") " pod="openshift-network-operator/iptables-alerter-h8jzv"
Oct 31 17:26:32.908863 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:32.908836    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/0c8a8a3b-14dd-45c9-b8fb-baf967142fd6-etc-sysctl-conf\") pod \"tuned-zm6cj\" (UID: \"0c8a8a3b-14dd-45c9-b8fb-baf967142fd6\") " pod="openshift-cluster-node-tuning-operator/tuned-zm6cj"
Oct 31 17:26:32.908863 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:32.908859    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0c8a8a3b-14dd-45c9-b8fb-baf967142fd6-var-lib-kubelet\") pod \"tuned-zm6cj\" (UID: \"0c8a8a3b-14dd-45c9-b8fb-baf967142fd6\") " pod="openshift-cluster-node-tuning-operator/tuned-zm6cj"
Oct 31 17:26:32.909162 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:32.908884    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/27af0f99-138f-42ac-89b9-9dfc4a522483-hostroot\") pod \"multus-9zs6c\" (UID: \"27af0f99-138f-42ac-89b9-9dfc4a522483\") " pod="openshift-multus/multus-9zs6c"
Oct 31 17:26:32.909162 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:32.908891    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ef27850a-20b3-4876-8330-57e8954f1a79-run-ovn\") pod \"ovnkube-node-v8sbm\" (UID: \"ef27850a-20b3-4876-8330-57e8954f1a79\") " pod="openshift-ovn-kubernetes/ovnkube-node-v8sbm"
Oct 31 17:26:32.909162 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:32.908910    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/fe1c5f7c-fdfd-40b9-bc0f-4e018779ee2b-cni-binary-copy\") pod \"multus-additional-cni-plugins-swb7n\" (UID: \"fe1c5f7c-fdfd-40b9-bc0f-4e018779ee2b\") " pod="openshift-multus/multus-additional-cni-plugins-swb7n"
Oct 31 17:26:32.909162 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:32.908939    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/0c8a8a3b-14dd-45c9-b8fb-baf967142fd6-etc-sysconfig\") pod \"tuned-zm6cj\" (UID: \"0c8a8a3b-14dd-45c9-b8fb-baf967142fd6\") " pod="openshift-cluster-node-tuning-operator/tuned-zm6cj"
Oct 31 17:26:32.909162 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:32.908967    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ef27850a-20b3-4876-8330-57e8954f1a79-ovnkube-config\") pod \"ovnkube-node-v8sbm\" (UID: \"ef27850a-20b3-4876-8330-57e8954f1a79\") " pod="openshift-ovn-kubernetes/ovnkube-node-v8sbm"
Oct 31 17:26:32.909162 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:32.908990    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/c915138c-9050-4958-b442-fee1aca9b002-serviceca\") pod \"node-ca-lcz9q\" (UID: \"c915138c-9050-4958-b442-fee1aca9b002\") " pod="openshift-image-registry/node-ca-lcz9q"
Oct 31 17:26:32.909162 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:32.909012    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/eaed4088-d322-48ab-af04-3c9efdea4e73-tmp-dir\") pod \"node-resolver-x25tg\" (UID: \"eaed4088-d322-48ab-af04-3c9efdea4e73\") " pod="openshift-dns/node-resolver-x25tg"
Oct 31 17:26:32.909162 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:32.909020    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/88be474b-fd0b-4784-8f1c-2dc0bdfb2792-etc-selinux\") pod \"aws-ebs-csi-driver-node-ldjrw\" (UID: \"88be474b-fd0b-4784-8f1c-2dc0bdfb2792\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ldjrw"
Oct 31 17:26:32.909162 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:32.909036    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/27af0f99-138f-42ac-89b9-9dfc4a522483-cni-binary-copy\") pod \"multus-9zs6c\" (UID: \"27af0f99-138f-42ac-89b9-9dfc4a522483\") " pod="openshift-multus/multus-9zs6c"
Oct 31 17:26:32.909162 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:32.909062    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c6ctd\" (UniqueName: \"kubernetes.io/projected/27af0f99-138f-42ac-89b9-9dfc4a522483-kube-api-access-c6ctd\") pod \"multus-9zs6c\" (UID: \"27af0f99-138f-42ac-89b9-9dfc4a522483\") " pod="openshift-multus/multus-9zs6c"
Oct 31 17:26:32.909162 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:32.909083    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b1e258da-4619-478c-895a-041aa7eeafb6-host-slash\") pod \"iptables-alerter-h8jzv\" (UID: \"b1e258da-4619-478c-895a-041aa7eeafb6\") " pod="openshift-network-operator/iptables-alerter-h8jzv"
Oct 31 17:26:32.909162 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:32.909091    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/88be474b-fd0b-4784-8f1c-2dc0bdfb2792-socket-dir\") pod \"aws-ebs-csi-driver-node-ldjrw\" (UID: \"88be474b-fd0b-4784-8f1c-2dc0bdfb2792\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ldjrw"
Oct 31 17:26:32.909162 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:32.909146    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0c8a8a3b-14dd-45c9-b8fb-baf967142fd6-var-lib-kubelet\") pod \"tuned-zm6cj\" (UID: \"0c8a8a3b-14dd-45c9-b8fb-baf967142fd6\") " pod="openshift-cluster-node-tuning-operator/tuned-zm6cj"
Oct 31 17:26:32.909871 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:32.909190    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/27af0f99-138f-42ac-89b9-9dfc4a522483-hostroot\") pod \"multus-9zs6c\" (UID: \"27af0f99-138f-42ac-89b9-9dfc4a522483\") " pod="openshift-multus/multus-9zs6c"
Oct 31 17:26:32.909871 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:32.909285    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ef27850a-20b3-4876-8330-57e8954f1a79-env-overrides\") pod \"ovnkube-node-v8sbm\" (UID: \"ef27850a-20b3-4876-8330-57e8954f1a79\") " pod="openshift-ovn-kubernetes/ovnkube-node-v8sbm"
Oct 31 17:26:32.909871 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:32.909512    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/eaed4088-d322-48ab-af04-3c9efdea4e73-tmp-dir\") pod \"node-resolver-x25tg\" (UID: \"eaed4088-d322-48ab-af04-3c9efdea4e73\") " pod="openshift-dns/node-resolver-x25tg"
Oct 31 17:26:32.909871 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:32.908941    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ef27850a-20b3-4876-8330-57e8954f1a79-host-cni-bin\") pod \"ovnkube-node-v8sbm\" (UID: \"ef27850a-20b3-4876-8330-57e8954f1a79\") " pod="openshift-ovn-kubernetes/ovnkube-node-v8sbm"
Oct 31 17:26:32.909871 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:32.909670    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/27af0f99-138f-42ac-89b9-9dfc4a522483-multus-daemon-config\") pod \"multus-9zs6c\" (UID: \"27af0f99-138f-42ac-89b9-9dfc4a522483\") " pod="openshift-multus/multus-9zs6c"
Oct 31 17:26:32.909871 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:32.909822    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/88be474b-fd0b-4784-8f1c-2dc0bdfb2792-socket-dir\") pod \"aws-ebs-csi-driver-node-ldjrw\" (UID: \"88be474b-fd0b-4784-8f1c-2dc0bdfb2792\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ldjrw"
Oct 31 17:26:32.909871 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:32.909858    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0c8a8a3b-14dd-45c9-b8fb-baf967142fd6-tmp\") pod \"tuned-zm6cj\" (UID: \"0c8a8a3b-14dd-45c9-b8fb-baf967142fd6\") " pod="openshift-cluster-node-tuning-operator/tuned-zm6cj"
Oct 31 17:26:32.910234 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:32.909885    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ef27850a-20b3-4876-8330-57e8954f1a79-host-kubelet\") pod \"ovnkube-node-v8sbm\" (UID: \"ef27850a-20b3-4876-8330-57e8954f1a79\") " pod="openshift-ovn-kubernetes/ovnkube-node-v8sbm"
Oct 31 17:26:32.910234 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:32.909915    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ef27850a-20b3-4876-8330-57e8954f1a79-var-lib-openvswitch\") pod \"ovnkube-node-v8sbm\" (UID: \"ef27850a-20b3-4876-8330-57e8954f1a79\") " pod="openshift-ovn-kubernetes/ovnkube-node-v8sbm"
Oct 31 17:26:32.910234 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:32.909944    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ef27850a-20b3-4876-8330-57e8954f1a79-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-v8sbm\" (UID: \"ef27850a-20b3-4876-8330-57e8954f1a79\") " pod="openshift-ovn-kubernetes/ovnkube-node-v8sbm"
Oct 31 17:26:32.910234 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:32.909972    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2ln8r\" (UniqueName: \"kubernetes.io/projected/88be474b-fd0b-4784-8f1c-2dc0bdfb2792-kube-api-access-2ln8r\") pod \"aws-ebs-csi-driver-node-ldjrw\" (UID: \"88be474b-fd0b-4784-8f1c-2dc0bdfb2792\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ldjrw"
Oct 31 17:26:32.910234 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:32.909997    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/27af0f99-138f-42ac-89b9-9dfc4a522483-host-run-netns\") pod \"multus-9zs6c\" (UID: \"27af0f99-138f-42ac-89b9-9dfc4a522483\") " pod="openshift-multus/multus-9zs6c"
Oct 31 17:26:32.910234 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:32.910025    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/88be474b-fd0b-4784-8f1c-2dc0bdfb2792-kubelet-dir\") pod \"aws-ebs-csi-driver-node-ldjrw\" (UID: \"88be474b-fd0b-4784-8f1c-2dc0bdfb2792\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ldjrw"
Oct 31 17:26:32.910234 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:32.910029    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ef27850a-20b3-4876-8330-57e8954f1a79-var-lib-openvswitch\") pod \"ovnkube-node-v8sbm\" (UID: \"ef27850a-20b3-4876-8330-57e8954f1a79\") " pod="openshift-ovn-kubernetes/ovnkube-node-v8sbm"
Oct 31 17:26:32.910234 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:32.910051    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/fe1c5f7c-fdfd-40b9-bc0f-4e018779ee2b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-swb7n\" (UID: \"fe1c5f7c-fdfd-40b9-bc0f-4e018779ee2b\") " pod="openshift-multus/multus-additional-cni-plugins-swb7n"
Oct 31 17:26:32.910234 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:32.910078    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/449efcb2-6707-4809-b869-1bb477f6e6ae-metrics-certs\") pod \"network-metrics-daemon-7j59v\" (UID: \"449efcb2-6707-4809-b869-1bb477f6e6ae\") " pod="openshift-multus/network-metrics-daemon-7j59v"
Oct 31 17:26:32.910234 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:32.910105    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0c8a8a3b-14dd-45c9-b8fb-baf967142fd6-host\") pod \"tuned-zm6cj\" (UID: \"0c8a8a3b-14dd-45c9-b8fb-baf967142fd6\") " pod="openshift-cluster-node-tuning-operator/tuned-zm6cj"
Oct 31 17:26:32.910234 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:32.910147    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/27af0f99-138f-42ac-89b9-9dfc4a522483-system-cni-dir\") pod \"multus-9zs6c\" (UID: \"27af0f99-138f-42ac-89b9-9dfc4a522483\") " pod="openshift-multus/multus-9zs6c"
Oct 31 17:26:32.910234 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:32.910174    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/27af0f99-138f-42ac-89b9-9dfc4a522483-host-var-lib-cni-bin\") pod \"multus-9zs6c\" (UID: \"27af0f99-138f-42ac-89b9-9dfc4a522483\") " pod="openshift-multus/multus-9zs6c"
Oct 31 17:26:32.910234 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:32.910199    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ef27850a-20b3-4876-8330-57e8954f1a79-ovnkube-script-lib\") pod \"ovnkube-node-v8sbm\" (UID: \"ef27850a-20b3-4876-8330-57e8954f1a79\") " pod="openshift-ovn-kubernetes/ovnkube-node-v8sbm"
Oct 31 17:26:32.910234 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:32.910225    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/9179e3c5-ef52-4445-aec0-779c3e99cb07-dbus\") pod \"global-pull-secret-syncer-qgtf4\" (UID: \"9179e3c5-ef52-4445-aec0-779c3e99cb07\") " pod="kube-system/global-pull-secret-syncer-qgtf4"
Oct 31 17:26:32.910927 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:32.910273    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/fe1c5f7c-fdfd-40b9-bc0f-4e018779ee2b-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-swb7n\" (UID: \"fe1c5f7c-fdfd-40b9-bc0f-4e018779ee2b\") " pod="openshift-multus/multus-additional-cni-plugins-swb7n"
Oct 31 17:26:32.910927 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:32.910303    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b2ncn\" (UniqueName: \"kubernetes.io/projected/fe1c5f7c-fdfd-40b9-bc0f-4e018779ee2b-kube-api-access-b2ncn\") pod \"multus-additional-cni-plugins-swb7n\" (UID: \"fe1c5f7c-fdfd-40b9-bc0f-4e018779ee2b\") " pod="openshift-multus/multus-additional-cni-plugins-swb7n"
Oct 31 17:26:32.910927 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:32.910331    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ef27850a-20b3-4876-8330-57e8954f1a79-systemd-units\") pod \"ovnkube-node-v8sbm\" (UID: \"ef27850a-20b3-4876-8330-57e8954f1a79\") " pod="openshift-ovn-kubernetes/ovnkube-node-v8sbm"
Oct 31 17:26:32.914218 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:32.911041    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/27af0f99-138f-42ac-89b9-9dfc4a522483-cni-binary-copy\") pod \"multus-9zs6c\" (UID: \"27af0f99-138f-42ac-89b9-9dfc4a522483\") " pod="openshift-multus/multus-9zs6c"
Oct 31 17:26:32.914218 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:32.911060    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ef27850a-20b3-4876-8330-57e8954f1a79-ovnkube-config\") pod \"ovnkube-node-v8sbm\" (UID: \"ef27850a-20b3-4876-8330-57e8954f1a79\") " pod="openshift-ovn-kubernetes/ovnkube-node-v8sbm"
Oct 31 17:26:32.914218 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:32.911079    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ef27850a-20b3-4876-8330-57e8954f1a79-host-run-netns\") pod \"ovnkube-node-v8sbm\" (UID: \"ef27850a-20b3-4876-8330-57e8954f1a79\") " pod="openshift-ovn-kubernetes/ovnkube-node-v8sbm"
Oct 31 17:26:32.914218 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:32.911231    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0c8a8a3b-14dd-45c9-b8fb-baf967142fd6-host\") pod \"tuned-zm6cj\" (UID: \"0c8a8a3b-14dd-45c9-b8fb-baf967142fd6\") " pod="openshift-cluster-node-tuning-operator/tuned-zm6cj"
Oct 31 17:26:32.914218 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:32.911285    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ef27850a-20b3-4876-8330-57e8954f1a79-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-v8sbm\" (UID: \"ef27850a-20b3-4876-8330-57e8954f1a79\") " pod="openshift-ovn-kubernetes/ovnkube-node-v8sbm"
Oct 31 17:26:32.914218 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:32.911334    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/fe1c5f7c-fdfd-40b9-bc0f-4e018779ee2b-cni-binary-copy\") pod \"multus-additional-cni-plugins-swb7n\" (UID: \"fe1c5f7c-fdfd-40b9-bc0f-4e018779ee2b\") " pod="openshift-multus/multus-additional-cni-plugins-swb7n"
Oct 31 17:26:32.914218 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:32.911516    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/27af0f99-138f-42ac-89b9-9dfc4a522483-host-run-netns\") pod \"multus-9zs6c\" (UID: \"27af0f99-138f-42ac-89b9-9dfc4a522483\") " pod="openshift-multus/multus-9zs6c"
Oct 31 17:26:32.914218 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:32.911618    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/9179e3c5-ef52-4445-aec0-779c3e99cb07-dbus\") pod \"global-pull-secret-syncer-qgtf4\" (UID: \"9179e3c5-ef52-4445-aec0-779c3e99cb07\") " pod="kube-system/global-pull-secret-syncer-qgtf4"
Oct 31 17:26:32.914218 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:32.911636    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/88be474b-fd0b-4784-8f1c-2dc0bdfb2792-kubelet-dir\") pod \"aws-ebs-csi-driver-node-ldjrw\" (UID: \"88be474b-fd0b-4784-8f1c-2dc0bdfb2792\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ldjrw"
Oct 31 17:26:32.914218 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:32.911675    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/27af0f99-138f-42ac-89b9-9dfc4a522483-system-cni-dir\") pod \"multus-9zs6c\" (UID: \"27af0f99-138f-42ac-89b9-9dfc4a522483\") " pod="openshift-multus/multus-9zs6c"
Oct 31 17:26:32.914218 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:32.911743    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/27af0f99-138f-42ac-89b9-9dfc4a522483-host-var-lib-cni-bin\") pod \"multus-9zs6c\" (UID: \"27af0f99-138f-42ac-89b9-9dfc4a522483\") " pod="openshift-multus/multus-9zs6c"
Oct 31 17:26:32.914218 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:32.911767    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ef27850a-20b3-4876-8330-57e8954f1a79-host-kubelet\") pod \"ovnkube-node-v8sbm\" (UID: \"ef27850a-20b3-4876-8330-57e8954f1a79\") " pod="openshift-ovn-kubernetes/ovnkube-node-v8sbm"
Oct 31 17:26:32.914218 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:32.911812    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/fe1c5f7c-fdfd-40b9-bc0f-4e018779ee2b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-swb7n\" (UID: \"fe1c5f7c-fdfd-40b9-bc0f-4e018779ee2b\") " pod="openshift-multus/multus-additional-cni-plugins-swb7n"
Oct 31 17:26:32.914218 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:32.911825    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ef27850a-20b3-4876-8330-57e8954f1a79-host-run-netns\") pod \"ovnkube-node-v8sbm\" (UID: \"ef27850a-20b3-4876-8330-57e8954f1a79\") " pod="openshift-ovn-kubernetes/ovnkube-node-v8sbm"
Oct 31 17:26:32.914218 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:32.911867    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/88be474b-fd0b-4784-8f1c-2dc0bdfb2792-device-dir\") pod \"aws-ebs-csi-driver-node-ldjrw\" (UID: \"88be474b-fd0b-4784-8f1c-2dc0bdfb2792\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ldjrw"
Oct 31 17:26:32.914218 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:32.911923    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/27af0f99-138f-42ac-89b9-9dfc4a522483-host-run-k8s-cni-cncf-io\") pod \"multus-9zs6c\" (UID: \"27af0f99-138f-42ac-89b9-9dfc4a522483\") " pod="openshift-multus/multus-9zs6c"
Oct 31 17:26:32.914218 ip-10-0-138-17 kubenswrapper[2572]: E1031 17:26:32.911944    2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 31 17:26:32.915072 ip-10-0-138-17 kubenswrapper[2572]: E1031 17:26:32.912023    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/449efcb2-6707-4809-b869-1bb477f6e6ae-metrics-certs podName:449efcb2-6707-4809-b869-1bb477f6e6ae nodeName:}" failed. No retries permitted until 2026-10-31 17:26:33.412000482 +0000 UTC m=+3.127858169 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/449efcb2-6707-4809-b869-1bb477f6e6ae-metrics-certs") pod "network-metrics-daemon-7j59v" (UID: "449efcb2-6707-4809-b869-1bb477f6e6ae") : object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 31 17:26:32.915072 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:32.911963    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0c8a8a3b-14dd-45c9-b8fb-baf967142fd6-etc-kubernetes\") pod \"tuned-zm6cj\" (UID: \"0c8a8a3b-14dd-45c9-b8fb-baf967142fd6\") " pod="openshift-cluster-node-tuning-operator/tuned-zm6cj"
Oct 31 17:26:32.915072 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:32.912105    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/0c8a8a3b-14dd-45c9-b8fb-baf967142fd6-etc-systemd\") pod \"tuned-zm6cj\" (UID: \"0c8a8a3b-14dd-45c9-b8fb-baf967142fd6\") " pod="openshift-cluster-node-tuning-operator/tuned-zm6cj"
Oct 31 17:26:32.915072 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:32.912141    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ef27850a-20b3-4876-8330-57e8954f1a79-run-openvswitch\") pod \"ovnkube-node-v8sbm\" (UID: \"ef27850a-20b3-4876-8330-57e8954f1a79\") " pod="openshift-ovn-kubernetes/ovnkube-node-v8sbm"
Oct 31 17:26:32.915072 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:32.912174    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ef27850a-20b3-4876-8330-57e8954f1a79-host-cni-netd\") pod \"ovnkube-node-v8sbm\" (UID: \"ef27850a-20b3-4876-8330-57e8954f1a79\") " pod="openshift-ovn-kubernetes/ovnkube-node-v8sbm"
Oct 31 17:26:32.915072 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:32.912208    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/b1e258da-4619-478c-895a-041aa7eeafb6-iptables-alerter-script\") pod \"iptables-alerter-h8jzv\" (UID: \"b1e258da-4619-478c-895a-041aa7eeafb6\") " pod="openshift-network-operator/iptables-alerter-h8jzv"
Oct 31 17:26:32.915072 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:32.912250    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/88be474b-fd0b-4784-8f1c-2dc0bdfb2792-sys-fs\") pod \"aws-ebs-csi-driver-node-ldjrw\" (UID: \"88be474b-fd0b-4784-8f1c-2dc0bdfb2792\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ldjrw"
Oct 31 17:26:32.915072 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:32.912383    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/27af0f99-138f-42ac-89b9-9dfc4a522483-host-var-lib-cni-multus\") pod \"multus-9zs6c\" (UID: \"27af0f99-138f-42ac-89b9-9dfc4a522483\") " pod="openshift-multus/multus-9zs6c"
Oct 31 17:26:32.915072 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:32.912410    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/27af0f99-138f-42ac-89b9-9dfc4a522483-multus-conf-dir\") pod \"multus-9zs6c\" (UID: \"27af0f99-138f-42ac-89b9-9dfc4a522483\") " pod="openshift-multus/multus-9zs6c"
Oct 31 17:26:32.915072 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:32.912421    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/86312227-efeb-4196-ab2d-3b4b03e5c50f-konnectivity-ca\") pod \"konnectivity-agent-vghkb\" (UID: \"86312227-efeb-4196-ab2d-3b4b03e5c50f\") " pod="kube-system/konnectivity-agent-vghkb"
Oct 31 17:26:32.915072 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:32.912443    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/27af0f99-138f-42ac-89b9-9dfc4a522483-host-run-multus-certs\") pod \"multus-9zs6c\" (UID: \"27af0f99-138f-42ac-89b9-9dfc4a522483\") " pod="openshift-multus/multus-9zs6c"
Oct 31 17:26:32.915072 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:32.912542    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ef27850a-20b3-4876-8330-57e8954f1a79-ovnkube-script-lib\") pod \"ovnkube-node-v8sbm\" (UID: \"ef27850a-20b3-4876-8330-57e8954f1a79\") " pod="openshift-ovn-kubernetes/ovnkube-node-v8sbm"
Oct 31 17:26:32.915072 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:32.912545    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ef27850a-20b3-4876-8330-57e8954f1a79-run-openvswitch\") pod \"ovnkube-node-v8sbm\" (UID: \"ef27850a-20b3-4876-8330-57e8954f1a79\") " pod="openshift-ovn-kubernetes/ovnkube-node-v8sbm"
Oct 31 17:26:32.915072 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:32.912553    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/9179e3c5-ef52-4445-aec0-779c3e99cb07-kubelet-config\") pod \"global-pull-secret-syncer-qgtf4\" (UID: \"9179e3c5-ef52-4445-aec0-779c3e99cb07\") " pod="kube-system/global-pull-secret-syncer-qgtf4"
Oct 31 17:26:32.915072 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:32.912590    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/0c8a8a3b-14dd-45c9-b8fb-baf967142fd6-etc-sysctl-d\") pod \"tuned-zm6cj\" (UID: \"0c8a8a3b-14dd-45c9-b8fb-baf967142fd6\") " pod="openshift-cluster-node-tuning-operator/tuned-zm6cj"
Oct 31 17:26:32.915072 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:32.912634    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/27af0f99-138f-42ac-89b9-9dfc4a522483-host-run-k8s-cni-cncf-io\") pod \"multus-9zs6c\" (UID: \"27af0f99-138f-42ac-89b9-9dfc4a522483\") " pod="openshift-multus/multus-9zs6c"
Oct 31 17:26:32.915072 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:32.912690    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0c8a8a3b-14dd-45c9-b8fb-baf967142fd6-etc-kubernetes\") pod \"tuned-zm6cj\" (UID: \"0c8a8a3b-14dd-45c9-b8fb-baf967142fd6\") " pod="openshift-cluster-node-tuning-operator/tuned-zm6cj"
Oct 31 17:26:32.915858 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:32.912745    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/9179e3c5-ef52-4445-aec0-779c3e99cb07-kubelet-config\") pod \"global-pull-secret-syncer-qgtf4\" (UID: \"9179e3c5-ef52-4445-aec0-779c3e99cb07\") " pod="kube-system/global-pull-secret-syncer-qgtf4"
Oct 31 17:26:32.915858 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:32.912613    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/0c8a8a3b-14dd-45c9-b8fb-baf967142fd6-run\") pod \"tuned-zm6cj\" (UID: \"0c8a8a3b-14dd-45c9-b8fb-baf967142fd6\") " pod="openshift-cluster-node-tuning-operator/tuned-zm6cj"
Oct 31 17:26:32.915858 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:32.912797    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/0c8a8a3b-14dd-45c9-b8fb-baf967142fd6-etc-systemd\") pod \"tuned-zm6cj\" (UID: \"0c8a8a3b-14dd-45c9-b8fb-baf967142fd6\") " pod="openshift-cluster-node-tuning-operator/tuned-zm6cj"
Oct 31 17:26:32.915858 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:32.912800    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h4fpf\" (UniqueName: \"kubernetes.io/projected/0c8a8a3b-14dd-45c9-b8fb-baf967142fd6-kube-api-access-h4fpf\") pod \"tuned-zm6cj\" (UID: \"0c8a8a3b-14dd-45c9-b8fb-baf967142fd6\") " pod="openshift-cluster-node-tuning-operator/tuned-zm6cj"
Oct 31 17:26:32.915858 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:32.912827    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/88be474b-fd0b-4784-8f1c-2dc0bdfb2792-sys-fs\") pod \"aws-ebs-csi-driver-node-ldjrw\" (UID: \"88be474b-fd0b-4784-8f1c-2dc0bdfb2792\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ldjrw"
Oct 31 17:26:32.915858 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:32.912853    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/fe1c5f7c-fdfd-40b9-bc0f-4e018779ee2b-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-swb7n\" (UID: \"fe1c5f7c-fdfd-40b9-bc0f-4e018779ee2b\") " pod="openshift-multus/multus-additional-cni-plugins-swb7n"
Oct 31 17:26:32.915858 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:32.912877    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ef27850a-20b3-4876-8330-57e8954f1a79-host-cni-netd\") pod \"ovnkube-node-v8sbm\" (UID: \"ef27850a-20b3-4876-8330-57e8954f1a79\") " pod="openshift-ovn-kubernetes/ovnkube-node-v8sbm"
Oct 31 17:26:32.915858 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:32.912892    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9179e3c5-ef52-4445-aec0-779c3e99cb07-original-pull-secret\") pod \"global-pull-secret-syncer-qgtf4\" (UID: \"9179e3c5-ef52-4445-aec0-779c3e99cb07\") " pod="kube-system/global-pull-secret-syncer-qgtf4"
Oct 31 17:26:32.915858 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:32.912930    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c915138c-9050-4958-b442-fee1aca9b002-host\") pod \"node-ca-lcz9q\" (UID: \"c915138c-9050-4958-b442-fee1aca9b002\") " pod="openshift-image-registry/node-ca-lcz9q"
Oct 31 17:26:32.915858 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:32.912948    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/0c8a8a3b-14dd-45c9-b8fb-baf967142fd6-run\") pod \"tuned-zm6cj\" (UID: \"0c8a8a3b-14dd-45c9-b8fb-baf967142fd6\") " pod="openshift-cluster-node-tuning-operator/tuned-zm6cj"
Oct 31 17:26:32.915858 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:32.912959    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/88be474b-fd0b-4784-8f1c-2dc0bdfb2792-registration-dir\") pod \"aws-ebs-csi-driver-node-ldjrw\" (UID: \"88be474b-fd0b-4784-8f1c-2dc0bdfb2792\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ldjrw"
Oct 31 17:26:32.915858 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:32.913006    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/88be474b-fd0b-4784-8f1c-2dc0bdfb2792-device-dir\") pod \"aws-ebs-csi-driver-node-ldjrw\" (UID: \"88be474b-fd0b-4784-8f1c-2dc0bdfb2792\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ldjrw"
Oct 31 17:26:32.915858 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:32.913049    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/88be474b-fd0b-4784-8f1c-2dc0bdfb2792-registration-dir\") pod \"aws-ebs-csi-driver-node-ldjrw\" (UID: \"88be474b-fd0b-4784-8f1c-2dc0bdfb2792\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ldjrw"
Oct 31 17:26:32.915858 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:32.913089    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/27af0f99-138f-42ac-89b9-9dfc4a522483-host-var-lib-cni-multus\") pod \"multus-9zs6c\" (UID: \"27af0f99-138f-42ac-89b9-9dfc4a522483\") " pod="openshift-multus/multus-9zs6c"
Oct 31 17:26:32.915858 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:32.913160    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/0c8a8a3b-14dd-45c9-b8fb-baf967142fd6-etc-sysctl-d\") pod \"tuned-zm6cj\" (UID: \"0c8a8a3b-14dd-45c9-b8fb-baf967142fd6\") " pod="openshift-cluster-node-tuning-operator/tuned-zm6cj"
Oct 31 17:26:32.915858 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:32.913164    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/27af0f99-138f-42ac-89b9-9dfc4a522483-multus-conf-dir\") pod \"multus-9zs6c\" (UID: \"27af0f99-138f-42ac-89b9-9dfc4a522483\") " pod="openshift-multus/multus-9zs6c"
Oct 31 17:26:32.915858 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:32.913260    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/27af0f99-138f-42ac-89b9-9dfc4a522483-host-run-multus-certs\") pod \"multus-9zs6c\" (UID: \"27af0f99-138f-42ac-89b9-9dfc4a522483\") " pod="openshift-multus/multus-9zs6c"
Oct 31 17:26:32.916802 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:32.913419    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ef27850a-20b3-4876-8330-57e8954f1a79-ovn-node-metrics-cert\") pod \"ovnkube-node-v8sbm\" (UID: \"ef27850a-20b3-4876-8330-57e8954f1a79\") " pod="openshift-ovn-kubernetes/ovnkube-node-v8sbm"
Oct 31 17:26:32.916802 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:32.913546    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/fe1c5f7c-fdfd-40b9-bc0f-4e018779ee2b-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-swb7n\" (UID: \"fe1c5f7c-fdfd-40b9-bc0f-4e018779ee2b\") " pod="openshift-multus/multus-additional-cni-plugins-swb7n"
Oct 31 17:26:32.916802 ip-10-0-138-17 kubenswrapper[2572]: E1031 17:26:32.913621    2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Oct 31 17:26:32.916802 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:32.913654    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/b1e258da-4619-478c-895a-041aa7eeafb6-iptables-alerter-script\") pod \"iptables-alerter-h8jzv\" (UID: \"b1e258da-4619-478c-895a-041aa7eeafb6\") " pod="openshift-network-operator/iptables-alerter-h8jzv"
Oct 31 17:26:32.916802 ip-10-0-138-17 kubenswrapper[2572]: E1031 17:26:32.913668    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9179e3c5-ef52-4445-aec0-779c3e99cb07-original-pull-secret podName:9179e3c5-ef52-4445-aec0-779c3e99cb07 nodeName:}" failed. No retries permitted until 2026-10-31 17:26:33.413656427 +0000 UTC m=+3.129514137 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9179e3c5-ef52-4445-aec0-779c3e99cb07-original-pull-secret") pod "global-pull-secret-syncer-qgtf4" (UID: "9179e3c5-ef52-4445-aec0-779c3e99cb07") : object "kube-system"/"original-pull-secret" not registered
Oct 31 17:26:32.916802 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:32.913852    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/0c8a8a3b-14dd-45c9-b8fb-baf967142fd6-etc-sysconfig\") pod \"tuned-zm6cj\" (UID: \"0c8a8a3b-14dd-45c9-b8fb-baf967142fd6\") " pod="openshift-cluster-node-tuning-operator/tuned-zm6cj"
Oct 31 17:26:32.916802 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:32.913858    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c915138c-9050-4958-b442-fee1aca9b002-host\") pod \"node-ca-lcz9q\" (UID: \"c915138c-9050-4958-b442-fee1aca9b002\") " pod="openshift-image-registry/node-ca-lcz9q"
Oct 31 17:26:32.916802 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:32.913974    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ef27850a-20b3-4876-8330-57e8954f1a79-systemd-units\") pod \"ovnkube-node-v8sbm\" (UID: \"ef27850a-20b3-4876-8330-57e8954f1a79\") " pod="openshift-ovn-kubernetes/ovnkube-node-v8sbm"
Oct 31 17:26:32.916802 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:32.914066    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/fe1c5f7c-fdfd-40b9-bc0f-4e018779ee2b-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-swb7n\" (UID: \"fe1c5f7c-fdfd-40b9-bc0f-4e018779ee2b\") " pod="openshift-multus/multus-additional-cni-plugins-swb7n"
Oct 31 17:26:32.916802 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:32.914388    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/c915138c-9050-4958-b442-fee1aca9b002-serviceca\") pod \"node-ca-lcz9q\" (UID: \"c915138c-9050-4958-b442-fee1aca9b002\") " pod="openshift-image-registry/node-ca-lcz9q"
Oct 31 17:26:32.918171 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:32.918139    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0c8a8a3b-14dd-45c9-b8fb-baf967142fd6-tmp\") pod \"tuned-zm6cj\" (UID: \"0c8a8a3b-14dd-45c9-b8fb-baf967142fd6\") " pod="openshift-cluster-node-tuning-operator/tuned-zm6cj"
Oct 31 17:26:32.919220 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:32.919193    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/0c8a8a3b-14dd-45c9-b8fb-baf967142fd6-etc-tuned\") pod \"tuned-zm6cj\" (UID: \"0c8a8a3b-14dd-45c9-b8fb-baf967142fd6\") " pod="openshift-cluster-node-tuning-operator/tuned-zm6cj"
Oct 31 17:26:32.922116 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:32.922092    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/86312227-efeb-4196-ab2d-3b4b03e5c50f-agent-certs\") pod \"konnectivity-agent-vghkb\" (UID: \"86312227-efeb-4196-ab2d-3b4b03e5c50f\") " pod="kube-system/konnectivity-agent-vghkb"
Oct 31 17:26:32.930756 ip-10-0-138-17 kubenswrapper[2572]: E1031 17:26:32.930724    2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Oct 31 17:26:32.930756 ip-10-0-138-17 kubenswrapper[2572]: E1031 17:26:32.930750    2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Oct 31 17:26:32.930883 ip-10-0-138-17 kubenswrapper[2572]: E1031 17:26:32.930765    2572 projected.go:196] Error preparing data for projected volume kube-api-access-96ckd for pod openshift-network-diagnostics/network-check-target-pqs8z: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 31 17:26:32.930883 ip-10-0-138-17 kubenswrapper[2572]: E1031 17:26:32.930821    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5d30d9b6-0431-47f2-b06c-8a03d4f59b97-kube-api-access-96ckd podName:5d30d9b6-0431-47f2-b06c-8a03d4f59b97 nodeName:}" failed. No retries permitted until 2026-10-31 17:26:33.430804506 +0000 UTC m=+3.146662188 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-96ckd" (UniqueName: "kubernetes.io/projected/5d30d9b6-0431-47f2-b06c-8a03d4f59b97-kube-api-access-96ckd") pod "network-check-target-pqs8z" (UID: "5d30d9b6-0431-47f2-b06c-8a03d4f59b97") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 31 17:26:32.935217 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:32.935138    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h4fpf\" (UniqueName: \"kubernetes.io/projected/0c8a8a3b-14dd-45c9-b8fb-baf967142fd6-kube-api-access-h4fpf\") pod \"tuned-zm6cj\" (UID: \"0c8a8a3b-14dd-45c9-b8fb-baf967142fd6\") " pod="openshift-cluster-node-tuning-operator/tuned-zm6cj"
Oct 31 17:26:32.935357 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:32.935325    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b2ncn\" (UniqueName: \"kubernetes.io/projected/fe1c5f7c-fdfd-40b9-bc0f-4e018779ee2b-kube-api-access-b2ncn\") pod \"multus-additional-cni-plugins-swb7n\" (UID: \"fe1c5f7c-fdfd-40b9-bc0f-4e018779ee2b\") " pod="openshift-multus/multus-additional-cni-plugins-swb7n"
Oct 31 17:26:32.935897 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:32.935874    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-69jvk\" (UniqueName: \"kubernetes.io/projected/ef27850a-20b3-4876-8330-57e8954f1a79-kube-api-access-69jvk\") pod \"ovnkube-node-v8sbm\" (UID: \"ef27850a-20b3-4876-8330-57e8954f1a79\") " pod="openshift-ovn-kubernetes/ovnkube-node-v8sbm"
Oct 31 17:26:32.936790 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:32.936767    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2ln8r\" (UniqueName: \"kubernetes.io/projected/88be474b-fd0b-4784-8f1c-2dc0bdfb2792-kube-api-access-2ln8r\") pod \"aws-ebs-csi-driver-node-ldjrw\" (UID: \"88be474b-fd0b-4784-8f1c-2dc0bdfb2792\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ldjrw"
Oct 31 17:26:32.938393 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:32.938336    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cq4kh\" (UniqueName: \"kubernetes.io/projected/449efcb2-6707-4809-b869-1bb477f6e6ae-kube-api-access-cq4kh\") pod \"network-metrics-daemon-7j59v\" (UID: \"449efcb2-6707-4809-b869-1bb477f6e6ae\") " pod="openshift-multus/network-metrics-daemon-7j59v"
Oct 31 17:26:32.938393 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:32.938336    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q9ctx\" (UniqueName: \"kubernetes.io/projected/eaed4088-d322-48ab-af04-3c9efdea4e73-kube-api-access-q9ctx\") pod \"node-resolver-x25tg\" (UID: \"eaed4088-d322-48ab-af04-3c9efdea4e73\") " pod="openshift-dns/node-resolver-x25tg"
Oct 31 17:26:32.938964 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:32.938940    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c6ctd\" (UniqueName: \"kubernetes.io/projected/27af0f99-138f-42ac-89b9-9dfc4a522483-kube-api-access-c6ctd\") pod \"multus-9zs6c\" (UID: \"27af0f99-138f-42ac-89b9-9dfc4a522483\") " pod="openshift-multus/multus-9zs6c"
Oct 31 17:26:32.939869 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:32.939823    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6tqgx\" (UniqueName: \"kubernetes.io/projected/c915138c-9050-4958-b442-fee1aca9b002-kube-api-access-6tqgx\") pod \"node-ca-lcz9q\" (UID: \"c915138c-9050-4958-b442-fee1aca9b002\") " pod="openshift-image-registry/node-ca-lcz9q"
Oct 31 17:26:32.939966 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:32.939948    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ghqc6\" (UniqueName: \"kubernetes.io/projected/b1e258da-4619-478c-895a-041aa7eeafb6-kube-api-access-ghqc6\") pod \"iptables-alerter-h8jzv\" (UID: \"b1e258da-4619-478c-895a-041aa7eeafb6\") " pod="openshift-network-operator/iptables-alerter-h8jzv"
Oct 31 17:26:33.035171 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:33.035135    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ldjrw"
Oct 31 17:26:33.047018 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:33.046993    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-vghkb"
Oct 31 17:26:33.047714 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:33.047683    2572 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod88be474b_fd0b_4784_8f1c_2dc0bdfb2792.slice/crio-ae6a674b56f493935c53ae0614e6db8e6328dc6f28f16e6f2803962175d16e00 WatchSource:0}: Error finding container ae6a674b56f493935c53ae0614e6db8e6328dc6f28f16e6f2803962175d16e00: Status 404 returned error can't find the container with id ae6a674b56f493935c53ae0614e6db8e6328dc6f28f16e6f2803962175d16e00
Oct 31 17:26:33.054596 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:33.054574    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-x25tg"
Oct 31 17:26:33.057573 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:33.057548    2572 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod86312227_efeb_4196_ab2d_3b4b03e5c50f.slice/crio-5d38c987e34445d1bde0bbf11d39b3fa047cdab3266f8e91c79dc0dc0111126d WatchSource:0}: Error finding container 5d38c987e34445d1bde0bbf11d39b3fa047cdab3266f8e91c79dc0dc0111126d: Status 404 returned error can't find the container with id 5d38c987e34445d1bde0bbf11d39b3fa047cdab3266f8e91c79dc0dc0111126d
Oct 31 17:26:33.060260 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:33.060236    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-9zs6c"
Oct 31 17:26:33.068617 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:33.068594    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-h8jzv"
Oct 31 17:26:33.071873 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:33.071841    2572 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod27af0f99_138f_42ac_89b9_9dfc4a522483.slice/crio-40e2493e3e7332fd3069f87c72eaaf0f1beaf1beaed3c950a6b9c150baa48160 WatchSource:0}: Error finding container 40e2493e3e7332fd3069f87c72eaaf0f1beaf1beaed3c950a6b9c150baa48160: Status 404 returned error can't find the container with id 40e2493e3e7332fd3069f87c72eaaf0f1beaf1beaed3c950a6b9c150baa48160
Oct 31 17:26:33.080773 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:33.080742    2572 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb1e258da_4619_478c_895a_041aa7eeafb6.slice/crio-887e4ba8e2f1819c14acae40c084561bb0e14797214b98b1f721f46071a2bc2c WatchSource:0}: Error finding container 887e4ba8e2f1819c14acae40c084561bb0e14797214b98b1f721f46071a2bc2c: Status 404 returned error can't find the container with id 887e4ba8e2f1819c14acae40c084561bb0e14797214b98b1f721f46071a2bc2c
Oct 31 17:26:33.092519 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:33.092456    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-zm6cj"
Oct 31 17:26:33.094562 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:33.094541    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-swb7n"
Oct 31 17:26:33.105314 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:33.105279    2572 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0c8a8a3b_14dd_45c9_b8fb_baf967142fd6.slice/crio-d60efb765be3a5910b7f1c40a90bfb697d8382f61d18a6bd2f4da17daaafabec WatchSource:0}: Error finding container d60efb765be3a5910b7f1c40a90bfb697d8382f61d18a6bd2f4da17daaafabec: Status 404 returned error can't find the container with id d60efb765be3a5910b7f1c40a90bfb697d8382f61d18a6bd2f4da17daaafabec
Oct 31 17:26:33.109701 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:33.109681    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-lcz9q"
Oct 31 17:26:33.111439 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:33.111415    2572 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfe1c5f7c_fdfd_40b9_bc0f_4e018779ee2b.slice/crio-9fa0667db86191a2451edf4dbe67513a34fc2240fa69790b1f98bac9fcaac48a WatchSource:0}: Error finding container 9fa0667db86191a2451edf4dbe67513a34fc2240fa69790b1f98bac9fcaac48a: Status 404 returned error can't find the container with id 9fa0667db86191a2451edf4dbe67513a34fc2240fa69790b1f98bac9fcaac48a
Oct 31 17:26:33.116980 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:33.116958    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-v8sbm"
Oct 31 17:26:33.120893 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:33.120868    2572 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc915138c_9050_4958_b442_fee1aca9b002.slice/crio-c6761ad57d4350d67c2dcce2c32cae91de22b1f0ec08230216d28a39fb381e49 WatchSource:0}: Error finding container c6761ad57d4350d67c2dcce2c32cae91de22b1f0ec08230216d28a39fb381e49: Status 404 returned error can't find the container with id c6761ad57d4350d67c2dcce2c32cae91de22b1f0ec08230216d28a39fb381e49
Oct 31 17:26:33.130175 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:26:33.130149    2572 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef27850a_20b3_4876_8330_57e8954f1a79.slice/crio-b1f7975c4fe44754cfb8a3963b2147f41bd63a3578974932c73f851106b5a047 WatchSource:0}: Error finding container b1f7975c4fe44754cfb8a3963b2147f41bd63a3578974932c73f851106b5a047: Status 404 returned error can't find the container with id b1f7975c4fe44754cfb8a3963b2147f41bd63a3578974932c73f851106b5a047
Oct 31 17:26:33.416414 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:33.416380    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9179e3c5-ef52-4445-aec0-779c3e99cb07-original-pull-secret\") pod \"global-pull-secret-syncer-qgtf4\" (UID: \"9179e3c5-ef52-4445-aec0-779c3e99cb07\") " pod="kube-system/global-pull-secret-syncer-qgtf4"
Oct 31 17:26:33.416583 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:33.416443    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/449efcb2-6707-4809-b869-1bb477f6e6ae-metrics-certs\") pod \"network-metrics-daemon-7j59v\" (UID: \"449efcb2-6707-4809-b869-1bb477f6e6ae\") " pod="openshift-multus/network-metrics-daemon-7j59v"
Oct 31 17:26:33.416583 ip-10-0-138-17 kubenswrapper[2572]: E1031 17:26:33.416540    2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 31 17:26:33.416583 ip-10-0-138-17 kubenswrapper[2572]: E1031 17:26:33.416540    2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Oct 31 17:26:33.416746 ip-10-0-138-17 kubenswrapper[2572]: E1031 17:26:33.416595    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/449efcb2-6707-4809-b869-1bb477f6e6ae-metrics-certs podName:449efcb2-6707-4809-b869-1bb477f6e6ae nodeName:}" failed. No retries permitted until 2026-10-31 17:26:34.416581634 +0000 UTC m=+4.132439305 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/449efcb2-6707-4809-b869-1bb477f6e6ae-metrics-certs") pod "network-metrics-daemon-7j59v" (UID: "449efcb2-6707-4809-b869-1bb477f6e6ae") : object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 31 17:26:33.416746 ip-10-0-138-17 kubenswrapper[2572]: E1031 17:26:33.416609    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9179e3c5-ef52-4445-aec0-779c3e99cb07-original-pull-secret podName:9179e3c5-ef52-4445-aec0-779c3e99cb07 nodeName:}" failed. No retries permitted until 2026-10-31 17:26:34.416602783 +0000 UTC m=+4.132460452 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9179e3c5-ef52-4445-aec0-779c3e99cb07-original-pull-secret") pod "global-pull-secret-syncer-qgtf4" (UID: "9179e3c5-ef52-4445-aec0-779c3e99cb07") : object "kube-system"/"original-pull-secret" not registered
Oct 31 17:26:33.517027 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:33.516986    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-96ckd\" (UniqueName: \"kubernetes.io/projected/5d30d9b6-0431-47f2-b06c-8a03d4f59b97-kube-api-access-96ckd\") pod \"network-check-target-pqs8z\" (UID: \"5d30d9b6-0431-47f2-b06c-8a03d4f59b97\") " pod="openshift-network-diagnostics/network-check-target-pqs8z"
Oct 31 17:26:33.517242 ip-10-0-138-17 kubenswrapper[2572]: E1031 17:26:33.517221    2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Oct 31 17:26:33.517242 ip-10-0-138-17 kubenswrapper[2572]: E1031 17:26:33.517246    2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Oct 31 17:26:33.517441 ip-10-0-138-17 kubenswrapper[2572]: E1031 17:26:33.517262    2572 projected.go:196] Error preparing data for projected volume kube-api-access-96ckd for pod openshift-network-diagnostics/network-check-target-pqs8z: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 31 17:26:33.517441 ip-10-0-138-17 kubenswrapper[2572]: E1031 17:26:33.517330    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5d30d9b6-0431-47f2-b06c-8a03d4f59b97-kube-api-access-96ckd podName:5d30d9b6-0431-47f2-b06c-8a03d4f59b97 nodeName:}" failed. No retries permitted until 2026-10-31 17:26:34.517304545 +0000 UTC m=+4.233162233 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-96ckd" (UniqueName: "kubernetes.io/projected/5d30d9b6-0431-47f2-b06c-8a03d4f59b97-kube-api-access-96ckd") pod "network-check-target-pqs8z" (UID: "5d30d9b6-0431-47f2-b06c-8a03d4f59b97") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 31 17:26:33.747486 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:33.747416    2572 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-10-30 17:21:33 +0000 UTC" deadline="2028-07-07 23:33:09.79156397 +0000 UTC"
Oct 31 17:26:33.747486 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:33.747484    2572 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14766h6m36.044083859s"
Oct 31 17:26:33.762270 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:33.762237    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qgtf4"
Oct 31 17:26:33.767700 ip-10-0-138-17 kubenswrapper[2572]: E1031 17:26:33.762420    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qgtf4" podUID="9179e3c5-ef52-4445-aec0-779c3e99cb07"
Oct 31 17:26:33.782318 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:33.782286    2572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-swb7n" event={"ID":"fe1c5f7c-fdfd-40b9-bc0f-4e018779ee2b","Type":"ContainerStarted","Data":"9fa0667db86191a2451edf4dbe67513a34fc2240fa69790b1f98bac9fcaac48a"}
Oct 31 17:26:33.791083 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:33.790988    2572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-h8jzv" event={"ID":"b1e258da-4619-478c-895a-041aa7eeafb6","Type":"ContainerStarted","Data":"887e4ba8e2f1819c14acae40c084561bb0e14797214b98b1f721f46071a2bc2c"}
Oct 31 17:26:33.799582 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:33.799481    2572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-9zs6c" event={"ID":"27af0f99-138f-42ac-89b9-9dfc4a522483","Type":"ContainerStarted","Data":"40e2493e3e7332fd3069f87c72eaaf0f1beaf1beaed3c950a6b9c150baa48160"}
Oct 31 17:26:33.806608 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:33.806576    2572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-x25tg" event={"ID":"eaed4088-d322-48ab-af04-3c9efdea4e73","Type":"ContainerStarted","Data":"e22c0522d326cbf89fef59bf03aad4739e006f0a5b39b49538ee85190d4e0d72"}
Oct 31 17:26:33.812698 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:33.812665    2572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-v8sbm" event={"ID":"ef27850a-20b3-4876-8330-57e8954f1a79","Type":"ContainerStarted","Data":"b1f7975c4fe44754cfb8a3963b2147f41bd63a3578974932c73f851106b5a047"}
Oct 31 17:26:33.821998 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:33.821968    2572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-lcz9q" event={"ID":"c915138c-9050-4958-b442-fee1aca9b002","Type":"ContainerStarted","Data":"c6761ad57d4350d67c2dcce2c32cae91de22b1f0ec08230216d28a39fb381e49"}
Oct 31 17:26:33.830543 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:33.830514    2572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-zm6cj" event={"ID":"0c8a8a3b-14dd-45c9-b8fb-baf967142fd6","Type":"ContainerStarted","Data":"d60efb765be3a5910b7f1c40a90bfb697d8382f61d18a6bd2f4da17daaafabec"}
Oct 31 17:26:33.848606 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:33.848489    2572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-vghkb" event={"ID":"86312227-efeb-4196-ab2d-3b4b03e5c50f","Type":"ContainerStarted","Data":"5d38c987e34445d1bde0bbf11d39b3fa047cdab3266f8e91c79dc0dc0111126d"}
Oct 31 17:26:33.851917 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:33.851811    2572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ldjrw" event={"ID":"88be474b-fd0b-4784-8f1c-2dc0bdfb2792","Type":"ContainerStarted","Data":"ae6a674b56f493935c53ae0614e6db8e6328dc6f28f16e6f2803962175d16e00"}
Oct 31 17:26:34.427603 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:34.427560    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9179e3c5-ef52-4445-aec0-779c3e99cb07-original-pull-secret\") pod \"global-pull-secret-syncer-qgtf4\" (UID: \"9179e3c5-ef52-4445-aec0-779c3e99cb07\") " pod="kube-system/global-pull-secret-syncer-qgtf4"
Oct 31 17:26:34.427827 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:34.427660    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/449efcb2-6707-4809-b869-1bb477f6e6ae-metrics-certs\") pod \"network-metrics-daemon-7j59v\" (UID: \"449efcb2-6707-4809-b869-1bb477f6e6ae\") " pod="openshift-multus/network-metrics-daemon-7j59v"
Oct 31 17:26:34.427827 ip-10-0-138-17 kubenswrapper[2572]: E1031 17:26:34.427819    2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 31 17:26:34.427977 ip-10-0-138-17 kubenswrapper[2572]: E1031 17:26:34.427884    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/449efcb2-6707-4809-b869-1bb477f6e6ae-metrics-certs podName:449efcb2-6707-4809-b869-1bb477f6e6ae nodeName:}" failed. No retries permitted until 2026-10-31 17:26:36.427863784 +0000 UTC m=+6.143721460 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/449efcb2-6707-4809-b869-1bb477f6e6ae-metrics-certs") pod "network-metrics-daemon-7j59v" (UID: "449efcb2-6707-4809-b869-1bb477f6e6ae") : object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 31 17:26:34.428346 ip-10-0-138-17 kubenswrapper[2572]: E1031 17:26:34.428324    2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Oct 31 17:26:34.428432 ip-10-0-138-17 kubenswrapper[2572]: E1031 17:26:34.428382    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9179e3c5-ef52-4445-aec0-779c3e99cb07-original-pull-secret podName:9179e3c5-ef52-4445-aec0-779c3e99cb07 nodeName:}" failed. No retries permitted until 2026-10-31 17:26:36.428366641 +0000 UTC m=+6.144224317 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9179e3c5-ef52-4445-aec0-779c3e99cb07-original-pull-secret") pod "global-pull-secret-syncer-qgtf4" (UID: "9179e3c5-ef52-4445-aec0-779c3e99cb07") : object "kube-system"/"original-pull-secret" not registered
Oct 31 17:26:34.528999 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:34.528957    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-96ckd\" (UniqueName: \"kubernetes.io/projected/5d30d9b6-0431-47f2-b06c-8a03d4f59b97-kube-api-access-96ckd\") pod \"network-check-target-pqs8z\" (UID: \"5d30d9b6-0431-47f2-b06c-8a03d4f59b97\") " pod="openshift-network-diagnostics/network-check-target-pqs8z"
Oct 31 17:26:34.529197 ip-10-0-138-17 kubenswrapper[2572]: E1031 17:26:34.529178    2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Oct 31 17:26:34.529275 ip-10-0-138-17 kubenswrapper[2572]: E1031 17:26:34.529204    2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Oct 31 17:26:34.529275 ip-10-0-138-17 kubenswrapper[2572]: E1031 17:26:34.529220    2572 projected.go:196] Error preparing data for projected volume kube-api-access-96ckd for pod openshift-network-diagnostics/network-check-target-pqs8z: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 31 17:26:34.529377 ip-10-0-138-17 kubenswrapper[2572]: E1031 17:26:34.529282    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5d30d9b6-0431-47f2-b06c-8a03d4f59b97-kube-api-access-96ckd podName:5d30d9b6-0431-47f2-b06c-8a03d4f59b97 nodeName:}" failed. No retries permitted until 2026-10-31 17:26:36.529263299 +0000 UTC m=+6.245120975 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-96ckd" (UniqueName: "kubernetes.io/projected/5d30d9b6-0431-47f2-b06c-8a03d4f59b97-kube-api-access-96ckd") pod "network-check-target-pqs8z" (UID: "5d30d9b6-0431-47f2-b06c-8a03d4f59b97") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 31 17:26:34.748598 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:34.748490    2572 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-10-30 17:21:33 +0000 UTC" deadline="2028-06-15 20:56:19.868001158 +0000 UTC"
Oct 31 17:26:34.748598 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:34.748548    2572 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14235h29m45.119455903s"
Oct 31 17:26:34.765505 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:34.765469    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pqs8z"
Oct 31 17:26:34.765670 ip-10-0-138-17 kubenswrapper[2572]: E1031 17:26:34.765618    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pqs8z" podUID="5d30d9b6-0431-47f2-b06c-8a03d4f59b97"
Oct 31 17:26:34.766077 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:34.766052    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7j59v"
Oct 31 17:26:34.766193 ip-10-0-138-17 kubenswrapper[2572]: E1031 17:26:34.766170    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7j59v" podUID="449efcb2-6707-4809-b869-1bb477f6e6ae"
Oct 31 17:26:34.864013 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:34.863973    2572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-17.ec2.internal" event={"ID":"4b3b7d414562a81671be0e69748417db","Type":"ContainerStarted","Data":"eed54914fcf9cb917bfb05f1936608d942471c84e30aa161939b10a9eb565289"}
Oct 31 17:26:34.871101 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:34.871068    2572 generic.go:356] "Generic (PLEG): container finished" podID="e2864fcc74b4907ea642d1f1fb68b712" containerID="439fe4f1726cc21f40d0d24ebe3bfe45626815e406518dddc17cc12d3c0f12ab" exitCode=0
Oct 31 17:26:34.871241 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:34.871126    2572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-17.ec2.internal" event={"ID":"e2864fcc74b4907ea642d1f1fb68b712","Type":"ContainerDied","Data":"439fe4f1726cc21f40d0d24ebe3bfe45626815e406518dddc17cc12d3c0f12ab"}
Oct 31 17:26:34.946146 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:34.946074    2572 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-17.ec2.internal" podStartSLOduration=2.9460521379999998 podStartE2EDuration="2.946052138s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-31 17:26:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 17:26:34.90531962 +0000 UTC m=+4.621177310" watchObservedRunningTime="2026-10-31 17:26:34.946052138 +0000 UTC m=+4.661909834"
Oct 31 17:26:35.763240 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:35.763151    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qgtf4"
Oct 31 17:26:35.763821 ip-10-0-138-17 kubenswrapper[2572]: E1031 17:26:35.763299    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qgtf4" podUID="9179e3c5-ef52-4445-aec0-779c3e99cb07"
Oct 31 17:26:35.883184 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:35.882814    2572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-17.ec2.internal" event={"ID":"e2864fcc74b4907ea642d1f1fb68b712","Type":"ContainerStarted","Data":"282ec0cbff3ec1d79f4667a8ad22169cfbb021600ec3bac31aba7f125ba79e30"}
Oct 31 17:26:36.446616 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:36.446518    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/449efcb2-6707-4809-b869-1bb477f6e6ae-metrics-certs\") pod \"network-metrics-daemon-7j59v\" (UID: \"449efcb2-6707-4809-b869-1bb477f6e6ae\") " pod="openshift-multus/network-metrics-daemon-7j59v"
Oct 31 17:26:36.446616 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:36.446600    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9179e3c5-ef52-4445-aec0-779c3e99cb07-original-pull-secret\") pod \"global-pull-secret-syncer-qgtf4\" (UID: \"9179e3c5-ef52-4445-aec0-779c3e99cb07\") " pod="kube-system/global-pull-secret-syncer-qgtf4"
Oct 31 17:26:36.446872 ip-10-0-138-17 kubenswrapper[2572]: E1031 17:26:36.446777    2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Oct 31 17:26:36.446872 ip-10-0-138-17 kubenswrapper[2572]: E1031 17:26:36.446844    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9179e3c5-ef52-4445-aec0-779c3e99cb07-original-pull-secret podName:9179e3c5-ef52-4445-aec0-779c3e99cb07 nodeName:}" failed. No retries permitted until 2026-10-31 17:26:40.446825168 +0000 UTC m=+10.162682842 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9179e3c5-ef52-4445-aec0-779c3e99cb07-original-pull-secret") pod "global-pull-secret-syncer-qgtf4" (UID: "9179e3c5-ef52-4445-aec0-779c3e99cb07") : object "kube-system"/"original-pull-secret" not registered
Oct 31 17:26:36.447309 ip-10-0-138-17 kubenswrapper[2572]: E1031 17:26:36.447286    2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 31 17:26:36.447424 ip-10-0-138-17 kubenswrapper[2572]: E1031 17:26:36.447348    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/449efcb2-6707-4809-b869-1bb477f6e6ae-metrics-certs podName:449efcb2-6707-4809-b869-1bb477f6e6ae nodeName:}" failed. No retries permitted until 2026-10-31 17:26:40.447330353 +0000 UTC m=+10.163188028 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/449efcb2-6707-4809-b869-1bb477f6e6ae-metrics-certs") pod "network-metrics-daemon-7j59v" (UID: "449efcb2-6707-4809-b869-1bb477f6e6ae") : object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 31 17:26:36.547458 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:36.547419    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-96ckd\" (UniqueName: \"kubernetes.io/projected/5d30d9b6-0431-47f2-b06c-8a03d4f59b97-kube-api-access-96ckd\") pod \"network-check-target-pqs8z\" (UID: \"5d30d9b6-0431-47f2-b06c-8a03d4f59b97\") " pod="openshift-network-diagnostics/network-check-target-pqs8z"
Oct 31 17:26:36.547639 ip-10-0-138-17 kubenswrapper[2572]: E1031 17:26:36.547586    2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Oct 31 17:26:36.547639 ip-10-0-138-17 kubenswrapper[2572]: E1031 17:26:36.547616    2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Oct 31 17:26:36.547639 ip-10-0-138-17 kubenswrapper[2572]: E1031 17:26:36.547631    2572 projected.go:196] Error preparing data for projected volume kube-api-access-96ckd for pod openshift-network-diagnostics/network-check-target-pqs8z: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 31 17:26:36.547862 ip-10-0-138-17 kubenswrapper[2572]: E1031 17:26:36.547729    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5d30d9b6-0431-47f2-b06c-8a03d4f59b97-kube-api-access-96ckd podName:5d30d9b6-0431-47f2-b06c-8a03d4f59b97 nodeName:}" failed. No retries permitted until 2026-10-31 17:26:40.547674582 +0000 UTC m=+10.263532254 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-96ckd" (UniqueName: "kubernetes.io/projected/5d30d9b6-0431-47f2-b06c-8a03d4f59b97-kube-api-access-96ckd") pod "network-check-target-pqs8z" (UID: "5d30d9b6-0431-47f2-b06c-8a03d4f59b97") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 31 17:26:36.764938 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:36.764849    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pqs8z"
Oct 31 17:26:36.765408 ip-10-0-138-17 kubenswrapper[2572]: E1031 17:26:36.764994    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pqs8z" podUID="5d30d9b6-0431-47f2-b06c-8a03d4f59b97"
Oct 31 17:26:36.765408 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:36.765225    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7j59v"
Oct 31 17:26:36.765408 ip-10-0-138-17 kubenswrapper[2572]: E1031 17:26:36.765360    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7j59v" podUID="449efcb2-6707-4809-b869-1bb477f6e6ae"
Oct 31 17:26:36.891227 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:36.891183    2572 generic.go:356] "Generic (PLEG): container finished" podID="fe1c5f7c-fdfd-40b9-bc0f-4e018779ee2b" containerID="fceec909280145ea6548f799b6ca8a62d6ebaf3f39423dfb8ce01da685c4b0db" exitCode=0
Oct 31 17:26:36.892467 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:36.892443    2572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-swb7n" event={"ID":"fe1c5f7c-fdfd-40b9-bc0f-4e018779ee2b","Type":"ContainerDied","Data":"fceec909280145ea6548f799b6ca8a62d6ebaf3f39423dfb8ce01da685c4b0db"}
Oct 31 17:26:36.966716 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:36.966647    2572 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-17.ec2.internal" podStartSLOduration=4.966627894 podStartE2EDuration="4.966627894s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-31 17:26:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 17:26:35.926067103 +0000 UTC m=+5.641924836" watchObservedRunningTime="2026-10-31 17:26:36.966627894 +0000 UTC m=+6.682485590"
Oct 31 17:26:37.762328 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:37.762293    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qgtf4"
Oct 31 17:26:37.762519 ip-10-0-138-17 kubenswrapper[2572]: E1031 17:26:37.762439    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qgtf4" podUID="9179e3c5-ef52-4445-aec0-779c3e99cb07"
Oct 31 17:26:37.905169 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:37.904746    2572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-vghkb" event={"ID":"86312227-efeb-4196-ab2d-3b4b03e5c50f","Type":"ContainerStarted","Data":"6fac45ea5badecc3ff8a646588f0c34c1fdef8d3a7ad148becfb27a6e9527827"}
Oct 31 17:26:38.765148 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:38.765116    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7j59v"
Oct 31 17:26:38.765299 ip-10-0-138-17 kubenswrapper[2572]: E1031 17:26:38.765255    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7j59v" podUID="449efcb2-6707-4809-b869-1bb477f6e6ae"
Oct 31 17:26:38.765679 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:38.765658    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pqs8z"
Oct 31 17:26:38.765787 ip-10-0-138-17 kubenswrapper[2572]: E1031 17:26:38.765751    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pqs8z" podUID="5d30d9b6-0431-47f2-b06c-8a03d4f59b97"
Oct 31 17:26:38.912826 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:38.912667    2572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ldjrw" event={"ID":"88be474b-fd0b-4784-8f1c-2dc0bdfb2792","Type":"ContainerStarted","Data":"b61826972d9e779e1428bdc5aa6d5a4a015dddcf98bd1a8939580589f458d62c"}
Oct 31 17:26:38.915770 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:38.915621    2572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-lcz9q" event={"ID":"c915138c-9050-4958-b442-fee1aca9b002","Type":"ContainerStarted","Data":"42fdd7584ee1d38616097630da9ee021ec9433be6148ab7ef0f2ff3b61088448"}
Oct 31 17:26:38.954015 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:38.953963    2572 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/konnectivity-agent-vghkb" podStartSLOduration=3.719755074 podStartE2EDuration="7.953945347s" totalImagesPullingTime="4.234190273s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 17:26:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 17:26:37.948853155 +0000 UTC m=+7.664710850" watchObservedRunningTime="2026-10-31 17:26:38.953945347 +0000 UTC m=+8.669803038"
Oct 31 17:26:39.763283 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:39.762687    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qgtf4"
Oct 31 17:26:39.763283 ip-10-0-138-17 kubenswrapper[2572]: E1031 17:26:39.762858    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qgtf4" podUID="9179e3c5-ef52-4445-aec0-779c3e99cb07"
Oct 31 17:26:40.392387 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:40.392317    2572 plugin_watcher.go:201] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Oct 31 17:26:40.480334 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:40.480249    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/449efcb2-6707-4809-b869-1bb477f6e6ae-metrics-certs\") pod \"network-metrics-daemon-7j59v\" (UID: \"449efcb2-6707-4809-b869-1bb477f6e6ae\") " pod="openshift-multus/network-metrics-daemon-7j59v"
Oct 31 17:26:40.480543 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:40.480414    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9179e3c5-ef52-4445-aec0-779c3e99cb07-original-pull-secret\") pod \"global-pull-secret-syncer-qgtf4\" (UID: \"9179e3c5-ef52-4445-aec0-779c3e99cb07\") " pod="kube-system/global-pull-secret-syncer-qgtf4"
Oct 31 17:26:40.480543 ip-10-0-138-17 kubenswrapper[2572]: E1031 17:26:40.480417    2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 31 17:26:40.480686 ip-10-0-138-17 kubenswrapper[2572]: E1031 17:26:40.480558    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/449efcb2-6707-4809-b869-1bb477f6e6ae-metrics-certs podName:449efcb2-6707-4809-b869-1bb477f6e6ae nodeName:}" failed. No retries permitted until 2026-10-31 17:26:48.480539823 +0000 UTC m=+18.196397511 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/449efcb2-6707-4809-b869-1bb477f6e6ae-metrics-certs") pod "network-metrics-daemon-7j59v" (UID: "449efcb2-6707-4809-b869-1bb477f6e6ae") : object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 31 17:26:40.480904 ip-10-0-138-17 kubenswrapper[2572]: E1031 17:26:40.480459    2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Oct 31 17:26:40.480962 ip-10-0-138-17 kubenswrapper[2572]: E1031 17:26:40.480954    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9179e3c5-ef52-4445-aec0-779c3e99cb07-original-pull-secret podName:9179e3c5-ef52-4445-aec0-779c3e99cb07 nodeName:}" failed. No retries permitted until 2026-10-31 17:26:48.480934 +0000 UTC m=+18.196791669 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9179e3c5-ef52-4445-aec0-779c3e99cb07-original-pull-secret") pod "global-pull-secret-syncer-qgtf4" (UID: "9179e3c5-ef52-4445-aec0-779c3e99cb07") : object "kube-system"/"original-pull-secret" not registered
Oct 31 17:26:40.581121 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:40.581088    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-96ckd\" (UniqueName: \"kubernetes.io/projected/5d30d9b6-0431-47f2-b06c-8a03d4f59b97-kube-api-access-96ckd\") pod \"network-check-target-pqs8z\" (UID: \"5d30d9b6-0431-47f2-b06c-8a03d4f59b97\") " pod="openshift-network-diagnostics/network-check-target-pqs8z"
Oct 31 17:26:40.581298 ip-10-0-138-17 kubenswrapper[2572]: E1031 17:26:40.581218    2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Oct 31 17:26:40.581298 ip-10-0-138-17 kubenswrapper[2572]: E1031 17:26:40.581234    2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Oct 31 17:26:40.581298 ip-10-0-138-17 kubenswrapper[2572]: E1031 17:26:40.581243    2572 projected.go:196] Error preparing data for projected volume kube-api-access-96ckd for pod openshift-network-diagnostics/network-check-target-pqs8z: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 31 17:26:40.581298 ip-10-0-138-17 kubenswrapper[2572]: E1031 17:26:40.581287    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5d30d9b6-0431-47f2-b06c-8a03d4f59b97-kube-api-access-96ckd podName:5d30d9b6-0431-47f2-b06c-8a03d4f59b97 nodeName:}" failed. No retries permitted until 2026-10-31 17:26:48.581275071 +0000 UTC m=+18.297132752 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-96ckd" (UniqueName: "kubernetes.io/projected/5d30d9b6-0431-47f2-b06c-8a03d4f59b97-kube-api-access-96ckd") pod "network-check-target-pqs8z" (UID: "5d30d9b6-0431-47f2-b06c-8a03d4f59b97") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 31 17:26:40.758538 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:40.758428    2572 reconciler.go:167] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-10-31T17:26:40.392342117Z","UUID":"329acd89-4d1a-4671-8eaf-028a62359fbd","Handler":null,"Name":"","Endpoint":""}
Oct 31 17:26:40.761146 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:40.761118    2572 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Oct 31 17:26:40.761283 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:40.761169    2572 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Oct 31 17:26:40.764000 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:40.763496    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7j59v"
Oct 31 17:26:40.764000 ip-10-0-138-17 kubenswrapper[2572]: E1031 17:26:40.763632    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7j59v" podUID="449efcb2-6707-4809-b869-1bb477f6e6ae"
Oct 31 17:26:40.764000 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:40.763668    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pqs8z"
Oct 31 17:26:40.764000 ip-10-0-138-17 kubenswrapper[2572]: E1031 17:26:40.763771    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pqs8z" podUID="5d30d9b6-0431-47f2-b06c-8a03d4f59b97"
Oct 31 17:26:40.929913 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:40.929816    2572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ldjrw" event={"ID":"88be474b-fd0b-4784-8f1c-2dc0bdfb2792","Type":"ContainerStarted","Data":"d361fc84ea44cd2ac529dcbb72ab1a896ff2d690d5414ab826ecadf023532ac6"}
Oct 31 17:26:40.932363 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:40.931724    2572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-9zs6c" event={"ID":"27af0f99-138f-42ac-89b9-9dfc4a522483","Type":"ContainerStarted","Data":"e8dd0748b95cd9fc962bac992acd2def02054283c966821918833b1ba1509f28"}
Oct 31 17:26:40.974033 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:40.973435    2572 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-image-registry/node-ca-lcz9q" podStartSLOduration=5.039786791 podStartE2EDuration="9.97341712s" totalImagesPullingTime="4.933630329s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-31 17:26:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 17:26:38.954333567 +0000 UTC m=+8.670191255" watchObservedRunningTime="2026-10-31 17:26:40.97341712 +0000 UTC m=+10.689274814"
Oct 31 17:26:40.974033 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:40.973792    2572 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-multus/multus-9zs6c" podStartSLOduration=2.4121430200000002 podStartE2EDuration="9.973779325s" totalImagesPullingTime="7.561636305s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-31 17:26:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 17:26:40.972776024 +0000 UTC m=+10.688633715" watchObservedRunningTime="2026-10-31 17:26:40.973779325 +0000 UTC m=+10.689637018"
Oct 31 17:26:41.763312 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:41.763131    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qgtf4"
Oct 31 17:26:41.763693 ip-10-0-138-17 kubenswrapper[2572]: E1031 17:26:41.763397    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qgtf4" podUID="9179e3c5-ef52-4445-aec0-779c3e99cb07"
Oct 31 17:26:41.935507 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:41.935468    2572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-x25tg" event={"ID":"eaed4088-d322-48ab-af04-3c9efdea4e73","Type":"ContainerStarted","Data":"dca2a04aaa7d264a4d3dc121d1d01fa24990432aa7f4002965b02582987689d2"}
Oct 31 17:26:41.938028 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:41.937994    2572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ldjrw" event={"ID":"88be474b-fd0b-4784-8f1c-2dc0bdfb2792","Type":"ContainerStarted","Data":"ebbe910008600b47e35159b304187119ef0ada59bd5880d98b3979ad0f288f7d"}
Oct 31 17:26:41.940213 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:41.940190    2572 generic.go:356] "Generic (PLEG): container finished" podID="fe1c5f7c-fdfd-40b9-bc0f-4e018779ee2b" containerID="565c7dd2f6eebea522f5f930b65a6da8351a70fcc5642cd9880ae7fec4c74578" exitCode=0
Oct 31 17:26:41.940339 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:41.940277    2572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-swb7n" event={"ID":"fe1c5f7c-fdfd-40b9-bc0f-4e018779ee2b","Type":"ContainerDied","Data":"565c7dd2f6eebea522f5f930b65a6da8351a70fcc5642cd9880ae7fec4c74578"}
Oct 31 17:26:41.973664 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:41.973596    2572 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-dns/node-resolver-x25tg" podStartSLOduration=2.91131638 podStartE2EDuration="10.973578507s" totalImagesPullingTime="8.062262127s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-31 17:26:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 17:26:41.973374131 +0000 UTC m=+11.689231932" watchObservedRunningTime="2026-10-31 17:26:41.973578507 +0000 UTC m=+11.689436200"
Oct 31 17:26:42.013376 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:42.013284    2572 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ldjrw" podStartSLOduration=2.879434437 podStartE2EDuration="11.013269976s" totalImagesPullingTime="8.133835539s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-31 17:26:31 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 17:26:42.012594684 +0000 UTC m=+11.728452376" watchObservedRunningTime="2026-10-31 17:26:42.013269976 +0000 UTC m=+11.729127665"
Oct 31 17:26:42.542029 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:42.541994    2572 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-vghkb"
Oct 31 17:26:42.542827 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:42.542812    2572 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-vghkb"
Oct 31 17:26:42.762603 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:42.762569    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7j59v"
Oct 31 17:26:42.762786 ip-10-0-138-17 kubenswrapper[2572]: E1031 17:26:42.762754    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7j59v" podUID="449efcb2-6707-4809-b869-1bb477f6e6ae"
Oct 31 17:26:42.763117 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:42.762568    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pqs8z"
Oct 31 17:26:42.763236 ip-10-0-138-17 kubenswrapper[2572]: E1031 17:26:42.763213    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pqs8z" podUID="5d30d9b6-0431-47f2-b06c-8a03d4f59b97"
Oct 31 17:26:42.945677 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:42.945491    2572 generic.go:356] "Generic (PLEG): container finished" podID="fe1c5f7c-fdfd-40b9-bc0f-4e018779ee2b" containerID="e097b1d59b8a3b00976ac29432d8f725fd9a3d079b52bb8de76a34904d35717d" exitCode=0
Oct 31 17:26:42.945677 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:42.945541    2572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-swb7n" event={"ID":"fe1c5f7c-fdfd-40b9-bc0f-4e018779ee2b","Type":"ContainerDied","Data":"e097b1d59b8a3b00976ac29432d8f725fd9a3d079b52bb8de76a34904d35717d"}
Oct 31 17:26:43.762238 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:43.762215    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qgtf4"
Oct 31 17:26:43.762362 ip-10-0-138-17 kubenswrapper[2572]: E1031 17:26:43.762313    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qgtf4" podUID="9179e3c5-ef52-4445-aec0-779c3e99cb07"
Oct 31 17:26:43.949894 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:43.949367    2572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-zm6cj" event={"ID":"0c8a8a3b-14dd-45c9-b8fb-baf967142fd6","Type":"ContainerStarted","Data":"8f1a7b125a880b01099ac1e11829e03b32a59657e968b162986c7f323bdb2c32"}
Oct 31 17:26:43.952190 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:43.952165    2572 generic.go:356] "Generic (PLEG): container finished" podID="fe1c5f7c-fdfd-40b9-bc0f-4e018779ee2b" containerID="de148cf762fc62c0691a225b4b49d5244a076eab71e7b4071f1d515c0a312a16" exitCode=0
Oct 31 17:26:43.952319 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:43.952241    2572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-swb7n" event={"ID":"fe1c5f7c-fdfd-40b9-bc0f-4e018779ee2b","Type":"ContainerDied","Data":"de148cf762fc62c0691a225b4b49d5244a076eab71e7b4071f1d515c0a312a16"}
Oct 31 17:26:43.953766 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:43.953744    2572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-h8jzv" event={"ID":"b1e258da-4619-478c-895a-041aa7eeafb6","Type":"ContainerStarted","Data":"37db7cf499b6e01271562895d5a6bfa3abe029a2c12fe820c018fa03445dd3dd"}
Oct 31 17:26:44.027695 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:44.027596    2572 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-zm6cj" podStartSLOduration=2.795405729 podStartE2EDuration="13.027582906s" totalImagesPullingTime="10.232177177s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-31 17:26:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 17:26:43.987726619 +0000 UTC m=+13.703584312" watchObservedRunningTime="2026-10-31 17:26:44.027582906 +0000 UTC m=+13.743440596"
Oct 31 17:26:44.069163 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:44.069107    2572 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-h8jzv" podStartSLOduration=4.6693829000000004 podStartE2EDuration="13.06909363s" totalImagesPullingTime="8.39971073s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-31 17:26:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 17:26:44.027564921 +0000 UTC m=+13.743422610" watchObservedRunningTime="2026-10-31 17:26:44.06909363 +0000 UTC m=+13.784951323"
Oct 31 17:26:44.113113 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:44.112607    2572 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-vghkb"
Oct 31 17:26:44.113113 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:44.112731    2572 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness"
Oct 31 17:26:44.113330 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:44.113243    2572 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-vghkb"
Oct 31 17:26:44.765161 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:44.764701    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7j59v"
Oct 31 17:26:44.765161 ip-10-0-138-17 kubenswrapper[2572]: E1031 17:26:44.764836    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7j59v" podUID="449efcb2-6707-4809-b869-1bb477f6e6ae"
Oct 31 17:26:44.765161 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:44.764909    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pqs8z"
Oct 31 17:26:44.765161 ip-10-0-138-17 kubenswrapper[2572]: E1031 17:26:44.764968    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pqs8z" podUID="5d30d9b6-0431-47f2-b06c-8a03d4f59b97"
Oct 31 17:26:45.762865 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:45.762827    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qgtf4"
Oct 31 17:26:45.763296 ip-10-0-138-17 kubenswrapper[2572]: E1031 17:26:45.762940    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qgtf4" podUID="9179e3c5-ef52-4445-aec0-779c3e99cb07"
Oct 31 17:26:46.762430 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:46.762400    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7j59v"
Oct 31 17:26:46.762430 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:46.762430    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pqs8z"
Oct 31 17:26:46.762665 ip-10-0-138-17 kubenswrapper[2572]: E1031 17:26:46.762546    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7j59v" podUID="449efcb2-6707-4809-b869-1bb477f6e6ae"
Oct 31 17:26:46.763028 ip-10-0-138-17 kubenswrapper[2572]: E1031 17:26:46.762998    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pqs8z" podUID="5d30d9b6-0431-47f2-b06c-8a03d4f59b97"
Oct 31 17:26:46.964285 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:46.964248    2572 generic.go:356] "Generic (PLEG): container finished" podID="fe1c5f7c-fdfd-40b9-bc0f-4e018779ee2b" containerID="33590bd96c9d4362b81d28ca33519beccd69e11f8bd501a356a2f47dc2b0459e" exitCode=0
Oct 31 17:26:46.964465 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:46.964295    2572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-swb7n" event={"ID":"fe1c5f7c-fdfd-40b9-bc0f-4e018779ee2b","Type":"ContainerDied","Data":"33590bd96c9d4362b81d28ca33519beccd69e11f8bd501a356a2f47dc2b0459e"}
Oct 31 17:26:47.763047 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:47.763016    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qgtf4"
Oct 31 17:26:47.763550 ip-10-0-138-17 kubenswrapper[2572]: E1031 17:26:47.763133    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qgtf4" podUID="9179e3c5-ef52-4445-aec0-779c3e99cb07"
Oct 31 17:26:47.968994 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:47.968959    2572 generic.go:356] "Generic (PLEG): container finished" podID="fe1c5f7c-fdfd-40b9-bc0f-4e018779ee2b" containerID="a8a29f08cdc945ab8d77e4f123871fbc277447b179c557ed4c39bda76313bc2d" exitCode=0
Oct 31 17:26:47.969153 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:47.969027    2572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-swb7n" event={"ID":"fe1c5f7c-fdfd-40b9-bc0f-4e018779ee2b","Type":"ContainerDied","Data":"a8a29f08cdc945ab8d77e4f123871fbc277447b179c557ed4c39bda76313bc2d"}
Oct 31 17:26:48.539568 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:48.539346    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9179e3c5-ef52-4445-aec0-779c3e99cb07-original-pull-secret\") pod \"global-pull-secret-syncer-qgtf4\" (UID: \"9179e3c5-ef52-4445-aec0-779c3e99cb07\") " pod="kube-system/global-pull-secret-syncer-qgtf4"
Oct 31 17:26:48.539568 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:48.539561    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/449efcb2-6707-4809-b869-1bb477f6e6ae-metrics-certs\") pod \"network-metrics-daemon-7j59v\" (UID: \"449efcb2-6707-4809-b869-1bb477f6e6ae\") " pod="openshift-multus/network-metrics-daemon-7j59v"
Oct 31 17:26:48.539760 ip-10-0-138-17 kubenswrapper[2572]: E1031 17:26:48.539485    2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Oct 31 17:26:48.539760 ip-10-0-138-17 kubenswrapper[2572]: E1031 17:26:48.539639    2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 31 17:26:48.539760 ip-10-0-138-17 kubenswrapper[2572]: E1031 17:26:48.539680    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9179e3c5-ef52-4445-aec0-779c3e99cb07-original-pull-secret podName:9179e3c5-ef52-4445-aec0-779c3e99cb07 nodeName:}" failed. No retries permitted until 2026-10-31 17:27:04.539662995 +0000 UTC m=+34.255520683 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9179e3c5-ef52-4445-aec0-779c3e99cb07-original-pull-secret") pod "global-pull-secret-syncer-qgtf4" (UID: "9179e3c5-ef52-4445-aec0-779c3e99cb07") : object "kube-system"/"original-pull-secret" not registered
Oct 31 17:26:48.539760 ip-10-0-138-17 kubenswrapper[2572]: E1031 17:26:48.539702    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/449efcb2-6707-4809-b869-1bb477f6e6ae-metrics-certs podName:449efcb2-6707-4809-b869-1bb477f6e6ae nodeName:}" failed. No retries permitted until 2026-10-31 17:27:04.539691729 +0000 UTC m=+34.255549397 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/449efcb2-6707-4809-b869-1bb477f6e6ae-metrics-certs") pod "network-metrics-daemon-7j59v" (UID: "449efcb2-6707-4809-b869-1bb477f6e6ae") : object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 31 17:26:48.640798 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:48.640771    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-96ckd\" (UniqueName: \"kubernetes.io/projected/5d30d9b6-0431-47f2-b06c-8a03d4f59b97-kube-api-access-96ckd\") pod \"network-check-target-pqs8z\" (UID: \"5d30d9b6-0431-47f2-b06c-8a03d4f59b97\") " pod="openshift-network-diagnostics/network-check-target-pqs8z"
Oct 31 17:26:48.640966 ip-10-0-138-17 kubenswrapper[2572]: E1031 17:26:48.640915    2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Oct 31 17:26:48.640966 ip-10-0-138-17 kubenswrapper[2572]: E1031 17:26:48.640932    2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Oct 31 17:26:48.640966 ip-10-0-138-17 kubenswrapper[2572]: E1031 17:26:48.640945    2572 projected.go:196] Error preparing data for projected volume kube-api-access-96ckd for pod openshift-network-diagnostics/network-check-target-pqs8z: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 31 17:26:48.641080 ip-10-0-138-17 kubenswrapper[2572]: E1031 17:26:48.640990    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5d30d9b6-0431-47f2-b06c-8a03d4f59b97-kube-api-access-96ckd podName:5d30d9b6-0431-47f2-b06c-8a03d4f59b97 nodeName:}" failed. No retries permitted until 2026-10-31 17:27:04.64097744 +0000 UTC m=+34.356835108 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-96ckd" (UniqueName: "kubernetes.io/projected/5d30d9b6-0431-47f2-b06c-8a03d4f59b97-kube-api-access-96ckd") pod "network-check-target-pqs8z" (UID: "5d30d9b6-0431-47f2-b06c-8a03d4f59b97") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 31 17:26:48.762765 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:48.762732    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7j59v"
Oct 31 17:26:48.762765 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:48.762768    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pqs8z"
Oct 31 17:26:48.762996 ip-10-0-138-17 kubenswrapper[2572]: E1031 17:26:48.762866    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7j59v" podUID="449efcb2-6707-4809-b869-1bb477f6e6ae"
Oct 31 17:26:48.762996 ip-10-0-138-17 kubenswrapper[2572]: E1031 17:26:48.762973    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pqs8z" podUID="5d30d9b6-0431-47f2-b06c-8a03d4f59b97"
Oct 31 17:26:48.974183 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:48.974144    2572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-v8sbm" event={"ID":"ef27850a-20b3-4876-8330-57e8954f1a79","Type":"ContainerStarted","Data":"12815f2398e74d995bdc2f5401a7ec817fac862810c8750d0bce7ba60e8c00a6"}
Oct 31 17:26:48.974714 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:48.974229    2572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-v8sbm" event={"ID":"ef27850a-20b3-4876-8330-57e8954f1a79","Type":"ContainerStarted","Data":"a1b1f1fa44df44d5e97420c3f2dfb387948f331927f4cb93d607f6973f04bf0c"}
Oct 31 17:26:48.974714 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:48.974263    2572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-v8sbm" event={"ID":"ef27850a-20b3-4876-8330-57e8954f1a79","Type":"ContainerStarted","Data":"3e4371a554763ac213b25864dcf718cb72d320b3b58127826061b62d9a39f6f7"}
Oct 31 17:26:48.974714 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:48.974290    2572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-v8sbm" event={"ID":"ef27850a-20b3-4876-8330-57e8954f1a79","Type":"ContainerStarted","Data":"33fc8dd3d114da91cacbbc2461966babb22001b0f7ed1e366351147aad145dfb"}
Oct 31 17:26:48.974714 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:48.974317    2572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-v8sbm" event={"ID":"ef27850a-20b3-4876-8330-57e8954f1a79","Type":"ContainerStarted","Data":"ea1c8adfa83c952d00d00869498fbe301f7568ce890f6be303193e130441a721"}
Oct 31 17:26:48.974714 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:48.974351    2572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-v8sbm" event={"ID":"ef27850a-20b3-4876-8330-57e8954f1a79","Type":"ContainerStarted","Data":"ac7492f9ea1a329a9ddeda86a3d1c838c1707b69b0b44dcf7f91c85b9e6c9e12"}
Oct 31 17:26:48.977223 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:48.977197    2572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-swb7n" event={"ID":"fe1c5f7c-fdfd-40b9-bc0f-4e018779ee2b","Type":"ContainerStarted","Data":"2529636d9fbfe3c8f49285f2c3d20b39e14369aa23fe0a707b201c29f3b34fe4"}
Oct 31 17:26:49.020480 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:49.020430    2572 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-swb7n" podStartSLOduration=7.19971553 podStartE2EDuration="18.020419022s" totalImagesPullingTime="10.820703492s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-31 17:26:31 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 17:26:49.020027402 +0000 UTC m=+18.735885203" watchObservedRunningTime="2026-10-31 17:26:49.020419022 +0000 UTC m=+18.736276712"
Oct 31 17:26:49.762485 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:49.762453    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qgtf4"
Oct 31 17:26:49.762678 ip-10-0-138-17 kubenswrapper[2572]: E1031 17:26:49.762548    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qgtf4" podUID="9179e3c5-ef52-4445-aec0-779c3e99cb07"
Oct 31 17:26:50.763158 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:50.763074    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7j59v"
Oct 31 17:26:50.763749 ip-10-0-138-17 kubenswrapper[2572]: E1031 17:26:50.763245    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7j59v" podUID="449efcb2-6707-4809-b869-1bb477f6e6ae"
Oct 31 17:26:50.763749 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:50.763281    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pqs8z"
Oct 31 17:26:50.763749 ip-10-0-138-17 kubenswrapper[2572]: E1031 17:26:50.763398    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pqs8z" podUID="5d30d9b6-0431-47f2-b06c-8a03d4f59b97"
Oct 31 17:26:50.984226 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:50.984191    2572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-v8sbm" event={"ID":"ef27850a-20b3-4876-8330-57e8954f1a79","Type":"ContainerStarted","Data":"aacad4a9385e3759f931fe1f68c94ee372ff611f2677a01bf439735eebe115e5"}
Oct 31 17:26:51.762277 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:51.762245    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qgtf4"
Oct 31 17:26:51.762447 ip-10-0-138-17 kubenswrapper[2572]: E1031 17:26:51.762345    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qgtf4" podUID="9179e3c5-ef52-4445-aec0-779c3e99cb07"
Oct 31 17:26:52.762729 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:52.762630    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7j59v"
Oct 31 17:26:52.763344 ip-10-0-138-17 kubenswrapper[2572]: E1031 17:26:52.762786    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7j59v" podUID="449efcb2-6707-4809-b869-1bb477f6e6ae"
Oct 31 17:26:52.763344 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:52.762831    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pqs8z"
Oct 31 17:26:52.763344 ip-10-0-138-17 kubenswrapper[2572]: E1031 17:26:52.762932    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pqs8z" podUID="5d30d9b6-0431-47f2-b06c-8a03d4f59b97"
Oct 31 17:26:52.992466 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:52.992433    2572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-v8sbm" event={"ID":"ef27850a-20b3-4876-8330-57e8954f1a79","Type":"ContainerStarted","Data":"562cf54cbec0a6cf6399467ecb9c6b5992b3e3da6d0cd3354c21b3176c72a16b"}
Oct 31 17:26:52.992700 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:52.992682    2572 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-v8sbm"
Oct 31 17:26:53.008497 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:53.008473    2572 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-v8sbm"
Oct 31 17:26:53.077119 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:53.077070    2572 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-v8sbm" podStartSLOduration=7.172488176 podStartE2EDuration="22.077058304s" totalImagesPullingTime="14.904570128s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-31 17:26:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 17:26:53.064441605 +0000 UTC m=+22.780299309" watchObservedRunningTime="2026-10-31 17:26:53.077058304 +0000 UTC m=+22.792915994"
Oct 31 17:26:53.763283 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:53.763251    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qgtf4"
Oct 31 17:26:53.763749 ip-10-0-138-17 kubenswrapper[2572]: E1031 17:26:53.763364    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qgtf4" podUID="9179e3c5-ef52-4445-aec0-779c3e99cb07"
Oct 31 17:26:53.994932 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:53.994904    2572 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-v8sbm"
Oct 31 17:26:53.995101 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:53.994983    2572 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-v8sbm"
Oct 31 17:26:54.010267 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:54.010242    2572 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-v8sbm"
Oct 31 17:26:54.563760 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:54.563728    2572 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-qgtf4"]
Oct 31 17:26:54.564023 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:54.563849    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qgtf4"
Oct 31 17:26:54.564023 ip-10-0-138-17 kubenswrapper[2572]: E1031 17:26:54.563952    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qgtf4" podUID="9179e3c5-ef52-4445-aec0-779c3e99cb07"
Oct 31 17:26:54.566911 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:54.566873    2572 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-pqs8z"]
Oct 31 17:26:54.567057 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:54.566998    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pqs8z"
Oct 31 17:26:54.567111 ip-10-0-138-17 kubenswrapper[2572]: E1031 17:26:54.567095    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pqs8z" podUID="5d30d9b6-0431-47f2-b06c-8a03d4f59b97"
Oct 31 17:26:54.567500 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:54.567476    2572 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-7j59v"]
Oct 31 17:26:54.567596 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:54.567584    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7j59v"
Oct 31 17:26:54.567700 ip-10-0-138-17 kubenswrapper[2572]: E1031 17:26:54.567685    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7j59v" podUID="449efcb2-6707-4809-b869-1bb477f6e6ae"
Oct 31 17:26:56.762674 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:56.762628    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7j59v"
Oct 31 17:26:56.762674 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:56.762662    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pqs8z"
Oct 31 17:26:56.763125 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:56.762870    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qgtf4"
Oct 31 17:26:56.763125 ip-10-0-138-17 kubenswrapper[2572]: E1031 17:26:56.762872    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7j59v" podUID="449efcb2-6707-4809-b869-1bb477f6e6ae"
Oct 31 17:26:56.763125 ip-10-0-138-17 kubenswrapper[2572]: E1031 17:26:56.762979    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pqs8z" podUID="5d30d9b6-0431-47f2-b06c-8a03d4f59b97"
Oct 31 17:26:56.763125 ip-10-0-138-17 kubenswrapper[2572]: E1031 17:26:56.763066    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qgtf4" podUID="9179e3c5-ef52-4445-aec0-779c3e99cb07"
Oct 31 17:26:58.762999 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:58.762962    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qgtf4"
Oct 31 17:26:58.763530 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:58.762962    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7j59v"
Oct 31 17:26:58.763530 ip-10-0-138-17 kubenswrapper[2572]: E1031 17:26:58.763085    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qgtf4" podUID="9179e3c5-ef52-4445-aec0-779c3e99cb07"
Oct 31 17:26:58.763530 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:26:58.762965    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pqs8z"
Oct 31 17:26:58.763530 ip-10-0-138-17 kubenswrapper[2572]: E1031 17:26:58.763144    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7j59v" podUID="449efcb2-6707-4809-b869-1bb477f6e6ae"
Oct 31 17:26:58.763530 ip-10-0-138-17 kubenswrapper[2572]: E1031 17:26:58.763233    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pqs8z" podUID="5d30d9b6-0431-47f2-b06c-8a03d4f59b97"
Oct 31 17:27:00.132270 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:00.132245    2572 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-138-17.ec2.internal" event="NodeReady"
Oct 31 17:27:00.132621 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:00.132422    2572 kubelet_node_status.go:477] "Fast updating node status as it just became ready"
Oct 31 17:27:00.178778 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:00.178743    2572 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-86c478bb88-rnvgv"]
Oct 31 17:27:00.185982 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:00.185948    2572 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kube-system/kas-connection-checker-685895c7c9-kgdxw"]
Oct 31 17:27:00.187399 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:00.187369    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-86c478bb88-rnvgv"
Oct 31 17:27:00.189236 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:00.189214    2572 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-7cd56b8dbc-b2xxw"]
Oct 31 17:27:00.189348 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:00.189333    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kas-connection-checker-685895c7c9-kgdxw"
Oct 31 17:27:00.192201 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:00.192178    2572 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kube-system/kas-connection-checker-685895c7c9-6pnp6"]
Oct 31 17:27:00.192308 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:00.192271    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-7cd56b8dbc-b2xxw"
Oct 31 17:27:00.197408 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:00.197387    2572 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-884576c57-csbxp"]
Oct 31 17:27:00.197520 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:00.197500    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kas-connection-checker-685895c7c9-6pnp6"
Oct 31 17:27:00.201874 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:00.201853    2572 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-th5tq"]
Oct 31 17:27:00.201997 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:00.201951    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-884576c57-csbxp"
Oct 31 17:27:00.204307 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:00.204286    2572 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Oct 31 17:27:00.204453 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:00.204318    2572 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Oct 31 17:27:00.204453 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:00.204374    2572 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-dockercfg-8nkt5\""
Oct 31 17:27:00.205046 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:00.205016    2572 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-544d749c8c-7lspr"]
Oct 31 17:27:00.205149 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:00.205135    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-th5tq"
Oct 31 17:27:00.209753 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:00.209730    2572 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-869fc8694f-xcqzj"]
Oct 31 17:27:00.209882 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:00.209860    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-7lspr"
Oct 31 17:27:00.210824 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:00.210803    2572 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Oct 31 17:27:00.214406 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:00.214383    2572 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-74dbfdb444-q7rkg"]
Oct 31 17:27:00.215725 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:00.215708    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-869fc8694f-xcqzj"
Oct 31 17:27:00.217884 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:00.217866    2572 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-4xtm4"]
Oct 31 17:27:00.218383 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:00.218362    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-74dbfdb444-q7rkg"
Oct 31 17:27:00.227485 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:00.227466    2572 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-rhsk4"]
Oct 31 17:27:00.228154 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:00.227588    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-4xtm4"
Oct 31 17:27:00.230956 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:00.230935    2572 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kube-system/kas-connection-checker-685895c7c9-ttbkh"]
Oct 31 17:27:00.231100 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:00.231077    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-rhsk4"
Oct 31 17:27:00.236136 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:00.236109    2572 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-65db5d9749-xvqmh"]
Oct 31 17:27:00.236564 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:00.236549    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kas-connection-checker-685895c7c9-ttbkh"
Oct 31 17:27:00.245188 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:00.245161    2572 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-7c4986d449-tggxv"]
Oct 31 17:27:00.245572 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:00.245515    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-65db5d9749-xvqmh"
Oct 31 17:27:00.250540 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:00.250441    2572 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-6f78d59f99-qkkwm"]
Oct 31 17:27:00.252033 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:00.252009    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-7c4986d449-tggxv"
Oct 31 17:27:00.253436 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:00.253414    2572 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-7v7x4"]
Oct 31 17:27:00.253632 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:00.253514    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-6f78d59f99-qkkwm"
Oct 31 17:27:00.256800 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:00.256782    2572 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-ptxt2"]
Oct 31 17:27:00.256916 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:00.256898    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-7v7x4"
Oct 31 17:27:00.261452 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:00.261432    2572 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-86c478bb88-rnvgv"]
Oct 31 17:27:00.261562 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:00.261460    2572 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/kas-connection-checker-685895c7c9-kgdxw"]
Oct 31 17:27:00.261562 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:00.261474    2572 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/kas-connection-checker-685895c7c9-6pnp6"]
Oct 31 17:27:00.261562 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:00.261487    2572 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-884576c57-csbxp"]
Oct 31 17:27:00.261562 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:00.261500    2572 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-544d749c8c-7lspr"]
Oct 31 17:27:00.261562 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:00.261513    2572 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/kas-connection-checker-685895c7c9-ttbkh"]
Oct 31 17:27:00.261562 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:00.261526    2572 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-7c4986d449-tggxv"]
Oct 31 17:27:00.261562 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:00.261534    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-ptxt2"
Oct 31 17:27:00.261958 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:00.261539    2572 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-74dbfdb444-q7rkg"]
Oct 31 17:27:00.261958 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:00.261849    2572 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-4xtm4"]
Oct 31 17:27:00.261958 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:00.261883    2572 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-869fc8694f-xcqzj"]
Oct 31 17:27:00.261958 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:00.261903    2572 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-7v7x4"]
Oct 31 17:27:00.261958 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:00.261930    2572 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-7cd56b8dbc-b2xxw"]
Oct 31 17:27:00.261958 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:00.261951    2572 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-th5tq"]
Oct 31 17:27:00.262236 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:00.261971    2572 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-65db5d9749-xvqmh"]
Oct 31 17:27:00.262236 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:00.261993    2572 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-6f78d59f99-qkkwm"]
Oct 31 17:27:00.262236 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:00.262017    2572 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-ptxt2"]
Oct 31 17:27:00.262236 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:00.262041    2572 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-rhsk4"]
Oct 31 17:27:00.304687 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:00.304658    2572 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Oct 31 17:27:00.304823 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:00.304717    2572 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Oct 31 17:27:00.304938 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:00.304914    2572 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Oct 31 17:27:00.305029 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:00.304939    2572 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Oct 31 17:27:00.305029 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:00.304997    2572 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Oct 31 17:27:00.305135 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:00.305047    2572 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Oct 31 17:27:00.305135 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:00.305114    2572 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Oct 31 17:27:00.305240 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:00.305149    2572 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Oct 31 17:27:00.305240 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:00.305156    2572 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Oct 31 17:27:00.305240 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:00.305161    2572 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"openshift-service-ca.crt\""
Oct 31 17:27:00.305240 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:00.305190    2572 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-6krd7\""
Oct 31 17:27:00.305413 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:00.305242    2572 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Oct 31 17:27:00.305585 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:00.305567    2572 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Oct 31 17:27:00.305672 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:00.305590    2572 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Oct 31 17:27:00.305672 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:00.305631    2572 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Oct 31 17:27:00.305808 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:00.305792    2572 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Oct 31 17:27:00.305867 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:00.305817    2572 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Oct 31 17:27:00.305910 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:00.305877    2572 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-42sgv\""
Oct 31 17:27:00.305966 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:00.305915    2572 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-qwvn9\""
Oct 31 17:27:00.305966 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:00.305915    2572 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Oct 31 17:27:00.306058 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:00.305972    2572 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Oct 31 17:27:00.306058 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:00.306028    2572 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Oct 31 17:27:00.306154 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:00.306090    2572 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Oct 31 17:27:00.306257 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:00.306235    2572 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Oct 31 17:27:00.306358 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:00.306329    2572 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Oct 31 17:27:00.306358 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:00.306340    2572 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Oct 31 17:27:00.306470 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:00.306380    2572 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-dwhr5\""
Oct 31 17:27:00.306470 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:00.306389    2572 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-config\""
Oct 31 17:27:00.306470 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:00.306390    2572 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Oct 31 17:27:00.306470 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:00.306414    2572 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Oct 31 17:27:00.306470 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:00.306411    2572 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-fftjl\""
Oct 31 17:27:00.306470 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:00.306445    2572 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-2pt75\""
Oct 31 17:27:00.306738 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:00.306484    2572 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Oct 31 17:27:00.306880 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:00.306864    2572 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Oct 31 17:27:00.306964 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:00.306881    2572 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Oct 31 17:27:00.306964 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:00.306942    2572 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"kube-root-ca.crt\""
Oct 31 17:27:00.307050 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:00.306995    2572 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-27h6r\""
Oct 31 17:27:00.317571 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:00.317555    2572 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Oct 31 17:27:00.317571 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:00.317563    2572 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Oct 31 17:27:00.317712 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:00.317580    2572 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Oct 31 17:27:00.318198 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:00.318178    2572 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Oct 31 17:27:00.318277 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:00.318212    2572 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"ingress-canary-dockercfg-8gjvp\""
Oct 31 17:27:00.318277 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:00.318225    2572 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Oct 31 17:27:00.318277 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:00.318264    2572 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Oct 31 17:27:00.318277 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:00.318265    2572 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-t4mdx\""
Oct 31 17:27:00.318759 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:00.318287    2572 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Oct 31 17:27:00.318759 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:00.318297    2572 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-zw2xk\""
Oct 31 17:27:00.318759 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:00.318319    2572 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Oct 31 17:27:00.318759 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:00.318326    2572 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Oct 31 17:27:00.318759 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:00.318343    2572 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-v8tmg\""
Oct 31 17:27:00.318759 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:00.318370    2572 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Oct 31 17:27:00.318759 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:00.318374    2572 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Oct 31 17:27:00.318759 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:00.318424    2572 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Oct 31 17:27:00.319083 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:00.318877    2572 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-4g54t\""
Oct 31 17:27:00.321547 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:00.321528    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/8e32277f-062d-4c16-81ca-b12e65b24fbb-snapshots\") pod \"insights-operator-7c4986d449-tggxv\" (UID: \"8e32277f-062d-4c16-81ca-b12e65b24fbb\") " pod="openshift-insights/insights-operator-7c4986d449-tggxv"
Oct 31 17:27:00.321634 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:00.321555    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8e32277f-062d-4c16-81ca-b12e65b24fbb-service-ca-bundle\") pod \"insights-operator-7c4986d449-tggxv\" (UID: \"8e32277f-062d-4c16-81ca-b12e65b24fbb\") " pod="openshift-insights/insights-operator-7c4986d449-tggxv"
Oct 31 17:27:00.321634 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:00.321572    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9d9ecf7f-6a11-469b-8626-99d5ef7ffac7-bound-sa-token\") pod \"image-registry-869fc8694f-xcqzj\" (UID: \"9d9ecf7f-6a11-469b-8626-99d5ef7ffac7\") " pod="openshift-image-registry/image-registry-869fc8694f-xcqzj"
Oct 31 17:27:00.321634 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:00.321589    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6tlzl\" (UniqueName: \"kubernetes.io/projected/8a9e5aa4-f4fc-4b33-a925-8e63df6c9cd2-kube-api-access-6tlzl\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-4xtm4\" (UID: \"8a9e5aa4-f4fc-4b33-a925-8e63df6c9cd2\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-4xtm4"
Oct 31 17:27:00.321827 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:00.321669    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8e32277f-062d-4c16-81ca-b12e65b24fbb-tmp\") pod \"insights-operator-7c4986d449-tggxv\" (UID: \"8e32277f-062d-4c16-81ca-b12e65b24fbb\") " pod="openshift-insights/insights-operator-7c4986d449-tggxv"
Oct 31 17:27:00.321827 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:00.321707    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h6b47\" (UniqueName: \"kubernetes.io/projected/170ada34-8944-43d2-bcfb-1d782aae5348-kube-api-access-h6b47\") pod \"image-registry-74dbfdb444-q7rkg\" (UID: \"170ada34-8944-43d2-bcfb-1d782aae5348\") " pod="openshift-image-registry/image-registry-74dbfdb444-q7rkg"
Oct 31 17:27:00.321827 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:00.321739    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/50e82975-3344-4653-8de3-68e8a64a8757-service-ca-bundle\") pod \"router-default-65db5d9749-xvqmh\" (UID: \"50e82975-3344-4653-8de3-68e8a64a8757\") " pod="openshift-ingress/router-default-65db5d9749-xvqmh"
Oct 31 17:27:00.321827 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:00.321793    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/170ada34-8944-43d2-bcfb-1d782aae5348-ca-trust-extracted\") pod \"image-registry-74dbfdb444-q7rkg\" (UID: \"170ada34-8944-43d2-bcfb-1d782aae5348\") " pod="openshift-image-registry/image-registry-74dbfdb444-q7rkg"
Oct 31 17:27:00.321827 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:00.321819    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/170ada34-8944-43d2-bcfb-1d782aae5348-registry-certificates\") pod \"image-registry-74dbfdb444-q7rkg\" (UID: \"170ada34-8944-43d2-bcfb-1d782aae5348\") " pod="openshift-image-registry/image-registry-74dbfdb444-q7rkg"
Oct 31 17:27:00.322099 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:00.321856    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/2330cbe7-498c-4f39-ba1b-3873e125dd18-config\") pod \"service-ca-operator-544d749c8c-7lspr\" (UID: \"2330cbe7-498c-4f39-ba1b-3873e125dd18\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-7lspr"
Oct 31 17:27:00.322099 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:00.321882    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/a1bea244-6573-4e3c-9849-b27ade411c9f-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-csbxp\" (UID: \"a1bea244-6573-4e3c-9849-b27ade411c9f\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-csbxp"
Oct 31 17:27:00.322099 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:00.321911    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9d9ecf7f-6a11-469b-8626-99d5ef7ffac7-registry-tls\") pod \"image-registry-869fc8694f-xcqzj\" (UID: \"9d9ecf7f-6a11-469b-8626-99d5ef7ffac7\") " pod="openshift-image-registry/image-registry-869fc8694f-xcqzj"
Oct 31 17:27:00.322099 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:00.321935    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/8a9e5aa4-f4fc-4b33-a925-8e63df6c9cd2-serving-cert\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-4xtm4\" (UID: \"8a9e5aa4-f4fc-4b33-a925-8e63df6c9cd2\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-4xtm4"
Oct 31 17:27:00.322099 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:00.321963    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j26t9\" (UniqueName: \"kubernetes.io/projected/340f062e-e599-4620-87d1-c5be0bb1b319-kube-api-access-j26t9\") pod \"kas-connection-checker-685895c7c9-kgdxw\" (UID: \"340f062e-e599-4620-87d1-c5be0bb1b319\") " pod="kube-system/kas-connection-checker-685895c7c9-kgdxw"
Oct 31 17:27:00.322099 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:00.322009    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/170ada34-8944-43d2-bcfb-1d782aae5348-registry-tls\") pod \"image-registry-74dbfdb444-q7rkg\" (UID: \"170ada34-8944-43d2-bcfb-1d782aae5348\") " pod="openshift-image-registry/image-registry-74dbfdb444-q7rkg"
Oct 31 17:27:00.322099 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:00.322078    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v5x5x\" (UniqueName: \"kubernetes.io/projected/26373302-592f-4fd5-bd54-7ac57ef19bfd-kube-api-access-v5x5x\") pod \"kas-connection-checker-685895c7c9-6pnp6\" (UID: \"26373302-592f-4fd5-bd54-7ac57ef19bfd\") " pod="kube-system/kas-connection-checker-685895c7c9-6pnp6"
Oct 31 17:27:00.322320 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:00.322121    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8e32277f-062d-4c16-81ca-b12e65b24fbb-trusted-ca-bundle\") pod \"insights-operator-7c4986d449-tggxv\" (UID: \"8e32277f-062d-4c16-81ca-b12e65b24fbb\") " pod="openshift-insights/insights-operator-7c4986d449-tggxv"
Oct 31 17:27:00.322320 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:00.322148    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/50e82975-3344-4653-8de3-68e8a64a8757-metrics-certs\") pod \"router-default-65db5d9749-xvqmh\" (UID: \"50e82975-3344-4653-8de3-68e8a64a8757\") " pod="openshift-ingress/router-default-65db5d9749-xvqmh"
Oct 31 17:27:00.322320 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:00.322176    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j86wf\" (UniqueName: \"kubernetes.io/projected/d5856011-8f77-4e60-8ecc-c7ac852a50b0-kube-api-access-j86wf\") pod \"network-check-source-6f78d59f99-qkkwm\" (UID: \"d5856011-8f77-4e60-8ecc-c7ac852a50b0\") " pod="openshift-network-diagnostics/network-check-source-6f78d59f99-qkkwm"
Oct 31 17:27:00.322320 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:00.322196    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5x4hs\" (UniqueName: \"kubernetes.io/projected/8e32277f-062d-4c16-81ca-b12e65b24fbb-kube-api-access-5x4hs\") pod \"insights-operator-7c4986d449-tggxv\" (UID: \"8e32277f-062d-4c16-81ca-b12e65b24fbb\") " pod="openshift-insights/insights-operator-7c4986d449-tggxv"
Oct 31 17:27:00.322320 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:00.322234    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-krrzb\" (UniqueName: \"kubernetes.io/projected/ec682f92-b657-44bd-9e85-3cd4680d2f95-kube-api-access-krrzb\") pod \"cluster-samples-operator-6ddb6c8b94-rhsk4\" (UID: \"ec682f92-b657-44bd-9e85-3cd4680d2f95\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-rhsk4"
Oct 31 17:27:00.322320 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:00.322270    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rbmtq\" (UniqueName: \"kubernetes.io/projected/a7959bdf-3723-4ee9-a587-6cd16e28d4b1-kube-api-access-rbmtq\") pod \"volume-data-source-validator-58c9f5f46d-th5tq\" (UID: \"a7959bdf-3723-4ee9-a587-6cd16e28d4b1\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-th5tq"
Oct 31 17:27:00.322320 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:00.322304    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mgwcl\" (UniqueName: \"kubernetes.io/projected/9d9ecf7f-6a11-469b-8626-99d5ef7ffac7-kube-api-access-mgwcl\") pod \"image-registry-869fc8694f-xcqzj\" (UID: \"9d9ecf7f-6a11-469b-8626-99d5ef7ffac7\") " pod="openshift-image-registry/image-registry-869fc8694f-xcqzj"
Oct 31 17:27:00.322320 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:00.322322    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/25ad5c67-f563-4653-9e86-7e9ecbe78675-metrics-tls\") pod \"dns-default-7v7x4\" (UID: \"25ad5c67-f563-4653-9e86-7e9ecbe78675\") " pod="openshift-dns/dns-default-7v7x4"
Oct 31 17:27:00.322552 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:00.322338    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9d9ecf7f-6a11-469b-8626-99d5ef7ffac7-trusted-ca\") pod \"image-registry-869fc8694f-xcqzj\" (UID: \"9d9ecf7f-6a11-469b-8626-99d5ef7ffac7\") " pod="openshift-image-registry/image-registry-869fc8694f-xcqzj"
Oct 31 17:27:00.322552 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:00.322423    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/9a0cf7f7-c12d-42fe-a83e-28e1f1859cd2-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-rnvgv\" (UID: \"9a0cf7f7-c12d-42fe-a83e-28e1f1859cd2\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-rnvgv"
Oct 31 17:27:00.322552 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:00.322442    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/25ad5c67-f563-4653-9e86-7e9ecbe78675-config-volume\") pod \"dns-default-7v7x4\" (UID: \"25ad5c67-f563-4653-9e86-7e9ecbe78675\") " pod="openshift-dns/dns-default-7v7x4"
Oct 31 17:27:00.322552 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:00.322465    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f88d4\" (UniqueName: \"kubernetes.io/projected/f03611db-3bd9-401a-a137-1d4f691b51ea-kube-api-access-f88d4\") pod \"console-operator-7cd56b8dbc-b2xxw\" (UID: \"f03611db-3bd9-401a-a137-1d4f691b51ea\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-b2xxw"
Oct 31 17:27:00.322552 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:00.322514    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/50e82975-3344-4653-8de3-68e8a64a8757-stats-auth\") pod \"router-default-65db5d9749-xvqmh\" (UID: \"50e82975-3344-4653-8de3-68e8a64a8757\") " pod="openshift-ingress/router-default-65db5d9749-xvqmh"
Oct 31 17:27:00.322552 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:00.322532    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9d9ecf7f-6a11-469b-8626-99d5ef7ffac7-registry-certificates\") pod \"image-registry-869fc8694f-xcqzj\" (UID: \"9d9ecf7f-6a11-469b-8626-99d5ef7ffac7\") " pod="openshift-image-registry/image-registry-869fc8694f-xcqzj"
Oct 31 17:27:00.322552 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:00.322550    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c390ea6f-c609-40f7-a9ec-53fd5c08d857-cert\") pod \"ingress-canary-ptxt2\" (UID: \"c390ea6f-c609-40f7-a9ec-53fd5c08d857\") " pod="openshift-ingress-canary/ingress-canary-ptxt2"
Oct 31 17:27:00.322794 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:00.322564    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kqpvj\" (UniqueName: \"kubernetes.io/projected/25ad5c67-f563-4653-9e86-7e9ecbe78675-kube-api-access-kqpvj\") pod \"dns-default-7v7x4\" (UID: \"25ad5c67-f563-4653-9e86-7e9ecbe78675\") " pod="openshift-dns/dns-default-7v7x4"
Oct 31 17:27:00.322794 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:00.322582    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/9a0cf7f7-c12d-42fe-a83e-28e1f1859cd2-nginx-conf\") pod \"networking-console-plugin-86c478bb88-rnvgv\" (UID: \"9a0cf7f7-c12d-42fe-a83e-28e1f1859cd2\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-rnvgv"
Oct 31 17:27:00.322794 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:00.322633    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/170ada34-8944-43d2-bcfb-1d782aae5348-image-registry-private-configuration\") pod \"image-registry-74dbfdb444-q7rkg\" (UID: \"170ada34-8944-43d2-bcfb-1d782aae5348\") " pod="openshift-image-registry/image-registry-74dbfdb444-q7rkg"
Oct 31 17:27:00.322794 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:00.322668    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2330cbe7-498c-4f39-ba1b-3873e125dd18-serving-cert\") pod \"service-ca-operator-544d749c8c-7lspr\" (UID: \"2330cbe7-498c-4f39-ba1b-3873e125dd18\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-7lspr"
Oct 31 17:27:00.322794 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:00.322713    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/170ada34-8944-43d2-bcfb-1d782aae5348-bound-sa-token\") pod \"image-registry-74dbfdb444-q7rkg\" (UID: \"170ada34-8944-43d2-bcfb-1d782aae5348\") " pod="openshift-image-registry/image-registry-74dbfdb444-q7rkg"
Oct 31 17:27:00.322794 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:00.322758    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/ec682f92-b657-44bd-9e85-3cd4680d2f95-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-rhsk4\" (UID: \"ec682f92-b657-44bd-9e85-3cd4680d2f95\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-rhsk4"
Oct 31 17:27:00.322794 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:00.322779    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vpl4m\" (UniqueName: \"kubernetes.io/projected/a1bea244-6573-4e3c-9849-b27ade411c9f-kube-api-access-vpl4m\") pod \"cluster-monitoring-operator-884576c57-csbxp\" (UID: \"a1bea244-6573-4e3c-9849-b27ade411c9f\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-csbxp"
Oct 31 17:27:00.323091 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:00.322801    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f03611db-3bd9-401a-a137-1d4f691b51ea-trusted-ca\") pod \"console-operator-7cd56b8dbc-b2xxw\" (UID: \"f03611db-3bd9-401a-a137-1d4f691b51ea\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-b2xxw"
Oct 31 17:27:00.323091 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:00.322847    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t9n2j\" (UniqueName: \"kubernetes.io/projected/9363fb38-792f-41a6-b6b3-d2c508fff328-kube-api-access-t9n2j\") pod \"kas-connection-checker-685895c7c9-ttbkh\" (UID: \"9363fb38-792f-41a6-b6b3-d2c508fff328\") " pod="kube-system/kas-connection-checker-685895c7c9-ttbkh"
Oct 31 17:27:00.323091 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:00.322870    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/50e82975-3344-4653-8de3-68e8a64a8757-default-certificate\") pod \"router-default-65db5d9749-xvqmh\" (UID: \"50e82975-3344-4653-8de3-68e8a64a8757\") " pod="openshift-ingress/router-default-65db5d9749-xvqmh"
Oct 31 17:27:00.323091 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:00.322946    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-config\" (UniqueName: \"kubernetes.io/configmap/ec682f92-b657-44bd-9e85-3cd4680d2f95-samples-operator-config\") pod \"cluster-samples-operator-6ddb6c8b94-rhsk4\" (UID: \"ec682f92-b657-44bd-9e85-3cd4680d2f95\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-rhsk4"
Oct 31 17:27:00.323091 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:00.323004    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/8e32277f-062d-4c16-81ca-b12e65b24fbb-serving-cert\") pod \"insights-operator-7c4986d449-tggxv\" (UID: \"8e32277f-062d-4c16-81ca-b12e65b24fbb\") " pod="openshift-insights/insights-operator-7c4986d449-tggxv"
Oct 31 17:27:00.323091 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:00.323031    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/25ad5c67-f563-4653-9e86-7e9ecbe78675-tmp-dir\") pod \"dns-default-7v7x4\" (UID: \"25ad5c67-f563-4653-9e86-7e9ecbe78675\") " pod="openshift-dns/dns-default-7v7x4"
Oct 31 17:27:00.323091 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:00.323054    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9d9ecf7f-6a11-469b-8626-99d5ef7ffac7-ca-trust-extracted\") pod \"image-registry-869fc8694f-xcqzj\" (UID: \"9d9ecf7f-6a11-469b-8626-99d5ef7ffac7\") " pod="openshift-image-registry/image-registry-869fc8694f-xcqzj"
Oct 31 17:27:00.323304 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:00.323106    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f03611db-3bd9-401a-a137-1d4f691b51ea-config\") pod \"console-operator-7cd56b8dbc-b2xxw\" (UID: \"f03611db-3bd9-401a-a137-1d4f691b51ea\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-b2xxw"
Oct 31 17:27:00.323304 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:00.323152    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ngvv2\" (UniqueName: \"kubernetes.io/projected/50e82975-3344-4653-8de3-68e8a64a8757-kube-api-access-ngvv2\") pod \"router-default-65db5d9749-xvqmh\" (UID: \"50e82975-3344-4653-8de3-68e8a64a8757\") " pod="openshift-ingress/router-default-65db5d9749-xvqmh"
Oct 31 17:27:00.323304 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:00.323180    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/170ada34-8944-43d2-bcfb-1d782aae5348-installation-pull-secrets\") pod \"image-registry-74dbfdb444-q7rkg\" (UID: \"170ada34-8944-43d2-bcfb-1d782aae5348\") " pod="openshift-image-registry/image-registry-74dbfdb444-q7rkg"
Oct 31 17:27:00.323304 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:00.323196    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9d9ecf7f-6a11-469b-8626-99d5ef7ffac7-image-registry-private-configuration\") pod \"image-registry-869fc8694f-xcqzj\" (UID: \"9d9ecf7f-6a11-469b-8626-99d5ef7ffac7\") " pod="openshift-image-registry/image-registry-869fc8694f-xcqzj"
Oct 31 17:27:00.326674 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:00.323840    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z57fk\" (UniqueName: \"kubernetes.io/projected/c390ea6f-c609-40f7-a9ec-53fd5c08d857-kube-api-access-z57fk\") pod \"ingress-canary-ptxt2\" (UID: \"c390ea6f-c609-40f7-a9ec-53fd5c08d857\") " pod="openshift-ingress-canary/ingress-canary-ptxt2"
Oct 31 17:27:00.326674 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:00.323885    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/8a9e5aa4-f4fc-4b33-a925-8e63df6c9cd2-config\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-4xtm4\" (UID: \"8a9e5aa4-f4fc-4b33-a925-8e63df6c9cd2\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-4xtm4"
Oct 31 17:27:00.326674 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:00.323925    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/170ada34-8944-43d2-bcfb-1d782aae5348-trusted-ca\") pod \"image-registry-74dbfdb444-q7rkg\" (UID: \"170ada34-8944-43d2-bcfb-1d782aae5348\") " pod="openshift-image-registry/image-registry-74dbfdb444-q7rkg"
Oct 31 17:27:00.326674 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:00.323968    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6vzgd\" (UniqueName: \"kubernetes.io/projected/2330cbe7-498c-4f39-ba1b-3873e125dd18-kube-api-access-6vzgd\") pod \"service-ca-operator-544d749c8c-7lspr\" (UID: \"2330cbe7-498c-4f39-ba1b-3873e125dd18\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-7lspr"
Oct 31 17:27:00.326674 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:00.324002    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/a1bea244-6573-4e3c-9849-b27ade411c9f-telemetry-config\") pod \"cluster-monitoring-operator-884576c57-csbxp\" (UID: \"a1bea244-6573-4e3c-9849-b27ade411c9f\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-csbxp"
Oct 31 17:27:00.326674 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:00.324035    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f03611db-3bd9-401a-a137-1d4f691b51ea-serving-cert\") pod \"console-operator-7cd56b8dbc-b2xxw\" (UID: \"f03611db-3bd9-401a-a137-1d4f691b51ea\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-b2xxw"
Oct 31 17:27:00.326674 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:00.324067    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9d9ecf7f-6a11-469b-8626-99d5ef7ffac7-installation-pull-secrets\") pod \"image-registry-869fc8694f-xcqzj\" (UID: \"9d9ecf7f-6a11-469b-8626-99d5ef7ffac7\") " pod="openshift-image-registry/image-registry-869fc8694f-xcqzj"
Oct 31 17:27:00.331574 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:00.331549    2572 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Oct 31 17:27:00.332347 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:00.332323    2572 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Oct 31 17:27:00.332469 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:00.332449    2572 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Oct 31 17:27:00.332866 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:00.332846    2572 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Oct 31 17:27:00.425303 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:00.425265    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/a1bea244-6573-4e3c-9849-b27ade411c9f-telemetry-config\") pod \"cluster-monitoring-operator-884576c57-csbxp\" (UID: \"a1bea244-6573-4e3c-9849-b27ade411c9f\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-csbxp"
Oct 31 17:27:00.425303 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:00.425302    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f03611db-3bd9-401a-a137-1d4f691b51ea-serving-cert\") pod \"console-operator-7cd56b8dbc-b2xxw\" (UID: \"f03611db-3bd9-401a-a137-1d4f691b51ea\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-b2xxw"
Oct 31 17:27:00.425561 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:00.425325    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9d9ecf7f-6a11-469b-8626-99d5ef7ffac7-installation-pull-secrets\") pod \"image-registry-869fc8694f-xcqzj\" (UID: \"9d9ecf7f-6a11-469b-8626-99d5ef7ffac7\") " pod="openshift-image-registry/image-registry-869fc8694f-xcqzj"
Oct 31 17:27:00.425561 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:00.425462    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/8e32277f-062d-4c16-81ca-b12e65b24fbb-snapshots\") pod \"insights-operator-7c4986d449-tggxv\" (UID: \"8e32277f-062d-4c16-81ca-b12e65b24fbb\") " pod="openshift-insights/insights-operator-7c4986d449-tggxv"
Oct 31 17:27:00.425561 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:00.425498    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8e32277f-062d-4c16-81ca-b12e65b24fbb-service-ca-bundle\") pod \"insights-operator-7c4986d449-tggxv\" (UID: \"8e32277f-062d-4c16-81ca-b12e65b24fbb\") " pod="openshift-insights/insights-operator-7c4986d449-tggxv"
Oct 31 17:27:00.425561 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:00.425517    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9d9ecf7f-6a11-469b-8626-99d5ef7ffac7-bound-sa-token\") pod \"image-registry-869fc8694f-xcqzj\" (UID: \"9d9ecf7f-6a11-469b-8626-99d5ef7ffac7\") " pod="openshift-image-registry/image-registry-869fc8694f-xcqzj"
Oct 31 17:27:00.425561 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:00.425544    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6tlzl\" (UniqueName: \"kubernetes.io/projected/8a9e5aa4-f4fc-4b33-a925-8e63df6c9cd2-kube-api-access-6tlzl\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-4xtm4\" (UID: \"8a9e5aa4-f4fc-4b33-a925-8e63df6c9cd2\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-4xtm4"
Oct 31 17:27:00.425865 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:00.425574    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8e32277f-062d-4c16-81ca-b12e65b24fbb-tmp\") pod \"insights-operator-7c4986d449-tggxv\" (UID: \"8e32277f-062d-4c16-81ca-b12e65b24fbb\") " pod="openshift-insights/insights-operator-7c4986d449-tggxv"
Oct 31 17:27:00.425865 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:00.425596    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h6b47\" (UniqueName: \"kubernetes.io/projected/170ada34-8944-43d2-bcfb-1d782aae5348-kube-api-access-h6b47\") pod \"image-registry-74dbfdb444-q7rkg\" (UID: \"170ada34-8944-43d2-bcfb-1d782aae5348\") " pod="openshift-image-registry/image-registry-74dbfdb444-q7rkg"
Oct 31 17:27:00.425865 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:00.425622    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/50e82975-3344-4653-8de3-68e8a64a8757-service-ca-bundle\") pod \"router-default-65db5d9749-xvqmh\" (UID: \"50e82975-3344-4653-8de3-68e8a64a8757\") " pod="openshift-ingress/router-default-65db5d9749-xvqmh"
Oct 31 17:27:00.425865 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:00.425668    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/170ada34-8944-43d2-bcfb-1d782aae5348-ca-trust-extracted\") pod \"image-registry-74dbfdb444-q7rkg\" (UID: \"170ada34-8944-43d2-bcfb-1d782aae5348\") " pod="openshift-image-registry/image-registry-74dbfdb444-q7rkg"
Oct 31 17:27:00.425865 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:00.425691    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/170ada34-8944-43d2-bcfb-1d782aae5348-registry-certificates\") pod \"image-registry-74dbfdb444-q7rkg\" (UID: \"170ada34-8944-43d2-bcfb-1d782aae5348\") " pod="openshift-image-registry/image-registry-74dbfdb444-q7rkg"
Oct 31 17:27:00.425865 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:00.425717    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/2330cbe7-498c-4f39-ba1b-3873e125dd18-config\") pod \"service-ca-operator-544d749c8c-7lspr\" (UID: \"2330cbe7-498c-4f39-ba1b-3873e125dd18\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-7lspr"
Oct 31 17:27:00.425865 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:00.425745    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/a1bea244-6573-4e3c-9849-b27ade411c9f-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-csbxp\" (UID: \"a1bea244-6573-4e3c-9849-b27ade411c9f\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-csbxp"
Oct 31 17:27:00.425865 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:00.425770    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9d9ecf7f-6a11-469b-8626-99d5ef7ffac7-registry-tls\") pod \"image-registry-869fc8694f-xcqzj\" (UID: \"9d9ecf7f-6a11-469b-8626-99d5ef7ffac7\") " pod="openshift-image-registry/image-registry-869fc8694f-xcqzj"
Oct 31 17:27:00.425865 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:00.425826    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/8a9e5aa4-f4fc-4b33-a925-8e63df6c9cd2-serving-cert\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-4xtm4\" (UID: \"8a9e5aa4-f4fc-4b33-a925-8e63df6c9cd2\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-4xtm4"
Oct 31 17:27:00.426298 ip-10-0-138-17 kubenswrapper[2572]: E1031 17:27:00.425869    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/50e82975-3344-4653-8de3-68e8a64a8757-service-ca-bundle podName:50e82975-3344-4653-8de3-68e8a64a8757 nodeName:}" failed. No retries permitted until 2026-10-31 17:27:00.925846695 +0000 UTC m=+30.641704381 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/50e82975-3344-4653-8de3-68e8a64a8757-service-ca-bundle") pod "router-default-65db5d9749-xvqmh" (UID: "50e82975-3344-4653-8de3-68e8a64a8757") : configmap references non-existent config key: service-ca.crt
Oct 31 17:27:00.426298 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:00.425899    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j26t9\" (UniqueName: \"kubernetes.io/projected/340f062e-e599-4620-87d1-c5be0bb1b319-kube-api-access-j26t9\") pod \"kas-connection-checker-685895c7c9-kgdxw\" (UID: \"340f062e-e599-4620-87d1-c5be0bb1b319\") " pod="kube-system/kas-connection-checker-685895c7c9-kgdxw"
Oct 31 17:27:00.426298 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:00.425946    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/170ada34-8944-43d2-bcfb-1d782aae5348-registry-tls\") pod \"image-registry-74dbfdb444-q7rkg\" (UID: \"170ada34-8944-43d2-bcfb-1d782aae5348\") " pod="openshift-image-registry/image-registry-74dbfdb444-q7rkg"
Oct 31 17:27:00.426298 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:00.426201    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8e32277f-062d-4c16-81ca-b12e65b24fbb-tmp\") pod \"insights-operator-7c4986d449-tggxv\" (UID: \"8e32277f-062d-4c16-81ca-b12e65b24fbb\") " pod="openshift-insights/insights-operator-7c4986d449-tggxv"
Oct 31 17:27:00.426298 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:00.426229    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v5x5x\" (UniqueName: \"kubernetes.io/projected/26373302-592f-4fd5-bd54-7ac57ef19bfd-kube-api-access-v5x5x\") pod \"kas-connection-checker-685895c7c9-6pnp6\" (UID: \"26373302-592f-4fd5-bd54-7ac57ef19bfd\") " pod="kube-system/kas-connection-checker-685895c7c9-6pnp6"
Oct 31 17:27:00.426298 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:00.426239    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8e32277f-062d-4c16-81ca-b12e65b24fbb-service-ca-bundle\") pod \"insights-operator-7c4986d449-tggxv\" (UID: \"8e32277f-062d-4c16-81ca-b12e65b24fbb\") " pod="openshift-insights/insights-operator-7c4986d449-tggxv"
Oct 31 17:27:00.426640 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:00.426309    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/a1bea244-6573-4e3c-9849-b27ade411c9f-telemetry-config\") pod \"cluster-monitoring-operator-884576c57-csbxp\" (UID: \"a1bea244-6573-4e3c-9849-b27ade411c9f\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-csbxp"
Oct 31 17:27:00.426640 ip-10-0-138-17 kubenswrapper[2572]: E1031 17:27:00.426339    2572 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Oct 31 17:27:00.426640 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:00.426365    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8e32277f-062d-4c16-81ca-b12e65b24fbb-trusted-ca-bundle\") pod \"insights-operator-7c4986d449-tggxv\" (UID: \"8e32277f-062d-4c16-81ca-b12e65b24fbb\") " pod="openshift-insights/insights-operator-7c4986d449-tggxv"
Oct 31 17:27:00.426640 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:00.426393    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/50e82975-3344-4653-8de3-68e8a64a8757-metrics-certs\") pod \"router-default-65db5d9749-xvqmh\" (UID: \"50e82975-3344-4653-8de3-68e8a64a8757\") " pod="openshift-ingress/router-default-65db5d9749-xvqmh"
Oct 31 17:27:00.426640 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:00.426419    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j86wf\" (UniqueName: \"kubernetes.io/projected/d5856011-8f77-4e60-8ecc-c7ac852a50b0-kube-api-access-j86wf\") pod \"network-check-source-6f78d59f99-qkkwm\" (UID: \"d5856011-8f77-4e60-8ecc-c7ac852a50b0\") " pod="openshift-network-diagnostics/network-check-source-6f78d59f99-qkkwm"
Oct 31 17:27:00.426640 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:00.426450    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5x4hs\" (UniqueName: \"kubernetes.io/projected/8e32277f-062d-4c16-81ca-b12e65b24fbb-kube-api-access-5x4hs\") pod \"insights-operator-7c4986d449-tggxv\" (UID: \"8e32277f-062d-4c16-81ca-b12e65b24fbb\") " pod="openshift-insights/insights-operator-7c4986d449-tggxv"
Oct 31 17:27:00.426640 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:00.426474    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-krrzb\" (UniqueName: \"kubernetes.io/projected/ec682f92-b657-44bd-9e85-3cd4680d2f95-kube-api-access-krrzb\") pod \"cluster-samples-operator-6ddb6c8b94-rhsk4\" (UID: \"ec682f92-b657-44bd-9e85-3cd4680d2f95\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-rhsk4"
Oct 31 17:27:00.426640 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:00.426501    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rbmtq\" (UniqueName: \"kubernetes.io/projected/a7959bdf-3723-4ee9-a587-6cd16e28d4b1-kube-api-access-rbmtq\") pod \"volume-data-source-validator-58c9f5f46d-th5tq\" (UID: \"a7959bdf-3723-4ee9-a587-6cd16e28d4b1\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-th5tq"
Oct 31 17:27:00.426640 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:00.426525    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mgwcl\" (UniqueName: \"kubernetes.io/projected/9d9ecf7f-6a11-469b-8626-99d5ef7ffac7-kube-api-access-mgwcl\") pod \"image-registry-869fc8694f-xcqzj\" (UID: \"9d9ecf7f-6a11-469b-8626-99d5ef7ffac7\") " pod="openshift-image-registry/image-registry-869fc8694f-xcqzj"
Oct 31 17:27:00.426640 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:00.426551    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/25ad5c67-f563-4653-9e86-7e9ecbe78675-metrics-tls\") pod \"dns-default-7v7x4\" (UID: \"25ad5c67-f563-4653-9e86-7e9ecbe78675\") " pod="openshift-dns/dns-default-7v7x4"
Oct 31 17:27:00.426640 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:00.426592    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9d9ecf7f-6a11-469b-8626-99d5ef7ffac7-trusted-ca\") pod \"image-registry-869fc8694f-xcqzj\" (UID: \"9d9ecf7f-6a11-469b-8626-99d5ef7ffac7\") " pod="openshift-image-registry/image-registry-869fc8694f-xcqzj"
Oct 31 17:27:00.426640 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:00.426635    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/9a0cf7f7-c12d-42fe-a83e-28e1f1859cd2-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-rnvgv\" (UID: \"9a0cf7f7-c12d-42fe-a83e-28e1f1859cd2\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-rnvgv"
Oct 31 17:27:00.427276 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:00.426682    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/25ad5c67-f563-4653-9e86-7e9ecbe78675-config-volume\") pod \"dns-default-7v7x4\" (UID: \"25ad5c67-f563-4653-9e86-7e9ecbe78675\") " pod="openshift-dns/dns-default-7v7x4"
Oct 31 17:27:00.427276 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:00.426709    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f88d4\" (UniqueName: \"kubernetes.io/projected/f03611db-3bd9-401a-a137-1d4f691b51ea-kube-api-access-f88d4\") pod \"console-operator-7cd56b8dbc-b2xxw\" (UID: \"f03611db-3bd9-401a-a137-1d4f691b51ea\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-b2xxw"
Oct 31 17:27:00.427276 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:00.426749    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/50e82975-3344-4653-8de3-68e8a64a8757-stats-auth\") pod \"router-default-65db5d9749-xvqmh\" (UID: \"50e82975-3344-4653-8de3-68e8a64a8757\") " pod="openshift-ingress/router-default-65db5d9749-xvqmh"
Oct 31 17:27:00.427276 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:00.426765    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/170ada34-8944-43d2-bcfb-1d782aae5348-ca-trust-extracted\") pod \"image-registry-74dbfdb444-q7rkg\" (UID: \"170ada34-8944-43d2-bcfb-1d782aae5348\") " pod="openshift-image-registry/image-registry-74dbfdb444-q7rkg"
Oct 31 17:27:00.427276 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:00.426781    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9d9ecf7f-6a11-469b-8626-99d5ef7ffac7-registry-certificates\") pod \"image-registry-869fc8694f-xcqzj\" (UID: \"9d9ecf7f-6a11-469b-8626-99d5ef7ffac7\") " pod="openshift-image-registry/image-registry-869fc8694f-xcqzj"
Oct 31 17:27:00.427276 ip-10-0-138-17 kubenswrapper[2572]: E1031 17:27:00.426811    2572 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Oct 31 17:27:00.427276 ip-10-0-138-17 kubenswrapper[2572]: E1031 17:27:00.426861    2572 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Oct 31 17:27:00.427276 ip-10-0-138-17 kubenswrapper[2572]: E1031 17:27:00.426875    2572 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-74dbfdb444-q7rkg: secret "image-registry-tls" not found
Oct 31 17:27:00.427276 ip-10-0-138-17 kubenswrapper[2572]: E1031 17:27:00.426877    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/50e82975-3344-4653-8de3-68e8a64a8757-metrics-certs podName:50e82975-3344-4653-8de3-68e8a64a8757 nodeName:}" failed. No retries permitted until 2026-10-31 17:27:00.926859515 +0000 UTC m=+30.642717189 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/50e82975-3344-4653-8de3-68e8a64a8757-metrics-certs") pod "router-default-65db5d9749-xvqmh" (UID: "50e82975-3344-4653-8de3-68e8a64a8757") : secret "router-metrics-certs-default" not found
Oct 31 17:27:00.427276 ip-10-0-138-17 kubenswrapper[2572]: E1031 17:27:00.426904    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a1bea244-6573-4e3c-9849-b27ade411c9f-cluster-monitoring-operator-tls podName:a1bea244-6573-4e3c-9849-b27ade411c9f nodeName:}" failed. No retries permitted until 2026-10-31 17:27:00.926892387 +0000 UTC m=+30.642750055 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/a1bea244-6573-4e3c-9849-b27ade411c9f-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-884576c57-csbxp" (UID: "a1bea244-6573-4e3c-9849-b27ade411c9f") : secret "cluster-monitoring-operator-tls" not found
Oct 31 17:27:00.427276 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:00.426811    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c390ea6f-c609-40f7-a9ec-53fd5c08d857-cert\") pod \"ingress-canary-ptxt2\" (UID: \"c390ea6f-c609-40f7-a9ec-53fd5c08d857\") " pod="openshift-ingress-canary/ingress-canary-ptxt2"
Oct 31 17:27:00.427276 ip-10-0-138-17 kubenswrapper[2572]: E1031 17:27:00.426925    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/170ada34-8944-43d2-bcfb-1d782aae5348-registry-tls podName:170ada34-8944-43d2-bcfb-1d782aae5348 nodeName:}" failed. No retries permitted until 2026-10-31 17:27:00.926911547 +0000 UTC m=+30.642769215 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/170ada34-8944-43d2-bcfb-1d782aae5348-registry-tls") pod "image-registry-74dbfdb444-q7rkg" (UID: "170ada34-8944-43d2-bcfb-1d782aae5348") : secret "image-registry-tls" not found
Oct 31 17:27:00.427276 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:00.426955    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kqpvj\" (UniqueName: \"kubernetes.io/projected/25ad5c67-f563-4653-9e86-7e9ecbe78675-kube-api-access-kqpvj\") pod \"dns-default-7v7x4\" (UID: \"25ad5c67-f563-4653-9e86-7e9ecbe78675\") " pod="openshift-dns/dns-default-7v7x4"
Oct 31 17:27:00.427276 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:00.427030    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/9a0cf7f7-c12d-42fe-a83e-28e1f1859cd2-nginx-conf\") pod \"networking-console-plugin-86c478bb88-rnvgv\" (UID: \"9a0cf7f7-c12d-42fe-a83e-28e1f1859cd2\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-rnvgv"
Oct 31 17:27:00.427276 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:00.427047    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8e32277f-062d-4c16-81ca-b12e65b24fbb-trusted-ca-bundle\") pod \"insights-operator-7c4986d449-tggxv\" (UID: \"8e32277f-062d-4c16-81ca-b12e65b24fbb\") " pod="openshift-insights/insights-operator-7c4986d449-tggxv"
Oct 31 17:27:00.427276 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:00.427063    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/170ada34-8944-43d2-bcfb-1d782aae5348-image-registry-private-configuration\") pod \"image-registry-74dbfdb444-q7rkg\" (UID: \"170ada34-8944-43d2-bcfb-1d782aae5348\") " pod="openshift-image-registry/image-registry-74dbfdb444-q7rkg"
Oct 31 17:27:00.428090 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:00.427094    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2330cbe7-498c-4f39-ba1b-3873e125dd18-serving-cert\") pod \"service-ca-operator-544d749c8c-7lspr\" (UID: \"2330cbe7-498c-4f39-ba1b-3873e125dd18\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-7lspr"
Oct 31 17:27:00.428090 ip-10-0-138-17 kubenswrapper[2572]: E1031 17:27:00.427137    2572 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Oct 31 17:27:00.428090 ip-10-0-138-17 kubenswrapper[2572]: E1031 17:27:00.427149    2572 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-869fc8694f-xcqzj: secret "image-registry-tls" not found
Oct 31 17:27:00.428090 ip-10-0-138-17 kubenswrapper[2572]: E1031 17:27:00.427188    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9d9ecf7f-6a11-469b-8626-99d5ef7ffac7-registry-tls podName:9d9ecf7f-6a11-469b-8626-99d5ef7ffac7 nodeName:}" failed. No retries permitted until 2026-10-31 17:27:00.927174364 +0000 UTC m=+30.643032052 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9d9ecf7f-6a11-469b-8626-99d5ef7ffac7-registry-tls") pod "image-registry-869fc8694f-xcqzj" (UID: "9d9ecf7f-6a11-469b-8626-99d5ef7ffac7") : secret "image-registry-tls" not found
Oct 31 17:27:00.428090 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:00.427147    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/170ada34-8944-43d2-bcfb-1d782aae5348-bound-sa-token\") pod \"image-registry-74dbfdb444-q7rkg\" (UID: \"170ada34-8944-43d2-bcfb-1d782aae5348\") " pod="openshift-image-registry/image-registry-74dbfdb444-q7rkg"
Oct 31 17:27:00.428090 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:00.427227    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/ec682f92-b657-44bd-9e85-3cd4680d2f95-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-rhsk4\" (UID: \"ec682f92-b657-44bd-9e85-3cd4680d2f95\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-rhsk4"
Oct 31 17:27:00.428090 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:00.427255    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vpl4m\" (UniqueName: \"kubernetes.io/projected/a1bea244-6573-4e3c-9849-b27ade411c9f-kube-api-access-vpl4m\") pod \"cluster-monitoring-operator-884576c57-csbxp\" (UID: \"a1bea244-6573-4e3c-9849-b27ade411c9f\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-csbxp"
Oct 31 17:27:00.428090 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:00.427279    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f03611db-3bd9-401a-a137-1d4f691b51ea-trusted-ca\") pod \"console-operator-7cd56b8dbc-b2xxw\" (UID: \"f03611db-3bd9-401a-a137-1d4f691b51ea\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-b2xxw"
Oct 31 17:27:00.428090 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:00.427312    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t9n2j\" (UniqueName: \"kubernetes.io/projected/9363fb38-792f-41a6-b6b3-d2c508fff328-kube-api-access-t9n2j\") pod \"kas-connection-checker-685895c7c9-ttbkh\" (UID: \"9363fb38-792f-41a6-b6b3-d2c508fff328\") " pod="kube-system/kas-connection-checker-685895c7c9-ttbkh"
Oct 31 17:27:00.428090 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:00.427337    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/50e82975-3344-4653-8de3-68e8a64a8757-default-certificate\") pod \"router-default-65db5d9749-xvqmh\" (UID: \"50e82975-3344-4653-8de3-68e8a64a8757\") " pod="openshift-ingress/router-default-65db5d9749-xvqmh"
Oct 31 17:27:00.428090 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:00.427367    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-config\" (UniqueName: \"kubernetes.io/configmap/ec682f92-b657-44bd-9e85-3cd4680d2f95-samples-operator-config\") pod \"cluster-samples-operator-6ddb6c8b94-rhsk4\" (UID: \"ec682f92-b657-44bd-9e85-3cd4680d2f95\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-rhsk4"
Oct 31 17:27:00.428090 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:00.427392    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/8e32277f-062d-4c16-81ca-b12e65b24fbb-serving-cert\") pod \"insights-operator-7c4986d449-tggxv\" (UID: \"8e32277f-062d-4c16-81ca-b12e65b24fbb\") " pod="openshift-insights/insights-operator-7c4986d449-tggxv"
Oct 31 17:27:00.428090 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:00.427413    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/25ad5c67-f563-4653-9e86-7e9ecbe78675-tmp-dir\") pod \"dns-default-7v7x4\" (UID: \"25ad5c67-f563-4653-9e86-7e9ecbe78675\") " pod="openshift-dns/dns-default-7v7x4"
Oct 31 17:27:00.428090 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:00.427435    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9d9ecf7f-6a11-469b-8626-99d5ef7ffac7-ca-trust-extracted\") pod \"image-registry-869fc8694f-xcqzj\" (UID: \"9d9ecf7f-6a11-469b-8626-99d5ef7ffac7\") " pod="openshift-image-registry/image-registry-869fc8694f-xcqzj"
Oct 31 17:27:00.428090 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:00.427459    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f03611db-3bd9-401a-a137-1d4f691b51ea-config\") pod \"console-operator-7cd56b8dbc-b2xxw\" (UID: \"f03611db-3bd9-401a-a137-1d4f691b51ea\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-b2xxw"
Oct 31 17:27:00.428090 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:00.427484    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ngvv2\" (UniqueName: \"kubernetes.io/projected/50e82975-3344-4653-8de3-68e8a64a8757-kube-api-access-ngvv2\") pod \"router-default-65db5d9749-xvqmh\" (UID: \"50e82975-3344-4653-8de3-68e8a64a8757\") " pod="openshift-ingress/router-default-65db5d9749-xvqmh"
Oct 31 17:27:00.428893 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:00.427510    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/170ada34-8944-43d2-bcfb-1d782aae5348-installation-pull-secrets\") pod \"image-registry-74dbfdb444-q7rkg\" (UID: \"170ada34-8944-43d2-bcfb-1d782aae5348\") " pod="openshift-image-registry/image-registry-74dbfdb444-q7rkg"
Oct 31 17:27:00.428893 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:00.427533    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9d9ecf7f-6a11-469b-8626-99d5ef7ffac7-image-registry-private-configuration\") pod \"image-registry-869fc8694f-xcqzj\" (UID: \"9d9ecf7f-6a11-469b-8626-99d5ef7ffac7\") " pod="openshift-image-registry/image-registry-869fc8694f-xcqzj"
Oct 31 17:27:00.428893 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:00.427559    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z57fk\" (UniqueName: \"kubernetes.io/projected/c390ea6f-c609-40f7-a9ec-53fd5c08d857-kube-api-access-z57fk\") pod \"ingress-canary-ptxt2\" (UID: \"c390ea6f-c609-40f7-a9ec-53fd5c08d857\") " pod="openshift-ingress-canary/ingress-canary-ptxt2"
Oct 31 17:27:00.428893 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:00.427585    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/8a9e5aa4-f4fc-4b33-a925-8e63df6c9cd2-config\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-4xtm4\" (UID: \"8a9e5aa4-f4fc-4b33-a925-8e63df6c9cd2\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-4xtm4"
Oct 31 17:27:00.428893 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:00.427615    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/170ada34-8944-43d2-bcfb-1d782aae5348-trusted-ca\") pod \"image-registry-74dbfdb444-q7rkg\" (UID: \"170ada34-8944-43d2-bcfb-1d782aae5348\") " pod="openshift-image-registry/image-registry-74dbfdb444-q7rkg"
Oct 31 17:27:00.428893 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:00.427660    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6vzgd\" (UniqueName: \"kubernetes.io/projected/2330cbe7-498c-4f39-ba1b-3873e125dd18-kube-api-access-6vzgd\") pod \"service-ca-operator-544d749c8c-7lspr\" (UID: \"2330cbe7-498c-4f39-ba1b-3873e125dd18\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-7lspr"
Oct 31 17:27:00.428893 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:00.427670    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/170ada34-8944-43d2-bcfb-1d782aae5348-registry-certificates\") pod \"image-registry-74dbfdb444-q7rkg\" (UID: \"170ada34-8944-43d2-bcfb-1d782aae5348\") " pod="openshift-image-registry/image-registry-74dbfdb444-q7rkg"
Oct 31 17:27:00.428893 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:00.427989    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/9a0cf7f7-c12d-42fe-a83e-28e1f1859cd2-nginx-conf\") pod \"networking-console-plugin-86c478bb88-rnvgv\" (UID: \"9a0cf7f7-c12d-42fe-a83e-28e1f1859cd2\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-rnvgv"
Oct 31 17:27:00.428893 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:00.428373    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-config\" (UniqueName: \"kubernetes.io/configmap/ec682f92-b657-44bd-9e85-3cd4680d2f95-samples-operator-config\") pod \"cluster-samples-operator-6ddb6c8b94-rhsk4\" (UID: \"ec682f92-b657-44bd-9e85-3cd4680d2f95\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-rhsk4"
Oct 31 17:27:00.428893 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:00.428771    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/8a9e5aa4-f4fc-4b33-a925-8e63df6c9cd2-config\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-4xtm4\" (UID: \"8a9e5aa4-f4fc-4b33-a925-8e63df6c9cd2\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-4xtm4"
Oct 31 17:27:00.429370 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:00.428932    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/8e32277f-062d-4c16-81ca-b12e65b24fbb-snapshots\") pod \"insights-operator-7c4986d449-tggxv\" (UID: \"8e32277f-062d-4c16-81ca-b12e65b24fbb\") " pod="openshift-insights/insights-operator-7c4986d449-tggxv"
Oct 31 17:27:00.429370 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:00.429243    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9d9ecf7f-6a11-469b-8626-99d5ef7ffac7-ca-trust-extracted\") pod \"image-registry-869fc8694f-xcqzj\" (UID: \"9d9ecf7f-6a11-469b-8626-99d5ef7ffac7\") " pod="openshift-image-registry/image-registry-869fc8694f-xcqzj"
Oct 31 17:27:00.429370 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:00.429254    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9d9ecf7f-6a11-469b-8626-99d5ef7ffac7-trusted-ca\") pod \"image-registry-869fc8694f-xcqzj\" (UID: \"9d9ecf7f-6a11-469b-8626-99d5ef7ffac7\") " pod="openshift-image-registry/image-registry-869fc8694f-xcqzj"
Oct 31 17:27:00.429587 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:00.429474    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/2330cbe7-498c-4f39-ba1b-3873e125dd18-config\") pod \"service-ca-operator-544d749c8c-7lspr\" (UID: \"2330cbe7-498c-4f39-ba1b-3873e125dd18\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-7lspr"
Oct 31 17:27:00.431415 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:00.429863    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f03611db-3bd9-401a-a137-1d4f691b51ea-config\") pod \"console-operator-7cd56b8dbc-b2xxw\" (UID: \"f03611db-3bd9-401a-a137-1d4f691b51ea\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-b2xxw"
Oct 31 17:27:00.431415 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:00.430119    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/25ad5c67-f563-4653-9e86-7e9ecbe78675-tmp-dir\") pod \"dns-default-7v7x4\" (UID: \"25ad5c67-f563-4653-9e86-7e9ecbe78675\") " pod="openshift-dns/dns-default-7v7x4"
Oct 31 17:27:00.431415 ip-10-0-138-17 kubenswrapper[2572]: E1031 17:27:00.430131    2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Oct 31 17:27:00.431415 ip-10-0-138-17 kubenswrapper[2572]: E1031 17:27:00.430185    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/25ad5c67-f563-4653-9e86-7e9ecbe78675-metrics-tls podName:25ad5c67-f563-4653-9e86-7e9ecbe78675 nodeName:}" failed. No retries permitted until 2026-10-31 17:27:00.930171466 +0000 UTC m=+30.646029154 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/25ad5c67-f563-4653-9e86-7e9ecbe78675-metrics-tls") pod "dns-default-7v7x4" (UID: "25ad5c67-f563-4653-9e86-7e9ecbe78675") : secret "dns-default-metrics-tls" not found
Oct 31 17:27:00.431415 ip-10-0-138-17 kubenswrapper[2572]: E1031 17:27:00.430342    2572 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Oct 31 17:27:00.431415 ip-10-0-138-17 kubenswrapper[2572]: E1031 17:27:00.430407    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9a0cf7f7-c12d-42fe-a83e-28e1f1859cd2-networking-console-plugin-cert podName:9a0cf7f7-c12d-42fe-a83e-28e1f1859cd2 nodeName:}" failed. No retries permitted until 2026-10-31 17:27:00.93038944 +0000 UTC m=+30.646247113 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/9a0cf7f7-c12d-42fe-a83e-28e1f1859cd2-networking-console-plugin-cert") pod "networking-console-plugin-86c478bb88-rnvgv" (UID: "9a0cf7f7-c12d-42fe-a83e-28e1f1859cd2") : secret "networking-console-plugin-cert" not found
Oct 31 17:27:00.431415 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:00.430664    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/170ada34-8944-43d2-bcfb-1d782aae5348-trusted-ca\") pod \"image-registry-74dbfdb444-q7rkg\" (UID: \"170ada34-8944-43d2-bcfb-1d782aae5348\") " pod="openshift-image-registry/image-registry-74dbfdb444-q7rkg"
Oct 31 17:27:00.431415 ip-10-0-138-17 kubenswrapper[2572]: E1031 17:27:00.430932    2572 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Oct 31 17:27:00.431415 ip-10-0-138-17 kubenswrapper[2572]: E1031 17:27:00.430984    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ec682f92-b657-44bd-9e85-3cd4680d2f95-samples-operator-tls podName:ec682f92-b657-44bd-9e85-3cd4680d2f95 nodeName:}" failed. No retries permitted until 2026-10-31 17:27:00.930970674 +0000 UTC m=+30.646828350 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/ec682f92-b657-44bd-9e85-3cd4680d2f95-samples-operator-tls") pod "cluster-samples-operator-6ddb6c8b94-rhsk4" (UID: "ec682f92-b657-44bd-9e85-3cd4680d2f95") : secret "samples-operator-tls" not found
Oct 31 17:27:00.431415 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:00.430995    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f03611db-3bd9-401a-a137-1d4f691b51ea-trusted-ca\") pod \"console-operator-7cd56b8dbc-b2xxw\" (UID: \"f03611db-3bd9-401a-a137-1d4f691b51ea\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-b2xxw"
Oct 31 17:27:00.432323 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:00.431528    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/25ad5c67-f563-4653-9e86-7e9ecbe78675-config-volume\") pod \"dns-default-7v7x4\" (UID: \"25ad5c67-f563-4653-9e86-7e9ecbe78675\") " pod="openshift-dns/dns-default-7v7x4"
Oct 31 17:27:00.432323 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:00.431740    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/8a9e5aa4-f4fc-4b33-a925-8e63df6c9cd2-serving-cert\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-4xtm4\" (UID: \"8a9e5aa4-f4fc-4b33-a925-8e63df6c9cd2\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-4xtm4"
Oct 31 17:27:00.432323 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:00.431856    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2330cbe7-498c-4f39-ba1b-3873e125dd18-serving-cert\") pod \"service-ca-operator-544d749c8c-7lspr\" (UID: \"2330cbe7-498c-4f39-ba1b-3873e125dd18\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-7lspr"
Oct 31 17:27:00.432934 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:00.432911    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9d9ecf7f-6a11-469b-8626-99d5ef7ffac7-registry-certificates\") pod \"image-registry-869fc8694f-xcqzj\" (UID: \"9d9ecf7f-6a11-469b-8626-99d5ef7ffac7\") " pod="openshift-image-registry/image-registry-869fc8694f-xcqzj"
Oct 31 17:27:00.433015 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:00.432934    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9d9ecf7f-6a11-469b-8626-99d5ef7ffac7-image-registry-private-configuration\") pod \"image-registry-869fc8694f-xcqzj\" (UID: \"9d9ecf7f-6a11-469b-8626-99d5ef7ffac7\") " pod="openshift-image-registry/image-registry-869fc8694f-xcqzj"
Oct 31 17:27:00.433762 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:00.433589    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/50e82975-3344-4653-8de3-68e8a64a8757-stats-auth\") pod \"router-default-65db5d9749-xvqmh\" (UID: \"50e82975-3344-4653-8de3-68e8a64a8757\") " pod="openshift-ingress/router-default-65db5d9749-xvqmh"
Oct 31 17:27:00.433762 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:00.433692    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/8e32277f-062d-4c16-81ca-b12e65b24fbb-serving-cert\") pod \"insights-operator-7c4986d449-tggxv\" (UID: \"8e32277f-062d-4c16-81ca-b12e65b24fbb\") " pod="openshift-insights/insights-operator-7c4986d449-tggxv"
Oct 31 17:27:00.433762 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:00.433720    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f03611db-3bd9-401a-a137-1d4f691b51ea-serving-cert\") pod \"console-operator-7cd56b8dbc-b2xxw\" (UID: \"f03611db-3bd9-401a-a137-1d4f691b51ea\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-b2xxw"
Oct 31 17:27:00.433960 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:00.433824    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9d9ecf7f-6a11-469b-8626-99d5ef7ffac7-installation-pull-secrets\") pod \"image-registry-869fc8694f-xcqzj\" (UID: \"9d9ecf7f-6a11-469b-8626-99d5ef7ffac7\") " pod="openshift-image-registry/image-registry-869fc8694f-xcqzj"
Oct 31 17:27:00.433960 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:00.433888    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/170ada34-8944-43d2-bcfb-1d782aae5348-installation-pull-secrets\") pod \"image-registry-74dbfdb444-q7rkg\" (UID: \"170ada34-8944-43d2-bcfb-1d782aae5348\") " pod="openshift-image-registry/image-registry-74dbfdb444-q7rkg"
Oct 31 17:27:00.434077 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:00.434061    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c390ea6f-c609-40f7-a9ec-53fd5c08d857-cert\") pod \"ingress-canary-ptxt2\" (UID: \"c390ea6f-c609-40f7-a9ec-53fd5c08d857\") " pod="openshift-ingress-canary/ingress-canary-ptxt2"
Oct 31 17:27:00.434407 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:00.434385    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/50e82975-3344-4653-8de3-68e8a64a8757-default-certificate\") pod \"router-default-65db5d9749-xvqmh\" (UID: \"50e82975-3344-4653-8de3-68e8a64a8757\") " pod="openshift-ingress/router-default-65db5d9749-xvqmh"
Oct 31 17:27:00.435047 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:00.435026    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/170ada34-8944-43d2-bcfb-1d782aae5348-image-registry-private-configuration\") pod \"image-registry-74dbfdb444-q7rkg\" (UID: \"170ada34-8944-43d2-bcfb-1d782aae5348\") " pod="openshift-image-registry/image-registry-74dbfdb444-q7rkg"
Oct 31 17:27:00.449431 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:00.449395    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v5x5x\" (UniqueName: \"kubernetes.io/projected/26373302-592f-4fd5-bd54-7ac57ef19bfd-kube-api-access-v5x5x\") pod \"kas-connection-checker-685895c7c9-6pnp6\" (UID: \"26373302-592f-4fd5-bd54-7ac57ef19bfd\") " pod="kube-system/kas-connection-checker-685895c7c9-6pnp6"
Oct 31 17:27:00.452900 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:00.450135    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9d9ecf7f-6a11-469b-8626-99d5ef7ffac7-bound-sa-token\") pod \"image-registry-869fc8694f-xcqzj\" (UID: \"9d9ecf7f-6a11-469b-8626-99d5ef7ffac7\") " pod="openshift-image-registry/image-registry-869fc8694f-xcqzj"
Oct 31 17:27:00.452900 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:00.450531    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6tlzl\" (UniqueName: \"kubernetes.io/projected/8a9e5aa4-f4fc-4b33-a925-8e63df6c9cd2-kube-api-access-6tlzl\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-4xtm4\" (UID: \"8a9e5aa4-f4fc-4b33-a925-8e63df6c9cd2\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-4xtm4"
Oct 31 17:27:00.453219 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:00.453188    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rbmtq\" (UniqueName: \"kubernetes.io/projected/a7959bdf-3723-4ee9-a587-6cd16e28d4b1-kube-api-access-rbmtq\") pod \"volume-data-source-validator-58c9f5f46d-th5tq\" (UID: \"a7959bdf-3723-4ee9-a587-6cd16e28d4b1\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-th5tq"
Oct 31 17:27:00.453683 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:00.453635    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j26t9\" (UniqueName: \"kubernetes.io/projected/340f062e-e599-4620-87d1-c5be0bb1b319-kube-api-access-j26t9\") pod \"kas-connection-checker-685895c7c9-kgdxw\" (UID: \"340f062e-e599-4620-87d1-c5be0bb1b319\") " pod="kube-system/kas-connection-checker-685895c7c9-kgdxw"
Oct 31 17:27:00.453916 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:00.453894    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-krrzb\" (UniqueName: \"kubernetes.io/projected/ec682f92-b657-44bd-9e85-3cd4680d2f95-kube-api-access-krrzb\") pod \"cluster-samples-operator-6ddb6c8b94-rhsk4\" (UID: \"ec682f92-b657-44bd-9e85-3cd4680d2f95\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-rhsk4"
Oct 31 17:27:00.454217 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:00.454199    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vpl4m\" (UniqueName: \"kubernetes.io/projected/a1bea244-6573-4e3c-9849-b27ade411c9f-kube-api-access-vpl4m\") pod \"cluster-monitoring-operator-884576c57-csbxp\" (UID: \"a1bea244-6573-4e3c-9849-b27ade411c9f\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-csbxp"
Oct 31 17:27:00.454820 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:00.454801    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5x4hs\" (UniqueName: \"kubernetes.io/projected/8e32277f-062d-4c16-81ca-b12e65b24fbb-kube-api-access-5x4hs\") pod \"insights-operator-7c4986d449-tggxv\" (UID: \"8e32277f-062d-4c16-81ca-b12e65b24fbb\") " pod="openshift-insights/insights-operator-7c4986d449-tggxv"
Oct 31 17:27:00.456420 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:00.456395    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f88d4\" (UniqueName: \"kubernetes.io/projected/f03611db-3bd9-401a-a137-1d4f691b51ea-kube-api-access-f88d4\") pod \"console-operator-7cd56b8dbc-b2xxw\" (UID: \"f03611db-3bd9-401a-a137-1d4f691b51ea\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-b2xxw"
Oct 31 17:27:00.456511 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:00.456451    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6vzgd\" (UniqueName: \"kubernetes.io/projected/2330cbe7-498c-4f39-ba1b-3873e125dd18-kube-api-access-6vzgd\") pod \"service-ca-operator-544d749c8c-7lspr\" (UID: \"2330cbe7-498c-4f39-ba1b-3873e125dd18\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-7lspr"
Oct 31 17:27:00.456584 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:00.456521    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j86wf\" (UniqueName: \"kubernetes.io/projected/d5856011-8f77-4e60-8ecc-c7ac852a50b0-kube-api-access-j86wf\") pod \"network-check-source-6f78d59f99-qkkwm\" (UID: \"d5856011-8f77-4e60-8ecc-c7ac852a50b0\") " pod="openshift-network-diagnostics/network-check-source-6f78d59f99-qkkwm"
Oct 31 17:27:00.456584 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:00.456536    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ngvv2\" (UniqueName: \"kubernetes.io/projected/50e82975-3344-4653-8de3-68e8a64a8757-kube-api-access-ngvv2\") pod \"router-default-65db5d9749-xvqmh\" (UID: \"50e82975-3344-4653-8de3-68e8a64a8757\") " pod="openshift-ingress/router-default-65db5d9749-xvqmh"
Oct 31 17:27:00.456719 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:00.456682    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mgwcl\" (UniqueName: \"kubernetes.io/projected/9d9ecf7f-6a11-469b-8626-99d5ef7ffac7-kube-api-access-mgwcl\") pod \"image-registry-869fc8694f-xcqzj\" (UID: \"9d9ecf7f-6a11-469b-8626-99d5ef7ffac7\") " pod="openshift-image-registry/image-registry-869fc8694f-xcqzj"
Oct 31 17:27:00.456966 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:00.456929    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/170ada34-8944-43d2-bcfb-1d782aae5348-bound-sa-token\") pod \"image-registry-74dbfdb444-q7rkg\" (UID: \"170ada34-8944-43d2-bcfb-1d782aae5348\") " pod="openshift-image-registry/image-registry-74dbfdb444-q7rkg"
Oct 31 17:27:00.457057 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:00.456993    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z57fk\" (UniqueName: \"kubernetes.io/projected/c390ea6f-c609-40f7-a9ec-53fd5c08d857-kube-api-access-z57fk\") pod \"ingress-canary-ptxt2\" (UID: \"c390ea6f-c609-40f7-a9ec-53fd5c08d857\") " pod="openshift-ingress-canary/ingress-canary-ptxt2"
Oct 31 17:27:00.457057 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:00.457039    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h6b47\" (UniqueName: \"kubernetes.io/projected/170ada34-8944-43d2-bcfb-1d782aae5348-kube-api-access-h6b47\") pod \"image-registry-74dbfdb444-q7rkg\" (UID: \"170ada34-8944-43d2-bcfb-1d782aae5348\") " pod="openshift-image-registry/image-registry-74dbfdb444-q7rkg"
Oct 31 17:27:00.457396 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:00.457372    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kqpvj\" (UniqueName: \"kubernetes.io/projected/25ad5c67-f563-4653-9e86-7e9ecbe78675-kube-api-access-kqpvj\") pod \"dns-default-7v7x4\" (UID: \"25ad5c67-f563-4653-9e86-7e9ecbe78675\") " pod="openshift-dns/dns-default-7v7x4"
Oct 31 17:27:00.458427 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:00.458405    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t9n2j\" (UniqueName: \"kubernetes.io/projected/9363fb38-792f-41a6-b6b3-d2c508fff328-kube-api-access-t9n2j\") pod \"kas-connection-checker-685895c7c9-ttbkh\" (UID: \"9363fb38-792f-41a6-b6b3-d2c508fff328\") " pod="kube-system/kas-connection-checker-685895c7c9-ttbkh"
Oct 31 17:27:00.509281 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:00.509245    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kas-connection-checker-685895c7c9-kgdxw"
Oct 31 17:27:00.518935 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:00.518891    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-7cd56b8dbc-b2xxw"
Oct 31 17:27:00.534657 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:00.534621    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kas-connection-checker-685895c7c9-6pnp6"
Oct 31 17:27:00.564790 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:00.564757    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-th5tq"
Oct 31 17:27:00.570555 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:00.570412    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-7lspr"
Oct 31 17:27:00.582038 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:00.582006    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-4xtm4"
Oct 31 17:27:00.596343 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:00.596270    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kas-connection-checker-685895c7c9-ttbkh"
Oct 31 17:27:00.606878 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:00.606848    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-7c4986d449-tggxv"
Oct 31 17:27:00.612611 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:00.612585    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-6f78d59f99-qkkwm"
Oct 31 17:27:00.629982 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:00.629798    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-ptxt2"
Oct 31 17:27:00.772471 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:00.770864    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qgtf4"
Oct 31 17:27:00.775201 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:00.772624    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pqs8z"
Oct 31 17:27:00.775201 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:00.773750    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7j59v"
Oct 31 17:27:00.789414 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:00.789383    2572 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"global-pull-secret-syncer-dockercfg-tj66q\""
Oct 31 17:27:00.789626 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:00.789393    2572 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-z2hdt\""
Oct 31 17:27:00.789764 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:00.789435    2572 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Oct 31 17:27:00.790112 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:00.790093    2572 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Oct 31 17:27:00.804406 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:00.804361    2572 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-check-target-dockercfg-nk5tf\""
Oct 31 17:27:00.870358 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:00.870325    2572 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/kas-connection-checker-685895c7c9-kgdxw"]
Oct 31 17:27:00.874367 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:00.874344    2572 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-th5tq"]
Oct 31 17:27:00.874505 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:27:00.874359    2572 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod340f062e_e599_4620_87d1_c5be0bb1b319.slice/crio-d7a09902a067c1ac1a86baee212c117b772da95dfc4dc1fb3607c960bc30f8cf WatchSource:0}: Error finding container d7a09902a067c1ac1a86baee212c117b772da95dfc4dc1fb3607c960bc30f8cf: Status 404 returned error can't find the container with id d7a09902a067c1ac1a86baee212c117b772da95dfc4dc1fb3607c960bc30f8cf
Oct 31 17:27:00.877044 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:00.877020    2572 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-7cd56b8dbc-b2xxw"]
Oct 31 17:27:00.877544 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:27:00.877523    2572 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda7959bdf_3723_4ee9_a587_6cd16e28d4b1.slice/crio-c75845d8ebe4c7da50fed94b6455e5612f288c07a0727d2e44903bfce28fe571 WatchSource:0}: Error finding container c75845d8ebe4c7da50fed94b6455e5612f288c07a0727d2e44903bfce28fe571: Status 404 returned error can't find the container with id c75845d8ebe4c7da50fed94b6455e5612f288c07a0727d2e44903bfce28fe571
Oct 31 17:27:00.880451 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:27:00.880431    2572 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf03611db_3bd9_401a_a137_1d4f691b51ea.slice/crio-c2338ea0da8ffd495897336bb22c7427577acf2382e1c3e4b5b0e9758b07fb2a WatchSource:0}: Error finding container c2338ea0da8ffd495897336bb22c7427577acf2382e1c3e4b5b0e9758b07fb2a: Status 404 returned error can't find the container with id c2338ea0da8ffd495897336bb22c7427577acf2382e1c3e4b5b0e9758b07fb2a
Oct 31 17:27:00.886812 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:00.886793    2572 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/kas-connection-checker-685895c7c9-6pnp6"]
Oct 31 17:27:00.890394 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:27:00.890368    2572 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod26373302_592f_4fd5_bd54_7ac57ef19bfd.slice/crio-55c24e9e35b3f3455301939fd9cf68e6a7756ba200158846632ae9c027f11501 WatchSource:0}: Error finding container 55c24e9e35b3f3455301939fd9cf68e6a7756ba200158846632ae9c027f11501: Status 404 returned error can't find the container with id 55c24e9e35b3f3455301939fd9cf68e6a7756ba200158846632ae9c027f11501
Oct 31 17:27:00.936323 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:00.936287    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/9a0cf7f7-c12d-42fe-a83e-28e1f1859cd2-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-rnvgv\" (UID: \"9a0cf7f7-c12d-42fe-a83e-28e1f1859cd2\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-rnvgv"
Oct 31 17:27:00.936514 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:00.936367    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/ec682f92-b657-44bd-9e85-3cd4680d2f95-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-rhsk4\" (UID: \"ec682f92-b657-44bd-9e85-3cd4680d2f95\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-rhsk4"
Oct 31 17:27:00.936514 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:00.936452    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/50e82975-3344-4653-8de3-68e8a64a8757-service-ca-bundle\") pod \"router-default-65db5d9749-xvqmh\" (UID: \"50e82975-3344-4653-8de3-68e8a64a8757\") " pod="openshift-ingress/router-default-65db5d9749-xvqmh"
Oct 31 17:27:00.936514 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:00.936485    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/a1bea244-6573-4e3c-9849-b27ade411c9f-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-csbxp\" (UID: \"a1bea244-6573-4e3c-9849-b27ade411c9f\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-csbxp"
Oct 31 17:27:00.936514 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:00.936513    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9d9ecf7f-6a11-469b-8626-99d5ef7ffac7-registry-tls\") pod \"image-registry-869fc8694f-xcqzj\" (UID: \"9d9ecf7f-6a11-469b-8626-99d5ef7ffac7\") " pod="openshift-image-registry/image-registry-869fc8694f-xcqzj"
Oct 31 17:27:00.937147 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:00.936571    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/170ada34-8944-43d2-bcfb-1d782aae5348-registry-tls\") pod \"image-registry-74dbfdb444-q7rkg\" (UID: \"170ada34-8944-43d2-bcfb-1d782aae5348\") " pod="openshift-image-registry/image-registry-74dbfdb444-q7rkg"
Oct 31 17:27:00.937147 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:00.936622    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/50e82975-3344-4653-8de3-68e8a64a8757-metrics-certs\") pod \"router-default-65db5d9749-xvqmh\" (UID: \"50e82975-3344-4653-8de3-68e8a64a8757\") " pod="openshift-ingress/router-default-65db5d9749-xvqmh"
Oct 31 17:27:00.937147 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:00.936667    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/25ad5c67-f563-4653-9e86-7e9ecbe78675-metrics-tls\") pod \"dns-default-7v7x4\" (UID: \"25ad5c67-f563-4653-9e86-7e9ecbe78675\") " pod="openshift-dns/dns-default-7v7x4"
Oct 31 17:27:00.937147 ip-10-0-138-17 kubenswrapper[2572]: E1031 17:27:00.936810    2572 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Oct 31 17:27:00.937147 ip-10-0-138-17 kubenswrapper[2572]: E1031 17:27:00.936868    2572 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Oct 31 17:27:00.937147 ip-10-0-138-17 kubenswrapper[2572]: E1031 17:27:00.936877    2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Oct 31 17:27:00.937147 ip-10-0-138-17 kubenswrapper[2572]: E1031 17:27:00.936898    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9a0cf7f7-c12d-42fe-a83e-28e1f1859cd2-networking-console-plugin-cert podName:9a0cf7f7-c12d-42fe-a83e-28e1f1859cd2 nodeName:}" failed. No retries permitted until 2026-10-31 17:27:01.936876338 +0000 UTC m=+31.652734017 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/9a0cf7f7-c12d-42fe-a83e-28e1f1859cd2-networking-console-plugin-cert") pod "networking-console-plugin-86c478bb88-rnvgv" (UID: "9a0cf7f7-c12d-42fe-a83e-28e1f1859cd2") : secret "networking-console-plugin-cert" not found
Oct 31 17:27:00.937147 ip-10-0-138-17 kubenswrapper[2572]: E1031 17:27:00.936812    2572 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Oct 31 17:27:00.937147 ip-10-0-138-17 kubenswrapper[2572]: E1031 17:27:00.936927    2572 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Oct 31 17:27:00.937147 ip-10-0-138-17 kubenswrapper[2572]: E1031 17:27:00.936936    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/25ad5c67-f563-4653-9e86-7e9ecbe78675-metrics-tls podName:25ad5c67-f563-4653-9e86-7e9ecbe78675 nodeName:}" failed. No retries permitted until 2026-10-31 17:27:01.936920692 +0000 UTC m=+31.652778385 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/25ad5c67-f563-4653-9e86-7e9ecbe78675-metrics-tls") pod "dns-default-7v7x4" (UID: "25ad5c67-f563-4653-9e86-7e9ecbe78675") : secret "dns-default-metrics-tls" not found
Oct 31 17:27:00.937147 ip-10-0-138-17 kubenswrapper[2572]: E1031 17:27:00.936887    2572 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Oct 31 17:27:00.937147 ip-10-0-138-17 kubenswrapper[2572]: E1031 17:27:00.936883    2572 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-74dbfdb444-q7rkg: secret "image-registry-tls" not found
Oct 31 17:27:00.937147 ip-10-0-138-17 kubenswrapper[2572]: E1031 17:27:00.936963    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/50e82975-3344-4653-8de3-68e8a64a8757-service-ca-bundle podName:50e82975-3344-4653-8de3-68e8a64a8757 nodeName:}" failed. No retries permitted until 2026-10-31 17:27:01.936945589 +0000 UTC m=+31.652803272 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/50e82975-3344-4653-8de3-68e8a64a8757-service-ca-bundle") pod "router-default-65db5d9749-xvqmh" (UID: "50e82975-3344-4653-8de3-68e8a64a8757") : configmap references non-existent config key: service-ca.crt
Oct 31 17:27:00.937147 ip-10-0-138-17 kubenswrapper[2572]: E1031 17:27:00.936964    2572 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-869fc8694f-xcqzj: secret "image-registry-tls" not found
Oct 31 17:27:00.937147 ip-10-0-138-17 kubenswrapper[2572]: E1031 17:27:00.936986    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ec682f92-b657-44bd-9e85-3cd4680d2f95-samples-operator-tls podName:ec682f92-b657-44bd-9e85-3cd4680d2f95 nodeName:}" failed. No retries permitted until 2026-10-31 17:27:01.936974547 +0000 UTC m=+31.652832223 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/ec682f92-b657-44bd-9e85-3cd4680d2f95-samples-operator-tls") pod "cluster-samples-operator-6ddb6c8b94-rhsk4" (UID: "ec682f92-b657-44bd-9e85-3cd4680d2f95") : secret "samples-operator-tls" not found
Oct 31 17:27:00.937147 ip-10-0-138-17 kubenswrapper[2572]: E1031 17:27:00.937011    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/170ada34-8944-43d2-bcfb-1d782aae5348-registry-tls podName:170ada34-8944-43d2-bcfb-1d782aae5348 nodeName:}" failed. No retries permitted until 2026-10-31 17:27:01.936999948 +0000 UTC m=+31.652857656 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/170ada34-8944-43d2-bcfb-1d782aae5348-registry-tls") pod "image-registry-74dbfdb444-q7rkg" (UID: "170ada34-8944-43d2-bcfb-1d782aae5348") : secret "image-registry-tls" not found
Oct 31 17:27:00.937956 ip-10-0-138-17 kubenswrapper[2572]: E1031 17:27:00.937040    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9d9ecf7f-6a11-469b-8626-99d5ef7ffac7-registry-tls podName:9d9ecf7f-6a11-469b-8626-99d5ef7ffac7 nodeName:}" failed. No retries permitted until 2026-10-31 17:27:01.937020943 +0000 UTC m=+31.652878623 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9d9ecf7f-6a11-469b-8626-99d5ef7ffac7-registry-tls") pod "image-registry-869fc8694f-xcqzj" (UID: "9d9ecf7f-6a11-469b-8626-99d5ef7ffac7") : secret "image-registry-tls" not found
Oct 31 17:27:00.937956 ip-10-0-138-17 kubenswrapper[2572]: E1031 17:27:00.937057    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a1bea244-6573-4e3c-9849-b27ade411c9f-cluster-monitoring-operator-tls podName:a1bea244-6573-4e3c-9849-b27ade411c9f nodeName:}" failed. No retries permitted until 2026-10-31 17:27:01.937048313 +0000 UTC m=+31.652905988 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/a1bea244-6573-4e3c-9849-b27ade411c9f-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-884576c57-csbxp" (UID: "a1bea244-6573-4e3c-9849-b27ade411c9f") : secret "cluster-monitoring-operator-tls" not found
Oct 31 17:27:00.937956 ip-10-0-138-17 kubenswrapper[2572]: E1031 17:27:00.937068    2572 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Oct 31 17:27:00.937956 ip-10-0-138-17 kubenswrapper[2572]: E1031 17:27:00.937120    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/50e82975-3344-4653-8de3-68e8a64a8757-metrics-certs podName:50e82975-3344-4653-8de3-68e8a64a8757 nodeName:}" failed. No retries permitted until 2026-10-31 17:27:01.937109686 +0000 UTC m=+31.652967375 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/50e82975-3344-4653-8de3-68e8a64a8757-metrics-certs") pod "router-default-65db5d9749-xvqmh" (UID: "50e82975-3344-4653-8de3-68e8a64a8757") : secret "router-metrics-certs-default" not found
Oct 31 17:27:00.963526 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:00.963458    2572 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-544d749c8c-7lspr"]
Oct 31 17:27:00.965130 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:00.964982    2572 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-4xtm4"]
Oct 31 17:27:00.999859 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:00.999717    2572 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/kas-connection-checker-685895c7c9-ttbkh"]
Oct 31 17:27:01.019058 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:01.018527    2572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-4xtm4" event={"ID":"8a9e5aa4-f4fc-4b33-a925-8e63df6c9cd2","Type":"ContainerStarted","Data":"199e372bc14f6d1835767bbf1d713534986731696ef08b89fcb16220f2b382d1"}
Oct 31 17:27:01.021167 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:01.021139    2572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kas-connection-checker-685895c7c9-kgdxw" event={"ID":"340f062e-e599-4620-87d1-c5be0bb1b319","Type":"ContainerStarted","Data":"d7a09902a067c1ac1a86baee212c117b772da95dfc4dc1fb3607c960bc30f8cf"}
Oct 31 17:27:01.023664 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:01.023587    2572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kas-connection-checker-685895c7c9-6pnp6" event={"ID":"26373302-592f-4fd5-bd54-7ac57ef19bfd","Type":"ContainerStarted","Data":"55c24e9e35b3f3455301939fd9cf68e6a7756ba200158846632ae9c027f11501"}
Oct 31 17:27:01.025305 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:01.025277    2572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-7lspr" event={"ID":"2330cbe7-498c-4f39-ba1b-3873e125dd18","Type":"ContainerStarted","Data":"0dea90a26434f8f6217f8618985f915fb0f73f4b017c635d9240a0b1ca615e8f"}
Oct 31 17:27:01.026469 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:01.026442    2572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7cd56b8dbc-b2xxw" event={"ID":"f03611db-3bd9-401a-a137-1d4f691b51ea","Type":"ContainerStarted","Data":"c2338ea0da8ffd495897336bb22c7427577acf2382e1c3e4b5b0e9758b07fb2a"}
Oct 31 17:27:01.027542 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:01.027522    2572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-th5tq" event={"ID":"a7959bdf-3723-4ee9-a587-6cd16e28d4b1","Type":"ContainerStarted","Data":"c75845d8ebe4c7da50fed94b6455e5612f288c07a0727d2e44903bfce28fe571"}
Oct 31 17:27:01.039638 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:01.039614    2572 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-ptxt2"]
Oct 31 17:27:01.043355 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:27:01.043316    2572 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc390ea6f_c609_40f7_a9ec_53fd5c08d857.slice/crio-75e7934ec6e3158727778643e8e4d10cb6bd24556a488c337e5dd699ab3c17c6 WatchSource:0}: Error finding container 75e7934ec6e3158727778643e8e4d10cb6bd24556a488c337e5dd699ab3c17c6: Status 404 returned error can't find the container with id 75e7934ec6e3158727778643e8e4d10cb6bd24556a488c337e5dd699ab3c17c6
Oct 31 17:27:01.075121 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:01.075079    2572 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-7c4986d449-tggxv"]
Oct 31 17:27:01.078179 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:27:01.078136    2572 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8e32277f_062d_4c16_81ca_b12e65b24fbb.slice/crio-ccaf9147bedffeecc2ec62a1f12370b33c20b2b6e4eddd1abaa0444d5431fefa WatchSource:0}: Error finding container ccaf9147bedffeecc2ec62a1f12370b33c20b2b6e4eddd1abaa0444d5431fefa: Status 404 returned error can't find the container with id ccaf9147bedffeecc2ec62a1f12370b33c20b2b6e4eddd1abaa0444d5431fefa
Oct 31 17:27:01.078179 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:01.078153    2572 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-6f78d59f99-qkkwm"]
Oct 31 17:27:01.948889 ip-10-0-138-17 kubenswrapper[2572]: E1031 17:27:01.948859    2572 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Oct 31 17:27:01.949508 ip-10-0-138-17 kubenswrapper[2572]: E1031 17:27:01.948925    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9a0cf7f7-c12d-42fe-a83e-28e1f1859cd2-networking-console-plugin-cert podName:9a0cf7f7-c12d-42fe-a83e-28e1f1859cd2 nodeName:}" failed. No retries permitted until 2026-10-31 17:27:03.948910925 +0000 UTC m=+33.664768606 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/9a0cf7f7-c12d-42fe-a83e-28e1f1859cd2-networking-console-plugin-cert") pod "networking-console-plugin-86c478bb88-rnvgv" (UID: "9a0cf7f7-c12d-42fe-a83e-28e1f1859cd2") : secret "networking-console-plugin-cert" not found
Oct 31 17:27:01.949757 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:01.948659    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/9a0cf7f7-c12d-42fe-a83e-28e1f1859cd2-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-rnvgv\" (UID: \"9a0cf7f7-c12d-42fe-a83e-28e1f1859cd2\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-rnvgv"
Oct 31 17:27:01.949966 ip-10-0-138-17 kubenswrapper[2572]: E1031 17:27:01.949947    2572 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Oct 31 17:27:01.950031 ip-10-0-138-17 kubenswrapper[2572]: E1031 17:27:01.950020    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ec682f92-b657-44bd-9e85-3cd4680d2f95-samples-operator-tls podName:ec682f92-b657-44bd-9e85-3cd4680d2f95 nodeName:}" failed. No retries permitted until 2026-10-31 17:27:03.949994635 +0000 UTC m=+33.665852322 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/ec682f92-b657-44bd-9e85-3cd4680d2f95-samples-operator-tls") pod "cluster-samples-operator-6ddb6c8b94-rhsk4" (UID: "ec682f92-b657-44bd-9e85-3cd4680d2f95") : secret "samples-operator-tls" not found
Oct 31 17:27:01.950296 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:01.950277    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/ec682f92-b657-44bd-9e85-3cd4680d2f95-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-rhsk4\" (UID: \"ec682f92-b657-44bd-9e85-3cd4680d2f95\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-rhsk4"
Oct 31 17:27:01.950404 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:01.950391    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/50e82975-3344-4653-8de3-68e8a64a8757-service-ca-bundle\") pod \"router-default-65db5d9749-xvqmh\" (UID: \"50e82975-3344-4653-8de3-68e8a64a8757\") " pod="openshift-ingress/router-default-65db5d9749-xvqmh"
Oct 31 17:27:01.950458 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:01.950427    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/a1bea244-6573-4e3c-9849-b27ade411c9f-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-csbxp\" (UID: \"a1bea244-6573-4e3c-9849-b27ade411c9f\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-csbxp"
Oct 31 17:27:01.950458 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:01.950451    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9d9ecf7f-6a11-469b-8626-99d5ef7ffac7-registry-tls\") pod \"image-registry-869fc8694f-xcqzj\" (UID: \"9d9ecf7f-6a11-469b-8626-99d5ef7ffac7\") " pod="openshift-image-registry/image-registry-869fc8694f-xcqzj"
Oct 31 17:27:01.950556 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:01.950475    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/170ada34-8944-43d2-bcfb-1d782aae5348-registry-tls\") pod \"image-registry-74dbfdb444-q7rkg\" (UID: \"170ada34-8944-43d2-bcfb-1d782aae5348\") " pod="openshift-image-registry/image-registry-74dbfdb444-q7rkg"
Oct 31 17:27:01.950556 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:01.950522    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/50e82975-3344-4653-8de3-68e8a64a8757-metrics-certs\") pod \"router-default-65db5d9749-xvqmh\" (UID: \"50e82975-3344-4653-8de3-68e8a64a8757\") " pod="openshift-ingress/router-default-65db5d9749-xvqmh"
Oct 31 17:27:01.950675 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:01.950561    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/25ad5c67-f563-4653-9e86-7e9ecbe78675-metrics-tls\") pod \"dns-default-7v7x4\" (UID: \"25ad5c67-f563-4653-9e86-7e9ecbe78675\") " pod="openshift-dns/dns-default-7v7x4"
Oct 31 17:27:01.950725 ip-10-0-138-17 kubenswrapper[2572]: E1031 17:27:01.950689    2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Oct 31 17:27:01.950725 ip-10-0-138-17 kubenswrapper[2572]: E1031 17:27:01.950724    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/25ad5c67-f563-4653-9e86-7e9ecbe78675-metrics-tls podName:25ad5c67-f563-4653-9e86-7e9ecbe78675 nodeName:}" failed. No retries permitted until 2026-10-31 17:27:03.950711181 +0000 UTC m=+33.666568849 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/25ad5c67-f563-4653-9e86-7e9ecbe78675-metrics-tls") pod "dns-default-7v7x4" (UID: "25ad5c67-f563-4653-9e86-7e9ecbe78675") : secret "dns-default-metrics-tls" not found
Oct 31 17:27:01.950830 ip-10-0-138-17 kubenswrapper[2572]: E1031 17:27:01.950788    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/50e82975-3344-4653-8de3-68e8a64a8757-service-ca-bundle podName:50e82975-3344-4653-8de3-68e8a64a8757 nodeName:}" failed. No retries permitted until 2026-10-31 17:27:03.950780061 +0000 UTC m=+33.666637742 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/50e82975-3344-4653-8de3-68e8a64a8757-service-ca-bundle") pod "router-default-65db5d9749-xvqmh" (UID: "50e82975-3344-4653-8de3-68e8a64a8757") : configmap references non-existent config key: service-ca.crt
Oct 31 17:27:01.950891 ip-10-0-138-17 kubenswrapper[2572]: E1031 17:27:01.950835    2572 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Oct 31 17:27:01.950891 ip-10-0-138-17 kubenswrapper[2572]: E1031 17:27:01.950861    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a1bea244-6573-4e3c-9849-b27ade411c9f-cluster-monitoring-operator-tls podName:a1bea244-6573-4e3c-9849-b27ade411c9f nodeName:}" failed. No retries permitted until 2026-10-31 17:27:03.950853743 +0000 UTC m=+33.666711414 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/a1bea244-6573-4e3c-9849-b27ade411c9f-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-884576c57-csbxp" (UID: "a1bea244-6573-4e3c-9849-b27ade411c9f") : secret "cluster-monitoring-operator-tls" not found
Oct 31 17:27:01.950989 ip-10-0-138-17 kubenswrapper[2572]: E1031 17:27:01.950935    2572 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Oct 31 17:27:01.950989 ip-10-0-138-17 kubenswrapper[2572]: E1031 17:27:01.950954    2572 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-869fc8694f-xcqzj: secret "image-registry-tls" not found
Oct 31 17:27:01.951076 ip-10-0-138-17 kubenswrapper[2572]: E1031 17:27:01.950992    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9d9ecf7f-6a11-469b-8626-99d5ef7ffac7-registry-tls podName:9d9ecf7f-6a11-469b-8626-99d5ef7ffac7 nodeName:}" failed. No retries permitted until 2026-10-31 17:27:03.950974593 +0000 UTC m=+33.666832279 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9d9ecf7f-6a11-469b-8626-99d5ef7ffac7-registry-tls") pod "image-registry-869fc8694f-xcqzj" (UID: "9d9ecf7f-6a11-469b-8626-99d5ef7ffac7") : secret "image-registry-tls" not found
Oct 31 17:27:01.951076 ip-10-0-138-17 kubenswrapper[2572]: E1031 17:27:01.951055    2572 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Oct 31 17:27:01.951076 ip-10-0-138-17 kubenswrapper[2572]: E1031 17:27:01.951065    2572 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-74dbfdb444-q7rkg: secret "image-registry-tls" not found
Oct 31 17:27:01.951221 ip-10-0-138-17 kubenswrapper[2572]: E1031 17:27:01.951102    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/170ada34-8944-43d2-bcfb-1d782aae5348-registry-tls podName:170ada34-8944-43d2-bcfb-1d782aae5348 nodeName:}" failed. No retries permitted until 2026-10-31 17:27:03.951091747 +0000 UTC m=+33.666949429 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/170ada34-8944-43d2-bcfb-1d782aae5348-registry-tls") pod "image-registry-74dbfdb444-q7rkg" (UID: "170ada34-8944-43d2-bcfb-1d782aae5348") : secret "image-registry-tls" not found
Oct 31 17:27:01.951221 ip-10-0-138-17 kubenswrapper[2572]: E1031 17:27:01.951169    2572 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Oct 31 17:27:01.951221 ip-10-0-138-17 kubenswrapper[2572]: E1031 17:27:01.951195    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/50e82975-3344-4653-8de3-68e8a64a8757-metrics-certs podName:50e82975-3344-4653-8de3-68e8a64a8757 nodeName:}" failed. No retries permitted until 2026-10-31 17:27:03.951189031 +0000 UTC m=+33.667046698 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/50e82975-3344-4653-8de3-68e8a64a8757-metrics-certs") pod "router-default-65db5d9749-xvqmh" (UID: "50e82975-3344-4653-8de3-68e8a64a8757") : secret "router-metrics-certs-default" not found
Oct 31 17:27:02.036198 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:02.036156    2572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-ptxt2" event={"ID":"c390ea6f-c609-40f7-a9ec-53fd5c08d857","Type":"ContainerStarted","Data":"75e7934ec6e3158727778643e8e4d10cb6bd24556a488c337e5dd699ab3c17c6"}
Oct 31 17:27:02.038971 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:02.038897    2572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kas-connection-checker-685895c7c9-ttbkh" event={"ID":"9363fb38-792f-41a6-b6b3-d2c508fff328","Type":"ContainerStarted","Data":"32cf56f04567aa500b53a59bcc9dcc78ccfe76e501a198efe9e03698b191e535"}
Oct 31 17:27:02.038971 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:02.038949    2572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kas-connection-checker-685895c7c9-ttbkh" event={"ID":"9363fb38-792f-41a6-b6b3-d2c508fff328","Type":"ContainerStarted","Data":"9845958ca43d987b6dc426bbe0514c2e3607c94dc1d6242590e450b8fa1ae20a"}
Oct 31 17:27:02.044864 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:02.044303    2572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kas-connection-checker-685895c7c9-kgdxw" event={"ID":"340f062e-e599-4620-87d1-c5be0bb1b319","Type":"ContainerStarted","Data":"de0ef82d85b4f139cf14d94d134d6d2eadbae7de51ad844e6701a9b1267cfa38"}
Oct 31 17:27:02.051829 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:02.051800    2572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-6f78d59f99-qkkwm" event={"ID":"d5856011-8f77-4e60-8ecc-c7ac852a50b0","Type":"ContainerStarted","Data":"83af66c7b7be1e89a549e9b361de40c83021477f0bfd5b909a56b53d6f5337ba"}
Oct 31 17:27:02.059161 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:02.059022    2572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-7c4986d449-tggxv" event={"ID":"8e32277f-062d-4c16-81ca-b12e65b24fbb","Type":"ContainerStarted","Data":"ccaf9147bedffeecc2ec62a1f12370b33c20b2b6e4eddd1abaa0444d5431fefa"}
Oct 31 17:27:02.061890 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:02.061862    2572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kas-connection-checker-685895c7c9-6pnp6" event={"ID":"26373302-592f-4fd5-bd54-7ac57ef19bfd","Type":"ContainerStarted","Data":"29295b118a9d4ee1e39cc7d35d766922ce91b1029bee787112059d57e3c9e223"}
Oct 31 17:27:02.119688 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:02.119604    2572 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/kas-connection-checker-685895c7c9-6pnp6" podStartSLOduration=418.119584173 podStartE2EDuration="6m58.119584173s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 17:20:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 17:27:02.117984123 +0000 UTC m=+31.833841843" watchObservedRunningTime="2026-10-31 17:27:02.119584173 +0000 UTC m=+31.835441862"
Oct 31 17:27:02.119890 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:02.119740    2572 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/kas-connection-checker-685895c7c9-ttbkh" podStartSLOduration=418.119734084 podStartE2EDuration="6m58.119734084s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 17:20:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 17:27:02.079277292 +0000 UTC m=+31.795134996" watchObservedRunningTime="2026-10-31 17:27:02.119734084 +0000 UTC m=+31.835591778"
Oct 31 17:27:02.158341 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:02.158285    2572 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/kas-connection-checker-685895c7c9-kgdxw" podStartSLOduration=418.158272826 podStartE2EDuration="6m58.158272826s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 17:20:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 17:27:02.157640373 +0000 UTC m=+31.873498064" watchObservedRunningTime="2026-10-31 17:27:02.158272826 +0000 UTC m=+31.874130513"
Oct 31 17:27:03.070712 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:03.070448    2572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-th5tq" event={"ID":"a7959bdf-3723-4ee9-a587-6cd16e28d4b1","Type":"ContainerStarted","Data":"ddd10d5f52058d7a6e1b670394e767ed9f9f24b73726bff3d5a0cd848fd4fd08"}
Oct 31 17:27:03.109824 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:03.108638    2572 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-th5tq" podStartSLOduration=385.168916635 podStartE2EDuration="6m27.108617381s" totalImagesPullingTime="1.939700746s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 17:20:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 17:27:03.107382066 +0000 UTC m=+32.823239783" watchObservedRunningTime="2026-10-31 17:27:03.108617381 +0000 UTC m=+32.824475072"
Oct 31 17:27:03.970620 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:03.970560    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/50e82975-3344-4653-8de3-68e8a64a8757-service-ca-bundle\") pod \"router-default-65db5d9749-xvqmh\" (UID: \"50e82975-3344-4653-8de3-68e8a64a8757\") " pod="openshift-ingress/router-default-65db5d9749-xvqmh"
Oct 31 17:27:03.970620 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:03.970622    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/a1bea244-6573-4e3c-9849-b27ade411c9f-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-csbxp\" (UID: \"a1bea244-6573-4e3c-9849-b27ade411c9f\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-csbxp"
Oct 31 17:27:03.970890 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:03.970674    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9d9ecf7f-6a11-469b-8626-99d5ef7ffac7-registry-tls\") pod \"image-registry-869fc8694f-xcqzj\" (UID: \"9d9ecf7f-6a11-469b-8626-99d5ef7ffac7\") " pod="openshift-image-registry/image-registry-869fc8694f-xcqzj"
Oct 31 17:27:03.970890 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:03.970703    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/170ada34-8944-43d2-bcfb-1d782aae5348-registry-tls\") pod \"image-registry-74dbfdb444-q7rkg\" (UID: \"170ada34-8944-43d2-bcfb-1d782aae5348\") " pod="openshift-image-registry/image-registry-74dbfdb444-q7rkg"
Oct 31 17:27:03.970890 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:03.970756    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/50e82975-3344-4653-8de3-68e8a64a8757-metrics-certs\") pod \"router-default-65db5d9749-xvqmh\" (UID: \"50e82975-3344-4653-8de3-68e8a64a8757\") " pod="openshift-ingress/router-default-65db5d9749-xvqmh"
Oct 31 17:27:03.970890 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:03.970790    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/25ad5c67-f563-4653-9e86-7e9ecbe78675-metrics-tls\") pod \"dns-default-7v7x4\" (UID: \"25ad5c67-f563-4653-9e86-7e9ecbe78675\") " pod="openshift-dns/dns-default-7v7x4"
Oct 31 17:27:03.970890 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:03.970830    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/9a0cf7f7-c12d-42fe-a83e-28e1f1859cd2-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-rnvgv\" (UID: \"9a0cf7f7-c12d-42fe-a83e-28e1f1859cd2\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-rnvgv"
Oct 31 17:27:03.970890 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:03.970887    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/ec682f92-b657-44bd-9e85-3cd4680d2f95-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-rhsk4\" (UID: \"ec682f92-b657-44bd-9e85-3cd4680d2f95\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-rhsk4"
Oct 31 17:27:03.971119 ip-10-0-138-17 kubenswrapper[2572]: E1031 17:27:03.971067    2572 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Oct 31 17:27:03.971156 ip-10-0-138-17 kubenswrapper[2572]: E1031 17:27:03.971132    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ec682f92-b657-44bd-9e85-3cd4680d2f95-samples-operator-tls podName:ec682f92-b657-44bd-9e85-3cd4680d2f95 nodeName:}" failed. No retries permitted until 2026-10-31 17:27:07.971113569 +0000 UTC m=+37.686971252 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/ec682f92-b657-44bd-9e85-3cd4680d2f95-samples-operator-tls") pod "cluster-samples-operator-6ddb6c8b94-rhsk4" (UID: "ec682f92-b657-44bd-9e85-3cd4680d2f95") : secret "samples-operator-tls" not found
Oct 31 17:27:03.971592 ip-10-0-138-17 kubenswrapper[2572]: E1031 17:27:03.971557    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/50e82975-3344-4653-8de3-68e8a64a8757-service-ca-bundle podName:50e82975-3344-4653-8de3-68e8a64a8757 nodeName:}" failed. No retries permitted until 2026-10-31 17:27:07.971542731 +0000 UTC m=+37.687400412 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/50e82975-3344-4653-8de3-68e8a64a8757-service-ca-bundle") pod "router-default-65db5d9749-xvqmh" (UID: "50e82975-3344-4653-8de3-68e8a64a8757") : configmap references non-existent config key: service-ca.crt
Oct 31 17:27:03.971759 ip-10-0-138-17 kubenswrapper[2572]: E1031 17:27:03.971632    2572 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Oct 31 17:27:03.971759 ip-10-0-138-17 kubenswrapper[2572]: E1031 17:27:03.971686    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a1bea244-6573-4e3c-9849-b27ade411c9f-cluster-monitoring-operator-tls podName:a1bea244-6573-4e3c-9849-b27ade411c9f nodeName:}" failed. No retries permitted until 2026-10-31 17:27:07.971674647 +0000 UTC m=+37.687532319 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/a1bea244-6573-4e3c-9849-b27ade411c9f-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-884576c57-csbxp" (UID: "a1bea244-6573-4e3c-9849-b27ade411c9f") : secret "cluster-monitoring-operator-tls" not found
Oct 31 17:27:03.971759 ip-10-0-138-17 kubenswrapper[2572]: E1031 17:27:03.971750    2572 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Oct 31 17:27:03.971759 ip-10-0-138-17 kubenswrapper[2572]: E1031 17:27:03.971760    2572 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-869fc8694f-xcqzj: secret "image-registry-tls" not found
Oct 31 17:27:03.971917 ip-10-0-138-17 kubenswrapper[2572]: E1031 17:27:03.971792    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9d9ecf7f-6a11-469b-8626-99d5ef7ffac7-registry-tls podName:9d9ecf7f-6a11-469b-8626-99d5ef7ffac7 nodeName:}" failed. No retries permitted until 2026-10-31 17:27:07.971780608 +0000 UTC m=+37.687638291 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9d9ecf7f-6a11-469b-8626-99d5ef7ffac7-registry-tls") pod "image-registry-869fc8694f-xcqzj" (UID: "9d9ecf7f-6a11-469b-8626-99d5ef7ffac7") : secret "image-registry-tls" not found
Oct 31 17:27:03.971917 ip-10-0-138-17 kubenswrapper[2572]: E1031 17:27:03.971861    2572 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Oct 31 17:27:03.971917 ip-10-0-138-17 kubenswrapper[2572]: E1031 17:27:03.971870    2572 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-74dbfdb444-q7rkg: secret "image-registry-tls" not found
Oct 31 17:27:03.971917 ip-10-0-138-17 kubenswrapper[2572]: E1031 17:27:03.971899    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/170ada34-8944-43d2-bcfb-1d782aae5348-registry-tls podName:170ada34-8944-43d2-bcfb-1d782aae5348 nodeName:}" failed. No retries permitted until 2026-10-31 17:27:07.971889126 +0000 UTC m=+37.687746799 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/170ada34-8944-43d2-bcfb-1d782aae5348-registry-tls") pod "image-registry-74dbfdb444-q7rkg" (UID: "170ada34-8944-43d2-bcfb-1d782aae5348") : secret "image-registry-tls" not found
Oct 31 17:27:03.972081 ip-10-0-138-17 kubenswrapper[2572]: E1031 17:27:03.971959    2572 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Oct 31 17:27:03.972081 ip-10-0-138-17 kubenswrapper[2572]: E1031 17:27:03.971988    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/50e82975-3344-4653-8de3-68e8a64a8757-metrics-certs podName:50e82975-3344-4653-8de3-68e8a64a8757 nodeName:}" failed. No retries permitted until 2026-10-31 17:27:07.971979104 +0000 UTC m=+37.687836787 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/50e82975-3344-4653-8de3-68e8a64a8757-metrics-certs") pod "router-default-65db5d9749-xvqmh" (UID: "50e82975-3344-4653-8de3-68e8a64a8757") : secret "router-metrics-certs-default" not found
Oct 31 17:27:03.972081 ip-10-0-138-17 kubenswrapper[2572]: E1031 17:27:03.972043    2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Oct 31 17:27:03.972081 ip-10-0-138-17 kubenswrapper[2572]: E1031 17:27:03.972069    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/25ad5c67-f563-4653-9e86-7e9ecbe78675-metrics-tls podName:25ad5c67-f563-4653-9e86-7e9ecbe78675 nodeName:}" failed. No retries permitted until 2026-10-31 17:27:07.972060441 +0000 UTC m=+37.687918112 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/25ad5c67-f563-4653-9e86-7e9ecbe78675-metrics-tls") pod "dns-default-7v7x4" (UID: "25ad5c67-f563-4653-9e86-7e9ecbe78675") : secret "dns-default-metrics-tls" not found
Oct 31 17:27:03.972238 ip-10-0-138-17 kubenswrapper[2572]: E1031 17:27:03.972121    2572 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Oct 31 17:27:03.972238 ip-10-0-138-17 kubenswrapper[2572]: E1031 17:27:03.972150    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9a0cf7f7-c12d-42fe-a83e-28e1f1859cd2-networking-console-plugin-cert podName:9a0cf7f7-c12d-42fe-a83e-28e1f1859cd2 nodeName:}" failed. No retries permitted until 2026-10-31 17:27:07.972140627 +0000 UTC m=+37.687998300 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/9a0cf7f7-c12d-42fe-a83e-28e1f1859cd2-networking-console-plugin-cert") pod "networking-console-plugin-86c478bb88-rnvgv" (UID: "9a0cf7f7-c12d-42fe-a83e-28e1f1859cd2") : secret "networking-console-plugin-cert" not found
Oct 31 17:27:04.577857 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:04.577806    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/449efcb2-6707-4809-b869-1bb477f6e6ae-metrics-certs\") pod \"network-metrics-daemon-7j59v\" (UID: \"449efcb2-6707-4809-b869-1bb477f6e6ae\") " pod="openshift-multus/network-metrics-daemon-7j59v"
Oct 31 17:27:04.578319 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:04.577900    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9179e3c5-ef52-4445-aec0-779c3e99cb07-original-pull-secret\") pod \"global-pull-secret-syncer-qgtf4\" (UID: \"9179e3c5-ef52-4445-aec0-779c3e99cb07\") " pod="kube-system/global-pull-secret-syncer-qgtf4"
Oct 31 17:27:04.579010 ip-10-0-138-17 kubenswrapper[2572]: E1031 17:27:04.578664    2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Oct 31 17:27:04.579010 ip-10-0-138-17 kubenswrapper[2572]: E1031 17:27:04.578742    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/449efcb2-6707-4809-b869-1bb477f6e6ae-metrics-certs podName:449efcb2-6707-4809-b869-1bb477f6e6ae nodeName:}" failed. No retries permitted until 2026-10-31 17:27:36.578722254 +0000 UTC m=+66.294579939 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/449efcb2-6707-4809-b869-1bb477f6e6ae-metrics-certs") pod "network-metrics-daemon-7j59v" (UID: "449efcb2-6707-4809-b869-1bb477f6e6ae") : secret "metrics-daemon-secret" not found
Oct 31 17:27:04.581801 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:04.581749    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9179e3c5-ef52-4445-aec0-779c3e99cb07-original-pull-secret\") pod \"global-pull-secret-syncer-qgtf4\" (UID: \"9179e3c5-ef52-4445-aec0-779c3e99cb07\") " pod="kube-system/global-pull-secret-syncer-qgtf4"
Oct 31 17:27:04.679125 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:04.679089    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-96ckd\" (UniqueName: \"kubernetes.io/projected/5d30d9b6-0431-47f2-b06c-8a03d4f59b97-kube-api-access-96ckd\") pod \"network-check-target-pqs8z\" (UID: \"5d30d9b6-0431-47f2-b06c-8a03d4f59b97\") " pod="openshift-network-diagnostics/network-check-target-pqs8z"
Oct 31 17:27:04.684880 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:04.684853    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-96ckd\" (UniqueName: \"kubernetes.io/projected/5d30d9b6-0431-47f2-b06c-8a03d4f59b97-kube-api-access-96ckd\") pod \"network-check-target-pqs8z\" (UID: \"5d30d9b6-0431-47f2-b06c-8a03d4f59b97\") " pod="openshift-network-diagnostics/network-check-target-pqs8z"
Oct 31 17:27:04.735920 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:04.735751    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qgtf4"
Oct 31 17:27:04.758756 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:04.758731    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pqs8z"
Oct 31 17:27:05.080920 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:05.080886    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-b2xxw_f03611db-3bd9-401a-a137-1d4f691b51ea/console-operator/0.log"
Oct 31 17:27:05.081088 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:05.080940    2572 generic.go:356] "Generic (PLEG): container finished" podID="f03611db-3bd9-401a-a137-1d4f691b51ea" containerID="5f19c02ccd34f79c0e5d98c7095635b54c0008e6c79b884d172ab220f883a124" exitCode=255
Oct 31 17:27:05.081088 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:05.080976    2572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7cd56b8dbc-b2xxw" event={"ID":"f03611db-3bd9-401a-a137-1d4f691b51ea","Type":"ContainerDied","Data":"5f19c02ccd34f79c0e5d98c7095635b54c0008e6c79b884d172ab220f883a124"}
Oct 31 17:27:05.082375 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:05.081297    2572 scope.go:122] "RemoveContainer" containerID="5f19c02ccd34f79c0e5d98c7095635b54c0008e6c79b884d172ab220f883a124"
Oct 31 17:27:05.094122 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:05.094092    2572 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-qgtf4"]
Oct 31 17:27:05.099060 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:27:05.099019    2572 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9179e3c5_ef52_4445_aec0_779c3e99cb07.slice/crio-dd6895944d74abbe426d24ba35505f7fa7f4aa9f7af9f66783e6e82e4a746087 WatchSource:0}: Error finding container dd6895944d74abbe426d24ba35505f7fa7f4aa9f7af9f66783e6e82e4a746087: Status 404 returned error can't find the container with id dd6895944d74abbe426d24ba35505f7fa7f4aa9f7af9f66783e6e82e4a746087
Oct 31 17:27:05.140131 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:05.140103    2572 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-pqs8z"]
Oct 31 17:27:05.174208 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:27:05.174179    2572 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5d30d9b6_0431_47f2_b06c_8a03d4f59b97.slice/crio-634f4ff5412ec8396e0ea23004b3855bfff910b7e4d092e2e525d339a14c9b1e WatchSource:0}: Error finding container 634f4ff5412ec8396e0ea23004b3855bfff910b7e4d092e2e525d339a14c9b1e: Status 404 returned error can't find the container with id 634f4ff5412ec8396e0ea23004b3855bfff910b7e4d092e2e525d339a14c9b1e
Oct 31 17:27:06.089681 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:06.088876    2572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-7lspr" event={"ID":"2330cbe7-498c-4f39-ba1b-3873e125dd18","Type":"ContainerStarted","Data":"a8dd3b9e683df9111d20b1cf40bf8b9df8c382fbf3fb524496291168a12be135"}
Oct 31 17:27:06.092075 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:06.092017    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-b2xxw_f03611db-3bd9-401a-a137-1d4f691b51ea/console-operator/1.log"
Oct 31 17:27:06.093004 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:06.092982    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-b2xxw_f03611db-3bd9-401a-a137-1d4f691b51ea/console-operator/0.log"
Oct 31 17:27:06.093093 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:06.093022    2572 generic.go:356] "Generic (PLEG): container finished" podID="f03611db-3bd9-401a-a137-1d4f691b51ea" containerID="0bd9770d3ee51d6d9482dae960ce96f0bd57304d5988f25ca104ece2f1b1109f" exitCode=255
Oct 31 17:27:06.093141 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:06.093110    2572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7cd56b8dbc-b2xxw" event={"ID":"f03611db-3bd9-401a-a137-1d4f691b51ea","Type":"ContainerDied","Data":"0bd9770d3ee51d6d9482dae960ce96f0bd57304d5988f25ca104ece2f1b1109f"}
Oct 31 17:27:06.093190 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:06.093152    2572 scope.go:122] "RemoveContainer" containerID="5f19c02ccd34f79c0e5d98c7095635b54c0008e6c79b884d172ab220f883a124"
Oct 31 17:27:06.093471 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:06.093458    2572 scope.go:122] "RemoveContainer" containerID="0bd9770d3ee51d6d9482dae960ce96f0bd57304d5988f25ca104ece2f1b1109f"
Oct 31 17:27:06.093635 ip-10-0-138-17 kubenswrapper[2572]: E1031 17:27:06.093619    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7cd56b8dbc-b2xxw_openshift-console-operator(f03611db-3bd9-401a-a137-1d4f691b51ea)\"" pod="openshift-console-operator/console-operator-7cd56b8dbc-b2xxw" podUID="f03611db-3bd9-401a-a137-1d4f691b51ea"
Oct 31 17:27:06.096789 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:06.096366    2572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-4xtm4" event={"ID":"8a9e5aa4-f4fc-4b33-a925-8e63df6c9cd2","Type":"ContainerStarted","Data":"6a6e9d9ec59151454ae639c1b8210bbdf66a2b72c58947efc394061d5423abb2"}
Oct 31 17:27:06.099146 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:06.099122    2572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-7c4986d449-tggxv" event={"ID":"8e32277f-062d-4c16-81ca-b12e65b24fbb","Type":"ContainerStarted","Data":"eefc277eff9e589cb48bb108b48d5e16a3fac9e40acd8d934d6191d7c9140e5d"}
Oct 31 17:27:06.103536 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:06.103515    2572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-pqs8z" event={"ID":"5d30d9b6-0431-47f2-b06c-8a03d4f59b97","Type":"ContainerStarted","Data":"634f4ff5412ec8396e0ea23004b3855bfff910b7e4d092e2e525d339a14c9b1e"}
Oct 31 17:27:06.105453 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:06.105391    2572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-qgtf4" event={"ID":"9179e3c5-ef52-4445-aec0-779c3e99cb07","Type":"ContainerStarted","Data":"dd6895944d74abbe426d24ba35505f7fa7f4aa9f7af9f66783e6e82e4a746087"}
Oct 31 17:27:06.131571 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:06.129601    2572 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-7lspr" podStartSLOduration=386.281891095 podStartE2EDuration="6m31.129582249s" totalImagesPullingTime="4.847691154s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 17:20:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 17:27:06.129227119 +0000 UTC m=+35.845084835" watchObservedRunningTime="2026-10-31 17:27:06.129582249 +0000 UTC m=+35.845439941"
Oct 31 17:27:06.184881 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:06.181583    2572 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-4xtm4" podStartSLOduration=385.312435273 podStartE2EDuration="6m30.181561704s" totalImagesPullingTime="4.869126431s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 17:20:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 17:27:06.174854587 +0000 UTC m=+35.890712293" watchObservedRunningTime="2026-10-31 17:27:06.181561704 +0000 UTC m=+35.897419386"
Oct 31 17:27:06.258486 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:06.258442    2572 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-insights/insights-operator-7c4986d449-tggxv" podStartSLOduration=380.519257292 podStartE2EDuration="6m25.258426435s" totalImagesPullingTime="4.739169143s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 17:20:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 17:27:06.257191016 +0000 UTC m=+35.973048710" watchObservedRunningTime="2026-10-31 17:27:06.258426435 +0000 UTC m=+35.974284125"
Oct 31 17:27:06.804099 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:06.803679    2572 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-66df5d496b-lfxtw"]
Oct 31 17:27:06.830680 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:06.829949    2572 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-66df5d496b-t48lj"]
Oct 31 17:27:06.831762 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:06.830977    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-lfxtw"
Oct 31 17:27:06.847022 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:06.846790    2572 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Oct 31 17:27:06.847022 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:06.846911    2572 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-wvfmn\""
Oct 31 17:27:06.848752 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:06.847708    2572 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Oct 31 17:27:06.855380 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:06.854067    2572 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-66df5d496b-lfxtw"]
Oct 31 17:27:06.855380 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:06.854110    2572 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-66df5d496b-t48lj"]
Oct 31 17:27:06.855380 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:06.854183    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-t48lj"
Oct 31 17:27:07.005021 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:07.004924    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kdg6k\" (UniqueName: \"kubernetes.io/projected/fef8c517-3be6-4cc1-908a-9e0116d8f978-kube-api-access-kdg6k\") pod \"migrator-66df5d496b-lfxtw\" (UID: \"fef8c517-3be6-4cc1-908a-9e0116d8f978\") " pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-lfxtw"
Oct 31 17:27:07.005197 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:07.005112    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rkfhx\" (UniqueName: \"kubernetes.io/projected/a26cba9f-c44a-405d-8e3d-de4bc5b6d6c0-kube-api-access-rkfhx\") pod \"migrator-66df5d496b-t48lj\" (UID: \"a26cba9f-c44a-405d-8e3d-de4bc5b6d6c0\") " pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-t48lj"
Oct 31 17:27:07.061627 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:07.061582    2572 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-tdzz5"]
Oct 31 17:27:07.080455 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:07.080426    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-tdzz5"
Oct 31 17:27:07.087921 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:07.087887    2572 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-tdzz5"]
Oct 31 17:27:07.096203 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:07.096179    2572 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-dm9tc\""
Oct 31 17:27:07.096842 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:07.096697    2572 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Oct 31 17:27:07.096842 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:07.096754    2572 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Oct 31 17:27:07.106719 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:07.106689    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kdg6k\" (UniqueName: \"kubernetes.io/projected/fef8c517-3be6-4cc1-908a-9e0116d8f978-kube-api-access-kdg6k\") pod \"migrator-66df5d496b-lfxtw\" (UID: \"fef8c517-3be6-4cc1-908a-9e0116d8f978\") " pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-lfxtw"
Oct 31 17:27:07.106883 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:07.106775    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rkfhx\" (UniqueName: \"kubernetes.io/projected/a26cba9f-c44a-405d-8e3d-de4bc5b6d6c0-kube-api-access-rkfhx\") pod \"migrator-66df5d496b-t48lj\" (UID: \"a26cba9f-c44a-405d-8e3d-de4bc5b6d6c0\") " pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-t48lj"
Oct 31 17:27:07.122713 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:07.122383    2572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-6f78d59f99-qkkwm" event={"ID":"d5856011-8f77-4e60-8ecc-c7ac852a50b0","Type":"ContainerStarted","Data":"c66a682db786fe1a2c8606bac7f8dd290afaaa3bc99e29b62755a055f74f076a"}
Oct 31 17:27:07.129135 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:07.129106    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rkfhx\" (UniqueName: \"kubernetes.io/projected/a26cba9f-c44a-405d-8e3d-de4bc5b6d6c0-kube-api-access-rkfhx\") pod \"migrator-66df5d496b-t48lj\" (UID: \"a26cba9f-c44a-405d-8e3d-de4bc5b6d6c0\") " pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-t48lj"
Oct 31 17:27:07.131604 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:07.131578    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kdg6k\" (UniqueName: \"kubernetes.io/projected/fef8c517-3be6-4cc1-908a-9e0116d8f978-kube-api-access-kdg6k\") pod \"migrator-66df5d496b-lfxtw\" (UID: \"fef8c517-3be6-4cc1-908a-9e0116d8f978\") " pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-lfxtw"
Oct 31 17:27:07.135533 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:07.134968    2572 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-insights/periodic-gathering-vhvfz-6pbpt"]
Oct 31 17:27:07.142711 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:07.141336    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-b2xxw_f03611db-3bd9-401a-a137-1d4f691b51ea/console-operator/1.log"
Oct 31 17:27:07.142711 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:07.142190    2572 scope.go:122] "RemoveContainer" containerID="0bd9770d3ee51d6d9482dae960ce96f0bd57304d5988f25ca104ece2f1b1109f"
Oct 31 17:27:07.142711 ip-10-0-138-17 kubenswrapper[2572]: E1031 17:27:07.142337    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7cd56b8dbc-b2xxw_openshift-console-operator(f03611db-3bd9-401a-a137-1d4f691b51ea)\"" pod="openshift-console-operator/console-operator-7cd56b8dbc-b2xxw" podUID="f03611db-3bd9-401a-a137-1d4f691b51ea"
Oct 31 17:27:07.156495 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:07.153673    2572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-ptxt2" event={"ID":"c390ea6f-c609-40f7-a9ec-53fd5c08d857","Type":"ContainerStarted","Data":"18f1fcb83897005e613299f3f7afd3e83713817904134e274ed9ab6e6fba2d28"}
Oct 31 17:27:07.156495 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:07.153804    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/periodic-gathering-vhvfz-6pbpt"
Oct 31 17:27:07.160774 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:07.160169    2572 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/periodic-gathering-vhvfz-6pbpt"]
Oct 31 17:27:07.174190 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:07.173926    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-lfxtw"
Oct 31 17:27:07.184273 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:07.184212    2572 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-6f78d59f99-qkkwm" podStartSLOduration=381.621628688 podStartE2EDuration="6m27.184196372s" totalImagesPullingTime="5.562567684s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 17:20:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 17:27:07.182325473 +0000 UTC m=+36.898183202" watchObservedRunningTime="2026-10-31 17:27:07.184196372 +0000 UTC m=+36.900054062"
Oct 31 17:27:07.188112 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:07.187684    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-t48lj"
Oct 31 17:27:07.207840 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:07.207806    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3aa3a055-ec26-4d70-bb04-d6a09abe6661-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-tdzz5\" (UID: \"3aa3a055-ec26-4d70-bb04-d6a09abe6661\") " pod="openshift-insights/insights-runtime-extractor-tdzz5"
Oct 31 17:27:07.207994 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:07.207858    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/3aa3a055-ec26-4d70-bb04-d6a09abe6661-crio-socket\") pod \"insights-runtime-extractor-tdzz5\" (UID: \"3aa3a055-ec26-4d70-bb04-d6a09abe6661\") " pod="openshift-insights/insights-runtime-extractor-tdzz5"
Oct 31 17:27:07.207994 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:07.207886    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/3aa3a055-ec26-4d70-bb04-d6a09abe6661-data-volume\") pod \"insights-runtime-extractor-tdzz5\" (UID: \"3aa3a055-ec26-4d70-bb04-d6a09abe6661\") " pod="openshift-insights/insights-runtime-extractor-tdzz5"
Oct 31 17:27:07.207994 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:07.207915    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-crrdz\" (UniqueName: \"kubernetes.io/projected/3aa3a055-ec26-4d70-bb04-d6a09abe6661-kube-api-access-crrdz\") pod \"insights-runtime-extractor-tdzz5\" (UID: \"3aa3a055-ec26-4d70-bb04-d6a09abe6661\") " pod="openshift-insights/insights-runtime-extractor-tdzz5"
Oct 31 17:27:07.208110 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:07.208000    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3aa3a055-ec26-4d70-bb04-d6a09abe6661-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-tdzz5\" (UID: \"3aa3a055-ec26-4d70-bb04-d6a09abe6661\") " pod="openshift-insights/insights-runtime-extractor-tdzz5"
Oct 31 17:27:07.225195 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:07.225131    2572 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-ptxt2" podStartSLOduration=2.013502498 podStartE2EDuration="7.225109761s" totalImagesPullingTime="5.211607263s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 17:27:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 17:27:07.224249063 +0000 UTC m=+36.940106779" watchObservedRunningTime="2026-10-31 17:27:07.225109761 +0000 UTC m=+36.940967451"
Oct 31 17:27:07.313039 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:07.309250    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-crrdz\" (UniqueName: \"kubernetes.io/projected/3aa3a055-ec26-4d70-bb04-d6a09abe6661-kube-api-access-crrdz\") pod \"insights-runtime-extractor-tdzz5\" (UID: \"3aa3a055-ec26-4d70-bb04-d6a09abe6661\") " pod="openshift-insights/insights-runtime-extractor-tdzz5"
Oct 31 17:27:07.313039 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:07.309334    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/948f2c4e-81a5-4c0e-9ec9-f4fb56368b87-archives-path\") pod \"periodic-gathering-vhvfz-6pbpt\" (UID: \"948f2c4e-81a5-4c0e-9ec9-f4fb56368b87\") " pod="openshift-insights/periodic-gathering-vhvfz-6pbpt"
Oct 31 17:27:07.313039 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:07.309449    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3aa3a055-ec26-4d70-bb04-d6a09abe6661-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-tdzz5\" (UID: \"3aa3a055-ec26-4d70-bb04-d6a09abe6661\") " pod="openshift-insights/insights-runtime-extractor-tdzz5"
Oct 31 17:27:07.313039 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:07.309472    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/948f2c4e-81a5-4c0e-9ec9-f4fb56368b87-trusted-ca-bundle\") pod \"periodic-gathering-vhvfz-6pbpt\" (UID: \"948f2c4e-81a5-4c0e-9ec9-f4fb56368b87\") " pod="openshift-insights/periodic-gathering-vhvfz-6pbpt"
Oct 31 17:27:07.313039 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:07.309808    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/948f2c4e-81a5-4c0e-9ec9-f4fb56368b87-service-ca-bundle\") pod \"periodic-gathering-vhvfz-6pbpt\" (UID: \"948f2c4e-81a5-4c0e-9ec9-f4fb56368b87\") " pod="openshift-insights/periodic-gathering-vhvfz-6pbpt"
Oct 31 17:27:07.313039 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:07.309940    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mkgtp\" (UniqueName: \"kubernetes.io/projected/948f2c4e-81a5-4c0e-9ec9-f4fb56368b87-kube-api-access-mkgtp\") pod \"periodic-gathering-vhvfz-6pbpt\" (UID: \"948f2c4e-81a5-4c0e-9ec9-f4fb56368b87\") " pod="openshift-insights/periodic-gathering-vhvfz-6pbpt"
Oct 31 17:27:07.313039 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:07.310069    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3aa3a055-ec26-4d70-bb04-d6a09abe6661-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-tdzz5\" (UID: \"3aa3a055-ec26-4d70-bb04-d6a09abe6661\") " pod="openshift-insights/insights-runtime-extractor-tdzz5"
Oct 31 17:27:07.313039 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:07.310113    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/3aa3a055-ec26-4d70-bb04-d6a09abe6661-crio-socket\") pod \"insights-runtime-extractor-tdzz5\" (UID: \"3aa3a055-ec26-4d70-bb04-d6a09abe6661\") " pod="openshift-insights/insights-runtime-extractor-tdzz5"
Oct 31 17:27:07.313039 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:07.310140    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/3aa3a055-ec26-4d70-bb04-d6a09abe6661-data-volume\") pod \"insights-runtime-extractor-tdzz5\" (UID: \"3aa3a055-ec26-4d70-bb04-d6a09abe6661\") " pod="openshift-insights/insights-runtime-extractor-tdzz5"
Oct 31 17:27:07.313039 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:07.310540    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/3aa3a055-ec26-4d70-bb04-d6a09abe6661-data-volume\") pod \"insights-runtime-extractor-tdzz5\" (UID: \"3aa3a055-ec26-4d70-bb04-d6a09abe6661\") " pod="openshift-insights/insights-runtime-extractor-tdzz5"
Oct 31 17:27:07.313632 ip-10-0-138-17 kubenswrapper[2572]: E1031 17:27:07.313050    2572 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Oct 31 17:27:07.313632 ip-10-0-138-17 kubenswrapper[2572]: E1031 17:27:07.313118    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3aa3a055-ec26-4d70-bb04-d6a09abe6661-insights-runtime-extractor-tls podName:3aa3a055-ec26-4d70-bb04-d6a09abe6661 nodeName:}" failed. No retries permitted until 2026-10-31 17:27:07.813095954 +0000 UTC m=+37.528953627 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/3aa3a055-ec26-4d70-bb04-d6a09abe6661-insights-runtime-extractor-tls") pod "insights-runtime-extractor-tdzz5" (UID: "3aa3a055-ec26-4d70-bb04-d6a09abe6661") : secret "insights-runtime-extractor-tls" not found
Oct 31 17:27:07.314425 ip-10-0-138-17 kubenswrapper[2572]: E1031 17:27:07.314403    2572 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Oct 31 17:27:07.314534 ip-10-0-138-17 kubenswrapper[2572]: E1031 17:27:07.314470    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3aa3a055-ec26-4d70-bb04-d6a09abe6661-kube-rbac-proxy-cm podName:3aa3a055-ec26-4d70-bb04-d6a09abe6661 nodeName:}" failed. No retries permitted until 2026-10-31 17:27:07.814453743 +0000 UTC m=+37.530311416 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/3aa3a055-ec26-4d70-bb04-d6a09abe6661-kube-rbac-proxy-cm") pod "insights-runtime-extractor-tdzz5" (UID: "3aa3a055-ec26-4d70-bb04-d6a09abe6661") : configmap "kube-rbac-proxy" not found
Oct 31 17:27:07.314534 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:07.314489    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/3aa3a055-ec26-4d70-bb04-d6a09abe6661-crio-socket\") pod \"insights-runtime-extractor-tdzz5\" (UID: \"3aa3a055-ec26-4d70-bb04-d6a09abe6661\") " pod="openshift-insights/insights-runtime-extractor-tdzz5"
Oct 31 17:27:07.336152 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:07.336082    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-crrdz\" (UniqueName: \"kubernetes.io/projected/3aa3a055-ec26-4d70-bb04-d6a09abe6661-kube-api-access-crrdz\") pod \"insights-runtime-extractor-tdzz5\" (UID: \"3aa3a055-ec26-4d70-bb04-d6a09abe6661\") " pod="openshift-insights/insights-runtime-extractor-tdzz5"
Oct 31 17:27:07.411621 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:07.411570    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/948f2c4e-81a5-4c0e-9ec9-f4fb56368b87-archives-path\") pod \"periodic-gathering-vhvfz-6pbpt\" (UID: \"948f2c4e-81a5-4c0e-9ec9-f4fb56368b87\") " pod="openshift-insights/periodic-gathering-vhvfz-6pbpt"
Oct 31 17:27:07.411819 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:07.411732    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/948f2c4e-81a5-4c0e-9ec9-f4fb56368b87-trusted-ca-bundle\") pod \"periodic-gathering-vhvfz-6pbpt\" (UID: \"948f2c4e-81a5-4c0e-9ec9-f4fb56368b87\") " pod="openshift-insights/periodic-gathering-vhvfz-6pbpt"
Oct 31 17:27:07.411909 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:07.411840    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/948f2c4e-81a5-4c0e-9ec9-f4fb56368b87-service-ca-bundle\") pod \"periodic-gathering-vhvfz-6pbpt\" (UID: \"948f2c4e-81a5-4c0e-9ec9-f4fb56368b87\") " pod="openshift-insights/periodic-gathering-vhvfz-6pbpt"
Oct 31 17:27:07.411960 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:07.411906    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mkgtp\" (UniqueName: \"kubernetes.io/projected/948f2c4e-81a5-4c0e-9ec9-f4fb56368b87-kube-api-access-mkgtp\") pod \"periodic-gathering-vhvfz-6pbpt\" (UID: \"948f2c4e-81a5-4c0e-9ec9-f4fb56368b87\") " pod="openshift-insights/periodic-gathering-vhvfz-6pbpt"
Oct 31 17:27:07.412076 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:07.412054    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/948f2c4e-81a5-4c0e-9ec9-f4fb56368b87-archives-path\") pod \"periodic-gathering-vhvfz-6pbpt\" (UID: \"948f2c4e-81a5-4c0e-9ec9-f4fb56368b87\") " pod="openshift-insights/periodic-gathering-vhvfz-6pbpt"
Oct 31 17:27:07.412710 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:07.412687    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/948f2c4e-81a5-4c0e-9ec9-f4fb56368b87-service-ca-bundle\") pod \"periodic-gathering-vhvfz-6pbpt\" (UID: \"948f2c4e-81a5-4c0e-9ec9-f4fb56368b87\") " pod="openshift-insights/periodic-gathering-vhvfz-6pbpt"
Oct 31 17:27:07.413006 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:07.412968    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/948f2c4e-81a5-4c0e-9ec9-f4fb56368b87-trusted-ca-bundle\") pod \"periodic-gathering-vhvfz-6pbpt\" (UID: \"948f2c4e-81a5-4c0e-9ec9-f4fb56368b87\") " pod="openshift-insights/periodic-gathering-vhvfz-6pbpt"
Oct 31 17:27:07.435956 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:07.435922    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mkgtp\" (UniqueName: \"kubernetes.io/projected/948f2c4e-81a5-4c0e-9ec9-f4fb56368b87-kube-api-access-mkgtp\") pod \"periodic-gathering-vhvfz-6pbpt\" (UID: \"948f2c4e-81a5-4c0e-9ec9-f4fb56368b87\") " pod="openshift-insights/periodic-gathering-vhvfz-6pbpt"
Oct 31 17:27:07.495394 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:07.495360    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/periodic-gathering-vhvfz-6pbpt"
Oct 31 17:27:07.507001 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:07.506818    2572 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-66df5d496b-lfxtw"]
Oct 31 17:27:07.510195 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:27:07.510162    2572 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfef8c517_3be6_4cc1_908a_9e0116d8f978.slice/crio-4e687914b465652caf2648448b13281d69a723f780957e2fc30f8fa75b8a7f0f WatchSource:0}: Error finding container 4e687914b465652caf2648448b13281d69a723f780957e2fc30f8fa75b8a7f0f: Status 404 returned error can't find the container with id 4e687914b465652caf2648448b13281d69a723f780957e2fc30f8fa75b8a7f0f
Oct 31 17:27:07.562895 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:07.562865    2572 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-66df5d496b-t48lj"]
Oct 31 17:27:07.565502 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:27:07.565463    2572 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda26cba9f_c44a_405d_8e3d_de4bc5b6d6c0.slice/crio-84e91389e75f52e3c36f05f68c789da4e3570d436b54dd1bc940548f53db651d WatchSource:0}: Error finding container 84e91389e75f52e3c36f05f68c789da4e3570d436b54dd1bc940548f53db651d: Status 404 returned error can't find the container with id 84e91389e75f52e3c36f05f68c789da4e3570d436b54dd1bc940548f53db651d
Oct 31 17:27:07.820582 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:07.820546    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3aa3a055-ec26-4d70-bb04-d6a09abe6661-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-tdzz5\" (UID: \"3aa3a055-ec26-4d70-bb04-d6a09abe6661\") " pod="openshift-insights/insights-runtime-extractor-tdzz5"
Oct 31 17:27:07.820849 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:07.820681    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3aa3a055-ec26-4d70-bb04-d6a09abe6661-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-tdzz5\" (UID: \"3aa3a055-ec26-4d70-bb04-d6a09abe6661\") " pod="openshift-insights/insights-runtime-extractor-tdzz5"
Oct 31 17:27:07.820970 ip-10-0-138-17 kubenswrapper[2572]: E1031 17:27:07.820944    2572 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Oct 31 17:27:07.821085 ip-10-0-138-17 kubenswrapper[2572]: E1031 17:27:07.821014    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3aa3a055-ec26-4d70-bb04-d6a09abe6661-insights-runtime-extractor-tls podName:3aa3a055-ec26-4d70-bb04-d6a09abe6661 nodeName:}" failed. No retries permitted until 2026-10-31 17:27:08.820996434 +0000 UTC m=+38.536854125 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/3aa3a055-ec26-4d70-bb04-d6a09abe6661-insights-runtime-extractor-tls") pod "insights-runtime-extractor-tdzz5" (UID: "3aa3a055-ec26-4d70-bb04-d6a09abe6661") : secret "insights-runtime-extractor-tls" not found
Oct 31 17:27:07.821335 ip-10-0-138-17 kubenswrapper[2572]: E1031 17:27:07.821316    2572 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Oct 31 17:27:07.821400 ip-10-0-138-17 kubenswrapper[2572]: E1031 17:27:07.821390    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3aa3a055-ec26-4d70-bb04-d6a09abe6661-kube-rbac-proxy-cm podName:3aa3a055-ec26-4d70-bb04-d6a09abe6661 nodeName:}" failed. No retries permitted until 2026-10-31 17:27:08.821372429 +0000 UTC m=+38.537230102 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/3aa3a055-ec26-4d70-bb04-d6a09abe6661-kube-rbac-proxy-cm") pod "insights-runtime-extractor-tdzz5" (UID: "3aa3a055-ec26-4d70-bb04-d6a09abe6661") : configmap "kube-rbac-proxy" not found
Oct 31 17:27:07.829175 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:07.829143    2572 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/periodic-gathering-vhvfz-6pbpt"]
Oct 31 17:27:07.834294 ip-10-0-138-17 kubenswrapper[2572]: W1031 17:27:07.834262    2572 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod948f2c4e_81a5_4c0e_9ec9_f4fb56368b87.slice/crio-b04372cdde747c31b9ddfaba1b1dec47cf42e7045d4e8970634373c035dc2f89 WatchSource:0}: Error finding container b04372cdde747c31b9ddfaba1b1dec47cf42e7045d4e8970634373c035dc2f89: Status 404 returned error can't find the container with id b04372cdde747c31b9ddfaba1b1dec47cf42e7045d4e8970634373c035dc2f89
Oct 31 17:27:08.022946 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:08.022912    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/9a0cf7f7-c12d-42fe-a83e-28e1f1859cd2-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-rnvgv\" (UID: \"9a0cf7f7-c12d-42fe-a83e-28e1f1859cd2\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-rnvgv"
Oct 31 17:27:08.023088 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:08.022963    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/ec682f92-b657-44bd-9e85-3cd4680d2f95-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-rhsk4\" (UID: \"ec682f92-b657-44bd-9e85-3cd4680d2f95\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-rhsk4"
Oct 31 17:27:08.023088 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:08.023031    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/50e82975-3344-4653-8de3-68e8a64a8757-service-ca-bundle\") pod \"router-default-65db5d9749-xvqmh\" (UID: \"50e82975-3344-4653-8de3-68e8a64a8757\") " pod="openshift-ingress/router-default-65db5d9749-xvqmh"
Oct 31 17:27:08.023088 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:08.023057    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/a1bea244-6573-4e3c-9849-b27ade411c9f-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-csbxp\" (UID: \"a1bea244-6573-4e3c-9849-b27ade411c9f\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-csbxp"
Oct 31 17:27:08.023088 ip-10-0-138-17 kubenswrapper[2572]: E1031 17:27:08.023070    2572 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Oct 31 17:27:08.023088 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:08.023083    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9d9ecf7f-6a11-469b-8626-99d5ef7ffac7-registry-tls\") pod \"image-registry-869fc8694f-xcqzj\" (UID: \"9d9ecf7f-6a11-469b-8626-99d5ef7ffac7\") " pod="openshift-image-registry/image-registry-869fc8694f-xcqzj"
Oct 31 17:27:08.023319 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:08.023111    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/170ada34-8944-43d2-bcfb-1d782aae5348-registry-tls\") pod \"image-registry-74dbfdb444-q7rkg\" (UID: \"170ada34-8944-43d2-bcfb-1d782aae5348\") " pod="openshift-image-registry/image-registry-74dbfdb444-q7rkg"
Oct 31 17:27:08.023319 ip-10-0-138-17 kubenswrapper[2572]: E1031 17:27:08.023129    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9a0cf7f7-c12d-42fe-a83e-28e1f1859cd2-networking-console-plugin-cert podName:9a0cf7f7-c12d-42fe-a83e-28e1f1859cd2 nodeName:}" failed. No retries permitted until 2026-10-31 17:27:16.023115632 +0000 UTC m=+45.738973301 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/9a0cf7f7-c12d-42fe-a83e-28e1f1859cd2-networking-console-plugin-cert") pod "networking-console-plugin-86c478bb88-rnvgv" (UID: "9a0cf7f7-c12d-42fe-a83e-28e1f1859cd2") : secret "networking-console-plugin-cert" not found
Oct 31 17:27:08.023319 ip-10-0-138-17 kubenswrapper[2572]: E1031 17:27:08.023138    2572 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Oct 31 17:27:08.023319 ip-10-0-138-17 kubenswrapper[2572]: E1031 17:27:08.023162    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/50e82975-3344-4653-8de3-68e8a64a8757-service-ca-bundle podName:50e82975-3344-4653-8de3-68e8a64a8757 nodeName:}" failed. No retries permitted until 2026-10-31 17:27:16.023146586 +0000 UTC m=+45.739004291 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/50e82975-3344-4653-8de3-68e8a64a8757-service-ca-bundle") pod "router-default-65db5d9749-xvqmh" (UID: "50e82975-3344-4653-8de3-68e8a64a8757") : configmap references non-existent config key: service-ca.crt
Oct 31 17:27:08.023319 ip-10-0-138-17 kubenswrapper[2572]: E1031 17:27:08.023164    2572 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Oct 31 17:27:08.023319 ip-10-0-138-17 kubenswrapper[2572]: E1031 17:27:08.023177    2572 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Oct 31 17:27:08.023319 ip-10-0-138-17 kubenswrapper[2572]: E1031 17:27:08.023210    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a1bea244-6573-4e3c-9849-b27ade411c9f-cluster-monitoring-operator-tls podName:a1bea244-6573-4e3c-9849-b27ade411c9f nodeName:}" failed. No retries permitted until 2026-10-31 17:27:16.023199522 +0000 UTC m=+45.739057201 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/a1bea244-6573-4e3c-9849-b27ade411c9f-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-884576c57-csbxp" (UID: "a1bea244-6573-4e3c-9849-b27ade411c9f") : secret "cluster-monitoring-operator-tls" not found
Oct 31 17:27:08.023319 ip-10-0-138-17 kubenswrapper[2572]: E1031 17:27:08.023212    2572 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-74dbfdb444-q7rkg: secret "image-registry-tls" not found
Oct 31 17:27:08.023319 ip-10-0-138-17 kubenswrapper[2572]: E1031 17:27:08.023229    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ec682f92-b657-44bd-9e85-3cd4680d2f95-samples-operator-tls podName:ec682f92-b657-44bd-9e85-3cd4680d2f95 nodeName:}" failed. No retries permitted until 2026-10-31 17:27:16.023223225 +0000 UTC m=+45.739080892 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/ec682f92-b657-44bd-9e85-3cd4680d2f95-samples-operator-tls") pod "cluster-samples-operator-6ddb6c8b94-rhsk4" (UID: "ec682f92-b657-44bd-9e85-3cd4680d2f95") : secret "samples-operator-tls" not found
Oct 31 17:27:08.023319 ip-10-0-138-17 kubenswrapper[2572]: E1031 17:27:08.023237    2572 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Oct 31 17:27:08.023319 ip-10-0-138-17 kubenswrapper[2572]: E1031 17:27:08.023245    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/170ada34-8944-43d2-bcfb-1d782aae5348-registry-tls podName:170ada34-8944-43d2-bcfb-1d782aae5348 nodeName:}" failed. No retries permitted until 2026-10-31 17:27:16.023234593 +0000 UTC m=+45.739092292 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/170ada34-8944-43d2-bcfb-1d782aae5348-registry-tls") pod "image-registry-74dbfdb444-q7rkg" (UID: "170ada34-8944-43d2-bcfb-1d782aae5348") : secret "image-registry-tls" not found
Oct 31 17:27:08.023319 ip-10-0-138-17 kubenswrapper[2572]: E1031 17:27:08.023250    2572 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-869fc8694f-xcqzj: secret "image-registry-tls" not found
Oct 31 17:27:08.023319 ip-10-0-138-17 kubenswrapper[2572]: E1031 17:27:08.023288    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9d9ecf7f-6a11-469b-8626-99d5ef7ffac7-registry-tls podName:9d9ecf7f-6a11-469b-8626-99d5ef7ffac7 nodeName:}" failed. No retries permitted until 2026-10-31 17:27:16.023276117 +0000 UTC m=+45.739133803 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9d9ecf7f-6a11-469b-8626-99d5ef7ffac7-registry-tls") pod "image-registry-869fc8694f-xcqzj" (UID: "9d9ecf7f-6a11-469b-8626-99d5ef7ffac7") : secret "image-registry-tls" not found
Oct 31 17:27:08.023319 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:08.023284    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/50e82975-3344-4653-8de3-68e8a64a8757-metrics-certs\") pod \"router-default-65db5d9749-xvqmh\" (UID: \"50e82975-3344-4653-8de3-68e8a64a8757\") " pod="openshift-ingress/router-default-65db5d9749-xvqmh"
Oct 31 17:27:08.023319 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:08.023321    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/25ad5c67-f563-4653-9e86-7e9ecbe78675-metrics-tls\") pod \"dns-default-7v7x4\" (UID: \"25ad5c67-f563-4653-9e86-7e9ecbe78675\") " pod="openshift-dns/dns-default-7v7x4"
Oct 31 17:27:08.023793 ip-10-0-138-17 kubenswrapper[2572]: E1031 17:27:08.023406    2572 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Oct 31 17:27:08.023793 ip-10-0-138-17 kubenswrapper[2572]: E1031 17:27:08.023415    2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Oct 31 17:27:08.023793 ip-10-0-138-17 kubenswrapper[2572]: E1031 17:27:08.023435    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/50e82975-3344-4653-8de3-68e8a64a8757-metrics-certs podName:50e82975-3344-4653-8de3-68e8a64a8757 nodeName:}" failed. No retries permitted until 2026-10-31 17:27:16.023424923 +0000 UTC m=+45.739282592 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/50e82975-3344-4653-8de3-68e8a64a8757-metrics-certs") pod "router-default-65db5d9749-xvqmh" (UID: "50e82975-3344-4653-8de3-68e8a64a8757") : secret "router-metrics-certs-default" not found
Oct 31 17:27:08.023793 ip-10-0-138-17 kubenswrapper[2572]: E1031 17:27:08.023447    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/25ad5c67-f563-4653-9e86-7e9ecbe78675-metrics-tls podName:25ad5c67-f563-4653-9e86-7e9ecbe78675 nodeName:}" failed. No retries permitted until 2026-10-31 17:27:16.023441626 +0000 UTC m=+45.739299293 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/25ad5c67-f563-4653-9e86-7e9ecbe78675-metrics-tls") pod "dns-default-7v7x4" (UID: "25ad5c67-f563-4653-9e86-7e9ecbe78675") : secret "dns-default-metrics-tls" not found
Oct 31 17:27:08.146983 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:08.146901    2572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/periodic-gathering-vhvfz-6pbpt" event={"ID":"948f2c4e-81a5-4c0e-9ec9-f4fb56368b87","Type":"ContainerStarted","Data":"5b973b35ae12bce514faa6cd27079d658e5ef589c3a28ca7fc49ecf1a489cf2d"}
Oct 31 17:27:08.146983 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:08.146964    2572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/periodic-gathering-vhvfz-6pbpt" event={"ID":"948f2c4e-81a5-4c0e-9ec9-f4fb56368b87","Type":"ContainerStarted","Data":"b04372cdde747c31b9ddfaba1b1dec47cf42e7045d4e8970634373c035dc2f89"}
Oct 31 17:27:08.148266 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:08.148234    2572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-t48lj" event={"ID":"a26cba9f-c44a-405d-8e3d-de4bc5b6d6c0","Type":"ContainerStarted","Data":"84e91389e75f52e3c36f05f68c789da4e3570d436b54dd1bc940548f53db651d"}
Oct 31 17:27:08.149814 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:08.149789    2572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-lfxtw" event={"ID":"fef8c517-3be6-4cc1-908a-9e0116d8f978","Type":"ContainerStarted","Data":"4e687914b465652caf2648448b13281d69a723f780957e2fc30f8fa75b8a7f0f"}
Oct 31 17:27:08.187696 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:08.187625    2572 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-insights/periodic-gathering-vhvfz-6pbpt" podStartSLOduration=1.187605743 podStartE2EDuration="1.187605743s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 17:27:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 17:27:08.186581038 +0000 UTC m=+37.902438728" watchObservedRunningTime="2026-10-31 17:27:08.187605743 +0000 UTC m=+37.903463434"
Oct 31 17:27:08.831779 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:08.831733    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3aa3a055-ec26-4d70-bb04-d6a09abe6661-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-tdzz5\" (UID: \"3aa3a055-ec26-4d70-bb04-d6a09abe6661\") " pod="openshift-insights/insights-runtime-extractor-tdzz5"
Oct 31 17:27:08.831960 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:08.831865    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3aa3a055-ec26-4d70-bb04-d6a09abe6661-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-tdzz5\" (UID: \"3aa3a055-ec26-4d70-bb04-d6a09abe6661\") " pod="openshift-insights/insights-runtime-extractor-tdzz5"
Oct 31 17:27:08.831960 ip-10-0-138-17 kubenswrapper[2572]: E1031 17:27:08.831873    2572 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Oct 31 17:27:08.831960 ip-10-0-138-17 kubenswrapper[2572]: E1031 17:27:08.831954    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3aa3a055-ec26-4d70-bb04-d6a09abe6661-kube-rbac-proxy-cm podName:3aa3a055-ec26-4d70-bb04-d6a09abe6661 nodeName:}" failed. No retries permitted until 2026-10-31 17:27:10.831932054 +0000 UTC m=+40.547789723 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/3aa3a055-ec26-4d70-bb04-d6a09abe6661-kube-rbac-proxy-cm") pod "insights-runtime-extractor-tdzz5" (UID: "3aa3a055-ec26-4d70-bb04-d6a09abe6661") : configmap "kube-rbac-proxy" not found
Oct 31 17:27:08.832135 ip-10-0-138-17 kubenswrapper[2572]: E1031 17:27:08.832055    2572 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Oct 31 17:27:08.832135 ip-10-0-138-17 kubenswrapper[2572]: E1031 17:27:08.832114    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3aa3a055-ec26-4d70-bb04-d6a09abe6661-insights-runtime-extractor-tls podName:3aa3a055-ec26-4d70-bb04-d6a09abe6661 nodeName:}" failed. No retries permitted until 2026-10-31 17:27:10.832097752 +0000 UTC m=+40.547955435 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/3aa3a055-ec26-4d70-bb04-d6a09abe6661-insights-runtime-extractor-tls") pod "insights-runtime-extractor-tdzz5" (UID: "3aa3a055-ec26-4d70-bb04-d6a09abe6661") : secret "insights-runtime-extractor-tls" not found
Oct 31 17:27:09.155266 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:09.155192    2572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-pqs8z" event={"ID":"5d30d9b6-0431-47f2-b06c-8a03d4f59b97","Type":"ContainerStarted","Data":"270690a32d01c9d9b40abe44b90f645b319f524a05a6a4ac76ee95477f50904e"}
Oct 31 17:27:09.195211 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:09.195083    2572 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-pqs8z" podStartSLOduration=35.109437981 podStartE2EDuration="38.195065557s" totalImagesPullingTime="3.085627576s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 17:26:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 17:27:09.194954196 +0000 UTC m=+38.910811885" watchObservedRunningTime="2026-10-31 17:27:09.195065557 +0000 UTC m=+38.910923247"
Oct 31 17:27:10.162108 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:10.162066    2572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-t48lj" event={"ID":"a26cba9f-c44a-405d-8e3d-de4bc5b6d6c0","Type":"ContainerStarted","Data":"a31695e01b45e1099e7fad82521b8685e22b6da8df6d993b598747d61e6ab83b"}
Oct 31 17:27:10.164077 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:10.164048    2572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-lfxtw" event={"ID":"fef8c517-3be6-4cc1-908a-9e0116d8f978","Type":"ContainerStarted","Data":"edb0ed1f89f66e1b2c5974e4dce51295958aed2466b2964f4509ecb06338b977"}
Oct 31 17:27:10.164322 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:10.164304    2572 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-pqs8z"
Oct 31 17:27:10.201250 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:10.201189    2572 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-t48lj" podStartSLOduration=2.385434932 podStartE2EDuration="4.201174919s" totalImagesPullingTime="1.815739987s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 17:27:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 17:27:10.199293754 +0000 UTC m=+39.915151475" watchObservedRunningTime="2026-10-31 17:27:10.201174919 +0000 UTC m=+39.917032609"
Oct 31 17:27:10.237208 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:10.237146    2572 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-lfxtw" podStartSLOduration=2.255052964 podStartE2EDuration="4.237134456s" totalImagesPullingTime="1.982081492s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 17:27:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 17:27:10.236465736 +0000 UTC m=+39.952323444" watchObservedRunningTime="2026-10-31 17:27:10.237134456 +0000 UTC m=+39.952992145"
Oct 31 17:27:10.520056 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:10.519980    2572 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7cd56b8dbc-b2xxw"
Oct 31 17:27:10.520056 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:10.520049    2572 kubelet.go:2727] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-7cd56b8dbc-b2xxw"
Oct 31 17:27:10.520482 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:10.520468    2572 scope.go:122] "RemoveContainer" containerID="0bd9770d3ee51d6d9482dae960ce96f0bd57304d5988f25ca104ece2f1b1109f"
Oct 31 17:27:10.520716 ip-10-0-138-17 kubenswrapper[2572]: E1031 17:27:10.520694    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7cd56b8dbc-b2xxw_openshift-console-operator(f03611db-3bd9-401a-a137-1d4f691b51ea)\"" pod="openshift-console-operator/console-operator-7cd56b8dbc-b2xxw" podUID="f03611db-3bd9-401a-a137-1d4f691b51ea"
Oct 31 17:27:10.854135 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:10.854101    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3aa3a055-ec26-4d70-bb04-d6a09abe6661-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-tdzz5\" (UID: \"3aa3a055-ec26-4d70-bb04-d6a09abe6661\") " pod="openshift-insights/insights-runtime-extractor-tdzz5"
Oct 31 17:27:10.854336 ip-10-0-138-17 kubenswrapper[2572]: E1031 17:27:10.854246    2572 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Oct 31 17:27:10.854336 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:10.854270    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3aa3a055-ec26-4d70-bb04-d6a09abe6661-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-tdzz5\" (UID: \"3aa3a055-ec26-4d70-bb04-d6a09abe6661\") " pod="openshift-insights/insights-runtime-extractor-tdzz5"
Oct 31 17:27:10.854336 ip-10-0-138-17 kubenswrapper[2572]: E1031 17:27:10.854310    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3aa3a055-ec26-4d70-bb04-d6a09abe6661-insights-runtime-extractor-tls podName:3aa3a055-ec26-4d70-bb04-d6a09abe6661 nodeName:}" failed. No retries permitted until 2026-10-31 17:27:14.854291481 +0000 UTC m=+44.570149172 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/3aa3a055-ec26-4d70-bb04-d6a09abe6661-insights-runtime-extractor-tls") pod "insights-runtime-extractor-tdzz5" (UID: "3aa3a055-ec26-4d70-bb04-d6a09abe6661") : secret "insights-runtime-extractor-tls" not found
Oct 31 17:27:10.854526 ip-10-0-138-17 kubenswrapper[2572]: E1031 17:27:10.854342    2572 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Oct 31 17:27:10.854526 ip-10-0-138-17 kubenswrapper[2572]: E1031 17:27:10.854376    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3aa3a055-ec26-4d70-bb04-d6a09abe6661-kube-rbac-proxy-cm podName:3aa3a055-ec26-4d70-bb04-d6a09abe6661 nodeName:}" failed. No retries permitted until 2026-10-31 17:27:14.854366142 +0000 UTC m=+44.570223824 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/3aa3a055-ec26-4d70-bb04-d6a09abe6661-kube-rbac-proxy-cm") pod "insights-runtime-extractor-tdzz5" (UID: "3aa3a055-ec26-4d70-bb04-d6a09abe6661") : configmap "kube-rbac-proxy" not found
Oct 31 17:27:11.691906 ip-10-0-138-17 kubenswrapper[2572]: I1031 17:27:11.691786    2572 dynamic_cafile_content.go:175] "Shutting down controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Oct 31 17:27:11.691937 ip-10-0-138-17 systemd[1]: Stopping Kubernetes Kubelet...
Oct 31 17:27:11.701988 ip-10-0-138-17 systemd[1]: kubelet.service: Deactivated successfully.
Oct 31 17:27:11.702205 ip-10-0-138-17 systemd[1]: Stopped Kubernetes Kubelet.
Oct 31 17:27:11.702264 ip-10-0-138-17 systemd[1]: kubelet.service: Consumed 3.197s CPU time.
Oct 31 17:27:11.714276 ip-10-0-138-17 systemd[1]: Starting Kubernetes Kubelet...
Oct 31 17:27:11.793140 ip-10-0-138-17 kubenswrapper[5003]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Oct 31 17:27:11.793140 ip-10-0-138-17 kubenswrapper[5003]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Oct 31 17:27:11.793140 ip-10-0-138-17 kubenswrapper[5003]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Oct 31 17:27:11.793140 ip-10-0-138-17 kubenswrapper[5003]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Oct 31 17:27:11.795433 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.795338    5003 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 31 17:27:11.795433 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.795427    5003 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 31 17:27:11.795433 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.795433    5003 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 31 17:27:11.795433 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.795436    5003 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 31 17:27:11.795732 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.795443    5003 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 31 17:27:11.795732 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.795447    5003 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 31 17:27:11.795732 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.795452    5003 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 31 17:27:11.795732 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.795455    5003 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 31 17:27:11.795732 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.795460    5003 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 31 17:27:11.795732 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.795463    5003 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 31 17:27:11.795732 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.795467    5003 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 31 17:27:11.795732 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.795470    5003 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 31 17:27:11.795732 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.795474    5003 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 31 17:27:11.795732 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.795478    5003 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 31 17:27:11.795732 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.795483    5003 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 31 17:27:11.795732 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.795486    5003 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 31 17:27:11.795732 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.795490    5003 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 31 17:27:11.795732 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.795496    5003 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 31 17:27:11.795732 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.795500    5003 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 31 17:27:11.795732 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.795504    5003 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 31 17:27:11.795732 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.795508    5003 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 31 17:27:11.795732 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.795513    5003 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 31 17:27:11.795732 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.795517    5003 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 31 17:27:11.795732 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.795521    5003 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 31 17:27:11.796669 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.795524    5003 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 31 17:27:11.796669 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.795529    5003 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 31 17:27:11.796669 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.795538    5003 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 31 17:27:11.796669 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.795542    5003 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 31 17:27:11.796669 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.795546    5003 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 31 17:27:11.796669 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.795550    5003 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 31 17:27:11.796669 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.795554    5003 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 31 17:27:11.796669 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.795558    5003 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 31 17:27:11.796669 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.795562    5003 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 31 17:27:11.796669 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.795566    5003 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 31 17:27:11.796669 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.795571    5003 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 31 17:27:11.796669 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.795576    5003 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 31 17:27:11.796669 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.795580    5003 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 31 17:27:11.796669 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.795585    5003 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 31 17:27:11.796669 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.795590    5003 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 31 17:27:11.796669 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.795594    5003 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 31 17:27:11.796669 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.795598    5003 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 31 17:27:11.796669 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.795603    5003 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 31 17:27:11.796669 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.795607    5003 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 31 17:27:11.796669 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.795612    5003 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 31 17:27:11.797799 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.795616    5003 feature_gate.go:386] unrecognized feature gate: Example2
Oct 31 17:27:11.797799 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.795621    5003 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 31 17:27:11.797799 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.795625    5003 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 31 17:27:11.797799 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.795630    5003 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 31 17:27:11.797799 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.795634    5003 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 31 17:27:11.797799 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.795638    5003 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 31 17:27:11.797799 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.795659    5003 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 31 17:27:11.797799 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.795664    5003 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 31 17:27:11.797799 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.795669    5003 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 31 17:27:11.797799 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.795673    5003 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 31 17:27:11.797799 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.795677    5003 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 31 17:27:11.797799 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.795681    5003 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 31 17:27:11.797799 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.795685    5003 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 31 17:27:11.797799 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.795690    5003 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 31 17:27:11.797799 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.795695    5003 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 31 17:27:11.797799 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.795700    5003 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 31 17:27:11.797799 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.795704    5003 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 31 17:27:11.797799 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.795709    5003 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 31 17:27:11.797799 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.795713    5003 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 31 17:27:11.798691 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.795718    5003 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 31 17:27:11.798691 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.795722    5003 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 31 17:27:11.798691 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.795726    5003 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 31 17:27:11.798691 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.795731    5003 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 31 17:27:11.798691 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.795737    5003 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 31 17:27:11.798691 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.795742    5003 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 31 17:27:11.798691 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.795746    5003 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 31 17:27:11.798691 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.795750    5003 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 31 17:27:11.798691 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.795755    5003 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 31 17:27:11.798691 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.795759    5003 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 31 17:27:11.798691 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.795764    5003 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 31 17:27:11.798691 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.795771    5003 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 31 17:27:11.798691 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.795779    5003 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 31 17:27:11.798691 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.795786    5003 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 31 17:27:11.798691 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.795791    5003 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 31 17:27:11.798691 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.795796    5003 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 31 17:27:11.798691 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.795800    5003 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 31 17:27:11.798691 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.795804    5003 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 31 17:27:11.798691 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.795808    5003 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 31 17:27:11.799563 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.795813    5003 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 31 17:27:11.799563 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.795817    5003 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 31 17:27:11.799563 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.795821    5003 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 31 17:27:11.799563 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.795826    5003 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 31 17:27:11.799563 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.795831    5003 feature_gate.go:386] unrecognized feature gate: Example
Oct 31 17:27:11.799563 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.795835    5003 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 31 17:27:11.799563 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.795840    5003 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 31 17:27:11.799563 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.795844    5003 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 31 17:27:11.799563 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.795848    5003 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 31 17:27:11.799563 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.795864    5003 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 31 17:27:11.799563 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.795869    5003 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 31 17:27:11.799563 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.795874    5003 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 31 17:27:11.799563 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.795878    5003 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 31 17:27:11.799563 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.795882    5003 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 31 17:27:11.799563 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.795886    5003 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 31 17:27:11.799563 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.795890    5003 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 31 17:27:11.799563 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.795895    5003 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 31 17:27:11.799563 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.795899    5003 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 31 17:27:11.799563 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.795905    5003 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 31 17:27:11.800438 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.795911    5003 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 31 17:27:11.800438 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.795916    5003 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 31 17:27:11.800438 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.795921    5003 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 31 17:27:11.800438 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.795925    5003 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 31 17:27:11.800438 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.795929    5003 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 31 17:27:11.800438 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.797197    5003 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 31 17:27:11.800438 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.797208    5003 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 31 17:27:11.800438 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.797213    5003 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 31 17:27:11.800438 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.797217    5003 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 31 17:27:11.800438 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.797221    5003 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 31 17:27:11.800438 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.797225    5003 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 31 17:27:11.800438 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.797229    5003 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 31 17:27:11.800438 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.797234    5003 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 31 17:27:11.800438 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.797239    5003 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 31 17:27:11.800438 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.797243    5003 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 31 17:27:11.800438 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.797247    5003 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 31 17:27:11.800438 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.797251    5003 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 31 17:27:11.800438 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.797256    5003 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 31 17:27:11.800438 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.797260    5003 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 31 17:27:11.800438 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.797264    5003 feature_gate.go:386] unrecognized feature gate: Example2
Oct 31 17:27:11.801373 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.797269    5003 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 31 17:27:11.801373 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.797273    5003 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 31 17:27:11.801373 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.797277    5003 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 31 17:27:11.801373 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.797282    5003 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 31 17:27:11.801373 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.797287    5003 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 31 17:27:11.801373 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.797291    5003 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 31 17:27:11.801373 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.797295    5003 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 31 17:27:11.801373 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.797299    5003 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 31 17:27:11.801373 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.797304    5003 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 31 17:27:11.801373 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.797308    5003 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 31 17:27:11.801373 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.797312    5003 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 31 17:27:11.801373 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.797317    5003 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 31 17:27:11.801373 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.797321    5003 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 31 17:27:11.801373 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.797325    5003 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 31 17:27:11.801373 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.797330    5003 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 31 17:27:11.801373 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.797334    5003 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 31 17:27:11.801373 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.797345    5003 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 31 17:27:11.801373 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.797349    5003 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 31 17:27:11.801373 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.797354    5003 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 31 17:27:11.802094 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.797358    5003 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 31 17:27:11.802094 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.797362    5003 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 31 17:27:11.802094 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.797367    5003 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 31 17:27:11.802094 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.797371    5003 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 31 17:27:11.802094 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.797375    5003 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 31 17:27:11.802094 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.797380    5003 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 31 17:27:11.802094 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.797384    5003 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 31 17:27:11.802094 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.797388    5003 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 31 17:27:11.802094 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.797395    5003 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 31 17:27:11.802094 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.797401    5003 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 31 17:27:11.802094 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.797406    5003 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 31 17:27:11.802094 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.797411    5003 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 31 17:27:11.802094 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.797415    5003 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 31 17:27:11.802094 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.797419    5003 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 31 17:27:11.802094 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.797424    5003 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 31 17:27:11.802094 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.797429    5003 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 31 17:27:11.802094 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.797433    5003 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 31 17:27:11.802094 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.797438    5003 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 31 17:27:11.802094 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.797442    5003 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 31 17:27:11.802583 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.797446    5003 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 31 17:27:11.802583 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.797451    5003 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 31 17:27:11.802583 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.797455    5003 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 31 17:27:11.802583 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.797459    5003 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 31 17:27:11.802583 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.797464    5003 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 31 17:27:11.802583 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.797469    5003 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 31 17:27:11.802583 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.797473    5003 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 31 17:27:11.802583 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.797478    5003 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 31 17:27:11.802583 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.797482    5003 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 31 17:27:11.802583 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.797487    5003 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 31 17:27:11.802583 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.797494    5003 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 31 17:27:11.802583 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.797498    5003 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 31 17:27:11.802583 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.797503    5003 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 31 17:27:11.802583 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.797507    5003 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 31 17:27:11.802583 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.797511    5003 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 31 17:27:11.802583 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.797515    5003 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 31 17:27:11.802583 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.797520    5003 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 31 17:27:11.802583 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.797525    5003 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 31 17:27:11.802583 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.797529    5003 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 31 17:27:11.802583 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.797533    5003 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 31 17:27:11.803127 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.797538    5003 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 31 17:27:11.803127 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.797542    5003 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 31 17:27:11.803127 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.797547    5003 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 31 17:27:11.803127 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.797553    5003 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 31 17:27:11.803127 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.797557    5003 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 31 17:27:11.803127 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.797561    5003 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 31 17:27:11.803127 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.797566    5003 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 31 17:27:11.803127 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.797570    5003 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 31 17:27:11.803127 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.797574    5003 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 31 17:27:11.803127 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.797579    5003 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 31 17:27:11.803127 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.797583    5003 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 31 17:27:11.803127 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.797589    5003 feature_gate.go:386] unrecognized feature gate: Example
Oct 31 17:27:11.803127 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.797594    5003 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 31 17:27:11.803127 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.797598    5003 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 31 17:27:11.803127 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.797602    5003 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 31 17:27:11.803127 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.797607    5003 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 31 17:27:11.803127 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.797611    5003 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 31 17:27:11.803127 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.797615    5003 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 31 17:27:11.803127 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.797620    5003 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 31 17:27:11.803127 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.797624    5003 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 31 17:27:11.803716 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.797628    5003 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 31 17:27:11.803716 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.797632    5003 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 31 17:27:11.803716 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.797638    5003 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 31 17:27:11.803716 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.797662    5003 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 31 17:27:11.803716 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.797667    5003 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 31 17:27:11.803716 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.797672    5003 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 31 17:27:11.803716 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.797677    5003 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 31 17:27:11.803716 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.797685    5003 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 31 17:27:11.803716 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.797690    5003 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 31 17:27:11.803716 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.797696    5003 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 31 17:27:11.803716 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.797701    5003 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 31 17:27:11.803716 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.797705    5003 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 31 17:27:11.803716 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.797709    5003 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 31 17:27:11.803716 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.798535    5003 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 31 17:27:11.803716 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.798545    5003 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 31 17:27:11.803716 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.798551    5003 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 31 17:27:11.803716 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.798555    5003 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 31 17:27:11.803716 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.798560    5003 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 31 17:27:11.803716 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.798564    5003 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 31 17:27:11.804221 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.798569    5003 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 31 17:27:11.804221 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.798573    5003 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 31 17:27:11.804221 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.798578    5003 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 31 17:27:11.804221 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.798582    5003 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 31 17:27:11.804221 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.798587    5003 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 31 17:27:11.804221 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.798592    5003 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 31 17:27:11.804221 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.798597    5003 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 31 17:27:11.804221 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.798601    5003 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 31 17:27:11.804221 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.798605    5003 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 31 17:27:11.804221 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.798609    5003 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 31 17:27:11.804221 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.798614    5003 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 31 17:27:11.804221 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.798618    5003 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 31 17:27:11.804221 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.798622    5003 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 31 17:27:11.804221 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.798626    5003 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 31 17:27:11.804221 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.798630    5003 feature_gate.go:386] unrecognized feature gate: Example
Oct 31 17:27:11.804221 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.798637    5003 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 31 17:27:11.804221 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.798660    5003 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 31 17:27:11.804221 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.798665    5003 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 31 17:27:11.804221 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.798670    5003 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 31 17:27:11.804221 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.798674    5003 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 31 17:27:11.804843 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.798679    5003 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 31 17:27:11.804843 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.798683    5003 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 31 17:27:11.804843 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.798687    5003 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 31 17:27:11.804843 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.798692    5003 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 31 17:27:11.804843 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.798696    5003 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 31 17:27:11.804843 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.798700    5003 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 31 17:27:11.804843 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.798704    5003 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 31 17:27:11.804843 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.798709    5003 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 31 17:27:11.804843 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.798713    5003 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 31 17:27:11.804843 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.798718    5003 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 31 17:27:11.804843 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.798722    5003 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 31 17:27:11.804843 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.798727    5003 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 31 17:27:11.804843 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.798732    5003 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 31 17:27:11.804843 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.798736    5003 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 31 17:27:11.804843 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.798741    5003 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 31 17:27:11.804843 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.798747    5003 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 31 17:27:11.804843 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.798753    5003 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 31 17:27:11.804843 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.798760    5003 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 31 17:27:11.804843 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.798765    5003 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 31 17:27:11.805354 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.798769    5003 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 31 17:27:11.805354 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.798776    5003 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 31 17:27:11.805354 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.798785    5003 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 31 17:27:11.805354 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.798790    5003 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 31 17:27:11.805354 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.798796    5003 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 31 17:27:11.805354 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.798800    5003 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 31 17:27:11.805354 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.798805    5003 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 31 17:27:11.805354 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.798810    5003 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 31 17:27:11.805354 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.798816    5003 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 31 17:27:11.805354 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.798820    5003 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 31 17:27:11.805354 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.798824    5003 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 31 17:27:11.805354 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.798829    5003 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 31 17:27:11.805354 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.798833    5003 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 31 17:27:11.805354 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.798838    5003 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 31 17:27:11.805354 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.798842    5003 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 31 17:27:11.805354 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.798846    5003 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 31 17:27:11.805354 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.798850    5003 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 31 17:27:11.805354 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.798855    5003 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 31 17:27:11.805354 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.798859    5003 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 31 17:27:11.806212 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.798863    5003 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 31 17:27:11.806212 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.798868    5003 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 31 17:27:11.806212 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.798873    5003 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 31 17:27:11.806212 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.798877    5003 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 31 17:27:11.806212 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.798882    5003 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 31 17:27:11.806212 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.798886    5003 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 31 17:27:11.806212 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.798890    5003 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 31 17:27:11.806212 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.798894    5003 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 31 17:27:11.806212 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.798899    5003 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 31 17:27:11.806212 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.798903    5003 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 31 17:27:11.806212 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.798908    5003 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 31 17:27:11.806212 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.798912    5003 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 31 17:27:11.806212 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.798917    5003 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 31 17:27:11.806212 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.798922    5003 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 31 17:27:11.806212 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.798926    5003 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 31 17:27:11.806212 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.798930    5003 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 31 17:27:11.806212 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.798934    5003 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 31 17:27:11.806212 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.798938    5003 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 31 17:27:11.806212 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.798943    5003 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 31 17:27:11.806212 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.798947    5003 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 31 17:27:11.806831 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.798951    5003 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 31 17:27:11.806831 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.798957    5003 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 31 17:27:11.806831 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.798961    5003 feature_gate.go:386] unrecognized feature gate: Example2
Oct 31 17:27:11.806831 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.798966    5003 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 31 17:27:11.806831 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.798970    5003 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 31 17:27:11.806831 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.798974    5003 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 31 17:27:11.806831 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.798979    5003 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 31 17:27:11.806831 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.798983    5003 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 31 17:27:11.806831 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.798988    5003 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 31 17:27:11.806831 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.798992    5003 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 31 17:27:11.806831 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.798998    5003 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 31 17:27:11.806831 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.799002    5003 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 31 17:27:11.806831 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.799007    5003 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 31 17:27:11.806831 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.799012    5003 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 31 17:27:11.806831 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.799017    5003 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 31 17:27:11.806831 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.799021    5003 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 31 17:27:11.806831 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.799026    5003 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 31 17:27:11.806831 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.799030    5003 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 31 17:27:11.806831 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.799034    5003 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 31 17:27:11.807333 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.799038    5003 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 31 17:27:11.807333 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.799042    5003 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 31 17:27:11.807333 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.799046    5003 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 31 17:27:11.807333 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.799183    5003 flags.go:64] FLAG: --address="0.0.0.0"
Oct 31 17:27:11.807333 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.799194    5003 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Oct 31 17:27:11.807333 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.799203    5003 flags.go:64] FLAG: --anonymous-auth="true"
Oct 31 17:27:11.807333 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.799210    5003 flags.go:64] FLAG: --application-metrics-count-limit="100"
Oct 31 17:27:11.807333 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.799218    5003 flags.go:64] FLAG: --authentication-token-webhook="false"
Oct 31 17:27:11.807333 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.799224    5003 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Oct 31 17:27:11.807333 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.799230    5003 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Oct 31 17:27:11.807333 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.799237    5003 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Oct 31 17:27:11.807333 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.799242    5003 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Oct 31 17:27:11.807333 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.799247    5003 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Oct 31 17:27:11.807333 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.799252    5003 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Oct 31 17:27:11.807333 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.799260    5003 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Oct 31 17:27:11.807333 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.799266    5003 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Oct 31 17:27:11.807333 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.799271    5003 flags.go:64] FLAG: --cgroup-root=""
Oct 31 17:27:11.807333 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.799275    5003 flags.go:64] FLAG: --cgroups-per-qos="true"
Oct 31 17:27:11.807333 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.799280    5003 flags.go:64] FLAG: --client-ca-file=""
Oct 31 17:27:11.807333 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.799285    5003 flags.go:64] FLAG: --cloud-provider="external"
Oct 31 17:27:11.807333 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.799290    5003 flags.go:64] FLAG: --cluster-dns="[]"
Oct 31 17:27:11.807333 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.799297    5003 flags.go:64] FLAG: --cluster-domain=""
Oct 31 17:27:11.807333 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.799302    5003 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Oct 31 17:27:11.807333 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.799308    5003 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Oct 31 17:27:11.807961 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.799318    5003 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Oct 31 17:27:11.807961 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.799324    5003 flags.go:64] FLAG: --container-log-max-files="5"
Oct 31 17:27:11.807961 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.799330    5003 flags.go:64] FLAG: --container-log-max-size="10Mi"
Oct 31 17:27:11.807961 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.799335    5003 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Oct 31 17:27:11.807961 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.799341    5003 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Oct 31 17:27:11.807961 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.799346    5003 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Oct 31 17:27:11.807961 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.799352    5003 flags.go:64] FLAG: --contention-profiling="false"
Oct 31 17:27:11.807961 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.799357    5003 flags.go:64] FLAG: --cpu-cfs-quota="true"
Oct 31 17:27:11.807961 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.799362    5003 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Oct 31 17:27:11.807961 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.799367    5003 flags.go:64] FLAG: --cpu-manager-policy="none"
Oct 31 17:27:11.807961 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.799372    5003 flags.go:64] FLAG: --cpu-manager-policy-options=""
Oct 31 17:27:11.807961 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.799378    5003 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Oct 31 17:27:11.807961 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.799383    5003 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Oct 31 17:27:11.807961 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.799388    5003 flags.go:64] FLAG: --enable-debugging-handlers="true"
Oct 31 17:27:11.807961 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.799393    5003 flags.go:64] FLAG: --enable-load-reader="false"
Oct 31 17:27:11.807961 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.799399    5003 flags.go:64] FLAG: --enable-server="true"
Oct 31 17:27:11.807961 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.799404    5003 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Oct 31 17:27:11.807961 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.799411    5003 flags.go:64] FLAG: --event-burst="100"
Oct 31 17:27:11.807961 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.799416    5003 flags.go:64] FLAG: --event-qps="50"
Oct 31 17:27:11.807961 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.799421    5003 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Oct 31 17:27:11.807961 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.799426    5003 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Oct 31 17:27:11.807961 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.799431    5003 flags.go:64] FLAG: --eviction-hard=""
Oct 31 17:27:11.807961 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.799440    5003 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Oct 31 17:27:11.807961 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.799445    5003 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Oct 31 17:27:11.808569 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.799450    5003 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Oct 31 17:27:11.808569 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.799455    5003 flags.go:64] FLAG: --eviction-soft=""
Oct 31 17:27:11.808569 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.799460    5003 flags.go:64] FLAG: --eviction-soft-grace-period=""
Oct 31 17:27:11.808569 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.799465    5003 flags.go:64] FLAG: --exit-on-lock-contention="false"
Oct 31 17:27:11.808569 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.799470    5003 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Oct 31 17:27:11.808569 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.799475    5003 flags.go:64] FLAG: --experimental-mounter-path=""
Oct 31 17:27:11.808569 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.799480    5003 flags.go:64] FLAG: --fail-cgroupv1="true"
Oct 31 17:27:11.808569 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.799485    5003 flags.go:64] FLAG: --fail-swap-on="true"
Oct 31 17:27:11.808569 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.799492    5003 flags.go:64] FLAG: --feature-gates=""
Oct 31 17:27:11.808569 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.799499    5003 flags.go:64] FLAG: --file-check-frequency="20s"
Oct 31 17:27:11.808569 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.799504    5003 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Oct 31 17:27:11.808569 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.799509    5003 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Oct 31 17:27:11.808569 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.799514    5003 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Oct 31 17:27:11.808569 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.799519    5003 flags.go:64] FLAG: --healthz-port="10248"
Oct 31 17:27:11.808569 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.799524    5003 flags.go:64] FLAG: --help="false"
Oct 31 17:27:11.808569 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.799529    5003 flags.go:64] FLAG: --hostname-override="ip-10-0-138-17.ec2.internal"
Oct 31 17:27:11.808569 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.799534    5003 flags.go:64] FLAG: --housekeeping-interval="10s"
Oct 31 17:27:11.808569 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.799539    5003 flags.go:64] FLAG: --http-check-frequency="20s"
Oct 31 17:27:11.808569 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.799544    5003 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Oct 31 17:27:11.808569 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.799551    5003 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Oct 31 17:27:11.808569 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.799557    5003 flags.go:64] FLAG: --image-gc-high-threshold="85"
Oct 31 17:27:11.808569 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.799562    5003 flags.go:64] FLAG: --image-gc-low-threshold="80"
Oct 31 17:27:11.808569 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.799567    5003 flags.go:64] FLAG: --image-service-endpoint=""
Oct 31 17:27:11.809169 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.799571    5003 flags.go:64] FLAG: --kernel-memcg-notification="false"
Oct 31 17:27:11.809169 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.799576    5003 flags.go:64] FLAG: --kube-api-burst="100"
Oct 31 17:27:11.809169 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.799581    5003 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Oct 31 17:27:11.809169 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.799587    5003 flags.go:64] FLAG: --kube-api-qps="50"
Oct 31 17:27:11.809169 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.799591    5003 flags.go:64] FLAG: --kube-reserved=""
Oct 31 17:27:11.809169 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.799597    5003 flags.go:64] FLAG: --kube-reserved-cgroup=""
Oct 31 17:27:11.809169 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.799602    5003 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Oct 31 17:27:11.809169 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.799609    5003 flags.go:64] FLAG: --kubelet-cgroups=""
Oct 31 17:27:11.809169 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.799614    5003 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Oct 31 17:27:11.809169 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.799619    5003 flags.go:64] FLAG: --lock-file=""
Oct 31 17:27:11.809169 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.799623    5003 flags.go:64] FLAG: --log-cadvisor-usage="false"
Oct 31 17:27:11.809169 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.799628    5003 flags.go:64] FLAG: --log-flush-frequency="5s"
Oct 31 17:27:11.809169 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.799633    5003 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Oct 31 17:27:11.809169 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.799658    5003 flags.go:64] FLAG: --log-json-split-stream="false"
Oct 31 17:27:11.809169 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.799663    5003 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Oct 31 17:27:11.809169 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.799669    5003 flags.go:64] FLAG: --log-text-split-stream="false"
Oct 31 17:27:11.809169 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.799673    5003 flags.go:64] FLAG: --logging-format="text"
Oct 31 17:27:11.809169 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.799680    5003 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Oct 31 17:27:11.809169 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.799686    5003 flags.go:64] FLAG: --make-iptables-util-chains="true"
Oct 31 17:27:11.809169 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.799691    5003 flags.go:64] FLAG: --manifest-url=""
Oct 31 17:27:11.809169 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.799696    5003 flags.go:64] FLAG: --manifest-url-header=""
Oct 31 17:27:11.809169 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.799703    5003 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Oct 31 17:27:11.809169 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.799708    5003 flags.go:64] FLAG: --max-open-files="1000000"
Oct 31 17:27:11.809169 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.799715    5003 flags.go:64] FLAG: --max-pods="110"
Oct 31 17:27:11.809169 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.799720    5003 flags.go:64] FLAG: --maximum-dead-containers="-1"
Oct 31 17:27:11.809802 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.799725    5003 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Oct 31 17:27:11.809802 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.799730    5003 flags.go:64] FLAG: --memory-manager-policy="None"
Oct 31 17:27:11.809802 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.799735    5003 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Oct 31 17:27:11.809802 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.799739    5003 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Oct 31 17:27:11.809802 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.799744    5003 flags.go:64] FLAG: --node-ip="0.0.0.0"
Oct 31 17:27:11.809802 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.799750    5003 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Oct 31 17:27:11.809802 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.799760    5003 flags.go:64] FLAG: --node-status-max-images="50"
Oct 31 17:27:11.809802 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.799765    5003 flags.go:64] FLAG: --node-status-update-frequency="10s"
Oct 31 17:27:11.809802 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.799770    5003 flags.go:64] FLAG: --oom-score-adj="-999"
Oct 31 17:27:11.809802 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.799777    5003 flags.go:64] FLAG: --pod-cidr=""
Oct 31 17:27:11.809802 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.799781    5003 flags.go:64] FLAG: --pod-manifest-path=""
Oct 31 17:27:11.809802 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.799786    5003 flags.go:64] FLAG: --pod-max-pids="-1"
Oct 31 17:27:11.809802 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.799791    5003 flags.go:64] FLAG: --pods-per-core="0"
Oct 31 17:27:11.809802 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.799796    5003 flags.go:64] FLAG: --port="10250"
Oct 31 17:27:11.809802 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.799803    5003 flags.go:64] FLAG: --protect-kernel-defaults="false"
Oct 31 17:27:11.809802 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.799808    5003 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-02d787b147d9ce028"
Oct 31 17:27:11.809802 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.799813    5003 flags.go:64] FLAG: --qos-reserved=""
Oct 31 17:27:11.809802 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.799818    5003 flags.go:64] FLAG: --read-only-port="10255"
Oct 31 17:27:11.809802 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.799823    5003 flags.go:64] FLAG: --register-node="true"
Oct 31 17:27:11.809802 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.799828    5003 flags.go:64] FLAG: --register-with-taints=""
Oct 31 17:27:11.809802 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.799834    5003 flags.go:64] FLAG: --registry-burst="10"
Oct 31 17:27:11.809802 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.799839    5003 flags.go:64] FLAG: --registry-qps="5"
Oct 31 17:27:11.809802 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.799844    5003 flags.go:64] FLAG: --reserved-cpus=""
Oct 31 17:27:11.809802 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.799849    5003 flags.go:64] FLAG: --reserved-memory=""
Oct 31 17:27:11.809802 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.799858    5003 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Oct 31 17:27:11.809802 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.799863    5003 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Oct 31 17:27:11.810450 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.799868    5003 flags.go:64] FLAG: --rotate-certificates="false"
Oct 31 17:27:11.810450 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.799873    5003 flags.go:64] FLAG: --rotate-server-certificates="false"
Oct 31 17:27:11.810450 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.799877    5003 flags.go:64] FLAG: --runonce="false"
Oct 31 17:27:11.810450 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.799882    5003 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Oct 31 17:27:11.810450 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.799888    5003 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Oct 31 17:27:11.810450 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.799893    5003 flags.go:64] FLAG: --seccomp-default="false"
Oct 31 17:27:11.810450 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.799898    5003 flags.go:64] FLAG: --serialize-image-pulls="true"
Oct 31 17:27:11.810450 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.799902    5003 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Oct 31 17:27:11.810450 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.799907    5003 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Oct 31 17:27:11.810450 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.799912    5003 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Oct 31 17:27:11.810450 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.799917    5003 flags.go:64] FLAG: --storage-driver-password="root"
Oct 31 17:27:11.810450 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.799922    5003 flags.go:64] FLAG: --storage-driver-secure="false"
Oct 31 17:27:11.810450 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.799927    5003 flags.go:64] FLAG: --storage-driver-table="stats"
Oct 31 17:27:11.810450 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.799932    5003 flags.go:64] FLAG: --storage-driver-user="root"
Oct 31 17:27:11.810450 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.799937    5003 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Oct 31 17:27:11.810450 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.799942    5003 flags.go:64] FLAG: --sync-frequency="1m0s"
Oct 31 17:27:11.810450 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.799948    5003 flags.go:64] FLAG: --system-cgroups=""
Oct 31 17:27:11.810450 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.799953    5003 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Oct 31 17:27:11.810450 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.799961    5003 flags.go:64] FLAG: --system-reserved-cgroup=""
Oct 31 17:27:11.810450 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.799966    5003 flags.go:64] FLAG: --tls-cert-file=""
Oct 31 17:27:11.810450 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.799972    5003 flags.go:64] FLAG: --tls-cipher-suites="[]"
Oct 31 17:27:11.810450 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.799980    5003 flags.go:64] FLAG: --tls-min-version=""
Oct 31 17:27:11.810450 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.799985    5003 flags.go:64] FLAG: --tls-private-key-file=""
Oct 31 17:27:11.810450 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.799989    5003 flags.go:64] FLAG: --topology-manager-policy="none"
Oct 31 17:27:11.810450 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.799994    5003 flags.go:64] FLAG: --topology-manager-policy-options=""
Oct 31 17:27:11.811149 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.799999    5003 flags.go:64] FLAG: --topology-manager-scope="container"
Oct 31 17:27:11.811149 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.800004    5003 flags.go:64] FLAG: --v="2"
Oct 31 17:27:11.811149 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.800011    5003 flags.go:64] FLAG: --version="false"
Oct 31 17:27:11.811149 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.800018    5003 flags.go:64] FLAG: --vmodule=""
Oct 31 17:27:11.811149 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.800024    5003 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Oct 31 17:27:11.811149 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.800031    5003 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Oct 31 17:27:11.811149 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.800245    5003 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 31 17:27:11.811149 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.800252    5003 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 31 17:27:11.811149 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.800257    5003 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 31 17:27:11.811149 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.800263    5003 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 31 17:27:11.811149 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.800270    5003 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 31 17:27:11.811149 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.800275    5003 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 31 17:27:11.811149 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.800279    5003 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 31 17:27:11.811149 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.800284    5003 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 31 17:27:11.811149 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.800289    5003 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 31 17:27:11.811149 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.800293    5003 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 31 17:27:11.811149 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.800297    5003 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 31 17:27:11.811149 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.800302    5003 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 31 17:27:11.811149 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.800306    5003 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 31 17:27:11.811149 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.800311    5003 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 31 17:27:11.811149 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.800315    5003 feature_gate.go:386] unrecognized feature gate: Example
Oct 31 17:27:11.811679 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.800319    5003 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 31 17:27:11.811679 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.800324    5003 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 31 17:27:11.811679 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.800328    5003 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 31 17:27:11.811679 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.800333    5003 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 31 17:27:11.811679 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.800337    5003 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 31 17:27:11.811679 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.800342    5003 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 31 17:27:11.811679 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.800349    5003 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 31 17:27:11.811679 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.800355    5003 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 31 17:27:11.811679 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.800359    5003 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 31 17:27:11.811679 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.800363    5003 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 31 17:27:11.811679 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.800367    5003 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 31 17:27:11.811679 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.800373    5003 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 31 17:27:11.811679 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.800377    5003 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 31 17:27:11.811679 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.800382    5003 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 31 17:27:11.811679 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.800386    5003 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 31 17:27:11.811679 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.800390    5003 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 31 17:27:11.811679 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.800397    5003 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 31 17:27:11.811679 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.800401    5003 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 31 17:27:11.811679 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.800405    5003 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 31 17:27:11.811679 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.800410    5003 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 31 17:27:11.812277 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.800414    5003 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 31 17:27:11.812277 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.800418    5003 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 31 17:27:11.812277 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.800423    5003 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 31 17:27:11.812277 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.800427    5003 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 31 17:27:11.812277 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.800431    5003 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 31 17:27:11.812277 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.800435    5003 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 31 17:27:11.812277 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.800440    5003 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 31 17:27:11.812277 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.800444    5003 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 31 17:27:11.812277 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.800448    5003 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 31 17:27:11.812277 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.800451    5003 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 31 17:27:11.812277 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.800455    5003 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 31 17:27:11.812277 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.800459    5003 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 31 17:27:11.812277 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.800464    5003 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 31 17:27:11.812277 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.800468    5003 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 31 17:27:11.812277 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.800472    5003 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 31 17:27:11.812277 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.800476    5003 feature_gate.go:386] unrecognized feature gate: Example2
Oct 31 17:27:11.812277 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.800482    5003 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 31 17:27:11.812277 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.800487    5003 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 31 17:27:11.812277 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.800492    5003 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 31 17:27:11.812819 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.800496    5003 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 31 17:27:11.812819 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.800500    5003 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 31 17:27:11.812819 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.800504    5003 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 31 17:27:11.812819 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.800508    5003 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 31 17:27:11.812819 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.800515    5003 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 31 17:27:11.812819 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.800521    5003 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 31 17:27:11.812819 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.800526    5003 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 31 17:27:11.812819 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.800531    5003 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 31 17:27:11.812819 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.800536    5003 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 31 17:27:11.812819 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.800543    5003 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 31 17:27:11.812819 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.800547    5003 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 31 17:27:11.812819 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.800551    5003 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 31 17:27:11.812819 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.800556    5003 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 31 17:27:11.812819 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.800563    5003 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 31 17:27:11.812819 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.800569    5003 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 31 17:27:11.812819 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.800574    5003 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 31 17:27:11.812819 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.800579    5003 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 31 17:27:11.812819 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.800583    5003 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 31 17:27:11.813595 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.800588    5003 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 31 17:27:11.813595 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.800593    5003 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 31 17:27:11.813595 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.800597    5003 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 31 17:27:11.813595 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.800601    5003 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 31 17:27:11.813595 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.800606    5003 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 31 17:27:11.813595 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.800610    5003 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 31 17:27:11.813595 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.800615    5003 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 31 17:27:11.813595 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.800620    5003 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 31 17:27:11.813595 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.800624    5003 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 31 17:27:11.813595 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.800628    5003 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 31 17:27:11.813595 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.800633    5003 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 31 17:27:11.813595 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.800637    5003 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 31 17:27:11.813595 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.800658    5003 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 31 17:27:11.813595 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.800663    5003 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 31 17:27:11.813595 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.800668    5003 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 31 17:27:11.813595 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.800672    5003 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 31 17:27:11.813595 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.800677    5003 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 31 17:27:11.813595 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.800681    5003 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 31 17:27:11.813595 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.800685    5003 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 31 17:27:11.813595 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.800690    5003 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 31 17:27:11.814603 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.800694    5003 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 31 17:27:11.814603 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.800698    5003 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 31 17:27:11.814603 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.800703    5003 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 31 17:27:11.814603 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.800709    5003 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 31 17:27:11.814603 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.800713    5003 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 31 17:27:11.814603 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.800718    5003 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 31 17:27:11.814603 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.800722    5003 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 31 17:27:11.814603 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.800727    5003 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 31 17:27:11.814603 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.800731    5003 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 31 17:27:11.814603 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.800736    5003 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 31 17:27:11.814603 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.800741    5003 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 31 17:27:11.814603 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.800745    5003 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 31 17:27:11.814603 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.800749    5003 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 31 17:27:11.814603 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.800754    5003 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 31 17:27:11.814603 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.800802    5003 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]}
Oct 31 17:27:11.814603 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.800858    5003 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 31 17:27:11.815130 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.800865    5003 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 31 17:27:11.815130 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.800870    5003 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 31 17:27:11.815130 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.800875    5003 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 31 17:27:11.815130 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.800879    5003 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 31 17:27:11.815130 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.800883    5003 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 31 17:27:11.815130 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.800887    5003 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 31 17:27:11.815130 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.800892    5003 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 31 17:27:11.815130 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.800897    5003 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 31 17:27:11.815130 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.800901    5003 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 31 17:27:11.815130 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.800906    5003 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 31 17:27:11.815130 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.800911    5003 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 31 17:27:11.815130 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.800915    5003 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 31 17:27:11.815130 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.800920    5003 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 31 17:27:11.815130 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.800924    5003 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 31 17:27:11.815130 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.800928    5003 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 31 17:27:11.815130 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.800932    5003 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 31 17:27:11.815130 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.800937    5003 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 31 17:27:11.815130 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.800942    5003 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 31 17:27:11.815130 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.800946    5003 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 31 17:27:11.815130 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.800952    5003 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 31 17:27:11.815813 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.800957    5003 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 31 17:27:11.815813 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.800961    5003 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 31 17:27:11.815813 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.800965    5003 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 31 17:27:11.815813 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.800969    5003 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 31 17:27:11.815813 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.800973    5003 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 31 17:27:11.815813 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.800978    5003 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 31 17:27:11.815813 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.800982    5003 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 31 17:27:11.815813 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.800987    5003 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 31 17:27:11.815813 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.800992    5003 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 31 17:27:11.815813 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.800996    5003 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 31 17:27:11.815813 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.801000    5003 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 31 17:27:11.815813 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.801005    5003 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 31 17:27:11.815813 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.801009    5003 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 31 17:27:11.815813 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.801013    5003 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 31 17:27:11.815813 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.801017    5003 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 31 17:27:11.815813 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.801022    5003 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 31 17:27:11.815813 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.801026    5003 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 31 17:27:11.815813 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.801030    5003 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 31 17:27:11.815813 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.801035    5003 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 31 17:27:11.815813 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.801039    5003 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 31 17:27:11.816376 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.801043    5003 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 31 17:27:11.816376 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.801048    5003 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 31 17:27:11.816376 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.801053    5003 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 31 17:27:11.816376 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.801057    5003 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 31 17:27:11.816376 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.801062    5003 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 31 17:27:11.816376 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.801066    5003 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 31 17:27:11.816376 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.801069    5003 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 31 17:27:11.816376 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.801074    5003 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 31 17:27:11.816376 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.801080    5003 feature_gate.go:386] unrecognized feature gate: Example
Oct 31 17:27:11.816376 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.801085    5003 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 31 17:27:11.816376 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.801089    5003 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 31 17:27:11.816376 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.801095    5003 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 31 17:27:11.816376 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.801099    5003 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 31 17:27:11.816376 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.801103    5003 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 31 17:27:11.816376 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.801108    5003 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 31 17:27:11.816376 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.801112    5003 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 31 17:27:11.816376 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.801117    5003 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 31 17:27:11.816376 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.801121    5003 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 31 17:27:11.816376 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.801126    5003 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 31 17:27:11.816376 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.801130    5003 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 31 17:27:11.816908 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.801136    5003 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 31 17:27:11.816908 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.801140    5003 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 31 17:27:11.816908 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.801144    5003 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 31 17:27:11.816908 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.801149    5003 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 31 17:27:11.816908 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.801153    5003 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 31 17:27:11.816908 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.801157    5003 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 31 17:27:11.816908 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.801162    5003 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 31 17:27:11.816908 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.801166    5003 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 31 17:27:11.816908 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.801171    5003 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 31 17:27:11.816908 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.801175    5003 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 31 17:27:11.816908 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.801179    5003 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 31 17:27:11.816908 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.801183    5003 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 31 17:27:11.816908 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.801188    5003 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 31 17:27:11.816908 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.801192    5003 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 31 17:27:11.816908 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.801196    5003 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 31 17:27:11.816908 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.801201    5003 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 31 17:27:11.816908 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.801205    5003 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 31 17:27:11.816908 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.801210    5003 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 31 17:27:11.816908 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.801214    5003 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 31 17:27:11.817381 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.801219    5003 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 31 17:27:11.817381 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.801225    5003 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 31 17:27:11.817381 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.801229    5003 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 31 17:27:11.817381 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.801233    5003 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 31 17:27:11.817381 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.801239    5003 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 31 17:27:11.817381 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.801243    5003 feature_gate.go:386] unrecognized feature gate: Example2
Oct 31 17:27:11.817381 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.801248    5003 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 31 17:27:11.817381 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.801252    5003 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 31 17:27:11.817381 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.801257    5003 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 31 17:27:11.817381 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.801261    5003 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 31 17:27:11.817381 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.801265    5003 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 31 17:27:11.817381 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.801270    5003 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 31 17:27:11.817381 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.801274    5003 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 31 17:27:11.817381 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.801280    5003 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 31 17:27:11.817381 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.801287    5003 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 31 17:27:11.817381 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.801292    5003 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 31 17:27:11.817381 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.801297    5003 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 31 17:27:11.817381 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.801302    5003 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 31 17:27:11.817381 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.801306    5003 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 31 17:27:11.817876 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.801310    5003 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 31 17:27:11.817876 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.801314    5003 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 31 17:27:11.817876 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.801319    5003 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 31 17:27:11.817876 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.801327    5003 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 31 17:27:11.817876 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.801333    5003 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 31 17:27:11.817876 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.801338    5003 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 31 17:27:11.817876 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.801344    5003 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 31 17:27:11.817876 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.807034    5003 server.go:525] "Kubelet version" kubeletVersion="v1.35.9"
Oct 31 17:27:11.817876 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.807052    5003 server.go:527] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Oct 31 17:27:11.817876 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.807072    5003 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Oct 31 17:27:11.817876 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.807077    5003 watchdog_linux.go:138] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Oct 31 17:27:11.817876 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.807135    5003 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 31 17:27:11.817876 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.807141    5003 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 31 17:27:11.817876 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.807145    5003 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 31 17:27:11.817876 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.807148    5003 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 31 17:27:11.817876 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.807151    5003 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 31 17:27:11.817876 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.807154    5003 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 31 17:27:11.817876 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.807157    5003 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 31 17:27:11.817876 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.807160    5003 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 31 17:27:11.818417 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.807163    5003 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 31 17:27:11.818417 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.807166    5003 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 31 17:27:11.818417 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.807169    5003 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 31 17:27:11.818417 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.807171    5003 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 31 17:27:11.818417 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.807174    5003 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 31 17:27:11.818417 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.807177    5003 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 31 17:27:11.818417 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.807180    5003 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 31 17:27:11.818417 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.807183    5003 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 31 17:27:11.818417 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.807186    5003 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 31 17:27:11.818417 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.807189    5003 feature_gate.go:386] unrecognized feature gate: Example
Oct 31 17:27:11.818417 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.807192    5003 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 31 17:27:11.818417 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.807195    5003 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 31 17:27:11.818417 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.807198    5003 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 31 17:27:11.818417 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.807201    5003 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 31 17:27:11.818417 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.807205    5003 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 31 17:27:11.818417 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.807207    5003 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 31 17:27:11.818417 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.807211    5003 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 31 17:27:11.818417 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.807214    5003 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 31 17:27:11.818417 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.807216    5003 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 31 17:27:11.818417 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.807219    5003 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 31 17:27:11.819027 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.807222    5003 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 31 17:27:11.819027 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.807225    5003 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 31 17:27:11.819027 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.807228    5003 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 31 17:27:11.819027 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.807231    5003 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 31 17:27:11.819027 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.807234    5003 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 31 17:27:11.819027 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.807237    5003 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 31 17:27:11.819027 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.807240    5003 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 31 17:27:11.819027 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.807243    5003 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 31 17:27:11.819027 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.807245    5003 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 31 17:27:11.819027 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.807248    5003 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 31 17:27:11.819027 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.807251    5003 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 31 17:27:11.819027 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.807253    5003 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 31 17:27:11.819027 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.807256    5003 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 31 17:27:11.819027 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.807258    5003 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 31 17:27:11.819027 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.807261    5003 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 31 17:27:11.819027 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.807264    5003 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 31 17:27:11.819027 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.807266    5003 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 31 17:27:11.819027 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.807269    5003 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 31 17:27:11.819027 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.807271    5003 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 31 17:27:11.819027 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.807275    5003 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 31 17:27:11.819542 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.807277    5003 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 31 17:27:11.819542 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.807280    5003 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 31 17:27:11.819542 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.807283    5003 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 31 17:27:11.819542 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.807285    5003 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 31 17:27:11.819542 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.807289    5003 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 31 17:27:11.819542 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.807292    5003 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 31 17:27:11.819542 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.807294    5003 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 31 17:27:11.819542 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.807297    5003 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 31 17:27:11.819542 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.807300    5003 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 31 17:27:11.819542 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.807303    5003 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 31 17:27:11.819542 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.807306    5003 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 31 17:27:11.819542 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.807311    5003 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 31 17:27:11.819542 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.807315    5003 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 31 17:27:11.819542 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.807318    5003 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 31 17:27:11.819542 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.807321    5003 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 31 17:27:11.819542 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.807324    5003 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 31 17:27:11.819542 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.807327    5003 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 31 17:27:11.819542 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.807329    5003 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 31 17:27:11.819542 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.807332    5003 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 31 17:27:11.820031 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.807335    5003 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 31 17:27:11.820031 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.807338    5003 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 31 17:27:11.820031 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.807341    5003 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 31 17:27:11.820031 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.807343    5003 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 31 17:27:11.820031 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.807346    5003 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 31 17:27:11.820031 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.807349    5003 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 31 17:27:11.820031 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.807352    5003 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 31 17:27:11.820031 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.807355    5003 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 31 17:27:11.820031 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.807357    5003 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 31 17:27:11.820031 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.807360    5003 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 31 17:27:11.820031 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.807363    5003 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 31 17:27:11.820031 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.807366    5003 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 31 17:27:11.820031 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.807372    5003 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 31 17:27:11.820031 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.807375    5003 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 31 17:27:11.820031 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.807378    5003 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 31 17:27:11.820031 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.807381    5003 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 31 17:27:11.820031 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.807385    5003 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 31 17:27:11.820031 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.807389    5003 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 31 17:27:11.820031 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.807392    5003 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 31 17:27:11.820500 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.807396    5003 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 31 17:27:11.820500 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.807399    5003 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 31 17:27:11.820500 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.807402    5003 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 31 17:27:11.820500 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.807405    5003 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 31 17:27:11.820500 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.807408    5003 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 31 17:27:11.820500 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.807411    5003 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 31 17:27:11.820500 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.807414    5003 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 31 17:27:11.820500 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.807417    5003 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 31 17:27:11.820500 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.807419    5003 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 31 17:27:11.820500 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.807422    5003 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 31 17:27:11.820500 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.807425    5003 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 31 17:27:11.820500 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.807428    5003 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 31 17:27:11.820500 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.807431    5003 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 31 17:27:11.820500 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.807433    5003 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 31 17:27:11.820500 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.807436    5003 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 31 17:27:11.820500 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.807439    5003 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 31 17:27:11.820500 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.807441    5003 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 31 17:27:11.820500 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.807444    5003 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 31 17:27:11.820500 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.807447    5003 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 31 17:27:11.821030 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.807449    5003 feature_gate.go:386] unrecognized feature gate: Example2
Oct 31 17:27:11.821030 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.807478    5003 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]}
Oct 31 17:27:11.821030 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.807620    5003 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 31 17:27:11.821030 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.807624    5003 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 31 17:27:11.821030 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.807628    5003 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 31 17:27:11.821030 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.807630    5003 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 31 17:27:11.821030 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.807634    5003 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 31 17:27:11.821030 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.807637    5003 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 31 17:27:11.821030 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.807640    5003 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 31 17:27:11.821030 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.807664    5003 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 31 17:27:11.821030 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.807668    5003 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 31 17:27:11.821030 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.807671    5003 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 31 17:27:11.821030 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.807673    5003 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 31 17:27:11.821030 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.807676    5003 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 31 17:27:11.821030 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.807679    5003 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 31 17:27:11.821030 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.807681    5003 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 31 17:27:11.821684 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.807684    5003 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 31 17:27:11.821684 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.807688    5003 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 31 17:27:11.821684 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.807691    5003 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 31 17:27:11.821684 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.807694    5003 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 31 17:27:11.821684 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.807697    5003 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 31 17:27:11.821684 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.807699    5003 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 31 17:27:11.821684 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.807702    5003 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 31 17:27:11.821684 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.807706    5003 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 31 17:27:11.821684 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.807710    5003 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 31 17:27:11.821684 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.807714    5003 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 31 17:27:11.821684 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.807717    5003 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 31 17:27:11.821684 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.807721    5003 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 31 17:27:11.821684 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.807723    5003 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 31 17:27:11.821684 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.807726    5003 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 31 17:27:11.821684 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.807729    5003 feature_gate.go:386] unrecognized feature gate: Example
Oct 31 17:27:11.821684 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.807731    5003 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 31 17:27:11.821684 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.807734    5003 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 31 17:27:11.821684 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.807737    5003 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 31 17:27:11.821684 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.807740    5003 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 31 17:27:11.822353 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.807742    5003 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 31 17:27:11.822353 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.807745    5003 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 31 17:27:11.822353 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.807747    5003 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 31 17:27:11.822353 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.807750    5003 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 31 17:27:11.822353 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.807753    5003 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 31 17:27:11.822353 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.807756    5003 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 31 17:27:11.822353 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.807759    5003 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 31 17:27:11.822353 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.807762    5003 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 31 17:27:11.822353 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.807764    5003 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 31 17:27:11.822353 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.807768    5003 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 31 17:27:11.822353 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.807770    5003 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 31 17:27:11.822353 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.807773    5003 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 31 17:27:11.822353 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.807775    5003 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 31 17:27:11.822353 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.807778    5003 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 31 17:27:11.822353 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.807781    5003 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 31 17:27:11.822353 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.807783    5003 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 31 17:27:11.822353 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.807786    5003 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 31 17:27:11.822353 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.807788    5003 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 31 17:27:11.822353 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.807791    5003 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 31 17:27:11.822353 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.807793    5003 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 31 17:27:11.822885 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.807796    5003 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 31 17:27:11.822885 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.807798    5003 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 31 17:27:11.822885 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.807801    5003 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 31 17:27:11.822885 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.807804    5003 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 31 17:27:11.822885 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.807806    5003 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 31 17:27:11.822885 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.807809    5003 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 31 17:27:11.822885 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.807812    5003 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 31 17:27:11.822885 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.807815    5003 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 31 17:27:11.822885 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.807817    5003 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 31 17:27:11.822885 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.807820    5003 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 31 17:27:11.822885 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.807822    5003 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 31 17:27:11.822885 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.807825    5003 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 31 17:27:11.822885 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.807827    5003 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 31 17:27:11.822885 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.807830    5003 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 31 17:27:11.822885 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.807832    5003 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 31 17:27:11.822885 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.807835    5003 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 31 17:27:11.822885 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.807838    5003 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 31 17:27:11.822885 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.807841    5003 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 31 17:27:11.822885 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.807844    5003 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 31 17:27:11.823411 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.807846    5003 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 31 17:27:11.823411 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.807849    5003 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 31 17:27:11.823411 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.807852    5003 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 31 17:27:11.823411 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.807854    5003 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 31 17:27:11.823411 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.807857    5003 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 31 17:27:11.823411 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.807859    5003 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 31 17:27:11.823411 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.807862    5003 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 31 17:27:11.823411 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.807865    5003 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 31 17:27:11.823411 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.807868    5003 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 31 17:27:11.823411 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.807871    5003 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 31 17:27:11.823411 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.807873    5003 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 31 17:27:11.823411 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.807876    5003 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 31 17:27:11.823411 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.807878    5003 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 31 17:27:11.823411 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.807881    5003 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 31 17:27:11.823411 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.807884    5003 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 31 17:27:11.823411 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.807886    5003 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 31 17:27:11.823411 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.807889    5003 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 31 17:27:11.823411 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.807891    5003 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 31 17:27:11.823411 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.807894    5003 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 31 17:27:11.823411 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.807896    5003 feature_gate.go:386] unrecognized feature gate: Example2
Oct 31 17:27:11.823944 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.807899    5003 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 31 17:27:11.823944 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.807901    5003 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 31 17:27:11.823944 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.807904    5003 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 31 17:27:11.823944 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.807906    5003 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 31 17:27:11.823944 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.807909    5003 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 31 17:27:11.823944 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.807911    5003 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 31 17:27:11.823944 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.807914    5003 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 31 17:27:11.823944 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.807917    5003 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 31 17:27:11.823944 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.807920    5003 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 31 17:27:11.823944 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.807922    5003 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 31 17:27:11.823944 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.807925    5003 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 31 17:27:11.823944 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.807927    5003 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 31 17:27:11.823944 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.807930    5003 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 31 17:27:11.823944 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.807933    5003 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 31 17:27:11.823944 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.807957    5003 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]}
Oct 31 17:27:11.823944 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.807990    5003 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 31 17:27:11.824355 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.807994    5003 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 31 17:27:11.824355 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.807998    5003 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 31 17:27:11.824355 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.808001    5003 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 31 17:27:11.824355 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.808004    5003 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 31 17:27:11.824355 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.808007    5003 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 31 17:27:11.824355 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.808010    5003 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 31 17:27:11.824355 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.808013    5003 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 31 17:27:11.824355 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.808016    5003 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 31 17:27:11.824355 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.808018    5003 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 31 17:27:11.824355 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.808021    5003 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 31 17:27:11.824355 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.808024    5003 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 31 17:27:11.824355 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.808027    5003 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 31 17:27:11.824355 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.808030    5003 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 31 17:27:11.824355 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.808032    5003 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 31 17:27:11.824355 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.808035    5003 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 31 17:27:11.824355 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.808038    5003 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 31 17:27:11.824355 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.808040    5003 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 31 17:27:11.824355 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.808043    5003 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 31 17:27:11.824355 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.808045    5003 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 31 17:27:11.824829 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.808048    5003 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 31 17:27:11.824829 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.808051    5003 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 31 17:27:11.824829 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.808053    5003 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 31 17:27:11.824829 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.808056    5003 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 31 17:27:11.824829 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.808059    5003 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 31 17:27:11.824829 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.808061    5003 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 31 17:27:11.824829 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.808064    5003 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 31 17:27:11.824829 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.808067    5003 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 31 17:27:11.824829 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.808069    5003 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 31 17:27:11.824829 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.808072    5003 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 31 17:27:11.824829 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.808075    5003 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 31 17:27:11.824829 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.808077    5003 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 31 17:27:11.824829 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.808080    5003 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 31 17:27:11.824829 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.808083    5003 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 31 17:27:11.824829 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.808086    5003 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 31 17:27:11.824829 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.808089    5003 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 31 17:27:11.824829 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.808092    5003 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 31 17:27:11.824829 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.808095    5003 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 31 17:27:11.824829 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.808097    5003 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 31 17:27:11.825331 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.808100    5003 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 31 17:27:11.825331 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.808103    5003 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 31 17:27:11.825331 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.808105    5003 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 31 17:27:11.825331 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.808108    5003 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 31 17:27:11.825331 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.808111    5003 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 31 17:27:11.825331 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.808113    5003 feature_gate.go:386] unrecognized feature gate: Example2
Oct 31 17:27:11.825331 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.808116    5003 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 31 17:27:11.825331 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.808119    5003 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 31 17:27:11.825331 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.808121    5003 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 31 17:27:11.825331 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.808124    5003 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 31 17:27:11.825331 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.808127    5003 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 31 17:27:11.825331 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.808129    5003 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 31 17:27:11.825331 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.808132    5003 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 31 17:27:11.825331 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.808135    5003 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 31 17:27:11.825331 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.808137    5003 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 31 17:27:11.825331 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.808140    5003 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 31 17:27:11.825331 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.808142    5003 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 31 17:27:11.825331 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.808145    5003 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 31 17:27:11.825331 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.808148    5003 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 31 17:27:11.825331 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.808151    5003 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 31 17:27:11.825852 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.808153    5003 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 31 17:27:11.825852 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.808156    5003 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 31 17:27:11.825852 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.808159    5003 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 31 17:27:11.825852 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.808161    5003 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 31 17:27:11.825852 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.808164    5003 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 31 17:27:11.825852 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.808167    5003 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 31 17:27:11.825852 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.808170    5003 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 31 17:27:11.825852 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.808172    5003 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 31 17:27:11.825852 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.808174    5003 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 31 17:27:11.825852 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.808177    5003 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 31 17:27:11.825852 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.808180    5003 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 31 17:27:11.825852 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.808182    5003 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 31 17:27:11.825852 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.808185    5003 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 31 17:27:11.825852 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.808187    5003 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 31 17:27:11.825852 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.808190    5003 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 31 17:27:11.825852 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.808192    5003 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 31 17:27:11.825852 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.808195    5003 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 31 17:27:11.825852 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.808198    5003 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 31 17:27:11.825852 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.808201    5003 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 31 17:27:11.825852 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.808203    5003 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 31 17:27:11.826383 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.808206    5003 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 31 17:27:11.826383 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.808210    5003 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 31 17:27:11.826383 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.808214    5003 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 31 17:27:11.826383 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.808218    5003 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 31 17:27:11.826383 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.808224    5003 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 31 17:27:11.826383 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.808228    5003 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 31 17:27:11.826383 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.808231    5003 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 31 17:27:11.826383 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.808233    5003 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 31 17:27:11.826383 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.808236    5003 feature_gate.go:386] unrecognized feature gate: Example
Oct 31 17:27:11.826383 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.808239    5003 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 31 17:27:11.826383 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.808241    5003 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 31 17:27:11.826383 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.808244    5003 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 31 17:27:11.826383 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.808247    5003 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 31 17:27:11.826383 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.808250    5003 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 31 17:27:11.826383 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.808252    5003 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 31 17:27:11.826383 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.808255    5003 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 31 17:27:11.826383 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.808257    5003 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 31 17:27:11.826383 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.808260    5003 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 31 17:27:11.826383 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.808263    5003 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 31 17:27:11.826869 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.808266    5003 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 31 17:27:11.826869 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.808268    5003 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 31 17:27:11.826869 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.808271    5003 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 31 17:27:11.826869 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.808275    5003 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 31 17:27:11.826869 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.808277    5003 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 31 17:27:11.826869 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.808280    5003 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 31 17:27:11.826869 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.808282    5003 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 31 17:27:11.826869 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:11.808285    5003 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 31 17:27:11.826869 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.808346    5003 server.go:957] "Client rotation is on, will bootstrap in background"
Oct 31 17:27:11.826869 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.809379    5003 bootstrap.go:85] "Current kubeconfig file contents are still valid, no bootstrap necessary"
Oct 31 17:27:11.826869 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.809441    5003 certificate_store.go:147] "Loading cert/key pair from a file" filePath="/var/lib/kubelet/pki/kubelet-client-current.pem"
Oct 31 17:27:11.826869 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.809625    5003 server.go:1014] "Starting client certificate rotation"
Oct 31 17:27:11.826869 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.809755    5003 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Oct 31 17:27:11.826869 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.809810    5003 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-10-30 17:21:31 +0000 UTC" deadline="2028-08-09 05:45:10.876095166 +0000 UTC"
Oct 31 17:27:11.826869 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.809847    5003 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15540h17m59.066250549s"
Oct 31 17:27:11.826869 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.810089    5003 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Oct 31 17:27:11.827271 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.811277    5003 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Oct 31 17:27:11.827271 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.812511    5003 log.go:25] "Validated CRI v1 runtime API"
Oct 31 17:27:11.827271 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.814658    5003 log.go:25] "Validated CRI v1 image API"
Oct 31 17:27:11.827271 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.815378    5003 server.go:1424] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Oct 31 17:27:11.827271 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.817384    5003 fs.go:135] Filesystem UUIDs: map[18b527d9-dc0e-4e18-a390-d46635bb98a9:/dev/nvme0n1p3 3a904ed3-640b-4191-a938-896bd1aad0bf:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2]
Oct 31 17:27:11.827438 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.817405    5003 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:24 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:26 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/0dea90a26434f8f6217f8618985f915fb0f73f4b017c635d9240a0b1ca615e8f/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/0dea90a26434f8f6217f8618985f915fb0f73f4b017c635d9240a0b1ca615e8f/userdata/shm major:0 minor:236 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/199e372bc14f6d1835767bbf1d713534986731696ef08b89fcb16220f2b382d1/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/199e372bc14f6d1835767bbf1d713534986731696ef08b89fcb16220f2b382d1/userdata/shm major:0 minor:238 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/40e2493e3e7332fd3069f87c72eaaf0f1beaf1beaed3c950a6b9c150baa48160/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/40e2493e3e7332fd3069f87c72eaaf0f1beaf1beaed3c950a6b9c150baa48160/userdata/shm major:0 minor:80 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/4e687914b465652caf2648448b13281d69a723f780957e2fc30f8fa75b8a7f0f/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/4e687914b465652caf2648448b13281d69a723f780957e2fc30f8fa75b8a7f0f/userdata/shm major:0 minor:334 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/55c24e9e35b3f3455301939fd9cf68e6a7756ba200158846632ae9c027f11501/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/55c24e9e35b3f3455301939fd9cf68e6a7756ba200158846632ae9c027f11501/userdata/shm major:0 minor:232 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/5d38c987e34445d1bde0bbf11d39b3fa047cdab3266f8e91c79dc0dc0111126d/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/5d38c987e34445d1bde0bbf11d39b3fa047cdab3266f8e91c79dc0dc0111126d/userdata/shm major:0 minor:72 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/634f4ff5412ec8396e0ea23004b3855bfff910b7e4d092e2e525d339a14c9b1e/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/634f4ff5412ec8396e0ea23004b3855bfff910b7e4d092e2e525d339a14c9b1e/userdata/shm major:0 minor:296 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/75e7934ec6e3158727778643e8e4d10cb6bd24556a488c337e5dd699ab3c17c6/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/75e7934ec6e3158727778643e8e4d10cb6bd24556a488c337e5dd699ab3c17c6/userdata/shm major:0 minor:242 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/83af66c7b7be1e89a549e9b361de40c83021477f0bfd5b909a56b53d6f5337ba/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/83af66c7b7be1e89a549e9b361de40c83021477f0bfd5b909a56b53d6f5337ba/userdata/shm major:0 minor:246 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/84e91389e75f52e3c36f05f68c789da4e3570d436b54dd1bc940548f53db651d/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/84e91389e75f52e3c36f05f68c789da4e3570d436b54dd1bc940548f53db651d/userdata/shm major:0 minor:336 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/887e4ba8e2f1819c14acae40c084561bb0e14797214b98b1f721f46071a2bc2c/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/887e4ba8e2f1819c14acae40c084561bb0e14797214b98b1f721f46071a2bc2c/userdata/shm major:0 minor:84 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/9845958ca43d987b6dc426bbe0514c2e3607c94dc1d6242590e450b8fa1ae20a/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/9845958ca43d987b6dc426bbe0514c2e3607c94dc1d6242590e450b8fa1ae20a/userdata/shm major:0 minor:240 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/9fa0667db86191a2451edf4dbe67513a34fc2240fa69790b1f98bac9fcaac48a/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/9fa0667db86191a2451edf4dbe67513a34fc2240fa69790b1f98bac9fcaac48a/userdata/shm major:0 minor:90 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/ae6a674b56f493935c53ae0614e6db8e6328dc6f28f16e6f2803962175d16e00/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/ae6a674b56f493935c53ae0614e6db8e6328dc6f28f16e6f2803962175d16e00/userdata/shm major:0 minor:68 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/b04372cdde747c31b9ddfaba1b1dec47cf42e7045d4e8970634373c035dc2f89/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/b04372cdde747c31b9ddfaba1b1dec47cf42e7045d4e8970634373c035dc2f89/userdata/shm major:0 minor:342 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/b1f7975c4fe44754cfb8a3963b2147f41bd63a3578974932c73f851106b5a047/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/b1f7975c4fe44754cfb8a3963b2147f41bd63a3578974932c73f851106b5a047/userdata/shm major:0 minor:98 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/bb0a00d4ae5cd9e352236bf7586fda56ae4091a154dba55bc35b663ed7bc06ce/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/bb0a00d4ae5cd9e352236bf7586fda56ae4091a154dba55bc35b663ed7bc06ce/userdata/shm major:0 minor:48 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/c2338ea0da8ffd495897336bb22c7427577acf2382e1c3e4b5b0e9758b07fb2a/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/c2338ea0da8ffd495897336bb22c7427577acf2382e1c3e4b5b0e9758b07fb2a/userdata/shm major:0 minor:230 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/c6761ad57d4350d67c2dcce2c32cae91de22b1f0ec08230216d28a39fb381e49/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/c6761ad57d4350d67c2dcce2c32cae91de22b1f0ec08230216d28a39fb381e49/userdata/shm major:0 minor:94 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/c75845d8ebe4c7da50fed94b6455e5612f288c07a0727d2e44903bfce28fe571/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/c75845d8ebe4c7da50fed94b6455e5612f288c07a0727d2e44903bfce28fe571/userdata/shm major:0 minor:234 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/ccaf9147bedffeecc2ec62a1f12370b33c20b2b6e4eddd1abaa0444d5431fefa/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/ccaf9147bedffeecc2ec62a1f12370b33c20b2b6e4eddd1abaa0444d5431fefa/userdata/shm major:0 minor:244 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/d7a09902a067c1ac1a86baee212c117b772da95dfc4dc1fb3607c960bc30f8cf/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/d7a09902a067c1ac1a86baee212c117b772da95dfc4dc1fb3607c960bc30f8cf/userdata/shm major:0 minor:228 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/dd6895944d74abbe426d24ba35505f7fa7f4aa9f7af9f66783e6e82e4a746087/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/dd6895944d74abbe426d24ba35505f7fa7f4aa9f7af9f66783e6e82e4a746087/userdata/shm major:0 minor:301 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/e22c0522d326cbf89fef59bf03aad4739e006f0a5b39b49538ee85190d4e0d72/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/e22c0522d326cbf89fef59bf03aad4739e006f0a5b39b49538ee85190d4e0d72/userdata/shm major:0 minor:76 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/e58c6a3710855022ae8b11167e0001480ccb26ed614ee6d6105468766fa9f00f/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/e58c6a3710855022ae8b11167e0001480ccb26ed614ee6d6105468766fa9f00f/userdata/shm major:0 minor:47 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:32 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/0c8a8a3b-14dd-45c9-b8fb-baf967142fd6/volumes/kubernetes.io~empty-dir/etc-tuned:{mountpoint:/var/lib/kubelet/pods/0c8a8a3b-14dd-45c9-b8fb-baf967142fd6/volumes/kubernetes.io~empty-dir/etc-tuned major:0 minor:58 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/0c8a8a3b-14dd-45c9-b8fb-baf967142fd6/volumes/kubernetes.io~empty-dir/tmp:{mountpoint:/var/lib/kubelet/pods/0c8a8a3b-14dd-45c9-b8fb-baf967142fd6/volumes/kubernetes.io~empty-dir/tmp major:0 minor:57 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/0c8a8a3b-14dd-45c9-b8fb-baf967142fd6/volumes/kubernetes.io~projected/kube-api-access-h4fpf:{mountpoint:/var/lib/kubelet/pods/0c8a8a3b-14dd-45c9-b8fb-baf967142fd6/volumes/kubernetes.io~projected/kube-api-access-h4fpf major:0 minor:63 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/170ada34-8944-43d2-bcfb-1d782aae5348/volumes/kubernetes.io~projected/bound-sa-token:{mountpoint:/var/lib/kubelet/pods/170ada34-8944-43d2-bcfb-1d782aae5348/volumes/kubernetes.io~projected/bound-sa-token major:0 minor:220 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/170ada34-8944-43d2-bcfb-1d782aae5348/volumes/kubernetes.io~projected/kube-api-access-h6b47:{mountpoint:/var/lib/kubelet/pods/170ada34-8944-43d2-bcfb-1d782aae5348/volumes/kubernetes.io~projected/kube-api-access-h6b47 major:0 minor:223 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/170ada34-8944-43d2-bcfb-1d782aae5348/volumes/kubernetes.io~secret/image-registry-private-configuration:{mountpoint:/var/lib/kubelet/pods/170ada34-8944-43d2-bcfb-1d782aae5348/volumes/kubernetes.io~secret/image-registry-private-configuration major:0 minor:209 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/170ada34-8944-43d2-bcfb-1d782aae5348/volumes/kubernetes.io~secret/installation-pull-secrets:{mountpoint:/var/lib/kubelet/pods/170ada34-8944-43d2-bcfb-1d782aae5348/volumes/kubernetes.io~secret/installation-pull-secrets major:0 minor:207 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/2330cbe7-498c-4f39-ba1b-3873e125dd18/volumes/kubernetes.io~projected/kube-api-access-6vzgd:{mountpoint:/var/lib/kubelet/pods/2330cbe7-498c-4f39-ba1b-3873e125dd18/volumes/kubernetes.io~projected/kube-api-access-6vzgd major:0 minor:224 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/2330cbe7-498c-4f39-ba1b-3873e125dd18/volumes/kubernetes.io~secret/serving-cert:{mountpoint:/var/lib/kubelet/pods/2330cbe7-498c-4f39-ba1b-3873e125dd18/volumes/kubernetes.io~secret/serving-cert major:0 minor:197 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/25ad5c67-f563-4653-9e86-7e9ecbe78675/volumes/kubernetes.io~projected/kube-api-access-kqpvj:{mountpoint:/var/lib/kubelet/pods/25ad5c67-f563-4653-9e86-7e9ecbe78675/volumes/kubernetes.io~projected/kube-api-access-kqpvj major:0 minor:226 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/26373302-592f-4fd5-bd54-7ac57ef19bfd/volumes/kubernetes.io~projected/kube-api-access-v5x5x:{mountpoint:/var/lib/kubelet/pods/26373302-592f-4fd5-bd54-7ac57ef19bfd/volumes/kubernetes.io~projected/kube-api-access-v5x5x major:0 minor:210 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/27af0f99-138f-42ac-89b9-9dfc4a522483/volumes/kubernetes.io~projected/kube-api-access-c6ctd:{mountpoint:/var/lib/kubelet/pods/27af0f99-138f-42ac-89b9-9dfc4a522483/volumes/kubernetes.io~projected/kube-api-access-c6ctd major:0 minor:61 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/340f062e-e599-4620-87d1-c5be0bb1b319/volumes/kubernetes.io~projected/kube-api-access-j26t9:{mountpoint:/var/lib/kubelet/pods/340f062e-e599-4620-87d1-c5be0bb1b319/volumes/kubernetes.io~projected/kube-api-access-j26t9 major:0 minor:214 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/3aa3a055-ec26-4d70-bb04-d6a09abe6661/volumes/kubernetes.io~projected/kube-api-access-crrdz:{mountpoint:/var/lib/kubelet/pods/3aa3a055-ec26-4d70-bb04-d6a09abe6661/volumes/kubernetes.io~projected/kube-api-access-crrdz major:0 minor:338 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/449efcb2-6707-4809-b869-1bb477f6e6ae/volumes/kubernetes.io~projected/kube-api-access-cq4kh:{mountpoint:/var/lib/kubelet/pods/449efcb2-6707-4809-b869-1bb477f6e6ae/volumes/kubernetes.io~projected/kube-api-access-cq4kh major:0 minor:60 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/50e82975-3344-4653-8de3-68e8a64a8757/volumes/kubernetes.io~projected/kube-api-access-ngvv2:{mountpoint:/var/lib/kubelet/pods/50e82975-3344-4653-8de3-68e8a64a8757/volumes/kubernetes.io~projected/kube-api-access-ngvv2 major:0 minor:217 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/50e82975-3344-4653-8de3-68e8a64a8757/volumes/kubernetes.io~secret/default-certificate:{mountpoint:/var/lib/kubelet/pods/50e82975-3344-4653-8de3-68e8a64a8757/volumes/kubernetes.io~secret/default-certificate major:0 minor:208 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/50e82975-3344-4653-8de3-68e8a64a8757/volumes/kubernetes.io~secret/stats-auth:{mountpoint:/var/lib/kubelet/pods/50e82975-3344-4653-8de3-68e8a64a8757/volumes/kubernetes.io~secret/stats-auth major:0 minor:206 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/5d30d9b6-0431-47f2-b06c-8a03d4f59b97/volumes/kubernetes.io~projected/kube-api-access-96ckd:{mountpoint:/var/lib/kubelet/pods/5d30d9b6-0431-47f2-b06c-8a03d4f59b97/volumes/kubernetes.io~projected/kube-api-access-96ckd major:0 minor:293 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/86312227-efeb-4196-ab2d-3b4b03e5c50f/volumes/kubernetes.io~secret/agent-certs:{mountpoint:/var/lib/kubelet/pods/86312227-efeb-4196-ab2d-3b4b03e5c50f/volumes/kubernetes.io~secret/agent-certs major:0 minor:55 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/88be474b-fd0b-4784-8f1c-2dc0bdfb2792/volumes/kubernetes.io~projected/kube-api-access-2ln8r:{mountpoint:/var/lib/kubelet/pods/88be474b-fd0b-4784-8f1c-2dc0bdfb2792/volumes/kubernetes.io~projected/kube-api-access-2ln8r major:0 minor:65 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/8a9e5aa4-f4fc-4b33-a925-8e63df6c9cd2/volumes/kubernetes.io~projected/kube-api-access-6tlzl:{mountpoint:/var/lib/kubelet/pods/8a9e5aa4-f4fc-4b33-a925-8e63df6c9cd2/volumes/kubernetes.io~projected/kube-api-access-6tlzl major:0 minor:212 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/8a9e5aa4-f4fc-4b33-a925-8e63df6c9cd2/volumes/kubernetes.io~secret/serving-cert:{mountpoint:/var/lib/kubelet/pods/8a9e5aa4-f4fc-4b33-a925-8e63df6c9cd2/volumes/kubernetes.io~secret/serving-cert major:0 minor:202 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/8e32277f-062d-4c16-81ca-b12e65b24fbb/volumes/kubernetes.io~projected/kube-api-access-5x4hs:{mountpoint:/var/lib/kubelet/pods/8e32277f-062d-4c16-81ca-b12e65b24fbb/volumes/kubernetes.io~projected/kube-api-access-5x4hs major:0 minor:215 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/8e32277f-062d-4c16-81ca-b12e65b24fbb/volumes/kubernetes.io~secret/serving-cert:{mountpoint:/var/lib/kubelet/pods/8e32277f-062d-4c16-81ca-b12e65b24fbb/volumes/kubernetes.io~secret/serving-cert major:0 minor:201 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/9179e3c5-ef52-4445-aec0-779c3e99cb07/volumes/kubernetes.io~secret/original-pull-secret:{mountpoint:/var/lib/kubelet/pods/9179e3c5-ef52-4445-aec0-779c3e99cb07/volumes/kubernetes.io~secret/original-pull-secret major:0 minor:288 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/9363fb38-792f-41a6-b6b3-d2c508fff328/volumes/kubernetes.io~projected/kube-api-access-t9n2j:{mountpoint:/var/lib/kubelet/pods/9363fb38-792f-41a6-b6b3-d2c508fff328/volumes/kubernetes.io~projected/kube-api-access-t9n2j major:0 minor:227 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/948f2c4e-81a5-4c0e-9ec9-f4fb56368b87/volumes/kubernetes.io~projected/kube-api-access-mkgtp:{mountpoint:/var/lib/kubelet/pods/948f2c4e-81a5-4c0e-9ec9-f4fb56368b87/volumes/kubernetes.io~projected/kube-api-access-mkgtp major:0 minor:339 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/9d9ecf7f-6a11-469b-8626-99d5ef7ffac7/volumes/kubernetes.io~projected/bound-sa-token:{mountpoint:/var/lib/kubelet/pods/9d9ecf7f-6a11-469b-8626-99d5ef7ffac7/volumes/kubernetes.io~projected/bound-sa-token major:0 minor:211 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/9d9ecf7f-6a11-469b-8626-99d5ef7ffac7/volumes/kubernetes.io~projected/kube-api-access-mgwcl:{mountpoint:/var/lib/kubelet/pods/9d9ecf7f-6a11-469b-8626-99d5ef7ffac7/volumes/kubernetes.io~projected/kube-api-access-mgwcl major:0 minor:225 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/9d9ecf7f-6a11-469b-8626-99d5ef7ffac7/volumes/kubernetes.io~secret/image-registry-private-configuration:{mountpoint:/var/lib/kubelet/pods/9d9ecf7f-6a11-469b-8626-99d5ef7ffac7/volumes/kubernetes.io~secret/image-registry-private-configuration major:0 minor:205 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/9d9ecf7f-6a11-469b-8626-99d5ef7ffac7/volumes/kubernetes.io~secret/installation-pull-secrets:{mountpoint:/var/lib/kubelet/pods/9d9ecf7f-6a11-469b-8626-99d5ef7ffac7/volumes/kubernetes.io~secret/installation-pull-secrets major:0 minor:203 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/a1bea244-6573-4e3c-9849-b27ade411c9f/volumes/kubernetes.io~projected/kube-api-access-vpl4m:{mountpoint:/var/lib/kubelet/pods/a1bea244-6573-4e3c-9849-b27ade411c9f/volumes/kubernetes.io~projected/kube-api-access-vpl4m major:0 minor:222 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/a26cba9f-c44a-405d-8e3d-de4bc5b6d6c0/volumes/kubernetes.io~projected/kube-api-access-rkfhx:{mountpoint:/var/lib/kubelet/pods/a26cba9f-c44a-405d-8e3d-de4bc5b6d6c0/volumes/kubernetes.io~projected/kube-api-access-rkfhx major:0 minor:328 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/a7959bdf-3723-4ee9-a587-6cd16e28d4b1/volumes/kubernetes.io~projected/kube-api-access-rbmtq:{mountpoint:/var/lib/kubelet/pods/a7959bdf-3723-4ee9-a587-6cd16e28d4b1/volumes/kubernetes.io~projected/kube-api-access-rbmtq major:0 minor:216 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/b1e258da-4619-478c-895a-041aa7eeafb6/volumes/kubernetes.io~projected/kube-api-access-ghqc6:{mountpoint:/var/lib/kubelet/pods/b1e258da-4619-478c-895a-041aa7eeafb6/volumes/kubernetes.io~projected/kube-api-access-ghqc6 major:0 minor:67 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/c390ea6f-c609-40f7-a9ec-53fd5c08d857/volumes/kubernetes.io~projected/kube-api-access-z57fk:{mountpoint:/var/lib/kubelet/pods/c390ea6f-c609-40f7-a9ec-53fd5c08d857/volumes/kubernetes.io~projected/kube-api-access-z57fk major:0 minor:219 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/c390ea6f-c609-40f7-a9ec-53fd5c08d857/volumes/kubernetes.io~secret/cert:{mountpoint:/var/lib/kubelet/pods/c390ea6f-c609-40f7-a9ec-53fd5c08d857/volumes/kubernetes.io~secret/cert major:0 minor:45 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/c915138c-9050-4958-b442-fee1aca9b002/volumes/kubernetes.io~projected/kube-api-access-6tqgx:{mountpoint:/var/lib/kubelet/pods/c915138c-9050-4958-b442-fee1aca9b002/volumes/kubernetes.io~projected/kube-api-access-6tqgx major:0 minor:66 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/d5856011-8f77-4e60-8ecc-c7ac852a50b0/volumes/kubernetes.io~projected/kube-api-access-j86wf:{mountpoint:/var/lib/kubelet/pods/d5856011-8f77-4e60-8ecc-c7ac852a50b0/volumes/kubernetes.io~projected/kube-api-access-j86wf major:0 minor:221 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/eaed4088-d322-48ab-af04-3c9efdea4e73/volumes/kubernetes.io~projected/kube-api-access-q9ctx:{mountpoint:/var/lib/kubelet/pods/eaed4088-d322-48ab-af04-3c9efdea4e73/volumes/kubernetes.io~projected/kube-api-access-q9ctx major:0 minor:59 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/ec682f92-b657-44bd-9e85-3cd4680d2f95/volumes/kubernetes.io~projected/kube-api-access-krrzb:{mountpoint:/var/lib/kubelet/pods/ec682f92-b657-44bd-9e85-3cd4680d2f95/volumes/kubernetes.io~projected/kube-api-access-krrzb major:0 minor:213 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/ef27850a-20b3-4876-8330-57e8954f1a79/volume-subpaths/run-systemd/ovnkube-controller/6:{mountpoint:/var/lib/kubelet/pods/ef27850a-20b3-4876-8330-57e8954f1a79/volume-subpaths/run-systemd/ovnkube-controller/6 major:0 minor:26 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/ef27850a-20b3-4876-8330-57e8954f1a79/volumes/kubernetes.io~projected/kube-api-access-69jvk:{mountpoint:/var/lib/kubelet/pods/ef27850a-20b3-4876-8330-57e8954f1a79/volumes/kubernetes.io~projected/kube-api-access-69jvk major:0 minor:64 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/ef27850a-20b3-4876-8330-57e8954f1a79/volumes/kubernetes.io~secret/ovn-node-metrics-cert:{mountpoint:/var/lib/kubelet/pods/ef27850a-20b3-4876-8330-57e8954f1a79/volumes/kubernetes.io~secret/ovn-node-metrics-cert major:0 minor:56 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/f03611db-3bd9-401a-a137-1d4f691b51ea/volumes/kubernetes.io~projected/kube-api-access-f88d4:{mountpoint:/var/lib/kubelet/pods/f03611db-3bd9-401a-a137-1d4f691b51ea/volumes/kubernetes.io~projected/kube-api-access-f88d4 major:0 minor:218 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/f03611db-3bd9-401a-a137-1d4f691b51ea/volumes/kubernetes.io~secret/serving-cert:{mountpoint:/var/lib/kubelet/pods/f03611db-3bd9-401a-a137-1d4f691b51ea/volumes/kubernetes.io~secret/serving-cert major:0 minor:204 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/fe1c5f7c-fdfd-40b9-bc0f-4e018779ee2b/volumes/kubernetes.io~projected/kube-api-access-b2ncn:{mountpoint:/var/lib/kubelet/pods/fe1c5f7c-fdfd-40b9-bc0f-4e018779ee2b/volumes/kubernetes.io~projected/kube-api-access-b2ncn major:0 minor:62 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/fef8c517-3be6-4cc1-908a-9e0116d8f978/volumes/kubernetes.io~projected/kube-api-access-kdg6k:{mountpoint:/var/lib/kubelet/pods/fef8c517-3be6-4cc1-908a-9e0116d8f978/volumes/kubernetes.io~projected/kube-api-access-kdg6k major:0 minor:333 fsType:tmpfs blockSize:0} composefs_0-34:{mountpoint:/ major:0 minor:34 fsType:overlay blockSize:0} overlay_0-100:{mountpoint:/var/lib/containers/storage/overlay/43452d60e7380fa791d9427c75c50a39629c06db6bab8cd412f0bd7950b1841b/merged major:0 minor:100 fsType:overlay blockSize:0} overlay_0-102:{mountpoint:/var/lib/containers/storage/overlay/8bbe70a9db3e8a07524817b939c144966111274c9ffdd73acbb6567f0c223e98/merged major:0 minor:102 fsType:overlay blockSize:0} overlay_0-104:{mountpoint:/var/lib/containers/storage/overlay/3392696a6313e1263c9d11adb00f5a34bb18679fa80bc98447fe081423198881/merged major:0 minor:104 fsType:overlay blockSize:0} overlay_0-106:{mountpoint:/var/lib/containers/storage/overlay/d75c821429f125af11b6c79974dcc96ed669a190bf46681b4bd2a84598566dd7/merged major:0 minor:106 fsType:overlay blockSize:0} overlay_0-114:{mountpoint:/var/lib/containers/storage/overlay/8316f7233407681e94d919871211f3de16500d1e32cbf75e92f4961a13546481/merged major:0 minor:114 fsType:overlay blockSize:0} overlay_0-119:{mountpoint:/var/lib/containers/storage/overlay/8d1feac1fd9019f820abbbdb56dc15f434a82a3d6a993d025b2e88b231c98b23/merged major:0 minor:119 fsType:overlay blockSize:0} overlay_0-124:{mountpoint:/var/lib/containers/storage/overlay/226f0417cbdeba700bd259b65e4a78ea00e9b4c70a86252d45ca61e7338d56f7/merged major:0 minor:124 fsType:overlay blockSize:0} overlay_0-127:{mountpoint:/var/lib/containers/storage/overlay/84105e2d2174d0f61567ae973f68ff6d09daa1a70d085e6e636be276ddd9f51a/merged major:0 minor:127 fsType:overlay blockSize:0} overlay_0-132:{mountpoint:/var/lib/containers/storage/overlay/465dce80167135b0f6b2d12cc3ef9e8d55e10f401b84a1daf17e61b3abbd8a34/merged major:0 minor:132 fsType:overlay blockSize:0} overlay_0-137:{mountpoint:/var/lib/containers/storage/overlay/9c54793cfd30cc7af4ed11f901b338cea7e1e50f92f8050e92f320a6cf6816a1/merged major:0 minor:137 fsType:overlay blockSize:0} overlay_0-142:{mountpoint:/var/lib/containers/storage/overlay/e19d95af762697af83b8b1c839f0371af45f508d5b073516bffbe94063558351/merged major:0 minor:142 fsType:overlay blockSize:0} overlay_0-144:{mountpoint:/var/lib/containers/storage/overlay/1f313a31cdb90cafac6e121d068b07f13d5b4fcc119d2ea1c2e0317d16a550c6/merged major:0 minor:144 fsType:overlay blockSize:0} overlay_0-149:{mountpoint:/var/lib/containers/storage/overlay/374d26870a0f20c2840ab0999161fb0325409c8b33b1460429f060a85b2c8954/merged major:0 minor:149 fsType:overlay blockSize:0} overlay_0-158:{mountpoint:/var/lib/containers/storage/overlay/639e466987bd8b0c8d7854044a23381e339ea520480fe9a456ec52e248e63319/merged major:0 minor:158 fsType:overlay blockSize:0} overlay_0-163:{mountpoint:/var/lib/containers/storage/overlay/7e0bd97836d12bd39e407eaea9172b2588d8cb28b341cf7d7f636ce91c496a99/merged major:0 minor:163 fsType:overlay blockSize:0} overlay_0-167:{mountpoint:/var/lib/containers/storage/overlay/577a594830dbd3e95aa828f299b837631eb71e44a239997aa6669cf2397c7282/merged major:0 minor:167 fsType:overlay blockSize:0} overlay_0-172:{mountpoint:/var/lib/containers/storage/overlay/0f9c2ee4c2db71413700340cda7330a114243efe5be82d146a8e72bb08b05138/merged major:0 minor:172 fsType:overlay blockSize:0} overlay_0-177:{mountpoint:/var/lib/containers/storage/overlay/087a0d143a06723232d6455eef19e66cabdfc961678668fd0dbe40f97febe3f0/merged major:0 minor:177 fsType:overlay blockSize:0} overlay_0-182:{mountpoint:/var/lib/containers/storage/overlay/2ae4c138cc634fb2096afcfa4b012edc0fab2c3563eef4298238a2f60428a481/merged major:0 minor:182 fsType:overlay blockSize:0} overlay_0-187:{mountpoint:/var/lib/containers/storage/overlay/3f587e42f05f571441de3649a82df6e747e0bd74b1f2b9e0bc8b07c19ff8b8e2/merged major:0 minor:187 fsType:overlay blockSize:0} overlay_0-192:{mountpoint:/var/lib/containers/storage/overlay/ef484945bfa3bb74317ee2c925efb7150ff9a4c2f7a886bae8b5b6b84ce156ab/merged major:0 minor:192 fsType:overlay blockSize:0} overlay_0-248:{mountpoint:/var/lib/containers/storage/overlay/895372bde2bb434372ee33c49d9e354ec1402479bbd368421c3aa39822aaf08d/merged major:0 minor:248 fsType:overlay blockSize:0} overlay_0-250:{mountpoint:/var/lib/containers/storage/overlay/071724e313575aa3740fb992cd9d62bd762ab3496de3c0cc9fc0d0a197b8757a/merged major:0 minor:250 fsType:overlay blockSize:0} overlay_0-252:{mountpoint:/var/lib/containers/storage/overlay/22606be2f605d79989ffc3990b8e108e5686993a6dc2d07911870affc9249e4d/merged major:0 minor:252 fsType:overlay blockSize:0} overlay_0-254:{mountpoint:/var/lib/containers/storage/overlay/73168445d7f2d20cbef8dc869045e1d4ea95b993f48c717149c805c3dbc581f2/merged major:0 minor:254 fsType:overlay blockSize:0} overlay_0-256:{mountpoint:/var/lib/containers/storage/overlay/a8353e804e426483d4150d81eb80cbc87aa0657c23fb90834a83c96b41dd9dfc/merged major:0 minor:256 fsType:overlay blockSize:0} overlay_0-258:{mountpoint:/var/lib/containers/storage/overlay/2f0efd5c444a0463b500947ceee14b346df0e4a7087dab7d513a41658216b0fd/merged major:0 minor:258 fsType:overlay blockSize:0} overlay_0-260:{mountpoint:/var/lib/containers/storage/overlay/0ae8975031361100b3fac7a416e0f921b9ae43a8d021da8ca3606cb7c8a866b2/merged major:0 minor:260 fsType:overlay blockSize:0} overlay_0-261:{mountpoint:/var/lib/containers/storage/overlay/b4d2c25095f1963179fc4b286f42671526789db417abfdd4df86f9061d5fc9ae/merged major:0 minor:261 fsType:overlay blockSize:0} overlay_0-263:{mountpoint:/var/lib/containers/storage/overlay/52202a9f1628c379dc9635554cfccf3888daefabd95c92e64eb769ab23949f14/merged major:0 minor:263 fsType:overlay blockSize:0} overlay_0-265:{mountpoint:/var/lib/containers/storage/overlay/b715976b3be2ad616d4b38bb50c2871659e9b56a642aa60ca92bbf173ae6c219/merged major:0 minor:265 fsType:overlay blockSize:0} overlay_0-274:{mountpoint:/var/lib/containers/storage/overlay/e773fdf356a4fd9119cc2f292c06dd22642a97e9de1ce3b40bba591adce4302c/merged major:0 minor:274 fsType:overlay blockSize:0} overlay_0-276:{mountpoint:/var/lib/containers/storage/overlay/d740b2d5da9ca7077d5c3ff1e63c3a72c2da25a674bd7f53246bb831e86ce72b/merged major:0 minor:276 fsType:overlay blockSize:0} overlay_0-280:{mountpoint:/var/lib/containers/storage/overlay/0289f3c6bcc16bd0dbe5c92e46f05f603efbf751ee781eb3215562bd32cb6400/merged major:0 minor:280 fsType:overlay blockSize:0} overlay_0-282:{mountpoint:/var/lib/containers/storage/overlay/465c56f262992d4721e67afccadc04c52f1d6c43cdd805b2158dc05406374660/merged major:0 minor:282 fsType:overlay blockSize:0} overlay_0-294:{mountpoint:/var/lib/containers/storage/overlay/3cc70399de1e67c23bb9652c9d48a60e3a9d5c42eaa120603fb2ddd947ff23da/merged major:0 minor:294 fsType:overlay blockSize:0} overlay_0-297:{mountpoint:/var/lib/containers/storage/overlay/424f3488b72bcc9127f9cd2035a5a1a1e628b674faf49cb4846e86e400dd05da/merged major:0 minor:297 fsType:overlay blockSize:0} overlay_0-299:{mountpoint:/var/lib/containers/storage/overlay/4149a9cad5dfe42b6bc5fda77477dc51453145d0faca3c1e5ddf0aaeadec9ad5/merged major:0 minor:299 fsType:overlay blockSize:0} overlay_0-304:{mountpoint:/var/lib/containers/storage/overlay/9f4abd1d2ff1d42c2d620c8d1ed0629073985fb36b6c577ae8591450161c6af2/merged major:0 minor:304 fsType:overlay blockSize:0} overlay_0-306:{mountpoint:/var/lib/containers/storage/overlay/b74085419a51dfd6cba951fc1934ed804e911c45ffd3ed5f7a06a921efbd0478/merged major:0 minor:306 fsType:overlay blockSize:0} overlay_0-307:{mountpoint:/var/lib/containers/storage/overlay/ed1e7e8def80ace978899a29ebd89606c1bb05b2c184f249b7804e137843a3f9/merged major:0 minor:307 fsType:overlay blockSize:0} overlay_0-310:{mountpoint:/var/lib/containers/storage/overlay/c0ba79589f27fe57f001ceef7268f44cda3f8aaf63653c23d0fd2cba89053d6a/merged major:0 minor:310 fsType:overlay blockSize:0} overlay_0-340:{mountpoint:/var/lib/containers/storage/overlay/02b69e81710ce4d26a922f7ecedd29ca764f1451ea8c381a95e03dba1cea333e/merged major:0 minor:340 fsType:overlay blockSize:0} overlay_0-344:{mountpoint:/var/lib/containers/storage/overlay/2f1fa1393d613b302d8640a805efc4dba041f1ee5a42153b6c03df841c724d89/merged major:0 minor:344 fsType:overlay blockSize:0} overlay_0-346:{mountpoint:/var/lib/containers/storage/overlay/d2920fb6b366a06a207b7c550e6d4766ad797666453784f7899e85fb8935a46f/merged major:0 minor:346 fsType:overlay blockSize:0} overlay_0-348:{mountpoint:/var/lib/containers/storage/overlay/a24a5ed2e58efdaffd98e6d8528bc4631bb64566abb161787de8d0e92218a6df/merged major:0 minor:348 fsType:overlay blockSize:0} overlay_0-350:{mountpoint:/var/lib/containers/storage/overlay/39adf0ad06f24d46d292a72c2bdbe8d595da3d67ac55d32bd4714af13ca01a37/merged major:0 minor:350 fsType:overlay blockSize:0} overlay_0-356:{mountpoint:/var/lib/containers/storage/overlay/0228ddee599fa3249bde5ef4c02237ca12fc9c5dc901626866322d2686922a62/merged major:0 minor:356 fsType:overlay blockSize:0} overlay_0-362:{mountpoint:/var/lib/containers/storage/overlay/f06fb857f1a2b1f577ffd4987f7ad817fdb37f2f7cd08f4a1a8429160e3a9db1/merged major:0 minor:362 fsType:overlay blockSize:0} overlay_0-368:{mountpoint:/var/lib/containers/storage/overlay/873c6d4c1168f8f17ca2339c4552309275121ef8e6461faf6890ee6193c585a9/merged major:0 minor:368 fsType:overlay blockSize:0} overlay_0-51:{mountpoint:/var/lib/containers/storage/overlay/91cea01eb0731fe0c663baea1e2c1316146b842ee7047c1aab28517e60180bd4/merged major:0 minor:51 fsType:overlay blockSize:0} overlay_0-53:{mountpoint:/var/lib/containers/storage/overlay/73cf4f7a9507c4a1b88d09b51febb687bd1d224f5f96e2e70538c87d6927b90b/merged major:0 minor:53 fsType:overlay blockSize:0} overlay_0-70:{mountpoint:/var/lib/containers/storage/overlay/2ab49d2e32614b8a717c3895c1b3ca8787c33ca8e4bf23878e5e9e0464890dea/merged major:0 minor:70 fsType:overlay blockSize:0} overlay_0-74:{mountpoint:/var/lib/containers/storage/overlay/c9e6c3c0250611dc391ed033188072d7e23ef7894a76c78e9036bd8fc20b89d7/merged major:0 minor:74 fsType:overlay blockSize:0} overlay_0-78:{mountpoint:/var/lib/containers/storage/overlay/b4b28e08271a990e2e2cc939eb9645ef8fa3ca2f59a45db10b1c9d63dfb81fa6/merged major:0 minor:78 fsType:overlay blockSize:0} overlay_0-82:{mountpoint:/var/lib/containers/storage/overlay/6bdd1aa39a25159190961fed3f7612b364d4a82c2674a658cbfab50446039792/merged major:0 minor:82 fsType:overlay blockSize:0} overlay_0-86:{mountpoint:/var/lib/containers/storage/overlay/f74d7f230a85611f322e759bd9518fc24dd8b4a540cbea023f7d3edc61b3abde/merged major:0 minor:86 fsType:overlay blockSize:0} overlay_0-88:{mountpoint:/var/lib/containers/storage/overlay/65b1e91576211b188945e62e12363b6e6b15e6d3750dbf083564176a30135746/merged major:0 minor:88 fsType:overlay blockSize:0} overlay_0-92:{mountpoint:/var/lib/containers/storage/overlay/ccff929db8c6ef6a4e42d51269c63a6fffa5f57cc23517744177714c2e02e16c/merged major:0 minor:92 fsType:overlay blockSize:0} overlay_0-96:{mountpoint:/var/lib/containers/storage/overlay/81d701edb7708fadce28743a78f0a64a2a5c7c529a3f35e5cc8519e91bde9517/merged major:0 minor:96 fsType:overlay blockSize:0}]
Oct 31 17:27:11.827766 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.827051    5003 manager.go:217] Machine: {Timestamp:2026-10-31 17:27:11.82656819 +0000 UTC m=+0.081422724 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100514 MemoryCapacity:33164328960 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2ab9df76a2e3169ad6668cd72c4ff8 SystemUUID:ec2ab9df-76a2-e316-9ad6-668cd72c4ff8 BootID:4342a198-8e47-449d-b470-fc4bf58703b3 Filesystems:[{Device:overlay_0-294 DeviceMajor:0 DeviceMinor:294 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-297 DeviceMajor:0 DeviceMinor:297 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-104 DeviceMajor:0 DeviceMinor:104 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/9845958ca43d987b6dc426bbe0514c2e3607c94dc1d6242590e450b8fa1ae20a/userdata/shm DeviceMajor:0 DeviceMinor:240 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-250 DeviceMajor:0 DeviceMinor:250 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/0c8a8a3b-14dd-45c9-b8fb-baf967142fd6/volumes/kubernetes.io~empty-dir/etc-tuned DeviceMajor:0 DeviceMinor:58 Capacity:31985729536 Type:vfs Inodes:4048380 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:overlay_0-177 DeviceMajor:0 DeviceMinor:177 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/eaed4088-d322-48ab-af04-3c9efdea4e73/volumes/kubernetes.io~projected/kube-api-access-q9ctx DeviceMajor:0 DeviceMinor:59 Capacity:31985729536 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-92 DeviceMajor:0 DeviceMinor:92 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/8e32277f-062d-4c16-81ca-b12e65b24fbb/volumes/kubernetes.io~secret/serving-cert DeviceMajor:0 DeviceMinor:201 Capacity:31985729536 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/50e82975-3344-4653-8de3-68e8a64a8757/volumes/kubernetes.io~secret/default-certificate DeviceMajor:0 DeviceMinor:208 Capacity:31985729536 Type:vfs Inodes:4048380 HasInodes:true} {Device:/run/containers/storage/overlay-containers/75e7934ec6e3158727778643e8e4d10cb6bd24556a488c337e5dd699ab3c17c6/userdata/shm DeviceMajor:0 DeviceMinor:242 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-263 DeviceMajor:0 DeviceMinor:263 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-114 DeviceMajor:0 DeviceMinor:114 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/c390ea6f-c609-40f7-a9ec-53fd5c08d857/volumes/kubernetes.io~projected/kube-api-access-z57fk DeviceMajor:0 DeviceMinor:219 Capacity:31985729536 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/9363fb38-792f-41a6-b6b3-d2c508fff328/volumes/kubernetes.io~projected/kube-api-access-t9n2j DeviceMajor:0 DeviceMinor:227 Capacity:31985729536 Type:vfs Inodes:4048380 HasInodes:true} {Device:/run/containers/storage/overlay-containers/dd6895944d74abbe426d24ba35505f7fa7f4aa9f7af9f66783e6e82e4a746087/userdata/shm DeviceMajor:0 DeviceMinor:301 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/26373302-592f-4fd5-bd54-7ac57ef19bfd/volumes/kubernetes.io~projected/kube-api-access-v5x5x DeviceMajor:0 DeviceMinor:210 Capacity:31985729536 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-78 DeviceMajor:0 DeviceMinor:78 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/40e2493e3e7332fd3069f87c72eaaf0f1beaf1beaed3c950a6b9c150baa48160/userdata/shm DeviceMajor:0 DeviceMinor:80 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:/run/containers/storage/overlay-containers/e58c6a3710855022ae8b11167e0001480ccb26ed614ee6d6105468766fa9f00f/userdata/shm DeviceMajor:0 DeviceMinor:47 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/86312227-efeb-4196-ab2d-3b4b03e5c50f/volumes/kubernetes.io~secret/agent-certs DeviceMajor:0 DeviceMinor:55 Capacity:31985729536 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/170ada34-8944-43d2-bcfb-1d782aae5348/volumes/kubernetes.io~projected/kube-api-access-h6b47 DeviceMajor:0 DeviceMinor:223 Capacity:31985729536 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-260 DeviceMajor:0 DeviceMinor:260 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-340 DeviceMajor:0 DeviceMinor:340 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-348 DeviceMajor:0 DeviceMinor:348 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/27af0f99-138f-42ac-89b9-9dfc4a522483/volumes/kubernetes.io~projected/kube-api-access-c6ctd DeviceMajor:0 DeviceMinor:61 Capacity:31985729536 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/a1bea244-6573-4e3c-9849-b27ade411c9f/volumes/kubernetes.io~projected/kube-api-access-vpl4m DeviceMajor:0 DeviceMinor:222 Capacity:31985729536 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-282 DeviceMajor:0 DeviceMinor:282 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-119 DeviceMajor:0 DeviceMinor:119 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-182 DeviceMajor:0 DeviceMinor:182 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/8a9e5aa4-f4fc-4b33-a925-8e63df6c9cd2/volumes/kubernetes.io~projected/kube-api-access-6tlzl DeviceMajor:0 DeviceMinor:212 Capacity:31985729536 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/8e32277f-062d-4c16-81ca-b12e65b24fbb/volumes/kubernetes.io~projected/kube-api-access-5x4hs DeviceMajor:0 DeviceMinor:215 Capacity:31985729536 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-261 DeviceMajor:0 DeviceMinor:261 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/0c8a8a3b-14dd-45c9-b8fb-baf967142fd6/volumes/kubernetes.io~empty-dir/tmp DeviceMajor:0 DeviceMinor:57 Capacity:31985729536 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-86 DeviceMajor:0 DeviceMinor:86 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-299 DeviceMajor:0 DeviceMinor:299 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-127 DeviceMajor:0 DeviceMinor:127 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/c390ea6f-c609-40f7-a9ec-53fd5c08d857/volumes/kubernetes.io~secret/cert DeviceMajor:0 DeviceMinor:45 Capacity:31985729536 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/f03611db-3bd9-401a-a137-1d4f691b51ea/volumes/kubernetes.io~secret/serving-cert DeviceMajor:0 DeviceMinor:204 Capacity:31985729536 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/d5856011-8f77-4e60-8ecc-c7ac852a50b0/volumes/kubernetes.io~projected/kube-api-access-j86wf DeviceMajor:0 DeviceMinor:221 Capacity:31985729536 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-82 DeviceMajor:0 DeviceMinor:82 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-106 DeviceMajor:0 DeviceMinor:106 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/fef8c517-3be6-4cc1-908a-9e0116d8f978/volumes/kubernetes.io~projected/kube-api-access-kdg6k DeviceMajor:0 DeviceMinor:333 Capacity:31985729536 Type:vfs Inodes:4048380 HasInodes:true} {Device:/run/containers/storage/overlay-containers/84e91389e75f52e3c36f05f68c789da4e3570d436b54dd1bc940548f53db651d/userdata/shm DeviceMajor:0 DeviceMinor:336 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-276 DeviceMajor:0 DeviceMinor:276 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/5d38c987e34445d1bde0bbf11d39b3fa047cdab3266f8e91c79dc0dc0111126d/userdata/shm DeviceMajor:0 DeviceMinor:72 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:/run/containers/storage/overlay-containers/c6761ad57d4350d67c2dcce2c32cae91de22b1f0ec08230216d28a39fb381e49/userdata/shm DeviceMajor:0 DeviceMinor:94 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-142 DeviceMajor:0 DeviceMinor:142 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/170ada34-8944-43d2-bcfb-1d782aae5348/volumes/kubernetes.io~secret/installation-pull-secrets DeviceMajor:0 DeviceMinor:207 Capacity:31985729536 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/170ada34-8944-43d2-bcfb-1d782aae5348/volumes/kubernetes.io~secret/image-registry-private-configuration DeviceMajor:0 DeviceMinor:209 Capacity:31985729536 Type:vfs Inodes:4048380 HasInodes:true} {Device:/run/containers/storage/overlay-containers/199e372bc14f6d1835767bbf1d713534986731696ef08b89fcb16220f2b382d1/userdata/shm DeviceMajor:0 DeviceMinor:238 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-350 DeviceMajor:0 DeviceMinor:350 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/b1e258da-4619-478c-895a-041aa7eeafb6/volumes/kubernetes.io~projected/kube-api-access-ghqc6 DeviceMajor:0 DeviceMinor:67 Capacity:31985729536 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/ef27850a-20b3-4876-8330-57e8954f1a79/volumes/kubernetes.io~secret/ovn-node-metrics-cert DeviceMajor:0 DeviceMinor:56 Capacity:31985729536 Type:vfs Inodes:4048380 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:26 Capacity:6632865792 Type:vfs Inodes:819200 HasInodes:true} {Device:/var/lib/kubelet/pods/9d9ecf7f-6a11-469b-8626-99d5ef7ffac7/volumes/kubernetes.io~secret/installation-pull-secrets DeviceMajor:0 DeviceMinor:203 Capacity:31985729536 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/9d9ecf7f-6a11-469b-8626-99d5ef7ffac7/volumes/kubernetes.io~projected/kube-api-access-mgwcl DeviceMajor:0 DeviceMinor:225 Capacity:31985729536 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/0c8a8a3b-14dd-45c9-b8fb-baf967142fd6/volumes/kubernetes.io~projected/kube-api-access-h4fpf DeviceMajor:0 DeviceMinor:63 Capacity:31985729536 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-88 DeviceMajor:0 DeviceMinor:88 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-137 DeviceMajor:0 DeviceMinor:137 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-254 DeviceMajor:0 DeviceMinor:254 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/948f2c4e-81a5-4c0e-9ec9-f4fb56368b87/volumes/kubernetes.io~projected/kube-api-access-mkgtp DeviceMajor:0 DeviceMinor:339 Capacity:31985729536 Type:vfs Inodes:4048380 HasInodes:true} {Device:/run/containers/storage/overlay-containers/bb0a00d4ae5cd9e352236bf7586fda56ae4091a154dba55bc35b663ed7bc06ce/userdata/shm DeviceMajor:0 DeviceMinor:48 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:/run/containers/storage/overlay-containers/e22c0522d326cbf89fef59bf03aad4739e006f0a5b39b49538ee85190d4e0d72/userdata/shm DeviceMajor:0 DeviceMinor:76 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-144 DeviceMajor:0 DeviceMinor:144 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/2330cbe7-498c-4f39-ba1b-3873e125dd18/volumes/kubernetes.io~projected/kube-api-access-6vzgd DeviceMajor:0 DeviceMinor:224 Capacity:31985729536 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-356 DeviceMajor:0 DeviceMinor:356 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-362 DeviceMajor:0 DeviceMinor:362 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-192 DeviceMajor:0 DeviceMinor:192 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/a7959bdf-3723-4ee9-a587-6cd16e28d4b1/volumes/kubernetes.io~projected/kube-api-access-rbmtq DeviceMajor:0 DeviceMinor:216 Capacity:31985729536 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/3aa3a055-ec26-4d70-bb04-d6a09abe6661/volumes/kubernetes.io~projected/kube-api-access-crrdz DeviceMajor:0 DeviceMinor:338 Capacity:31985729536 Type:vfs Inodes:4048380 HasInodes:true} {Device:/run/containers/storage/overlay-containers/887e4ba8e2f1819c14acae40c084561bb0e14797214b98b1f721f46071a2bc2c/userdata/shm DeviceMajor:0 DeviceMinor:84 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-172 DeviceMajor:0 DeviceMinor:172 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-248 DeviceMajor:0 DeviceMinor:248 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-280 DeviceMajor:0 DeviceMinor:280 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-74 DeviceMajor:0 DeviceMinor:74 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/0dea90a26434f8f6217f8618985f915fb0f73f4b017c635d9240a0b1ca615e8f/userdata/shm DeviceMajor:0 DeviceMinor:236 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:/run/containers/storage/overlay-containers/ccaf9147bedffeecc2ec62a1f12370b33c20b2b6e4eddd1abaa0444d5431fefa/userdata/shm DeviceMajor:0 DeviceMinor:244 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-368 DeviceMajor:0 DeviceMinor:368 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/88be474b-fd0b-4784-8f1c-2dc0bdfb2792/volumes/kubernetes.io~projected/kube-api-access-2ln8r DeviceMajor:0 DeviceMinor:65 Capacity:31985729536 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-167 DeviceMajor:0 DeviceMinor:167 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-187 DeviceMajor:0 DeviceMinor:187 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-53 DeviceMajor:0 DeviceMinor:53 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-149 DeviceMajor:0 DeviceMinor:149 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-163 DeviceMajor:0 DeviceMinor:163 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-304 DeviceMajor:0 DeviceMinor:304 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-96 DeviceMajor:0 DeviceMinor:96 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:32 Capacity:16582164480 Type:vfs Inodes:1048576 HasInodes:true} {Device:/run/containers/storage/overlay-containers/4e687914b465652caf2648448b13281d69a723f780957e2fc30f8fa75b8a7f0f/userdata/shm DeviceMajor:0 DeviceMinor:334 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/ec682f92-b657-44bd-9e85-3cd4680d2f95/volumes/kubernetes.io~projected/kube-api-access-krrzb DeviceMajor:0 DeviceMinor:213 Capacity:31985729536 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/170ada34-8944-43d2-bcfb-1d782aae5348/volumes/kubernetes.io~projected/bound-sa-token DeviceMajor:0 DeviceMinor:220 Capacity:31985729536 Type:vfs Inodes:4048380 HasInodes:true} {Device:/run/containers/storage/overlay-containers/c75845d8ebe4c7da50fed94b6455e5612f288c07a0727d2e44903bfce28fe571/userdata/shm DeviceMajor:0 DeviceMinor:234 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-274 DeviceMajor:0 DeviceMinor:274 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-306 DeviceMajor:0 DeviceMinor:306 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-344 DeviceMajor:0 DeviceMinor:344 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-51 DeviceMajor:0 DeviceMinor:51 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-132 DeviceMajor:0 DeviceMinor:132 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-307 DeviceMajor:0 DeviceMinor:307 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/a26cba9f-c44a-405d-8e3d-de4bc5b6d6c0/volumes/kubernetes.io~projected/kube-api-access-rkfhx DeviceMajor:0 DeviceMinor:328 Capacity:31985729536 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/c915138c-9050-4958-b442-fee1aca9b002/volumes/kubernetes.io~projected/kube-api-access-6tqgx DeviceMajor:0 DeviceMinor:66 Capacity:31985729536 Type:vfs Inodes:4048380 HasInodes:true} {Device:/run/containers/storage/overlay-containers/ae6a674b56f493935c53ae0614e6db8e6328dc6f28f16e6f2803962175d16e00/userdata/shm DeviceMajor:0 DeviceMinor:68 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/ef27850a-20b3-4876-8330-57e8954f1a79/volume-subpaths/run-systemd/ovnkube-controller/6 DeviceMajor:0 DeviceMinor:26 Capacity:6632865792 Type:vfs Inodes:819200 HasInodes:true} {Device:/run/containers/storage/overlay-containers/83af66c7b7be1e89a549e9b361de40c83021477f0bfd5b909a56b53d6f5337ba/userdata/shm DeviceMajor:0 DeviceMinor:246 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-256 DeviceMajor:0 DeviceMinor:256 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-258 DeviceMajor:0 DeviceMinor:258 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/b04372cdde747c31b9ddfaba1b1dec47cf42e7045d4e8970634373c035dc2f89/userdata/shm DeviceMajor:0 DeviceMinor:342 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-346 DeviceMajor:0 DeviceMinor:346 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/8a9e5aa4-f4fc-4b33-a925-8e63df6c9cd2/volumes/kubernetes.io~secret/serving-cert DeviceMajor:0 DeviceMinor:202 Capacity:31985729536 Type:vfs Inodes:4048380 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:24 Capacity:16582164480 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/ef27850a-20b3-4876-8330-57e8954f1a79/volumes/kubernetes.io~projected/kube-api-access-69jvk DeviceMajor:0 DeviceMinor:64 Capacity:31985729536 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-70 DeviceMajor:0 DeviceMinor:70 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/9fa0667db86191a2451edf4dbe67513a34fc2240fa69790b1f98bac9fcaac48a/userdata/shm DeviceMajor:0 DeviceMinor:90 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/2330cbe7-498c-4f39-ba1b-3873e125dd18/volumes/kubernetes.io~secret/serving-cert DeviceMajor:0 DeviceMinor:197 Capacity:31985729536 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/9d9ecf7f-6a11-469b-8626-99d5ef7ffac7/volumes/kubernetes.io~secret/image-registry-private-configuration DeviceMajor:0 DeviceMinor:205 Capacity:31985729536 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/f03611db-3bd9-401a-a137-1d4f691b51ea/volumes/kubernetes.io~projected/kube-api-access-f88d4 DeviceMajor:0 DeviceMinor:218 Capacity:31985729536 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/5d30d9b6-0431-47f2-b06c-8a03d4f59b97/volumes/kubernetes.io~projected/kube-api-access-96ckd DeviceMajor:0 DeviceMinor:293 Capacity:31985729536 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/449efcb2-6707-4809-b869-1bb477f6e6ae/volumes/kubernetes.io~projected/kube-api-access-cq4kh DeviceMajor:0 DeviceMinor:60 Capacity:31985729536 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-100 DeviceMajor:0 DeviceMinor:100 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/25ad5c67-f563-4653-9e86-7e9ecbe78675/volumes/kubernetes.io~projected/kube-api-access-kqpvj DeviceMajor:0 DeviceMinor:226 Capacity:31985729536 Type:vfs Inodes:4048380 HasInodes:true} {Device:/run/containers/storage/overlay-containers/d7a09902a067c1ac1a86baee212c117b772da95dfc4dc1fb3607c960bc30f8cf/userdata/shm DeviceMajor:0 DeviceMinor:228 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:/run/containers/storage/overlay-containers/c2338ea0da8ffd495897336bb22c7427577acf2382e1c3e4b5b0e9758b07fb2a/userdata/shm DeviceMajor:0 DeviceMinor:230 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/9179e3c5-ef52-4445-aec0-779c3e99cb07/volumes/kubernetes.io~secret/original-pull-secret DeviceMajor:0 DeviceMinor:288 Capacity:31985729536 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-102 DeviceMajor:0 DeviceMinor:102 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/340f062e-e599-4620-87d1-c5be0bb1b319/volumes/kubernetes.io~projected/kube-api-access-j26t9 DeviceMajor:0 DeviceMinor:214 Capacity:31985729536 Type:vfs Inodes:4048380 HasInodes:true} {Device:/run/containers/storage/overlay-containers/634f4ff5412ec8396e0ea23004b3855bfff910b7e4d092e2e525d339a14c9b1e/userdata/shm DeviceMajor:0 DeviceMinor:296 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/fe1c5f7c-fdfd-40b9-bc0f-4e018779ee2b/volumes/kubernetes.io~projected/kube-api-access-b2ncn DeviceMajor:0 DeviceMinor:62 Capacity:31985729536 Type:vfs Inodes:4048380 HasInodes:true} {Device:composefs_0-34 DeviceMajor:0 DeviceMinor:34 Capacity:6422528 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/var/lib/kubelet/pods/50e82975-3344-4653-8de3-68e8a64a8757/volumes/kubernetes.io~projected/kube-api-access-ngvv2 DeviceMajor:0 DeviceMinor:217 Capacity:31985729536 Type:vfs Inodes:4048380 HasInodes:true} {Device:/run/containers/storage/overlay-containers/55c24e9e35b3f3455301939fd9cf68e6a7756ba200158846632ae9c027f11501/userdata/shm DeviceMajor:0 DeviceMinor:232 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-265 DeviceMajor:0 DeviceMinor:265 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-124 DeviceMajor:0 DeviceMinor:124 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-158 DeviceMajor:0 DeviceMinor:158 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/9d9ecf7f-6a11-469b-8626-99d5ef7ffac7/volumes/kubernetes.io~projected/bound-sa-token DeviceMajor:0 DeviceMinor:211 Capacity:31985729536 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-310 DeviceMajor:0 DeviceMinor:310 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/b1f7975c4fe44754cfb8a3963b2147f41bd63a3578974932c73f851106b5a047/userdata/shm DeviceMajor:0 DeviceMinor:98 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/50e82975-3344-4653-8de3-68e8a64a8757/volumes/kubernetes.io~secret/stats-auth DeviceMajor:0 DeviceMinor:206 Capacity:31985729536 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-252 DeviceMajor:0 DeviceMinor:252 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:0dea90a26434f8f MacAddress:36:96:70:2e:d8:6e Speed:10000 Mtu:8901} {Name:199e372bc14f6d1 MacAddress:76:e9:5b:0a:64:d0 Speed:10000 Mtu:8901} {Name:4e687914b465652 MacAddress:5a:02:cf:24:b0:2c Speed:10000 Mtu:8901} {Name:55c24e9e35b3f34 MacAddress:1a:06:6c:1b:34:5b Speed:10000 Mtu:8901} {Name:634f4ff5412ec83 MacAddress:de:92:d5:e2:85:8e Speed:10000 Mtu:8901} {Name:75e7934ec6e3158 MacAddress:c2:62:aa:d2:db:e4 Speed:10000 Mtu:8901} {Name:83af66c7b7be1e8 MacAddress:56:fd:b9:94:0f:d3 Speed:10000 Mtu:8901} {Name:84e91389e75f52e MacAddress:6e:2b:07:68:ae:68 Speed:10000 Mtu:8901} {Name:9845958ca43d987 MacAddress:ae:4a:30:57:5c:ef Speed:10000 Mtu:8901} {Name:b04372cdde747c3 MacAddress:c6:18:fe:b3:07:59 Speed:10000 Mtu:8901} {Name:br-ex MacAddress:02:ff:de:a1:6e:7f Speed:0 Mtu:9001} {Name:br-int MacAddress:d2:d8:9f:40:10:67 Speed:0 Mtu:8901} {Name:c2338ea0da8ffd4 MacAddress:22:ca:f8:57:89:85 Speed:10000 Mtu:8901} {Name:c75845d8ebe4c7d MacAddress:12:f5:a9:24:46:51 Speed:10000 Mtu:8901} {Name:ccaf9147bedffee MacAddress:72:7d:5f:7a:29:28 Speed:10000 Mtu:8901} {Name:d7a09902a067c1a MacAddress:a2:e6:c6:1e:de:14 Speed:10000 Mtu:8901} {Name:dd6895944d74abb MacAddress:66:be:0f:b5:57:7f Speed:10000 Mtu:8901} {Name:ens5 MacAddress:02:ff:de:a1:6e:7f Speed:0 Mtu:9001} {Name:genev_sys_6081 MacAddress:6a:15:60:d8:2c:ba Speed:0 Mtu:65000} {Name:ovn-k8s-mp0 MacAddress:0a:58:0a:84:00:02 Speed:0 Mtu:8901} {Name:ovs-system MacAddress:aa:05:aa:52:60:51 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164328960 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Oct 31 17:27:11.827766 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.827450    5003 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Oct 31 17:27:11.827766 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.827497    5003 manager.go:233] Version: {KernelVersion:5.14.0-687.60.1.el9_8.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.8.20261023-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Oct 31 17:27:11.828007 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.827829    5003 container_manager_linux.go:275] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Oct 31 17:27:11.828007 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.827855    5003 container_manager_linux.go:280] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-138-17.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"/system.slice","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{},"system-reserved-compressible":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Oct 31 17:27:11.828007 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.827986    5003 topology_manager.go:143] "Creating topology manager with none policy"
Oct 31 17:27:11.828007 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.827994    5003 container_manager_linux.go:311] "Creating device plugin manager"
Oct 31 17:27:11.828007 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.828005    5003 manager.go:144] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Oct 31 17:27:11.828141 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.828019    5003 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Oct 31 17:27:11.828141 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.828038    5003 container_manager_linux.go:320] "Creating Dynamic Resource Allocation (DRA) manager"
Oct 31 17:27:11.828237 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.828226    5003 state_mem.go:41] "Initialized" logger="CPUManager state memory"
Oct 31 17:27:11.828353 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.828343    5003 server.go:1235] "Using root directory" path="/var/lib/kubelet"
Oct 31 17:27:11.828394 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.828385    5003 kubelet.go:493] "Attempting to sync node with API server"
Oct 31 17:27:11.828427 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.828399    5003 kubelet.go:394] "Adding static pod path" path="/etc/kubernetes/manifests"
Oct 31 17:27:11.828427 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.828410    5003 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Oct 31 17:27:11.828427 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.828420    5003 kubelet.go:405] "Adding apiserver pod source"
Oct 31 17:27:11.828540 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.828428    5003 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Oct 31 17:27:11.829541 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.829521    5003 state_checkpoint.go:81] "State checkpoint: restored pod resource state from checkpoint"
Oct 31 17:27:11.829541 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.829539    5003 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Oct 31 17:27:11.830120 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.830065    5003 kuberuntime_manager.go:304] "Container runtime initialized" containerRuntime="cri-o" version="1.35.10-3.rhaos4.22.git9383502.el9" apiVersion="v1"
Oct 31 17:27:11.832502 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.832488    5003 state_checkpoint.go:81] "State checkpoint: restored pod resource state from checkpoint"
Oct 31 17:27:11.832547 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.832503    5003 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Oct 31 17:27:11.832614 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.832605    5003 certificate_store.go:147] "Loading cert/key pair from a file" filePath="/var/lib/kubelet/pki/kubelet-server-current.pem"
Oct 31 17:27:11.832835 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.832823    5003 kubelet.go:963] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Oct 31 17:27:11.832867 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.832854    5003 kubelet.go:990] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Oct 31 17:27:11.833001 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.832987    5003 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Oct 31 17:27:11.833036 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.833014    5003 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Oct 31 17:27:11.833036 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.833028    5003 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Oct 31 17:27:11.833088 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.833042    5003 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Oct 31 17:27:11.833088 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.833055    5003 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Oct 31 17:27:11.833088 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.833081    5003 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Oct 31 17:27:11.833175 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.833094    5003 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Oct 31 17:27:11.833175 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.833108    5003 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Oct 31 17:27:11.833175 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.833122    5003 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Oct 31 17:27:11.833175 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.833135    5003 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Oct 31 17:27:11.833175 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.833162    5003 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Oct 31 17:27:11.833307 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.833182    5003 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Oct 31 17:27:11.833307 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.833232    5003 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Oct 31 17:27:11.833307 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.833245    5003 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Oct 31 17:27:11.837000 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.836987    5003 server.go:1263] "Started kubelet"
Oct 31 17:27:11.837461 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.837112    5003 server.go:182] "Starting to listen" address="0.0.0.0" port=10250
Oct 31 17:27:11.838090 ip-10-0-138-17 systemd[1]: Started Kubernetes Kubelet.
Oct 31 17:27:11.840954 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.839847    5003 server.go:317] "Adding debug handlers to kubelet server"
Oct 31 17:27:11.840954 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.837125    5003 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Oct 31 17:27:11.840954 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.840853    5003 server_v1.go:49] "podresources" method="list" useActivePods=true
Oct 31 17:27:11.841343 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.841239    5003 server.go:254] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Oct 31 17:27:11.844141 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.844122    5003 fs_resource_analyzer.go:69] "Starting FS ResourceAnalyzer"
Oct 31 17:27:11.844245 ip-10-0-138-17 kubenswrapper[5003]: E1031 17:27:11.844224    5003 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-138-17.ec2.internal\" not found"
Oct 31 17:27:11.844296 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.844272    5003 volume_manager.go:309] "The desired_state_of_world populator starts"
Oct 31 17:27:11.844296 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.844279    5003 volume_manager.go:311] "Starting Kubelet Volume Manager"
Oct 31 17:27:11.844398 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.844363    5003 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Oct 31 17:27:11.844459 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.844418    5003 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Oct 31 17:27:11.844988 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.844959    5003 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-10-30 17:21:33 +0000 UTC" deadline="2028-07-13 18:42:33.014981122 +0000 UTC"
Oct 31 17:27:11.845088 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.844990    5003 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14905h15m21.169995598s"
Oct 31 17:27:11.845088 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.844971    5003 factory.go:55] Registering systemd factory
Oct 31 17:27:11.845088 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.845016    5003 factory.go:223] Registration of the systemd container factory successfully
Oct 31 17:27:11.845287 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.845271    5003 factory.go:153] Registering CRI-O factory
Oct 31 17:27:11.845339 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.845292    5003 factory.go:223] Registration of the crio container factory successfully
Oct 31 17:27:11.845386 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.845351    5003 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Oct 31 17:27:11.845386 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.845370    5003 factory.go:103] Registering Raw factory
Oct 31 17:27:11.845541 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.845387    5003 manager.go:1199] Started watching for new ooms in manager
Oct 31 17:27:11.845798 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.845783    5003 manager.go:319] Starting recovery of all containers
Oct 31 17:27:11.847672 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.847473    5003 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="170ada34-8944-43d2-bcfb-1d782aae5348" volumeName="kubernetes.io/projected/170ada34-8944-43d2-bcfb-1d782aae5348-bound-sa-token" seLinuxMountContext=""
Oct 31 17:27:11.847672 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.847562    5003 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="8e32277f-062d-4c16-81ca-b12e65b24fbb" volumeName="kubernetes.io/empty-dir/8e32277f-062d-4c16-81ca-b12e65b24fbb-snapshots" seLinuxMountContext=""
Oct 31 17:27:11.847672 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.847578    5003 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="c915138c-9050-4958-b442-fee1aca9b002" volumeName="kubernetes.io/projected/c915138c-9050-4958-b442-fee1aca9b002-kube-api-access-6tqgx" seLinuxMountContext=""
Oct 31 17:27:11.847672 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.847602    5003 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="170ada34-8944-43d2-bcfb-1d782aae5348" volumeName="kubernetes.io/projected/170ada34-8944-43d2-bcfb-1d782aae5348-kube-api-access-h6b47" seLinuxMountContext=""
Oct 31 17:27:11.847672 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.847615    5003 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="2330cbe7-498c-4f39-ba1b-3873e125dd18" volumeName="kubernetes.io/configmap/2330cbe7-498c-4f39-ba1b-3873e125dd18-config" seLinuxMountContext=""
Oct 31 17:27:11.847672 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.847627    5003 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="8a9e5aa4-f4fc-4b33-a925-8e63df6c9cd2" volumeName="kubernetes.io/projected/8a9e5aa4-f4fc-4b33-a925-8e63df6c9cd2-kube-api-access-6tlzl" seLinuxMountContext=""
Oct 31 17:27:11.847672 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.847662    5003 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="9d9ecf7f-6a11-469b-8626-99d5ef7ffac7" volumeName="kubernetes.io/secret/9d9ecf7f-6a11-469b-8626-99d5ef7ffac7-image-registry-private-configuration" seLinuxMountContext=""
Oct 31 17:27:11.847672 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.847676    5003 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="a1bea244-6573-4e3c-9849-b27ade411c9f" volumeName="kubernetes.io/projected/a1bea244-6573-4e3c-9849-b27ade411c9f-kube-api-access-vpl4m" seLinuxMountContext=""
Oct 31 17:27:11.848142 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.847690    5003 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="fe1c5f7c-fdfd-40b9-bc0f-4e018779ee2b" volumeName="kubernetes.io/projected/fe1c5f7c-fdfd-40b9-bc0f-4e018779ee2b-kube-api-access-b2ncn" seLinuxMountContext=""
Oct 31 17:27:11.848142 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.847713    5003 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="340f062e-e599-4620-87d1-c5be0bb1b319" volumeName="kubernetes.io/projected/340f062e-e599-4620-87d1-c5be0bb1b319-kube-api-access-j26t9" seLinuxMountContext=""
Oct 31 17:27:11.848142 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.847726    5003 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="8e32277f-062d-4c16-81ca-b12e65b24fbb" volumeName="kubernetes.io/configmap/8e32277f-062d-4c16-81ca-b12e65b24fbb-service-ca-bundle" seLinuxMountContext=""
Oct 31 17:27:11.848142 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.847747    5003 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="ef27850a-20b3-4876-8330-57e8954f1a79" volumeName="kubernetes.io/configmap/ef27850a-20b3-4876-8330-57e8954f1a79-ovnkube-config" seLinuxMountContext=""
Oct 31 17:27:11.848142 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.847767    5003 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="ef27850a-20b3-4876-8330-57e8954f1a79" volumeName="kubernetes.io/secret/ef27850a-20b3-4876-8330-57e8954f1a79-ovn-node-metrics-cert" seLinuxMountContext=""
Oct 31 17:27:11.848142 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.847779    5003 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="fe1c5f7c-fdfd-40b9-bc0f-4e018779ee2b" volumeName="kubernetes.io/configmap/fe1c5f7c-fdfd-40b9-bc0f-4e018779ee2b-whereabouts-flatfile-configmap" seLinuxMountContext=""
Oct 31 17:27:11.848142 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.847821    5003 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="170ada34-8944-43d2-bcfb-1d782aae5348" volumeName="kubernetes.io/configmap/170ada34-8944-43d2-bcfb-1d782aae5348-registry-certificates" seLinuxMountContext=""
Oct 31 17:27:11.848142 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.847833    5003 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="25ad5c67-f563-4653-9e86-7e9ecbe78675" volumeName="kubernetes.io/empty-dir/25ad5c67-f563-4653-9e86-7e9ecbe78675-tmp-dir" seLinuxMountContext=""
Oct 31 17:27:11.848142 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.847844    5003 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="8a9e5aa4-f4fc-4b33-a925-8e63df6c9cd2" volumeName="kubernetes.io/secret/8a9e5aa4-f4fc-4b33-a925-8e63df6c9cd2-serving-cert" seLinuxMountContext=""
Oct 31 17:27:11.848142 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.847856    5003 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="9d9ecf7f-6a11-469b-8626-99d5ef7ffac7" volumeName="kubernetes.io/configmap/9d9ecf7f-6a11-469b-8626-99d5ef7ffac7-trusted-ca" seLinuxMountContext=""
Oct 31 17:27:11.848142 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.847878    5003 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="eaed4088-d322-48ab-af04-3c9efdea4e73" volumeName="kubernetes.io/empty-dir/eaed4088-d322-48ab-af04-3c9efdea4e73-tmp-dir" seLinuxMountContext=""
Oct 31 17:27:11.848142 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.847893    5003 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="fe1c5f7c-fdfd-40b9-bc0f-4e018779ee2b" volumeName="kubernetes.io/configmap/fe1c5f7c-fdfd-40b9-bc0f-4e018779ee2b-cni-sysctl-allowlist" seLinuxMountContext=""
Oct 31 17:27:11.848142 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.847910    5003 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="25ad5c67-f563-4653-9e86-7e9ecbe78675" volumeName="kubernetes.io/configmap/25ad5c67-f563-4653-9e86-7e9ecbe78675-config-volume" seLinuxMountContext=""
Oct 31 17:27:11.848142 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.847924    5003 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="8e32277f-062d-4c16-81ca-b12e65b24fbb" volumeName="kubernetes.io/configmap/8e32277f-062d-4c16-81ca-b12e65b24fbb-trusted-ca-bundle" seLinuxMountContext=""
Oct 31 17:27:11.848142 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.847938    5003 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="948f2c4e-81a5-4c0e-9ec9-f4fb56368b87" volumeName="kubernetes.io/configmap/948f2c4e-81a5-4c0e-9ec9-f4fb56368b87-service-ca-bundle" seLinuxMountContext=""
Oct 31 17:27:11.848142 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.847951    5003 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="f03611db-3bd9-401a-a137-1d4f691b51ea" volumeName="kubernetes.io/configmap/f03611db-3bd9-401a-a137-1d4f691b51ea-config" seLinuxMountContext=""
Oct 31 17:27:11.848142 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.847964    5003 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="f03611db-3bd9-401a-a137-1d4f691b51ea" volumeName="kubernetes.io/configmap/f03611db-3bd9-401a-a137-1d4f691b51ea-trusted-ca" seLinuxMountContext=""
Oct 31 17:27:11.848142 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.847978    5003 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="0c8a8a3b-14dd-45c9-b8fb-baf967142fd6" volumeName="kubernetes.io/empty-dir/0c8a8a3b-14dd-45c9-b8fb-baf967142fd6-tmp" seLinuxMountContext=""
Oct 31 17:27:11.848142 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.848002    5003 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="27af0f99-138f-42ac-89b9-9dfc4a522483" volumeName="kubernetes.io/configmap/27af0f99-138f-42ac-89b9-9dfc4a522483-multus-daemon-config" seLinuxMountContext=""
Oct 31 17:27:11.848142 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.848050    5003 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="449efcb2-6707-4809-b869-1bb477f6e6ae" volumeName="kubernetes.io/projected/449efcb2-6707-4809-b869-1bb477f6e6ae-kube-api-access-cq4kh" seLinuxMountContext=""
Oct 31 17:27:11.848142 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.848073    5003 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="8e32277f-062d-4c16-81ca-b12e65b24fbb" volumeName="kubernetes.io/secret/8e32277f-062d-4c16-81ca-b12e65b24fbb-serving-cert" seLinuxMountContext=""
Oct 31 17:27:11.848142 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.848086    5003 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="b1e258da-4619-478c-895a-041aa7eeafb6" volumeName="kubernetes.io/projected/b1e258da-4619-478c-895a-041aa7eeafb6-kube-api-access-ghqc6" seLinuxMountContext=""
Oct 31 17:27:11.848142 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.848101    5003 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="170ada34-8944-43d2-bcfb-1d782aae5348" volumeName="kubernetes.io/secret/170ada34-8944-43d2-bcfb-1d782aae5348-image-registry-private-configuration" seLinuxMountContext=""
Oct 31 17:27:11.848142 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.848113    5003 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="170ada34-8944-43d2-bcfb-1d782aae5348" volumeName="kubernetes.io/secret/170ada34-8944-43d2-bcfb-1d782aae5348-installation-pull-secrets" seLinuxMountContext=""
Oct 31 17:27:11.848142 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.848137    5003 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="88be474b-fd0b-4784-8f1c-2dc0bdfb2792" volumeName="kubernetes.io/projected/88be474b-fd0b-4784-8f1c-2dc0bdfb2792-kube-api-access-2ln8r" seLinuxMountContext=""
Oct 31 17:27:11.848142 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.848152    5003 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="948f2c4e-81a5-4c0e-9ec9-f4fb56368b87" volumeName="kubernetes.io/projected/948f2c4e-81a5-4c0e-9ec9-f4fb56368b87-kube-api-access-mkgtp" seLinuxMountContext=""
Oct 31 17:27:11.849459 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.848165    5003 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="9d9ecf7f-6a11-469b-8626-99d5ef7ffac7" volumeName="kubernetes.io/projected/9d9ecf7f-6a11-469b-8626-99d5ef7ffac7-kube-api-access-mgwcl" seLinuxMountContext=""
Oct 31 17:27:11.849459 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.848190    5003 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="9d9ecf7f-6a11-469b-8626-99d5ef7ffac7" volumeName="kubernetes.io/secret/9d9ecf7f-6a11-469b-8626-99d5ef7ffac7-installation-pull-secrets" seLinuxMountContext=""
Oct 31 17:27:11.849459 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.848205    5003 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="fe1c5f7c-fdfd-40b9-bc0f-4e018779ee2b" volumeName="kubernetes.io/configmap/fe1c5f7c-fdfd-40b9-bc0f-4e018779ee2b-cni-binary-copy" seLinuxMountContext=""
Oct 31 17:27:11.849459 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.848218    5003 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="9d9ecf7f-6a11-469b-8626-99d5ef7ffac7" volumeName="kubernetes.io/projected/9d9ecf7f-6a11-469b-8626-99d5ef7ffac7-bound-sa-token" seLinuxMountContext=""
Oct 31 17:27:11.849459 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.848231    5003 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="2330cbe7-498c-4f39-ba1b-3873e125dd18" volumeName="kubernetes.io/projected/2330cbe7-498c-4f39-ba1b-3873e125dd18-kube-api-access-6vzgd" seLinuxMountContext=""
Oct 31 17:27:11.849459 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.848254    5003 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="25ad5c67-f563-4653-9e86-7e9ecbe78675" volumeName="kubernetes.io/projected/25ad5c67-f563-4653-9e86-7e9ecbe78675-kube-api-access-kqpvj" seLinuxMountContext=""
Oct 31 17:27:11.849459 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.848268    5003 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="50e82975-3344-4653-8de3-68e8a64a8757" volumeName="kubernetes.io/secret/50e82975-3344-4653-8de3-68e8a64a8757-stats-auth" seLinuxMountContext=""
Oct 31 17:27:11.849459 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.848301    5003 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="8e32277f-062d-4c16-81ca-b12e65b24fbb" volumeName="kubernetes.io/empty-dir/8e32277f-062d-4c16-81ca-b12e65b24fbb-tmp" seLinuxMountContext=""
Oct 31 17:27:11.849459 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.848327    5003 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="9d9ecf7f-6a11-469b-8626-99d5ef7ffac7" volumeName="kubernetes.io/configmap/9d9ecf7f-6a11-469b-8626-99d5ef7ffac7-registry-certificates" seLinuxMountContext=""
Oct 31 17:27:11.849459 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.848352    5003 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="ef27850a-20b3-4876-8330-57e8954f1a79" volumeName="kubernetes.io/configmap/ef27850a-20b3-4876-8330-57e8954f1a79-env-overrides" seLinuxMountContext=""
Oct 31 17:27:11.849459 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.848364    5003 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="0c8a8a3b-14dd-45c9-b8fb-baf967142fd6" volumeName="kubernetes.io/empty-dir/0c8a8a3b-14dd-45c9-b8fb-baf967142fd6-etc-tuned" seLinuxMountContext=""
Oct 31 17:27:11.849459 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.848404    5003 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="0c8a8a3b-14dd-45c9-b8fb-baf967142fd6" volumeName="kubernetes.io/projected/0c8a8a3b-14dd-45c9-b8fb-baf967142fd6-kube-api-access-h4fpf" seLinuxMountContext=""
Oct 31 17:27:11.849459 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.848425    5003 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="26373302-592f-4fd5-bd54-7ac57ef19bfd" volumeName="kubernetes.io/projected/26373302-592f-4fd5-bd54-7ac57ef19bfd-kube-api-access-v5x5x" seLinuxMountContext=""
Oct 31 17:27:11.849459 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.848436    5003 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="9179e3c5-ef52-4445-aec0-779c3e99cb07" volumeName="kubernetes.io/secret/9179e3c5-ef52-4445-aec0-779c3e99cb07-original-pull-secret" seLinuxMountContext=""
Oct 31 17:27:11.849459 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.848458    5003 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="948f2c4e-81a5-4c0e-9ec9-f4fb56368b87" volumeName="kubernetes.io/empty-dir/948f2c4e-81a5-4c0e-9ec9-f4fb56368b87-archives-path" seLinuxMountContext=""
Oct 31 17:27:11.849459 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.848469    5003 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="9a0cf7f7-c12d-42fe-a83e-28e1f1859cd2" volumeName="kubernetes.io/configmap/9a0cf7f7-c12d-42fe-a83e-28e1f1859cd2-nginx-conf" seLinuxMountContext=""
Oct 31 17:27:11.849459 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.848491    5003 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="c390ea6f-c609-40f7-a9ec-53fd5c08d857" volumeName="kubernetes.io/secret/c390ea6f-c609-40f7-a9ec-53fd5c08d857-cert" seLinuxMountContext=""
Oct 31 17:27:11.849459 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.848503    5003 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="170ada34-8944-43d2-bcfb-1d782aae5348" volumeName="kubernetes.io/empty-dir/170ada34-8944-43d2-bcfb-1d782aae5348-ca-trust-extracted" seLinuxMountContext=""
Oct 31 17:27:11.849459 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.848514    5003 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="a26cba9f-c44a-405d-8e3d-de4bc5b6d6c0" volumeName="kubernetes.io/projected/a26cba9f-c44a-405d-8e3d-de4bc5b6d6c0-kube-api-access-rkfhx" seLinuxMountContext=""
Oct 31 17:27:11.849459 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.848528    5003 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="c390ea6f-c609-40f7-a9ec-53fd5c08d857" volumeName="kubernetes.io/projected/c390ea6f-c609-40f7-a9ec-53fd5c08d857-kube-api-access-z57fk" seLinuxMountContext=""
Oct 31 17:27:11.849459 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.848548    5003 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="ef27850a-20b3-4876-8330-57e8954f1a79" volumeName="kubernetes.io/configmap/ef27850a-20b3-4876-8330-57e8954f1a79-ovnkube-script-lib" seLinuxMountContext=""
Oct 31 17:27:11.849459 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.848558    5003 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="fef8c517-3be6-4cc1-908a-9e0116d8f978" volumeName="kubernetes.io/projected/fef8c517-3be6-4cc1-908a-9e0116d8f978-kube-api-access-kdg6k" seLinuxMountContext=""
Oct 31 17:27:11.849459 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.848577    5003 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="50e82975-3344-4653-8de3-68e8a64a8757" volumeName="kubernetes.io/projected/50e82975-3344-4653-8de3-68e8a64a8757-kube-api-access-ngvv2" seLinuxMountContext=""
Oct 31 17:27:11.849459 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.848589    5003 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="50e82975-3344-4653-8de3-68e8a64a8757" volumeName="kubernetes.io/secret/50e82975-3344-4653-8de3-68e8a64a8757-default-certificate" seLinuxMountContext=""
Oct 31 17:27:11.849459 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.848609    5003 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="5d30d9b6-0431-47f2-b06c-8a03d4f59b97" volumeName="kubernetes.io/projected/5d30d9b6-0431-47f2-b06c-8a03d4f59b97-kube-api-access-96ckd" seLinuxMountContext=""
Oct 31 17:27:11.849459 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.848620    5003 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="86312227-efeb-4196-ab2d-3b4b03e5c50f" volumeName="kubernetes.io/configmap/86312227-efeb-4196-ab2d-3b4b03e5c50f-konnectivity-ca" seLinuxMountContext=""
Oct 31 17:27:11.849459 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.848631    5003 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="9363fb38-792f-41a6-b6b3-d2c508fff328" volumeName="kubernetes.io/projected/9363fb38-792f-41a6-b6b3-d2c508fff328-kube-api-access-t9n2j" seLinuxMountContext=""
Oct 31 17:27:11.849459 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.848666    5003 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="a1bea244-6573-4e3c-9849-b27ade411c9f" volumeName="kubernetes.io/configmap/a1bea244-6573-4e3c-9849-b27ade411c9f-telemetry-config" seLinuxMountContext=""
Oct 31 17:27:11.849459 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.848682    5003 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="ec682f92-b657-44bd-9e85-3cd4680d2f95" volumeName="kubernetes.io/configmap/ec682f92-b657-44bd-9e85-3cd4680d2f95-samples-operator-config" seLinuxMountContext=""
Oct 31 17:27:11.849459 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.848699    5003 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="ec682f92-b657-44bd-9e85-3cd4680d2f95" volumeName="kubernetes.io/projected/ec682f92-b657-44bd-9e85-3cd4680d2f95-kube-api-access-krrzb" seLinuxMountContext=""
Oct 31 17:27:11.849459 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.848711    5003 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="2330cbe7-498c-4f39-ba1b-3873e125dd18" volumeName="kubernetes.io/secret/2330cbe7-498c-4f39-ba1b-3873e125dd18-serving-cert" seLinuxMountContext=""
Oct 31 17:27:11.849459 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.848723    5003 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="b1e258da-4619-478c-895a-041aa7eeafb6" volumeName="kubernetes.io/configmap/b1e258da-4619-478c-895a-041aa7eeafb6-iptables-alerter-script" seLinuxMountContext=""
Oct 31 17:27:11.849459 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.848735    5003 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="f03611db-3bd9-401a-a137-1d4f691b51ea" volumeName="kubernetes.io/projected/f03611db-3bd9-401a-a137-1d4f691b51ea-kube-api-access-f88d4" seLinuxMountContext=""
Oct 31 17:27:11.849459 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.848746    5003 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="f03611db-3bd9-401a-a137-1d4f691b51ea" volumeName="kubernetes.io/secret/f03611db-3bd9-401a-a137-1d4f691b51ea-serving-cert" seLinuxMountContext=""
Oct 31 17:27:11.849459 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.848757    5003 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="27af0f99-138f-42ac-89b9-9dfc4a522483" volumeName="kubernetes.io/configmap/27af0f99-138f-42ac-89b9-9dfc4a522483-cni-binary-copy" seLinuxMountContext=""
Oct 31 17:27:11.849459 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.848771    5003 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="27af0f99-138f-42ac-89b9-9dfc4a522483" volumeName="kubernetes.io/projected/27af0f99-138f-42ac-89b9-9dfc4a522483-kube-api-access-c6ctd" seLinuxMountContext=""
Oct 31 17:27:11.849459 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.848782    5003 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="9d9ecf7f-6a11-469b-8626-99d5ef7ffac7" volumeName="kubernetes.io/empty-dir/9d9ecf7f-6a11-469b-8626-99d5ef7ffac7-ca-trust-extracted" seLinuxMountContext=""
Oct 31 17:27:11.849459 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.848793    5003 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="ef27850a-20b3-4876-8330-57e8954f1a79" volumeName="kubernetes.io/projected/ef27850a-20b3-4876-8330-57e8954f1a79-kube-api-access-69jvk" seLinuxMountContext=""
Oct 31 17:27:11.849459 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.848805    5003 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="3aa3a055-ec26-4d70-bb04-d6a09abe6661" volumeName="kubernetes.io/projected/3aa3a055-ec26-4d70-bb04-d6a09abe6661-kube-api-access-crrdz" seLinuxMountContext=""
Oct 31 17:27:11.849459 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.848826    5003 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="8e32277f-062d-4c16-81ca-b12e65b24fbb" volumeName="kubernetes.io/projected/8e32277f-062d-4c16-81ca-b12e65b24fbb-kube-api-access-5x4hs" seLinuxMountContext=""
Oct 31 17:27:11.849459 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.848838    5003 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="c915138c-9050-4958-b442-fee1aca9b002" volumeName="kubernetes.io/configmap/c915138c-9050-4958-b442-fee1aca9b002-serviceca" seLinuxMountContext=""
Oct 31 17:27:11.849459 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.848857    5003 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="eaed4088-d322-48ab-af04-3c9efdea4e73" volumeName="kubernetes.io/projected/eaed4088-d322-48ab-af04-3c9efdea4e73-kube-api-access-q9ctx" seLinuxMountContext=""
Oct 31 17:27:11.849459 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.848868    5003 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="8a9e5aa4-f4fc-4b33-a925-8e63df6c9cd2" volumeName="kubernetes.io/configmap/8a9e5aa4-f4fc-4b33-a925-8e63df6c9cd2-config" seLinuxMountContext=""
Oct 31 17:27:11.849459 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.848881    5003 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="a7959bdf-3723-4ee9-a587-6cd16e28d4b1" volumeName="kubernetes.io/projected/a7959bdf-3723-4ee9-a587-6cd16e28d4b1-kube-api-access-rbmtq" seLinuxMountContext=""
Oct 31 17:27:11.849459 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.848894    5003 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="d5856011-8f77-4e60-8ecc-c7ac852a50b0" volumeName="kubernetes.io/projected/d5856011-8f77-4e60-8ecc-c7ac852a50b0-kube-api-access-j86wf" seLinuxMountContext=""
Oct 31 17:27:11.849459 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.848906    5003 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="170ada34-8944-43d2-bcfb-1d782aae5348" volumeName="kubernetes.io/configmap/170ada34-8944-43d2-bcfb-1d782aae5348-trusted-ca" seLinuxMountContext=""
Oct 31 17:27:11.849459 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.848917    5003 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="3aa3a055-ec26-4d70-bb04-d6a09abe6661" volumeName="kubernetes.io/empty-dir/3aa3a055-ec26-4d70-bb04-d6a09abe6661-data-volume" seLinuxMountContext=""
Oct 31 17:27:11.849459 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.848929    5003 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="86312227-efeb-4196-ab2d-3b4b03e5c50f" volumeName="kubernetes.io/secret/86312227-efeb-4196-ab2d-3b4b03e5c50f-agent-certs" seLinuxMountContext=""
Oct 31 17:27:11.849459 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.848940    5003 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="948f2c4e-81a5-4c0e-9ec9-f4fb56368b87" volumeName="kubernetes.io/configmap/948f2c4e-81a5-4c0e-9ec9-f4fb56368b87-trusted-ca-bundle" seLinuxMountContext=""
Oct 31 17:27:11.849459 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.848952    5003 reconstruct.go:97] "Volume reconstruction finished"
Oct 31 17:27:11.849459 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.848959    5003 reconciler.go:29] "Reconciler: start to sync state"
Oct 31 17:27:11.872783 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.872754    5003 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-b2xxw_f03611db-3bd9-401a-a137-1d4f691b51ea/console-operator/1.log"
Oct 31 17:27:11.873201 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.873177    5003 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-b2xxw_f03611db-3bd9-401a-a137-1d4f691b51ea/console-operator/1.log"
Oct 31 17:27:11.879606 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.879561    5003 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Oct 31 17:27:11.881160 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.881129    5003 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Oct 31 17:27:11.881160 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.881161    5003 status_manager.go:249] "Starting to sync pod status with apiserver"
Oct 31 17:27:11.881361 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.881180    5003 kubelet.go:2521] "Starting kubelet main sync loop"
Oct 31 17:27:11.881361 ip-10-0-138-17 kubenswrapper[5003]: E1031 17:27:11.881218    5003 kubelet.go:2545] "Skipping pod synchronization" err="[container runtime status check may not have completed yet, PLEG is not healthy: pleg has yet to be successful]"
Oct 31 17:27:11.888102 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.887318    5003 reconstruct.go:205] "DevicePaths of reconstructed volumes updated"
Oct 31 17:27:11.889348 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.889328    5003 reflector.go:446] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 31 17:27:11.889986 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.889959    5003 reflector.go:446] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 31 17:27:11.901556 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.901528    5003 reflector.go:446] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 31 17:27:11.901811 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.901788    5003 reflector.go:446] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 31 17:27:11.905979 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.905940    5003 generic.go:356] "Generic (PLEG): container finished" podID="e2864fcc74b4907ea642d1f1fb68b712" containerID="439fe4f1726cc21f40d0d24ebe3bfe45626815e406518dddc17cc12d3c0f12ab" exitCode=0
Oct 31 17:27:11.920743 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.920040    5003 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-b2xxw_f03611db-3bd9-401a-a137-1d4f691b51ea/console-operator/1.log"
Oct 31 17:27:11.920743 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.920074    5003 generic.go:356] "Generic (PLEG): container finished" podID="f03611db-3bd9-401a-a137-1d4f691b51ea" containerID="0bd9770d3ee51d6d9482dae960ce96f0bd57304d5988f25ca104ece2f1b1109f" exitCode=255
Oct 31 17:27:11.927592 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.927568    5003 generic.go:356] "Generic (PLEG): container finished" podID="fe1c5f7c-fdfd-40b9-bc0f-4e018779ee2b" containerID="a8a29f08cdc945ab8d77e4f123871fbc277447b179c557ed4c39bda76313bc2d" exitCode=0
Oct 31 17:27:11.927592 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.927590    5003 generic.go:356] "Generic (PLEG): container finished" podID="fe1c5f7c-fdfd-40b9-bc0f-4e018779ee2b" containerID="33590bd96c9d4362b81d28ca33519beccd69e11f8bd501a356a2f47dc2b0459e" exitCode=0
Oct 31 17:27:11.927779 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.927603    5003 generic.go:356] "Generic (PLEG): container finished" podID="fe1c5f7c-fdfd-40b9-bc0f-4e018779ee2b" containerID="de148cf762fc62c0691a225b4b49d5244a076eab71e7b4071f1d515c0a312a16" exitCode=0
Oct 31 17:27:11.927779 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.927611    5003 generic.go:356] "Generic (PLEG): container finished" podID="fe1c5f7c-fdfd-40b9-bc0f-4e018779ee2b" containerID="e097b1d59b8a3b00976ac29432d8f725fd9a3d079b52bb8de76a34904d35717d" exitCode=0
Oct 31 17:27:11.927779 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.927619    5003 generic.go:356] "Generic (PLEG): container finished" podID="fe1c5f7c-fdfd-40b9-bc0f-4e018779ee2b" containerID="565c7dd2f6eebea522f5f930b65a6da8351a70fcc5642cd9880ae7fec4c74578" exitCode=0
Oct 31 17:27:11.927779 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.927627    5003 generic.go:356] "Generic (PLEG): container finished" podID="fe1c5f7c-fdfd-40b9-bc0f-4e018779ee2b" containerID="fceec909280145ea6548f799b6ca8a62d6ebaf3f39423dfb8ce01da685c4b0db" exitCode=0
Oct 31 17:27:11.950791 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.950726    5003 manager.go:324] Recovery completed
Oct 31 17:27:11.970916 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.970889    5003 cpu_manager.go:226] "Starting" policy="none"
Oct 31 17:27:11.970916 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.970907    5003 cpu_manager.go:227] "Reconciling" reconcilePeriod="10s"
Oct 31 17:27:11.971092 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.970929    5003 state_mem.go:41] "Initialized" logger="CPUManager state checkpoint.CPUManager state memory"
Oct 31 17:27:11.971092 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.971079    5003 state_mem.go:94] "Updated default CPUSet" logger="CPUManager state checkpoint.CPUManager state memory" cpuSet=""
Oct 31 17:27:11.971151 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.971093    5003 state_mem.go:102] "Updated CPUSet assignments" logger="CPUManager state checkpoint.CPUManager state memory" assignments={}
Oct 31 17:27:11.971151 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.971116    5003 state_checkpoint.go:142] "restored state from checkpoint" logger="CPUManager state checkpoint"
Oct 31 17:27:11.971151 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.971124    5003 state_checkpoint.go:143] "defaultCPUSet" logger="CPUManager state checkpoint" defaultCpuSet=""
Oct 31 17:27:11.971151 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.971132    5003 policy_none.go:50] "Start"
Oct 31 17:27:11.971151 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.971144    5003 memory_manager.go:187] "Starting memorymanager" policy="None"
Oct 31 17:27:11.971284 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.971157    5003 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Oct 31 17:27:11.971319 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.971294    5003 state_mem.go:77] "Updated machine memory state" logger="Memory Manager state checkpoint"
Oct 31 17:27:11.971319 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.971302    5003 state_checkpoint.go:85] "State checkpoint: restored state from checkpoint" logger="Memory Manager state checkpoint"
Oct 31 17:27:11.971319 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.971308    5003 policy_none.go:44] "Start"
Oct 31 17:27:11.977281 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.977249    5003 node_container_manager_linux.go:130] "Enforcing system reserved compressible on cgroup" cgroupName="/system.slice" limits={"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"}
Oct 31 17:27:11.979873 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.979858    5003 manager.go:341] "Starting Device Plugin manager"
Oct 31 17:27:11.980464 ip-10-0-138-17 kubenswrapper[5003]: E1031 17:27:11.980444    5003 manager.go:525] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Oct 31 17:27:11.980464 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.980460    5003 server.go:87] "Starting device plugin registration server"
Oct 31 17:27:11.980763 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.980746    5003 eviction_manager.go:194] "Eviction manager: starting control loop"
Oct 31 17:27:11.980763 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.980764    5003 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Oct 31 17:27:11.981045 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.981029    5003 plugin_watcher.go:53] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Oct 31 17:27:11.981165 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.981134    5003 plugin_watcher.go:201] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Oct 31 17:27:11.981219 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.981173    5003 plugin_manager.go:119] "The desired_state_of_world populator (plugin watcher) starts"
Oct 31 17:27:11.981219 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.981180    5003 plugin_manager.go:121] "Starting Kubelet Plugin Manager"
Oct 31 17:27:11.981311 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.981231    5003 reconciler.go:167] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-10-31T17:27:11.981162942Z","UUID":"dbbfff57-8f33-4dc6-bc3c-29db6743146d","Handler":null,"Name":"","Endpoint":""}
Oct 31 17:27:11.981406 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.981372    5003 kubelet.go:2608] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-17.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-138-17.ec2.internal"]
Oct 31 17:27:11.982239 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.982217    5003 kubelet.go:3368] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-17.ec2.internal"
Oct 31 17:27:11.982507 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.982489    5003 kubelet.go:3368] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-17.ec2.internal"
Oct 31 17:27:11.982765 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.982724    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-17.ec2.internal" event={"ID":"4b3b7d414562a81671be0e69748417db","Type":"ContainerStarted","Data":"eed54914fcf9cb917bfb05f1936608d942471c84e30aa161939b10a9eb565289"}
Oct 31 17:27:11.982765 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.982784    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-17.ec2.internal" event={"ID":"4b3b7d414562a81671be0e69748417db","Type":"ContainerStarted","Data":"bb0a00d4ae5cd9e352236bf7586fda56ae4091a154dba55bc35b663ed7bc06ce"}
Oct 31 17:27:11.982765 ip-10-0-138-17 kubenswrapper[5003]: E1031 17:27:11.982797    5003 eviction_manager.go:272] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Oct 31 17:27:11.982765 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.982805    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-17.ec2.internal" event={"ID":"e2864fcc74b4907ea642d1f1fb68b712","Type":"ContainerStarted","Data":"282ec0cbff3ec1d79f4667a8ad22169cfbb021600ec3bac31aba7f125ba79e30"}
Oct 31 17:27:11.982765 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.982825    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-17.ec2.internal" event={"ID":"e2864fcc74b4907ea642d1f1fb68b712","Type":"ContainerDied","Data":"439fe4f1726cc21f40d0d24ebe3bfe45626815e406518dddc17cc12d3c0f12ab"}
Oct 31 17:27:11.983197 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.982843    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-17.ec2.internal" event={"ID":"e2864fcc74b4907ea642d1f1fb68b712","Type":"ContainerStarted","Data":"e58c6a3710855022ae8b11167e0001480ccb26ed614ee6d6105468766fa9f00f"}
Oct 31 17:27:11.983197 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.982977    5003 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Oct 31 17:27:11.983197 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:11.983009    5003 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Oct 31 17:27:12.006195 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:12.006173    5003 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Oct 31 17:27:12.006300 ip-10-0-138-17 kubenswrapper[5003]: E1031 17:27:12.006216    5003 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-apiserver-proxy-ip-10-0-138-17.ec2.internal\" already exists" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-17.ec2.internal"
Oct 31 17:27:12.006735 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:12.006703    5003 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Oct 31 17:27:12.006840 ip-10-0-138-17 kubenswrapper[5003]: E1031 17:27:12.006756    5003 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-rbac-proxy-crio-ip-10-0-138-17.ec2.internal\" already exists" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-17.ec2.internal"
Oct 31 17:27:12.081425 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:12.081389    5003 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 31 17:27:12.083162 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:12.083142    5003 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-138-17.ec2.internal" event="NodeHasSufficientMemory"
Oct 31 17:27:12.083162 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:12.083172    5003 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-138-17.ec2.internal" event="NodeHasNoDiskPressure"
Oct 31 17:27:12.083323 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:12.083182    5003 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-138-17.ec2.internal" event="NodeHasSufficientPID"
Oct 31 17:27:12.083323 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:12.083226    5003 kubelet_node_status.go:77] "Attempting to register node" node="ip-10-0-138-17.ec2.internal"
Oct 31 17:27:12.088350 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:12.088332    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/e2864fcc74b4907ea642d1f1fb68b712-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-17.ec2.internal\" (UID: \"e2864fcc74b4907ea642d1f1fb68b712\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-17.ec2.internal"
Oct 31 17:27:12.088420 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:12.088358    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e2864fcc74b4907ea642d1f1fb68b712-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-17.ec2.internal\" (UID: \"e2864fcc74b4907ea642d1f1fb68b712\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-17.ec2.internal"
Oct 31 17:27:12.088420 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:12.088376    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/4b3b7d414562a81671be0e69748417db-config\") pod \"kube-apiserver-proxy-ip-10-0-138-17.ec2.internal\" (UID: \"4b3b7d414562a81671be0e69748417db\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-17.ec2.internal"
Oct 31 17:27:12.115794 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:12.115771    5003 kubelet_node_status.go:126] "Node was previously registered" node="ip-10-0-138-17.ec2.internal"
Oct 31 17:27:12.115900 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:12.115832    5003 kubelet_node_status.go:80] "Successfully registered node" node="ip-10-0-138-17.ec2.internal"
Oct 31 17:27:12.189294 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:12.189256    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/e2864fcc74b4907ea642d1f1fb68b712-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-17.ec2.internal\" (UID: \"e2864fcc74b4907ea642d1f1fb68b712\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-17.ec2.internal"
Oct 31 17:27:12.189294 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:12.189280    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/e2864fcc74b4907ea642d1f1fb68b712-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-17.ec2.internal\" (UID: \"e2864fcc74b4907ea642d1f1fb68b712\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-17.ec2.internal"
Oct 31 17:27:12.189486 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:12.189307    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e2864fcc74b4907ea642d1f1fb68b712-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-17.ec2.internal\" (UID: \"e2864fcc74b4907ea642d1f1fb68b712\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-17.ec2.internal"
Oct 31 17:27:12.189486 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:12.189348    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e2864fcc74b4907ea642d1f1fb68b712-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-17.ec2.internal\" (UID: \"e2864fcc74b4907ea642d1f1fb68b712\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-17.ec2.internal"
Oct 31 17:27:12.189486 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:12.189349    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/4b3b7d414562a81671be0e69748417db-config\") pod \"kube-apiserver-proxy-ip-10-0-138-17.ec2.internal\" (UID: \"4b3b7d414562a81671be0e69748417db\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-17.ec2.internal"
Oct 31 17:27:12.189486 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:12.189379    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/4b3b7d414562a81671be0e69748417db-config\") pod \"kube-apiserver-proxy-ip-10-0-138-17.ec2.internal\" (UID: \"4b3b7d414562a81671be0e69748417db\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-17.ec2.internal"
Oct 31 17:27:12.829379 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:12.829341    5003 apiserver.go:52] "Watching apiserver"
Oct 31 17:27:12.891810 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:12.891774    5003 reflector.go:446] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Oct 31 17:27:12.892556 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:12.892530    5003 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-17.ec2.internal","openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-th5tq","kube-system/kas-connection-checker-685895c7c9-ttbkh","openshift-insights/insights-runtime-extractor-tdzz5","openshift-console-operator/console-operator-7cd56b8dbc-b2xxw","kube-system/konnectivity-agent-vghkb","openshift-network-diagnostics/network-check-target-pqs8z","openshift-network-operator/iptables-alerter-h8jzv","kube-system/kas-connection-checker-685895c7c9-kgdxw","openshift-insights/insights-operator-7c4986d449-tggxv","openshift-multus/multus-additional-cni-plugins-swb7n","openshift-network-console/networking-console-plugin-86c478bb88-rnvgv","openshift-network-diagnostics/network-check-source-6f78d59f99-qkkwm","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ldjrw","openshift-kube-storage-version-migrator/migrator-66df5d496b-t48lj","openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-rhsk4","openshift-image-registry/image-registry-74dbfdb444-q7rkg","openshift-ovn-kubernetes/ovnkube-node-v8sbm","openshift-ingress/router-default-65db5d9749-xvqmh","openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-4xtm4","openshift-multus/network-metrics-daemon-7j59v","openshift-image-registry/image-registry-869fc8694f-xcqzj","openshift-ingress-canary/ingress-canary-ptxt2","openshift-service-ca-operator/service-ca-operator-544d749c8c-7lspr","openshift-monitoring/cluster-monitoring-operator-884576c57-csbxp","openshift-insights/periodic-gathering-vhvfz-6pbpt","openshift-multus/multus-9zs6c","openshift-dns/dns-default-7v7x4","openshift-cluster-node-tuning-operator/tuned-zm6cj","kube-system/global-pull-secret-syncer-qgtf4","openshift-dns/node-resolver-x25tg","openshift-image-registry/node-ca-lcz9q","kube-system/kas-connection-checker-685895c7c9-6pnp6","openshift-kube-storage-version-migrator/migrator-66df5d496b-lfxtw","kube-system/kube-apiserver-proxy-ip-10-0-138-17.ec2.internal"]
Oct 31 17:27:12.893920 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:12.893898    5003 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-74dbfdb444-q7rkg"
Oct 31 17:27:12.894259 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:12.894238    5003 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-884576c57-csbxp"
Oct 31 17:27:12.896152 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:12.896132    5003 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-rhsk4"
Oct 31 17:27:12.896959 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:12.896942    5003 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-65db5d9749-xvqmh"
Oct 31 17:27:12.897298 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:12.897281    5003 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-86c478bb88-rnvgv"
Oct 31 17:27:12.897682 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:12.897668    5003 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7j59v"
Oct 31 17:27:12.906298 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:12.906275    5003 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-869fc8694f-xcqzj"
Oct 31 17:27:12.906801 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:12.906780    5003 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-7v7x4"
Oct 31 17:27:12.907327 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:12.907309    5003 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"openshift-service-ca.crt\""
Oct 31 17:27:12.907327 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:12.907309    5003 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"kube-root-ca.crt\""
Oct 31 17:27:12.907854 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:12.907833    5003 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Oct 31 17:27:12.908223 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:12.908207    5003 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Oct 31 17:27:12.908892 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:12.908873    5003 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Oct 31 17:27:12.908892 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:12.908888    5003 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Oct 31 17:27:12.909066 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:12.908918    5003 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Oct 31 17:27:12.909066 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:12.908952    5003 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Oct 31 17:27:12.909066 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:12.909011    5003 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-6krd7\""
Oct 31 17:27:12.909066 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:12.909014    5003 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Oct 31 17:27:12.909066 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:12.909067    5003 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-v8tmg\""
Oct 31 17:27:12.909528 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:12.909181    5003 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-2pt75\""
Oct 31 17:27:12.909528 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:12.909211    5003 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Oct 31 17:27:12.909528 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:12.909219    5003 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Oct 31 17:27:12.909528 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:12.909336    5003 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Oct 31 17:27:12.909528 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:12.909357    5003 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Oct 31 17:27:12.909528 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:12.909334    5003 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Oct 31 17:27:12.909528 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:12.909385    5003 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Oct 31 17:27:12.909528 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:12.909388    5003 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Oct 31 17:27:12.909528 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:12.909448    5003 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Oct 31 17:27:12.909528 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:12.909463    5003 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Oct 31 17:27:12.909528 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:12.909506    5003 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-27h6r\""
Oct 31 17:27:12.910155 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:12.909624    5003 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-tdzz5"
Oct 31 17:27:12.910155 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:12.909932    5003 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Oct 31 17:27:12.910155 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:12.909937    5003 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Oct 31 17:27:12.921264 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:12.921228    5003 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Oct 31 17:27:12.921433 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:12.921326    5003 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Oct 31 17:27:12.921433 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:12.921332    5003 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Oct 31 17:27:12.921554 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:12.921466    5003 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Oct 31 17:27:12.921554 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:12.921494    5003 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"global-pull-secret-syncer-dockercfg-tj66q\""
Oct 31 17:27:12.921554 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:12.921523    5003 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-fftjl\""
Oct 31 17:27:12.921554 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:12.921535    5003 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Oct 31 17:27:12.921759 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:12.921580    5003 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Oct 31 17:27:12.921759 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:12.921588    5003 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Oct 31 17:27:12.921759 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:12.921624    5003 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Oct 31 17:27:12.921759 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:12.921635    5003 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Oct 31 17:27:12.921759 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:12.921639    5003 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Oct 31 17:27:12.921759 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:12.921630    5003 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Oct 31 17:27:12.921759 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:12.921682    5003 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Oct 31 17:27:12.922048 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:12.921799    5003 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Oct 31 17:27:12.922048 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:12.921832    5003 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Oct 31 17:27:12.922048 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:12.921858    5003 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Oct 31 17:27:12.922048 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:12.921889    5003 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-t4mdx\""
Oct 31 17:27:12.922048 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:12.922003    5003 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Oct 31 17:27:12.922048 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:12.922021    5003 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-z2hdt\""
Oct 31 17:27:12.922298 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:12.922051    5003 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Oct 31 17:27:12.922298 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:12.922063    5003 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Oct 31 17:27:12.922298 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:12.922069    5003 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Oct 31 17:27:12.922298 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:12.922227    5003 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Oct 31 17:27:12.922474 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:12.922453    5003 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-dwhr5\""
Oct 31 17:27:12.922604 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:12.922586    5003 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Oct 31 17:27:12.922809 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:12.922786    5003 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Oct 31 17:27:12.922809 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:12.922800    5003 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Oct 31 17:27:12.922911 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:12.922825    5003 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Oct 31 17:27:12.923038 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:12.923017    5003 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Oct 31 17:27:12.923038 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:12.923022    5003 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Oct 31 17:27:12.923244 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:12.923223    5003 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Oct 31 17:27:12.924499 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:12.924475    5003 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-g2t4b\""
Oct 31 17:27:12.925390 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:12.925368    5003 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-42sgv\""
Oct 31 17:27:12.925481 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:12.925424    5003 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-zv4z8\""
Oct 31 17:27:12.925481 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:12.925445    5003 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Oct 31 17:27:12.925713 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:12.925696    5003 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Oct 31 17:27:12.925807 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:12.925716    5003 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Oct 31 17:27:12.925807 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:12.925780    5003 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Oct 31 17:27:12.925924 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:12.925707    5003 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Oct 31 17:27:12.926213 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:12.926188    5003 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Oct 31 17:27:12.926421 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:12.926406    5003 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Oct 31 17:27:12.926498 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:12.926453    5003 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-config\""
Oct 31 17:27:12.926546 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:12.926528    5003 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Oct 31 17:27:12.926590 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:12.926569    5003 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Oct 31 17:27:12.926665 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:12.926602    5003 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-qwvn9\""
Oct 31 17:27:12.926665 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:12.926640    5003 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Oct 31 17:27:12.926873 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:12.926857    5003 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Oct 31 17:27:12.926873 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:12.926873    5003 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-vvnlg\""
Oct 31 17:27:12.931122 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:12.931104    5003 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Oct 31 17:27:12.931231 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:12.931152    5003 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Oct 31 17:27:12.931231 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:12.931225    5003 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Oct 31 17:27:12.931329 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:12.931271    5003 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Oct 31 17:27:12.932853 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:12.932830    5003 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Oct 31 17:27:12.932922 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:12.932888    5003 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-zw2xk\""
Oct 31 17:27:12.933014 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:12.932997    5003 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Oct 31 17:27:12.933102 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:12.933015    5003 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Oct 31 17:27:12.933102 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:12.933021    5003 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Oct 31 17:27:12.933102 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:12.933064    5003 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent-dockercfg-k6pvq\""
Oct 31 17:27:12.933102 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:12.933063    5003 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Oct 31 17:27:12.933249 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:12.933148    5003 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Oct 31 17:27:12.933369 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:12.933326    5003 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-xbzzg\""
Oct 31 17:27:12.933369 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:12.933343    5003 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Oct 31 17:27:12.933369 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:12.933328    5003 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-5bhk8\""
Oct 31 17:27:12.933369 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:12.933357    5003 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-check-target-dockercfg-nk5tf\""
Oct 31 17:27:12.933369 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:12.933361    5003 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-8d7mp\""
Oct 31 17:27:12.933629 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:12.933372    5003 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-wvfmn\""
Oct 31 17:27:12.933629 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:12.933377    5003 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-9gvm6\""
Oct 31 17:27:12.933629 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:12.933377    5003 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Oct 31 17:27:12.933629 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:12.933401    5003 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Oct 31 17:27:12.933629 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:12.933421    5003 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-node-identity-dockercfg-x4c5q\""
Oct 31 17:27:12.933629 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:12.933494    5003 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"ingress-canary-dockercfg-8gjvp\""
Oct 31 17:27:12.933629 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:12.933507    5003 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-dockercfg-8nkt5\""
Oct 31 17:27:12.933629 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:12.933517    5003 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Oct 31 17:27:12.933629 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:12.933540    5003 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Oct 31 17:27:12.933629 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:12.933541    5003 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Oct 31 17:27:12.933629 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:12.933584    5003 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Oct 31 17:27:12.933629 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:12.933590    5003 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Oct 31 17:27:12.933629 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:12.933598    5003 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-4g54t\""
Oct 31 17:27:12.934156 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:12.933741    5003 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Oct 31 17:27:12.934156 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:12.933889    5003 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Oct 31 17:27:12.934156 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:12.933972    5003 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-dm9tc\""
Oct 31 17:27:12.934156 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:12.933972    5003 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Oct 31 17:27:12.934453 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:12.934436    5003 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Oct 31 17:27:12.934523 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:12.934509    5003 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Oct 31 17:27:12.942358 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:12.942341    5003 kubelet.go:3368] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-17.ec2.internal"
Oct 31 17:27:12.942470 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:12.942457    5003 kubelet.go:3368] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-17.ec2.internal"
Oct 31 17:27:12.946494 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:12.946478    5003 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Oct 31 17:27:12.964085 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:12.964056    5003 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Oct 31 17:27:12.964233 ip-10-0-138-17 kubenswrapper[5003]: E1031 17:27:12.964115    5003 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-apiserver-proxy-ip-10-0-138-17.ec2.internal\" already exists" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-17.ec2.internal"
Oct 31 17:27:12.964337 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:12.964321    5003 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Oct 31 17:27:12.964380 ip-10-0-138-17 kubenswrapper[5003]: E1031 17:27:12.964363    5003 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-rbac-proxy-crio-ip-10-0-138-17.ec2.internal\" already exists" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-17.ec2.internal"
Oct 31 17:27:12.994252 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:12.994217    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3aa3a055-ec26-4d70-bb04-d6a09abe6661-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-tdzz5\" (UID: \"3aa3a055-ec26-4d70-bb04-d6a09abe6661\") " pod="openshift-insights/insights-runtime-extractor-tdzz5"
Oct 31 17:27:12.994252 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:12.994251    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/0c8a8a3b-14dd-45c9-b8fb-baf967142fd6-etc-sysctl-d\") pod \"tuned-zm6cj\" (UID: \"0c8a8a3b-14dd-45c9-b8fb-baf967142fd6\") " pod="openshift-cluster-node-tuning-operator/tuned-zm6cj"
Oct 31 17:27:12.994504 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:12.994277    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9d9ecf7f-6a11-469b-8626-99d5ef7ffac7-image-registry-private-configuration\") pod \"image-registry-869fc8694f-xcqzj\" (UID: \"9d9ecf7f-6a11-469b-8626-99d5ef7ffac7\") " pod="openshift-image-registry/image-registry-869fc8694f-xcqzj"
Oct 31 17:27:12.994504 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:12.994296    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/fe1c5f7c-fdfd-40b9-bc0f-4e018779ee2b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-swb7n\" (UID: \"fe1c5f7c-fdfd-40b9-bc0f-4e018779ee2b\") " pod="openshift-multus/multus-additional-cni-plugins-swb7n"
Oct 31 17:27:12.994504 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:12.994356    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0c8a8a3b-14dd-45c9-b8fb-baf967142fd6-etc-kubernetes\") pod \"tuned-zm6cj\" (UID: \"0c8a8a3b-14dd-45c9-b8fb-baf967142fd6\") " pod="openshift-cluster-node-tuning-operator/tuned-zm6cj"
Oct 31 17:27:12.994504 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:12.994393    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/27af0f99-138f-42ac-89b9-9dfc4a522483-cnibin\") pod \"multus-9zs6c\" (UID: \"27af0f99-138f-42ac-89b9-9dfc4a522483\") " pod="openshift-multus/multus-9zs6c"
Oct 31 17:27:12.994504 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:12.994418    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rbmtq\" (UniqueName: \"kubernetes.io/projected/a7959bdf-3723-4ee9-a587-6cd16e28d4b1-kube-api-access-rbmtq\") pod \"volume-data-source-validator-58c9f5f46d-th5tq\" (UID: \"a7959bdf-3723-4ee9-a587-6cd16e28d4b1\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-th5tq"
Oct 31 17:27:12.994504 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:12.994450    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/88be474b-fd0b-4784-8f1c-2dc0bdfb2792-kubelet-dir\") pod \"aws-ebs-csi-driver-node-ldjrw\" (UID: \"88be474b-fd0b-4784-8f1c-2dc0bdfb2792\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ldjrw"
Oct 31 17:27:12.994870 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:12.994552    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/170ada34-8944-43d2-bcfb-1d782aae5348-registry-certificates\") pod \"image-registry-74dbfdb444-q7rkg\" (UID: \"170ada34-8944-43d2-bcfb-1d782aae5348\") " pod="openshift-image-registry/image-registry-74dbfdb444-q7rkg"
Oct 31 17:27:12.994870 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:12.994594    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9d9ecf7f-6a11-469b-8626-99d5ef7ffac7-image-registry-private-configuration\") pod \"image-registry-869fc8694f-xcqzj\" (UID: \"9d9ecf7f-6a11-469b-8626-99d5ef7ffac7\") " pod="openshift-image-registry/image-registry-869fc8694f-xcqzj"
Oct 31 17:27:12.994870 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:12.994610    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/fe1c5f7c-fdfd-40b9-bc0f-4e018779ee2b-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-swb7n\" (UID: \"fe1c5f7c-fdfd-40b9-bc0f-4e018779ee2b\") " pod="openshift-multus/multus-additional-cni-plugins-swb7n"
Oct 31 17:27:12.994870 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:12.994693    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0c8a8a3b-14dd-45c9-b8fb-baf967142fd6-var-lib-kubelet\") pod \"tuned-zm6cj\" (UID: \"0c8a8a3b-14dd-45c9-b8fb-baf967142fd6\") " pod="openshift-cluster-node-tuning-operator/tuned-zm6cj"
Oct 31 17:27:12.994870 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:12.994729    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/2330cbe7-498c-4f39-ba1b-3873e125dd18-config\") pod \"service-ca-operator-544d749c8c-7lspr\" (UID: \"2330cbe7-498c-4f39-ba1b-3873e125dd18\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-7lspr"
Oct 31 17:27:12.994870 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:12.994756    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/a1bea244-6573-4e3c-9849-b27ade411c9f-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-csbxp\" (UID: \"a1bea244-6573-4e3c-9849-b27ade411c9f\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-csbxp"
Oct 31 17:27:12.995125 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:12.994909    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v5x5x\" (UniqueName: \"kubernetes.io/projected/26373302-592f-4fd5-bd54-7ac57ef19bfd-kube-api-access-v5x5x\") pod \"kas-connection-checker-685895c7c9-6pnp6\" (UID: \"26373302-592f-4fd5-bd54-7ac57ef19bfd\") " pod="kube-system/kas-connection-checker-685895c7c9-6pnp6"
Oct 31 17:27:12.995125 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:12.994936    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ef27850a-20b3-4876-8330-57e8954f1a79-ovnkube-config\") pod \"ovnkube-node-v8sbm\" (UID: \"ef27850a-20b3-4876-8330-57e8954f1a79\") " pod="openshift-ovn-kubernetes/ovnkube-node-v8sbm"
Oct 31 17:27:12.995125 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:12.994946    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/fe1c5f7c-fdfd-40b9-bc0f-4e018779ee2b-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-swb7n\" (UID: \"fe1c5f7c-fdfd-40b9-bc0f-4e018779ee2b\") " pod="openshift-multus/multus-additional-cni-plugins-swb7n"
Oct 31 17:27:12.995125 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:12.994953    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/2330cbe7-498c-4f39-ba1b-3873e125dd18-config\") pod \"service-ca-operator-544d749c8c-7lspr\" (UID: \"2330cbe7-498c-4f39-ba1b-3873e125dd18\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-7lspr"
Oct 31 17:27:12.995125 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:12.994960    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/88be474b-fd0b-4784-8f1c-2dc0bdfb2792-registration-dir\") pod \"aws-ebs-csi-driver-node-ldjrw\" (UID: \"88be474b-fd0b-4784-8f1c-2dc0bdfb2792\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ldjrw"
Oct 31 17:27:12.995125 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:12.995007    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8e32277f-062d-4c16-81ca-b12e65b24fbb-service-ca-bundle\") pod \"insights-operator-7c4986d449-tggxv\" (UID: \"8e32277f-062d-4c16-81ca-b12e65b24fbb\") " pod="openshift-insights/insights-operator-7c4986d449-tggxv"
Oct 31 17:27:12.995125 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:12.995027    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/0c8a8a3b-14dd-45c9-b8fb-baf967142fd6-run\") pod \"tuned-zm6cj\" (UID: \"0c8a8a3b-14dd-45c9-b8fb-baf967142fd6\") " pod="openshift-cluster-node-tuning-operator/tuned-zm6cj"
Oct 31 17:27:12.995125 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:12.995051    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-krrzb\" (UniqueName: \"kubernetes.io/projected/ec682f92-b657-44bd-9e85-3cd4680d2f95-kube-api-access-krrzb\") pod \"cluster-samples-operator-6ddb6c8b94-rhsk4\" (UID: \"ec682f92-b657-44bd-9e85-3cd4680d2f95\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-rhsk4"
Oct 31 17:27:12.995125 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:12.995078    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ef27850a-20b3-4876-8330-57e8954f1a79-host-cni-bin\") pod \"ovnkube-node-v8sbm\" (UID: \"ef27850a-20b3-4876-8330-57e8954f1a79\") " pod="openshift-ovn-kubernetes/ovnkube-node-v8sbm"
Oct 31 17:27:12.995125 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:12.995102    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/eaed4088-d322-48ab-af04-3c9efdea4e73-hosts-file\") pod \"node-resolver-x25tg\" (UID: \"eaed4088-d322-48ab-af04-3c9efdea4e73\") " pod="openshift-dns/node-resolver-x25tg"
Oct 31 17:27:12.995125 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:12.995128    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q9ctx\" (UniqueName: \"kubernetes.io/projected/eaed4088-d322-48ab-af04-3c9efdea4e73-kube-api-access-q9ctx\") pod \"node-resolver-x25tg\" (UID: \"eaed4088-d322-48ab-af04-3c9efdea4e73\") " pod="openshift-dns/node-resolver-x25tg"
Oct 31 17:27:12.995494 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:12.995155    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/27af0f99-138f-42ac-89b9-9dfc4a522483-etc-kubernetes\") pod \"multus-9zs6c\" (UID: \"27af0f99-138f-42ac-89b9-9dfc4a522483\") " pod="openshift-multus/multus-9zs6c"
Oct 31 17:27:12.995494 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:12.995205    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9d9ecf7f-6a11-469b-8626-99d5ef7ffac7-registry-tls\") pod \"image-registry-869fc8694f-xcqzj\" (UID: \"9d9ecf7f-6a11-469b-8626-99d5ef7ffac7\") " pod="openshift-image-registry/image-registry-869fc8694f-xcqzj"
Oct 31 17:27:12.995494 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:12.995207    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8e32277f-062d-4c16-81ca-b12e65b24fbb-service-ca-bundle\") pod \"insights-operator-7c4986d449-tggxv\" (UID: \"8e32277f-062d-4c16-81ca-b12e65b24fbb\") " pod="openshift-insights/insights-operator-7c4986d449-tggxv"
Oct 31 17:27:12.995494 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:12.995242    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/948f2c4e-81a5-4c0e-9ec9-f4fb56368b87-trusted-ca-bundle\") pod \"periodic-gathering-vhvfz-6pbpt\" (UID: \"948f2c4e-81a5-4c0e-9ec9-f4fb56368b87\") " pod="openshift-insights/periodic-gathering-vhvfz-6pbpt"
Oct 31 17:27:12.995494 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:12.995294    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f88d4\" (UniqueName: \"kubernetes.io/projected/f03611db-3bd9-401a-a137-1d4f691b51ea-kube-api-access-f88d4\") pod \"console-operator-7cd56b8dbc-b2xxw\" (UID: \"f03611db-3bd9-401a-a137-1d4f691b51ea\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-b2xxw"
Oct 31 17:27:12.995494 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:12.995312    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ef27850a-20b3-4876-8330-57e8954f1a79-ovnkube-config\") pod \"ovnkube-node-v8sbm\" (UID: \"ef27850a-20b3-4876-8330-57e8954f1a79\") " pod="openshift-ovn-kubernetes/ovnkube-node-v8sbm"
Oct 31 17:27:12.995494 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:12.995321    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/3aa3a055-ec26-4d70-bb04-d6a09abe6661-crio-socket\") pod \"insights-runtime-extractor-tdzz5\" (UID: \"3aa3a055-ec26-4d70-bb04-d6a09abe6661\") " pod="openshift-insights/insights-runtime-extractor-tdzz5"
Oct 31 17:27:12.995494 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:12.995344    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/170ada34-8944-43d2-bcfb-1d782aae5348-registry-certificates\") pod \"image-registry-74dbfdb444-q7rkg\" (UID: \"170ada34-8944-43d2-bcfb-1d782aae5348\") " pod="openshift-image-registry/image-registry-74dbfdb444-q7rkg"
Oct 31 17:27:12.995494 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:12.995438    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0c8a8a3b-14dd-45c9-b8fb-baf967142fd6-host\") pod \"tuned-zm6cj\" (UID: \"0c8a8a3b-14dd-45c9-b8fb-baf967142fd6\") " pod="openshift-cluster-node-tuning-operator/tuned-zm6cj"
Oct 31 17:27:12.995494 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:12.995472    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/27af0f99-138f-42ac-89b9-9dfc4a522483-host-var-lib-cni-multus\") pod \"multus-9zs6c\" (UID: \"27af0f99-138f-42ac-89b9-9dfc4a522483\") " pod="openshift-multus/multus-9zs6c"
Oct 31 17:27:12.995494 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:12.995492    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9d9ecf7f-6a11-469b-8626-99d5ef7ffac7-installation-pull-secrets\") pod \"image-registry-869fc8694f-xcqzj\" (UID: \"9d9ecf7f-6a11-469b-8626-99d5ef7ffac7\") " pod="openshift-image-registry/image-registry-869fc8694f-xcqzj"
Oct 31 17:27:12.996033 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:12.995517    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-config\" (UniqueName: \"kubernetes.io/configmap/ec682f92-b657-44bd-9e85-3cd4680d2f95-samples-operator-config\") pod \"cluster-samples-operator-6ddb6c8b94-rhsk4\" (UID: \"ec682f92-b657-44bd-9e85-3cd4680d2f95\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-rhsk4"
Oct 31 17:27:12.996033 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:12.995558    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/86312227-efeb-4196-ab2d-3b4b03e5c50f-agent-certs\") pod \"konnectivity-agent-vghkb\" (UID: \"86312227-efeb-4196-ab2d-3b4b03e5c50f\") " pod="kube-system/konnectivity-agent-vghkb"
Oct 31 17:27:12.996033 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:12.995582    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ef27850a-20b3-4876-8330-57e8954f1a79-host-cni-netd\") pod \"ovnkube-node-v8sbm\" (UID: \"ef27850a-20b3-4876-8330-57e8954f1a79\") " pod="openshift-ovn-kubernetes/ovnkube-node-v8sbm"
Oct 31 17:27:12.996033 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:12.995606    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b1e258da-4619-478c-895a-041aa7eeafb6-host-slash\") pod \"iptables-alerter-h8jzv\" (UID: \"b1e258da-4619-478c-895a-041aa7eeafb6\") " pod="openshift-network-operator/iptables-alerter-h8jzv"
Oct 31 17:27:12.996033 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:12.995666    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/948f2c4e-81a5-4c0e-9ec9-f4fb56368b87-trusted-ca-bundle\") pod \"periodic-gathering-vhvfz-6pbpt\" (UID: \"948f2c4e-81a5-4c0e-9ec9-f4fb56368b87\") " pod="openshift-insights/periodic-gathering-vhvfz-6pbpt"
Oct 31 17:27:12.996033 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:12.995674    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2ln8r\" (UniqueName: \"kubernetes.io/projected/88be474b-fd0b-4784-8f1c-2dc0bdfb2792-kube-api-access-2ln8r\") pod \"aws-ebs-csi-driver-node-ldjrw\" (UID: \"88be474b-fd0b-4784-8f1c-2dc0bdfb2792\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ldjrw"
Oct 31 17:27:12.996033 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:12.995719    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/9179e3c5-ef52-4445-aec0-779c3e99cb07-kubelet-config\") pod \"global-pull-secret-syncer-qgtf4\" (UID: \"9179e3c5-ef52-4445-aec0-779c3e99cb07\") " pod="kube-system/global-pull-secret-syncer-qgtf4"
Oct 31 17:27:12.996033 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:12.995720    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-config\" (UniqueName: \"kubernetes.io/configmap/ec682f92-b657-44bd-9e85-3cd4680d2f95-samples-operator-config\") pod \"cluster-samples-operator-6ddb6c8b94-rhsk4\" (UID: \"ec682f92-b657-44bd-9e85-3cd4680d2f95\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-rhsk4"
Oct 31 17:27:12.996033 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:12.995750    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/9179e3c5-ef52-4445-aec0-779c3e99cb07-dbus\") pod \"global-pull-secret-syncer-qgtf4\" (UID: \"9179e3c5-ef52-4445-aec0-779c3e99cb07\") " pod="kube-system/global-pull-secret-syncer-qgtf4"
Oct 31 17:27:12.996033 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:12.995825    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9d9ecf7f-6a11-469b-8626-99d5ef7ffac7-installation-pull-secrets\") pod \"image-registry-869fc8694f-xcqzj\" (UID: \"9d9ecf7f-6a11-469b-8626-99d5ef7ffac7\") " pod="openshift-image-registry/image-registry-869fc8694f-xcqzj"
Oct 31 17:27:12.996033 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:12.995846    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/27af0f99-138f-42ac-89b9-9dfc4a522483-host-run-k8s-cni-cncf-io\") pod \"multus-9zs6c\" (UID: \"27af0f99-138f-42ac-89b9-9dfc4a522483\") " pod="openshift-multus/multus-9zs6c"
Oct 31 17:27:12.996033 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:12.995882    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rkfhx\" (UniqueName: \"kubernetes.io/projected/a26cba9f-c44a-405d-8e3d-de4bc5b6d6c0-kube-api-access-rkfhx\") pod \"migrator-66df5d496b-t48lj\" (UID: \"a26cba9f-c44a-405d-8e3d-de4bc5b6d6c0\") " pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-t48lj"
Oct 31 17:27:12.996033 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:12.995908    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f03611db-3bd9-401a-a137-1d4f691b51ea-trusted-ca\") pod \"console-operator-7cd56b8dbc-b2xxw\" (UID: \"f03611db-3bd9-401a-a137-1d4f691b51ea\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-b2xxw"
Oct 31 17:27:12.996033 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:12.995931    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/fe1c5f7c-fdfd-40b9-bc0f-4e018779ee2b-cnibin\") pod \"multus-additional-cni-plugins-swb7n\" (UID: \"fe1c5f7c-fdfd-40b9-bc0f-4e018779ee2b\") " pod="openshift-multus/multus-additional-cni-plugins-swb7n"
Oct 31 17:27:12.996033 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:12.995948    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ef27850a-20b3-4876-8330-57e8954f1a79-host-slash\") pod \"ovnkube-node-v8sbm\" (UID: \"ef27850a-20b3-4876-8330-57e8954f1a79\") " pod="openshift-ovn-kubernetes/ovnkube-node-v8sbm"
Oct 31 17:27:12.996033 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:12.995976    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/c915138c-9050-4958-b442-fee1aca9b002-serviceca\") pod \"node-ca-lcz9q\" (UID: \"c915138c-9050-4958-b442-fee1aca9b002\") " pod="openshift-image-registry/node-ca-lcz9q"
Oct 31 17:27:12.996755 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:12.996043    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ghqc6\" (UniqueName: \"kubernetes.io/projected/b1e258da-4619-478c-895a-041aa7eeafb6-kube-api-access-ghqc6\") pod \"iptables-alerter-h8jzv\" (UID: \"b1e258da-4619-478c-895a-041aa7eeafb6\") " pod="openshift-network-operator/iptables-alerter-h8jzv"
Oct 31 17:27:12.996755 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:12.996082    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/27af0f99-138f-42ac-89b9-9dfc4a522483-host-run-netns\") pod \"multus-9zs6c\" (UID: \"27af0f99-138f-42ac-89b9-9dfc4a522483\") " pod="openshift-multus/multus-9zs6c"
Oct 31 17:27:12.996755 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:12.996096    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/86312227-efeb-4196-ab2d-3b4b03e5c50f-agent-certs\") pod \"konnectivity-agent-vghkb\" (UID: \"86312227-efeb-4196-ab2d-3b4b03e5c50f\") " pod="kube-system/konnectivity-agent-vghkb"
Oct 31 17:27:12.996755 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:12.996107    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9d9ecf7f-6a11-469b-8626-99d5ef7ffac7-trusted-ca\") pod \"image-registry-869fc8694f-xcqzj\" (UID: \"9d9ecf7f-6a11-469b-8626-99d5ef7ffac7\") " pod="openshift-image-registry/image-registry-869fc8694f-xcqzj"
Oct 31 17:27:12.996755 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:12.996132    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9d9ecf7f-6a11-469b-8626-99d5ef7ffac7-bound-sa-token\") pod \"image-registry-869fc8694f-xcqzj\" (UID: \"9d9ecf7f-6a11-469b-8626-99d5ef7ffac7\") " pod="openshift-image-registry/image-registry-869fc8694f-xcqzj"
Oct 31 17:27:12.996755 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:12.996157    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/170ada34-8944-43d2-bcfb-1d782aae5348-image-registry-private-configuration\") pod \"image-registry-74dbfdb444-q7rkg\" (UID: \"170ada34-8944-43d2-bcfb-1d782aae5348\") " pod="openshift-image-registry/image-registry-74dbfdb444-q7rkg"
Oct 31 17:27:12.996755 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:12.996185    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/86312227-efeb-4196-ab2d-3b4b03e5c50f-konnectivity-ca\") pod \"konnectivity-agent-vghkb\" (UID: \"86312227-efeb-4196-ab2d-3b4b03e5c50f\") " pod="kube-system/konnectivity-agent-vghkb"
Oct 31 17:27:12.996755 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:12.996232    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/88be474b-fd0b-4784-8f1c-2dc0bdfb2792-etc-selinux\") pod \"aws-ebs-csi-driver-node-ldjrw\" (UID: \"88be474b-fd0b-4784-8f1c-2dc0bdfb2792\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ldjrw"
Oct 31 17:27:12.996755 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:12.996251    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f03611db-3bd9-401a-a137-1d4f691b51ea-trusted-ca\") pod \"console-operator-7cd56b8dbc-b2xxw\" (UID: \"f03611db-3bd9-401a-a137-1d4f691b51ea\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-b2xxw"
Oct 31 17:27:12.996755 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:12.996261    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/27af0f99-138f-42ac-89b9-9dfc4a522483-multus-conf-dir\") pod \"multus-9zs6c\" (UID: \"27af0f99-138f-42ac-89b9-9dfc4a522483\") " pod="openshift-multus/multus-9zs6c"
Oct 31 17:27:12.996755 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:12.996295    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/27af0f99-138f-42ac-89b9-9dfc4a522483-system-cni-dir\") pod \"multus-9zs6c\" (UID: \"27af0f99-138f-42ac-89b9-9dfc4a522483\") " pod="openshift-multus/multus-9zs6c"
Oct 31 17:27:12.996755 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:12.996451    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/27af0f99-138f-42ac-89b9-9dfc4a522483-multus-socket-dir-parent\") pod \"multus-9zs6c\" (UID: \"27af0f99-138f-42ac-89b9-9dfc4a522483\") " pod="openshift-multus/multus-9zs6c"
Oct 31 17:27:12.996755 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:12.996465    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9d9ecf7f-6a11-469b-8626-99d5ef7ffac7-trusted-ca\") pod \"image-registry-869fc8694f-xcqzj\" (UID: \"9d9ecf7f-6a11-469b-8626-99d5ef7ffac7\") " pod="openshift-image-registry/image-registry-869fc8694f-xcqzj"
Oct 31 17:27:12.996755 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:12.996474    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/86312227-efeb-4196-ab2d-3b4b03e5c50f-konnectivity-ca\") pod \"konnectivity-agent-vghkb\" (UID: \"86312227-efeb-4196-ab2d-3b4b03e5c50f\") " pod="kube-system/konnectivity-agent-vghkb"
Oct 31 17:27:12.996755 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:12.996479    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/170ada34-8944-43d2-bcfb-1d782aae5348-image-registry-private-configuration\") pod \"image-registry-74dbfdb444-q7rkg\" (UID: \"170ada34-8944-43d2-bcfb-1d782aae5348\") " pod="openshift-image-registry/image-registry-74dbfdb444-q7rkg"
Oct 31 17:27:12.996755 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:12.996496    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ef27850a-20b3-4876-8330-57e8954f1a79-ovn-node-metrics-cert\") pod \"ovnkube-node-v8sbm\" (UID: \"ef27850a-20b3-4876-8330-57e8954f1a79\") " pod="openshift-ovn-kubernetes/ovnkube-node-v8sbm"
Oct 31 17:27:12.996755 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:12.996534    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ef27850a-20b3-4876-8330-57e8954f1a79-ovnkube-script-lib\") pod \"ovnkube-node-v8sbm\" (UID: \"ef27850a-20b3-4876-8330-57e8954f1a79\") " pod="openshift-ovn-kubernetes/ovnkube-node-v8sbm"
Oct 31 17:27:12.996755 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:12.996548    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/c915138c-9050-4958-b442-fee1aca9b002-serviceca\") pod \"node-ca-lcz9q\" (UID: \"c915138c-9050-4958-b442-fee1aca9b002\") " pod="openshift-image-registry/node-ca-lcz9q"
Oct 31 17:27:12.996755 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:12.996629    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kdg6k\" (UniqueName: \"kubernetes.io/projected/fef8c517-3be6-4cc1-908a-9e0116d8f978-kube-api-access-kdg6k\") pod \"migrator-66df5d496b-lfxtw\" (UID: \"fef8c517-3be6-4cc1-908a-9e0116d8f978\") " pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-lfxtw"
Oct 31 17:27:12.996755 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:12.996760    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kqpvj\" (UniqueName: \"kubernetes.io/projected/25ad5c67-f563-4653-9e86-7e9ecbe78675-kube-api-access-kqpvj\") pod \"dns-default-7v7x4\" (UID: \"25ad5c67-f563-4653-9e86-7e9ecbe78675\") " pod="openshift-dns/dns-default-7v7x4"
Oct 31 17:27:12.997563 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:12.996804    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/170ada34-8944-43d2-bcfb-1d782aae5348-registry-tls\") pod \"image-registry-74dbfdb444-q7rkg\" (UID: \"170ada34-8944-43d2-bcfb-1d782aae5348\") " pod="openshift-image-registry/image-registry-74dbfdb444-q7rkg"
Oct 31 17:27:12.997563 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:12.996822    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c915138c-9050-4958-b442-fee1aca9b002-host\") pod \"node-ca-lcz9q\" (UID: \"c915138c-9050-4958-b442-fee1aca9b002\") " pod="openshift-image-registry/node-ca-lcz9q"
Oct 31 17:27:12.997563 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:12.996889    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ef27850a-20b3-4876-8330-57e8954f1a79-ovnkube-script-lib\") pod \"ovnkube-node-v8sbm\" (UID: \"ef27850a-20b3-4876-8330-57e8954f1a79\") " pod="openshift-ovn-kubernetes/ovnkube-node-v8sbm"
Oct 31 17:27:12.997563 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:12.996910    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/27af0f99-138f-42ac-89b9-9dfc4a522483-host-var-lib-kubelet\") pod \"multus-9zs6c\" (UID: \"27af0f99-138f-42ac-89b9-9dfc4a522483\") " pod="openshift-multus/multus-9zs6c"
Oct 31 17:27:12.997563 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:12.996928    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/170ada34-8944-43d2-bcfb-1d782aae5348-bound-sa-token\") pod \"image-registry-74dbfdb444-q7rkg\" (UID: \"170ada34-8944-43d2-bcfb-1d782aae5348\") " pod="openshift-image-registry/image-registry-74dbfdb444-q7rkg"
Oct 31 17:27:12.997563 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:12.996956    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z57fk\" (UniqueName: \"kubernetes.io/projected/c390ea6f-c609-40f7-a9ec-53fd5c08d857-kube-api-access-z57fk\") pod \"ingress-canary-ptxt2\" (UID: \"c390ea6f-c609-40f7-a9ec-53fd5c08d857\") " pod="openshift-ingress-canary/ingress-canary-ptxt2"
Oct 31 17:27:12.997563 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:12.996981    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/8a9e5aa4-f4fc-4b33-a925-8e63df6c9cd2-serving-cert\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-4xtm4\" (UID: \"8a9e5aa4-f4fc-4b33-a925-8e63df6c9cd2\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-4xtm4"
Oct 31 17:27:12.997563 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:12.996970    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ef27850a-20b3-4876-8330-57e8954f1a79-ovn-node-metrics-cert\") pod \"ovnkube-node-v8sbm\" (UID: \"ef27850a-20b3-4876-8330-57e8954f1a79\") " pod="openshift-ovn-kubernetes/ovnkube-node-v8sbm"
Oct 31 17:27:12.997563 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:12.997097    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/88be474b-fd0b-4784-8f1c-2dc0bdfb2792-socket-dir\") pod \"aws-ebs-csi-driver-node-ldjrw\" (UID: \"88be474b-fd0b-4784-8f1c-2dc0bdfb2792\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ldjrw"
Oct 31 17:27:12.997563 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:12.997134    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/88be474b-fd0b-4784-8f1c-2dc0bdfb2792-device-dir\") pod \"aws-ebs-csi-driver-node-ldjrw\" (UID: \"88be474b-fd0b-4784-8f1c-2dc0bdfb2792\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ldjrw"
Oct 31 17:27:12.997563 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:12.997182    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/fe1c5f7c-fdfd-40b9-bc0f-4e018779ee2b-cni-binary-copy\") pod \"multus-additional-cni-plugins-swb7n\" (UID: \"fe1c5f7c-fdfd-40b9-bc0f-4e018779ee2b\") " pod="openshift-multus/multus-additional-cni-plugins-swb7n"
Oct 31 17:27:12.997563 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:12.997201    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/8a9e5aa4-f4fc-4b33-a925-8e63df6c9cd2-serving-cert\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-4xtm4\" (UID: \"8a9e5aa4-f4fc-4b33-a925-8e63df6c9cd2\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-4xtm4"
Oct 31 17:27:12.997563 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:12.997238    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/0c8a8a3b-14dd-45c9-b8fb-baf967142fd6-etc-sysctl-conf\") pod \"tuned-zm6cj\" (UID: \"0c8a8a3b-14dd-45c9-b8fb-baf967142fd6\") " pod="openshift-cluster-node-tuning-operator/tuned-zm6cj"
Oct 31 17:27:12.997563 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:12.997267    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/449efcb2-6707-4809-b869-1bb477f6e6ae-metrics-certs\") pod \"network-metrics-daemon-7j59v\" (UID: \"449efcb2-6707-4809-b869-1bb477f6e6ae\") " pod="openshift-multus/network-metrics-daemon-7j59v"
Oct 31 17:27:12.997563 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:12.997359    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/3aa3a055-ec26-4d70-bb04-d6a09abe6661-data-volume\") pod \"insights-runtime-extractor-tdzz5\" (UID: \"3aa3a055-ec26-4d70-bb04-d6a09abe6661\") " pod="openshift-insights/insights-runtime-extractor-tdzz5"
Oct 31 17:27:12.997563 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:12.997394    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/fe1c5f7c-fdfd-40b9-bc0f-4e018779ee2b-cni-binary-copy\") pod \"multus-additional-cni-plugins-swb7n\" (UID: \"fe1c5f7c-fdfd-40b9-bc0f-4e018779ee2b\") " pod="openshift-multus/multus-additional-cni-plugins-swb7n"
Oct 31 17:27:12.997563 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:12.997394    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ef27850a-20b3-4876-8330-57e8954f1a79-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-v8sbm\" (UID: \"ef27850a-20b3-4876-8330-57e8954f1a79\") " pod="openshift-ovn-kubernetes/ovnkube-node-v8sbm"
Oct 31 17:27:12.997563 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:12.997426    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/3aa3a055-ec26-4d70-bb04-d6a09abe6661-data-volume\") pod \"insights-runtime-extractor-tdzz5\" (UID: \"3aa3a055-ec26-4d70-bb04-d6a09abe6661\") " pod="openshift-insights/insights-runtime-extractor-tdzz5"
Oct 31 17:27:12.997563 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:12.997435    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-69jvk\" (UniqueName: \"kubernetes.io/projected/ef27850a-20b3-4876-8330-57e8954f1a79-kube-api-access-69jvk\") pod \"ovnkube-node-v8sbm\" (UID: \"ef27850a-20b3-4876-8330-57e8954f1a79\") " pod="openshift-ovn-kubernetes/ovnkube-node-v8sbm"
Oct 31 17:27:12.997563 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:12.997488    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8e32277f-062d-4c16-81ca-b12e65b24fbb-tmp\") pod \"insights-operator-7c4986d449-tggxv\" (UID: \"8e32277f-062d-4c16-81ca-b12e65b24fbb\") " pod="openshift-insights/insights-operator-7c4986d449-tggxv"
Oct 31 17:27:12.997563 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:12.997543    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ef27850a-20b3-4876-8330-57e8954f1a79-host-kubelet\") pod \"ovnkube-node-v8sbm\" (UID: \"ef27850a-20b3-4876-8330-57e8954f1a79\") " pod="openshift-ovn-kubernetes/ovnkube-node-v8sbm"
Oct 31 17:27:12.997563 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:12.997584    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8e32277f-062d-4c16-81ca-b12e65b24fbb-tmp\") pod \"insights-operator-7c4986d449-tggxv\" (UID: \"8e32277f-062d-4c16-81ca-b12e65b24fbb\") " pod="openshift-insights/insights-operator-7c4986d449-tggxv"
Oct 31 17:27:12.999130 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:12.997590    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/0c8a8a3b-14dd-45c9-b8fb-baf967142fd6-etc-sysconfig\") pod \"tuned-zm6cj\" (UID: \"0c8a8a3b-14dd-45c9-b8fb-baf967142fd6\") " pod="openshift-cluster-node-tuning-operator/tuned-zm6cj"
Oct 31 17:27:12.999130 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:12.997618    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/27af0f99-138f-42ac-89b9-9dfc4a522483-host-run-multus-certs\") pod \"multus-9zs6c\" (UID: \"27af0f99-138f-42ac-89b9-9dfc4a522483\") " pod="openshift-multus/multus-9zs6c"
Oct 31 17:27:12.999130 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:12.997663    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2330cbe7-498c-4f39-ba1b-3873e125dd18-serving-cert\") pod \"service-ca-operator-544d749c8c-7lspr\" (UID: \"2330cbe7-498c-4f39-ba1b-3873e125dd18\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-7lspr"
Oct 31 17:27:12.999130 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:12.997701    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-96ckd\" (UniqueName: \"kubernetes.io/projected/5d30d9b6-0431-47f2-b06c-8a03d4f59b97-kube-api-access-96ckd\") pod \"network-check-target-pqs8z\" (UID: \"5d30d9b6-0431-47f2-b06c-8a03d4f59b97\") " pod="openshift-network-diagnostics/network-check-target-pqs8z"
Oct 31 17:27:12.999130 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:12.997735    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/a1bea244-6573-4e3c-9849-b27ade411c9f-telemetry-config\") pod \"cluster-monitoring-operator-884576c57-csbxp\" (UID: \"a1bea244-6573-4e3c-9849-b27ade411c9f\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-csbxp"
Oct 31 17:27:12.999130 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:12.997759    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9d9ecf7f-6a11-469b-8626-99d5ef7ffac7-ca-trust-extracted\") pod \"image-registry-869fc8694f-xcqzj\" (UID: \"9d9ecf7f-6a11-469b-8626-99d5ef7ffac7\") " pod="openshift-image-registry/image-registry-869fc8694f-xcqzj"
Oct 31 17:27:12.999130 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:12.997784    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3aa3a055-ec26-4d70-bb04-d6a09abe6661-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-tdzz5\" (UID: \"3aa3a055-ec26-4d70-bb04-d6a09abe6661\") " pod="openshift-insights/insights-runtime-extractor-tdzz5"
Oct 31 17:27:12.999130 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:12.997813    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5x4hs\" (UniqueName: \"kubernetes.io/projected/8e32277f-062d-4c16-81ca-b12e65b24fbb-kube-api-access-5x4hs\") pod \"insights-operator-7c4986d449-tggxv\" (UID: \"8e32277f-062d-4c16-81ca-b12e65b24fbb\") " pod="openshift-insights/insights-operator-7c4986d449-tggxv"
Oct 31 17:27:12.999130 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:12.997827    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2330cbe7-498c-4f39-ba1b-3873e125dd18-serving-cert\") pod \"service-ca-operator-544d749c8c-7lspr\" (UID: \"2330cbe7-498c-4f39-ba1b-3873e125dd18\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-7lspr"
Oct 31 17:27:12.999130 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:12.997870    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/27af0f99-138f-42ac-89b9-9dfc4a522483-cni-binary-copy\") pod \"multus-9zs6c\" (UID: \"27af0f99-138f-42ac-89b9-9dfc4a522483\") " pod="openshift-multus/multus-9zs6c"
Oct 31 17:27:12.999130 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:12.997891    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9d9ecf7f-6a11-469b-8626-99d5ef7ffac7-ca-trust-extracted\") pod \"image-registry-869fc8694f-xcqzj\" (UID: \"9d9ecf7f-6a11-469b-8626-99d5ef7ffac7\") " pod="openshift-image-registry/image-registry-869fc8694f-xcqzj"
Oct 31 17:27:12.999130 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:12.997904    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j86wf\" (UniqueName: \"kubernetes.io/projected/d5856011-8f77-4e60-8ecc-c7ac852a50b0-kube-api-access-j86wf\") pod \"network-check-source-6f78d59f99-qkkwm\" (UID: \"d5856011-8f77-4e60-8ecc-c7ac852a50b0\") " pod="openshift-network-diagnostics/network-check-source-6f78d59f99-qkkwm"
Oct 31 17:27:12.999130 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:12.997931    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/170ada34-8944-43d2-bcfb-1d782aae5348-ca-trust-extracted\") pod \"image-registry-74dbfdb444-q7rkg\" (UID: \"170ada34-8944-43d2-bcfb-1d782aae5348\") " pod="openshift-image-registry/image-registry-74dbfdb444-q7rkg"
Oct 31 17:27:12.999130 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:12.997958    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/50e82975-3344-4653-8de3-68e8a64a8757-metrics-certs\") pod \"router-default-65db5d9749-xvqmh\" (UID: \"50e82975-3344-4653-8de3-68e8a64a8757\") " pod="openshift-ingress/router-default-65db5d9749-xvqmh"
Oct 31 17:27:12.999130 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:12.997984    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ef27850a-20b3-4876-8330-57e8954f1a79-var-lib-openvswitch\") pod \"ovnkube-node-v8sbm\" (UID: \"ef27850a-20b3-4876-8330-57e8954f1a79\") " pod="openshift-ovn-kubernetes/ovnkube-node-v8sbm"
Oct 31 17:27:12.999130 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:12.997997    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/a1bea244-6573-4e3c-9849-b27ade411c9f-telemetry-config\") pod \"cluster-monitoring-operator-884576c57-csbxp\" (UID: \"a1bea244-6573-4e3c-9849-b27ade411c9f\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-csbxp"
Oct 31 17:27:12.999130 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:12.998011    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6tlzl\" (UniqueName: \"kubernetes.io/projected/8a9e5aa4-f4fc-4b33-a925-8e63df6c9cd2-kube-api-access-6tlzl\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-4xtm4\" (UID: \"8a9e5aa4-f4fc-4b33-a925-8e63df6c9cd2\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-4xtm4"
Oct 31 17:27:12.999130 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:12.998038    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/170ada34-8944-43d2-bcfb-1d782aae5348-ca-trust-extracted\") pod \"image-registry-74dbfdb444-q7rkg\" (UID: \"170ada34-8944-43d2-bcfb-1d782aae5348\") " pod="openshift-image-registry/image-registry-74dbfdb444-q7rkg"
Oct 31 17:27:12.999130 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:12.998045    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/8e32277f-062d-4c16-81ca-b12e65b24fbb-serving-cert\") pod \"insights-operator-7c4986d449-tggxv\" (UID: \"8e32277f-062d-4c16-81ca-b12e65b24fbb\") " pod="openshift-insights/insights-operator-7c4986d449-tggxv"
Oct 31 17:27:12.999130 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:12.998081    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/27af0f99-138f-42ac-89b9-9dfc4a522483-host-var-lib-cni-bin\") pod \"multus-9zs6c\" (UID: \"27af0f99-138f-42ac-89b9-9dfc4a522483\") " pod="openshift-multus/multus-9zs6c"
Oct 31 17:27:12.999130 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:12.998179    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/27af0f99-138f-42ac-89b9-9dfc4a522483-cni-binary-copy\") pod \"multus-9zs6c\" (UID: \"27af0f99-138f-42ac-89b9-9dfc4a522483\") " pod="openshift-multus/multus-9zs6c"
Oct 31 17:27:12.999130 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:12.998186    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c6ctd\" (UniqueName: \"kubernetes.io/projected/27af0f99-138f-42ac-89b9-9dfc4a522483-kube-api-access-c6ctd\") pod \"multus-9zs6c\" (UID: \"27af0f99-138f-42ac-89b9-9dfc4a522483\") " pod="openshift-multus/multus-9zs6c"
Oct 31 17:27:12.999130 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:12.998213    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0c8a8a3b-14dd-45c9-b8fb-baf967142fd6-sys\") pod \"tuned-zm6cj\" (UID: \"0c8a8a3b-14dd-45c9-b8fb-baf967142fd6\") " pod="openshift-cluster-node-tuning-operator/tuned-zm6cj"
Oct 31 17:27:12.999130 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:12.998247    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0c8a8a3b-14dd-45c9-b8fb-baf967142fd6-lib-modules\") pod \"tuned-zm6cj\" (UID: \"0c8a8a3b-14dd-45c9-b8fb-baf967142fd6\") " pod="openshift-cluster-node-tuning-operator/tuned-zm6cj"
Oct 31 17:27:12.999130 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:12.998286    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/ec682f92-b657-44bd-9e85-3cd4680d2f95-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-rhsk4\" (UID: \"ec682f92-b657-44bd-9e85-3cd4680d2f95\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-rhsk4"
Oct 31 17:27:12.999130 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:12.998345    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6vzgd\" (UniqueName: \"kubernetes.io/projected/2330cbe7-498c-4f39-ba1b-3873e125dd18-kube-api-access-6vzgd\") pod \"service-ca-operator-544d749c8c-7lspr\" (UID: \"2330cbe7-498c-4f39-ba1b-3873e125dd18\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-7lspr"
Oct 31 17:27:12.999130 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:12.998374    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ef27850a-20b3-4876-8330-57e8954f1a79-run-systemd\") pod \"ovnkube-node-v8sbm\" (UID: \"ef27850a-20b3-4876-8330-57e8954f1a79\") " pod="openshift-ovn-kubernetes/ovnkube-node-v8sbm"
Oct 31 17:27:12.999130 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:12.998466    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/0c8a8a3b-14dd-45c9-b8fb-baf967142fd6-etc-tuned\") pod \"tuned-zm6cj\" (UID: \"0c8a8a3b-14dd-45c9-b8fb-baf967142fd6\") " pod="openshift-cluster-node-tuning-operator/tuned-zm6cj"
Oct 31 17:27:12.999130 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:12.998469    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/8e32277f-062d-4c16-81ca-b12e65b24fbb-serving-cert\") pod \"insights-operator-7c4986d449-tggxv\" (UID: \"8e32277f-062d-4c16-81ca-b12e65b24fbb\") " pod="openshift-insights/insights-operator-7c4986d449-tggxv"
Oct 31 17:27:12.999130 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:12.998484    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/0c8a8a3b-14dd-45c9-b8fb-baf967142fd6-etc-modprobe-d\") pod \"tuned-zm6cj\" (UID: \"0c8a8a3b-14dd-45c9-b8fb-baf967142fd6\") " pod="openshift-cluster-node-tuning-operator/tuned-zm6cj"
Oct 31 17:27:12.999130 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:12.998511    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mgwcl\" (UniqueName: \"kubernetes.io/projected/9d9ecf7f-6a11-469b-8626-99d5ef7ffac7-kube-api-access-mgwcl\") pod \"image-registry-869fc8694f-xcqzj\" (UID: \"9d9ecf7f-6a11-469b-8626-99d5ef7ffac7\") " pod="openshift-image-registry/image-registry-869fc8694f-xcqzj"
Oct 31 17:27:12.999130 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:12.998535    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ef27850a-20b3-4876-8330-57e8954f1a79-etc-openvswitch\") pod \"ovnkube-node-v8sbm\" (UID: \"ef27850a-20b3-4876-8330-57e8954f1a79\") " pod="openshift-ovn-kubernetes/ovnkube-node-v8sbm"
Oct 31 17:27:12.999130 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:12.998583    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/0c8a8a3b-14dd-45c9-b8fb-baf967142fd6-etc-tuned\") pod \"tuned-zm6cj\" (UID: \"0c8a8a3b-14dd-45c9-b8fb-baf967142fd6\") " pod="openshift-cluster-node-tuning-operator/tuned-zm6cj"
Oct 31 17:27:12.999130 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:12.998595    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/b1e258da-4619-478c-895a-041aa7eeafb6-iptables-alerter-script\") pod \"iptables-alerter-h8jzv\" (UID: \"b1e258da-4619-478c-895a-041aa7eeafb6\") " pod="openshift-network-operator/iptables-alerter-h8jzv"
Oct 31 17:27:12.999130 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:12.998627    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h6b47\" (UniqueName: \"kubernetes.io/projected/170ada34-8944-43d2-bcfb-1d782aae5348-kube-api-access-h6b47\") pod \"image-registry-74dbfdb444-q7rkg\" (UID: \"170ada34-8944-43d2-bcfb-1d782aae5348\") " pod="openshift-image-registry/image-registry-74dbfdb444-q7rkg"
Oct 31 17:27:12.999130 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:12.998666    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/50e82975-3344-4653-8de3-68e8a64a8757-stats-auth\") pod \"router-default-65db5d9749-xvqmh\" (UID: \"50e82975-3344-4653-8de3-68e8a64a8757\") " pod="openshift-ingress/router-default-65db5d9749-xvqmh"
Oct 31 17:27:12.999130 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:12.998773    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ef27850a-20b3-4876-8330-57e8954f1a79-host-run-netns\") pod \"ovnkube-node-v8sbm\" (UID: \"ef27850a-20b3-4876-8330-57e8954f1a79\") " pod="openshift-ovn-kubernetes/ovnkube-node-v8sbm"
Oct 31 17:27:12.999130 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:12.998796    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ef27850a-20b3-4876-8330-57e8954f1a79-host-run-ovn-kubernetes\") pod \"ovnkube-node-v8sbm\" (UID: \"ef27850a-20b3-4876-8330-57e8954f1a79\") " pod="openshift-ovn-kubernetes/ovnkube-node-v8sbm"
Oct 31 17:27:12.999130 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:12.998858    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/948f2c4e-81a5-4c0e-9ec9-f4fb56368b87-service-ca-bundle\") pod \"periodic-gathering-vhvfz-6pbpt\" (UID: \"948f2c4e-81a5-4c0e-9ec9-f4fb56368b87\") " pod="openshift-insights/periodic-gathering-vhvfz-6pbpt"
Oct 31 17:27:12.999130 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:12.998874    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/b1e258da-4619-478c-895a-041aa7eeafb6-iptables-alerter-script\") pod \"iptables-alerter-h8jzv\" (UID: \"b1e258da-4619-478c-895a-041aa7eeafb6\") " pod="openshift-network-operator/iptables-alerter-h8jzv"
Oct 31 17:27:12.999130 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:12.998889    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/27af0f99-138f-42ac-89b9-9dfc4a522483-hostroot\") pod \"multus-9zs6c\" (UID: \"27af0f99-138f-42ac-89b9-9dfc4a522483\") " pod="openshift-multus/multus-9zs6c"
Oct 31 17:27:12.999130 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:12.998917    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/170ada34-8944-43d2-bcfb-1d782aae5348-trusted-ca\") pod \"image-registry-74dbfdb444-q7rkg\" (UID: \"170ada34-8944-43d2-bcfb-1d782aae5348\") " pod="openshift-image-registry/image-registry-74dbfdb444-q7rkg"
Oct 31 17:27:12.999130 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:12.998919    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/50e82975-3344-4653-8de3-68e8a64a8757-stats-auth\") pod \"router-default-65db5d9749-xvqmh\" (UID: \"50e82975-3344-4653-8de3-68e8a64a8757\") " pod="openshift-ingress/router-default-65db5d9749-xvqmh"
Oct 31 17:27:12.999130 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:12.998944    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/170ada34-8944-43d2-bcfb-1d782aae5348-installation-pull-secrets\") pod \"image-registry-74dbfdb444-q7rkg\" (UID: \"170ada34-8944-43d2-bcfb-1d782aae5348\") " pod="openshift-image-registry/image-registry-74dbfdb444-q7rkg"
Oct 31 17:27:12.999130 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:12.998974    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/9a0cf7f7-c12d-42fe-a83e-28e1f1859cd2-nginx-conf\") pod \"networking-console-plugin-86c478bb88-rnvgv\" (UID: \"9a0cf7f7-c12d-42fe-a83e-28e1f1859cd2\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-rnvgv"
Oct 31 17:27:12.999130 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:12.999015    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c390ea6f-c609-40f7-a9ec-53fd5c08d857-cert\") pod \"ingress-canary-ptxt2\" (UID: \"c390ea6f-c609-40f7-a9ec-53fd5c08d857\") " pod="openshift-ingress-canary/ingress-canary-ptxt2"
Oct 31 17:27:12.999130 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:12.999021    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/948f2c4e-81a5-4c0e-9ec9-f4fb56368b87-service-ca-bundle\") pod \"periodic-gathering-vhvfz-6pbpt\" (UID: \"948f2c4e-81a5-4c0e-9ec9-f4fb56368b87\") " pod="openshift-insights/periodic-gathering-vhvfz-6pbpt"
Oct 31 17:27:12.999130 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:12.999041    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f03611db-3bd9-401a-a137-1d4f691b51ea-config\") pod \"console-operator-7cd56b8dbc-b2xxw\" (UID: \"f03611db-3bd9-401a-a137-1d4f691b51ea\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-b2xxw"
Oct 31 17:27:12.999130 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:12.999071    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9d9ecf7f-6a11-469b-8626-99d5ef7ffac7-registry-certificates\") pod \"image-registry-869fc8694f-xcqzj\" (UID: \"9d9ecf7f-6a11-469b-8626-99d5ef7ffac7\") " pod="openshift-image-registry/image-registry-869fc8694f-xcqzj"
Oct 31 17:27:12.999130 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:12.999084    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/170ada34-8944-43d2-bcfb-1d782aae5348-installation-pull-secrets\") pod \"image-registry-74dbfdb444-q7rkg\" (UID: \"170ada34-8944-43d2-bcfb-1d782aae5348\") " pod="openshift-image-registry/image-registry-74dbfdb444-q7rkg"
Oct 31 17:27:12.999130 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:12.999097    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ngvv2\" (UniqueName: \"kubernetes.io/projected/50e82975-3344-4653-8de3-68e8a64a8757-kube-api-access-ngvv2\") pod \"router-default-65db5d9749-xvqmh\" (UID: \"50e82975-3344-4653-8de3-68e8a64a8757\") " pod="openshift-ingress/router-default-65db5d9749-xvqmh"
Oct 31 17:27:12.999130 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:12.999125    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ef27850a-20b3-4876-8330-57e8954f1a79-log-socket\") pod \"ovnkube-node-v8sbm\" (UID: \"ef27850a-20b3-4876-8330-57e8954f1a79\") " pod="openshift-ovn-kubernetes/ovnkube-node-v8sbm"
Oct 31 17:27:12.999130 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:12.999152    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0c8a8a3b-14dd-45c9-b8fb-baf967142fd6-tmp\") pod \"tuned-zm6cj\" (UID: \"0c8a8a3b-14dd-45c9-b8fb-baf967142fd6\") " pod="openshift-cluster-node-tuning-operator/tuned-zm6cj"
Oct 31 17:27:12.999130 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:12.999185    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/0c8a8a3b-14dd-45c9-b8fb-baf967142fd6-etc-systemd\") pod \"tuned-zm6cj\" (UID: \"0c8a8a3b-14dd-45c9-b8fb-baf967142fd6\") " pod="openshift-cluster-node-tuning-operator/tuned-zm6cj"
Oct 31 17:27:12.999130 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:12.999195    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/9a0cf7f7-c12d-42fe-a83e-28e1f1859cd2-nginx-conf\") pod \"networking-console-plugin-86c478bb88-rnvgv\" (UID: \"9a0cf7f7-c12d-42fe-a83e-28e1f1859cd2\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-rnvgv"
Oct 31 17:27:13.001325 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:12.999215    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/50e82975-3344-4653-8de3-68e8a64a8757-default-certificate\") pod \"router-default-65db5d9749-xvqmh\" (UID: \"50e82975-3344-4653-8de3-68e8a64a8757\") " pod="openshift-ingress/router-default-65db5d9749-xvqmh"
Oct 31 17:27:13.001325 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:12.999241    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9179e3c5-ef52-4445-aec0-779c3e99cb07-original-pull-secret\") pod \"global-pull-secret-syncer-qgtf4\" (UID: \"9179e3c5-ef52-4445-aec0-779c3e99cb07\") " pod="kube-system/global-pull-secret-syncer-qgtf4"
Oct 31 17:27:13.001325 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:12.999256    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f03611db-3bd9-401a-a137-1d4f691b51ea-config\") pod \"console-operator-7cd56b8dbc-b2xxw\" (UID: \"f03611db-3bd9-401a-a137-1d4f691b51ea\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-b2xxw"
Oct 31 17:27:13.001325 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:12.999271    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/fe1c5f7c-fdfd-40b9-bc0f-4e018779ee2b-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-swb7n\" (UID: \"fe1c5f7c-fdfd-40b9-bc0f-4e018779ee2b\") " pod="openshift-multus/multus-additional-cni-plugins-swb7n"
Oct 31 17:27:13.001325 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:12.999313    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/8a9e5aa4-f4fc-4b33-a925-8e63df6c9cd2-config\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-4xtm4\" (UID: \"8a9e5aa4-f4fc-4b33-a925-8e63df6c9cd2\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-4xtm4"
Oct 31 17:27:13.001325 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:12.999339    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c390ea6f-c609-40f7-a9ec-53fd5c08d857-cert\") pod \"ingress-canary-ptxt2\" (UID: \"c390ea6f-c609-40f7-a9ec-53fd5c08d857\") " pod="openshift-ingress-canary/ingress-canary-ptxt2"
Oct 31 17:27:13.001325 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:12.999342    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/8e32277f-062d-4c16-81ca-b12e65b24fbb-snapshots\") pod \"insights-operator-7c4986d449-tggxv\" (UID: \"8e32277f-062d-4c16-81ca-b12e65b24fbb\") " pod="openshift-insights/insights-operator-7c4986d449-tggxv"
Oct 31 17:27:13.001325 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:12.999378    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8e32277f-062d-4c16-81ca-b12e65b24fbb-trusted-ca-bundle\") pod \"insights-operator-7c4986d449-tggxv\" (UID: \"8e32277f-062d-4c16-81ca-b12e65b24fbb\") " pod="openshift-insights/insights-operator-7c4986d449-tggxv"
Oct 31 17:27:13.001325 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:12.999396    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mkgtp\" (UniqueName: \"kubernetes.io/projected/948f2c4e-81a5-4c0e-9ec9-f4fb56368b87-kube-api-access-mkgtp\") pod \"periodic-gathering-vhvfz-6pbpt\" (UID: \"948f2c4e-81a5-4c0e-9ec9-f4fb56368b87\") " pod="openshift-insights/periodic-gathering-vhvfz-6pbpt"
Oct 31 17:27:13.001325 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:12.999398    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/8e32277f-062d-4c16-81ca-b12e65b24fbb-snapshots\") pod \"insights-operator-7c4986d449-tggxv\" (UID: \"8e32277f-062d-4c16-81ca-b12e65b24fbb\") " pod="openshift-insights/insights-operator-7c4986d449-tggxv"
Oct 31 17:27:13.001325 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:12.999417    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/25ad5c67-f563-4653-9e86-7e9ecbe78675-metrics-tls\") pod \"dns-default-7v7x4\" (UID: \"25ad5c67-f563-4653-9e86-7e9ecbe78675\") " pod="openshift-dns/dns-default-7v7x4"
Oct 31 17:27:13.001325 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:12.999458    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/fe1c5f7c-fdfd-40b9-bc0f-4e018779ee2b-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-swb7n\" (UID: \"fe1c5f7c-fdfd-40b9-bc0f-4e018779ee2b\") " pod="openshift-multus/multus-additional-cni-plugins-swb7n"
Oct 31 17:27:13.001325 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:12.999487    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0c8a8a3b-14dd-45c9-b8fb-baf967142fd6-tmp\") pod \"tuned-zm6cj\" (UID: \"0c8a8a3b-14dd-45c9-b8fb-baf967142fd6\") " pod="openshift-cluster-node-tuning-operator/tuned-zm6cj"
Oct 31 17:27:13.001325 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:12.999603    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/50e82975-3344-4653-8de3-68e8a64a8757-default-certificate\") pod \"router-default-65db5d9749-xvqmh\" (UID: \"50e82975-3344-4653-8de3-68e8a64a8757\") " pod="openshift-ingress/router-default-65db5d9749-xvqmh"
Oct 31 17:27:13.001325 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:12.999624    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8e32277f-062d-4c16-81ca-b12e65b24fbb-trusted-ca-bundle\") pod \"insights-operator-7c4986d449-tggxv\" (UID: \"8e32277f-062d-4c16-81ca-b12e65b24fbb\") " pod="openshift-insights/insights-operator-7c4986d449-tggxv"
Oct 31 17:27:13.001325 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:12.999685    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j26t9\" (UniqueName: \"kubernetes.io/projected/340f062e-e599-4620-87d1-c5be0bb1b319-kube-api-access-j26t9\") pod \"kas-connection-checker-685895c7c9-kgdxw\" (UID: \"340f062e-e599-4620-87d1-c5be0bb1b319\") " pod="kube-system/kas-connection-checker-685895c7c9-kgdxw"
Oct 31 17:27:13.001325 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:12.999715    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/27af0f99-138f-42ac-89b9-9dfc4a522483-multus-cni-dir\") pod \"multus-9zs6c\" (UID: \"27af0f99-138f-42ac-89b9-9dfc4a522483\") " pod="openshift-multus/multus-9zs6c"
Oct 31 17:27:13.001325 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:12.999742    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ef27850a-20b3-4876-8330-57e8954f1a79-node-log\") pod \"ovnkube-node-v8sbm\" (UID: \"ef27850a-20b3-4876-8330-57e8954f1a79\") " pod="openshift-ovn-kubernetes/ovnkube-node-v8sbm"
Oct 31 17:27:13.001325 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:12.999755    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/170ada34-8944-43d2-bcfb-1d782aae5348-trusted-ca\") pod \"image-registry-74dbfdb444-q7rkg\" (UID: \"170ada34-8944-43d2-bcfb-1d782aae5348\") " pod="openshift-image-registry/image-registry-74dbfdb444-q7rkg"
Oct 31 17:27:13.001325 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:12.999769    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6tqgx\" (UniqueName: \"kubernetes.io/projected/c915138c-9050-4958-b442-fee1aca9b002-kube-api-access-6tqgx\") pod \"node-ca-lcz9q\" (UID: \"c915138c-9050-4958-b442-fee1aca9b002\") " pod="openshift-image-registry/node-ca-lcz9q"
Oct 31 17:27:13.001325 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:12.999688    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/8a9e5aa4-f4fc-4b33-a925-8e63df6c9cd2-config\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-4xtm4\" (UID: \"8a9e5aa4-f4fc-4b33-a925-8e63df6c9cd2\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-4xtm4"
Oct 31 17:27:13.001325 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:12.999777    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9179e3c5-ef52-4445-aec0-779c3e99cb07-original-pull-secret\") pod \"global-pull-secret-syncer-qgtf4\" (UID: \"9179e3c5-ef52-4445-aec0-779c3e99cb07\") " pod="kube-system/global-pull-secret-syncer-qgtf4"
Oct 31 17:27:13.001325 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:12.999828    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cq4kh\" (UniqueName: \"kubernetes.io/projected/449efcb2-6707-4809-b869-1bb477f6e6ae-kube-api-access-cq4kh\") pod \"network-metrics-daemon-7j59v\" (UID: \"449efcb2-6707-4809-b869-1bb477f6e6ae\") " pod="openshift-multus/network-metrics-daemon-7j59v"
Oct 31 17:27:13.001325 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:12.999861    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-crrdz\" (UniqueName: \"kubernetes.io/projected/3aa3a055-ec26-4d70-bb04-d6a09abe6661-kube-api-access-crrdz\") pod \"insights-runtime-extractor-tdzz5\" (UID: \"3aa3a055-ec26-4d70-bb04-d6a09abe6661\") " pod="openshift-insights/insights-runtime-extractor-tdzz5"
Oct 31 17:27:13.001325 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:12.999875    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9d9ecf7f-6a11-469b-8626-99d5ef7ffac7-registry-certificates\") pod \"image-registry-869fc8694f-xcqzj\" (UID: \"9d9ecf7f-6a11-469b-8626-99d5ef7ffac7\") " pod="openshift-image-registry/image-registry-869fc8694f-xcqzj"
Oct 31 17:27:13.001325 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:12.999893    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/88be474b-fd0b-4784-8f1c-2dc0bdfb2792-sys-fs\") pod \"aws-ebs-csi-driver-node-ldjrw\" (UID: \"88be474b-fd0b-4784-8f1c-2dc0bdfb2792\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ldjrw"
Oct 31 17:27:13.001325 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:12.999922    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b2ncn\" (UniqueName: \"kubernetes.io/projected/fe1c5f7c-fdfd-40b9-bc0f-4e018779ee2b-kube-api-access-b2ncn\") pod \"multus-additional-cni-plugins-swb7n\" (UID: \"fe1c5f7c-fdfd-40b9-bc0f-4e018779ee2b\") " pod="openshift-multus/multus-additional-cni-plugins-swb7n"
Oct 31 17:27:13.001325 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:12.999963    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t9n2j\" (UniqueName: \"kubernetes.io/projected/9363fb38-792f-41a6-b6b3-d2c508fff328-kube-api-access-t9n2j\") pod \"kas-connection-checker-685895c7c9-ttbkh\" (UID: \"9363fb38-792f-41a6-b6b3-d2c508fff328\") " pod="kube-system/kas-connection-checker-685895c7c9-ttbkh"
Oct 31 17:27:13.001325 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:12.999997    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ef27850a-20b3-4876-8330-57e8954f1a79-run-openvswitch\") pod \"ovnkube-node-v8sbm\" (UID: \"ef27850a-20b3-4876-8330-57e8954f1a79\") " pod="openshift-ovn-kubernetes/ovnkube-node-v8sbm"
Oct 31 17:27:13.001325 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:13.000025    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ef27850a-20b3-4876-8330-57e8954f1a79-env-overrides\") pod \"ovnkube-node-v8sbm\" (UID: \"ef27850a-20b3-4876-8330-57e8954f1a79\") " pod="openshift-ovn-kubernetes/ovnkube-node-v8sbm"
Oct 31 17:27:13.001325 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:13.000075    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/25ad5c67-f563-4653-9e86-7e9ecbe78675-config-volume\") pod \"dns-default-7v7x4\" (UID: \"25ad5c67-f563-4653-9e86-7e9ecbe78675\") " pod="openshift-dns/dns-default-7v7x4"
Oct 31 17:27:13.001325 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:13.000097    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/27af0f99-138f-42ac-89b9-9dfc4a522483-multus-daemon-config\") pod \"multus-9zs6c\" (UID: \"27af0f99-138f-42ac-89b9-9dfc4a522483\") " pod="openshift-multus/multus-9zs6c"
Oct 31 17:27:13.001325 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:13.000115    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ef27850a-20b3-4876-8330-57e8954f1a79-systemd-units\") pod \"ovnkube-node-v8sbm\" (UID: \"ef27850a-20b3-4876-8330-57e8954f1a79\") " pod="openshift-ovn-kubernetes/ovnkube-node-v8sbm"
Oct 31 17:27:13.001325 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:13.000179    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ef27850a-20b3-4876-8330-57e8954f1a79-env-overrides\") pod \"ovnkube-node-v8sbm\" (UID: \"ef27850a-20b3-4876-8330-57e8954f1a79\") " pod="openshift-ovn-kubernetes/ovnkube-node-v8sbm"
Oct 31 17:27:13.001325 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:13.000196    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/eaed4088-d322-48ab-af04-3c9efdea4e73-tmp-dir\") pod \"node-resolver-x25tg\" (UID: \"eaed4088-d322-48ab-af04-3c9efdea4e73\") " pod="openshift-dns/node-resolver-x25tg"
Oct 31 17:27:13.001325 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:13.000234    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/50e82975-3344-4653-8de3-68e8a64a8757-service-ca-bundle\") pod \"router-default-65db5d9749-xvqmh\" (UID: \"50e82975-3344-4653-8de3-68e8a64a8757\") " pod="openshift-ingress/router-default-65db5d9749-xvqmh"
Oct 31 17:27:13.001325 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:13.000263    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/27af0f99-138f-42ac-89b9-9dfc4a522483-multus-daemon-config\") pod \"multus-9zs6c\" (UID: \"27af0f99-138f-42ac-89b9-9dfc4a522483\") " pod="openshift-multus/multus-9zs6c"
Oct 31 17:27:13.001325 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:13.000264    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/9a0cf7f7-c12d-42fe-a83e-28e1f1859cd2-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-rnvgv\" (UID: \"9a0cf7f7-c12d-42fe-a83e-28e1f1859cd2\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-rnvgv"
Oct 31 17:27:13.001325 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:13.000306    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/25ad5c67-f563-4653-9e86-7e9ecbe78675-config-volume\") pod \"dns-default-7v7x4\" (UID: \"25ad5c67-f563-4653-9e86-7e9ecbe78675\") " pod="openshift-dns/dns-default-7v7x4"
Oct 31 17:27:13.001325 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:13.000319    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/eaed4088-d322-48ab-af04-3c9efdea4e73-tmp-dir\") pod \"node-resolver-x25tg\" (UID: \"eaed4088-d322-48ab-af04-3c9efdea4e73\") " pod="openshift-dns/node-resolver-x25tg"
Oct 31 17:27:13.001325 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:13.000322    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ef27850a-20b3-4876-8330-57e8954f1a79-run-ovn\") pod \"ovnkube-node-v8sbm\" (UID: \"ef27850a-20b3-4876-8330-57e8954f1a79\") " pod="openshift-ovn-kubernetes/ovnkube-node-v8sbm"
Oct 31 17:27:13.001325 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:13.000349    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f03611db-3bd9-401a-a137-1d4f691b51ea-serving-cert\") pod \"console-operator-7cd56b8dbc-b2xxw\" (UID: \"f03611db-3bd9-401a-a137-1d4f691b51ea\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-b2xxw"
Oct 31 17:27:13.001325 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:13.000365    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/25ad5c67-f563-4653-9e86-7e9ecbe78675-tmp-dir\") pod \"dns-default-7v7x4\" (UID: \"25ad5c67-f563-4653-9e86-7e9ecbe78675\") " pod="openshift-dns/dns-default-7v7x4"
Oct 31 17:27:13.001325 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:13.000381    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/948f2c4e-81a5-4c0e-9ec9-f4fb56368b87-archives-path\") pod \"periodic-gathering-vhvfz-6pbpt\" (UID: \"948f2c4e-81a5-4c0e-9ec9-f4fb56368b87\") " pod="openshift-insights/periodic-gathering-vhvfz-6pbpt"
Oct 31 17:27:13.001325 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:13.000399    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fe1c5f7c-fdfd-40b9-bc0f-4e018779ee2b-system-cni-dir\") pod \"multus-additional-cni-plugins-swb7n\" (UID: \"fe1c5f7c-fdfd-40b9-bc0f-4e018779ee2b\") " pod="openshift-multus/multus-additional-cni-plugins-swb7n"
Oct 31 17:27:13.001325 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:13.000436    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h4fpf\" (UniqueName: \"kubernetes.io/projected/0c8a8a3b-14dd-45c9-b8fb-baf967142fd6-kube-api-access-h4fpf\") pod \"tuned-zm6cj\" (UID: \"0c8a8a3b-14dd-45c9-b8fb-baf967142fd6\") " pod="openshift-cluster-node-tuning-operator/tuned-zm6cj"
Oct 31 17:27:13.001325 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:13.000458    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vpl4m\" (UniqueName: \"kubernetes.io/projected/a1bea244-6573-4e3c-9849-b27ade411c9f-kube-api-access-vpl4m\") pod \"cluster-monitoring-operator-884576c57-csbxp\" (UID: \"a1bea244-6573-4e3c-9849-b27ade411c9f\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-csbxp"
Oct 31 17:27:13.001325 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:13.000461    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f03611db-3bd9-401a-a137-1d4f691b51ea-serving-cert\") pod \"console-operator-7cd56b8dbc-b2xxw\" (UID: \"f03611db-3bd9-401a-a137-1d4f691b51ea\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-b2xxw"
Oct 31 17:27:13.001325 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:13.000467    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/948f2c4e-81a5-4c0e-9ec9-f4fb56368b87-archives-path\") pod \"periodic-gathering-vhvfz-6pbpt\" (UID: \"948f2c4e-81a5-4c0e-9ec9-f4fb56368b87\") " pod="openshift-insights/periodic-gathering-vhvfz-6pbpt"
Oct 31 17:27:13.001325 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:13.000458    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/25ad5c67-f563-4653-9e86-7e9ecbe78675-tmp-dir\") pod \"dns-default-7v7x4\" (UID: \"25ad5c67-f563-4653-9e86-7e9ecbe78675\") " pod="openshift-dns/dns-default-7v7x4"
Oct 31 17:27:13.012022 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:13.011970    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rbmtq\" (UniqueName: \"kubernetes.io/projected/a7959bdf-3723-4ee9-a587-6cd16e28d4b1-kube-api-access-rbmtq\") pod \"volume-data-source-validator-58c9f5f46d-th5tq\" (UID: \"a7959bdf-3723-4ee9-a587-6cd16e28d4b1\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-th5tq"
Oct 31 17:27:13.013943 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:13.013504    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ghqc6\" (UniqueName: \"kubernetes.io/projected/b1e258da-4619-478c-895a-041aa7eeafb6-kube-api-access-ghqc6\") pod \"iptables-alerter-h8jzv\" (UID: \"b1e258da-4619-478c-895a-041aa7eeafb6\") " pod="openshift-network-operator/iptables-alerter-h8jzv"
Oct 31 17:27:13.013943 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:13.013882    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v5x5x\" (UniqueName: \"kubernetes.io/projected/26373302-592f-4fd5-bd54-7ac57ef19bfd-kube-api-access-v5x5x\") pod \"kas-connection-checker-685895c7c9-6pnp6\" (UID: \"26373302-592f-4fd5-bd54-7ac57ef19bfd\") " pod="kube-system/kas-connection-checker-685895c7c9-6pnp6"
Oct 31 17:27:13.014105 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:13.013992    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9d9ecf7f-6a11-469b-8626-99d5ef7ffac7-bound-sa-token\") pod \"image-registry-869fc8694f-xcqzj\" (UID: \"9d9ecf7f-6a11-469b-8626-99d5ef7ffac7\") " pod="openshift-image-registry/image-registry-869fc8694f-xcqzj"
Oct 31 17:27:13.014105 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:13.014085    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rkfhx\" (UniqueName: \"kubernetes.io/projected/a26cba9f-c44a-405d-8e3d-de4bc5b6d6c0-kube-api-access-rkfhx\") pod \"migrator-66df5d496b-t48lj\" (UID: \"a26cba9f-c44a-405d-8e3d-de4bc5b6d6c0\") " pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-t48lj"
Oct 31 17:27:13.014205 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:13.014111    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2ln8r\" (UniqueName: \"kubernetes.io/projected/88be474b-fd0b-4784-8f1c-2dc0bdfb2792-kube-api-access-2ln8r\") pod \"aws-ebs-csi-driver-node-ldjrw\" (UID: \"88be474b-fd0b-4784-8f1c-2dc0bdfb2792\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ldjrw"
Oct 31 17:27:13.014205 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:13.014142    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q9ctx\" (UniqueName: \"kubernetes.io/projected/eaed4088-d322-48ab-af04-3c9efdea4e73-kube-api-access-q9ctx\") pod \"node-resolver-x25tg\" (UID: \"eaed4088-d322-48ab-af04-3c9efdea4e73\") " pod="openshift-dns/node-resolver-x25tg"
Oct 31 17:27:13.014205 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:13.014168    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-krrzb\" (UniqueName: \"kubernetes.io/projected/ec682f92-b657-44bd-9e85-3cd4680d2f95-kube-api-access-krrzb\") pod \"cluster-samples-operator-6ddb6c8b94-rhsk4\" (UID: \"ec682f92-b657-44bd-9e85-3cd4680d2f95\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-rhsk4"
Oct 31 17:27:13.014310 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:13.014264    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f88d4\" (UniqueName: \"kubernetes.io/projected/f03611db-3bd9-401a-a137-1d4f691b51ea-kube-api-access-f88d4\") pod \"console-operator-7cd56b8dbc-b2xxw\" (UID: \"f03611db-3bd9-401a-a137-1d4f691b51ea\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-b2xxw"
Oct 31 17:27:13.017070 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:13.017031    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kdg6k\" (UniqueName: \"kubernetes.io/projected/fef8c517-3be6-4cc1-908a-9e0116d8f978-kube-api-access-kdg6k\") pod \"migrator-66df5d496b-lfxtw\" (UID: \"fef8c517-3be6-4cc1-908a-9e0116d8f978\") " pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-lfxtw"
Oct 31 17:27:13.017140 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:13.017124    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/170ada34-8944-43d2-bcfb-1d782aae5348-bound-sa-token\") pod \"image-registry-74dbfdb444-q7rkg\" (UID: \"170ada34-8944-43d2-bcfb-1d782aae5348\") " pod="openshift-image-registry/image-registry-74dbfdb444-q7rkg"
Oct 31 17:27:13.017272 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:13.017257    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kqpvj\" (UniqueName: \"kubernetes.io/projected/25ad5c67-f563-4653-9e86-7e9ecbe78675-kube-api-access-kqpvj\") pod \"dns-default-7v7x4\" (UID: \"25ad5c67-f563-4653-9e86-7e9ecbe78675\") " pod="openshift-dns/dns-default-7v7x4"
Oct 31 17:27:13.020692 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:13.018259    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c6ctd\" (UniqueName: \"kubernetes.io/projected/27af0f99-138f-42ac-89b9-9dfc4a522483-kube-api-access-c6ctd\") pod \"multus-9zs6c\" (UID: \"27af0f99-138f-42ac-89b9-9dfc4a522483\") " pod="openshift-multus/multus-9zs6c"
Oct 31 17:27:13.020692 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:13.018929    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5x4hs\" (UniqueName: \"kubernetes.io/projected/8e32277f-062d-4c16-81ca-b12e65b24fbb-kube-api-access-5x4hs\") pod \"insights-operator-7c4986d449-tggxv\" (UID: \"8e32277f-062d-4c16-81ca-b12e65b24fbb\") " pod="openshift-insights/insights-operator-7c4986d449-tggxv"
Oct 31 17:27:13.020692 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:13.018939    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-96ckd\" (UniqueName: \"kubernetes.io/projected/5d30d9b6-0431-47f2-b06c-8a03d4f59b97-kube-api-access-96ckd\") pod \"network-check-target-pqs8z\" (UID: \"5d30d9b6-0431-47f2-b06c-8a03d4f59b97\") " pod="openshift-network-diagnostics/network-check-target-pqs8z"
Oct 31 17:27:13.020692 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:13.018969    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6vzgd\" (UniqueName: \"kubernetes.io/projected/2330cbe7-498c-4f39-ba1b-3873e125dd18-kube-api-access-6vzgd\") pod \"service-ca-operator-544d749c8c-7lspr\" (UID: \"2330cbe7-498c-4f39-ba1b-3873e125dd18\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-7lspr"
Oct 31 17:27:13.020692 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:13.019046    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-69jvk\" (UniqueName: \"kubernetes.io/projected/ef27850a-20b3-4876-8330-57e8954f1a79-kube-api-access-69jvk\") pod \"ovnkube-node-v8sbm\" (UID: \"ef27850a-20b3-4876-8330-57e8954f1a79\") " pod="openshift-ovn-kubernetes/ovnkube-node-v8sbm"
Oct 31 17:27:13.020692 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:13.019106    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z57fk\" (UniqueName: \"kubernetes.io/projected/c390ea6f-c609-40f7-a9ec-53fd5c08d857-kube-api-access-z57fk\") pod \"ingress-canary-ptxt2\" (UID: \"c390ea6f-c609-40f7-a9ec-53fd5c08d857\") " pod="openshift-ingress-canary/ingress-canary-ptxt2"
Oct 31 17:27:13.020692 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:13.019426    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mgwcl\" (UniqueName: \"kubernetes.io/projected/9d9ecf7f-6a11-469b-8626-99d5ef7ffac7-kube-api-access-mgwcl\") pod \"image-registry-869fc8694f-xcqzj\" (UID: \"9d9ecf7f-6a11-469b-8626-99d5ef7ffac7\") " pod="openshift-image-registry/image-registry-869fc8694f-xcqzj"
Oct 31 17:27:13.020692 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:13.019452    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j86wf\" (UniqueName: \"kubernetes.io/projected/d5856011-8f77-4e60-8ecc-c7ac852a50b0-kube-api-access-j86wf\") pod \"network-check-source-6f78d59f99-qkkwm\" (UID: \"d5856011-8f77-4e60-8ecc-c7ac852a50b0\") " pod="openshift-network-diagnostics/network-check-source-6f78d59f99-qkkwm"
Oct 31 17:27:13.020692 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:13.019425    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6tlzl\" (UniqueName: \"kubernetes.io/projected/8a9e5aa4-f4fc-4b33-a925-8e63df6c9cd2-kube-api-access-6tlzl\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-4xtm4\" (UID: \"8a9e5aa4-f4fc-4b33-a925-8e63df6c9cd2\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-4xtm4"
Oct 31 17:27:13.020692 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:13.019848    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t9n2j\" (UniqueName: \"kubernetes.io/projected/9363fb38-792f-41a6-b6b3-d2c508fff328-kube-api-access-t9n2j\") pod \"kas-connection-checker-685895c7c9-ttbkh\" (UID: \"9363fb38-792f-41a6-b6b3-d2c508fff328\") " pod="kube-system/kas-connection-checker-685895c7c9-ttbkh"
Oct 31 17:27:13.020692 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:13.020027    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6tqgx\" (UniqueName: \"kubernetes.io/projected/c915138c-9050-4958-b442-fee1aca9b002-kube-api-access-6tqgx\") pod \"node-ca-lcz9q\" (UID: \"c915138c-9050-4958-b442-fee1aca9b002\") " pod="openshift-image-registry/node-ca-lcz9q"
Oct 31 17:27:13.020692 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:13.020369    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vpl4m\" (UniqueName: \"kubernetes.io/projected/a1bea244-6573-4e3c-9849-b27ade411c9f-kube-api-access-vpl4m\") pod \"cluster-monitoring-operator-884576c57-csbxp\" (UID: \"a1bea244-6573-4e3c-9849-b27ade411c9f\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-csbxp"
Oct 31 17:27:13.020692 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:13.020399    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b2ncn\" (UniqueName: \"kubernetes.io/projected/fe1c5f7c-fdfd-40b9-bc0f-4e018779ee2b-kube-api-access-b2ncn\") pod \"multus-additional-cni-plugins-swb7n\" (UID: \"fe1c5f7c-fdfd-40b9-bc0f-4e018779ee2b\") " pod="openshift-multus/multus-additional-cni-plugins-swb7n"
Oct 31 17:27:13.020692 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:13.020621    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-crrdz\" (UniqueName: \"kubernetes.io/projected/3aa3a055-ec26-4d70-bb04-d6a09abe6661-kube-api-access-crrdz\") pod \"insights-runtime-extractor-tdzz5\" (UID: \"3aa3a055-ec26-4d70-bb04-d6a09abe6661\") " pod="openshift-insights/insights-runtime-extractor-tdzz5"
Oct 31 17:27:13.021406 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:13.020927    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j26t9\" (UniqueName: \"kubernetes.io/projected/340f062e-e599-4620-87d1-c5be0bb1b319-kube-api-access-j26t9\") pod \"kas-connection-checker-685895c7c9-kgdxw\" (UID: \"340f062e-e599-4620-87d1-c5be0bb1b319\") " pod="kube-system/kas-connection-checker-685895c7c9-kgdxw"
Oct 31 17:27:13.021406 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:13.021049    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h6b47\" (UniqueName: \"kubernetes.io/projected/170ada34-8944-43d2-bcfb-1d782aae5348-kube-api-access-h6b47\") pod \"image-registry-74dbfdb444-q7rkg\" (UID: \"170ada34-8944-43d2-bcfb-1d782aae5348\") " pod="openshift-image-registry/image-registry-74dbfdb444-q7rkg"
Oct 31 17:27:13.021406 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:13.021110    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ngvv2\" (UniqueName: \"kubernetes.io/projected/50e82975-3344-4653-8de3-68e8a64a8757-kube-api-access-ngvv2\") pod \"router-default-65db5d9749-xvqmh\" (UID: \"50e82975-3344-4653-8de3-68e8a64a8757\") " pod="openshift-ingress/router-default-65db5d9749-xvqmh"
Oct 31 17:27:13.021545 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:13.021417    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h4fpf\" (UniqueName: \"kubernetes.io/projected/0c8a8a3b-14dd-45c9-b8fb-baf967142fd6-kube-api-access-h4fpf\") pod \"tuned-zm6cj\" (UID: \"0c8a8a3b-14dd-45c9-b8fb-baf967142fd6\") " pod="openshift-cluster-node-tuning-operator/tuned-zm6cj"
Oct 31 17:27:13.021545 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:13.021427    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cq4kh\" (UniqueName: \"kubernetes.io/projected/449efcb2-6707-4809-b869-1bb477f6e6ae-kube-api-access-cq4kh\") pod \"network-metrics-daemon-7j59v\" (UID: \"449efcb2-6707-4809-b869-1bb477f6e6ae\") " pod="openshift-multus/network-metrics-daemon-7j59v"
Oct 31 17:27:13.021545 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:13.021484    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mkgtp\" (UniqueName: \"kubernetes.io/projected/948f2c4e-81a5-4c0e-9ec9-f4fb56368b87-kube-api-access-mkgtp\") pod \"periodic-gathering-vhvfz-6pbpt\" (UID: \"948f2c4e-81a5-4c0e-9ec9-f4fb56368b87\") " pod="openshift-insights/periodic-gathering-vhvfz-6pbpt"
Oct 31 17:27:13.101761 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:13.101675    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ef27850a-20b3-4876-8330-57e8954f1a79-host-kubelet\") pod \"ovnkube-node-v8sbm\" (UID: \"ef27850a-20b3-4876-8330-57e8954f1a79\") " pod="openshift-ovn-kubernetes/ovnkube-node-v8sbm"
Oct 31 17:27:13.101761 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:13.101711    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/0c8a8a3b-14dd-45c9-b8fb-baf967142fd6-etc-sysconfig\") pod \"tuned-zm6cj\" (UID: \"0c8a8a3b-14dd-45c9-b8fb-baf967142fd6\") " pod="openshift-cluster-node-tuning-operator/tuned-zm6cj"
Oct 31 17:27:13.101761 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:13.101728    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/27af0f99-138f-42ac-89b9-9dfc4a522483-host-run-multus-certs\") pod \"multus-9zs6c\" (UID: \"27af0f99-138f-42ac-89b9-9dfc4a522483\") " pod="openshift-multus/multus-9zs6c"
Oct 31 17:27:13.101982 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:13.101789    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/0c8a8a3b-14dd-45c9-b8fb-baf967142fd6-etc-sysconfig\") pod \"tuned-zm6cj\" (UID: \"0c8a8a3b-14dd-45c9-b8fb-baf967142fd6\") " pod="openshift-cluster-node-tuning-operator/tuned-zm6cj"
Oct 31 17:27:13.101982 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:13.101786    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ef27850a-20b3-4876-8330-57e8954f1a79-host-kubelet\") pod \"ovnkube-node-v8sbm\" (UID: \"ef27850a-20b3-4876-8330-57e8954f1a79\") " pod="openshift-ovn-kubernetes/ovnkube-node-v8sbm"
Oct 31 17:27:13.101982 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:13.101809    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3aa3a055-ec26-4d70-bb04-d6a09abe6661-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-tdzz5\" (UID: \"3aa3a055-ec26-4d70-bb04-d6a09abe6661\") " pod="openshift-insights/insights-runtime-extractor-tdzz5"
Oct 31 17:27:13.101982 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:13.101831    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/27af0f99-138f-42ac-89b9-9dfc4a522483-host-run-multus-certs\") pod \"multus-9zs6c\" (UID: \"27af0f99-138f-42ac-89b9-9dfc4a522483\") " pod="openshift-multus/multus-9zs6c"
Oct 31 17:27:13.101982 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:13.101867    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/50e82975-3344-4653-8de3-68e8a64a8757-metrics-certs\") pod \"router-default-65db5d9749-xvqmh\" (UID: \"50e82975-3344-4653-8de3-68e8a64a8757\") " pod="openshift-ingress/router-default-65db5d9749-xvqmh"
Oct 31 17:27:13.101982 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:13.101899    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ef27850a-20b3-4876-8330-57e8954f1a79-var-lib-openvswitch\") pod \"ovnkube-node-v8sbm\" (UID: \"ef27850a-20b3-4876-8330-57e8954f1a79\") " pod="openshift-ovn-kubernetes/ovnkube-node-v8sbm"
Oct 31 17:27:13.101982 ip-10-0-138-17 kubenswrapper[5003]: E1031 17:27:13.101911    5003 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Oct 31 17:27:13.101982 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:13.101916    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/27af0f99-138f-42ac-89b9-9dfc4a522483-host-var-lib-cni-bin\") pod \"multus-9zs6c\" (UID: \"27af0f99-138f-42ac-89b9-9dfc4a522483\") " pod="openshift-multus/multus-9zs6c"
Oct 31 17:27:13.101982 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:13.101935    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0c8a8a3b-14dd-45c9-b8fb-baf967142fd6-sys\") pod \"tuned-zm6cj\" (UID: \"0c8a8a3b-14dd-45c9-b8fb-baf967142fd6\") " pod="openshift-cluster-node-tuning-operator/tuned-zm6cj"
Oct 31 17:27:13.101982 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:13.101951    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0c8a8a3b-14dd-45c9-b8fb-baf967142fd6-lib-modules\") pod \"tuned-zm6cj\" (UID: \"0c8a8a3b-14dd-45c9-b8fb-baf967142fd6\") " pod="openshift-cluster-node-tuning-operator/tuned-zm6cj"
Oct 31 17:27:13.101982 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:13.101971    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/ec682f92-b657-44bd-9e85-3cd4680d2f95-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-rhsk4\" (UID: \"ec682f92-b657-44bd-9e85-3cd4680d2f95\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-rhsk4"
Oct 31 17:27:13.101982 ip-10-0-138-17 kubenswrapper[5003]: E1031 17:27:13.101983    5003 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3aa3a055-ec26-4d70-bb04-d6a09abe6661-insights-runtime-extractor-tls podName:3aa3a055-ec26-4d70-bb04-d6a09abe6661 nodeName:}" failed. No retries permitted until 2026-10-31 17:27:13.601966416 +0000 UTC m=+1.856820955 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/3aa3a055-ec26-4d70-bb04-d6a09abe6661-insights-runtime-extractor-tls") pod "insights-runtime-extractor-tdzz5" (UID: "3aa3a055-ec26-4d70-bb04-d6a09abe6661") : secret "insights-runtime-extractor-tls" not found
Oct 31 17:27:13.101982 ip-10-0-138-17 kubenswrapper[5003]: E1031 17:27:13.101985    5003 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Oct 31 17:27:13.102523 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:13.101999    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/27af0f99-138f-42ac-89b9-9dfc4a522483-host-var-lib-cni-bin\") pod \"multus-9zs6c\" (UID: \"27af0f99-138f-42ac-89b9-9dfc4a522483\") " pod="openshift-multus/multus-9zs6c"
Oct 31 17:27:13.102523 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:13.102003    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ef27850a-20b3-4876-8330-57e8954f1a79-run-systemd\") pod \"ovnkube-node-v8sbm\" (UID: \"ef27850a-20b3-4876-8330-57e8954f1a79\") " pod="openshift-ovn-kubernetes/ovnkube-node-v8sbm"
Oct 31 17:27:13.102523 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:13.102033    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ef27850a-20b3-4876-8330-57e8954f1a79-run-systemd\") pod \"ovnkube-node-v8sbm\" (UID: \"ef27850a-20b3-4876-8330-57e8954f1a79\") " pod="openshift-ovn-kubernetes/ovnkube-node-v8sbm"
Oct 31 17:27:13.102523 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:13.102040    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/0c8a8a3b-14dd-45c9-b8fb-baf967142fd6-etc-modprobe-d\") pod \"tuned-zm6cj\" (UID: \"0c8a8a3b-14dd-45c9-b8fb-baf967142fd6\") " pod="openshift-cluster-node-tuning-operator/tuned-zm6cj"
Oct 31 17:27:13.102523 ip-10-0-138-17 kubenswrapper[5003]: E1031 17:27:13.102054    5003 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/50e82975-3344-4653-8de3-68e8a64a8757-metrics-certs podName:50e82975-3344-4653-8de3-68e8a64a8757 nodeName:}" failed. No retries permitted until 2026-10-31 17:27:13.602036509 +0000 UTC m=+1.856891042 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/50e82975-3344-4653-8de3-68e8a64a8757-metrics-certs") pod "router-default-65db5d9749-xvqmh" (UID: "50e82975-3344-4653-8de3-68e8a64a8757") : secret "router-metrics-certs-default" not found
Oct 31 17:27:13.102523 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:13.102057    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0c8a8a3b-14dd-45c9-b8fb-baf967142fd6-sys\") pod \"tuned-zm6cj\" (UID: \"0c8a8a3b-14dd-45c9-b8fb-baf967142fd6\") " pod="openshift-cluster-node-tuning-operator/tuned-zm6cj"
Oct 31 17:27:13.102523 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:13.102073    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ef27850a-20b3-4876-8330-57e8954f1a79-var-lib-openvswitch\") pod \"ovnkube-node-v8sbm\" (UID: \"ef27850a-20b3-4876-8330-57e8954f1a79\") " pod="openshift-ovn-kubernetes/ovnkube-node-v8sbm"
Oct 31 17:27:13.102523 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:13.102090    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ef27850a-20b3-4876-8330-57e8954f1a79-etc-openvswitch\") pod \"ovnkube-node-v8sbm\" (UID: \"ef27850a-20b3-4876-8330-57e8954f1a79\") " pod="openshift-ovn-kubernetes/ovnkube-node-v8sbm"
Oct 31 17:27:13.102523 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:13.102116    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ef27850a-20b3-4876-8330-57e8954f1a79-host-run-netns\") pod \"ovnkube-node-v8sbm\" (UID: \"ef27850a-20b3-4876-8330-57e8954f1a79\") " pod="openshift-ovn-kubernetes/ovnkube-node-v8sbm"
Oct 31 17:27:13.102523 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:13.102120    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ef27850a-20b3-4876-8330-57e8954f1a79-etc-openvswitch\") pod \"ovnkube-node-v8sbm\" (UID: \"ef27850a-20b3-4876-8330-57e8954f1a79\") " pod="openshift-ovn-kubernetes/ovnkube-node-v8sbm"
Oct 31 17:27:13.102523 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:13.102142    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ef27850a-20b3-4876-8330-57e8954f1a79-host-run-ovn-kubernetes\") pod \"ovnkube-node-v8sbm\" (UID: \"ef27850a-20b3-4876-8330-57e8954f1a79\") " pod="openshift-ovn-kubernetes/ovnkube-node-v8sbm"
Oct 31 17:27:13.102523 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:13.102155    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/0c8a8a3b-14dd-45c9-b8fb-baf967142fd6-etc-modprobe-d\") pod \"tuned-zm6cj\" (UID: \"0c8a8a3b-14dd-45c9-b8fb-baf967142fd6\") " pod="openshift-cluster-node-tuning-operator/tuned-zm6cj"
Oct 31 17:27:13.102523 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:13.102166    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ef27850a-20b3-4876-8330-57e8954f1a79-host-run-netns\") pod \"ovnkube-node-v8sbm\" (UID: \"ef27850a-20b3-4876-8330-57e8954f1a79\") " pod="openshift-ovn-kubernetes/ovnkube-node-v8sbm"
Oct 31 17:27:13.102523 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:13.102177    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0c8a8a3b-14dd-45c9-b8fb-baf967142fd6-lib-modules\") pod \"tuned-zm6cj\" (UID: \"0c8a8a3b-14dd-45c9-b8fb-baf967142fd6\") " pod="openshift-cluster-node-tuning-operator/tuned-zm6cj"
Oct 31 17:27:13.102523 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:13.102196    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ef27850a-20b3-4876-8330-57e8954f1a79-host-run-ovn-kubernetes\") pod \"ovnkube-node-v8sbm\" (UID: \"ef27850a-20b3-4876-8330-57e8954f1a79\") " pod="openshift-ovn-kubernetes/ovnkube-node-v8sbm"
Oct 31 17:27:13.102523 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:13.102201    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/27af0f99-138f-42ac-89b9-9dfc4a522483-hostroot\") pod \"multus-9zs6c\" (UID: \"27af0f99-138f-42ac-89b9-9dfc4a522483\") " pod="openshift-multus/multus-9zs6c"
Oct 31 17:27:13.102523 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:13.102169    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/27af0f99-138f-42ac-89b9-9dfc4a522483-hostroot\") pod \"multus-9zs6c\" (UID: \"27af0f99-138f-42ac-89b9-9dfc4a522483\") " pod="openshift-multus/multus-9zs6c"
Oct 31 17:27:13.102523 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:13.102237    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ef27850a-20b3-4876-8330-57e8954f1a79-log-socket\") pod \"ovnkube-node-v8sbm\" (UID: \"ef27850a-20b3-4876-8330-57e8954f1a79\") " pod="openshift-ovn-kubernetes/ovnkube-node-v8sbm"
Oct 31 17:27:13.102523 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:13.102253    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/0c8a8a3b-14dd-45c9-b8fb-baf967142fd6-etc-systemd\") pod \"tuned-zm6cj\" (UID: \"0c8a8a3b-14dd-45c9-b8fb-baf967142fd6\") " pod="openshift-cluster-node-tuning-operator/tuned-zm6cj"
Oct 31 17:27:13.102523 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:13.102274    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/25ad5c67-f563-4653-9e86-7e9ecbe78675-metrics-tls\") pod \"dns-default-7v7x4\" (UID: \"25ad5c67-f563-4653-9e86-7e9ecbe78675\") " pod="openshift-dns/dns-default-7v7x4"
Oct 31 17:27:13.102523 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:13.102284    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ef27850a-20b3-4876-8330-57e8954f1a79-log-socket\") pod \"ovnkube-node-v8sbm\" (UID: \"ef27850a-20b3-4876-8330-57e8954f1a79\") " pod="openshift-ovn-kubernetes/ovnkube-node-v8sbm"
Oct 31 17:27:13.102523 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:13.102297    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/27af0f99-138f-42ac-89b9-9dfc4a522483-multus-cni-dir\") pod \"multus-9zs6c\" (UID: \"27af0f99-138f-42ac-89b9-9dfc4a522483\") " pod="openshift-multus/multus-9zs6c"
Oct 31 17:27:13.102523 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:13.102321    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ef27850a-20b3-4876-8330-57e8954f1a79-node-log\") pod \"ovnkube-node-v8sbm\" (UID: \"ef27850a-20b3-4876-8330-57e8954f1a79\") " pod="openshift-ovn-kubernetes/ovnkube-node-v8sbm"
Oct 31 17:27:13.102523 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:13.102321    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/0c8a8a3b-14dd-45c9-b8fb-baf967142fd6-etc-systemd\") pod \"tuned-zm6cj\" (UID: \"0c8a8a3b-14dd-45c9-b8fb-baf967142fd6\") " pod="openshift-cluster-node-tuning-operator/tuned-zm6cj"
Oct 31 17:27:13.102523 ip-10-0-138-17 kubenswrapper[5003]: E1031 17:27:13.102338    5003 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Oct 31 17:27:13.102523 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:13.102347    5003 swap_util.go:78] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Oct 31 17:27:13.102523 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:13.102349    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/88be474b-fd0b-4784-8f1c-2dc0bdfb2792-sys-fs\") pod \"aws-ebs-csi-driver-node-ldjrw\" (UID: \"88be474b-fd0b-4784-8f1c-2dc0bdfb2792\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ldjrw"
Oct 31 17:27:13.102523 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:13.102370    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ef27850a-20b3-4876-8330-57e8954f1a79-node-log\") pod \"ovnkube-node-v8sbm\" (UID: \"ef27850a-20b3-4876-8330-57e8954f1a79\") " pod="openshift-ovn-kubernetes/ovnkube-node-v8sbm"
Oct 31 17:27:13.102523 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:13.102375    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/27af0f99-138f-42ac-89b9-9dfc4a522483-multus-cni-dir\") pod \"multus-9zs6c\" (UID: \"27af0f99-138f-42ac-89b9-9dfc4a522483\") " pod="openshift-multus/multus-9zs6c"
Oct 31 17:27:13.102523 ip-10-0-138-17 kubenswrapper[5003]: E1031 17:27:13.102374    5003 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/25ad5c67-f563-4653-9e86-7e9ecbe78675-metrics-tls podName:25ad5c67-f563-4653-9e86-7e9ecbe78675 nodeName:}" failed. No retries permitted until 2026-10-31 17:27:13.602362482 +0000 UTC m=+1.857217007 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/25ad5c67-f563-4653-9e86-7e9ecbe78675-metrics-tls") pod "dns-default-7v7x4" (UID: "25ad5c67-f563-4653-9e86-7e9ecbe78675") : secret "dns-default-metrics-tls" not found
Oct 31 17:27:13.102523 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:13.102421    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ef27850a-20b3-4876-8330-57e8954f1a79-run-openvswitch\") pod \"ovnkube-node-v8sbm\" (UID: \"ef27850a-20b3-4876-8330-57e8954f1a79\") " pod="openshift-ovn-kubernetes/ovnkube-node-v8sbm"
Oct 31 17:27:13.102523 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:13.102429    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/88be474b-fd0b-4784-8f1c-2dc0bdfb2792-sys-fs\") pod \"aws-ebs-csi-driver-node-ldjrw\" (UID: \"88be474b-fd0b-4784-8f1c-2dc0bdfb2792\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ldjrw"
Oct 31 17:27:13.102523 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:13.102466    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ef27850a-20b3-4876-8330-57e8954f1a79-run-openvswitch\") pod \"ovnkube-node-v8sbm\" (UID: \"ef27850a-20b3-4876-8330-57e8954f1a79\") " pod="openshift-ovn-kubernetes/ovnkube-node-v8sbm"
Oct 31 17:27:13.102523 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:13.102450    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ef27850a-20b3-4876-8330-57e8954f1a79-systemd-units\") pod \"ovnkube-node-v8sbm\" (UID: \"ef27850a-20b3-4876-8330-57e8954f1a79\") " pod="openshift-ovn-kubernetes/ovnkube-node-v8sbm"
Oct 31 17:27:13.102523 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:13.102479    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ef27850a-20b3-4876-8330-57e8954f1a79-systemd-units\") pod \"ovnkube-node-v8sbm\" (UID: \"ef27850a-20b3-4876-8330-57e8954f1a79\") " pod="openshift-ovn-kubernetes/ovnkube-node-v8sbm"
Oct 31 17:27:13.102523 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:13.102496    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/50e82975-3344-4653-8de3-68e8a64a8757-service-ca-bundle\") pod \"router-default-65db5d9749-xvqmh\" (UID: \"50e82975-3344-4653-8de3-68e8a64a8757\") " pod="openshift-ingress/router-default-65db5d9749-xvqmh"
Oct 31 17:27:13.102523 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:13.102522    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/9a0cf7f7-c12d-42fe-a83e-28e1f1859cd2-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-rnvgv\" (UID: \"9a0cf7f7-c12d-42fe-a83e-28e1f1859cd2\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-rnvgv"
Oct 31 17:27:13.104128 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:13.102552    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ef27850a-20b3-4876-8330-57e8954f1a79-run-ovn\") pod \"ovnkube-node-v8sbm\" (UID: \"ef27850a-20b3-4876-8330-57e8954f1a79\") " pod="openshift-ovn-kubernetes/ovnkube-node-v8sbm"
Oct 31 17:27:13.104128 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:13.102573    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fe1c5f7c-fdfd-40b9-bc0f-4e018779ee2b-system-cni-dir\") pod \"multus-additional-cni-plugins-swb7n\" (UID: \"fe1c5f7c-fdfd-40b9-bc0f-4e018779ee2b\") " pod="openshift-multus/multus-additional-cni-plugins-swb7n"
Oct 31 17:27:13.104128 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:13.102598    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3aa3a055-ec26-4d70-bb04-d6a09abe6661-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-tdzz5\" (UID: \"3aa3a055-ec26-4d70-bb04-d6a09abe6661\") " pod="openshift-insights/insights-runtime-extractor-tdzz5"
Oct 31 17:27:13.104128 ip-10-0-138-17 kubenswrapper[5003]: E1031 17:27:13.102639    5003 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/50e82975-3344-4653-8de3-68e8a64a8757-service-ca-bundle podName:50e82975-3344-4653-8de3-68e8a64a8757 nodeName:}" failed. No retries permitted until 2026-10-31 17:27:13.602623591 +0000 UTC m=+1.857478134 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/50e82975-3344-4653-8de3-68e8a64a8757-service-ca-bundle") pod "router-default-65db5d9749-xvqmh" (UID: "50e82975-3344-4653-8de3-68e8a64a8757") : configmap references non-existent config key: service-ca.crt
Oct 31 17:27:13.104128 ip-10-0-138-17 kubenswrapper[5003]: E1031 17:27:13.102673    5003 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Oct 31 17:27:13.104128 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:13.102675    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ef27850a-20b3-4876-8330-57e8954f1a79-run-ovn\") pod \"ovnkube-node-v8sbm\" (UID: \"ef27850a-20b3-4876-8330-57e8954f1a79\") " pod="openshift-ovn-kubernetes/ovnkube-node-v8sbm"
Oct 31 17:27:13.104128 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:13.102677    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fe1c5f7c-fdfd-40b9-bc0f-4e018779ee2b-system-cni-dir\") pod \"multus-additional-cni-plugins-swb7n\" (UID: \"fe1c5f7c-fdfd-40b9-bc0f-4e018779ee2b\") " pod="openshift-multus/multus-additional-cni-plugins-swb7n"
Oct 31 17:27:13.104128 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:13.102695    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/0c8a8a3b-14dd-45c9-b8fb-baf967142fd6-etc-sysctl-d\") pod \"tuned-zm6cj\" (UID: \"0c8a8a3b-14dd-45c9-b8fb-baf967142fd6\") " pod="openshift-cluster-node-tuning-operator/tuned-zm6cj"
Oct 31 17:27:13.104128 ip-10-0-138-17 kubenswrapper[5003]: E1031 17:27:13.102715    5003 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9a0cf7f7-c12d-42fe-a83e-28e1f1859cd2-networking-console-plugin-cert podName:9a0cf7f7-c12d-42fe-a83e-28e1f1859cd2 nodeName:}" failed. No retries permitted until 2026-10-31 17:27:13.602702991 +0000 UTC m=+1.857557546 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/9a0cf7f7-c12d-42fe-a83e-28e1f1859cd2-networking-console-plugin-cert") pod "networking-console-plugin-86c478bb88-rnvgv" (UID: "9a0cf7f7-c12d-42fe-a83e-28e1f1859cd2") : secret "networking-console-plugin-cert" not found
Oct 31 17:27:13.104128 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:13.102750    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/fe1c5f7c-fdfd-40b9-bc0f-4e018779ee2b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-swb7n\" (UID: \"fe1c5f7c-fdfd-40b9-bc0f-4e018779ee2b\") " pod="openshift-multus/multus-additional-cni-plugins-swb7n"
Oct 31 17:27:13.104128 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:13.102775    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/0c8a8a3b-14dd-45c9-b8fb-baf967142fd6-etc-sysctl-d\") pod \"tuned-zm6cj\" (UID: \"0c8a8a3b-14dd-45c9-b8fb-baf967142fd6\") " pod="openshift-cluster-node-tuning-operator/tuned-zm6cj"
Oct 31 17:27:13.104128 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:13.102809    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0c8a8a3b-14dd-45c9-b8fb-baf967142fd6-etc-kubernetes\") pod \"tuned-zm6cj\" (UID: \"0c8a8a3b-14dd-45c9-b8fb-baf967142fd6\") " pod="openshift-cluster-node-tuning-operator/tuned-zm6cj"
Oct 31 17:27:13.104128 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:13.102775    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0c8a8a3b-14dd-45c9-b8fb-baf967142fd6-etc-kubernetes\") pod \"tuned-zm6cj\" (UID: \"0c8a8a3b-14dd-45c9-b8fb-baf967142fd6\") " pod="openshift-cluster-node-tuning-operator/tuned-zm6cj"
Oct 31 17:27:13.104128 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:13.102825    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/fe1c5f7c-fdfd-40b9-bc0f-4e018779ee2b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-swb7n\" (UID: \"fe1c5f7c-fdfd-40b9-bc0f-4e018779ee2b\") " pod="openshift-multus/multus-additional-cni-plugins-swb7n"
Oct 31 17:27:13.104128 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:13.102833    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/27af0f99-138f-42ac-89b9-9dfc4a522483-cnibin\") pod \"multus-9zs6c\" (UID: \"27af0f99-138f-42ac-89b9-9dfc4a522483\") " pod="openshift-multus/multus-9zs6c"
Oct 31 17:27:13.104128 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:13.102859    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/27af0f99-138f-42ac-89b9-9dfc4a522483-cnibin\") pod \"multus-9zs6c\" (UID: \"27af0f99-138f-42ac-89b9-9dfc4a522483\") " pod="openshift-multus/multus-9zs6c"
Oct 31 17:27:13.104128 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:13.102873    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/88be474b-fd0b-4784-8f1c-2dc0bdfb2792-kubelet-dir\") pod \"aws-ebs-csi-driver-node-ldjrw\" (UID: \"88be474b-fd0b-4784-8f1c-2dc0bdfb2792\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ldjrw"
Oct 31 17:27:13.104128 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:13.102901    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0c8a8a3b-14dd-45c9-b8fb-baf967142fd6-var-lib-kubelet\") pod \"tuned-zm6cj\" (UID: \"0c8a8a3b-14dd-45c9-b8fb-baf967142fd6\") " pod="openshift-cluster-node-tuning-operator/tuned-zm6cj"
Oct 31 17:27:13.104128 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:13.102929    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/a1bea244-6573-4e3c-9849-b27ade411c9f-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-csbxp\" (UID: \"a1bea244-6573-4e3c-9849-b27ade411c9f\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-csbxp"
Oct 31 17:27:13.104128 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:13.102954    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/88be474b-fd0b-4784-8f1c-2dc0bdfb2792-kubelet-dir\") pod \"aws-ebs-csi-driver-node-ldjrw\" (UID: \"88be474b-fd0b-4784-8f1c-2dc0bdfb2792\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ldjrw"
Oct 31 17:27:13.104128 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:13.102958    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/88be474b-fd0b-4784-8f1c-2dc0bdfb2792-registration-dir\") pod \"aws-ebs-csi-driver-node-ldjrw\" (UID: \"88be474b-fd0b-4784-8f1c-2dc0bdfb2792\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ldjrw"
Oct 31 17:27:13.104128 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:13.102986    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/0c8a8a3b-14dd-45c9-b8fb-baf967142fd6-run\") pod \"tuned-zm6cj\" (UID: \"0c8a8a3b-14dd-45c9-b8fb-baf967142fd6\") " pod="openshift-cluster-node-tuning-operator/tuned-zm6cj"
Oct 31 17:27:13.104128 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:13.103006    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ef27850a-20b3-4876-8330-57e8954f1a79-host-cni-bin\") pod \"ovnkube-node-v8sbm\" (UID: \"ef27850a-20b3-4876-8330-57e8954f1a79\") " pod="openshift-ovn-kubernetes/ovnkube-node-v8sbm"
Oct 31 17:27:13.104128 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:13.103007    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/88be474b-fd0b-4784-8f1c-2dc0bdfb2792-registration-dir\") pod \"aws-ebs-csi-driver-node-ldjrw\" (UID: \"88be474b-fd0b-4784-8f1c-2dc0bdfb2792\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ldjrw"
Oct 31 17:27:13.104128 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:13.103014    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0c8a8a3b-14dd-45c9-b8fb-baf967142fd6-var-lib-kubelet\") pod \"tuned-zm6cj\" (UID: \"0c8a8a3b-14dd-45c9-b8fb-baf967142fd6\") " pod="openshift-cluster-node-tuning-operator/tuned-zm6cj"
Oct 31 17:27:13.104128 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:13.103030    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ef27850a-20b3-4876-8330-57e8954f1a79-host-cni-bin\") pod \"ovnkube-node-v8sbm\" (UID: \"ef27850a-20b3-4876-8330-57e8954f1a79\") " pod="openshift-ovn-kubernetes/ovnkube-node-v8sbm"
Oct 31 17:27:13.104128 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:13.103033    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/eaed4088-d322-48ab-af04-3c9efdea4e73-hosts-file\") pod \"node-resolver-x25tg\" (UID: \"eaed4088-d322-48ab-af04-3c9efdea4e73\") " pod="openshift-dns/node-resolver-x25tg"
Oct 31 17:27:13.104128 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:13.103061    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/27af0f99-138f-42ac-89b9-9dfc4a522483-etc-kubernetes\") pod \"multus-9zs6c\" (UID: \"27af0f99-138f-42ac-89b9-9dfc4a522483\") " pod="openshift-multus/multus-9zs6c"
Oct 31 17:27:13.104128 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:13.103085    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9d9ecf7f-6a11-469b-8626-99d5ef7ffac7-registry-tls\") pod \"image-registry-869fc8694f-xcqzj\" (UID: \"9d9ecf7f-6a11-469b-8626-99d5ef7ffac7\") " pod="openshift-image-registry/image-registry-869fc8694f-xcqzj"
Oct 31 17:27:13.104128 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:13.103089    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/0c8a8a3b-14dd-45c9-b8fb-baf967142fd6-run\") pod \"tuned-zm6cj\" (UID: \"0c8a8a3b-14dd-45c9-b8fb-baf967142fd6\") " pod="openshift-cluster-node-tuning-operator/tuned-zm6cj"
Oct 31 17:27:13.104128 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:13.103107    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3aa3a055-ec26-4d70-bb04-d6a09abe6661-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-tdzz5\" (UID: \"3aa3a055-ec26-4d70-bb04-d6a09abe6661\") " pod="openshift-insights/insights-runtime-extractor-tdzz5"
Oct 31 17:27:13.104128 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:13.103112    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/3aa3a055-ec26-4d70-bb04-d6a09abe6661-crio-socket\") pod \"insights-runtime-extractor-tdzz5\" (UID: \"3aa3a055-ec26-4d70-bb04-d6a09abe6661\") " pod="openshift-insights/insights-runtime-extractor-tdzz5"
Oct 31 17:27:13.104128 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:13.103134    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/27af0f99-138f-42ac-89b9-9dfc4a522483-etc-kubernetes\") pod \"multus-9zs6c\" (UID: \"27af0f99-138f-42ac-89b9-9dfc4a522483\") " pod="openshift-multus/multus-9zs6c"
Oct 31 17:27:13.104128 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:13.103138    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/eaed4088-d322-48ab-af04-3c9efdea4e73-hosts-file\") pod \"node-resolver-x25tg\" (UID: \"eaed4088-d322-48ab-af04-3c9efdea4e73\") " pod="openshift-dns/node-resolver-x25tg"
Oct 31 17:27:13.104128 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:13.103153    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/3aa3a055-ec26-4d70-bb04-d6a09abe6661-crio-socket\") pod \"insights-runtime-extractor-tdzz5\" (UID: \"3aa3a055-ec26-4d70-bb04-d6a09abe6661\") " pod="openshift-insights/insights-runtime-extractor-tdzz5"
Oct 31 17:27:13.104128 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:13.103162    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0c8a8a3b-14dd-45c9-b8fb-baf967142fd6-host\") pod \"tuned-zm6cj\" (UID: \"0c8a8a3b-14dd-45c9-b8fb-baf967142fd6\") " pod="openshift-cluster-node-tuning-operator/tuned-zm6cj"
Oct 31 17:27:13.104128 ip-10-0-138-17 kubenswrapper[5003]: E1031 17:27:13.103175    5003 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Oct 31 17:27:13.104128 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:13.103188    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/27af0f99-138f-42ac-89b9-9dfc4a522483-host-var-lib-cni-multus\") pod \"multus-9zs6c\" (UID: \"27af0f99-138f-42ac-89b9-9dfc4a522483\") " pod="openshift-multus/multus-9zs6c"
Oct 31 17:27:13.104128 ip-10-0-138-17 kubenswrapper[5003]: E1031 17:27:13.103197    5003 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-869fc8694f-xcqzj: secret "image-registry-tls" not found
Oct 31 17:27:13.104128 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:13.103200    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0c8a8a3b-14dd-45c9-b8fb-baf967142fd6-host\") pod \"tuned-zm6cj\" (UID: \"0c8a8a3b-14dd-45c9-b8fb-baf967142fd6\") " pod="openshift-cluster-node-tuning-operator/tuned-zm6cj"
Oct 31 17:27:13.104128 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:13.103223    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ef27850a-20b3-4876-8330-57e8954f1a79-host-cni-netd\") pod \"ovnkube-node-v8sbm\" (UID: \"ef27850a-20b3-4876-8330-57e8954f1a79\") " pod="openshift-ovn-kubernetes/ovnkube-node-v8sbm"
Oct 31 17:27:13.104128 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:13.103249    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b1e258da-4619-478c-895a-041aa7eeafb6-host-slash\") pod \"iptables-alerter-h8jzv\" (UID: \"b1e258da-4619-478c-895a-041aa7eeafb6\") " pod="openshift-network-operator/iptables-alerter-h8jzv"
Oct 31 17:27:13.104128 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:13.103250    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/27af0f99-138f-42ac-89b9-9dfc4a522483-host-var-lib-cni-multus\") pod \"multus-9zs6c\" (UID: \"27af0f99-138f-42ac-89b9-9dfc4a522483\") " pod="openshift-multus/multus-9zs6c"
Oct 31 17:27:13.104128 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:13.103259    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ef27850a-20b3-4876-8330-57e8954f1a79-host-cni-netd\") pod \"ovnkube-node-v8sbm\" (UID: \"ef27850a-20b3-4876-8330-57e8954f1a79\") " pod="openshift-ovn-kubernetes/ovnkube-node-v8sbm"
Oct 31 17:27:13.104128 ip-10-0-138-17 kubenswrapper[5003]: E1031 17:27:13.103267    5003 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9d9ecf7f-6a11-469b-8626-99d5ef7ffac7-registry-tls podName:9d9ecf7f-6a11-469b-8626-99d5ef7ffac7 nodeName:}" failed. No retries permitted until 2026-10-31 17:27:13.603253894 +0000 UTC m=+1.858108437 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9d9ecf7f-6a11-469b-8626-99d5ef7ffac7-registry-tls") pod "image-registry-869fc8694f-xcqzj" (UID: "9d9ecf7f-6a11-469b-8626-99d5ef7ffac7") : secret "image-registry-tls" not found
Oct 31 17:27:13.104128 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:13.103296    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b1e258da-4619-478c-895a-041aa7eeafb6-host-slash\") pod \"iptables-alerter-h8jzv\" (UID: \"b1e258da-4619-478c-895a-041aa7eeafb6\") " pod="openshift-network-operator/iptables-alerter-h8jzv"
Oct 31 17:27:13.104128 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:13.103310    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/9179e3c5-ef52-4445-aec0-779c3e99cb07-kubelet-config\") pod \"global-pull-secret-syncer-qgtf4\" (UID: \"9179e3c5-ef52-4445-aec0-779c3e99cb07\") " pod="kube-system/global-pull-secret-syncer-qgtf4"
Oct 31 17:27:13.104128 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:13.103337    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/9179e3c5-ef52-4445-aec0-779c3e99cb07-dbus\") pod \"global-pull-secret-syncer-qgtf4\" (UID: \"9179e3c5-ef52-4445-aec0-779c3e99cb07\") " pod="kube-system/global-pull-secret-syncer-qgtf4"
Oct 31 17:27:13.104128 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:13.103362    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/27af0f99-138f-42ac-89b9-9dfc4a522483-host-run-k8s-cni-cncf-io\") pod \"multus-9zs6c\" (UID: \"27af0f99-138f-42ac-89b9-9dfc4a522483\") " pod="openshift-multus/multus-9zs6c"
Oct 31 17:27:13.104128 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:13.103378    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/9179e3c5-ef52-4445-aec0-779c3e99cb07-kubelet-config\") pod \"global-pull-secret-syncer-qgtf4\" (UID: \"9179e3c5-ef52-4445-aec0-779c3e99cb07\") " pod="kube-system/global-pull-secret-syncer-qgtf4"
Oct 31 17:27:13.104128 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:13.103387    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/fe1c5f7c-fdfd-40b9-bc0f-4e018779ee2b-cnibin\") pod \"multus-additional-cni-plugins-swb7n\" (UID: \"fe1c5f7c-fdfd-40b9-bc0f-4e018779ee2b\") " pod="openshift-multus/multus-additional-cni-plugins-swb7n"
Oct 31 17:27:13.104128 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:13.103402    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/9179e3c5-ef52-4445-aec0-779c3e99cb07-dbus\") pod \"global-pull-secret-syncer-qgtf4\" (UID: \"9179e3c5-ef52-4445-aec0-779c3e99cb07\") " pod="kube-system/global-pull-secret-syncer-qgtf4"
Oct 31 17:27:13.104128 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:13.103409    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ef27850a-20b3-4876-8330-57e8954f1a79-host-slash\") pod \"ovnkube-node-v8sbm\" (UID: \"ef27850a-20b3-4876-8330-57e8954f1a79\") " pod="openshift-ovn-kubernetes/ovnkube-node-v8sbm"
Oct 31 17:27:13.104128 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:13.103418    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/27af0f99-138f-42ac-89b9-9dfc4a522483-host-run-k8s-cni-cncf-io\") pod \"multus-9zs6c\" (UID: \"27af0f99-138f-42ac-89b9-9dfc4a522483\") " pod="openshift-multus/multus-9zs6c"
Oct 31 17:27:13.104128 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:13.103434    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/27af0f99-138f-42ac-89b9-9dfc4a522483-host-run-netns\") pod \"multus-9zs6c\" (UID: \"27af0f99-138f-42ac-89b9-9dfc4a522483\") " pod="openshift-multus/multus-9zs6c"
Oct 31 17:27:13.104128 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:13.103443    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/fe1c5f7c-fdfd-40b9-bc0f-4e018779ee2b-cnibin\") pod \"multus-additional-cni-plugins-swb7n\" (UID: \"fe1c5f7c-fdfd-40b9-bc0f-4e018779ee2b\") " pod="openshift-multus/multus-additional-cni-plugins-swb7n"
Oct 31 17:27:13.104128 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:13.103460    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ef27850a-20b3-4876-8330-57e8954f1a79-host-slash\") pod \"ovnkube-node-v8sbm\" (UID: \"ef27850a-20b3-4876-8330-57e8954f1a79\") " pod="openshift-ovn-kubernetes/ovnkube-node-v8sbm"
Oct 31 17:27:13.104128 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:13.103472    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/88be474b-fd0b-4784-8f1c-2dc0bdfb2792-etc-selinux\") pod \"aws-ebs-csi-driver-node-ldjrw\" (UID: \"88be474b-fd0b-4784-8f1c-2dc0bdfb2792\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ldjrw"
Oct 31 17:27:13.104128 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:13.103478    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/27af0f99-138f-42ac-89b9-9dfc4a522483-host-run-netns\") pod \"multus-9zs6c\" (UID: \"27af0f99-138f-42ac-89b9-9dfc4a522483\") " pod="openshift-multus/multus-9zs6c"
Oct 31 17:27:13.104128 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:13.103500    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/27af0f99-138f-42ac-89b9-9dfc4a522483-multus-conf-dir\") pod \"multus-9zs6c\" (UID: \"27af0f99-138f-42ac-89b9-9dfc4a522483\") " pod="openshift-multus/multus-9zs6c"
Oct 31 17:27:13.104128 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:13.103524    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/27af0f99-138f-42ac-89b9-9dfc4a522483-system-cni-dir\") pod \"multus-9zs6c\" (UID: \"27af0f99-138f-42ac-89b9-9dfc4a522483\") " pod="openshift-multus/multus-9zs6c"
Oct 31 17:27:13.104128 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:13.103532    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/88be474b-fd0b-4784-8f1c-2dc0bdfb2792-etc-selinux\") pod \"aws-ebs-csi-driver-node-ldjrw\" (UID: \"88be474b-fd0b-4784-8f1c-2dc0bdfb2792\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ldjrw"
Oct 31 17:27:13.104128 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:13.103548    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/27af0f99-138f-42ac-89b9-9dfc4a522483-multus-socket-dir-parent\") pod \"multus-9zs6c\" (UID: \"27af0f99-138f-42ac-89b9-9dfc4a522483\") " pod="openshift-multus/multus-9zs6c"
Oct 31 17:27:13.104128 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:13.103564    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/27af0f99-138f-42ac-89b9-9dfc4a522483-multus-conf-dir\") pod \"multus-9zs6c\" (UID: \"27af0f99-138f-42ac-89b9-9dfc4a522483\") " pod="openshift-multus/multus-9zs6c"
Oct 31 17:27:13.104128 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:13.103580    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/170ada34-8944-43d2-bcfb-1d782aae5348-registry-tls\") pod \"image-registry-74dbfdb444-q7rkg\" (UID: \"170ada34-8944-43d2-bcfb-1d782aae5348\") " pod="openshift-image-registry/image-registry-74dbfdb444-q7rkg"
Oct 31 17:27:13.104128 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:13.103585    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/27af0f99-138f-42ac-89b9-9dfc4a522483-system-cni-dir\") pod \"multus-9zs6c\" (UID: \"27af0f99-138f-42ac-89b9-9dfc4a522483\") " pod="openshift-multus/multus-9zs6c"
Oct 31 17:27:13.104128 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:13.103604    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/27af0f99-138f-42ac-89b9-9dfc4a522483-multus-socket-dir-parent\") pod \"multus-9zs6c\" (UID: \"27af0f99-138f-42ac-89b9-9dfc4a522483\") " pod="openshift-multus/multus-9zs6c"
Oct 31 17:27:13.104128 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:13.103614    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c915138c-9050-4958-b442-fee1aca9b002-host\") pod \"node-ca-lcz9q\" (UID: \"c915138c-9050-4958-b442-fee1aca9b002\") " pod="openshift-image-registry/node-ca-lcz9q"
Oct 31 17:27:13.104128 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:13.103659    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/27af0f99-138f-42ac-89b9-9dfc4a522483-host-var-lib-kubelet\") pod \"multus-9zs6c\" (UID: \"27af0f99-138f-42ac-89b9-9dfc4a522483\") " pod="openshift-multus/multus-9zs6c"
Oct 31 17:27:13.104128 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:13.103673    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c915138c-9050-4958-b442-fee1aca9b002-host\") pod \"node-ca-lcz9q\" (UID: \"c915138c-9050-4958-b442-fee1aca9b002\") " pod="openshift-image-registry/node-ca-lcz9q"
Oct 31 17:27:13.104128 ip-10-0-138-17 kubenswrapper[5003]: E1031 17:27:13.103674    5003 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Oct 31 17:27:13.104128 ip-10-0-138-17 kubenswrapper[5003]: E1031 17:27:13.103695    5003 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-74dbfdb444-q7rkg: secret "image-registry-tls" not found
Oct 31 17:27:13.104128 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:13.103699    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/88be474b-fd0b-4784-8f1c-2dc0bdfb2792-socket-dir\") pod \"aws-ebs-csi-driver-node-ldjrw\" (UID: \"88be474b-fd0b-4784-8f1c-2dc0bdfb2792\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ldjrw"
Oct 31 17:27:13.104128 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:13.103691    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/27af0f99-138f-42ac-89b9-9dfc4a522483-host-var-lib-kubelet\") pod \"multus-9zs6c\" (UID: \"27af0f99-138f-42ac-89b9-9dfc4a522483\") " pod="openshift-multus/multus-9zs6c"
Oct 31 17:27:13.104128 ip-10-0-138-17 kubenswrapper[5003]: E1031 17:27:13.103747    5003 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/170ada34-8944-43d2-bcfb-1d782aae5348-registry-tls podName:170ada34-8944-43d2-bcfb-1d782aae5348 nodeName:}" failed. No retries permitted until 2026-10-31 17:27:13.603714313 +0000 UTC m=+1.858568852 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/170ada34-8944-43d2-bcfb-1d782aae5348-registry-tls") pod "image-registry-74dbfdb444-q7rkg" (UID: "170ada34-8944-43d2-bcfb-1d782aae5348") : secret "image-registry-tls" not found
Oct 31 17:27:13.104128 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:13.103760    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/88be474b-fd0b-4784-8f1c-2dc0bdfb2792-device-dir\") pod \"aws-ebs-csi-driver-node-ldjrw\" (UID: \"88be474b-fd0b-4784-8f1c-2dc0bdfb2792\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ldjrw"
Oct 31 17:27:13.104128 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:13.103779    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/0c8a8a3b-14dd-45c9-b8fb-baf967142fd6-etc-sysctl-conf\") pod \"tuned-zm6cj\" (UID: \"0c8a8a3b-14dd-45c9-b8fb-baf967142fd6\") " pod="openshift-cluster-node-tuning-operator/tuned-zm6cj"
Oct 31 17:27:13.104128 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:13.103760    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/88be474b-fd0b-4784-8f1c-2dc0bdfb2792-socket-dir\") pod \"aws-ebs-csi-driver-node-ldjrw\" (UID: \"88be474b-fd0b-4784-8f1c-2dc0bdfb2792\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ldjrw"
Oct 31 17:27:13.104128 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:13.103797    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/449efcb2-6707-4809-b869-1bb477f6e6ae-metrics-certs\") pod \"network-metrics-daemon-7j59v\" (UID: \"449efcb2-6707-4809-b869-1bb477f6e6ae\") " pod="openshift-multus/network-metrics-daemon-7j59v"
Oct 31 17:27:13.104128 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:13.103801    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/88be474b-fd0b-4784-8f1c-2dc0bdfb2792-device-dir\") pod \"aws-ebs-csi-driver-node-ldjrw\" (UID: \"88be474b-fd0b-4784-8f1c-2dc0bdfb2792\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ldjrw"
Oct 31 17:27:13.104128 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:13.103833    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ef27850a-20b3-4876-8330-57e8954f1a79-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-v8sbm\" (UID: \"ef27850a-20b3-4876-8330-57e8954f1a79\") " pod="openshift-ovn-kubernetes/ovnkube-node-v8sbm"
Oct 31 17:27:13.104128 ip-10-0-138-17 kubenswrapper[5003]: E1031 17:27:13.103874    5003 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Oct 31 17:27:13.104128 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:13.103896    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ef27850a-20b3-4876-8330-57e8954f1a79-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-v8sbm\" (UID: \"ef27850a-20b3-4876-8330-57e8954f1a79\") " pod="openshift-ovn-kubernetes/ovnkube-node-v8sbm"
Oct 31 17:27:13.104128 ip-10-0-138-17 kubenswrapper[5003]: E1031 17:27:13.103935    5003 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/449efcb2-6707-4809-b869-1bb477f6e6ae-metrics-certs podName:449efcb2-6707-4809-b869-1bb477f6e6ae nodeName:}" failed. No retries permitted until 2026-10-31 17:27:13.603920764 +0000 UTC m=+1.858775298 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/449efcb2-6707-4809-b869-1bb477f6e6ae-metrics-certs") pod "network-metrics-daemon-7j59v" (UID: "449efcb2-6707-4809-b869-1bb477f6e6ae") : secret "metrics-daemon-secret" not found
Oct 31 17:27:13.104128 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:13.103926    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/0c8a8a3b-14dd-45c9-b8fb-baf967142fd6-etc-sysctl-conf\") pod \"tuned-zm6cj\" (UID: \"0c8a8a3b-14dd-45c9-b8fb-baf967142fd6\") " pod="openshift-cluster-node-tuning-operator/tuned-zm6cj"
Oct 31 17:27:13.106362 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:13.104718    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/ec682f92-b657-44bd-9e85-3cd4680d2f95-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-rhsk4\" (UID: \"ec682f92-b657-44bd-9e85-3cd4680d2f95\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-rhsk4"
Oct 31 17:27:13.106362 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:13.105208    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/a1bea244-6573-4e3c-9849-b27ade411c9f-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-csbxp\" (UID: \"a1bea244-6573-4e3c-9849-b27ade411c9f\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-csbxp"
Oct 31 17:27:13.194685 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:13.194631    5003 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-884576c57-csbxp"
Oct 31 17:27:13.195745 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:13.195726    5003 scope.go:122] "RemoveContainer" containerID="0bd9770d3ee51d6d9482dae960ce96f0bd57304d5988f25ca104ece2f1b1109f"
Oct 31 17:27:13.196628 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:13.196604    5003 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-rhsk4"
Oct 31 17:27:13.533058 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:13.533025    5003 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-884576c57-csbxp"]
Oct 31 17:27:13.538932 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:13.538899    5003 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda1bea244_6573_4e3c_9849_b27ade411c9f.slice/crio-0cde110449bdbc0e6e36fc263202fec7558543f53404ce79c25ac8b377e37818 WatchSource:0}: Error finding container 0cde110449bdbc0e6e36fc263202fec7558543f53404ce79c25ac8b377e37818: Status 404 returned error can't find the container with id 0cde110449bdbc0e6e36fc263202fec7558543f53404ce79c25ac8b377e37818
Oct 31 17:27:13.541084 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:13.541067    5003 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Oct 31 17:27:13.548766 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:13.548742    5003 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-rhsk4"]
Oct 31 17:27:13.608607 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:13.608380    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9d9ecf7f-6a11-469b-8626-99d5ef7ffac7-registry-tls\") pod \"image-registry-869fc8694f-xcqzj\" (UID: \"9d9ecf7f-6a11-469b-8626-99d5ef7ffac7\") " pod="openshift-image-registry/image-registry-869fc8694f-xcqzj"
Oct 31 17:27:13.608607 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:13.608435    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/170ada34-8944-43d2-bcfb-1d782aae5348-registry-tls\") pod \"image-registry-74dbfdb444-q7rkg\" (UID: \"170ada34-8944-43d2-bcfb-1d782aae5348\") " pod="openshift-image-registry/image-registry-74dbfdb444-q7rkg"
Oct 31 17:27:13.608607 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:13.608465    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/449efcb2-6707-4809-b869-1bb477f6e6ae-metrics-certs\") pod \"network-metrics-daemon-7j59v\" (UID: \"449efcb2-6707-4809-b869-1bb477f6e6ae\") " pod="openshift-multus/network-metrics-daemon-7j59v"
Oct 31 17:27:13.608607 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:13.608492    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3aa3a055-ec26-4d70-bb04-d6a09abe6661-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-tdzz5\" (UID: \"3aa3a055-ec26-4d70-bb04-d6a09abe6661\") " pod="openshift-insights/insights-runtime-extractor-tdzz5"
Oct 31 17:27:13.608607 ip-10-0-138-17 kubenswrapper[5003]: E1031 17:27:13.608553    5003 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Oct 31 17:27:13.608607 ip-10-0-138-17 kubenswrapper[5003]: E1031 17:27:13.608575    5003 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-869fc8694f-xcqzj: secret "image-registry-tls" not found
Oct 31 17:27:13.608924 ip-10-0-138-17 kubenswrapper[5003]: E1031 17:27:13.608612    5003 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Oct 31 17:27:13.608924 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:13.608618    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/50e82975-3344-4653-8de3-68e8a64a8757-metrics-certs\") pod \"router-default-65db5d9749-xvqmh\" (UID: \"50e82975-3344-4653-8de3-68e8a64a8757\") " pod="openshift-ingress/router-default-65db5d9749-xvqmh"
Oct 31 17:27:13.608924 ip-10-0-138-17 kubenswrapper[5003]: E1031 17:27:13.608629    5003 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-74dbfdb444-q7rkg: secret "image-registry-tls" not found
Oct 31 17:27:13.608924 ip-10-0-138-17 kubenswrapper[5003]: E1031 17:27:13.608630    5003 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Oct 31 17:27:13.608924 ip-10-0-138-17 kubenswrapper[5003]: E1031 17:27:13.608667    5003 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9d9ecf7f-6a11-469b-8626-99d5ef7ffac7-registry-tls podName:9d9ecf7f-6a11-469b-8626-99d5ef7ffac7 nodeName:}" failed. No retries permitted until 2026-10-31 17:27:14.608634219 +0000 UTC m=+2.863488738 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9d9ecf7f-6a11-469b-8626-99d5ef7ffac7-registry-tls") pod "image-registry-869fc8694f-xcqzj" (UID: "9d9ecf7f-6a11-469b-8626-99d5ef7ffac7") : secret "image-registry-tls" not found
Oct 31 17:27:13.608924 ip-10-0-138-17 kubenswrapper[5003]: E1031 17:27:13.608710    5003 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Oct 31 17:27:13.608924 ip-10-0-138-17 kubenswrapper[5003]: E1031 17:27:13.608733    5003 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/170ada34-8944-43d2-bcfb-1d782aae5348-registry-tls podName:170ada34-8944-43d2-bcfb-1d782aae5348 nodeName:}" failed. No retries permitted until 2026-10-31 17:27:14.608716454 +0000 UTC m=+2.863570981 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/170ada34-8944-43d2-bcfb-1d782aae5348-registry-tls") pod "image-registry-74dbfdb444-q7rkg" (UID: "170ada34-8944-43d2-bcfb-1d782aae5348") : secret "image-registry-tls" not found
Oct 31 17:27:13.608924 ip-10-0-138-17 kubenswrapper[5003]: E1031 17:27:13.608752    5003 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/449efcb2-6707-4809-b869-1bb477f6e6ae-metrics-certs podName:449efcb2-6707-4809-b869-1bb477f6e6ae nodeName:}" failed. No retries permitted until 2026-10-31 17:27:14.60874318 +0000 UTC m=+2.863597701 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/449efcb2-6707-4809-b869-1bb477f6e6ae-metrics-certs") pod "network-metrics-daemon-7j59v" (UID: "449efcb2-6707-4809-b869-1bb477f6e6ae") : secret "metrics-daemon-secret" not found
Oct 31 17:27:13.608924 ip-10-0-138-17 kubenswrapper[5003]: E1031 17:27:13.608753    5003 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Oct 31 17:27:13.608924 ip-10-0-138-17 kubenswrapper[5003]: E1031 17:27:13.608782    5003 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/50e82975-3344-4653-8de3-68e8a64a8757-metrics-certs podName:50e82975-3344-4653-8de3-68e8a64a8757 nodeName:}" failed. No retries permitted until 2026-10-31 17:27:14.608766491 +0000 UTC m=+2.863621019 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/50e82975-3344-4653-8de3-68e8a64a8757-metrics-certs") pod "router-default-65db5d9749-xvqmh" (UID: "50e82975-3344-4653-8de3-68e8a64a8757") : secret "router-metrics-certs-default" not found
Oct 31 17:27:13.608924 ip-10-0-138-17 kubenswrapper[5003]: E1031 17:27:13.608802    5003 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3aa3a055-ec26-4d70-bb04-d6a09abe6661-insights-runtime-extractor-tls podName:3aa3a055-ec26-4d70-bb04-d6a09abe6661 nodeName:}" failed. No retries permitted until 2026-10-31 17:27:14.608793972 +0000 UTC m=+2.863648495 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/3aa3a055-ec26-4d70-bb04-d6a09abe6661-insights-runtime-extractor-tls") pod "insights-runtime-extractor-tdzz5" (UID: "3aa3a055-ec26-4d70-bb04-d6a09abe6661") : secret "insights-runtime-extractor-tls" not found
Oct 31 17:27:13.608924 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:13.608853    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/25ad5c67-f563-4653-9e86-7e9ecbe78675-metrics-tls\") pod \"dns-default-7v7x4\" (UID: \"25ad5c67-f563-4653-9e86-7e9ecbe78675\") " pod="openshift-dns/dns-default-7v7x4"
Oct 31 17:27:13.608924 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:13.608890    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/50e82975-3344-4653-8de3-68e8a64a8757-service-ca-bundle\") pod \"router-default-65db5d9749-xvqmh\" (UID: \"50e82975-3344-4653-8de3-68e8a64a8757\") " pod="openshift-ingress/router-default-65db5d9749-xvqmh"
Oct 31 17:27:13.608924 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:13.608923    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/9a0cf7f7-c12d-42fe-a83e-28e1f1859cd2-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-rnvgv\" (UID: \"9a0cf7f7-c12d-42fe-a83e-28e1f1859cd2\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-rnvgv"
Oct 31 17:27:13.609435 ip-10-0-138-17 kubenswrapper[5003]: E1031 17:27:13.608983    5003 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/50e82975-3344-4653-8de3-68e8a64a8757-service-ca-bundle podName:50e82975-3344-4653-8de3-68e8a64a8757 nodeName:}" failed. No retries permitted until 2026-10-31 17:27:14.608972168 +0000 UTC m=+2.863826712 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/50e82975-3344-4653-8de3-68e8a64a8757-service-ca-bundle") pod "router-default-65db5d9749-xvqmh" (UID: "50e82975-3344-4653-8de3-68e8a64a8757") : configmap references non-existent config key: service-ca.crt
Oct 31 17:27:13.609435 ip-10-0-138-17 kubenswrapper[5003]: E1031 17:27:13.609049    5003 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Oct 31 17:27:13.609435 ip-10-0-138-17 kubenswrapper[5003]: E1031 17:27:13.609094    5003 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9a0cf7f7-c12d-42fe-a83e-28e1f1859cd2-networking-console-plugin-cert podName:9a0cf7f7-c12d-42fe-a83e-28e1f1859cd2 nodeName:}" failed. No retries permitted until 2026-10-31 17:27:14.609081628 +0000 UTC m=+2.863936179 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/9a0cf7f7-c12d-42fe-a83e-28e1f1859cd2-networking-console-plugin-cert") pod "networking-console-plugin-86c478bb88-rnvgv" (UID: "9a0cf7f7-c12d-42fe-a83e-28e1f1859cd2") : secret "networking-console-plugin-cert" not found
Oct 31 17:27:13.611373 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:13.611300    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/25ad5c67-f563-4653-9e86-7e9ecbe78675-metrics-tls\") pod \"dns-default-7v7x4\" (UID: \"25ad5c67-f563-4653-9e86-7e9ecbe78675\") " pod="openshift-dns/dns-default-7v7x4"
Oct 31 17:27:13.807625 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:13.807587    5003 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-7v7x4"
Oct 31 17:27:13.924265 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:13.924229    5003 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-x25tg_eaed4088-d322-48ab-af04-3c9efdea4e73/dns-node-resolver/0.log"
Oct 31 17:27:13.946277 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:13.946237    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-rhsk4" event={"ID":"ec682f92-b657-44bd-9e85-3cd4680d2f95","Type":"ContainerStarted","Data":"ec4ded374139b6d200a1c9d0eaf673961c5552f875890b0759f445ecccbab462"}
Oct 31 17:27:13.947353 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:13.947315    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-884576c57-csbxp" event={"ID":"a1bea244-6573-4e3c-9849-b27ade411c9f","Type":"ContainerStarted","Data":"0cde110449bdbc0e6e36fc263202fec7558543f53404ce79c25ac8b377e37818"}
Oct 31 17:27:13.948801 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:13.948783    5003 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-b2xxw_f03611db-3bd9-401a-a137-1d4f691b51ea/console-operator/2.log"
Oct 31 17:27:13.949203 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:13.949184    5003 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-b2xxw_f03611db-3bd9-401a-a137-1d4f691b51ea/console-operator/1.log"
Oct 31 17:27:13.949289 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:13.949217    5003 generic.go:356] "Generic (PLEG): container finished" podID="f03611db-3bd9-401a-a137-1d4f691b51ea" containerID="03bb31d19f9e255d8a15ed609a61f110d1c8ffa858a639d9bc49216b1c5fb603" exitCode=255
Oct 31 17:27:13.949323 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:13.949294    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7cd56b8dbc-b2xxw" event={"ID":"f03611db-3bd9-401a-a137-1d4f691b51ea","Type":"ContainerDied","Data":"03bb31d19f9e255d8a15ed609a61f110d1c8ffa858a639d9bc49216b1c5fb603"}
Oct 31 17:27:13.949359 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:13.949349    5003 scope.go:122] "RemoveContainer" containerID="0bd9770d3ee51d6d9482dae960ce96f0bd57304d5988f25ca104ece2f1b1109f"
Oct 31 17:27:13.949816 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:13.949795    5003 scope.go:122] "RemoveContainer" containerID="03bb31d19f9e255d8a15ed609a61f110d1c8ffa858a639d9bc49216b1c5fb603"
Oct 31 17:27:13.950004 ip-10-0-138-17 kubenswrapper[5003]: E1031 17:27:13.949980    5003 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7cd56b8dbc-b2xxw_openshift-console-operator(f03611db-3bd9-401a-a137-1d4f691b51ea)\"" pod="openshift-console-operator/console-operator-7cd56b8dbc-b2xxw" podUID="f03611db-3bd9-401a-a137-1d4f691b51ea"
Oct 31 17:27:14.121424 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:14.121389    5003 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-7v7x4"]
Oct 31 17:27:14.127371 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:14.127302    5003 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod25ad5c67_f563_4653_9e86_7e9ecbe78675.slice/crio-0b9df00bbad5c7ef3aa72830db196a024e91f4aa795817a0e609f23017982dca WatchSource:0}: Error finding container 0b9df00bbad5c7ef3aa72830db196a024e91f4aa795817a0e609f23017982dca: Status 404 returned error can't find the container with id 0b9df00bbad5c7ef3aa72830db196a024e91f4aa795817a0e609f23017982dca
Oct 31 17:27:14.619287 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:14.619247    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3aa3a055-ec26-4d70-bb04-d6a09abe6661-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-tdzz5\" (UID: \"3aa3a055-ec26-4d70-bb04-d6a09abe6661\") " pod="openshift-insights/insights-runtime-extractor-tdzz5"
Oct 31 17:27:14.619476 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:14.619308    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/50e82975-3344-4653-8de3-68e8a64a8757-metrics-certs\") pod \"router-default-65db5d9749-xvqmh\" (UID: \"50e82975-3344-4653-8de3-68e8a64a8757\") " pod="openshift-ingress/router-default-65db5d9749-xvqmh"
Oct 31 17:27:14.619476 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:14.619376    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/50e82975-3344-4653-8de3-68e8a64a8757-service-ca-bundle\") pod \"router-default-65db5d9749-xvqmh\" (UID: \"50e82975-3344-4653-8de3-68e8a64a8757\") " pod="openshift-ingress/router-default-65db5d9749-xvqmh"
Oct 31 17:27:14.619476 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:14.619406    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/9a0cf7f7-c12d-42fe-a83e-28e1f1859cd2-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-rnvgv\" (UID: \"9a0cf7f7-c12d-42fe-a83e-28e1f1859cd2\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-rnvgv"
Oct 31 17:27:14.619476 ip-10-0-138-17 kubenswrapper[5003]: E1031 17:27:14.619419    5003 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Oct 31 17:27:14.619476 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:14.619444    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9d9ecf7f-6a11-469b-8626-99d5ef7ffac7-registry-tls\") pod \"image-registry-869fc8694f-xcqzj\" (UID: \"9d9ecf7f-6a11-469b-8626-99d5ef7ffac7\") " pod="openshift-image-registry/image-registry-869fc8694f-xcqzj"
Oct 31 17:27:14.619753 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:14.619479    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/170ada34-8944-43d2-bcfb-1d782aae5348-registry-tls\") pod \"image-registry-74dbfdb444-q7rkg\" (UID: \"170ada34-8944-43d2-bcfb-1d782aae5348\") " pod="openshift-image-registry/image-registry-74dbfdb444-q7rkg"
Oct 31 17:27:14.619753 ip-10-0-138-17 kubenswrapper[5003]: E1031 17:27:14.619481    5003 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Oct 31 17:27:14.619753 ip-10-0-138-17 kubenswrapper[5003]: E1031 17:27:14.619501    5003 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3aa3a055-ec26-4d70-bb04-d6a09abe6661-insights-runtime-extractor-tls podName:3aa3a055-ec26-4d70-bb04-d6a09abe6661 nodeName:}" failed. No retries permitted until 2026-10-31 17:27:16.619478597 +0000 UTC m=+4.874333135 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/3aa3a055-ec26-4d70-bb04-d6a09abe6661-insights-runtime-extractor-tls") pod "insights-runtime-extractor-tdzz5" (UID: "3aa3a055-ec26-4d70-bb04-d6a09abe6661") : secret "insights-runtime-extractor-tls" not found
Oct 31 17:27:14.619753 ip-10-0-138-17 kubenswrapper[5003]: E1031 17:27:14.619553    5003 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Oct 31 17:27:14.619753 ip-10-0-138-17 kubenswrapper[5003]: E1031 17:27:14.619591    5003 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Oct 31 17:27:14.619753 ip-10-0-138-17 kubenswrapper[5003]: E1031 17:27:14.619595    5003 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-74dbfdb444-q7rkg: secret "image-registry-tls" not found
Oct 31 17:27:14.619753 ip-10-0-138-17 kubenswrapper[5003]: E1031 17:27:14.619600    5003 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-869fc8694f-xcqzj: secret "image-registry-tls" not found
Oct 31 17:27:14.619753 ip-10-0-138-17 kubenswrapper[5003]: E1031 17:27:14.619600    5003 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Oct 31 17:27:14.619753 ip-10-0-138-17 kubenswrapper[5003]: E1031 17:27:14.619680    5003 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/50e82975-3344-4653-8de3-68e8a64a8757-service-ca-bundle podName:50e82975-3344-4653-8de3-68e8a64a8757 nodeName:}" failed. No retries permitted until 2026-10-31 17:27:16.61966877 +0000 UTC m=+4.874523303 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/50e82975-3344-4653-8de3-68e8a64a8757-service-ca-bundle") pod "router-default-65db5d9749-xvqmh" (UID: "50e82975-3344-4653-8de3-68e8a64a8757") : configmap references non-existent config key: service-ca.crt
Oct 31 17:27:14.619753 ip-10-0-138-17 kubenswrapper[5003]: E1031 17:27:14.619693    5003 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/50e82975-3344-4653-8de3-68e8a64a8757-metrics-certs podName:50e82975-3344-4653-8de3-68e8a64a8757 nodeName:}" failed. No retries permitted until 2026-10-31 17:27:16.619687673 +0000 UTC m=+4.874542193 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/50e82975-3344-4653-8de3-68e8a64a8757-metrics-certs") pod "router-default-65db5d9749-xvqmh" (UID: "50e82975-3344-4653-8de3-68e8a64a8757") : secret "router-metrics-certs-default" not found
Oct 31 17:27:14.619753 ip-10-0-138-17 kubenswrapper[5003]: E1031 17:27:14.619707    5003 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/170ada34-8944-43d2-bcfb-1d782aae5348-registry-tls podName:170ada34-8944-43d2-bcfb-1d782aae5348 nodeName:}" failed. No retries permitted until 2026-10-31 17:27:16.619701555 +0000 UTC m=+4.874556075 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/170ada34-8944-43d2-bcfb-1d782aae5348-registry-tls") pod "image-registry-74dbfdb444-q7rkg" (UID: "170ada34-8944-43d2-bcfb-1d782aae5348") : secret "image-registry-tls" not found
Oct 31 17:27:14.619753 ip-10-0-138-17 kubenswrapper[5003]: E1031 17:27:14.619717    5003 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9d9ecf7f-6a11-469b-8626-99d5ef7ffac7-registry-tls podName:9d9ecf7f-6a11-469b-8626-99d5ef7ffac7 nodeName:}" failed. No retries permitted until 2026-10-31 17:27:16.619712815 +0000 UTC m=+4.874567335 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9d9ecf7f-6a11-469b-8626-99d5ef7ffac7-registry-tls") pod "image-registry-869fc8694f-xcqzj" (UID: "9d9ecf7f-6a11-469b-8626-99d5ef7ffac7") : secret "image-registry-tls" not found
Oct 31 17:27:14.619753 ip-10-0-138-17 kubenswrapper[5003]: E1031 17:27:14.619728    5003 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9a0cf7f7-c12d-42fe-a83e-28e1f1859cd2-networking-console-plugin-cert podName:9a0cf7f7-c12d-42fe-a83e-28e1f1859cd2 nodeName:}" failed. No retries permitted until 2026-10-31 17:27:16.619723512 +0000 UTC m=+4.874578032 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/9a0cf7f7-c12d-42fe-a83e-28e1f1859cd2-networking-console-plugin-cert") pod "networking-console-plugin-86c478bb88-rnvgv" (UID: "9a0cf7f7-c12d-42fe-a83e-28e1f1859cd2") : secret "networking-console-plugin-cert" not found
Oct 31 17:27:14.620358 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:14.619766    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/449efcb2-6707-4809-b869-1bb477f6e6ae-metrics-certs\") pod \"network-metrics-daemon-7j59v\" (UID: \"449efcb2-6707-4809-b869-1bb477f6e6ae\") " pod="openshift-multus/network-metrics-daemon-7j59v"
Oct 31 17:27:14.620358 ip-10-0-138-17 kubenswrapper[5003]: E1031 17:27:14.619862    5003 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Oct 31 17:27:14.620358 ip-10-0-138-17 kubenswrapper[5003]: E1031 17:27:14.619904    5003 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/449efcb2-6707-4809-b869-1bb477f6e6ae-metrics-certs podName:449efcb2-6707-4809-b869-1bb477f6e6ae nodeName:}" failed. No retries permitted until 2026-10-31 17:27:16.619893728 +0000 UTC m=+4.874748264 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/449efcb2-6707-4809-b869-1bb477f6e6ae-metrics-certs") pod "network-metrics-daemon-7j59v" (UID: "449efcb2-6707-4809-b869-1bb477f6e6ae") : secret "metrics-daemon-secret" not found
Oct 31 17:27:14.724048 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:14.724019    5003 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-lcz9q_c915138c-9050-4958-b442-fee1aca9b002/node-ca/0.log"
Oct 31 17:27:14.959295 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:14.959210    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-7v7x4" event={"ID":"25ad5c67-f563-4653-9e86-7e9ecbe78675","Type":"ContainerStarted","Data":"0b9df00bbad5c7ef3aa72830db196a024e91f4aa795817a0e609f23017982dca"}
Oct 31 17:27:14.961285 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:14.961259    5003 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-b2xxw_f03611db-3bd9-401a-a137-1d4f691b51ea/console-operator/2.log"
Oct 31 17:27:15.525633 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:15.525573    5003 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-ptxt2_c390ea6f-c609-40f7-a9ec-53fd5c08d857/serve-healthcheck-canary/0.log"
Oct 31 17:27:15.724365 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:15.724324    5003 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-66df5d496b-lfxtw_fef8c517-3be6-4cc1-908a-9e0116d8f978/migrator/0.log"
Oct 31 17:27:15.778223 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:15.778190    5003 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-v8sbm"
Oct 31 17:27:15.788489 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:15.788455    5003 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7cd56b8dbc-b2xxw"
Oct 31 17:27:15.788975 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:15.788951    5003 scope.go:122] "RemoveContainer" containerID="03bb31d19f9e255d8a15ed609a61f110d1c8ffa858a639d9bc49216b1c5fb603"
Oct 31 17:27:15.789229 ip-10-0-138-17 kubenswrapper[5003]: E1031 17:27:15.789204    5003 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7cd56b8dbc-b2xxw_openshift-console-operator(f03611db-3bd9-401a-a137-1d4f691b51ea)\"" pod="openshift-console-operator/console-operator-7cd56b8dbc-b2xxw" podUID="f03611db-3bd9-401a-a137-1d4f691b51ea"
Oct 31 17:27:15.924882 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:15.924851    5003 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-66df5d496b-t48lj_a26cba9f-c44a-405d-8e3d-de4bc5b6d6c0/migrator/0.log"
Oct 31 17:27:15.969848 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:15.966878    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-rhsk4" event={"ID":"ec682f92-b657-44bd-9e85-3cd4680d2f95","Type":"ContainerStarted","Data":"4371af185525e2e57436e797c6fa86e388afeac64404130fca816f5f7254e6fc"}
Oct 31 17:27:15.969848 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:15.967036    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-rhsk4" event={"ID":"ec682f92-b657-44bd-9e85-3cd4680d2f95","Type":"ContainerStarted","Data":"7f2cf036e7be885d4af8f0e44bf97f9553c2d5cc0fa684de5bd247636e31f8bd"}
Oct 31 17:27:15.972307 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:15.972277    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-884576c57-csbxp" event={"ID":"a1bea244-6573-4e3c-9849-b27ade411c9f","Type":"ContainerStarted","Data":"c734a168597e8f476d177d519fef3aac6f11b1e2120bb6cb9fa90c06b511afc6"}
Oct 31 17:27:16.125829 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:16.125795    5003 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-7d4bc45dd6-4xtm4_8a9e5aa4-f4fc-4b33-a925-8e63df6c9cd2/kube-storage-version-migrator-operator/0.log"
Oct 31 17:27:16.392358 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:16.392321    5003 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-pqs8z"
Oct 31 17:27:16.645727 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:16.645642    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9d9ecf7f-6a11-469b-8626-99d5ef7ffac7-registry-tls\") pod \"image-registry-869fc8694f-xcqzj\" (UID: \"9d9ecf7f-6a11-469b-8626-99d5ef7ffac7\") " pod="openshift-image-registry/image-registry-869fc8694f-xcqzj"
Oct 31 17:27:16.645932 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:16.645773    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/170ada34-8944-43d2-bcfb-1d782aae5348-registry-tls\") pod \"image-registry-74dbfdb444-q7rkg\" (UID: \"170ada34-8944-43d2-bcfb-1d782aae5348\") " pod="openshift-image-registry/image-registry-74dbfdb444-q7rkg"
Oct 31 17:27:16.645932 ip-10-0-138-17 kubenswrapper[5003]: E1031 17:27:16.645783    5003 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Oct 31 17:27:16.645932 ip-10-0-138-17 kubenswrapper[5003]: E1031 17:27:16.645799    5003 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-869fc8694f-xcqzj: secret "image-registry-tls" not found
Oct 31 17:27:16.645932 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:16.645814    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/449efcb2-6707-4809-b869-1bb477f6e6ae-metrics-certs\") pod \"network-metrics-daemon-7j59v\" (UID: \"449efcb2-6707-4809-b869-1bb477f6e6ae\") " pod="openshift-multus/network-metrics-daemon-7j59v"
Oct 31 17:27:16.645932 ip-10-0-138-17 kubenswrapper[5003]: E1031 17:27:16.645867    5003 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9d9ecf7f-6a11-469b-8626-99d5ef7ffac7-registry-tls podName:9d9ecf7f-6a11-469b-8626-99d5ef7ffac7 nodeName:}" failed. No retries permitted until 2026-10-31 17:27:20.645849412 +0000 UTC m=+8.900703939 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9d9ecf7f-6a11-469b-8626-99d5ef7ffac7-registry-tls") pod "image-registry-869fc8694f-xcqzj" (UID: "9d9ecf7f-6a11-469b-8626-99d5ef7ffac7") : secret "image-registry-tls" not found
Oct 31 17:27:16.645932 ip-10-0-138-17 kubenswrapper[5003]: E1031 17:27:16.645924    5003 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Oct 31 17:27:16.646144 ip-10-0-138-17 kubenswrapper[5003]: E1031 17:27:16.645946    5003 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-74dbfdb444-q7rkg: secret "image-registry-tls" not found
Oct 31 17:27:16.646144 ip-10-0-138-17 kubenswrapper[5003]: E1031 17:27:16.645990    5003 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/170ada34-8944-43d2-bcfb-1d782aae5348-registry-tls podName:170ada34-8944-43d2-bcfb-1d782aae5348 nodeName:}" failed. No retries permitted until 2026-10-31 17:27:20.645974159 +0000 UTC m=+8.900828680 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/170ada34-8944-43d2-bcfb-1d782aae5348-registry-tls") pod "image-registry-74dbfdb444-q7rkg" (UID: "170ada34-8944-43d2-bcfb-1d782aae5348") : secret "image-registry-tls" not found
Oct 31 17:27:16.646144 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:16.646009    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3aa3a055-ec26-4d70-bb04-d6a09abe6661-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-tdzz5\" (UID: \"3aa3a055-ec26-4d70-bb04-d6a09abe6661\") " pod="openshift-insights/insights-runtime-extractor-tdzz5"
Oct 31 17:27:16.646144 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:16.646037    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/50e82975-3344-4653-8de3-68e8a64a8757-metrics-certs\") pod \"router-default-65db5d9749-xvqmh\" (UID: \"50e82975-3344-4653-8de3-68e8a64a8757\") " pod="openshift-ingress/router-default-65db5d9749-xvqmh"
Oct 31 17:27:16.646144 ip-10-0-138-17 kubenswrapper[5003]: E1031 17:27:16.646051    5003 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Oct 31 17:27:16.646144 ip-10-0-138-17 kubenswrapper[5003]: E1031 17:27:16.646092    5003 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/449efcb2-6707-4809-b869-1bb477f6e6ae-metrics-certs podName:449efcb2-6707-4809-b869-1bb477f6e6ae nodeName:}" failed. No retries permitted until 2026-10-31 17:27:20.646079907 +0000 UTC m=+8.900934441 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/449efcb2-6707-4809-b869-1bb477f6e6ae-metrics-certs") pod "network-metrics-daemon-7j59v" (UID: "449efcb2-6707-4809-b869-1bb477f6e6ae") : secret "metrics-daemon-secret" not found
Oct 31 17:27:16.646144 ip-10-0-138-17 kubenswrapper[5003]: E1031 17:27:16.646125    5003 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Oct 31 17:27:16.646144 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:16.646135    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/50e82975-3344-4653-8de3-68e8a64a8757-service-ca-bundle\") pod \"router-default-65db5d9749-xvqmh\" (UID: \"50e82975-3344-4653-8de3-68e8a64a8757\") " pod="openshift-ingress/router-default-65db5d9749-xvqmh"
Oct 31 17:27:16.646455 ip-10-0-138-17 kubenswrapper[5003]: E1031 17:27:16.646125    5003 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Oct 31 17:27:16.646455 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:16.646161    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/9a0cf7f7-c12d-42fe-a83e-28e1f1859cd2-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-rnvgv\" (UID: \"9a0cf7f7-c12d-42fe-a83e-28e1f1859cd2\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-rnvgv"
Oct 31 17:27:16.646455 ip-10-0-138-17 kubenswrapper[5003]: E1031 17:27:16.646179    5003 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/50e82975-3344-4653-8de3-68e8a64a8757-metrics-certs podName:50e82975-3344-4653-8de3-68e8a64a8757 nodeName:}" failed. No retries permitted until 2026-10-31 17:27:20.646171395 +0000 UTC m=+8.901025948 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/50e82975-3344-4653-8de3-68e8a64a8757-metrics-certs") pod "router-default-65db5d9749-xvqmh" (UID: "50e82975-3344-4653-8de3-68e8a64a8757") : secret "router-metrics-certs-default" not found
Oct 31 17:27:16.646455 ip-10-0-138-17 kubenswrapper[5003]: E1031 17:27:16.646201    5003 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3aa3a055-ec26-4d70-bb04-d6a09abe6661-insights-runtime-extractor-tls podName:3aa3a055-ec26-4d70-bb04-d6a09abe6661 nodeName:}" failed. No retries permitted until 2026-10-31 17:27:20.64619199 +0000 UTC m=+8.901046514 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/3aa3a055-ec26-4d70-bb04-d6a09abe6661-insights-runtime-extractor-tls") pod "insights-runtime-extractor-tdzz5" (UID: "3aa3a055-ec26-4d70-bb04-d6a09abe6661") : secret "insights-runtime-extractor-tls" not found
Oct 31 17:27:16.646455 ip-10-0-138-17 kubenswrapper[5003]: E1031 17:27:16.646233    5003 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/50e82975-3344-4653-8de3-68e8a64a8757-service-ca-bundle podName:50e82975-3344-4653-8de3-68e8a64a8757 nodeName:}" failed. No retries permitted until 2026-10-31 17:27:20.64622107 +0000 UTC m=+8.901075605 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/50e82975-3344-4653-8de3-68e8a64a8757-service-ca-bundle") pod "router-default-65db5d9749-xvqmh" (UID: "50e82975-3344-4653-8de3-68e8a64a8757") : configmap references non-existent config key: service-ca.crt
Oct 31 17:27:16.646455 ip-10-0-138-17 kubenswrapper[5003]: E1031 17:27:16.646283    5003 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Oct 31 17:27:16.646455 ip-10-0-138-17 kubenswrapper[5003]: E1031 17:27:16.646349    5003 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9a0cf7f7-c12d-42fe-a83e-28e1f1859cd2-networking-console-plugin-cert podName:9a0cf7f7-c12d-42fe-a83e-28e1f1859cd2 nodeName:}" failed. No retries permitted until 2026-10-31 17:27:20.646332308 +0000 UTC m=+8.901186848 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/9a0cf7f7-c12d-42fe-a83e-28e1f1859cd2-networking-console-plugin-cert") pod "networking-console-plugin-86c478bb88-rnvgv" (UID: "9a0cf7f7-c12d-42fe-a83e-28e1f1859cd2") : secret "networking-console-plugin-cert" not found
Oct 31 17:27:16.977374 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:16.977291    5003 generic.go:356] "Generic (PLEG): container finished" podID="8e32277f-062d-4c16-81ca-b12e65b24fbb" containerID="eefc277eff9e589cb48bb108b48d5e16a3fac9e40acd8d934d6191d7c9140e5d" exitCode=0
Oct 31 17:27:16.977779 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:16.977371    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-7c4986d449-tggxv" event={"ID":"8e32277f-062d-4c16-81ca-b12e65b24fbb","Type":"ContainerDied","Data":"eefc277eff9e589cb48bb108b48d5e16a3fac9e40acd8d934d6191d7c9140e5d"}
Oct 31 17:27:16.977837 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:16.977809    5003 scope.go:122] "RemoveContainer" containerID="eefc277eff9e589cb48bb108b48d5e16a3fac9e40acd8d934d6191d7c9140e5d"
Oct 31 17:27:16.979509 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:16.979486    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-7v7x4" event={"ID":"25ad5c67-f563-4653-9e86-7e9ecbe78675","Type":"ContainerStarted","Data":"173969dee97d9769e660895050cf29b59ebb87e478278166060296159437ef92"}
Oct 31 17:27:16.979614 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:16.979537    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-7v7x4" event={"ID":"25ad5c67-f563-4653-9e86-7e9ecbe78675","Type":"ContainerStarted","Data":"171d06835064795f161472da7d0fb509fdf4cea79656021332ad7b0faf666ce5"}
Oct 31 17:27:16.979761 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:16.979743    5003 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-7v7x4"
Oct 31 17:27:17.984908 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:17.984868    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-7c4986d449-tggxv" event={"ID":"8e32277f-062d-4c16-81ca-b12e65b24fbb","Type":"ContainerStarted","Data":"c93d8b92bf57eca44e640695da55004fd9c1f626ec7707e635668df548581005"}
Oct 31 17:27:18.190228 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:18.190198    5003 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-v8sbm"
Oct 31 17:27:18.190523 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:18.190506    5003 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness"
Oct 31 17:27:18.612946 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:18.612921    5003 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-v8sbm"
Oct 31 17:27:19.120970 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:19.120932    5003 kubelet.go:2727] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-7cd56b8dbc-b2xxw"
Oct 31 17:27:19.121373 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:19.121347    5003 scope.go:122] "RemoveContainer" containerID="03bb31d19f9e255d8a15ed609a61f110d1c8ffa858a639d9bc49216b1c5fb603"
Oct 31 17:27:19.121554 ip-10-0-138-17 kubenswrapper[5003]: E1031 17:27:19.121534    5003 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7cd56b8dbc-b2xxw_openshift-console-operator(f03611db-3bd9-401a-a137-1d4f691b51ea)\"" pod="openshift-console-operator/console-operator-7cd56b8dbc-b2xxw" podUID="f03611db-3bd9-401a-a137-1d4f691b51ea"
Oct 31 17:27:20.685670 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:20.685605    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/50e82975-3344-4653-8de3-68e8a64a8757-service-ca-bundle\") pod \"router-default-65db5d9749-xvqmh\" (UID: \"50e82975-3344-4653-8de3-68e8a64a8757\") " pod="openshift-ingress/router-default-65db5d9749-xvqmh"
Oct 31 17:27:20.685670 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:20.685672    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/9a0cf7f7-c12d-42fe-a83e-28e1f1859cd2-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-rnvgv\" (UID: \"9a0cf7f7-c12d-42fe-a83e-28e1f1859cd2\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-rnvgv"
Oct 31 17:27:20.686214 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:20.685716    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9d9ecf7f-6a11-469b-8626-99d5ef7ffac7-registry-tls\") pod \"image-registry-869fc8694f-xcqzj\" (UID: \"9d9ecf7f-6a11-469b-8626-99d5ef7ffac7\") " pod="openshift-image-registry/image-registry-869fc8694f-xcqzj"
Oct 31 17:27:20.686214 ip-10-0-138-17 kubenswrapper[5003]: E1031 17:27:20.685835    5003 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Oct 31 17:27:20.686214 ip-10-0-138-17 kubenswrapper[5003]: E1031 17:27:20.685857    5003 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-869fc8694f-xcqzj: secret "image-registry-tls" not found
Oct 31 17:27:20.686214 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:20.685865    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/170ada34-8944-43d2-bcfb-1d782aae5348-registry-tls\") pod \"image-registry-74dbfdb444-q7rkg\" (UID: \"170ada34-8944-43d2-bcfb-1d782aae5348\") " pod="openshift-image-registry/image-registry-74dbfdb444-q7rkg"
Oct 31 17:27:20.686214 ip-10-0-138-17 kubenswrapper[5003]: E1031 17:27:20.685913    5003 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9d9ecf7f-6a11-469b-8626-99d5ef7ffac7-registry-tls podName:9d9ecf7f-6a11-469b-8626-99d5ef7ffac7 nodeName:}" failed. No retries permitted until 2026-10-31 17:27:28.685895768 +0000 UTC m=+16.940750306 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9d9ecf7f-6a11-469b-8626-99d5ef7ffac7-registry-tls") pod "image-registry-869fc8694f-xcqzj" (UID: "9d9ecf7f-6a11-469b-8626-99d5ef7ffac7") : secret "image-registry-tls" not found
Oct 31 17:27:20.686214 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:20.685934    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/449efcb2-6707-4809-b869-1bb477f6e6ae-metrics-certs\") pod \"network-metrics-daemon-7j59v\" (UID: \"449efcb2-6707-4809-b869-1bb477f6e6ae\") " pod="openshift-multus/network-metrics-daemon-7j59v"
Oct 31 17:27:20.686214 ip-10-0-138-17 kubenswrapper[5003]: E1031 17:27:20.685956    5003 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Oct 31 17:27:20.686214 ip-10-0-138-17 kubenswrapper[5003]: E1031 17:27:20.685970    5003 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-74dbfdb444-q7rkg: secret "image-registry-tls" not found
Oct 31 17:27:20.686214 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:20.685975    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3aa3a055-ec26-4d70-bb04-d6a09abe6661-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-tdzz5\" (UID: \"3aa3a055-ec26-4d70-bb04-d6a09abe6661\") " pod="openshift-insights/insights-runtime-extractor-tdzz5"
Oct 31 17:27:20.686214 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:20.686007    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/50e82975-3344-4653-8de3-68e8a64a8757-metrics-certs\") pod \"router-default-65db5d9749-xvqmh\" (UID: \"50e82975-3344-4653-8de3-68e8a64a8757\") " pod="openshift-ingress/router-default-65db5d9749-xvqmh"
Oct 31 17:27:20.686214 ip-10-0-138-17 kubenswrapper[5003]: E1031 17:27:20.686063    5003 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/170ada34-8944-43d2-bcfb-1d782aae5348-registry-tls podName:170ada34-8944-43d2-bcfb-1d782aae5348 nodeName:}" failed. No retries permitted until 2026-10-31 17:27:28.68605207 +0000 UTC m=+16.940906591 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/170ada34-8944-43d2-bcfb-1d782aae5348-registry-tls") pod "image-registry-74dbfdb444-q7rkg" (UID: "170ada34-8944-43d2-bcfb-1d782aae5348") : secret "image-registry-tls" not found
Oct 31 17:27:20.686214 ip-10-0-138-17 kubenswrapper[5003]: E1031 17:27:20.686064    5003 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Oct 31 17:27:20.686214 ip-10-0-138-17 kubenswrapper[5003]: E1031 17:27:20.686115    5003 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3aa3a055-ec26-4d70-bb04-d6a09abe6661-insights-runtime-extractor-tls podName:3aa3a055-ec26-4d70-bb04-d6a09abe6661 nodeName:}" failed. No retries permitted until 2026-10-31 17:27:28.686099762 +0000 UTC m=+16.940954282 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/3aa3a055-ec26-4d70-bb04-d6a09abe6661-insights-runtime-extractor-tls") pod "insights-runtime-extractor-tdzz5" (UID: "3aa3a055-ec26-4d70-bb04-d6a09abe6661") : secret "insights-runtime-extractor-tls" not found
Oct 31 17:27:20.686716 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:20.686420    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/50e82975-3344-4653-8de3-68e8a64a8757-service-ca-bundle\") pod \"router-default-65db5d9749-xvqmh\" (UID: \"50e82975-3344-4653-8de3-68e8a64a8757\") " pod="openshift-ingress/router-default-65db5d9749-xvqmh"
Oct 31 17:27:20.688135 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:20.688111    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/449efcb2-6707-4809-b869-1bb477f6e6ae-metrics-certs\") pod \"network-metrics-daemon-7j59v\" (UID: \"449efcb2-6707-4809-b869-1bb477f6e6ae\") " pod="openshift-multus/network-metrics-daemon-7j59v"
Oct 31 17:27:20.688234 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:20.688140    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/9a0cf7f7-c12d-42fe-a83e-28e1f1859cd2-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-rnvgv\" (UID: \"9a0cf7f7-c12d-42fe-a83e-28e1f1859cd2\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-rnvgv"
Oct 31 17:27:20.688350 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:20.688331    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/50e82975-3344-4653-8de3-68e8a64a8757-metrics-certs\") pod \"router-default-65db5d9749-xvqmh\" (UID: \"50e82975-3344-4653-8de3-68e8a64a8757\") " pod="openshift-ingress/router-default-65db5d9749-xvqmh"
Oct 31 17:27:20.698253 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:20.698234    5003 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-86c478bb88-rnvgv"
Oct 31 17:27:20.698356 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:20.698345    5003 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-65db5d9749-xvqmh"
Oct 31 17:27:20.698412 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:20.698374    5003 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7j59v"
Oct 31 17:27:21.025872 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:21.025788    5003 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-7j59v"]
Oct 31 17:27:21.026364 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:21.026305    5003 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-86c478bb88-rnvgv"]
Oct 31 17:27:21.031684 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:21.030738    5003 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a0cf7f7_c12d_42fe_a83e_28e1f1859cd2.slice/crio-af461dea1c2e511f0f89e578f2b00b10a85a01e51c67d366a084d3e3ec8d0940 WatchSource:0}: Error finding container af461dea1c2e511f0f89e578f2b00b10a85a01e51c67d366a084d3e3ec8d0940: Status 404 returned error can't find the container with id af461dea1c2e511f0f89e578f2b00b10a85a01e51c67d366a084d3e3ec8d0940
Oct 31 17:27:21.034491 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:21.034436    5003 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod449efcb2_6707_4809_b869_1bb477f6e6ae.slice/crio-0dcbce0272a706098d4328fea00cb597e1064047d1f22993e635059de1ae8a51 WatchSource:0}: Error finding container 0dcbce0272a706098d4328fea00cb597e1064047d1f22993e635059de1ae8a51: Status 404 returned error can't find the container with id 0dcbce0272a706098d4328fea00cb597e1064047d1f22993e635059de1ae8a51
Oct 31 17:27:21.037703 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:21.037683    5003 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-65db5d9749-xvqmh"]
Oct 31 17:27:21.042758 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:21.042735    5003 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod50e82975_3344_4653_8de3_68e8a64a8757.slice/crio-ea55724938ab65f3107df1d5b35c505919b1354a80816258a8ae8b83de13f04f WatchSource:0}: Error finding container ea55724938ab65f3107df1d5b35c505919b1354a80816258a8ae8b83de13f04f: Status 404 returned error can't find the container with id ea55724938ab65f3107df1d5b35c505919b1354a80816258a8ae8b83de13f04f
Oct 31 17:27:22.001530 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:22.001493    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-65db5d9749-xvqmh" event={"ID":"50e82975-3344-4653-8de3-68e8a64a8757","Type":"ContainerStarted","Data":"275d30d7ee0a98b5b47a6e4ac16b90be98d6b6410bdc0e39b8bcf277bf796e64"}
Oct 31 17:27:22.001936 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:22.001561    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-65db5d9749-xvqmh" event={"ID":"50e82975-3344-4653-8de3-68e8a64a8757","Type":"ContainerStarted","Data":"ea55724938ab65f3107df1d5b35c505919b1354a80816258a8ae8b83de13f04f"}
Oct 31 17:27:22.006907 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:22.006831    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-86c478bb88-rnvgv" event={"ID":"9a0cf7f7-c12d-42fe-a83e-28e1f1859cd2","Type":"ContainerStarted","Data":"af461dea1c2e511f0f89e578f2b00b10a85a01e51c67d366a084d3e3ec8d0940"}
Oct 31 17:27:22.009018 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:22.008956    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-7j59v" event={"ID":"449efcb2-6707-4809-b869-1bb477f6e6ae","Type":"ContainerStarted","Data":"0dcbce0272a706098d4328fea00cb597e1064047d1f22993e635059de1ae8a51"}
Oct 31 17:27:22.698548 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:22.698511    5003 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-65db5d9749-xvqmh"
Oct 31 17:27:22.701202 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:22.701178    5003 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-65db5d9749-xvqmh"
Oct 31 17:27:23.014108 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:23.014019    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-7j59v" event={"ID":"449efcb2-6707-4809-b869-1bb477f6e6ae","Type":"ContainerStarted","Data":"f4ff17fb8089af43a1d5b91c7263ab05ca007c914bcc5ae7f42060c1f8b23bc4"}
Oct 31 17:27:23.014108 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:23.014087    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-7j59v" event={"ID":"449efcb2-6707-4809-b869-1bb477f6e6ae","Type":"ContainerStarted","Data":"8a6d390d12f97779eaaee08e1e6fe702c715f2217727c440697f544e337eb0ba"}
Oct 31 17:27:23.015996 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:23.015972    5003 generic.go:356] "Generic (PLEG): container finished" podID="8e32277f-062d-4c16-81ca-b12e65b24fbb" containerID="c93d8b92bf57eca44e640695da55004fd9c1f626ec7707e635668df548581005" exitCode=0
Oct 31 17:27:23.016076 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:23.016048    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-7c4986d449-tggxv" event={"ID":"8e32277f-062d-4c16-81ca-b12e65b24fbb","Type":"ContainerDied","Data":"c93d8b92bf57eca44e640695da55004fd9c1f626ec7707e635668df548581005"}
Oct 31 17:27:23.016126 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:23.016093    5003 scope.go:122] "RemoveContainer" containerID="eefc277eff9e589cb48bb108b48d5e16a3fac9e40acd8d934d6191d7c9140e5d"
Oct 31 17:27:23.016511 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:23.016496    5003 scope.go:122] "RemoveContainer" containerID="c93d8b92bf57eca44e640695da55004fd9c1f626ec7707e635668df548581005"
Oct 31 17:27:23.016762 ip-10-0-138-17 kubenswrapper[5003]: E1031 17:27:23.016742    5003 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"insights-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=insights-operator pod=insights-operator-7c4986d449-tggxv_openshift-insights(8e32277f-062d-4c16-81ca-b12e65b24fbb)\"" pod="openshift-insights/insights-operator-7c4986d449-tggxv" podUID="8e32277f-062d-4c16-81ca-b12e65b24fbb"
Oct 31 17:27:23.017692 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:23.017668    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-86c478bb88-rnvgv" event={"ID":"9a0cf7f7-c12d-42fe-a83e-28e1f1859cd2","Type":"ContainerStarted","Data":"3c2c672a8475d88aea5240d199adc5856c5b23a44b1f0d70ee5211e620bf179d"}
Oct 31 17:27:23.017835 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:23.017815    5003 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-65db5d9749-xvqmh"
Oct 31 17:27:23.019162 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:23.019147    5003 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-65db5d9749-xvqmh"
Oct 31 17:27:24.256161 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:24.256133    5003 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-vghkb"
Oct 31 17:27:24.882451 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:24.882420    5003 scope.go:122] "RemoveContainer" containerID="03bb31d19f9e255d8a15ed609a61f110d1c8ffa858a639d9bc49216b1c5fb603"
Oct 31 17:27:25.028656 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:25.028617    5003 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-b2xxw_f03611db-3bd9-401a-a137-1d4f691b51ea/console-operator/2.log"
Oct 31 17:27:25.028847 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:25.028757    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7cd56b8dbc-b2xxw" event={"ID":"f03611db-3bd9-401a-a137-1d4f691b51ea","Type":"ContainerStarted","Data":"48e85fbb40c65d06f2577ebd87bcb0723f95fd289e0b65d71548c99767833bd0"}
Oct 31 17:27:25.029029 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:25.029008    5003 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7cd56b8dbc-b2xxw"
Oct 31 17:27:25.030213 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:25.030188    5003 patch_prober.go:29] interesting pod/console-operator-7cd56b8dbc-b2xxw container/console-operator namespace/openshift-console-operator: Readiness probe status=failure output="Get \"https://10.132.0.17:8443/readyz\": dial tcp 10.132.0.17:8443: connect: connection refused" start-of-body=
Oct 31 17:27:25.030300 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:25.030231    5003 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-console-operator/console-operator-7cd56b8dbc-b2xxw" podUID="f03611db-3bd9-401a-a137-1d4f691b51ea" containerName="console-operator" probeResult="failure" output="Get \"https://10.132.0.17:8443/readyz\": dial tcp 10.132.0.17:8443: connect: connection refused"
Oct 31 17:27:26.036248 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:26.036219    5003 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-7cd56b8dbc-b2xxw"
Oct 31 17:27:26.987115 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:26.987085    5003 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-7v7x4"
Oct 31 17:27:28.753405 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:28.753363    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/170ada34-8944-43d2-bcfb-1d782aae5348-registry-tls\") pod \"image-registry-74dbfdb444-q7rkg\" (UID: \"170ada34-8944-43d2-bcfb-1d782aae5348\") " pod="openshift-image-registry/image-registry-74dbfdb444-q7rkg"
Oct 31 17:27:28.753799 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:28.753417    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3aa3a055-ec26-4d70-bb04-d6a09abe6661-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-tdzz5\" (UID: \"3aa3a055-ec26-4d70-bb04-d6a09abe6661\") " pod="openshift-insights/insights-runtime-extractor-tdzz5"
Oct 31 17:27:28.753799 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:28.753493    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9d9ecf7f-6a11-469b-8626-99d5ef7ffac7-registry-tls\") pod \"image-registry-869fc8694f-xcqzj\" (UID: \"9d9ecf7f-6a11-469b-8626-99d5ef7ffac7\") " pod="openshift-image-registry/image-registry-869fc8694f-xcqzj"
Oct 31 17:27:28.755879 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:28.755842    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3aa3a055-ec26-4d70-bb04-d6a09abe6661-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-tdzz5\" (UID: \"3aa3a055-ec26-4d70-bb04-d6a09abe6661\") " pod="openshift-insights/insights-runtime-extractor-tdzz5"
Oct 31 17:27:28.756092 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:28.756070    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9d9ecf7f-6a11-469b-8626-99d5ef7ffac7-registry-tls\") pod \"image-registry-869fc8694f-xcqzj\" (UID: \"9d9ecf7f-6a11-469b-8626-99d5ef7ffac7\") " pod="openshift-image-registry/image-registry-869fc8694f-xcqzj"
Oct 31 17:27:28.756130 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:28.756070    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/170ada34-8944-43d2-bcfb-1d782aae5348-registry-tls\") pod \"image-registry-74dbfdb444-q7rkg\" (UID: \"170ada34-8944-43d2-bcfb-1d782aae5348\") " pod="openshift-image-registry/image-registry-74dbfdb444-q7rkg"
Oct 31 17:27:28.794878 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:28.794846    5003 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-74dbfdb444-q7rkg"
Oct 31 17:27:28.807105 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:28.807081    5003 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-869fc8694f-xcqzj"
Oct 31 17:27:28.810023 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:28.809965    5003 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-tdzz5"
Oct 31 17:27:29.119989 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:29.119954    5003 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-tdzz5"]
Oct 31 17:27:29.126572 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:29.126543    5003 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3aa3a055_ec26_4d70_bb04_d6a09abe6661.slice/crio-0954a49a62f7c3205786ad72b880ffb1df8d2b69152ab091f8808250ed8d3fa0 WatchSource:0}: Error finding container 0954a49a62f7c3205786ad72b880ffb1df8d2b69152ab091f8808250ed8d3fa0: Status 404 returned error can't find the container with id 0954a49a62f7c3205786ad72b880ffb1df8d2b69152ab091f8808250ed8d3fa0
Oct 31 17:27:29.127910 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:29.127883    5003 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod170ada34_8944_43d2_bcfb_1d782aae5348.slice/crio-590d8ef120a163922fd19fbd07e1dcbbfada7400341f0416d2d7c4be3e9f7977 WatchSource:0}: Error finding container 590d8ef120a163922fd19fbd07e1dcbbfada7400341f0416d2d7c4be3e9f7977: Status 404 returned error can't find the container with id 590d8ef120a163922fd19fbd07e1dcbbfada7400341f0416d2d7c4be3e9f7977
Oct 31 17:27:29.132327 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:29.132300    5003 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-869fc8694f-xcqzj"]
Oct 31 17:27:29.133313 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:29.133290    5003 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9d9ecf7f_6a11_469b_8626_99d5ef7ffac7.slice/crio-5c93af39befd1c67c95c2d029eb0a91147d4d92d0cca41fbd0ef89cfb1da52eb WatchSource:0}: Error finding container 5c93af39befd1c67c95c2d029eb0a91147d4d92d0cca41fbd0ef89cfb1da52eb: Status 404 returned error can't find the container with id 5c93af39befd1c67c95c2d029eb0a91147d4d92d0cca41fbd0ef89cfb1da52eb
Oct 31 17:27:29.134988 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:29.134970    5003 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-74dbfdb444-q7rkg"]
Oct 31 17:27:29.292312 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:29.291151    5003 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-insights/periodic-gathering-7hd6d-tll9c"]
Oct 31 17:27:29.297034 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:29.296074    5003 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/periodic-gathering-7hd6d-tll9c"
Oct 31 17:27:29.316118 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:29.316089    5003 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/periodic-gathering-7hd6d-tll9c"]
Oct 31 17:27:29.327398 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:29.327371    5003 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-74dbfdb444-q7rkg"]
Oct 31 17:27:29.358128 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:29.358094    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f9d20ae4-1aa4-40f8-bd2e-549490e31b0a-trusted-ca-bundle\") pod \"periodic-gathering-7hd6d-tll9c\" (UID: \"f9d20ae4-1aa4-40f8-bd2e-549490e31b0a\") " pod="openshift-insights/periodic-gathering-7hd6d-tll9c"
Oct 31 17:27:29.358291 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:29.358165    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f9d20ae4-1aa4-40f8-bd2e-549490e31b0a-service-ca-bundle\") pod \"periodic-gathering-7hd6d-tll9c\" (UID: \"f9d20ae4-1aa4-40f8-bd2e-549490e31b0a\") " pod="openshift-insights/periodic-gathering-7hd6d-tll9c"
Oct 31 17:27:29.358291 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:29.358205    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/f9d20ae4-1aa4-40f8-bd2e-549490e31b0a-archives-path\") pod \"periodic-gathering-7hd6d-tll9c\" (UID: \"f9d20ae4-1aa4-40f8-bd2e-549490e31b0a\") " pod="openshift-insights/periodic-gathering-7hd6d-tll9c"
Oct 31 17:27:29.358291 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:29.358251    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tbq2w\" (UniqueName: \"kubernetes.io/projected/f9d20ae4-1aa4-40f8-bd2e-549490e31b0a-kube-api-access-tbq2w\") pod \"periodic-gathering-7hd6d-tll9c\" (UID: \"f9d20ae4-1aa4-40f8-bd2e-549490e31b0a\") " pod="openshift-insights/periodic-gathering-7hd6d-tll9c"
Oct 31 17:27:29.459080 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:29.458994    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f9d20ae4-1aa4-40f8-bd2e-549490e31b0a-service-ca-bundle\") pod \"periodic-gathering-7hd6d-tll9c\" (UID: \"f9d20ae4-1aa4-40f8-bd2e-549490e31b0a\") " pod="openshift-insights/periodic-gathering-7hd6d-tll9c"
Oct 31 17:27:29.459080 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:29.459038    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/f9d20ae4-1aa4-40f8-bd2e-549490e31b0a-archives-path\") pod \"periodic-gathering-7hd6d-tll9c\" (UID: \"f9d20ae4-1aa4-40f8-bd2e-549490e31b0a\") " pod="openshift-insights/periodic-gathering-7hd6d-tll9c"
Oct 31 17:27:29.459080 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:29.459077    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tbq2w\" (UniqueName: \"kubernetes.io/projected/f9d20ae4-1aa4-40f8-bd2e-549490e31b0a-kube-api-access-tbq2w\") pod \"periodic-gathering-7hd6d-tll9c\" (UID: \"f9d20ae4-1aa4-40f8-bd2e-549490e31b0a\") " pod="openshift-insights/periodic-gathering-7hd6d-tll9c"
Oct 31 17:27:29.459335 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:29.459114    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f9d20ae4-1aa4-40f8-bd2e-549490e31b0a-trusted-ca-bundle\") pod \"periodic-gathering-7hd6d-tll9c\" (UID: \"f9d20ae4-1aa4-40f8-bd2e-549490e31b0a\") " pod="openshift-insights/periodic-gathering-7hd6d-tll9c"
Oct 31 17:27:29.465083 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:29.459858    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/f9d20ae4-1aa4-40f8-bd2e-549490e31b0a-archives-path\") pod \"periodic-gathering-7hd6d-tll9c\" (UID: \"f9d20ae4-1aa4-40f8-bd2e-549490e31b0a\") " pod="openshift-insights/periodic-gathering-7hd6d-tll9c"
Oct 31 17:27:29.465083 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:29.460220    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f9d20ae4-1aa4-40f8-bd2e-549490e31b0a-service-ca-bundle\") pod \"periodic-gathering-7hd6d-tll9c\" (UID: \"f9d20ae4-1aa4-40f8-bd2e-549490e31b0a\") " pod="openshift-insights/periodic-gathering-7hd6d-tll9c"
Oct 31 17:27:29.466034 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:29.465992    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f9d20ae4-1aa4-40f8-bd2e-549490e31b0a-trusted-ca-bundle\") pod \"periodic-gathering-7hd6d-tll9c\" (UID: \"f9d20ae4-1aa4-40f8-bd2e-549490e31b0a\") " pod="openshift-insights/periodic-gathering-7hd6d-tll9c"
Oct 31 17:27:29.480057 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:29.480025    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tbq2w\" (UniqueName: \"kubernetes.io/projected/f9d20ae4-1aa4-40f8-bd2e-549490e31b0a-kube-api-access-tbq2w\") pod \"periodic-gathering-7hd6d-tll9c\" (UID: \"f9d20ae4-1aa4-40f8-bd2e-549490e31b0a\") " pod="openshift-insights/periodic-gathering-7hd6d-tll9c"
Oct 31 17:27:29.613495 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:29.613449    5003 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/periodic-gathering-7hd6d-tll9c"
Oct 31 17:27:29.909341 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:29.909312    5003 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/periodic-gathering-7hd6d-tll9c"]
Oct 31 17:27:29.914317 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:29.914287    5003 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf9d20ae4_1aa4_40f8_bd2e_549490e31b0a.slice/crio-046bb2859390ff250cbe9e8f8fa4bbe52b142c8f5b49cee5e81a8d8a03f4e4c4 WatchSource:0}: Error finding container 046bb2859390ff250cbe9e8f8fa4bbe52b142c8f5b49cee5e81a8d8a03f4e4c4: Status 404 returned error can't find the container with id 046bb2859390ff250cbe9e8f8fa4bbe52b142c8f5b49cee5e81a8d8a03f4e4c4
Oct 31 17:27:30.048930 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:30.048898    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-74dbfdb444-q7rkg" event={"ID":"170ada34-8944-43d2-bcfb-1d782aae5348","Type":"ContainerStarted","Data":"fdf7a08f6ee540e61465e16f4322a0b63783137bc8a67c2a49608d491d9dc3c5"}
Oct 31 17:27:30.049089 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:30.048953    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-74dbfdb444-q7rkg" event={"ID":"170ada34-8944-43d2-bcfb-1d782aae5348","Type":"ContainerStarted","Data":"590d8ef120a163922fd19fbd07e1dcbbfada7400341f0416d2d7c4be3e9f7977"}
Oct 31 17:27:30.049089 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:30.049006    5003 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-74dbfdb444-q7rkg"
Oct 31 17:27:30.050497 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:30.050473    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-869fc8694f-xcqzj" event={"ID":"9d9ecf7f-6a11-469b-8626-99d5ef7ffac7","Type":"ContainerStarted","Data":"8079387e120056d58249009effd7c5d8499b21bae5b3a13c3bdf151d57904080"}
Oct 31 17:27:30.050630 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:30.050509    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-869fc8694f-xcqzj" event={"ID":"9d9ecf7f-6a11-469b-8626-99d5ef7ffac7","Type":"ContainerStarted","Data":"5c93af39befd1c67c95c2d029eb0a91147d4d92d0cca41fbd0ef89cfb1da52eb"}
Oct 31 17:27:30.050630 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:30.050532    5003 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-869fc8694f-xcqzj"
Oct 31 17:27:30.051962 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:30.051940    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/periodic-gathering-7hd6d-tll9c" event={"ID":"f9d20ae4-1aa4-40f8-bd2e-549490e31b0a","Type":"ContainerStarted","Data":"1ad705f35352eaf156351021d439ffd7e2099bfc5221bb7744a8a7c261522c68"}
Oct 31 17:27:30.052049 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:30.051980    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/periodic-gathering-7hd6d-tll9c" event={"ID":"f9d20ae4-1aa4-40f8-bd2e-549490e31b0a","Type":"ContainerStarted","Data":"046bb2859390ff250cbe9e8f8fa4bbe52b142c8f5b49cee5e81a8d8a03f4e4c4"}
Oct 31 17:27:30.053690 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:30.053629    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-tdzz5" event={"ID":"3aa3a055-ec26-4d70-bb04-d6a09abe6661","Type":"ContainerStarted","Data":"c3bafba58669148c10671171daad5bd3235dd89e64862d02cc5b052107e16601"}
Oct 31 17:27:30.053690 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:30.053678    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-tdzz5" event={"ID":"3aa3a055-ec26-4d70-bb04-d6a09abe6661","Type":"ContainerStarted","Data":"cf4f7fa45c5e776e3bf8994493a03d505ace681a884e692f33fc2fd595dd80c0"}
Oct 31 17:27:30.053783 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:30.053698    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-tdzz5" event={"ID":"3aa3a055-ec26-4d70-bb04-d6a09abe6661","Type":"ContainerStarted","Data":"0954a49a62f7c3205786ad72b880ffb1df8d2b69152ab091f8808250ed8d3fa0"}
Oct 31 17:27:30.161446 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:30.161383    5003 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-insights/periodic-gathering-7hd6d-tll9c" podStartSLOduration=1.161369164 podStartE2EDuration="1.161369164s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 17:27:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 17:27:30.122179319 +0000 UTC m=+18.377033861" watchObservedRunningTime="2026-10-31 17:27:30.161369164 +0000 UTC m=+18.416223705"
Oct 31 17:27:31.756855 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:31.756801    5003 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-7v7x4_25ad5c67-f563-4653-9e86-7e9ecbe78675/dns/0.log"
Oct 31 17:27:31.956839 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:31.956816    5003 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-7v7x4_25ad5c67-f563-4653-9e86-7e9ecbe78675/kube-rbac-proxy/0.log"
Oct 31 17:27:32.065214 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:32.065180    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-tdzz5" event={"ID":"3aa3a055-ec26-4d70-bb04-d6a09abe6661","Type":"ContainerStarted","Data":"01b1bf94eb3ab856ff237a1898126f7efa518ca504f7f065e1a5b9376c07225f"}
Oct 31 17:27:32.556135 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:32.556109    5003 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-x25tg_eaed4088-d322-48ab-af04-3c9efdea4e73/dns-node-resolver/0.log"
Oct 31 17:27:32.756276 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:32.756246    5003 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-74dbfdb444-q7rkg_170ada34-8944-43d2-bcfb-1d782aae5348/registry/0.log"
Oct 31 17:27:33.156449 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:33.156409    5003 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-869fc8694f-xcqzj_9d9ecf7f-6a11-469b-8626-99d5ef7ffac7/registry/0.log"
Oct 31 17:27:33.556333 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:33.556301    5003 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-lcz9q_c915138c-9050-4958-b442-fee1aca9b002/node-ca/0.log"
Oct 31 17:27:33.956675 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:33.956591    5003 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-65db5d9749-xvqmh_50e82975-3344-4653-8de3-68e8a64a8757/router/0.log"
Oct 31 17:27:34.356568 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:34.356542    5003 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-ptxt2_c390ea6f-c609-40f7-a9ec-53fd5c08d857/serve-healthcheck-canary/0.log"
Oct 31 17:27:35.882535 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:35.882504    5003 scope.go:122] "RemoveContainer" containerID="c93d8b92bf57eca44e640695da55004fd9c1f626ec7707e635668df548581005"
Oct 31 17:27:36.082421 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:36.082386    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-7c4986d449-tggxv" event={"ID":"8e32277f-062d-4c16-81ca-b12e65b24fbb","Type":"ContainerStarted","Data":"7f46531b6cb3b54d4814b1ee88ea9bfd00c37460fa10cecd78ddc62159335243"}
Oct 31 17:27:38.137116 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:38.137082    5003 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-tv8g4"]
Oct 31 17:27:38.172195 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:38.172161    5003 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-tv8g4"
Oct 31 17:27:38.198292 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:38.198263    5003 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Oct 31 17:27:38.198450 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:38.198344    5003 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Oct 31 17:27:38.198450 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:38.198369    5003 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Oct 31 17:27:38.198576 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:38.198470    5003 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Oct 31 17:27:38.198625 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:38.198597    5003 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-mcfpr\""
Oct 31 17:27:38.240474 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:38.240443    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/282d8289-dbbd-427e-86a1-f17c37ef70e4-node-exporter-wtmp\") pod \"node-exporter-tv8g4\" (UID: \"282d8289-dbbd-427e-86a1-f17c37ef70e4\") " pod="openshift-monitoring/node-exporter-tv8g4"
Oct 31 17:27:38.240610 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:38.240478    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/282d8289-dbbd-427e-86a1-f17c37ef70e4-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-tv8g4\" (UID: \"282d8289-dbbd-427e-86a1-f17c37ef70e4\") " pod="openshift-monitoring/node-exporter-tv8g4"
Oct 31 17:27:38.240610 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:38.240504    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/282d8289-dbbd-427e-86a1-f17c37ef70e4-root\") pod \"node-exporter-tv8g4\" (UID: \"282d8289-dbbd-427e-86a1-f17c37ef70e4\") " pod="openshift-monitoring/node-exporter-tv8g4"
Oct 31 17:27:38.240724 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:38.240663    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/282d8289-dbbd-427e-86a1-f17c37ef70e4-sys\") pod \"node-exporter-tv8g4\" (UID: \"282d8289-dbbd-427e-86a1-f17c37ef70e4\") " pod="openshift-monitoring/node-exporter-tv8g4"
Oct 31 17:27:38.240724 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:38.240695    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zvvtn\" (UniqueName: \"kubernetes.io/projected/282d8289-dbbd-427e-86a1-f17c37ef70e4-kube-api-access-zvvtn\") pod \"node-exporter-tv8g4\" (UID: \"282d8289-dbbd-427e-86a1-f17c37ef70e4\") " pod="openshift-monitoring/node-exporter-tv8g4"
Oct 31 17:27:38.240724 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:38.240716    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/282d8289-dbbd-427e-86a1-f17c37ef70e4-node-exporter-accelerators-collector-config\") pod \"node-exporter-tv8g4\" (UID: \"282d8289-dbbd-427e-86a1-f17c37ef70e4\") " pod="openshift-monitoring/node-exporter-tv8g4"
Oct 31 17:27:38.240865 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:38.240848    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/282d8289-dbbd-427e-86a1-f17c37ef70e4-metrics-client-ca\") pod \"node-exporter-tv8g4\" (UID: \"282d8289-dbbd-427e-86a1-f17c37ef70e4\") " pod="openshift-monitoring/node-exporter-tv8g4"
Oct 31 17:27:38.240909 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:38.240879    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/282d8289-dbbd-427e-86a1-f17c37ef70e4-node-exporter-tls\") pod \"node-exporter-tv8g4\" (UID: \"282d8289-dbbd-427e-86a1-f17c37ef70e4\") " pod="openshift-monitoring/node-exporter-tv8g4"
Oct 31 17:27:38.240909 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:38.240901    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/282d8289-dbbd-427e-86a1-f17c37ef70e4-node-exporter-textfile\") pod \"node-exporter-tv8g4\" (UID: \"282d8289-dbbd-427e-86a1-f17c37ef70e4\") " pod="openshift-monitoring/node-exporter-tv8g4"
Oct 31 17:27:38.341639 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:38.341607    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/282d8289-dbbd-427e-86a1-f17c37ef70e4-sys\") pod \"node-exporter-tv8g4\" (UID: \"282d8289-dbbd-427e-86a1-f17c37ef70e4\") " pod="openshift-monitoring/node-exporter-tv8g4"
Oct 31 17:27:38.341820 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:38.341672    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zvvtn\" (UniqueName: \"kubernetes.io/projected/282d8289-dbbd-427e-86a1-f17c37ef70e4-kube-api-access-zvvtn\") pod \"node-exporter-tv8g4\" (UID: \"282d8289-dbbd-427e-86a1-f17c37ef70e4\") " pod="openshift-monitoring/node-exporter-tv8g4"
Oct 31 17:27:38.341820 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:38.341701    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/282d8289-dbbd-427e-86a1-f17c37ef70e4-node-exporter-accelerators-collector-config\") pod \"node-exporter-tv8g4\" (UID: \"282d8289-dbbd-427e-86a1-f17c37ef70e4\") " pod="openshift-monitoring/node-exporter-tv8g4"
Oct 31 17:27:38.341820 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:38.341738    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/282d8289-dbbd-427e-86a1-f17c37ef70e4-metrics-client-ca\") pod \"node-exporter-tv8g4\" (UID: \"282d8289-dbbd-427e-86a1-f17c37ef70e4\") " pod="openshift-monitoring/node-exporter-tv8g4"
Oct 31 17:27:38.341820 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:38.341737    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/282d8289-dbbd-427e-86a1-f17c37ef70e4-sys\") pod \"node-exporter-tv8g4\" (UID: \"282d8289-dbbd-427e-86a1-f17c37ef70e4\") " pod="openshift-monitoring/node-exporter-tv8g4"
Oct 31 17:27:38.341820 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:38.341770    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/282d8289-dbbd-427e-86a1-f17c37ef70e4-node-exporter-tls\") pod \"node-exporter-tv8g4\" (UID: \"282d8289-dbbd-427e-86a1-f17c37ef70e4\") " pod="openshift-monitoring/node-exporter-tv8g4"
Oct 31 17:27:38.341820 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:38.341796    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/282d8289-dbbd-427e-86a1-f17c37ef70e4-node-exporter-textfile\") pod \"node-exporter-tv8g4\" (UID: \"282d8289-dbbd-427e-86a1-f17c37ef70e4\") " pod="openshift-monitoring/node-exporter-tv8g4"
Oct 31 17:27:38.342104 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:38.341826    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/282d8289-dbbd-427e-86a1-f17c37ef70e4-node-exporter-wtmp\") pod \"node-exporter-tv8g4\" (UID: \"282d8289-dbbd-427e-86a1-f17c37ef70e4\") " pod="openshift-monitoring/node-exporter-tv8g4"
Oct 31 17:27:38.342104 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:38.341854    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/282d8289-dbbd-427e-86a1-f17c37ef70e4-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-tv8g4\" (UID: \"282d8289-dbbd-427e-86a1-f17c37ef70e4\") " pod="openshift-monitoring/node-exporter-tv8g4"
Oct 31 17:27:38.342104 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:38.341886    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/282d8289-dbbd-427e-86a1-f17c37ef70e4-root\") pod \"node-exporter-tv8g4\" (UID: \"282d8289-dbbd-427e-86a1-f17c37ef70e4\") " pod="openshift-monitoring/node-exporter-tv8g4"
Oct 31 17:27:38.342104 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:38.342001    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/282d8289-dbbd-427e-86a1-f17c37ef70e4-root\") pod \"node-exporter-tv8g4\" (UID: \"282d8289-dbbd-427e-86a1-f17c37ef70e4\") " pod="openshift-monitoring/node-exporter-tv8g4"
Oct 31 17:27:38.342104 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:38.341996    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/282d8289-dbbd-427e-86a1-f17c37ef70e4-node-exporter-wtmp\") pod \"node-exporter-tv8g4\" (UID: \"282d8289-dbbd-427e-86a1-f17c37ef70e4\") " pod="openshift-monitoring/node-exporter-tv8g4"
Oct 31 17:27:38.342310 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:38.342182    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/282d8289-dbbd-427e-86a1-f17c37ef70e4-node-exporter-textfile\") pod \"node-exporter-tv8g4\" (UID: \"282d8289-dbbd-427e-86a1-f17c37ef70e4\") " pod="openshift-monitoring/node-exporter-tv8g4"
Oct 31 17:27:38.342362 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:38.342346    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/282d8289-dbbd-427e-86a1-f17c37ef70e4-node-exporter-accelerators-collector-config\") pod \"node-exporter-tv8g4\" (UID: \"282d8289-dbbd-427e-86a1-f17c37ef70e4\") " pod="openshift-monitoring/node-exporter-tv8g4"
Oct 31 17:27:38.342362 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:38.342350    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/282d8289-dbbd-427e-86a1-f17c37ef70e4-metrics-client-ca\") pod \"node-exporter-tv8g4\" (UID: \"282d8289-dbbd-427e-86a1-f17c37ef70e4\") " pod="openshift-monitoring/node-exporter-tv8g4"
Oct 31 17:27:38.344105 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:38.344087    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/282d8289-dbbd-427e-86a1-f17c37ef70e4-node-exporter-tls\") pod \"node-exporter-tv8g4\" (UID: \"282d8289-dbbd-427e-86a1-f17c37ef70e4\") " pod="openshift-monitoring/node-exporter-tv8g4"
Oct 31 17:27:38.344215 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:38.344107    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/282d8289-dbbd-427e-86a1-f17c37ef70e4-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-tv8g4\" (UID: \"282d8289-dbbd-427e-86a1-f17c37ef70e4\") " pod="openshift-monitoring/node-exporter-tv8g4"
Oct 31 17:27:38.359892 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:38.359867    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zvvtn\" (UniqueName: \"kubernetes.io/projected/282d8289-dbbd-427e-86a1-f17c37ef70e4-kube-api-access-zvvtn\") pod \"node-exporter-tv8g4\" (UID: \"282d8289-dbbd-427e-86a1-f17c37ef70e4\") " pod="openshift-monitoring/node-exporter-tv8g4"
Oct 31 17:27:38.522852 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:38.522776    5003 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-tv8g4"
Oct 31 17:27:38.562566 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:27:38.562531    5003 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod282d8289_dbbd_427e_86a1_f17c37ef70e4.slice/crio-01e926561c6257b68872b5cc61a13bd4cb49c566d3763211cad14bedab904901 WatchSource:0}: Error finding container 01e926561c6257b68872b5cc61a13bd4cb49c566d3763211cad14bedab904901: Status 404 returned error can't find the container with id 01e926561c6257b68872b5cc61a13bd4cb49c566d3763211cad14bedab904901
Oct 31 17:27:39.099692 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:39.099622    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-tv8g4" event={"ID":"282d8289-dbbd-427e-86a1-f17c37ef70e4","Type":"ContainerStarted","Data":"01e926561c6257b68872b5cc61a13bd4cb49c566d3763211cad14bedab904901"}
Oct 31 17:27:40.104998 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:40.104922    5003 generic.go:356] "Generic (PLEG): container finished" podID="282d8289-dbbd-427e-86a1-f17c37ef70e4" containerID="0e8a59b6a24ff3bae0c19662d34daf687f9643936261df5367b928240d94ad8b" exitCode=0
Oct 31 17:27:40.105405 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:40.105014    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-tv8g4" event={"ID":"282d8289-dbbd-427e-86a1-f17c37ef70e4","Type":"ContainerDied","Data":"0e8a59b6a24ff3bae0c19662d34daf687f9643936261df5367b928240d94ad8b"}
Oct 31 17:27:40.331669 ip-10-0-138-17 kubenswrapper[5003]: E1031 17:27:40.331611    5003 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-tdzz5" containerName="extractor"
Oct 31 17:27:41.111528 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:41.111494    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-tv8g4" event={"ID":"282d8289-dbbd-427e-86a1-f17c37ef70e4","Type":"ContainerStarted","Data":"b1f715d35ab0cdf174e4b75afdff0f8f42eeaaeae68570e60099d631c5dc5662"}
Oct 31 17:27:41.111904 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:41.111544    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-tv8g4" event={"ID":"282d8289-dbbd-427e-86a1-f17c37ef70e4","Type":"ContainerStarted","Data":"88a7652f71b9f5a13f611b414e4cc546d5fbb3cae87da07ad94781c9b104dfc3"}
Oct 31 17:27:41.173845 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:41.173796    5003 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-tv8g4" podStartSLOduration=1.817444541 podStartE2EDuration="3.17378371s" totalImagesPullingTime="1.278045433s" totalInitContainerRuntime="78.293736ms" isStatefulPod=true podCreationTimestamp="2026-10-31 17:27:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 17:27:41.160902585 +0000 UTC m=+29.415757128" watchObservedRunningTime="2026-10-31 17:27:41.17378371 +0000 UTC m=+29.428638252"
Oct 31 17:27:46.394850 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:46.394807    5003 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-pqs8z"
Oct 31 17:27:51.069280 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:51.069254    5003 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-869fc8694f-xcqzj"
Oct 31 17:27:51.071282 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:51.071252    5003 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-74dbfdb444-q7rkg"
Oct 31 17:27:51.557865 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:51.557830    5003 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-869fc8694f-xcqzj"]
Oct 31 17:27:56.083213 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:56.083119    5003 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-image-registry/image-registry-74dbfdb444-q7rkg" podUID="170ada34-8944-43d2-bcfb-1d782aae5348" containerName="registry" containerID="cri-o://fdf7a08f6ee540e61465e16f4322a0b63783137bc8a67c2a49608d491d9dc3c5" gracePeriod=30
Oct 31 17:27:56.318686 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:56.318664    5003 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-74dbfdb444-q7rkg"
Oct 31 17:27:56.393528 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:56.393458    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/170ada34-8944-43d2-bcfb-1d782aae5348-ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/170ada34-8944-43d2-bcfb-1d782aae5348-ca-trust-extracted\") pod \"170ada34-8944-43d2-bcfb-1d782aae5348\" (UID: \"170ada34-8944-43d2-bcfb-1d782aae5348\") "
Oct 31 17:27:56.393528 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:56.393507    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/170ada34-8944-43d2-bcfb-1d782aae5348-installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/170ada34-8944-43d2-bcfb-1d782aae5348-installation-pull-secrets\") pod \"170ada34-8944-43d2-bcfb-1d782aae5348\" (UID: \"170ada34-8944-43d2-bcfb-1d782aae5348\") "
Oct 31 17:27:56.393766 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:56.393562    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/170ada34-8944-43d2-bcfb-1d782aae5348-image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/170ada34-8944-43d2-bcfb-1d782aae5348-image-registry-private-configuration\") pod \"170ada34-8944-43d2-bcfb-1d782aae5348\" (UID: \"170ada34-8944-43d2-bcfb-1d782aae5348\") "
Oct 31 17:27:56.393766 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:56.393586    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/170ada34-8944-43d2-bcfb-1d782aae5348-registry-tls\" (UniqueName: \"kubernetes.io/projected/170ada34-8944-43d2-bcfb-1d782aae5348-registry-tls\") pod \"170ada34-8944-43d2-bcfb-1d782aae5348\" (UID: \"170ada34-8944-43d2-bcfb-1d782aae5348\") "
Oct 31 17:27:56.393766 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:56.393629    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/170ada34-8944-43d2-bcfb-1d782aae5348-kube-api-access-h6b47\" (UniqueName: \"kubernetes.io/projected/170ada34-8944-43d2-bcfb-1d782aae5348-kube-api-access-h6b47\") pod \"170ada34-8944-43d2-bcfb-1d782aae5348\" (UID: \"170ada34-8944-43d2-bcfb-1d782aae5348\") "
Oct 31 17:27:56.393766 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:56.393674    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/170ada34-8944-43d2-bcfb-1d782aae5348-registry-certificates\" (UniqueName: \"kubernetes.io/configmap/170ada34-8944-43d2-bcfb-1d782aae5348-registry-certificates\") pod \"170ada34-8944-43d2-bcfb-1d782aae5348\" (UID: \"170ada34-8944-43d2-bcfb-1d782aae5348\") "
Oct 31 17:27:56.393766 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:56.393710    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/170ada34-8944-43d2-bcfb-1d782aae5348-trusted-ca\" (UniqueName: \"kubernetes.io/configmap/170ada34-8944-43d2-bcfb-1d782aae5348-trusted-ca\") pod \"170ada34-8944-43d2-bcfb-1d782aae5348\" (UID: \"170ada34-8944-43d2-bcfb-1d782aae5348\") "
Oct 31 17:27:56.393766 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:56.393757    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/170ada34-8944-43d2-bcfb-1d782aae5348-bound-sa-token\" (UniqueName: \"kubernetes.io/projected/170ada34-8944-43d2-bcfb-1d782aae5348-bound-sa-token\") pod \"170ada34-8944-43d2-bcfb-1d782aae5348\" (UID: \"170ada34-8944-43d2-bcfb-1d782aae5348\") "
Oct 31 17:27:56.394432 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:56.394386    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/170ada34-8944-43d2-bcfb-1d782aae5348-trusted-ca" pod "170ada34-8944-43d2-bcfb-1d782aae5348" (UID: "170ada34-8944-43d2-bcfb-1d782aae5348"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 17:27:56.399667 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:56.399564    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/170ada34-8944-43d2-bcfb-1d782aae5348-registry-certificates" pod "170ada34-8944-43d2-bcfb-1d782aae5348" (UID: "170ada34-8944-43d2-bcfb-1d782aae5348"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 17:27:56.403665 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:56.403518    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/170ada34-8944-43d2-bcfb-1d782aae5348-image-registry-private-configuration" pod "170ada34-8944-43d2-bcfb-1d782aae5348" (UID: "170ada34-8944-43d2-bcfb-1d782aae5348"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 17:27:56.403733 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:56.403658    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/170ada34-8944-43d2-bcfb-1d782aae5348-installation-pull-secrets" pod "170ada34-8944-43d2-bcfb-1d782aae5348" (UID: "170ada34-8944-43d2-bcfb-1d782aae5348"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 17:27:56.404055 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:56.404028    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/170ada34-8944-43d2-bcfb-1d782aae5348-registry-tls" pod "170ada34-8944-43d2-bcfb-1d782aae5348" (UID: "170ada34-8944-43d2-bcfb-1d782aae5348"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 17:27:56.404134 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:56.404040    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/170ada34-8944-43d2-bcfb-1d782aae5348-kube-api-access-h6b47" pod "170ada34-8944-43d2-bcfb-1d782aae5348" (UID: "170ada34-8944-43d2-bcfb-1d782aae5348"). InnerVolumeSpecName "kube-api-access-h6b47". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 17:27:56.404463 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:56.404411    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/170ada34-8944-43d2-bcfb-1d782aae5348-bound-sa-token" pod "170ada34-8944-43d2-bcfb-1d782aae5348" (UID: "170ada34-8944-43d2-bcfb-1d782aae5348"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 17:27:56.404862 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:56.404833    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/170ada34-8944-43d2-bcfb-1d782aae5348-ca-trust-extracted" pod "170ada34-8944-43d2-bcfb-1d782aae5348" (UID: "170ada34-8944-43d2-bcfb-1d782aae5348"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 17:27:56.494448 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:56.494418    5003 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/170ada34-8944-43d2-bcfb-1d782aae5348-registry-certificates\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:27:56.494448 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:56.494446    5003 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/170ada34-8944-43d2-bcfb-1d782aae5348-trusted-ca\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:27:56.494448 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:56.494458    5003 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/170ada34-8944-43d2-bcfb-1d782aae5348-bound-sa-token\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:27:56.494677 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:56.494466    5003 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/170ada34-8944-43d2-bcfb-1d782aae5348-ca-trust-extracted\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:27:56.494677 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:56.494475    5003 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/170ada34-8944-43d2-bcfb-1d782aae5348-installation-pull-secrets\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:27:56.494677 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:56.494488    5003 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/170ada34-8944-43d2-bcfb-1d782aae5348-image-registry-private-configuration\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:27:56.494677 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:56.494497    5003 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/170ada34-8944-43d2-bcfb-1d782aae5348-registry-tls\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:27:56.494677 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:56.494507    5003 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h6b47\" (UniqueName: \"kubernetes.io/projected/170ada34-8944-43d2-bcfb-1d782aae5348-kube-api-access-h6b47\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:27:57.182947 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:57.182907    5003 generic.go:356] "Generic (PLEG): container finished" podID="170ada34-8944-43d2-bcfb-1d782aae5348" containerID="fdf7a08f6ee540e61465e16f4322a0b63783137bc8a67c2a49608d491d9dc3c5" exitCode=0
Oct 31 17:27:57.183370 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:57.182976    5003 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-74dbfdb444-q7rkg"
Oct 31 17:27:57.183370 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:57.182991    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-74dbfdb444-q7rkg" event={"ID":"170ada34-8944-43d2-bcfb-1d782aae5348","Type":"ContainerDied","Data":"fdf7a08f6ee540e61465e16f4322a0b63783137bc8a67c2a49608d491d9dc3c5"}
Oct 31 17:27:57.183370 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:57.183052    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-74dbfdb444-q7rkg" event={"ID":"170ada34-8944-43d2-bcfb-1d782aae5348","Type":"ContainerDied","Data":"590d8ef120a163922fd19fbd07e1dcbbfada7400341f0416d2d7c4be3e9f7977"}
Oct 31 17:27:57.183370 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:57.183072    5003 scope.go:122] "RemoveContainer" containerID="fdf7a08f6ee540e61465e16f4322a0b63783137bc8a67c2a49608d491d9dc3c5"
Oct 31 17:27:57.192534 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:57.192514    5003 scope.go:122] "RemoveContainer" containerID="fdf7a08f6ee540e61465e16f4322a0b63783137bc8a67c2a49608d491d9dc3c5"
Oct 31 17:27:57.192845 ip-10-0-138-17 kubenswrapper[5003]: E1031 17:27:57.192825    5003 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fdf7a08f6ee540e61465e16f4322a0b63783137bc8a67c2a49608d491d9dc3c5\": container with ID starting with fdf7a08f6ee540e61465e16f4322a0b63783137bc8a67c2a49608d491d9dc3c5 not found: ID does not exist" containerID="fdf7a08f6ee540e61465e16f4322a0b63783137bc8a67c2a49608d491d9dc3c5"
Oct 31 17:27:57.192896 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:57.192855    5003 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fdf7a08f6ee540e61465e16f4322a0b63783137bc8a67c2a49608d491d9dc3c5"} err="failed to get container status \"fdf7a08f6ee540e61465e16f4322a0b63783137bc8a67c2a49608d491d9dc3c5\": rpc error: code = NotFound desc = could not find container \"fdf7a08f6ee540e61465e16f4322a0b63783137bc8a67c2a49608d491d9dc3c5\": container with ID starting with fdf7a08f6ee540e61465e16f4322a0b63783137bc8a67c2a49608d491d9dc3c5 not found: ID does not exist"
Oct 31 17:27:57.243453 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:57.243423    5003 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-74dbfdb444-q7rkg"]
Oct 31 17:27:57.245334 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:57.245310    5003 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-74dbfdb444-q7rkg"]
Oct 31 17:27:57.887069 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:27:57.887034    5003 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="170ada34-8944-43d2-bcfb-1d782aae5348" path="/var/lib/kubelet/pods/170ada34-8944-43d2-bcfb-1d782aae5348/volumes"
Oct 31 17:28:01.741293 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:28:01.741260    5003 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-insights/periodic-gathering-7hd6d-tll9c"]
Oct 31 17:28:01.741804 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:28:01.741513    5003 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-insights/periodic-gathering-7hd6d-tll9c" podUID="f9d20ae4-1aa4-40f8-bd2e-549490e31b0a" containerName="insights-gathering" containerID="cri-o://1ad705f35352eaf156351021d439ffd7e2099bfc5221bb7744a8a7c261522c68" gracePeriod=30
Oct 31 17:28:01.746920 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:28:01.746896    5003 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-insights/periodic-gathering-vhvfz-6pbpt"]
Oct 31 17:28:01.747128 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:28:01.747100    5003 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-insights/periodic-gathering-vhvfz-6pbpt" podUID="948f2c4e-81a5-4c0e-9ec9-f4fb56368b87" containerName="insights-gathering" containerID="cri-o://5b973b35ae12bce514faa6cd27079d658e5ef589c3a28ca7fc49ecf1a489cf2d" gracePeriod=30
Oct 31 17:28:02.017547 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:28:02.017520    5003 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-insights/periodic-gathering-7hd6d-tll9c"
Oct 31 17:28:02.020314 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:28:02.020292    5003 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-insights/periodic-gathering-vhvfz-6pbpt"
Oct 31 17:28:02.145463 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:28:02.145431    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/948f2c4e-81a5-4c0e-9ec9-f4fb56368b87-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/948f2c4e-81a5-4c0e-9ec9-f4fb56368b87-trusted-ca-bundle\") pod \"948f2c4e-81a5-4c0e-9ec9-f4fb56368b87\" (UID: \"948f2c4e-81a5-4c0e-9ec9-f4fb56368b87\") "
Oct 31 17:28:02.145635 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:28:02.145490    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/f9d20ae4-1aa4-40f8-bd2e-549490e31b0a-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f9d20ae4-1aa4-40f8-bd2e-549490e31b0a-trusted-ca-bundle\") pod \"f9d20ae4-1aa4-40f8-bd2e-549490e31b0a\" (UID: \"f9d20ae4-1aa4-40f8-bd2e-549490e31b0a\") "
Oct 31 17:28:02.145635 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:28:02.145522    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/f9d20ae4-1aa4-40f8-bd2e-549490e31b0a-kube-api-access-tbq2w\" (UniqueName: \"kubernetes.io/projected/f9d20ae4-1aa4-40f8-bd2e-549490e31b0a-kube-api-access-tbq2w\") pod \"f9d20ae4-1aa4-40f8-bd2e-549490e31b0a\" (UID: \"f9d20ae4-1aa4-40f8-bd2e-549490e31b0a\") "
Oct 31 17:28:02.145635 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:28:02.145557    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/948f2c4e-81a5-4c0e-9ec9-f4fb56368b87-kube-api-access-mkgtp\" (UniqueName: \"kubernetes.io/projected/948f2c4e-81a5-4c0e-9ec9-f4fb56368b87-kube-api-access-mkgtp\") pod \"948f2c4e-81a5-4c0e-9ec9-f4fb56368b87\" (UID: \"948f2c4e-81a5-4c0e-9ec9-f4fb56368b87\") "
Oct 31 17:28:02.145635 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:28:02.145615    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/948f2c4e-81a5-4c0e-9ec9-f4fb56368b87-archives-path\" (UniqueName: \"kubernetes.io/empty-dir/948f2c4e-81a5-4c0e-9ec9-f4fb56368b87-archives-path\") pod \"948f2c4e-81a5-4c0e-9ec9-f4fb56368b87\" (UID: \"948f2c4e-81a5-4c0e-9ec9-f4fb56368b87\") "
Oct 31 17:28:02.145891 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:28:02.145706    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f9d20ae4-1aa4-40f8-bd2e-549490e31b0a-archives-path\" (UniqueName: \"kubernetes.io/empty-dir/f9d20ae4-1aa4-40f8-bd2e-549490e31b0a-archives-path\") pod \"f9d20ae4-1aa4-40f8-bd2e-549490e31b0a\" (UID: \"f9d20ae4-1aa4-40f8-bd2e-549490e31b0a\") "
Oct 31 17:28:02.145891 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:28:02.145739    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/f9d20ae4-1aa4-40f8-bd2e-549490e31b0a-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f9d20ae4-1aa4-40f8-bd2e-549490e31b0a-service-ca-bundle\") pod \"f9d20ae4-1aa4-40f8-bd2e-549490e31b0a\" (UID: \"f9d20ae4-1aa4-40f8-bd2e-549490e31b0a\") "
Oct 31 17:28:02.145891 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:28:02.145781    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/948f2c4e-81a5-4c0e-9ec9-f4fb56368b87-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/948f2c4e-81a5-4c0e-9ec9-f4fb56368b87-service-ca-bundle\") pod \"948f2c4e-81a5-4c0e-9ec9-f4fb56368b87\" (UID: \"948f2c4e-81a5-4c0e-9ec9-f4fb56368b87\") "
Oct 31 17:28:02.146299 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:28:02.145896    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/948f2c4e-81a5-4c0e-9ec9-f4fb56368b87-trusted-ca-bundle" pod "948f2c4e-81a5-4c0e-9ec9-f4fb56368b87" (UID: "948f2c4e-81a5-4c0e-9ec9-f4fb56368b87"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 17:28:02.146299 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:28:02.146061    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f9d20ae4-1aa4-40f8-bd2e-549490e31b0a-trusted-ca-bundle" pod "f9d20ae4-1aa4-40f8-bd2e-549490e31b0a" (UID: "f9d20ae4-1aa4-40f8-bd2e-549490e31b0a"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 17:28:02.146299 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:28:02.146085    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/948f2c4e-81a5-4c0e-9ec9-f4fb56368b87-archives-path" pod "948f2c4e-81a5-4c0e-9ec9-f4fb56368b87" (UID: "948f2c4e-81a5-4c0e-9ec9-f4fb56368b87"). InnerVolumeSpecName "archives-path". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 17:28:02.146299 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:28:02.146083    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f9d20ae4-1aa4-40f8-bd2e-549490e31b0a-archives-path" pod "f9d20ae4-1aa4-40f8-bd2e-549490e31b0a" (UID: "f9d20ae4-1aa4-40f8-bd2e-549490e31b0a"). InnerVolumeSpecName "archives-path". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 17:28:02.146299 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:28:02.146259    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f9d20ae4-1aa4-40f8-bd2e-549490e31b0a-service-ca-bundle" pod "f9d20ae4-1aa4-40f8-bd2e-549490e31b0a" (UID: "f9d20ae4-1aa4-40f8-bd2e-549490e31b0a"). InnerVolumeSpecName "service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 17:28:02.146299 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:28:02.146296    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/948f2c4e-81a5-4c0e-9ec9-f4fb56368b87-service-ca-bundle" pod "948f2c4e-81a5-4c0e-9ec9-f4fb56368b87" (UID: "948f2c4e-81a5-4c0e-9ec9-f4fb56368b87"). InnerVolumeSpecName "service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 17:28:02.147870 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:28:02.147848    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f9d20ae4-1aa4-40f8-bd2e-549490e31b0a-kube-api-access-tbq2w" pod "f9d20ae4-1aa4-40f8-bd2e-549490e31b0a" (UID: "f9d20ae4-1aa4-40f8-bd2e-549490e31b0a"). InnerVolumeSpecName "kube-api-access-tbq2w". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 17:28:02.147915 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:28:02.147890    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/948f2c4e-81a5-4c0e-9ec9-f4fb56368b87-kube-api-access-mkgtp" pod "948f2c4e-81a5-4c0e-9ec9-f4fb56368b87" (UID: "948f2c4e-81a5-4c0e-9ec9-f4fb56368b87"). InnerVolumeSpecName "kube-api-access-mkgtp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 17:28:02.208124 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:28:02.208089    5003 generic.go:356] "Generic (PLEG): container finished" podID="f9d20ae4-1aa4-40f8-bd2e-549490e31b0a" containerID="1ad705f35352eaf156351021d439ffd7e2099bfc5221bb7744a8a7c261522c68" exitCode=2
Oct 31 17:28:02.208303 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:28:02.208146    5003 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-insights/periodic-gathering-7hd6d-tll9c"
Oct 31 17:28:02.208303 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:28:02.208185    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/periodic-gathering-7hd6d-tll9c" event={"ID":"f9d20ae4-1aa4-40f8-bd2e-549490e31b0a","Type":"ContainerDied","Data":"1ad705f35352eaf156351021d439ffd7e2099bfc5221bb7744a8a7c261522c68"}
Oct 31 17:28:02.208303 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:28:02.208237    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/periodic-gathering-7hd6d-tll9c" event={"ID":"f9d20ae4-1aa4-40f8-bd2e-549490e31b0a","Type":"ContainerDied","Data":"046bb2859390ff250cbe9e8f8fa4bbe52b142c8f5b49cee5e81a8d8a03f4e4c4"}
Oct 31 17:28:02.208303 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:28:02.208261    5003 scope.go:122] "RemoveContainer" containerID="1ad705f35352eaf156351021d439ffd7e2099bfc5221bb7744a8a7c261522c68"
Oct 31 17:28:02.209716 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:28:02.209571    5003 generic.go:356] "Generic (PLEG): container finished" podID="948f2c4e-81a5-4c0e-9ec9-f4fb56368b87" containerID="5b973b35ae12bce514faa6cd27079d658e5ef589c3a28ca7fc49ecf1a489cf2d" exitCode=2
Oct 31 17:28:02.209716 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:28:02.209626    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/periodic-gathering-vhvfz-6pbpt" event={"ID":"948f2c4e-81a5-4c0e-9ec9-f4fb56368b87","Type":"ContainerDied","Data":"5b973b35ae12bce514faa6cd27079d658e5ef589c3a28ca7fc49ecf1a489cf2d"}
Oct 31 17:28:02.209716 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:28:02.209689    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/periodic-gathering-vhvfz-6pbpt" event={"ID":"948f2c4e-81a5-4c0e-9ec9-f4fb56368b87","Type":"ContainerDied","Data":"b04372cdde747c31b9ddfaba1b1dec47cf42e7045d4e8970634373c035dc2f89"}
Oct 31 17:28:02.209842 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:28:02.209748    5003 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-insights/periodic-gathering-vhvfz-6pbpt"
Oct 31 17:28:02.217711 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:28:02.217692    5003 scope.go:122] "RemoveContainer" containerID="1ad705f35352eaf156351021d439ffd7e2099bfc5221bb7744a8a7c261522c68"
Oct 31 17:28:02.217998 ip-10-0-138-17 kubenswrapper[5003]: E1031 17:28:02.217977    5003 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1ad705f35352eaf156351021d439ffd7e2099bfc5221bb7744a8a7c261522c68\": container with ID starting with 1ad705f35352eaf156351021d439ffd7e2099bfc5221bb7744a8a7c261522c68 not found: ID does not exist" containerID="1ad705f35352eaf156351021d439ffd7e2099bfc5221bb7744a8a7c261522c68"
Oct 31 17:28:02.218056 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:28:02.218007    5003 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1ad705f35352eaf156351021d439ffd7e2099bfc5221bb7744a8a7c261522c68"} err="failed to get container status \"1ad705f35352eaf156351021d439ffd7e2099bfc5221bb7744a8a7c261522c68\": rpc error: code = NotFound desc = could not find container \"1ad705f35352eaf156351021d439ffd7e2099bfc5221bb7744a8a7c261522c68\": container with ID starting with 1ad705f35352eaf156351021d439ffd7e2099bfc5221bb7744a8a7c261522c68 not found: ID does not exist"
Oct 31 17:28:02.218056 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:28:02.218025    5003 scope.go:122] "RemoveContainer" containerID="5b973b35ae12bce514faa6cd27079d658e5ef589c3a28ca7fc49ecf1a489cf2d"
Oct 31 17:28:02.225735 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:28:02.225717    5003 scope.go:122] "RemoveContainer" containerID="5b973b35ae12bce514faa6cd27079d658e5ef589c3a28ca7fc49ecf1a489cf2d"
Oct 31 17:28:02.225989 ip-10-0-138-17 kubenswrapper[5003]: E1031 17:28:02.225972    5003 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5b973b35ae12bce514faa6cd27079d658e5ef589c3a28ca7fc49ecf1a489cf2d\": container with ID starting with 5b973b35ae12bce514faa6cd27079d658e5ef589c3a28ca7fc49ecf1a489cf2d not found: ID does not exist" containerID="5b973b35ae12bce514faa6cd27079d658e5ef589c3a28ca7fc49ecf1a489cf2d"
Oct 31 17:28:02.226038 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:28:02.225997    5003 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5b973b35ae12bce514faa6cd27079d658e5ef589c3a28ca7fc49ecf1a489cf2d"} err="failed to get container status \"5b973b35ae12bce514faa6cd27079d658e5ef589c3a28ca7fc49ecf1a489cf2d\": rpc error: code = NotFound desc = could not find container \"5b973b35ae12bce514faa6cd27079d658e5ef589c3a28ca7fc49ecf1a489cf2d\": container with ID starting with 5b973b35ae12bce514faa6cd27079d658e5ef589c3a28ca7fc49ecf1a489cf2d not found: ID does not exist"
Oct 31 17:28:02.246564 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:28:02.246509    5003 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f9d20ae4-1aa4-40f8-bd2e-549490e31b0a-trusted-ca-bundle\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:28:02.246564 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:28:02.246532    5003 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tbq2w\" (UniqueName: \"kubernetes.io/projected/f9d20ae4-1aa4-40f8-bd2e-549490e31b0a-kube-api-access-tbq2w\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:28:02.246564 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:28:02.246541    5003 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mkgtp\" (UniqueName: \"kubernetes.io/projected/948f2c4e-81a5-4c0e-9ec9-f4fb56368b87-kube-api-access-mkgtp\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:28:02.246564 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:28:02.246551    5003 reconciler_common.go:299] "Volume detached for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/948f2c4e-81a5-4c0e-9ec9-f4fb56368b87-archives-path\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:28:02.246564 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:28:02.246561    5003 reconciler_common.go:299] "Volume detached for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/f9d20ae4-1aa4-40f8-bd2e-549490e31b0a-archives-path\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:28:02.246818 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:28:02.246570    5003 reconciler_common.go:299] "Volume detached for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f9d20ae4-1aa4-40f8-bd2e-549490e31b0a-service-ca-bundle\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:28:02.246818 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:28:02.246578    5003 reconciler_common.go:299] "Volume detached for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/948f2c4e-81a5-4c0e-9ec9-f4fb56368b87-service-ca-bundle\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:28:02.246818 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:28:02.246586    5003 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/948f2c4e-81a5-4c0e-9ec9-f4fb56368b87-trusted-ca-bundle\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:28:02.258372 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:28:02.258348    5003 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-insights/periodic-gathering-7hd6d-tll9c"]
Oct 31 17:28:02.261287 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:28:02.261266    5003 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-insights/periodic-gathering-7hd6d-tll9c"]
Oct 31 17:28:02.293089 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:28:02.293056    5003 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-insights/periodic-gathering-vhvfz-6pbpt"]
Oct 31 17:28:02.296935 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:28:02.296908    5003 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-insights/periodic-gathering-vhvfz-6pbpt"]
Oct 31 17:28:03.886900 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:28:03.886867    5003 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="948f2c4e-81a5-4c0e-9ec9-f4fb56368b87" path="/var/lib/kubelet/pods/948f2c4e-81a5-4c0e-9ec9-f4fb56368b87/volumes"
Oct 31 17:28:03.887284 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:28:03.887273    5003 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="f9d20ae4-1aa4-40f8-bd2e-549490e31b0a" path="/var/lib/kubelet/pods/f9d20ae4-1aa4-40f8-bd2e-549490e31b0a/volumes"
Oct 31 17:28:10.329259 ip-10-0-138-17 kubenswrapper[5003]: E1031 17:28:10.329222    5003 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-tdzz5" containerName="extractor"
Oct 31 17:28:16.585599 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:28:16.585532    5003 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-image-registry/image-registry-869fc8694f-xcqzj" podUID="9d9ecf7f-6a11-469b-8626-99d5ef7ffac7" containerName="registry" containerID="cri-o://8079387e120056d58249009effd7c5d8499b21bae5b3a13c3bdf151d57904080" gracePeriod=30
Oct 31 17:28:16.829035 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:28:16.829005    5003 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-869fc8694f-xcqzj"
Oct 31 17:28:16.968884 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:28:16.968813    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/9d9ecf7f-6a11-469b-8626-99d5ef7ffac7-installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9d9ecf7f-6a11-469b-8626-99d5ef7ffac7-installation-pull-secrets\") pod \"9d9ecf7f-6a11-469b-8626-99d5ef7ffac7\" (UID: \"9d9ecf7f-6a11-469b-8626-99d5ef7ffac7\") "
Oct 31 17:28:16.968884 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:28:16.968846    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/9d9ecf7f-6a11-469b-8626-99d5ef7ffac7-registry-tls\" (UniqueName: \"kubernetes.io/projected/9d9ecf7f-6a11-469b-8626-99d5ef7ffac7-registry-tls\") pod \"9d9ecf7f-6a11-469b-8626-99d5ef7ffac7\" (UID: \"9d9ecf7f-6a11-469b-8626-99d5ef7ffac7\") "
Oct 31 17:28:16.968884 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:28:16.968874    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/9d9ecf7f-6a11-469b-8626-99d5ef7ffac7-registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9d9ecf7f-6a11-469b-8626-99d5ef7ffac7-registry-certificates\") pod \"9d9ecf7f-6a11-469b-8626-99d5ef7ffac7\" (UID: \"9d9ecf7f-6a11-469b-8626-99d5ef7ffac7\") "
Oct 31 17:28:16.969099 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:28:16.969014    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9d9ecf7f-6a11-469b-8626-99d5ef7ffac7-ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9d9ecf7f-6a11-469b-8626-99d5ef7ffac7-ca-trust-extracted\") pod \"9d9ecf7f-6a11-469b-8626-99d5ef7ffac7\" (UID: \"9d9ecf7f-6a11-469b-8626-99d5ef7ffac7\") "
Oct 31 17:28:16.969099 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:28:16.969071    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/9d9ecf7f-6a11-469b-8626-99d5ef7ffac7-trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9d9ecf7f-6a11-469b-8626-99d5ef7ffac7-trusted-ca\") pod \"9d9ecf7f-6a11-469b-8626-99d5ef7ffac7\" (UID: \"9d9ecf7f-6a11-469b-8626-99d5ef7ffac7\") "
Oct 31 17:28:16.969199 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:28:16.969114    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/9d9ecf7f-6a11-469b-8626-99d5ef7ffac7-image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9d9ecf7f-6a11-469b-8626-99d5ef7ffac7-image-registry-private-configuration\") pod \"9d9ecf7f-6a11-469b-8626-99d5ef7ffac7\" (UID: \"9d9ecf7f-6a11-469b-8626-99d5ef7ffac7\") "
Oct 31 17:28:16.969199 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:28:16.969159    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/9d9ecf7f-6a11-469b-8626-99d5ef7ffac7-kube-api-access-mgwcl\" (UniqueName: \"kubernetes.io/projected/9d9ecf7f-6a11-469b-8626-99d5ef7ffac7-kube-api-access-mgwcl\") pod \"9d9ecf7f-6a11-469b-8626-99d5ef7ffac7\" (UID: \"9d9ecf7f-6a11-469b-8626-99d5ef7ffac7\") "
Oct 31 17:28:16.969199 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:28:16.969190    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/9d9ecf7f-6a11-469b-8626-99d5ef7ffac7-bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9d9ecf7f-6a11-469b-8626-99d5ef7ffac7-bound-sa-token\") pod \"9d9ecf7f-6a11-469b-8626-99d5ef7ffac7\" (UID: \"9d9ecf7f-6a11-469b-8626-99d5ef7ffac7\") "
Oct 31 17:28:16.969354 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:28:16.969250    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9d9ecf7f-6a11-469b-8626-99d5ef7ffac7-registry-certificates" pod "9d9ecf7f-6a11-469b-8626-99d5ef7ffac7" (UID: "9d9ecf7f-6a11-469b-8626-99d5ef7ffac7"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 17:28:16.969493 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:28:16.969464    5003 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9d9ecf7f-6a11-469b-8626-99d5ef7ffac7-registry-certificates\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:28:16.969608 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:28:16.969485    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9d9ecf7f-6a11-469b-8626-99d5ef7ffac7-trusted-ca" pod "9d9ecf7f-6a11-469b-8626-99d5ef7ffac7" (UID: "9d9ecf7f-6a11-469b-8626-99d5ef7ffac7"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 17:28:16.971337 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:28:16.971299    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9d9ecf7f-6a11-469b-8626-99d5ef7ffac7-registry-tls" pod "9d9ecf7f-6a11-469b-8626-99d5ef7ffac7" (UID: "9d9ecf7f-6a11-469b-8626-99d5ef7ffac7"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 17:28:16.971744 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:28:16.971719    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9d9ecf7f-6a11-469b-8626-99d5ef7ffac7-installation-pull-secrets" pod "9d9ecf7f-6a11-469b-8626-99d5ef7ffac7" (UID: "9d9ecf7f-6a11-469b-8626-99d5ef7ffac7"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 17:28:16.971852 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:28:16.971767    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9d9ecf7f-6a11-469b-8626-99d5ef7ffac7-bound-sa-token" pod "9d9ecf7f-6a11-469b-8626-99d5ef7ffac7" (UID: "9d9ecf7f-6a11-469b-8626-99d5ef7ffac7"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 17:28:16.971852 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:28:16.971831    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9d9ecf7f-6a11-469b-8626-99d5ef7ffac7-image-registry-private-configuration" pod "9d9ecf7f-6a11-469b-8626-99d5ef7ffac7" (UID: "9d9ecf7f-6a11-469b-8626-99d5ef7ffac7"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 17:28:16.971944 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:28:16.971868    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9d9ecf7f-6a11-469b-8626-99d5ef7ffac7-kube-api-access-mgwcl" pod "9d9ecf7f-6a11-469b-8626-99d5ef7ffac7" (UID: "9d9ecf7f-6a11-469b-8626-99d5ef7ffac7"). InnerVolumeSpecName "kube-api-access-mgwcl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 17:28:16.976057 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:28:16.976034    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9d9ecf7f-6a11-469b-8626-99d5ef7ffac7-ca-trust-extracted" pod "9d9ecf7f-6a11-469b-8626-99d5ef7ffac7" (UID: "9d9ecf7f-6a11-469b-8626-99d5ef7ffac7"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 17:28:17.070081 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:28:17.070048    5003 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9d9ecf7f-6a11-469b-8626-99d5ef7ffac7-image-registry-private-configuration\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:28:17.070081 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:28:17.070076    5003 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mgwcl\" (UniqueName: \"kubernetes.io/projected/9d9ecf7f-6a11-469b-8626-99d5ef7ffac7-kube-api-access-mgwcl\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:28:17.070081 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:28:17.070088    5003 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9d9ecf7f-6a11-469b-8626-99d5ef7ffac7-bound-sa-token\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:28:17.070299 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:28:17.070098    5003 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9d9ecf7f-6a11-469b-8626-99d5ef7ffac7-installation-pull-secrets\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:28:17.070299 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:28:17.070108    5003 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9d9ecf7f-6a11-469b-8626-99d5ef7ffac7-registry-tls\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:28:17.070299 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:28:17.070116    5003 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9d9ecf7f-6a11-469b-8626-99d5ef7ffac7-ca-trust-extracted\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:28:17.070299 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:28:17.070125    5003 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9d9ecf7f-6a11-469b-8626-99d5ef7ffac7-trusted-ca\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:28:17.270560 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:28:17.270477    5003 generic.go:356] "Generic (PLEG): container finished" podID="9d9ecf7f-6a11-469b-8626-99d5ef7ffac7" containerID="8079387e120056d58249009effd7c5d8499b21bae5b3a13c3bdf151d57904080" exitCode=0
Oct 31 17:28:17.270560 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:28:17.270521    5003 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-869fc8694f-xcqzj"
Oct 31 17:28:17.270560 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:28:17.270531    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-869fc8694f-xcqzj" event={"ID":"9d9ecf7f-6a11-469b-8626-99d5ef7ffac7","Type":"ContainerDied","Data":"8079387e120056d58249009effd7c5d8499b21bae5b3a13c3bdf151d57904080"}
Oct 31 17:28:17.270810 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:28:17.270571    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-869fc8694f-xcqzj" event={"ID":"9d9ecf7f-6a11-469b-8626-99d5ef7ffac7","Type":"ContainerDied","Data":"5c93af39befd1c67c95c2d029eb0a91147d4d92d0cca41fbd0ef89cfb1da52eb"}
Oct 31 17:28:17.270810 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:28:17.270591    5003 scope.go:122] "RemoveContainer" containerID="8079387e120056d58249009effd7c5d8499b21bae5b3a13c3bdf151d57904080"
Oct 31 17:28:17.278585 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:28:17.278563    5003 scope.go:122] "RemoveContainer" containerID="8079387e120056d58249009effd7c5d8499b21bae5b3a13c3bdf151d57904080"
Oct 31 17:28:17.278889 ip-10-0-138-17 kubenswrapper[5003]: E1031 17:28:17.278866    5003 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8079387e120056d58249009effd7c5d8499b21bae5b3a13c3bdf151d57904080\": container with ID starting with 8079387e120056d58249009effd7c5d8499b21bae5b3a13c3bdf151d57904080 not found: ID does not exist" containerID="8079387e120056d58249009effd7c5d8499b21bae5b3a13c3bdf151d57904080"
Oct 31 17:28:17.278970 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:28:17.278896    5003 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8079387e120056d58249009effd7c5d8499b21bae5b3a13c3bdf151d57904080"} err="failed to get container status \"8079387e120056d58249009effd7c5d8499b21bae5b3a13c3bdf151d57904080\": rpc error: code = NotFound desc = could not find container \"8079387e120056d58249009effd7c5d8499b21bae5b3a13c3bdf151d57904080\": container with ID starting with 8079387e120056d58249009effd7c5d8499b21bae5b3a13c3bdf151d57904080 not found: ID does not exist"
Oct 31 17:28:17.318653 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:28:17.318608    5003 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-869fc8694f-xcqzj"]
Oct 31 17:28:17.330364 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:28:17.330334    5003 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-869fc8694f-xcqzj"]
Oct 31 17:28:17.886407 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:28:17.886373    5003 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="9d9ecf7f-6a11-469b-8626-99d5ef7ffac7" path="/var/lib/kubelet/pods/9d9ecf7f-6a11-469b-8626-99d5ef7ffac7/volumes"
Oct 31 17:28:31.330118 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:28:31.330085    5003 generic.go:356] "Generic (PLEG): container finished" podID="8a9e5aa4-f4fc-4b33-a925-8e63df6c9cd2" containerID="6a6e9d9ec59151454ae639c1b8210bbdf66a2b72c58947efc394061d5423abb2" exitCode=0
Oct 31 17:28:31.330613 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:28:31.330162    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-4xtm4" event={"ID":"8a9e5aa4-f4fc-4b33-a925-8e63df6c9cd2","Type":"ContainerDied","Data":"6a6e9d9ec59151454ae639c1b8210bbdf66a2b72c58947efc394061d5423abb2"}
Oct 31 17:28:31.330613 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:28:31.330517    5003 scope.go:122] "RemoveContainer" containerID="6a6e9d9ec59151454ae639c1b8210bbdf66a2b72c58947efc394061d5423abb2"
Oct 31 17:28:31.331800 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:28:31.331780    5003 generic.go:356] "Generic (PLEG): container finished" podID="2330cbe7-498c-4f39-ba1b-3873e125dd18" containerID="a8dd3b9e683df9111d20b1cf40bf8b9df8c382fbf3fb524496291168a12be135" exitCode=0
Oct 31 17:28:31.331910 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:28:31.331829    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-7lspr" event={"ID":"2330cbe7-498c-4f39-ba1b-3873e125dd18","Type":"ContainerDied","Data":"a8dd3b9e683df9111d20b1cf40bf8b9df8c382fbf3fb524496291168a12be135"}
Oct 31 17:28:31.332153 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:28:31.332136    5003 scope.go:122] "RemoveContainer" containerID="a8dd3b9e683df9111d20b1cf40bf8b9df8c382fbf3fb524496291168a12be135"
Oct 31 17:28:32.337795 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:28:32.337757    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-7lspr" event={"ID":"2330cbe7-498c-4f39-ba1b-3873e125dd18","Type":"ContainerStarted","Data":"617383585f096f10619f198cab9be8fdcd2df45c2782091d3980cbcab3246c15"}
Oct 31 17:28:32.339571 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:28:32.339550    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-4xtm4" event={"ID":"8a9e5aa4-f4fc-4b33-a925-8e63df6c9cd2","Type":"ContainerStarted","Data":"f16eb0fcb0a9d6abbe8777cdaf79b324bbd8056208e346006a7f1225bc846c2b"}
Oct 31 17:28:40.331086 ip-10-0-138-17 kubenswrapper[5003]: E1031 17:28:40.331043    5003 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-tdzz5" containerName="extractor"
Oct 31 17:29:10.330102 ip-10-0-138-17 kubenswrapper[5003]: E1031 17:29:10.330064    5003 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-tdzz5" containerName="extractor"
Oct 31 17:29:40.331340 ip-10-0-138-17 kubenswrapper[5003]: E1031 17:29:40.331255    5003 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-tdzz5" containerName="extractor"
Oct 31 17:30:07.301358 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:07.301318    5003 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a5xhx5"]
Oct 31 17:30:07.301933 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:07.301657    5003 cpu_manager.go:414] "containerMap: removing container" podUID="9d9ecf7f-6a11-469b-8626-99d5ef7ffac7" containerName="registry"
Oct 31 17:30:07.301933 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:07.301671    5003 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="9d9ecf7f-6a11-469b-8626-99d5ef7ffac7" containerName="registry"
Oct 31 17:30:07.301933 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:07.301690    5003 cpu_manager.go:414] "containerMap: removing container" podUID="948f2c4e-81a5-4c0e-9ec9-f4fb56368b87" containerName="insights-gathering"
Oct 31 17:30:07.301933 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:07.301695    5003 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="948f2c4e-81a5-4c0e-9ec9-f4fb56368b87" containerName="insights-gathering"
Oct 31 17:30:07.301933 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:07.301707    5003 cpu_manager.go:414] "containerMap: removing container" podUID="f9d20ae4-1aa4-40f8-bd2e-549490e31b0a" containerName="insights-gathering"
Oct 31 17:30:07.301933 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:07.301712    5003 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="f9d20ae4-1aa4-40f8-bd2e-549490e31b0a" containerName="insights-gathering"
Oct 31 17:30:07.301933 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:07.301723    5003 cpu_manager.go:414] "containerMap: removing container" podUID="170ada34-8944-43d2-bcfb-1d782aae5348" containerName="registry"
Oct 31 17:30:07.301933 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:07.301728    5003 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="170ada34-8944-43d2-bcfb-1d782aae5348" containerName="registry"
Oct 31 17:30:07.301933 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:07.301790    5003 memory_manager.go:365] "RemoveStaleState removing state" podUID="170ada34-8944-43d2-bcfb-1d782aae5348" containerName="registry"
Oct 31 17:30:07.301933 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:07.301804    5003 memory_manager.go:365] "RemoveStaleState removing state" podUID="9d9ecf7f-6a11-469b-8626-99d5ef7ffac7" containerName="registry"
Oct 31 17:30:07.301933 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:07.301817    5003 memory_manager.go:365] "RemoveStaleState removing state" podUID="948f2c4e-81a5-4c0e-9ec9-f4fb56368b87" containerName="insights-gathering"
Oct 31 17:30:07.301933 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:07.301828    5003 memory_manager.go:365] "RemoveStaleState removing state" podUID="f9d20ae4-1aa4-40f8-bd2e-549490e31b0a" containerName="insights-gathering"
Oct 31 17:30:07.305203 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:07.305185    5003 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a5xhx5"
Oct 31 17:30:07.333991 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:07.333957    5003 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Oct 31 17:30:07.334146 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:07.334025    5003 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Oct 31 17:30:07.335019 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:07.334996    5003 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a5xhx5"]
Oct 31 17:30:07.392344 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:07.392310    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/63b287e5-9291-47b5-9033-e117583a4ad7-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a5xhx5\" (UID: \"63b287e5-9291-47b5-9033-e117583a4ad7\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a5xhx5"
Oct 31 17:30:07.392344 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:07.392344    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/63b287e5-9291-47b5-9033-e117583a4ad7-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a5xhx5\" (UID: \"63b287e5-9291-47b5-9033-e117583a4ad7\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a5xhx5"
Oct 31 17:30:07.392533 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:07.392459    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7qzdk\" (UniqueName: \"kubernetes.io/projected/63b287e5-9291-47b5-9033-e117583a4ad7-kube-api-access-7qzdk\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a5xhx5\" (UID: \"63b287e5-9291-47b5-9033-e117583a4ad7\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a5xhx5"
Oct 31 17:30:07.394015 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:07.393999    5003 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"6541d93aaee335d6227a8778ab4e840bbe7f52-f98fbcf8-dockercfg-5mmtk\""
Oct 31 17:30:07.400021 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:07.400001    5003 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c88jw2"]
Oct 31 17:30:07.403548 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:07.403529    5003 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c88jw2"
Oct 31 17:30:07.417433 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:07.417408    5003 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"e3d011e69d9573cabb8c359e5ac709eb5ac240-be78d160-dockercfg-dprkl\""
Oct 31 17:30:07.423385 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:07.423364    5003 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c88jw2"]
Oct 31 17:30:07.493101 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:07.493068    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7f8b7ebd-2dc8-4664-afab-de39e221af75-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c88jw2\" (UID: \"7f8b7ebd-2dc8-4664-afab-de39e221af75\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c88jw2"
Oct 31 17:30:07.493259 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:07.493107    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7f8b7ebd-2dc8-4664-afab-de39e221af75-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c88jw2\" (UID: \"7f8b7ebd-2dc8-4664-afab-de39e221af75\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c88jw2"
Oct 31 17:30:07.493259 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:07.493147    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7qzdk\" (UniqueName: \"kubernetes.io/projected/63b287e5-9291-47b5-9033-e117583a4ad7-kube-api-access-7qzdk\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a5xhx5\" (UID: \"63b287e5-9291-47b5-9033-e117583a4ad7\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a5xhx5"
Oct 31 17:30:07.493349 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:07.493247    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/63b287e5-9291-47b5-9033-e117583a4ad7-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a5xhx5\" (UID: \"63b287e5-9291-47b5-9033-e117583a4ad7\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a5xhx5"
Oct 31 17:30:07.493349 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:07.493283    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sd4cq\" (UniqueName: \"kubernetes.io/projected/7f8b7ebd-2dc8-4664-afab-de39e221af75-kube-api-access-sd4cq\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c88jw2\" (UID: \"7f8b7ebd-2dc8-4664-afab-de39e221af75\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c88jw2"
Oct 31 17:30:07.493349 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:07.493303    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/63b287e5-9291-47b5-9033-e117583a4ad7-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a5xhx5\" (UID: \"63b287e5-9291-47b5-9033-e117583a4ad7\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a5xhx5"
Oct 31 17:30:07.493663 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:07.493624    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/63b287e5-9291-47b5-9033-e117583a4ad7-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a5xhx5\" (UID: \"63b287e5-9291-47b5-9033-e117583a4ad7\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a5xhx5"
Oct 31 17:30:07.493713 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:07.493629    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/63b287e5-9291-47b5-9033-e117583a4ad7-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a5xhx5\" (UID: \"63b287e5-9291-47b5-9033-e117583a4ad7\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a5xhx5"
Oct 31 17:30:07.496699 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:07.496678    5003 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6fnjm6"]
Oct 31 17:30:07.500162 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:07.500145    5003 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6fnjm6"
Oct 31 17:30:07.514078 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:07.514050    5003 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3-b83c8cba-dockercfg-xlfdv\""
Oct 31 17:30:07.515523 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:07.515496    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7qzdk\" (UniqueName: \"kubernetes.io/projected/63b287e5-9291-47b5-9033-e117583a4ad7-kube-api-access-7qzdk\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a5xhx5\" (UID: \"63b287e5-9291-47b5-9033-e117583a4ad7\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a5xhx5"
Oct 31 17:30:07.519051 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:07.519030    5003 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6fnjm6"]
Oct 31 17:30:07.594309 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:07.594280    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7f8b7ebd-2dc8-4664-afab-de39e221af75-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c88jw2\" (UID: \"7f8b7ebd-2dc8-4664-afab-de39e221af75\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c88jw2"
Oct 31 17:30:07.594485 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:07.594320    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zbplm\" (UniqueName: \"kubernetes.io/projected/de955af9-a688-4c00-afd3-46504ed014b8-kube-api-access-zbplm\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6fnjm6\" (UID: \"de955af9-a688-4c00-afd3-46504ed014b8\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6fnjm6"
Oct 31 17:30:07.594485 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:07.594346    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/de955af9-a688-4c00-afd3-46504ed014b8-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6fnjm6\" (UID: \"de955af9-a688-4c00-afd3-46504ed014b8\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6fnjm6"
Oct 31 17:30:07.594485 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:07.594440    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sd4cq\" (UniqueName: \"kubernetes.io/projected/7f8b7ebd-2dc8-4664-afab-de39e221af75-kube-api-access-sd4cq\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c88jw2\" (UID: \"7f8b7ebd-2dc8-4664-afab-de39e221af75\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c88jw2"
Oct 31 17:30:07.594485 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:07.594465    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/de955af9-a688-4c00-afd3-46504ed014b8-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6fnjm6\" (UID: \"de955af9-a688-4c00-afd3-46504ed014b8\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6fnjm6"
Oct 31 17:30:07.594661 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:07.594488    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7f8b7ebd-2dc8-4664-afab-de39e221af75-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c88jw2\" (UID: \"7f8b7ebd-2dc8-4664-afab-de39e221af75\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c88jw2"
Oct 31 17:30:07.594704 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:07.594679    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7f8b7ebd-2dc8-4664-afab-de39e221af75-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c88jw2\" (UID: \"7f8b7ebd-2dc8-4664-afab-de39e221af75\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c88jw2"
Oct 31 17:30:07.594791 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:07.594774    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7f8b7ebd-2dc8-4664-afab-de39e221af75-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c88jw2\" (UID: \"7f8b7ebd-2dc8-4664-afab-de39e221af75\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c88jw2"
Oct 31 17:30:07.603465 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:07.603441    5003 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7xv9kb"]
Oct 31 17:30:07.606986 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:07.606969    5003 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7xv9kb"
Oct 31 17:30:07.612561 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:07.612542    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sd4cq\" (UniqueName: \"kubernetes.io/projected/7f8b7ebd-2dc8-4664-afab-de39e221af75-kube-api-access-sd4cq\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c88jw2\" (UID: \"7f8b7ebd-2dc8-4664-afab-de39e221af75\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c88jw2"
Oct 31 17:30:07.620253 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:07.620235    5003 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a5xhx5"
Oct 31 17:30:07.621224 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:07.621202    5003 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"da112bd609bff87f7bacd2ba941225d7cff15c-bd73b2fc-dockercfg-7wx69\""
Oct 31 17:30:07.625411 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:07.625357    5003 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7xv9kb"]
Oct 31 17:30:07.695768 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:07.695728    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m4nf4\" (UniqueName: \"kubernetes.io/projected/b13c5afb-a308-498c-99a5-903018a493a1-kube-api-access-m4nf4\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7xv9kb\" (UID: \"b13c5afb-a308-498c-99a5-903018a493a1\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7xv9kb"
Oct 31 17:30:07.695920 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:07.695810    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/de955af9-a688-4c00-afd3-46504ed014b8-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6fnjm6\" (UID: \"de955af9-a688-4c00-afd3-46504ed014b8\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6fnjm6"
Oct 31 17:30:07.695920 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:07.695836    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b13c5afb-a308-498c-99a5-903018a493a1-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7xv9kb\" (UID: \"b13c5afb-a308-498c-99a5-903018a493a1\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7xv9kb"
Oct 31 17:30:07.695920 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:07.695862    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b13c5afb-a308-498c-99a5-903018a493a1-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7xv9kb\" (UID: \"b13c5afb-a308-498c-99a5-903018a493a1\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7xv9kb"
Oct 31 17:30:07.695920 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:07.695909    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zbplm\" (UniqueName: \"kubernetes.io/projected/de955af9-a688-4c00-afd3-46504ed014b8-kube-api-access-zbplm\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6fnjm6\" (UID: \"de955af9-a688-4c00-afd3-46504ed014b8\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6fnjm6"
Oct 31 17:30:07.696077 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:07.696063    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/de955af9-a688-4c00-afd3-46504ed014b8-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6fnjm6\" (UID: \"de955af9-a688-4c00-afd3-46504ed014b8\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6fnjm6"
Oct 31 17:30:07.696168 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:07.696146    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/de955af9-a688-4c00-afd3-46504ed014b8-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6fnjm6\" (UID: \"de955af9-a688-4c00-afd3-46504ed014b8\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6fnjm6"
Oct 31 17:30:07.696392 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:07.696371    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/de955af9-a688-4c00-afd3-46504ed014b8-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6fnjm6\" (UID: \"de955af9-a688-4c00-afd3-46504ed014b8\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6fnjm6"
Oct 31 17:30:07.714194 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:07.714166    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zbplm\" (UniqueName: \"kubernetes.io/projected/de955af9-a688-4c00-afd3-46504ed014b8-kube-api-access-zbplm\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6fnjm6\" (UID: \"de955af9-a688-4c00-afd3-46504ed014b8\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6fnjm6"
Oct 31 17:30:07.718985 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:07.718964    5003 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c88jw2"
Oct 31 17:30:07.797513 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:07.797472    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m4nf4\" (UniqueName: \"kubernetes.io/projected/b13c5afb-a308-498c-99a5-903018a493a1-kube-api-access-m4nf4\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7xv9kb\" (UID: \"b13c5afb-a308-498c-99a5-903018a493a1\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7xv9kb"
Oct 31 17:30:07.797679 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:07.797528    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b13c5afb-a308-498c-99a5-903018a493a1-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7xv9kb\" (UID: \"b13c5afb-a308-498c-99a5-903018a493a1\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7xv9kb"
Oct 31 17:30:07.797679 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:07.797568    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b13c5afb-a308-498c-99a5-903018a493a1-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7xv9kb\" (UID: \"b13c5afb-a308-498c-99a5-903018a493a1\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7xv9kb"
Oct 31 17:30:07.798013 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:07.797992    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b13c5afb-a308-498c-99a5-903018a493a1-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7xv9kb\" (UID: \"b13c5afb-a308-498c-99a5-903018a493a1\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7xv9kb"
Oct 31 17:30:07.798049 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:07.797994    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b13c5afb-a308-498c-99a5-903018a493a1-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7xv9kb\" (UID: \"b13c5afb-a308-498c-99a5-903018a493a1\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7xv9kb"
Oct 31 17:30:07.815433 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:07.815408    5003 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6fnjm6"
Oct 31 17:30:07.816290 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:07.816270    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m4nf4\" (UniqueName: \"kubernetes.io/projected/b13c5afb-a308-498c-99a5-903018a493a1-kube-api-access-m4nf4\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7xv9kb\" (UID: \"b13c5afb-a308-498c-99a5-903018a493a1\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7xv9kb"
Oct 31 17:30:07.916578 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:07.916541    5003 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a5xhx5"]
Oct 31 17:30:07.921262 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:30:07.921235    5003 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod63b287e5_9291_47b5_9033_e117583a4ad7.slice/crio-dfd9b011e10e67cbdec9723494a228782a3e0bda3cb8002663f322320dc2068d WatchSource:0}: Error finding container dfd9b011e10e67cbdec9723494a228782a3e0bda3cb8002663f322320dc2068d: Status 404 returned error can't find the container with id dfd9b011e10e67cbdec9723494a228782a3e0bda3cb8002663f322320dc2068d
Oct 31 17:30:07.933788 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:07.933766    5003 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7xv9kb"
Oct 31 17:30:08.009712 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:08.009676    5003 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c88jw2"]
Oct 31 17:30:08.015549 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:30:08.015516    5003 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7f8b7ebd_2dc8_4664_afab_de39e221af75.slice/crio-833723c0755014ba09c525bb5dd889f1a5460fb9a0c10ecfc88aad9b874e1477 WatchSource:0}: Error finding container 833723c0755014ba09c525bb5dd889f1a5460fb9a0c10ecfc88aad9b874e1477: Status 404 returned error can't find the container with id 833723c0755014ba09c525bb5dd889f1a5460fb9a0c10ecfc88aad9b874e1477
Oct 31 17:30:08.106072 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:08.106014    5003 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6fnjm6"]
Oct 31 17:30:08.111063 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:30:08.111034    5003 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podde955af9_a688_4c00_afd3_46504ed014b8.slice/crio-64c1a7f20fe1898e6f9bbfbe68aaf57cfc1f7e200b8eff4016a1f8131e7963e2 WatchSource:0}: Error finding container 64c1a7f20fe1898e6f9bbfbe68aaf57cfc1f7e200b8eff4016a1f8131e7963e2: Status 404 returned error can't find the container with id 64c1a7f20fe1898e6f9bbfbe68aaf57cfc1f7e200b8eff4016a1f8131e7963e2
Oct 31 17:30:08.225361 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:08.225327    5003 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7xv9kb"]
Oct 31 17:30:08.230629 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:30:08.230594    5003 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb13c5afb_a308_498c_99a5_903018a493a1.slice/crio-7db32a99109b1408809464ebd337fa856061c66a937e905c301e6e95b2ef82f2 WatchSource:0}: Error finding container 7db32a99109b1408809464ebd337fa856061c66a937e905c301e6e95b2ef82f2: Status 404 returned error can't find the container with id 7db32a99109b1408809464ebd337fa856061c66a937e905c301e6e95b2ef82f2
Oct 31 17:30:08.463315 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:08.463117    5003 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71x7z4q"]
Oct 31 17:30:08.467445 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:08.467410    5003 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71x7z4q"
Oct 31 17:30:08.484228 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:08.484185    5003 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"e644421527c169d876fdb59235c927986d6bd2-9d2815fc-dockercfg-dvj89\""
Oct 31 17:30:08.487769 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:08.487723    5003 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71x7z4q"]
Oct 31 17:30:08.510895 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:08.510851    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ce0297c8-60bd-4318-ace1-48c28d7b2fc1-util\") pod \"e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71x7z4q\" (UID: \"ce0297c8-60bd-4318-ace1-48c28d7b2fc1\") " pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71x7z4q"
Oct 31 17:30:08.511094 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:08.510921    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gmmk5\" (UniqueName: \"kubernetes.io/projected/ce0297c8-60bd-4318-ace1-48c28d7b2fc1-kube-api-access-gmmk5\") pod \"e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71x7z4q\" (UID: \"ce0297c8-60bd-4318-ace1-48c28d7b2fc1\") " pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71x7z4q"
Oct 31 17:30:08.511094 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:08.511031    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ce0297c8-60bd-4318-ace1-48c28d7b2fc1-bundle\") pod \"e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71x7z4q\" (UID: \"ce0297c8-60bd-4318-ace1-48c28d7b2fc1\") " pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71x7z4q"
Oct 31 17:30:08.611716 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:08.611676    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ce0297c8-60bd-4318-ace1-48c28d7b2fc1-util\") pod \"e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71x7z4q\" (UID: \"ce0297c8-60bd-4318-ace1-48c28d7b2fc1\") " pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71x7z4q"
Oct 31 17:30:08.611897 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:08.611744    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gmmk5\" (UniqueName: \"kubernetes.io/projected/ce0297c8-60bd-4318-ace1-48c28d7b2fc1-kube-api-access-gmmk5\") pod \"e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71x7z4q\" (UID: \"ce0297c8-60bd-4318-ace1-48c28d7b2fc1\") " pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71x7z4q"
Oct 31 17:30:08.611897 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:08.611794    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ce0297c8-60bd-4318-ace1-48c28d7b2fc1-bundle\") pod \"e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71x7z4q\" (UID: \"ce0297c8-60bd-4318-ace1-48c28d7b2fc1\") " pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71x7z4q"
Oct 31 17:30:08.612254 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:08.612230    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ce0297c8-60bd-4318-ace1-48c28d7b2fc1-bundle\") pod \"e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71x7z4q\" (UID: \"ce0297c8-60bd-4318-ace1-48c28d7b2fc1\") " pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71x7z4q"
Oct 31 17:30:08.612506 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:08.612485    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ce0297c8-60bd-4318-ace1-48c28d7b2fc1-util\") pod \"e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71x7z4q\" (UID: \"ce0297c8-60bd-4318-ace1-48c28d7b2fc1\") " pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71x7z4q"
Oct 31 17:30:08.632499 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:08.632471    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gmmk5\" (UniqueName: \"kubernetes.io/projected/ce0297c8-60bd-4318-ace1-48c28d7b2fc1-kube-api-access-gmmk5\") pod \"e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71x7z4q\" (UID: \"ce0297c8-60bd-4318-ace1-48c28d7b2fc1\") " pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71x7z4q"
Oct 31 17:30:08.693484 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:08.693411    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a5xhx5" event={"ID":"63b287e5-9291-47b5-9033-e117583a4ad7","Type":"ContainerStarted","Data":"dfd9b011e10e67cbdec9723494a228782a3e0bda3cb8002663f322320dc2068d"}
Oct 31 17:30:08.695305 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:08.695277    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7xv9kb" event={"ID":"b13c5afb-a308-498c-99a5-903018a493a1","Type":"ContainerStarted","Data":"7db32a99109b1408809464ebd337fa856061c66a937e905c301e6e95b2ef82f2"}
Oct 31 17:30:08.696761 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:08.696730    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6fnjm6" event={"ID":"de955af9-a688-4c00-afd3-46504ed014b8","Type":"ContainerStarted","Data":"64c1a7f20fe1898e6f9bbfbe68aaf57cfc1f7e200b8eff4016a1f8131e7963e2"}
Oct 31 17:30:08.699400 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:08.699373    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c88jw2" event={"ID":"7f8b7ebd-2dc8-4664-afab-de39e221af75","Type":"ContainerStarted","Data":"833723c0755014ba09c525bb5dd889f1a5460fb9a0c10ecfc88aad9b874e1477"}
Oct 31 17:30:08.790615 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:08.790527    5003 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71x7z4q"
Oct 31 17:30:09.105094 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:09.105058    5003 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71x7z4q"]
Oct 31 17:30:09.122139 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:30:09.122097    5003 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podce0297c8_60bd_4318_ace1_48c28d7b2fc1.slice/crio-f97f8937185e15db5bf8c02f69bb4c860085bde606dd4b20227cc921db0f6bd4 WatchSource:0}: Error finding container f97f8937185e15db5bf8c02f69bb4c860085bde606dd4b20227cc921db0f6bd4: Status 404 returned error can't find the container with id f97f8937185e15db5bf8c02f69bb4c860085bde606dd4b20227cc921db0f6bd4
Oct 31 17:30:09.709052 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:09.708974    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71x7z4q" event={"ID":"ce0297c8-60bd-4318-ace1-48c28d7b2fc1","Type":"ContainerStarted","Data":"f97f8937185e15db5bf8c02f69bb4c860085bde606dd4b20227cc921db0f6bd4"}
Oct 31 17:30:09.792975 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:09.792940    5003 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cxq428"]
Oct 31 17:30:09.797111 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:09.797072    5003 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cxq428"
Oct 31 17:30:09.822131 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:09.822016    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cad20c98-5623-459c-9633-35de91881dc9-bundle\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cxq428\" (UID: \"cad20c98-5623-459c-9633-35de91881dc9\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cxq428"
Oct 31 17:30:09.822131 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:09.822058    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j2rhg\" (UniqueName: \"kubernetes.io/projected/cad20c98-5623-459c-9633-35de91881dc9-kube-api-access-j2rhg\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cxq428\" (UID: \"cad20c98-5623-459c-9633-35de91881dc9\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cxq428"
Oct 31 17:30:09.822131 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:09.822084    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cad20c98-5623-459c-9633-35de91881dc9-util\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cxq428\" (UID: \"cad20c98-5623-459c-9633-35de91881dc9\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cxq428"
Oct 31 17:30:09.830339 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:09.826248    5003 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"c7537007944577f64df34960ace3c69136c416-139ec370-dockercfg-gntkd\""
Oct 31 17:30:09.830339 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:09.827065    5003 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cxq428"]
Oct 31 17:30:09.922579 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:09.922534    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j2rhg\" (UniqueName: \"kubernetes.io/projected/cad20c98-5623-459c-9633-35de91881dc9-kube-api-access-j2rhg\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cxq428\" (UID: \"cad20c98-5623-459c-9633-35de91881dc9\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cxq428"
Oct 31 17:30:09.922766 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:09.922599    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cad20c98-5623-459c-9633-35de91881dc9-util\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cxq428\" (UID: \"cad20c98-5623-459c-9633-35de91881dc9\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cxq428"
Oct 31 17:30:09.922766 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:09.922715    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cad20c98-5623-459c-9633-35de91881dc9-bundle\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cxq428\" (UID: \"cad20c98-5623-459c-9633-35de91881dc9\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cxq428"
Oct 31 17:30:09.923159 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:09.923137    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cad20c98-5623-459c-9633-35de91881dc9-bundle\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cxq428\" (UID: \"cad20c98-5623-459c-9633-35de91881dc9\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cxq428"
Oct 31 17:30:09.923761 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:09.923739    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cad20c98-5623-459c-9633-35de91881dc9-util\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cxq428\" (UID: \"cad20c98-5623-459c-9633-35de91881dc9\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cxq428"
Oct 31 17:30:09.942556 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:09.942526    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j2rhg\" (UniqueName: \"kubernetes.io/projected/cad20c98-5623-459c-9633-35de91881dc9-kube-api-access-j2rhg\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cxq428\" (UID: \"cad20c98-5623-459c-9633-35de91881dc9\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cxq428"
Oct 31 17:30:10.125693 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:10.125660    5003 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cxq428"
Oct 31 17:30:10.356312 ip-10-0-138-17 kubenswrapper[5003]: E1031 17:30:10.356268    5003 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-tdzz5" containerName="extractor"
Oct 31 17:30:10.452669 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:10.452564    5003 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cxq428"]
Oct 31 17:30:10.461734 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:30:10.461243    5003 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcad20c98_5623_459c_9633_35de91881dc9.slice/crio-e13a7285f22788df30316db69691b599f0ab19098a8b87c15fee2308f1cc2215 WatchSource:0}: Error finding container e13a7285f22788df30316db69691b599f0ab19098a8b87c15fee2308f1cc2215: Status 404 returned error can't find the container with id e13a7285f22788df30316db69691b599f0ab19098a8b87c15fee2308f1cc2215
Oct 31 17:30:10.717620 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:10.717535    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cxq428" event={"ID":"cad20c98-5623-459c-9633-35de91881dc9","Type":"ContainerStarted","Data":"e13a7285f22788df30316db69691b599f0ab19098a8b87c15fee2308f1cc2215"}
Oct 31 17:30:11.483915 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:11.483874    5003 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-7smk2"]
Oct 31 17:30:11.488268 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:11.488242    5003 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-7smk2"
Oct 31 17:30:11.506499 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:11.506451    5003 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Oct 31 17:30:11.520301 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:11.518994    5003 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-7smk2"]
Oct 31 17:30:11.520301 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:11.519275    5003 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-9kmpm\""
Oct 31 17:30:11.538755 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:11.538716    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/effd3895-446f-4877-8218-6414ce2e321b-workload-socket\") pod \"maas-default-gateway-openshift-default-7d9897b54c-7smk2\" (UID: \"effd3895-446f-4877-8218-6414ce2e321b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-7smk2"
Oct 31 17:30:11.538938 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:11.538779    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/effd3895-446f-4877-8218-6414ce2e321b-credential-socket\") pod \"maas-default-gateway-openshift-default-7d9897b54c-7smk2\" (UID: \"effd3895-446f-4877-8218-6414ce2e321b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-7smk2"
Oct 31 17:30:11.538938 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:11.538810    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/effd3895-446f-4877-8218-6414ce2e321b-istio-envoy\") pod \"maas-default-gateway-openshift-default-7d9897b54c-7smk2\" (UID: \"effd3895-446f-4877-8218-6414ce2e321b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-7smk2"
Oct 31 17:30:11.538938 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:11.538840    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/effd3895-446f-4877-8218-6414ce2e321b-istio-token\") pod \"maas-default-gateway-openshift-default-7d9897b54c-7smk2\" (UID: \"effd3895-446f-4877-8218-6414ce2e321b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-7smk2"
Oct 31 17:30:11.538938 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:11.538864    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jpvvx\" (UniqueName: \"kubernetes.io/projected/effd3895-446f-4877-8218-6414ce2e321b-kube-api-access-jpvvx\") pod \"maas-default-gateway-openshift-default-7d9897b54c-7smk2\" (UID: \"effd3895-446f-4877-8218-6414ce2e321b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-7smk2"
Oct 31 17:30:11.538938 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:11.538898    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/effd3895-446f-4877-8218-6414ce2e321b-workload-certs\") pod \"maas-default-gateway-openshift-default-7d9897b54c-7smk2\" (UID: \"effd3895-446f-4877-8218-6414ce2e321b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-7smk2"
Oct 31 17:30:11.539124 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:11.538949    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/effd3895-446f-4877-8218-6414ce2e321b-istio-data\") pod \"maas-default-gateway-openshift-default-7d9897b54c-7smk2\" (UID: \"effd3895-446f-4877-8218-6414ce2e321b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-7smk2"
Oct 31 17:30:11.539124 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:11.538973    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/effd3895-446f-4877-8218-6414ce2e321b-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-7d9897b54c-7smk2\" (UID: \"effd3895-446f-4877-8218-6414ce2e321b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-7smk2"
Oct 31 17:30:11.539124 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:11.539014    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/effd3895-446f-4877-8218-6414ce2e321b-istio-podinfo\") pod \"maas-default-gateway-openshift-default-7d9897b54c-7smk2\" (UID: \"effd3895-446f-4877-8218-6414ce2e321b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-7smk2"
Oct 31 17:30:11.628098 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:11.628064    5003 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/openshift-ai-inference-openshift-ai-inference-6dd6bfb767-t8zg4"]
Oct 31 17:30:11.631912 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:11.631883    5003 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-6dd6bfb767-t8zg4"
Oct 31 17:30:11.644665 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:11.643809    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/effd3895-446f-4877-8218-6414ce2e321b-workload-socket\") pod \"maas-default-gateway-openshift-default-7d9897b54c-7smk2\" (UID: \"effd3895-446f-4877-8218-6414ce2e321b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-7smk2"
Oct 31 17:30:11.644665 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:11.643879    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/effd3895-446f-4877-8218-6414ce2e321b-credential-socket\") pod \"maas-default-gateway-openshift-default-7d9897b54c-7smk2\" (UID: \"effd3895-446f-4877-8218-6414ce2e321b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-7smk2"
Oct 31 17:30:11.644665 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:11.643911    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/effd3895-446f-4877-8218-6414ce2e321b-istio-envoy\") pod \"maas-default-gateway-openshift-default-7d9897b54c-7smk2\" (UID: \"effd3895-446f-4877-8218-6414ce2e321b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-7smk2"
Oct 31 17:30:11.644665 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:11.643941    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/effd3895-446f-4877-8218-6414ce2e321b-istio-token\") pod \"maas-default-gateway-openshift-default-7d9897b54c-7smk2\" (UID: \"effd3895-446f-4877-8218-6414ce2e321b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-7smk2"
Oct 31 17:30:11.644665 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:11.643967    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jpvvx\" (UniqueName: \"kubernetes.io/projected/effd3895-446f-4877-8218-6414ce2e321b-kube-api-access-jpvvx\") pod \"maas-default-gateway-openshift-default-7d9897b54c-7smk2\" (UID: \"effd3895-446f-4877-8218-6414ce2e321b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-7smk2"
Oct 31 17:30:11.644665 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:11.644008    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/effd3895-446f-4877-8218-6414ce2e321b-workload-certs\") pod \"maas-default-gateway-openshift-default-7d9897b54c-7smk2\" (UID: \"effd3895-446f-4877-8218-6414ce2e321b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-7smk2"
Oct 31 17:30:11.644665 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:11.644066    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/effd3895-446f-4877-8218-6414ce2e321b-istio-data\") pod \"maas-default-gateway-openshift-default-7d9897b54c-7smk2\" (UID: \"effd3895-446f-4877-8218-6414ce2e321b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-7smk2"
Oct 31 17:30:11.644665 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:11.644092    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/effd3895-446f-4877-8218-6414ce2e321b-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-7d9897b54c-7smk2\" (UID: \"effd3895-446f-4877-8218-6414ce2e321b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-7smk2"
Oct 31 17:30:11.644665 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:11.644136    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/effd3895-446f-4877-8218-6414ce2e321b-istio-podinfo\") pod \"maas-default-gateway-openshift-default-7d9897b54c-7smk2\" (UID: \"effd3895-446f-4877-8218-6414ce2e321b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-7smk2"
Oct 31 17:30:11.644665 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:11.644335    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/effd3895-446f-4877-8218-6414ce2e321b-workload-socket\") pod \"maas-default-gateway-openshift-default-7d9897b54c-7smk2\" (UID: \"effd3895-446f-4877-8218-6414ce2e321b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-7smk2"
Oct 31 17:30:11.646288 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:11.646258    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/effd3895-446f-4877-8218-6414ce2e321b-credential-socket\") pod \"maas-default-gateway-openshift-default-7d9897b54c-7smk2\" (UID: \"effd3895-446f-4877-8218-6414ce2e321b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-7smk2"
Oct 31 17:30:11.648054 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:11.647751    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/effd3895-446f-4877-8218-6414ce2e321b-istio-data\") pod \"maas-default-gateway-openshift-default-7d9897b54c-7smk2\" (UID: \"effd3895-446f-4877-8218-6414ce2e321b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-7smk2"
Oct 31 17:30:11.648054 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:11.648018    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/effd3895-446f-4877-8218-6414ce2e321b-workload-certs\") pod \"maas-default-gateway-openshift-default-7d9897b54c-7smk2\" (UID: \"effd3895-446f-4877-8218-6414ce2e321b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-7smk2"
Oct 31 17:30:11.648477 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:11.648431    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/effd3895-446f-4877-8218-6414ce2e321b-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-7d9897b54c-7smk2\" (UID: \"effd3895-446f-4877-8218-6414ce2e321b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-7smk2"
Oct 31 17:30:11.649458 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:11.649432    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/effd3895-446f-4877-8218-6414ce2e321b-istio-podinfo\") pod \"maas-default-gateway-openshift-default-7d9897b54c-7smk2\" (UID: \"effd3895-446f-4877-8218-6414ce2e321b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-7smk2"
Oct 31 17:30:11.651880 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:11.651213    5003 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"openshift-ai-inference-openshift-ai-inference-dockercfg-nctf7\""
Oct 31 17:30:11.659038 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:11.658952    5003 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/openshift-ai-inference-openshift-ai-inference-6dd6bfb767-t8zg4"]
Oct 31 17:30:11.662091 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:11.661956    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/effd3895-446f-4877-8218-6414ce2e321b-istio-envoy\") pod \"maas-default-gateway-openshift-default-7d9897b54c-7smk2\" (UID: \"effd3895-446f-4877-8218-6414ce2e321b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-7smk2"
Oct 31 17:30:11.673304 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:11.673244    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jpvvx\" (UniqueName: \"kubernetes.io/projected/effd3895-446f-4877-8218-6414ce2e321b-kube-api-access-jpvvx\") pod \"maas-default-gateway-openshift-default-7d9897b54c-7smk2\" (UID: \"effd3895-446f-4877-8218-6414ce2e321b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-7smk2"
Oct 31 17:30:11.686878 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:11.686811    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/effd3895-446f-4877-8218-6414ce2e321b-istio-token\") pod \"maas-default-gateway-openshift-default-7d9897b54c-7smk2\" (UID: \"effd3895-446f-4877-8218-6414ce2e321b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-7smk2"
Oct 31 17:30:11.746013 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:11.745924    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9d187bce-1d54-4dd5-b7d3-ee25ca1057f7-istio-data\") pod \"openshift-ai-inference-openshift-ai-inference-6dd6bfb767-t8zg4\" (UID: \"9d187bce-1d54-4dd5-b7d3-ee25ca1057f7\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-6dd6bfb767-t8zg4"
Oct 31 17:30:11.746013 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:11.745982    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9d187bce-1d54-4dd5-b7d3-ee25ca1057f7-workload-socket\") pod \"openshift-ai-inference-openshift-ai-inference-6dd6bfb767-t8zg4\" (UID: \"9d187bce-1d54-4dd5-b7d3-ee25ca1057f7\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-6dd6bfb767-t8zg4"
Oct 31 17:30:11.746538 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:11.746097    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9d187bce-1d54-4dd5-b7d3-ee25ca1057f7-istiod-ca-cert\") pod \"openshift-ai-inference-openshift-ai-inference-6dd6bfb767-t8zg4\" (UID: \"9d187bce-1d54-4dd5-b7d3-ee25ca1057f7\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-6dd6bfb767-t8zg4"
Oct 31 17:30:11.746538 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:11.746157    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9d187bce-1d54-4dd5-b7d3-ee25ca1057f7-istio-podinfo\") pod \"openshift-ai-inference-openshift-ai-inference-6dd6bfb767-t8zg4\" (UID: \"9d187bce-1d54-4dd5-b7d3-ee25ca1057f7\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-6dd6bfb767-t8zg4"
Oct 31 17:30:11.746538 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:11.746197    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9d187bce-1d54-4dd5-b7d3-ee25ca1057f7-istio-token\") pod \"openshift-ai-inference-openshift-ai-inference-6dd6bfb767-t8zg4\" (UID: \"9d187bce-1d54-4dd5-b7d3-ee25ca1057f7\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-6dd6bfb767-t8zg4"
Oct 31 17:30:11.746538 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:11.746237    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9d187bce-1d54-4dd5-b7d3-ee25ca1057f7-istio-envoy\") pod \"openshift-ai-inference-openshift-ai-inference-6dd6bfb767-t8zg4\" (UID: \"9d187bce-1d54-4dd5-b7d3-ee25ca1057f7\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-6dd6bfb767-t8zg4"
Oct 31 17:30:11.746538 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:11.746278    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9d187bce-1d54-4dd5-b7d3-ee25ca1057f7-credential-socket\") pod \"openshift-ai-inference-openshift-ai-inference-6dd6bfb767-t8zg4\" (UID: \"9d187bce-1d54-4dd5-b7d3-ee25ca1057f7\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-6dd6bfb767-t8zg4"
Oct 31 17:30:11.746538 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:11.746316    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jx4sv\" (UniqueName: \"kubernetes.io/projected/9d187bce-1d54-4dd5-b7d3-ee25ca1057f7-kube-api-access-jx4sv\") pod \"openshift-ai-inference-openshift-ai-inference-6dd6bfb767-t8zg4\" (UID: \"9d187bce-1d54-4dd5-b7d3-ee25ca1057f7\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-6dd6bfb767-t8zg4"
Oct 31 17:30:11.746538 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:11.746360    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9d187bce-1d54-4dd5-b7d3-ee25ca1057f7-workload-certs\") pod \"openshift-ai-inference-openshift-ai-inference-6dd6bfb767-t8zg4\" (UID: \"9d187bce-1d54-4dd5-b7d3-ee25ca1057f7\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-6dd6bfb767-t8zg4"
Oct 31 17:30:11.814036 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:11.813708    5003 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-7smk2"
Oct 31 17:30:11.852942 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:11.850592    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9d187bce-1d54-4dd5-b7d3-ee25ca1057f7-istiod-ca-cert\") pod \"openshift-ai-inference-openshift-ai-inference-6dd6bfb767-t8zg4\" (UID: \"9d187bce-1d54-4dd5-b7d3-ee25ca1057f7\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-6dd6bfb767-t8zg4"
Oct 31 17:30:11.852942 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:11.850665    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9d187bce-1d54-4dd5-b7d3-ee25ca1057f7-istio-podinfo\") pod \"openshift-ai-inference-openshift-ai-inference-6dd6bfb767-t8zg4\" (UID: \"9d187bce-1d54-4dd5-b7d3-ee25ca1057f7\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-6dd6bfb767-t8zg4"
Oct 31 17:30:11.852942 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:11.850700    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9d187bce-1d54-4dd5-b7d3-ee25ca1057f7-istio-token\") pod \"openshift-ai-inference-openshift-ai-inference-6dd6bfb767-t8zg4\" (UID: \"9d187bce-1d54-4dd5-b7d3-ee25ca1057f7\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-6dd6bfb767-t8zg4"
Oct 31 17:30:11.852942 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:11.850732    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9d187bce-1d54-4dd5-b7d3-ee25ca1057f7-istio-envoy\") pod \"openshift-ai-inference-openshift-ai-inference-6dd6bfb767-t8zg4\" (UID: \"9d187bce-1d54-4dd5-b7d3-ee25ca1057f7\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-6dd6bfb767-t8zg4"
Oct 31 17:30:11.852942 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:11.850769    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9d187bce-1d54-4dd5-b7d3-ee25ca1057f7-credential-socket\") pod \"openshift-ai-inference-openshift-ai-inference-6dd6bfb767-t8zg4\" (UID: \"9d187bce-1d54-4dd5-b7d3-ee25ca1057f7\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-6dd6bfb767-t8zg4"
Oct 31 17:30:11.852942 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:11.850801    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jx4sv\" (UniqueName: \"kubernetes.io/projected/9d187bce-1d54-4dd5-b7d3-ee25ca1057f7-kube-api-access-jx4sv\") pod \"openshift-ai-inference-openshift-ai-inference-6dd6bfb767-t8zg4\" (UID: \"9d187bce-1d54-4dd5-b7d3-ee25ca1057f7\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-6dd6bfb767-t8zg4"
Oct 31 17:30:11.852942 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:11.850843    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9d187bce-1d54-4dd5-b7d3-ee25ca1057f7-workload-certs\") pod \"openshift-ai-inference-openshift-ai-inference-6dd6bfb767-t8zg4\" (UID: \"9d187bce-1d54-4dd5-b7d3-ee25ca1057f7\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-6dd6bfb767-t8zg4"
Oct 31 17:30:11.852942 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:11.850891    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9d187bce-1d54-4dd5-b7d3-ee25ca1057f7-istio-data\") pod \"openshift-ai-inference-openshift-ai-inference-6dd6bfb767-t8zg4\" (UID: \"9d187bce-1d54-4dd5-b7d3-ee25ca1057f7\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-6dd6bfb767-t8zg4"
Oct 31 17:30:11.852942 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:11.850916    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9d187bce-1d54-4dd5-b7d3-ee25ca1057f7-workload-socket\") pod \"openshift-ai-inference-openshift-ai-inference-6dd6bfb767-t8zg4\" (UID: \"9d187bce-1d54-4dd5-b7d3-ee25ca1057f7\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-6dd6bfb767-t8zg4"
Oct 31 17:30:11.852942 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:11.851327    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9d187bce-1d54-4dd5-b7d3-ee25ca1057f7-workload-socket\") pod \"openshift-ai-inference-openshift-ai-inference-6dd6bfb767-t8zg4\" (UID: \"9d187bce-1d54-4dd5-b7d3-ee25ca1057f7\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-6dd6bfb767-t8zg4"
Oct 31 17:30:11.852942 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:11.851981    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9d187bce-1d54-4dd5-b7d3-ee25ca1057f7-istiod-ca-cert\") pod \"openshift-ai-inference-openshift-ai-inference-6dd6bfb767-t8zg4\" (UID: \"9d187bce-1d54-4dd5-b7d3-ee25ca1057f7\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-6dd6bfb767-t8zg4"
Oct 31 17:30:11.852942 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:11.852664    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9d187bce-1d54-4dd5-b7d3-ee25ca1057f7-credential-socket\") pod \"openshift-ai-inference-openshift-ai-inference-6dd6bfb767-t8zg4\" (UID: \"9d187bce-1d54-4dd5-b7d3-ee25ca1057f7\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-6dd6bfb767-t8zg4"
Oct 31 17:30:11.852942 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:11.852711    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9d187bce-1d54-4dd5-b7d3-ee25ca1057f7-istio-data\") pod \"openshift-ai-inference-openshift-ai-inference-6dd6bfb767-t8zg4\" (UID: \"9d187bce-1d54-4dd5-b7d3-ee25ca1057f7\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-6dd6bfb767-t8zg4"
Oct 31 17:30:11.852942 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:11.852790    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9d187bce-1d54-4dd5-b7d3-ee25ca1057f7-workload-certs\") pod \"openshift-ai-inference-openshift-ai-inference-6dd6bfb767-t8zg4\" (UID: \"9d187bce-1d54-4dd5-b7d3-ee25ca1057f7\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-6dd6bfb767-t8zg4"
Oct 31 17:30:11.856474 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:11.856418    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9d187bce-1d54-4dd5-b7d3-ee25ca1057f7-istio-envoy\") pod \"openshift-ai-inference-openshift-ai-inference-6dd6bfb767-t8zg4\" (UID: \"9d187bce-1d54-4dd5-b7d3-ee25ca1057f7\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-6dd6bfb767-t8zg4"
Oct 31 17:30:11.859040 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:11.858962    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9d187bce-1d54-4dd5-b7d3-ee25ca1057f7-istio-podinfo\") pod \"openshift-ai-inference-openshift-ai-inference-6dd6bfb767-t8zg4\" (UID: \"9d187bce-1d54-4dd5-b7d3-ee25ca1057f7\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-6dd6bfb767-t8zg4"
Oct 31 17:30:11.873498 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:11.873352    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9d187bce-1d54-4dd5-b7d3-ee25ca1057f7-istio-token\") pod \"openshift-ai-inference-openshift-ai-inference-6dd6bfb767-t8zg4\" (UID: \"9d187bce-1d54-4dd5-b7d3-ee25ca1057f7\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-6dd6bfb767-t8zg4"
Oct 31 17:30:11.877294 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:11.876911    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jx4sv\" (UniqueName: \"kubernetes.io/projected/9d187bce-1d54-4dd5-b7d3-ee25ca1057f7-kube-api-access-jx4sv\") pod \"openshift-ai-inference-openshift-ai-inference-6dd6bfb767-t8zg4\" (UID: \"9d187bce-1d54-4dd5-b7d3-ee25ca1057f7\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-6dd6bfb767-t8zg4"
Oct 31 17:30:11.971148 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:11.971101    5003 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"openshift-ai-inference-openshift-ai-inference-dockercfg-nctf7\""
Oct 31 17:30:11.977906 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:11.977874    5003 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-6dd6bfb767-t8zg4"
Oct 31 17:30:12.155322 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:12.155287    5003 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-7smk2"]
Oct 31 17:30:12.160292 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:30:12.160250    5003 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeffd3895_446f_4877_8218_6414ce2e321b.slice/crio-ad439d807b4eb6dc7e09fba0e70ee78e3bb3efe849bf2c4dabb316209dfe2fe4 WatchSource:0}: Error finding container ad439d807b4eb6dc7e09fba0e70ee78e3bb3efe849bf2c4dabb316209dfe2fe4: Status 404 returned error can't find the container with id ad439d807b4eb6dc7e09fba0e70ee78e3bb3efe849bf2c4dabb316209dfe2fe4
Oct 31 17:30:12.314711 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:12.314541    5003 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/openshift-ai-inference-openshift-ai-inference-6dd6bfb767-t8zg4"]
Oct 31 17:30:12.321812 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:30:12.321777    5003 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9d187bce_1d54_4dd5_b7d3_ee25ca1057f7.slice/crio-352d316cb0af4ccf0e62106e8a402a4a27e2e7dd8cf2121e8900da92d1b80839 WatchSource:0}: Error finding container 352d316cb0af4ccf0e62106e8a402a4a27e2e7dd8cf2121e8900da92d1b80839: Status 404 returned error can't find the container with id 352d316cb0af4ccf0e62106e8a402a4a27e2e7dd8cf2121e8900da92d1b80839
Oct 31 17:30:12.744516 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:12.744363    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-6dd6bfb767-t8zg4" event={"ID":"9d187bce-1d54-4dd5-b7d3-ee25ca1057f7","Type":"ContainerStarted","Data":"352d316cb0af4ccf0e62106e8a402a4a27e2e7dd8cf2121e8900da92d1b80839"}
Oct 31 17:30:12.747856 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:12.747744    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-7smk2" event={"ID":"effd3895-446f-4877-8218-6414ce2e321b","Type":"ContainerStarted","Data":"ad439d807b4eb6dc7e09fba0e70ee78e3bb3efe849bf2c4dabb316209dfe2fe4"}
Oct 31 17:30:14.453803 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:14.451713    5003 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847atdtrh"]
Oct 31 17:30:14.456838 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:14.456085    5003 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847atdtrh"
Oct 31 17:30:14.511266 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:14.511228    5003 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847atdtrh"]
Oct 31 17:30:14.516686 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:14.516655    5003 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6vmsg2"]
Oct 31 17:30:14.521737 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:14.521714    5003 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6vmsg2"]
Oct 31 17:30:14.522774 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:14.522022    5003 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6vmsg2"
Oct 31 17:30:14.585423 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:14.585388    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8e2e4bac-15eb-40b0-9b6a-d03fa7aa0d03-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847atdtrh\" (UID: \"8e2e4bac-15eb-40b0-9b6a-d03fa7aa0d03\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847atdtrh"
Oct 31 17:30:14.585609 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:14.585432    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lx2c4\" (UniqueName: \"kubernetes.io/projected/8e2e4bac-15eb-40b0-9b6a-d03fa7aa0d03-kube-api-access-lx2c4\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847atdtrh\" (UID: \"8e2e4bac-15eb-40b0-9b6a-d03fa7aa0d03\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847atdtrh"
Oct 31 17:30:14.585609 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:14.585453    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8e2e4bac-15eb-40b0-9b6a-d03fa7aa0d03-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847atdtrh\" (UID: \"8e2e4bac-15eb-40b0-9b6a-d03fa7aa0d03\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847atdtrh"
Oct 31 17:30:14.585609 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:14.585479    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sffdg\" (UniqueName: \"kubernetes.io/projected/6e5dce76-55b6-4c27-ac80-3ee3d6310061-kube-api-access-sffdg\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6vmsg2\" (UID: \"6e5dce76-55b6-4c27-ac80-3ee3d6310061\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6vmsg2"
Oct 31 17:30:14.585609 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:14.585515    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6e5dce76-55b6-4c27-ac80-3ee3d6310061-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6vmsg2\" (UID: \"6e5dce76-55b6-4c27-ac80-3ee3d6310061\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6vmsg2"
Oct 31 17:30:14.585609 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:14.585561    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6e5dce76-55b6-4c27-ac80-3ee3d6310061-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6vmsg2\" (UID: \"6e5dce76-55b6-4c27-ac80-3ee3d6310061\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6vmsg2"
Oct 31 17:30:14.687117 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:14.687075    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6e5dce76-55b6-4c27-ac80-3ee3d6310061-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6vmsg2\" (UID: \"6e5dce76-55b6-4c27-ac80-3ee3d6310061\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6vmsg2"
Oct 31 17:30:14.687290 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:14.687165    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6e5dce76-55b6-4c27-ac80-3ee3d6310061-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6vmsg2\" (UID: \"6e5dce76-55b6-4c27-ac80-3ee3d6310061\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6vmsg2"
Oct 31 17:30:14.687290 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:14.687225    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8e2e4bac-15eb-40b0-9b6a-d03fa7aa0d03-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847atdtrh\" (UID: \"8e2e4bac-15eb-40b0-9b6a-d03fa7aa0d03\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847atdtrh"
Oct 31 17:30:14.687290 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:14.687257    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lx2c4\" (UniqueName: \"kubernetes.io/projected/8e2e4bac-15eb-40b0-9b6a-d03fa7aa0d03-kube-api-access-lx2c4\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847atdtrh\" (UID: \"8e2e4bac-15eb-40b0-9b6a-d03fa7aa0d03\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847atdtrh"
Oct 31 17:30:14.687290 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:14.687286    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8e2e4bac-15eb-40b0-9b6a-d03fa7aa0d03-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847atdtrh\" (UID: \"8e2e4bac-15eb-40b0-9b6a-d03fa7aa0d03\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847atdtrh"
Oct 31 17:30:14.687579 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:14.687317    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sffdg\" (UniqueName: \"kubernetes.io/projected/6e5dce76-55b6-4c27-ac80-3ee3d6310061-kube-api-access-sffdg\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6vmsg2\" (UID: \"6e5dce76-55b6-4c27-ac80-3ee3d6310061\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6vmsg2"
Oct 31 17:30:14.688066 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:14.688040    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6e5dce76-55b6-4c27-ac80-3ee3d6310061-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6vmsg2\" (UID: \"6e5dce76-55b6-4c27-ac80-3ee3d6310061\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6vmsg2"
Oct 31 17:30:14.688308 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:14.688289    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6e5dce76-55b6-4c27-ac80-3ee3d6310061-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6vmsg2\" (UID: \"6e5dce76-55b6-4c27-ac80-3ee3d6310061\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6vmsg2"
Oct 31 17:30:14.688657 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:14.688625    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8e2e4bac-15eb-40b0-9b6a-d03fa7aa0d03-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847atdtrh\" (UID: \"8e2e4bac-15eb-40b0-9b6a-d03fa7aa0d03\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847atdtrh"
Oct 31 17:30:14.689162 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:14.689114    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8e2e4bac-15eb-40b0-9b6a-d03fa7aa0d03-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847atdtrh\" (UID: \"8e2e4bac-15eb-40b0-9b6a-d03fa7aa0d03\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847atdtrh"
Oct 31 17:30:14.715364 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:14.715328    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lx2c4\" (UniqueName: \"kubernetes.io/projected/8e2e4bac-15eb-40b0-9b6a-d03fa7aa0d03-kube-api-access-lx2c4\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847atdtrh\" (UID: \"8e2e4bac-15eb-40b0-9b6a-d03fa7aa0d03\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847atdtrh"
Oct 31 17:30:14.717916 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:14.717706    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sffdg\" (UniqueName: \"kubernetes.io/projected/6e5dce76-55b6-4c27-ac80-3ee3d6310061-kube-api-access-sffdg\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6vmsg2\" (UID: \"6e5dce76-55b6-4c27-ac80-3ee3d6310061\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6vmsg2"
Oct 31 17:30:14.780494 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:14.780457    5003 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847atdtrh"
Oct 31 17:30:14.845614 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:14.845573    5003 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6vmsg2"
Oct 31 17:30:15.128586 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:15.128506    5003 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847atdtrh"]
Oct 31 17:30:15.136882 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:30:15.136851    5003 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8e2e4bac_15eb_40b0_9b6a_d03fa7aa0d03.slice/crio-40a035a3a3e4bfc7c11a1edd52c846024bc61ee8e5e9628a7ee9260b43ded345 WatchSource:0}: Error finding container 40a035a3a3e4bfc7c11a1edd52c846024bc61ee8e5e9628a7ee9260b43ded345: Status 404 returned error can't find the container with id 40a035a3a3e4bfc7c11a1edd52c846024bc61ee8e5e9628a7ee9260b43ded345
Oct 31 17:30:15.237677 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:15.237574    5003 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6vmsg2"]
Oct 31 17:30:15.245784 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:30:15.245695    5003 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6e5dce76_55b6_4c27_ac80_3ee3d6310061.slice/crio-8e4b1f6c1d13c35017c40bea999c7bf276c8bbd5494fd883c43209922e15d10e WatchSource:0}: Error finding container 8e4b1f6c1d13c35017c40bea999c7bf276c8bbd5494fd883c43209922e15d10e: Status 404 returned error can't find the container with id 8e4b1f6c1d13c35017c40bea999c7bf276c8bbd5494fd883c43209922e15d10e
Oct 31 17:30:15.785289 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:15.785223    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847atdtrh" event={"ID":"8e2e4bac-15eb-40b0-9b6a-d03fa7aa0d03","Type":"ContainerStarted","Data":"40a035a3a3e4bfc7c11a1edd52c846024bc61ee8e5e9628a7ee9260b43ded345"}
Oct 31 17:30:15.810525 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:15.810469    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6vmsg2" event={"ID":"6e5dce76-55b6-4c27-ac80-3ee3d6310061","Type":"ContainerStarted","Data":"8e4b1f6c1d13c35017c40bea999c7bf276c8bbd5494fd883c43209922e15d10e"}
Oct 31 17:30:20.691866 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:20.691282    5003 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Oct 31 17:30:20.691866 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:20.691374    5003 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Oct 31 17:30:20.691866 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:20.691416    5003 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Oct 31 17:30:21.146125 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:21.145503    5003 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Oct 31 17:30:21.146125 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:21.145581    5003 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Oct 31 17:30:21.146125 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:21.145614    5003 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Oct 31 17:30:21.860670 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:21.859989    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-6dd6bfb767-t8zg4" event={"ID":"9d187bce-1d54-4dd5-b7d3-ee25ca1057f7","Type":"ContainerStarted","Data":"849e9f26db4db3a337945a290e82a32a6d1ca7402cc1ad9d6174ca55027a8c3a"}
Oct 31 17:30:21.866490 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:21.865741    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-7smk2" event={"ID":"effd3895-446f-4877-8218-6414ce2e321b","Type":"ContainerStarted","Data":"42427b7babad578a9a20d4e99b8b0dea6132f26202d319aaf2d814ef0642ba23"}
Oct 31 17:30:21.927320 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:21.926049    5003 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-6dd6bfb767-t8zg4" podStartSLOduration=2.5654478 podStartE2EDuration="10.926029692s" totalImagesPullingTime="8.360581892s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 17:30:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 17:30:21.913895137 +0000 UTC m=+190.168749691" watchObservedRunningTime="2026-10-31 17:30:21.926029692 +0000 UTC m=+190.180884237"
Oct 31 17:30:21.953957 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:21.953879    5003 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-7smk2" podStartSLOduration=1.980414878 podStartE2EDuration="10.953861178s" totalImagesPullingTime="8.9734463s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 17:30:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 17:30:21.952924798 +0000 UTC m=+190.207779340" watchObservedRunningTime="2026-10-31 17:30:21.953861178 +0000 UTC m=+190.208715723"
Oct 31 17:30:21.979009 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:21.978905    5003 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-6dd6bfb767-t8zg4"
Oct 31 17:30:21.985375 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:21.985338    5003 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-6dd6bfb767-t8zg4"
Oct 31 17:30:22.815050 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:22.815005    5003 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-7smk2"
Oct 31 17:30:22.821458 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:22.821416    5003 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-7smk2"
Oct 31 17:30:22.873305 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:22.872780    5003 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-7smk2"
Oct 31 17:30:22.873305 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:22.872921    5003 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-6dd6bfb767-t8zg4"
Oct 31 17:30:22.875318 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:22.874994    5003 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-6dd6bfb767-t8zg4"
Oct 31 17:30:22.875318 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:22.875247    5003 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-7smk2"
Oct 31 17:30:23.896242 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:23.896200    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a5xhx5" event={"ID":"63b287e5-9291-47b5-9033-e117583a4ad7","Type":"ContainerStarted","Data":"8034d4871c58b4a8513357882eba03cbaad40f98d67e73a0ef3d5ecd581315f7"}
Oct 31 17:30:23.896772 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:23.896270    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c88jw2" event={"ID":"7f8b7ebd-2dc8-4664-afab-de39e221af75","Type":"ContainerStarted","Data":"f58710f892aa6281b1d8d151294d45deeb5fe6a94c990ee3998bbbf56f8c639b"}
Oct 31 17:30:24.901990 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:24.901954    5003 generic.go:356] "Generic (PLEG): container finished" podID="63b287e5-9291-47b5-9033-e117583a4ad7" containerID="8034d4871c58b4a8513357882eba03cbaad40f98d67e73a0ef3d5ecd581315f7" exitCode=0
Oct 31 17:30:24.902428 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:24.902037    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a5xhx5" event={"ID":"63b287e5-9291-47b5-9033-e117583a4ad7","Type":"ContainerDied","Data":"8034d4871c58b4a8513357882eba03cbaad40f98d67e73a0ef3d5ecd581315f7"}
Oct 31 17:30:24.904018 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:24.903987    5003 generic.go:356] "Generic (PLEG): container finished" podID="b13c5afb-a308-498c-99a5-903018a493a1" containerID="06ab454a00e00f0c63bdfee82347cb32db1e207b36b4590fb676515158f4045a" exitCode=0
Oct 31 17:30:24.904147 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:24.904075    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7xv9kb" event={"ID":"b13c5afb-a308-498c-99a5-903018a493a1","Type":"ContainerDied","Data":"06ab454a00e00f0c63bdfee82347cb32db1e207b36b4590fb676515158f4045a"}
Oct 31 17:30:24.905709 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:24.905687    5003 generic.go:356] "Generic (PLEG): container finished" podID="de955af9-a688-4c00-afd3-46504ed014b8" containerID="26e330a6a48ab0bc987a88c0f8c3421ace3b28a96ab042eb16c03a67508e58a5" exitCode=0
Oct 31 17:30:24.905817 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:24.905776    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6fnjm6" event={"ID":"de955af9-a688-4c00-afd3-46504ed014b8","Type":"ContainerDied","Data":"26e330a6a48ab0bc987a88c0f8c3421ace3b28a96ab042eb16c03a67508e58a5"}
Oct 31 17:30:24.907292 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:24.907273    5003 generic.go:356] "Generic (PLEG): container finished" podID="7f8b7ebd-2dc8-4664-afab-de39e221af75" containerID="f58710f892aa6281b1d8d151294d45deeb5fe6a94c990ee3998bbbf56f8c639b" exitCode=0
Oct 31 17:30:24.907402 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:24.907342    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c88jw2" event={"ID":"7f8b7ebd-2dc8-4664-afab-de39e221af75","Type":"ContainerDied","Data":"f58710f892aa6281b1d8d151294d45deeb5fe6a94c990ee3998bbbf56f8c639b"}
Oct 31 17:30:25.913555 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:25.913517    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71x7z4q" event={"ID":"ce0297c8-60bd-4318-ace1-48c28d7b2fc1","Type":"ContainerStarted","Data":"6850680bd6cca2b7c1342aa8948177efb12c1df26426ec1687505ec4a2c8ef72"}
Oct 31 17:30:25.915022 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:25.914994    5003 generic.go:356] "Generic (PLEG): container finished" podID="8e2e4bac-15eb-40b0-9b6a-d03fa7aa0d03" containerID="abe9e6330805674adbe531c6d1c43eb63f192ec205202d3ec4fd81ce03eda94a" exitCode=0
Oct 31 17:30:25.915140 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:25.915086    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847atdtrh" event={"ID":"8e2e4bac-15eb-40b0-9b6a-d03fa7aa0d03","Type":"ContainerDied","Data":"abe9e6330805674adbe531c6d1c43eb63f192ec205202d3ec4fd81ce03eda94a"}
Oct 31 17:30:25.916573 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:25.916553    5003 generic.go:356] "Generic (PLEG): container finished" podID="6e5dce76-55b6-4c27-ac80-3ee3d6310061" containerID="897ce3b4453ee89f80fe7f5a6e6eb85b12bb4e211e56750eb0b3295523f37fdd" exitCode=0
Oct 31 17:30:25.916673 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:25.916638    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6vmsg2" event={"ID":"6e5dce76-55b6-4c27-ac80-3ee3d6310061","Type":"ContainerDied","Data":"897ce3b4453ee89f80fe7f5a6e6eb85b12bb4e211e56750eb0b3295523f37fdd"}
Oct 31 17:30:26.923083 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:26.923038    5003 generic.go:356] "Generic (PLEG): container finished" podID="63b287e5-9291-47b5-9033-e117583a4ad7" containerID="6712f720e1a6ab06ea0184751c077136073e8b324e1b587741dd4b810482d0e6" exitCode=0
Oct 31 17:30:26.923549 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:26.923110    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a5xhx5" event={"ID":"63b287e5-9291-47b5-9033-e117583a4ad7","Type":"ContainerDied","Data":"6712f720e1a6ab06ea0184751c077136073e8b324e1b587741dd4b810482d0e6"}
Oct 31 17:30:26.926047 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:26.926017    5003 generic.go:356] "Generic (PLEG): container finished" podID="ce0297c8-60bd-4318-ace1-48c28d7b2fc1" containerID="6850680bd6cca2b7c1342aa8948177efb12c1df26426ec1687505ec4a2c8ef72" exitCode=0
Oct 31 17:30:26.926141 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:26.926114    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71x7z4q" event={"ID":"ce0297c8-60bd-4318-ace1-48c28d7b2fc1","Type":"ContainerDied","Data":"6850680bd6cca2b7c1342aa8948177efb12c1df26426ec1687505ec4a2c8ef72"}
Oct 31 17:30:26.930323 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:26.930276    5003 generic.go:356] "Generic (PLEG): container finished" podID="8e2e4bac-15eb-40b0-9b6a-d03fa7aa0d03" containerID="6784e82e880c9c35ac2eb14c7c52d51357c3120d2de9d89927a66df51a2d0124" exitCode=0
Oct 31 17:30:26.930423 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:26.930360    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847atdtrh" event={"ID":"8e2e4bac-15eb-40b0-9b6a-d03fa7aa0d03","Type":"ContainerDied","Data":"6784e82e880c9c35ac2eb14c7c52d51357c3120d2de9d89927a66df51a2d0124"}
Oct 31 17:30:26.932795 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:26.932776    5003 generic.go:356] "Generic (PLEG): container finished" podID="b13c5afb-a308-498c-99a5-903018a493a1" containerID="43d4da49ff9bdd9243ad00ade9b2fdb9d4020899f92882526977a511b0d3d2d2" exitCode=0
Oct 31 17:30:26.932974 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:26.932953    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7xv9kb" event={"ID":"b13c5afb-a308-498c-99a5-903018a493a1","Type":"ContainerDied","Data":"43d4da49ff9bdd9243ad00ade9b2fdb9d4020899f92882526977a511b0d3d2d2"}
Oct 31 17:30:26.934732 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:26.934710    5003 generic.go:356] "Generic (PLEG): container finished" podID="de955af9-a688-4c00-afd3-46504ed014b8" containerID="140c299cf13390610f78b28645bfed058c720888d50cd12880232a9cd820b67f" exitCode=0
Oct 31 17:30:26.934834 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:26.934761    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6fnjm6" event={"ID":"de955af9-a688-4c00-afd3-46504ed014b8","Type":"ContainerDied","Data":"140c299cf13390610f78b28645bfed058c720888d50cd12880232a9cd820b67f"}
Oct 31 17:30:26.936861 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:26.936840    5003 generic.go:356] "Generic (PLEG): container finished" podID="6e5dce76-55b6-4c27-ac80-3ee3d6310061" containerID="dbe05e27d8309285461197dff54d4fd46258677191b4fb9b214bf70e5c81587b" exitCode=0
Oct 31 17:30:26.936956 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:26.936914    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6vmsg2" event={"ID":"6e5dce76-55b6-4c27-ac80-3ee3d6310061","Type":"ContainerDied","Data":"dbe05e27d8309285461197dff54d4fd46258677191b4fb9b214bf70e5c81587b"}
Oct 31 17:30:26.939821 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:26.939300    5003 generic.go:356] "Generic (PLEG): container finished" podID="7f8b7ebd-2dc8-4664-afab-de39e221af75" containerID="3d5bf0d5b79ba2eed57f51ee2cd33f5db6aaa02f6ffa80dee06342232bd714c3" exitCode=0
Oct 31 17:30:26.939821 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:26.939324    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c88jw2" event={"ID":"7f8b7ebd-2dc8-4664-afab-de39e221af75","Type":"ContainerDied","Data":"3d5bf0d5b79ba2eed57f51ee2cd33f5db6aaa02f6ffa80dee06342232bd714c3"}
Oct 31 17:30:26.941180 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:26.941157    5003 generic.go:356] "Generic (PLEG): container finished" podID="cad20c98-5623-459c-9633-35de91881dc9" containerID="eeb57585fed81e01c367bb18a3a3583e2352d69e56ee643b543c995607e86e30" exitCode=0
Oct 31 17:30:26.941294 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:26.941208    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cxq428" event={"ID":"cad20c98-5623-459c-9633-35de91881dc9","Type":"ContainerDied","Data":"eeb57585fed81e01c367bb18a3a3583e2352d69e56ee643b543c995607e86e30"}
Oct 31 17:30:27.954934 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:27.954846    5003 generic.go:356] "Generic (PLEG): container finished" podID="ce0297c8-60bd-4318-ace1-48c28d7b2fc1" containerID="155483f211a27c852696776cd2c2f115d57147d7ecb1d63ee0016d31c1a2e536" exitCode=0
Oct 31 17:30:27.954934 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:27.954904    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71x7z4q" event={"ID":"ce0297c8-60bd-4318-ace1-48c28d7b2fc1","Type":"ContainerDied","Data":"155483f211a27c852696776cd2c2f115d57147d7ecb1d63ee0016d31c1a2e536"}
Oct 31 17:30:33.024593 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:33.023523    5003 generic.go:356] "Generic (PLEG): container finished" podID="cad20c98-5623-459c-9633-35de91881dc9" containerID="2d6831a87fa352f31c91b8d1248ccbe1db9f9f5d1b7bd4181aa07280c4fb797d" exitCode=0
Oct 31 17:30:33.024593 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:33.023690    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cxq428" event={"ID":"cad20c98-5623-459c-9633-35de91881dc9","Type":"ContainerDied","Data":"2d6831a87fa352f31c91b8d1248ccbe1db9f9f5d1b7bd4181aa07280c4fb797d"}
Oct 31 17:30:40.379868 ip-10-0-138-17 kubenswrapper[5003]: E1031 17:30:40.379791    5003 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-tdzz5" containerName="extractor"
Oct 31 17:30:44.149600 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:44.149085    5003 generic.go:356] "Generic (PLEG): container finished" podID="8e2e4bac-15eb-40b0-9b6a-d03fa7aa0d03" containerID="bcf5ab823b48199442da7c17a47e6b7f9ab0a202a86b3772780666b34ada2770" exitCode=0
Oct 31 17:30:44.149600 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:44.149183    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847atdtrh" event={"ID":"8e2e4bac-15eb-40b0-9b6a-d03fa7aa0d03","Type":"ContainerDied","Data":"bcf5ab823b48199442da7c17a47e6b7f9ab0a202a86b3772780666b34ada2770"}
Oct 31 17:30:44.152672 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:44.152618    5003 generic.go:356] "Generic (PLEG): container finished" podID="b13c5afb-a308-498c-99a5-903018a493a1" containerID="2c919be42e75aeb22d6ce1efa4af07a425d6f064f2be5dd92dfcd027058e3178" exitCode=0
Oct 31 17:30:44.152884 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:44.152855    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7xv9kb" event={"ID":"b13c5afb-a308-498c-99a5-903018a493a1","Type":"ContainerDied","Data":"2c919be42e75aeb22d6ce1efa4af07a425d6f064f2be5dd92dfcd027058e3178"}
Oct 31 17:30:44.155477 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:44.155448    5003 generic.go:356] "Generic (PLEG): container finished" podID="6e5dce76-55b6-4c27-ac80-3ee3d6310061" containerID="6afb993735dd62e75cf4acba4714de47e5cf8cb945880313deb2804877568be7" exitCode=0
Oct 31 17:30:44.155582 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:44.155516    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6vmsg2" event={"ID":"6e5dce76-55b6-4c27-ac80-3ee3d6310061","Type":"ContainerDied","Data":"6afb993735dd62e75cf4acba4714de47e5cf8cb945880313deb2804877568be7"}
Oct 31 17:30:45.164213 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:45.164128    5003 generic.go:356] "Generic (PLEG): container finished" podID="de955af9-a688-4c00-afd3-46504ed014b8" containerID="664d18f40066d4a25bdd226b0401393bd6348471887d4d908679d637b4082a44" exitCode=0
Oct 31 17:30:45.164718 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:45.164218    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6fnjm6" event={"ID":"de955af9-a688-4c00-afd3-46504ed014b8","Type":"ContainerDied","Data":"664d18f40066d4a25bdd226b0401393bd6348471887d4d908679d637b4082a44"}
Oct 31 17:30:45.166887 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:45.166715    5003 generic.go:356] "Generic (PLEG): container finished" podID="7f8b7ebd-2dc8-4664-afab-de39e221af75" containerID="274ba24d70cb20b96637d625da58a9ca241136a28155b6012471f0c19a6e26f5" exitCode=0
Oct 31 17:30:45.166887 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:45.166797    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c88jw2" event={"ID":"7f8b7ebd-2dc8-4664-afab-de39e221af75","Type":"ContainerDied","Data":"274ba24d70cb20b96637d625da58a9ca241136a28155b6012471f0c19a6e26f5"}
Oct 31 17:30:45.169279 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:45.169253    5003 generic.go:356] "Generic (PLEG): container finished" podID="63b287e5-9291-47b5-9033-e117583a4ad7" containerID="9576be652775e61dea346fd6fdc0272f1a167ffdbf41a1ca7a60cb3cab9af63d" exitCode=0
Oct 31 17:30:45.169428 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:45.169339    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a5xhx5" event={"ID":"63b287e5-9291-47b5-9033-e117583a4ad7","Type":"ContainerDied","Data":"9576be652775e61dea346fd6fdc0272f1a167ffdbf41a1ca7a60cb3cab9af63d"}
Oct 31 17:30:45.171835 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:45.171808    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71x7z4q" event={"ID":"ce0297c8-60bd-4318-ace1-48c28d7b2fc1","Type":"ContainerStarted","Data":"e4530602926c8bdd12b8343ae5674379db806ffb1b78e693b0f651bd83769908"}
Oct 31 17:30:45.286630 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:45.286413    5003 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71x7z4q" podStartSLOduration=3.19182393 podStartE2EDuration="37.286393139s" totalImagesPullingTime="34.094569209s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 17:30:08 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 17:30:45.24285327 +0000 UTC m=+213.497707813" watchObservedRunningTime="2026-10-31 17:30:45.286393139 +0000 UTC m=+213.541247693"
Oct 31 17:30:45.317600 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:45.317487    5003 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6vmsg2"
Oct 31 17:30:45.357466 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:45.357434    5003 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7xv9kb"
Oct 31 17:30:45.393690 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:45.393636    5003 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847atdtrh"
Oct 31 17:30:45.421434 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:45.421352    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/6e5dce76-55b6-4c27-ac80-3ee3d6310061-kube-api-access-sffdg\" (UniqueName: \"kubernetes.io/projected/6e5dce76-55b6-4c27-ac80-3ee3d6310061-kube-api-access-sffdg\") pod \"6e5dce76-55b6-4c27-ac80-3ee3d6310061\" (UID: \"6e5dce76-55b6-4c27-ac80-3ee3d6310061\") "
Oct 31 17:30:45.421434 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:45.421403    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/6e5dce76-55b6-4c27-ac80-3ee3d6310061-bundle\" (UniqueName: \"kubernetes.io/empty-dir/6e5dce76-55b6-4c27-ac80-3ee3d6310061-bundle\") pod \"6e5dce76-55b6-4c27-ac80-3ee3d6310061\" (UID: \"6e5dce76-55b6-4c27-ac80-3ee3d6310061\") "
Oct 31 17:30:45.421670 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:45.421549    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/6e5dce76-55b6-4c27-ac80-3ee3d6310061-util\" (UniqueName: \"kubernetes.io/empty-dir/6e5dce76-55b6-4c27-ac80-3ee3d6310061-util\") pod \"6e5dce76-55b6-4c27-ac80-3ee3d6310061\" (UID: \"6e5dce76-55b6-4c27-ac80-3ee3d6310061\") "
Oct 31 17:30:45.421974 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:45.421945    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6e5dce76-55b6-4c27-ac80-3ee3d6310061-bundle" pod "6e5dce76-55b6-4c27-ac80-3ee3d6310061" (UID: "6e5dce76-55b6-4c27-ac80-3ee3d6310061"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 17:30:45.423873 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:45.423846    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6e5dce76-55b6-4c27-ac80-3ee3d6310061-kube-api-access-sffdg" pod "6e5dce76-55b6-4c27-ac80-3ee3d6310061" (UID: "6e5dce76-55b6-4c27-ac80-3ee3d6310061"). InnerVolumeSpecName "kube-api-access-sffdg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 17:30:45.426820 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:45.426782    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6e5dce76-55b6-4c27-ac80-3ee3d6310061-util" pod "6e5dce76-55b6-4c27-ac80-3ee3d6310061" (UID: "6e5dce76-55b6-4c27-ac80-3ee3d6310061"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 17:30:45.522381 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:45.522345    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8e2e4bac-15eb-40b0-9b6a-d03fa7aa0d03-util\" (UniqueName: \"kubernetes.io/empty-dir/8e2e4bac-15eb-40b0-9b6a-d03fa7aa0d03-util\") pod \"8e2e4bac-15eb-40b0-9b6a-d03fa7aa0d03\" (UID: \"8e2e4bac-15eb-40b0-9b6a-d03fa7aa0d03\") "
Oct 31 17:30:45.522556 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:45.522437    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/8e2e4bac-15eb-40b0-9b6a-d03fa7aa0d03-kube-api-access-lx2c4\" (UniqueName: \"kubernetes.io/projected/8e2e4bac-15eb-40b0-9b6a-d03fa7aa0d03-kube-api-access-lx2c4\") pod \"8e2e4bac-15eb-40b0-9b6a-d03fa7aa0d03\" (UID: \"8e2e4bac-15eb-40b0-9b6a-d03fa7aa0d03\") "
Oct 31 17:30:45.522556 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:45.522472    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8e2e4bac-15eb-40b0-9b6a-d03fa7aa0d03-bundle\" (UniqueName: \"kubernetes.io/empty-dir/8e2e4bac-15eb-40b0-9b6a-d03fa7aa0d03-bundle\") pod \"8e2e4bac-15eb-40b0-9b6a-d03fa7aa0d03\" (UID: \"8e2e4bac-15eb-40b0-9b6a-d03fa7aa0d03\") "
Oct 31 17:30:45.522556 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:45.522505    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b13c5afb-a308-498c-99a5-903018a493a1-bundle\" (UniqueName: \"kubernetes.io/empty-dir/b13c5afb-a308-498c-99a5-903018a493a1-bundle\") pod \"b13c5afb-a308-498c-99a5-903018a493a1\" (UID: \"b13c5afb-a308-498c-99a5-903018a493a1\") "
Oct 31 17:30:45.522745 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:45.522576    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b13c5afb-a308-498c-99a5-903018a493a1-util\" (UniqueName: \"kubernetes.io/empty-dir/b13c5afb-a308-498c-99a5-903018a493a1-util\") pod \"b13c5afb-a308-498c-99a5-903018a493a1\" (UID: \"b13c5afb-a308-498c-99a5-903018a493a1\") "
Oct 31 17:30:45.522745 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:45.522626    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/b13c5afb-a308-498c-99a5-903018a493a1-kube-api-access-m4nf4\" (UniqueName: \"kubernetes.io/projected/b13c5afb-a308-498c-99a5-903018a493a1-kube-api-access-m4nf4\") pod \"b13c5afb-a308-498c-99a5-903018a493a1\" (UID: \"b13c5afb-a308-498c-99a5-903018a493a1\") "
Oct 31 17:30:45.522907 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:45.522880    5003 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6e5dce76-55b6-4c27-ac80-3ee3d6310061-util\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:30:45.523025 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:45.522914    5003 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sffdg\" (UniqueName: \"kubernetes.io/projected/6e5dce76-55b6-4c27-ac80-3ee3d6310061-kube-api-access-sffdg\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:30:45.523025 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:45.522930    5003 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6e5dce76-55b6-4c27-ac80-3ee3d6310061-bundle\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:30:45.523333 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:45.523304    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8e2e4bac-15eb-40b0-9b6a-d03fa7aa0d03-bundle" pod "8e2e4bac-15eb-40b0-9b6a-d03fa7aa0d03" (UID: "8e2e4bac-15eb-40b0-9b6a-d03fa7aa0d03"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 17:30:45.524811 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:45.524768    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b13c5afb-a308-498c-99a5-903018a493a1-bundle" pod "b13c5afb-a308-498c-99a5-903018a493a1" (UID: "b13c5afb-a308-498c-99a5-903018a493a1"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 17:30:45.524965 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:45.524885    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8e2e4bac-15eb-40b0-9b6a-d03fa7aa0d03-kube-api-access-lx2c4" pod "8e2e4bac-15eb-40b0-9b6a-d03fa7aa0d03" (UID: "8e2e4bac-15eb-40b0-9b6a-d03fa7aa0d03"). InnerVolumeSpecName "kube-api-access-lx2c4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 17:30:45.525386 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:45.525354    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b13c5afb-a308-498c-99a5-903018a493a1-kube-api-access-m4nf4" pod "b13c5afb-a308-498c-99a5-903018a493a1" (UID: "b13c5afb-a308-498c-99a5-903018a493a1"). InnerVolumeSpecName "kube-api-access-m4nf4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 17:30:45.527914 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:45.527887    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8e2e4bac-15eb-40b0-9b6a-d03fa7aa0d03-util" pod "8e2e4bac-15eb-40b0-9b6a-d03fa7aa0d03" (UID: "8e2e4bac-15eb-40b0-9b6a-d03fa7aa0d03"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 17:30:45.529537 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:45.529505    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b13c5afb-a308-498c-99a5-903018a493a1-util" pod "b13c5afb-a308-498c-99a5-903018a493a1" (UID: "b13c5afb-a308-498c-99a5-903018a493a1"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 17:30:45.624201 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:45.624152    5003 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m4nf4\" (UniqueName: \"kubernetes.io/projected/b13c5afb-a308-498c-99a5-903018a493a1-kube-api-access-m4nf4\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:30:45.624201 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:45.624201    5003 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8e2e4bac-15eb-40b0-9b6a-d03fa7aa0d03-util\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:30:45.624406 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:45.624217    5003 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lx2c4\" (UniqueName: \"kubernetes.io/projected/8e2e4bac-15eb-40b0-9b6a-d03fa7aa0d03-kube-api-access-lx2c4\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:30:45.624406 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:45.624230    5003 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8e2e4bac-15eb-40b0-9b6a-d03fa7aa0d03-bundle\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:30:45.624406 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:45.624242    5003 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b13c5afb-a308-498c-99a5-903018a493a1-bundle\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:30:45.624406 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:45.624252    5003 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b13c5afb-a308-498c-99a5-903018a493a1-util\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:30:46.178332 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:46.178224    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cxq428" event={"ID":"cad20c98-5623-459c-9633-35de91881dc9","Type":"ContainerStarted","Data":"ab3471d6c17986a069bbf033487d3fd1a6f073065eebb6967a5a63c5c7cba172"}
Oct 31 17:30:46.180415 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:46.180383    5003 generic.go:356] "Generic (PLEG): container finished" podID="ce0297c8-60bd-4318-ace1-48c28d7b2fc1" containerID="e4530602926c8bdd12b8343ae5674379db806ffb1b78e693b0f651bd83769908" exitCode=0
Oct 31 17:30:46.180535 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:46.180462    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71x7z4q" event={"ID":"ce0297c8-60bd-4318-ace1-48c28d7b2fc1","Type":"ContainerDied","Data":"e4530602926c8bdd12b8343ae5674379db806ffb1b78e693b0f651bd83769908"}
Oct 31 17:30:46.182313 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:46.182292    5003 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847atdtrh"
Oct 31 17:30:46.182428 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:46.182290    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847atdtrh" event={"ID":"8e2e4bac-15eb-40b0-9b6a-d03fa7aa0d03","Type":"ContainerDied","Data":"40a035a3a3e4bfc7c11a1edd52c846024bc61ee8e5e9628a7ee9260b43ded345"}
Oct 31 17:30:46.182428 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:46.182412    5003 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="40a035a3a3e4bfc7c11a1edd52c846024bc61ee8e5e9628a7ee9260b43ded345"
Oct 31 17:30:46.184265 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:46.184224    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7xv9kb" event={"ID":"b13c5afb-a308-498c-99a5-903018a493a1","Type":"ContainerDied","Data":"7db32a99109b1408809464ebd337fa856061c66a937e905c301e6e95b2ef82f2"}
Oct 31 17:30:46.184371 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:46.184241    5003 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7xv9kb"
Oct 31 17:30:46.185260 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:46.185240    5003 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7db32a99109b1408809464ebd337fa856061c66a937e905c301e6e95b2ef82f2"
Oct 31 17:30:46.187124 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:46.187098    5003 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6vmsg2"
Oct 31 17:30:46.187202 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:46.187132    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6vmsg2" event={"ID":"6e5dce76-55b6-4c27-ac80-3ee3d6310061","Type":"ContainerDied","Data":"8e4b1f6c1d13c35017c40bea999c7bf276c8bbd5494fd883c43209922e15d10e"}
Oct 31 17:30:46.187202 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:46.187169    5003 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8e4b1f6c1d13c35017c40bea999c7bf276c8bbd5494fd883c43209922e15d10e"
Oct 31 17:30:46.217308 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:46.217246    5003 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cxq428" podStartSLOduration=2.804567089 podStartE2EDuration="37.217225723s" totalImagesPullingTime="34.412658634s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 17:30:09 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 17:30:46.215618917 +0000 UTC m=+214.470473463" watchObservedRunningTime="2026-10-31 17:30:46.217225723 +0000 UTC m=+214.472080269"
Oct 31 17:30:46.338745 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:46.338714    5003 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a5xhx5"
Oct 31 17:30:46.363196 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:46.363171    5003 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6fnjm6"
Oct 31 17:30:46.371555 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:46.371525    5003 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c88jw2"
Oct 31 17:30:46.435400 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:46.435305    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/63b287e5-9291-47b5-9033-e117583a4ad7-bundle\" (UniqueName: \"kubernetes.io/empty-dir/63b287e5-9291-47b5-9033-e117583a4ad7-bundle\") pod \"63b287e5-9291-47b5-9033-e117583a4ad7\" (UID: \"63b287e5-9291-47b5-9033-e117583a4ad7\") "
Oct 31 17:30:46.435400 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:46.435368    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/63b287e5-9291-47b5-9033-e117583a4ad7-util\" (UniqueName: \"kubernetes.io/empty-dir/63b287e5-9291-47b5-9033-e117583a4ad7-util\") pod \"63b287e5-9291-47b5-9033-e117583a4ad7\" (UID: \"63b287e5-9291-47b5-9033-e117583a4ad7\") "
Oct 31 17:30:46.435631 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:46.435411    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/7f8b7ebd-2dc8-4664-afab-de39e221af75-kube-api-access-sd4cq\" (UniqueName: \"kubernetes.io/projected/7f8b7ebd-2dc8-4664-afab-de39e221af75-kube-api-access-sd4cq\") pod \"7f8b7ebd-2dc8-4664-afab-de39e221af75\" (UID: \"7f8b7ebd-2dc8-4664-afab-de39e221af75\") "
Oct 31 17:30:46.435631 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:46.435446    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/7f8b7ebd-2dc8-4664-afab-de39e221af75-bundle\" (UniqueName: \"kubernetes.io/empty-dir/7f8b7ebd-2dc8-4664-afab-de39e221af75-bundle\") pod \"7f8b7ebd-2dc8-4664-afab-de39e221af75\" (UID: \"7f8b7ebd-2dc8-4664-afab-de39e221af75\") "
Oct 31 17:30:46.435631 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:46.435495    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/de955af9-a688-4c00-afd3-46504ed014b8-bundle\" (UniqueName: \"kubernetes.io/empty-dir/de955af9-a688-4c00-afd3-46504ed014b8-bundle\") pod \"de955af9-a688-4c00-afd3-46504ed014b8\" (UID: \"de955af9-a688-4c00-afd3-46504ed014b8\") "
Oct 31 17:30:46.435631 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:46.435532    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/de955af9-a688-4c00-afd3-46504ed014b8-util\" (UniqueName: \"kubernetes.io/empty-dir/de955af9-a688-4c00-afd3-46504ed014b8-util\") pod \"de955af9-a688-4c00-afd3-46504ed014b8\" (UID: \"de955af9-a688-4c00-afd3-46504ed014b8\") "
Oct 31 17:30:46.435631 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:46.435602    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/7f8b7ebd-2dc8-4664-afab-de39e221af75-util\" (UniqueName: \"kubernetes.io/empty-dir/7f8b7ebd-2dc8-4664-afab-de39e221af75-util\") pod \"7f8b7ebd-2dc8-4664-afab-de39e221af75\" (UID: \"7f8b7ebd-2dc8-4664-afab-de39e221af75\") "
Oct 31 17:30:46.435631 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:46.435628    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/de955af9-a688-4c00-afd3-46504ed014b8-kube-api-access-zbplm\" (UniqueName: \"kubernetes.io/projected/de955af9-a688-4c00-afd3-46504ed014b8-kube-api-access-zbplm\") pod \"de955af9-a688-4c00-afd3-46504ed014b8\" (UID: \"de955af9-a688-4c00-afd3-46504ed014b8\") "
Oct 31 17:30:46.435956 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:46.435687    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/63b287e5-9291-47b5-9033-e117583a4ad7-kube-api-access-7qzdk\" (UniqueName: \"kubernetes.io/projected/63b287e5-9291-47b5-9033-e117583a4ad7-kube-api-access-7qzdk\") pod \"63b287e5-9291-47b5-9033-e117583a4ad7\" (UID: \"63b287e5-9291-47b5-9033-e117583a4ad7\") "
Oct 31 17:30:46.436128 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:46.436071    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/de955af9-a688-4c00-afd3-46504ed014b8-bundle" pod "de955af9-a688-4c00-afd3-46504ed014b8" (UID: "de955af9-a688-4c00-afd3-46504ed014b8"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 17:30:46.436276 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:46.436228    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/63b287e5-9291-47b5-9033-e117583a4ad7-bundle" pod "63b287e5-9291-47b5-9033-e117583a4ad7" (UID: "63b287e5-9291-47b5-9033-e117583a4ad7"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 17:30:46.437205 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:46.437183    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7f8b7ebd-2dc8-4664-afab-de39e221af75-bundle" pod "7f8b7ebd-2dc8-4664-afab-de39e221af75" (UID: "7f8b7ebd-2dc8-4664-afab-de39e221af75"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 17:30:46.438148 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:46.438125    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7f8b7ebd-2dc8-4664-afab-de39e221af75-kube-api-access-sd4cq" pod "7f8b7ebd-2dc8-4664-afab-de39e221af75" (UID: "7f8b7ebd-2dc8-4664-afab-de39e221af75"). InnerVolumeSpecName "kube-api-access-sd4cq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 17:30:46.438483 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:46.438463    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/63b287e5-9291-47b5-9033-e117583a4ad7-kube-api-access-7qzdk" pod "63b287e5-9291-47b5-9033-e117583a4ad7" (UID: "63b287e5-9291-47b5-9033-e117583a4ad7"). InnerVolumeSpecName "kube-api-access-7qzdk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 17:30:46.438544 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:46.438487    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/de955af9-a688-4c00-afd3-46504ed014b8-kube-api-access-zbplm" pod "de955af9-a688-4c00-afd3-46504ed014b8" (UID: "de955af9-a688-4c00-afd3-46504ed014b8"). InnerVolumeSpecName "kube-api-access-zbplm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 17:30:46.442715 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:46.442689    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/63b287e5-9291-47b5-9033-e117583a4ad7-util" pod "63b287e5-9291-47b5-9033-e117583a4ad7" (UID: "63b287e5-9291-47b5-9033-e117583a4ad7"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 17:30:46.442836 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:46.442752    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7f8b7ebd-2dc8-4664-afab-de39e221af75-util" pod "7f8b7ebd-2dc8-4664-afab-de39e221af75" (UID: "7f8b7ebd-2dc8-4664-afab-de39e221af75"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 17:30:46.445316 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:46.445280    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/de955af9-a688-4c00-afd3-46504ed014b8-util" pod "de955af9-a688-4c00-afd3-46504ed014b8" (UID: "de955af9-a688-4c00-afd3-46504ed014b8"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 17:30:46.536755 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:46.536719    5003 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/de955af9-a688-4c00-afd3-46504ed014b8-bundle\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:30:46.536755 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:46.536749    5003 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/de955af9-a688-4c00-afd3-46504ed014b8-util\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:30:46.536755 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:46.536758    5003 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7f8b7ebd-2dc8-4664-afab-de39e221af75-util\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:30:46.536985 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:46.536767    5003 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zbplm\" (UniqueName: \"kubernetes.io/projected/de955af9-a688-4c00-afd3-46504ed014b8-kube-api-access-zbplm\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:30:46.536985 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:46.536780    5003 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7qzdk\" (UniqueName: \"kubernetes.io/projected/63b287e5-9291-47b5-9033-e117583a4ad7-kube-api-access-7qzdk\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:30:46.536985 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:46.536789    5003 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/63b287e5-9291-47b5-9033-e117583a4ad7-bundle\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:30:46.536985 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:46.536797    5003 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/63b287e5-9291-47b5-9033-e117583a4ad7-util\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:30:46.536985 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:46.536805    5003 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sd4cq\" (UniqueName: \"kubernetes.io/projected/7f8b7ebd-2dc8-4664-afab-de39e221af75-kube-api-access-sd4cq\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:30:46.536985 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:46.536812    5003 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7f8b7ebd-2dc8-4664-afab-de39e221af75-bundle\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:30:47.193278 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:47.193251    5003 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a5xhx5"
Oct 31 17:30:47.193720 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:47.193255    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a5xhx5" event={"ID":"63b287e5-9291-47b5-9033-e117583a4ad7","Type":"ContainerDied","Data":"dfd9b011e10e67cbdec9723494a228782a3e0bda3cb8002663f322320dc2068d"}
Oct 31 17:30:47.193720 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:47.193375    5003 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="dfd9b011e10e67cbdec9723494a228782a3e0bda3cb8002663f322320dc2068d"
Oct 31 17:30:47.195371 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:47.195349    5003 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6fnjm6"
Oct 31 17:30:47.195491 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:47.195368    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6fnjm6" event={"ID":"de955af9-a688-4c00-afd3-46504ed014b8","Type":"ContainerDied","Data":"64c1a7f20fe1898e6f9bbfbe68aaf57cfc1f7e200b8eff4016a1f8131e7963e2"}
Oct 31 17:30:47.195491 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:47.195411    5003 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="64c1a7f20fe1898e6f9bbfbe68aaf57cfc1f7e200b8eff4016a1f8131e7963e2"
Oct 31 17:30:47.197399 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:47.197377    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c88jw2" event={"ID":"7f8b7ebd-2dc8-4664-afab-de39e221af75","Type":"ContainerDied","Data":"833723c0755014ba09c525bb5dd889f1a5460fb9a0c10ecfc88aad9b874e1477"}
Oct 31 17:30:47.197399 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:47.197390    5003 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c88jw2"
Oct 31 17:30:47.197555 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:47.197412    5003 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="833723c0755014ba09c525bb5dd889f1a5460fb9a0c10ecfc88aad9b874e1477"
Oct 31 17:30:47.199681 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:47.199656    5003 generic.go:356] "Generic (PLEG): container finished" podID="cad20c98-5623-459c-9633-35de91881dc9" containerID="ab3471d6c17986a069bbf033487d3fd1a6f073065eebb6967a5a63c5c7cba172" exitCode=0
Oct 31 17:30:47.199773 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:47.199731    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cxq428" event={"ID":"cad20c98-5623-459c-9633-35de91881dc9","Type":"ContainerDied","Data":"ab3471d6c17986a069bbf033487d3fd1a6f073065eebb6967a5a63c5c7cba172"}
Oct 31 17:30:47.325135 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:47.325110    5003 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71x7z4q"
Oct 31 17:30:47.341384 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:47.341359    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ce0297c8-60bd-4318-ace1-48c28d7b2fc1-util\" (UniqueName: \"kubernetes.io/empty-dir/ce0297c8-60bd-4318-ace1-48c28d7b2fc1-util\") pod \"ce0297c8-60bd-4318-ace1-48c28d7b2fc1\" (UID: \"ce0297c8-60bd-4318-ace1-48c28d7b2fc1\") "
Oct 31 17:30:47.341533 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:47.341411    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/ce0297c8-60bd-4318-ace1-48c28d7b2fc1-kube-api-access-gmmk5\" (UniqueName: \"kubernetes.io/projected/ce0297c8-60bd-4318-ace1-48c28d7b2fc1-kube-api-access-gmmk5\") pod \"ce0297c8-60bd-4318-ace1-48c28d7b2fc1\" (UID: \"ce0297c8-60bd-4318-ace1-48c28d7b2fc1\") "
Oct 31 17:30:47.341533 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:47.341444    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ce0297c8-60bd-4318-ace1-48c28d7b2fc1-bundle\" (UniqueName: \"kubernetes.io/empty-dir/ce0297c8-60bd-4318-ace1-48c28d7b2fc1-bundle\") pod \"ce0297c8-60bd-4318-ace1-48c28d7b2fc1\" (UID: \"ce0297c8-60bd-4318-ace1-48c28d7b2fc1\") "
Oct 31 17:30:47.342115 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:47.342084    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ce0297c8-60bd-4318-ace1-48c28d7b2fc1-bundle" pod "ce0297c8-60bd-4318-ace1-48c28d7b2fc1" (UID: "ce0297c8-60bd-4318-ace1-48c28d7b2fc1"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 17:30:47.343565 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:47.343547    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ce0297c8-60bd-4318-ace1-48c28d7b2fc1-kube-api-access-gmmk5" pod "ce0297c8-60bd-4318-ace1-48c28d7b2fc1" (UID: "ce0297c8-60bd-4318-ace1-48c28d7b2fc1"). InnerVolumeSpecName "kube-api-access-gmmk5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 17:30:47.349186 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:47.349155    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ce0297c8-60bd-4318-ace1-48c28d7b2fc1-util" pod "ce0297c8-60bd-4318-ace1-48c28d7b2fc1" (UID: "ce0297c8-60bd-4318-ace1-48c28d7b2fc1"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 17:30:47.442727 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:47.442685    5003 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ce0297c8-60bd-4318-ace1-48c28d7b2fc1-util\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:30:47.442727 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:47.442720    5003 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gmmk5\" (UniqueName: \"kubernetes.io/projected/ce0297c8-60bd-4318-ace1-48c28d7b2fc1-kube-api-access-gmmk5\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:30:47.442727 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:47.442731    5003 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ce0297c8-60bd-4318-ace1-48c28d7b2fc1-bundle\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:30:48.206773 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:48.206687    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71x7z4q" event={"ID":"ce0297c8-60bd-4318-ace1-48c28d7b2fc1","Type":"ContainerDied","Data":"f97f8937185e15db5bf8c02f69bb4c860085bde606dd4b20227cc921db0f6bd4"}
Oct 31 17:30:48.206773 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:48.206759    5003 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f97f8937185e15db5bf8c02f69bb4c860085bde606dd4b20227cc921db0f6bd4"
Oct 31 17:30:48.207146 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:48.206712    5003 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71x7z4q"
Oct 31 17:30:48.346744 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:48.346718    5003 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cxq428"
Oct 31 17:30:48.450275 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:48.450240    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/cad20c98-5623-459c-9633-35de91881dc9-util\" (UniqueName: \"kubernetes.io/empty-dir/cad20c98-5623-459c-9633-35de91881dc9-util\") pod \"cad20c98-5623-459c-9633-35de91881dc9\" (UID: \"cad20c98-5623-459c-9633-35de91881dc9\") "
Oct 31 17:30:48.450275 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:48.450281    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/cad20c98-5623-459c-9633-35de91881dc9-kube-api-access-j2rhg\" (UniqueName: \"kubernetes.io/projected/cad20c98-5623-459c-9633-35de91881dc9-kube-api-access-j2rhg\") pod \"cad20c98-5623-459c-9633-35de91881dc9\" (UID: \"cad20c98-5623-459c-9633-35de91881dc9\") "
Oct 31 17:30:48.450521 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:48.450318    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/cad20c98-5623-459c-9633-35de91881dc9-bundle\" (UniqueName: \"kubernetes.io/empty-dir/cad20c98-5623-459c-9633-35de91881dc9-bundle\") pod \"cad20c98-5623-459c-9633-35de91881dc9\" (UID: \"cad20c98-5623-459c-9633-35de91881dc9\") "
Oct 31 17:30:48.451051 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:48.451022    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cad20c98-5623-459c-9633-35de91881dc9-bundle" pod "cad20c98-5623-459c-9633-35de91881dc9" (UID: "cad20c98-5623-459c-9633-35de91881dc9"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 17:30:48.452447 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:48.452418    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cad20c98-5623-459c-9633-35de91881dc9-kube-api-access-j2rhg" pod "cad20c98-5623-459c-9633-35de91881dc9" (UID: "cad20c98-5623-459c-9633-35de91881dc9"). InnerVolumeSpecName "kube-api-access-j2rhg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 17:30:48.455826 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:48.455800    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cad20c98-5623-459c-9633-35de91881dc9-util" pod "cad20c98-5623-459c-9633-35de91881dc9" (UID: "cad20c98-5623-459c-9633-35de91881dc9"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 17:30:48.550978 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:48.550941    5003 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cad20c98-5623-459c-9633-35de91881dc9-util\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:30:48.550978 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:48.550971    5003 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j2rhg\" (UniqueName: \"kubernetes.io/projected/cad20c98-5623-459c-9633-35de91881dc9-kube-api-access-j2rhg\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:30:48.550978 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:48.550985    5003 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cad20c98-5623-459c-9633-35de91881dc9-bundle\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:30:49.213266 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:49.213229    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cxq428" event={"ID":"cad20c98-5623-459c-9633-35de91881dc9","Type":"ContainerDied","Data":"e13a7285f22788df30316db69691b599f0ab19098a8b87c15fee2308f1cc2215"}
Oct 31 17:30:49.213997 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:49.213277    5003 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e13a7285f22788df30316db69691b599f0ab19098a8b87c15fee2308f1cc2215"
Oct 31 17:30:49.213997 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:49.213285    5003 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cxq428"
Oct 31 17:30:59.218898 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:59.218806    5003 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-5778bb4449-d2s7v"]
Oct 31 17:30:59.219381 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:59.219275    5003 cpu_manager.go:414] "containerMap: removing container" podUID="ce0297c8-60bd-4318-ace1-48c28d7b2fc1" containerName="extract"
Oct 31 17:30:59.219381 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:59.219297    5003 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="ce0297c8-60bd-4318-ace1-48c28d7b2fc1" containerName="extract"
Oct 31 17:30:59.219381 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:59.219313    5003 cpu_manager.go:414] "containerMap: removing container" podUID="7f8b7ebd-2dc8-4664-afab-de39e221af75" containerName="pull"
Oct 31 17:30:59.219381 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:59.219318    5003 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="7f8b7ebd-2dc8-4664-afab-de39e221af75" containerName="pull"
Oct 31 17:30:59.219381 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:59.219326    5003 cpu_manager.go:414] "containerMap: removing container" podUID="6e5dce76-55b6-4c27-ac80-3ee3d6310061" containerName="extract"
Oct 31 17:30:59.219381 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:59.219331    5003 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="6e5dce76-55b6-4c27-ac80-3ee3d6310061" containerName="extract"
Oct 31 17:30:59.219381 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:59.219341    5003 cpu_manager.go:414] "containerMap: removing container" podUID="6e5dce76-55b6-4c27-ac80-3ee3d6310061" containerName="pull"
Oct 31 17:30:59.219381 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:59.219346    5003 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="6e5dce76-55b6-4c27-ac80-3ee3d6310061" containerName="pull"
Oct 31 17:30:59.219381 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:59.219355    5003 cpu_manager.go:414] "containerMap: removing container" podUID="63b287e5-9291-47b5-9033-e117583a4ad7" containerName="extract"
Oct 31 17:30:59.219381 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:59.219361    5003 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="63b287e5-9291-47b5-9033-e117583a4ad7" containerName="extract"
Oct 31 17:30:59.219381 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:59.219368    5003 cpu_manager.go:414] "containerMap: removing container" podUID="ce0297c8-60bd-4318-ace1-48c28d7b2fc1" containerName="pull"
Oct 31 17:30:59.219381 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:59.219373    5003 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="ce0297c8-60bd-4318-ace1-48c28d7b2fc1" containerName="pull"
Oct 31 17:30:59.219381 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:59.219379    5003 cpu_manager.go:414] "containerMap: removing container" podUID="7f8b7ebd-2dc8-4664-afab-de39e221af75" containerName="extract"
Oct 31 17:30:59.219381 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:59.219384    5003 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="7f8b7ebd-2dc8-4664-afab-de39e221af75" containerName="extract"
Oct 31 17:30:59.219816 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:59.219392    5003 cpu_manager.go:414] "containerMap: removing container" podUID="de955af9-a688-4c00-afd3-46504ed014b8" containerName="util"
Oct 31 17:30:59.219816 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:59.219397    5003 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="de955af9-a688-4c00-afd3-46504ed014b8" containerName="util"
Oct 31 17:30:59.219816 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:59.219403    5003 cpu_manager.go:414] "containerMap: removing container" podUID="8e2e4bac-15eb-40b0-9b6a-d03fa7aa0d03" containerName="util"
Oct 31 17:30:59.219816 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:59.219408    5003 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="8e2e4bac-15eb-40b0-9b6a-d03fa7aa0d03" containerName="util"
Oct 31 17:30:59.219816 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:59.219413    5003 cpu_manager.go:414] "containerMap: removing container" podUID="b13c5afb-a308-498c-99a5-903018a493a1" containerName="pull"
Oct 31 17:30:59.219816 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:59.219417    5003 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="b13c5afb-a308-498c-99a5-903018a493a1" containerName="pull"
Oct 31 17:30:59.219816 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:59.219422    5003 cpu_manager.go:414] "containerMap: removing container" podUID="b13c5afb-a308-498c-99a5-903018a493a1" containerName="extract"
Oct 31 17:30:59.219816 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:59.219426    5003 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="b13c5afb-a308-498c-99a5-903018a493a1" containerName="extract"
Oct 31 17:30:59.219816 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:59.219432    5003 cpu_manager.go:414] "containerMap: removing container" podUID="b13c5afb-a308-498c-99a5-903018a493a1" containerName="util"
Oct 31 17:30:59.219816 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:59.219436    5003 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="b13c5afb-a308-498c-99a5-903018a493a1" containerName="util"
Oct 31 17:30:59.219816 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:59.219445    5003 cpu_manager.go:414] "containerMap: removing container" podUID="ce0297c8-60bd-4318-ace1-48c28d7b2fc1" containerName="util"
Oct 31 17:30:59.219816 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:59.219449    5003 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="ce0297c8-60bd-4318-ace1-48c28d7b2fc1" containerName="util"
Oct 31 17:30:59.219816 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:59.219458    5003 cpu_manager.go:414] "containerMap: removing container" podUID="cad20c98-5623-459c-9633-35de91881dc9" containerName="extract"
Oct 31 17:30:59.219816 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:59.219462    5003 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="cad20c98-5623-459c-9633-35de91881dc9" containerName="extract"
Oct 31 17:30:59.219816 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:59.219469    5003 cpu_manager.go:414] "containerMap: removing container" podUID="63b287e5-9291-47b5-9033-e117583a4ad7" containerName="util"
Oct 31 17:30:59.219816 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:59.219473    5003 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="63b287e5-9291-47b5-9033-e117583a4ad7" containerName="util"
Oct 31 17:30:59.219816 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:59.219479    5003 cpu_manager.go:414] "containerMap: removing container" podUID="6e5dce76-55b6-4c27-ac80-3ee3d6310061" containerName="util"
Oct 31 17:30:59.219816 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:59.219485    5003 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="6e5dce76-55b6-4c27-ac80-3ee3d6310061" containerName="util"
Oct 31 17:30:59.219816 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:59.219490    5003 cpu_manager.go:414] "containerMap: removing container" podUID="de955af9-a688-4c00-afd3-46504ed014b8" containerName="pull"
Oct 31 17:30:59.219816 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:59.219495    5003 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="de955af9-a688-4c00-afd3-46504ed014b8" containerName="pull"
Oct 31 17:30:59.219816 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:59.219500    5003 cpu_manager.go:414] "containerMap: removing container" podUID="8e2e4bac-15eb-40b0-9b6a-d03fa7aa0d03" containerName="pull"
Oct 31 17:30:59.219816 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:59.219504    5003 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="8e2e4bac-15eb-40b0-9b6a-d03fa7aa0d03" containerName="pull"
Oct 31 17:30:59.219816 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:59.219512    5003 cpu_manager.go:414] "containerMap: removing container" podUID="cad20c98-5623-459c-9633-35de91881dc9" containerName="util"
Oct 31 17:30:59.219816 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:59.219516    5003 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="cad20c98-5623-459c-9633-35de91881dc9" containerName="util"
Oct 31 17:30:59.219816 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:59.219522    5003 cpu_manager.go:414] "containerMap: removing container" podUID="8e2e4bac-15eb-40b0-9b6a-d03fa7aa0d03" containerName="extract"
Oct 31 17:30:59.219816 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:59.219527    5003 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="8e2e4bac-15eb-40b0-9b6a-d03fa7aa0d03" containerName="extract"
Oct 31 17:30:59.219816 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:59.219535    5003 cpu_manager.go:414] "containerMap: removing container" podUID="de955af9-a688-4c00-afd3-46504ed014b8" containerName="extract"
Oct 31 17:30:59.219816 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:59.219539    5003 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="de955af9-a688-4c00-afd3-46504ed014b8" containerName="extract"
Oct 31 17:30:59.219816 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:59.219545    5003 cpu_manager.go:414] "containerMap: removing container" podUID="7f8b7ebd-2dc8-4664-afab-de39e221af75" containerName="util"
Oct 31 17:30:59.219816 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:59.219549    5003 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="7f8b7ebd-2dc8-4664-afab-de39e221af75" containerName="util"
Oct 31 17:30:59.219816 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:59.219557    5003 cpu_manager.go:414] "containerMap: removing container" podUID="63b287e5-9291-47b5-9033-e117583a4ad7" containerName="pull"
Oct 31 17:30:59.219816 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:59.219561    5003 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="63b287e5-9291-47b5-9033-e117583a4ad7" containerName="pull"
Oct 31 17:30:59.219816 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:59.219566    5003 cpu_manager.go:414] "containerMap: removing container" podUID="cad20c98-5623-459c-9633-35de91881dc9" containerName="pull"
Oct 31 17:30:59.219816 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:59.219570    5003 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="cad20c98-5623-459c-9633-35de91881dc9" containerName="pull"
Oct 31 17:30:59.219816 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:59.219619    5003 memory_manager.go:365] "RemoveStaleState removing state" podUID="cad20c98-5623-459c-9633-35de91881dc9" containerName="extract"
Oct 31 17:30:59.219816 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:59.219627    5003 memory_manager.go:365] "RemoveStaleState removing state" podUID="8e2e4bac-15eb-40b0-9b6a-d03fa7aa0d03" containerName="extract"
Oct 31 17:30:59.219816 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:59.219633    5003 memory_manager.go:365] "RemoveStaleState removing state" podUID="de955af9-a688-4c00-afd3-46504ed014b8" containerName="extract"
Oct 31 17:30:59.219816 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:59.219638    5003 memory_manager.go:365] "RemoveStaleState removing state" podUID="ce0297c8-60bd-4318-ace1-48c28d7b2fc1" containerName="extract"
Oct 31 17:30:59.219816 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:59.219661    5003 memory_manager.go:365] "RemoveStaleState removing state" podUID="6e5dce76-55b6-4c27-ac80-3ee3d6310061" containerName="extract"
Oct 31 17:30:59.219816 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:59.219668    5003 memory_manager.go:365] "RemoveStaleState removing state" podUID="63b287e5-9291-47b5-9033-e117583a4ad7" containerName="extract"
Oct 31 17:30:59.219816 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:59.219674    5003 memory_manager.go:365] "RemoveStaleState removing state" podUID="7f8b7ebd-2dc8-4664-afab-de39e221af75" containerName="extract"
Oct 31 17:30:59.219816 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:59.219680    5003 memory_manager.go:365] "RemoveStaleState removing state" podUID="b13c5afb-a308-498c-99a5-903018a493a1" containerName="extract"
Oct 31 17:30:59.222396 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:59.222380    5003 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-5778bb4449-d2s7v"
Oct 31 17:30:59.239538 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:59.239499    5003 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Oct 31 17:30:59.241312 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:59.241290    5003 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-5778bb4449-d2s7v"]
Oct 31 17:30:59.251602 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:59.251566    5003 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Oct 31 17:30:59.251783 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:59.251663    5003 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-gbkhn\""
Oct 31 17:30:59.336835 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:59.336793    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bpb28\" (UniqueName: \"kubernetes.io/projected/59a4028e-1e9f-4bc1-8ebb-5db28ed51fdc-kube-api-access-bpb28\") pod \"limitador-operator-controller-manager-5778bb4449-d2s7v\" (UID: \"59a4028e-1e9f-4bc1-8ebb-5db28ed51fdc\") " pod="kuadrant-system/limitador-operator-controller-manager-5778bb4449-d2s7v"
Oct 31 17:30:59.438118 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:59.438054    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bpb28\" (UniqueName: \"kubernetes.io/projected/59a4028e-1e9f-4bc1-8ebb-5db28ed51fdc-kube-api-access-bpb28\") pod \"limitador-operator-controller-manager-5778bb4449-d2s7v\" (UID: \"59a4028e-1e9f-4bc1-8ebb-5db28ed51fdc\") " pod="kuadrant-system/limitador-operator-controller-manager-5778bb4449-d2s7v"
Oct 31 17:30:59.462676 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:59.462610    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bpb28\" (UniqueName: \"kubernetes.io/projected/59a4028e-1e9f-4bc1-8ebb-5db28ed51fdc-kube-api-access-bpb28\") pod \"limitador-operator-controller-manager-5778bb4449-d2s7v\" (UID: \"59a4028e-1e9f-4bc1-8ebb-5db28ed51fdc\") " pod="kuadrant-system/limitador-operator-controller-manager-5778bb4449-d2s7v"
Oct 31 17:30:59.535130 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:59.535042    5003 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-5778bb4449-d2s7v"
Oct 31 17:30:59.840433 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:30:59.840400    5003 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-5778bb4449-d2s7v"]
Oct 31 17:30:59.845033 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:30:59.844989    5003 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod59a4028e_1e9f_4bc1_8ebb_5db28ed51fdc.slice/crio-35b9096badc5e30a4806a66beb501e35deeb9886a25f2200d079ded868ea0ad4 WatchSource:0}: Error finding container 35b9096badc5e30a4806a66beb501e35deeb9886a25f2200d079ded868ea0ad4: Status 404 returned error can't find the container with id 35b9096badc5e30a4806a66beb501e35deeb9886a25f2200d079ded868ea0ad4
Oct 31 17:31:00.264605 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:31:00.264523    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-5778bb4449-d2s7v" event={"ID":"59a4028e-1e9f-4bc1-8ebb-5db28ed51fdc","Type":"ContainerStarted","Data":"35b9096badc5e30a4806a66beb501e35deeb9886a25f2200d079ded868ea0ad4"}
Oct 31 17:31:01.018810 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:31:01.018776    5003 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub-operator-system/opendatahub-operator-controller-manager-75767875db-djjss"]
Oct 31 17:31:01.026732 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:31:01.025089    5003 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-75767875db-djjss"
Oct 31 17:31:01.040500 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:31:01.040473    5003 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub-operator-system\"/\"opendatahub-operator-controller-manager-service-cert\""
Oct 31 17:31:01.040500 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:31:01.040474    5003 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub-operator-system\"/\"opendatahub-operator-controller-webhook-cert\""
Oct 31 17:31:01.040717 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:31:01.040572    5003 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub-operator-system\"/\"opendatahub-operator-metrics-tls\""
Oct 31 17:31:01.040717 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:31:01.040590    5003 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub-operator-system\"/\"opendatahub-operator-controller-manager-dockercfg-wsnj7\""
Oct 31 17:31:01.050996 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:31:01.050964    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7620714c-7f53-48c5-a4e0-12db220b0d56-webhook-cert\") pod \"opendatahub-operator-controller-manager-75767875db-djjss\" (UID: \"7620714c-7f53-48c5-a4e0-12db220b0d56\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-75767875db-djjss"
Oct 31 17:31:01.051109 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:31:01.050996    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/7620714c-7f53-48c5-a4e0-12db220b0d56-manifests\") pod \"opendatahub-operator-controller-manager-75767875db-djjss\" (UID: \"7620714c-7f53-48c5-a4e0-12db220b0d56\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-75767875db-djjss"
Oct 31 17:31:01.051109 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:31:01.051019    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/7620714c-7f53-48c5-a4e0-12db220b0d56-metrics-cert\") pod \"opendatahub-operator-controller-manager-75767875db-djjss\" (UID: \"7620714c-7f53-48c5-a4e0-12db220b0d56\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-75767875db-djjss"
Oct 31 17:31:01.051109 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:31:01.051085    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/7620714c-7f53-48c5-a4e0-12db220b0d56-apiservice-cert\") pod \"opendatahub-operator-controller-manager-75767875db-djjss\" (UID: \"7620714c-7f53-48c5-a4e0-12db220b0d56\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-75767875db-djjss"
Oct 31 17:31:01.051218 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:31:01.051122    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7620714c-7f53-48c5-a4e0-12db220b0d56-tmp\") pod \"opendatahub-operator-controller-manager-75767875db-djjss\" (UID: \"7620714c-7f53-48c5-a4e0-12db220b0d56\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-75767875db-djjss"
Oct 31 17:31:01.051218 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:31:01.051148    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n9fmf\" (UniqueName: \"kubernetes.io/projected/7620714c-7f53-48c5-a4e0-12db220b0d56-kube-api-access-n9fmf\") pod \"opendatahub-operator-controller-manager-75767875db-djjss\" (UID: \"7620714c-7f53-48c5-a4e0-12db220b0d56\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-75767875db-djjss"
Oct 31 17:31:01.052194 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:31:01.052172    5003 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub-operator-system\"/\"kube-root-ca.crt\""
Oct 31 17:31:01.052290 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:31:01.052201    5003 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub-operator-system\"/\"openshift-service-ca.crt\""
Oct 31 17:31:01.077066 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:31:01.077039    5003 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub-operator-system/opendatahub-operator-controller-manager-75767875db-djjss"]
Oct 31 17:31:01.152144 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:31:01.152097    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7620714c-7f53-48c5-a4e0-12db220b0d56-webhook-cert\") pod \"opendatahub-operator-controller-manager-75767875db-djjss\" (UID: \"7620714c-7f53-48c5-a4e0-12db220b0d56\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-75767875db-djjss"
Oct 31 17:31:01.152144 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:31:01.152142    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/7620714c-7f53-48c5-a4e0-12db220b0d56-manifests\") pod \"opendatahub-operator-controller-manager-75767875db-djjss\" (UID: \"7620714c-7f53-48c5-a4e0-12db220b0d56\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-75767875db-djjss"
Oct 31 17:31:01.152373 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:31:01.152167    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/7620714c-7f53-48c5-a4e0-12db220b0d56-metrics-cert\") pod \"opendatahub-operator-controller-manager-75767875db-djjss\" (UID: \"7620714c-7f53-48c5-a4e0-12db220b0d56\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-75767875db-djjss"
Oct 31 17:31:01.152373 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:31:01.152285    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/7620714c-7f53-48c5-a4e0-12db220b0d56-apiservice-cert\") pod \"opendatahub-operator-controller-manager-75767875db-djjss\" (UID: \"7620714c-7f53-48c5-a4e0-12db220b0d56\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-75767875db-djjss"
Oct 31 17:31:01.152373 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:31:01.152352    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7620714c-7f53-48c5-a4e0-12db220b0d56-tmp\") pod \"opendatahub-operator-controller-manager-75767875db-djjss\" (UID: \"7620714c-7f53-48c5-a4e0-12db220b0d56\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-75767875db-djjss"
Oct 31 17:31:01.152487 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:31:01.152386    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n9fmf\" (UniqueName: \"kubernetes.io/projected/7620714c-7f53-48c5-a4e0-12db220b0d56-kube-api-access-n9fmf\") pod \"opendatahub-operator-controller-manager-75767875db-djjss\" (UID: \"7620714c-7f53-48c5-a4e0-12db220b0d56\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-75767875db-djjss"
Oct 31 17:31:01.152597 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:31:01.152569    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/7620714c-7f53-48c5-a4e0-12db220b0d56-manifests\") pod \"opendatahub-operator-controller-manager-75767875db-djjss\" (UID: \"7620714c-7f53-48c5-a4e0-12db220b0d56\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-75767875db-djjss"
Oct 31 17:31:01.154735 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:31:01.154708    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7620714c-7f53-48c5-a4e0-12db220b0d56-tmp\") pod \"opendatahub-operator-controller-manager-75767875db-djjss\" (UID: \"7620714c-7f53-48c5-a4e0-12db220b0d56\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-75767875db-djjss"
Oct 31 17:31:01.155010 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:31:01.154993    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7620714c-7f53-48c5-a4e0-12db220b0d56-webhook-cert\") pod \"opendatahub-operator-controller-manager-75767875db-djjss\" (UID: \"7620714c-7f53-48c5-a4e0-12db220b0d56\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-75767875db-djjss"
Oct 31 17:31:01.155084 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:31:01.154993    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/7620714c-7f53-48c5-a4e0-12db220b0d56-metrics-cert\") pod \"opendatahub-operator-controller-manager-75767875db-djjss\" (UID: \"7620714c-7f53-48c5-a4e0-12db220b0d56\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-75767875db-djjss"
Oct 31 17:31:01.155084 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:31:01.155024    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/7620714c-7f53-48c5-a4e0-12db220b0d56-apiservice-cert\") pod \"opendatahub-operator-controller-manager-75767875db-djjss\" (UID: \"7620714c-7f53-48c5-a4e0-12db220b0d56\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-75767875db-djjss"
Oct 31 17:31:01.173319 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:31:01.173294    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n9fmf\" (UniqueName: \"kubernetes.io/projected/7620714c-7f53-48c5-a4e0-12db220b0d56-kube-api-access-n9fmf\") pod \"opendatahub-operator-controller-manager-75767875db-djjss\" (UID: \"7620714c-7f53-48c5-a4e0-12db220b0d56\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-75767875db-djjss"
Oct 31 17:31:01.344370 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:31:01.344326    5003 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-75767875db-djjss"
Oct 31 17:31:01.683960 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:31:01.683929    5003 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7620714c_7f53_48c5_a4e0_12db220b0d56.slice/crio-b43f08799cfb343e95acde4195bb91e097543aa4e9364b485b0990170b79c008 WatchSource:0}: Error finding container b43f08799cfb343e95acde4195bb91e097543aa4e9364b485b0990170b79c008: Status 404 returned error can't find the container with id b43f08799cfb343e95acde4195bb91e097543aa4e9364b485b0990170b79c008
Oct 31 17:31:01.691766 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:31:01.691348    5003 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub-operator-system/opendatahub-operator-controller-manager-75767875db-djjss"]
Oct 31 17:31:02.280261 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:31:02.280170    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-75767875db-djjss" event={"ID":"7620714c-7f53-48c5-a4e0-12db220b0d56","Type":"ContainerStarted","Data":"b43f08799cfb343e95acde4195bb91e097543aa4e9364b485b0990170b79c008"}
Oct 31 17:31:04.200236 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:31:04.200154    5003 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-7b7bb4bc77-fnjvs"]
Oct 31 17:31:04.204573 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:31:04.204547    5003 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-7b7bb4bc77-fnjvs"
Oct 31 17:31:04.226581 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:31:04.226552    5003 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-4wr62\""
Oct 31 17:31:04.236822 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:31:04.236788    5003 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-7b7bb4bc77-fnjvs"]
Oct 31 17:31:04.282952 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:31:04.282904    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-445gn\" (UniqueName: \"kubernetes.io/projected/1e05cbb8-2102-41b9-adcd-ad0dd16bbd97-kube-api-access-445gn\") pod \"authorino-operator-7b7bb4bc77-fnjvs\" (UID: \"1e05cbb8-2102-41b9-adcd-ad0dd16bbd97\") " pod="kuadrant-system/authorino-operator-7b7bb4bc77-fnjvs"
Oct 31 17:31:04.295116 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:31:04.295081    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-5778bb4449-d2s7v" event={"ID":"59a4028e-1e9f-4bc1-8ebb-5db28ed51fdc","Type":"ContainerStarted","Data":"8021b948fba58bf0538141e5da6fffc450242a19b68c84be78d932226679a66c"}
Oct 31 17:31:04.295275 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:31:04.295195    5003 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-5778bb4449-d2s7v"
Oct 31 17:31:04.335404 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:31:04.335308    5003 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-5778bb4449-d2s7v" podStartSLOduration=1.368199618 podStartE2EDuration="5.335291243s" totalImagesPullingTime="3.967091625s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 17:30:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 17:31:04.33416839 +0000 UTC m=+232.589022935" watchObservedRunningTime="2026-10-31 17:31:04.335291243 +0000 UTC m=+232.590145776"
Oct 31 17:31:04.383636 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:31:04.383596    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-445gn\" (UniqueName: \"kubernetes.io/projected/1e05cbb8-2102-41b9-adcd-ad0dd16bbd97-kube-api-access-445gn\") pod \"authorino-operator-7b7bb4bc77-fnjvs\" (UID: \"1e05cbb8-2102-41b9-adcd-ad0dd16bbd97\") " pod="kuadrant-system/authorino-operator-7b7bb4bc77-fnjvs"
Oct 31 17:31:04.405619 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:31:04.405582    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-445gn\" (UniqueName: \"kubernetes.io/projected/1e05cbb8-2102-41b9-adcd-ad0dd16bbd97-kube-api-access-445gn\") pod \"authorino-operator-7b7bb4bc77-fnjvs\" (UID: \"1e05cbb8-2102-41b9-adcd-ad0dd16bbd97\") " pod="kuadrant-system/authorino-operator-7b7bb4bc77-fnjvs"
Oct 31 17:31:04.519583 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:31:04.519505    5003 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-7b7bb4bc77-fnjvs"
Oct 31 17:31:04.834984 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:31:04.834961    5003 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-7b7bb4bc77-fnjvs"]
Oct 31 17:31:04.851886 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:31:04.851859    5003 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1e05cbb8_2102_41b9_adcd_ad0dd16bbd97.slice/crio-3caf8e13d28cef2f86240d36605f566d2eb6e9ce2714130118c8f2407461e543 WatchSource:0}: Error finding container 3caf8e13d28cef2f86240d36605f566d2eb6e9ce2714130118c8f2407461e543: Status 404 returned error can't find the container with id 3caf8e13d28cef2f86240d36605f566d2eb6e9ce2714130118c8f2407461e543
Oct 31 17:31:05.301379 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:31:05.301283    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-75767875db-djjss" event={"ID":"7620714c-7f53-48c5-a4e0-12db220b0d56","Type":"ContainerStarted","Data":"ee2291885c1c261877fb6d9cc4f3e7eef6dbd1fc48441b66c7f8a0d6c8287a41"}
Oct 31 17:31:05.302705 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:31:05.302681    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-7b7bb4bc77-fnjvs" event={"ID":"1e05cbb8-2102-41b9-adcd-ad0dd16bbd97","Type":"ContainerStarted","Data":"3caf8e13d28cef2f86240d36605f566d2eb6e9ce2714130118c8f2407461e543"}
Oct 31 17:31:06.309369 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:31:06.309334    5003 generic.go:356] "Generic (PLEG): container finished" podID="7620714c-7f53-48c5-a4e0-12db220b0d56" containerID="ee2291885c1c261877fb6d9cc4f3e7eef6dbd1fc48441b66c7f8a0d6c8287a41" exitCode=0
Oct 31 17:31:06.309748 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:31:06.309414    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-75767875db-djjss" event={"ID":"7620714c-7f53-48c5-a4e0-12db220b0d56","Type":"ContainerDied","Data":"ee2291885c1c261877fb6d9cc4f3e7eef6dbd1fc48441b66c7f8a0d6c8287a41"}
Oct 31 17:31:07.315396 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:31:07.315358    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-7b7bb4bc77-fnjvs" event={"ID":"1e05cbb8-2102-41b9-adcd-ad0dd16bbd97","Type":"ContainerStarted","Data":"e1b8f2fba84cb432b1e1e03fc770c4860518130aab03b1ec8cce9d369eb99ef6"}
Oct 31 17:31:07.315922 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:31:07.315471    5003 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-7b7bb4bc77-fnjvs"
Oct 31 17:31:07.317421 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:31:07.317396    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-75767875db-djjss" event={"ID":"7620714c-7f53-48c5-a4e0-12db220b0d56","Type":"ContainerStarted","Data":"48bed95991974d50a3f95087b6499bf3eca681e32d58c89f6d031e16a1d09b9d"}
Oct 31 17:31:07.317544 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:31:07.317526    5003 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-75767875db-djjss"
Oct 31 17:31:07.357492 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:31:07.357441    5003 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-7b7bb4bc77-fnjvs" podStartSLOduration=1.922737953 podStartE2EDuration="3.357428987s" totalImagesPullingTime="1.434691034s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 17:31:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 17:31:07.356255786 +0000 UTC m=+235.611110328" watchObservedRunningTime="2026-10-31 17:31:07.357428987 +0000 UTC m=+235.612283528"
Oct 31 17:31:07.442084 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:31:07.442028    5003 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-75767875db-djjss" podStartSLOduration=3.477923972 podStartE2EDuration="7.44201227s" totalImagesPullingTime="3.494495729s" totalInitContainerRuntime="469.592569ms" isStatefulPod=false podCreationTimestamp="2026-10-31 17:31:00 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 17:31:07.435365443 +0000 UTC m=+235.690219986" watchObservedRunningTime="2026-10-31 17:31:07.44201227 +0000 UTC m=+235.696866812"
Oct 31 17:31:10.331185 ip-10-0-138-17 kubenswrapper[5003]: E1031 17:31:10.331149    5003 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-tdzz5" containerName="extractor"
Oct 31 17:31:12.718502 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:31:12.718465    5003 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-n5ltz"]
Oct 31 17:31:12.760334 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:31:12.760302    5003 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-n5ltz"]
Oct 31 17:31:12.760487 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:31:12.760400    5003 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-n5ltz"
Oct 31 17:31:12.774589 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:31:12.774564    5003 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\""
Oct 31 17:31:12.774739 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:31:12.774697    5003 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-mqrw5\""
Oct 31 17:31:12.774789 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:31:12.774738    5003 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\""
Oct 31 17:31:12.858010 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:31:12.857961    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/094bdc62-5f80-4190-bd1c-a29eeedff50e-tmp\") pod \"cert-manager-operator-controller-manager-7d87bcd5fd-n5ltz\" (UID: \"094bdc62-5f80-4190-bd1c-a29eeedff50e\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-n5ltz"
Oct 31 17:31:12.858184 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:31:12.858028    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5hqcg\" (UniqueName: \"kubernetes.io/projected/094bdc62-5f80-4190-bd1c-a29eeedff50e-kube-api-access-5hqcg\") pod \"cert-manager-operator-controller-manager-7d87bcd5fd-n5ltz\" (UID: \"094bdc62-5f80-4190-bd1c-a29eeedff50e\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-n5ltz"
Oct 31 17:31:12.958552 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:31:12.958511    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/094bdc62-5f80-4190-bd1c-a29eeedff50e-tmp\") pod \"cert-manager-operator-controller-manager-7d87bcd5fd-n5ltz\" (UID: \"094bdc62-5f80-4190-bd1c-a29eeedff50e\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-n5ltz"
Oct 31 17:31:12.958733 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:31:12.958563    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5hqcg\" (UniqueName: \"kubernetes.io/projected/094bdc62-5f80-4190-bd1c-a29eeedff50e-kube-api-access-5hqcg\") pod \"cert-manager-operator-controller-manager-7d87bcd5fd-n5ltz\" (UID: \"094bdc62-5f80-4190-bd1c-a29eeedff50e\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-n5ltz"
Oct 31 17:31:12.958992 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:31:12.958972    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/094bdc62-5f80-4190-bd1c-a29eeedff50e-tmp\") pod \"cert-manager-operator-controller-manager-7d87bcd5fd-n5ltz\" (UID: \"094bdc62-5f80-4190-bd1c-a29eeedff50e\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-n5ltz"
Oct 31 17:31:12.978924 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:31:12.978851    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5hqcg\" (UniqueName: \"kubernetes.io/projected/094bdc62-5f80-4190-bd1c-a29eeedff50e-kube-api-access-5hqcg\") pod \"cert-manager-operator-controller-manager-7d87bcd5fd-n5ltz\" (UID: \"094bdc62-5f80-4190-bd1c-a29eeedff50e\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-n5ltz"
Oct 31 17:31:13.090200 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:31:13.090160    5003 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-n5ltz"
Oct 31 17:31:13.434890 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:31:13.434855    5003 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-n5ltz"]
Oct 31 17:31:13.441445 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:31:13.441414    5003 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod094bdc62_5f80_4190_bd1c_a29eeedff50e.slice/crio-f6bc994d64b7e7a303b3c795205d39971feed13839fe3e48b8e282ecf78bd172 WatchSource:0}: Error finding container f6bc994d64b7e7a303b3c795205d39971feed13839fe3e48b8e282ecf78bd172: Status 404 returned error can't find the container with id f6bc994d64b7e7a303b3c795205d39971feed13839fe3e48b8e282ecf78bd172
Oct 31 17:31:14.352095 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:31:14.352060    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-n5ltz" event={"ID":"094bdc62-5f80-4190-bd1c-a29eeedff50e","Type":"ContainerStarted","Data":"f6bc994d64b7e7a303b3c795205d39971feed13839fe3e48b8e282ecf78bd172"}
Oct 31 17:31:15.305368 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:31:15.305336    5003 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-5778bb4449-d2s7v"
Oct 31 17:31:16.366250 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:31:16.366209    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-n5ltz" event={"ID":"094bdc62-5f80-4190-bd1c-a29eeedff50e","Type":"ContainerStarted","Data":"9b96da3a89e60db26dfe7ae78f7e9930af528c1a8001d3cefb0608c6d026ce7f"}
Oct 31 17:31:16.435078 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:31:16.435018    5003 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-n5ltz" podStartSLOduration=1.945238198 podStartE2EDuration="4.434999382s" totalImagesPullingTime="2.489761184s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 17:31:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 17:31:16.420839492 +0000 UTC m=+244.675694035" watchObservedRunningTime="2026-10-31 17:31:16.434999382 +0000 UTC m=+244.689853922"
Oct 31 17:31:16.572120 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:31:16.572082    5003 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-8557cbdb84-vmqpq"]
Oct 31 17:31:16.574393 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:31:16.574377    5003 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-8557cbdb84-vmqpq"
Oct 31 17:31:16.606318 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:31:16.606293    5003 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Oct 31 17:31:16.606487 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:31:16.606377    5003 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-6tx6j\""
Oct 31 17:31:16.609543 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:31:16.609516    5003 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-8557cbdb84-vmqpq"]
Oct 31 17:31:16.692871 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:31:16.692590    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wghdd\" (UniqueName: \"kubernetes.io/projected/82b3225d-4b28-457f-b41b-284758aaf104-kube-api-access-wghdd\") pod \"dns-operator-controller-manager-8557cbdb84-vmqpq\" (UID: \"82b3225d-4b28-457f-b41b-284758aaf104\") " pod="kuadrant-system/dns-operator-controller-manager-8557cbdb84-vmqpq"
Oct 31 17:31:16.793561 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:31:16.793526    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wghdd\" (UniqueName: \"kubernetes.io/projected/82b3225d-4b28-457f-b41b-284758aaf104-kube-api-access-wghdd\") pod \"dns-operator-controller-manager-8557cbdb84-vmqpq\" (UID: \"82b3225d-4b28-457f-b41b-284758aaf104\") " pod="kuadrant-system/dns-operator-controller-manager-8557cbdb84-vmqpq"
Oct 31 17:31:16.813140 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:31:16.813107    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wghdd\" (UniqueName: \"kubernetes.io/projected/82b3225d-4b28-457f-b41b-284758aaf104-kube-api-access-wghdd\") pod \"dns-operator-controller-manager-8557cbdb84-vmqpq\" (UID: \"82b3225d-4b28-457f-b41b-284758aaf104\") " pod="kuadrant-system/dns-operator-controller-manager-8557cbdb84-vmqpq"
Oct 31 17:31:16.886272 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:31:16.886238    5003 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-8557cbdb84-vmqpq"
Oct 31 17:31:17.189309 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:31:17.189275    5003 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-8557cbdb84-vmqpq"]
Oct 31 17:31:17.193497 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:31:17.193469    5003 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod82b3225d_4b28_457f_b41b_284758aaf104.slice/crio-28bfd5944f49dc0ef6247e6e01151a951066216862db681694cc82dbe1717ff7 WatchSource:0}: Error finding container 28bfd5944f49dc0ef6247e6e01151a951066216862db681694cc82dbe1717ff7: Status 404 returned error can't find the container with id 28bfd5944f49dc0ef6247e6e01151a951066216862db681694cc82dbe1717ff7
Oct 31 17:31:17.372941 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:31:17.372904    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-8557cbdb84-vmqpq" event={"ID":"82b3225d-4b28-457f-b41b-284758aaf104","Type":"ContainerStarted","Data":"28bfd5944f49dc0ef6247e6e01151a951066216862db681694cc82dbe1717ff7"}
Oct 31 17:31:18.324577 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:31:18.324534    5003 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-7b7bb4bc77-fnjvs"
Oct 31 17:31:18.324779 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:31:18.324630    5003 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-75767875db-djjss"
Oct 31 17:31:20.434180 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:31:20.434146    5003 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-5c57bbd4fc-zxbbx"]
Oct 31 17:31:20.436522 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:31:20.436506    5003 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-5c57bbd4fc-zxbbx"
Oct 31 17:31:20.453589 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:31:20.453568    5003 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Oct 31 17:31:20.455355 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:31:20.455329    5003 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-5c57bbd4fc-zxbbx"]
Oct 31 17:31:20.465619 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:31:20.465594    5003 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-4m7vl\""
Oct 31 17:31:20.465619 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:31:20.465610    5003 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Oct 31 17:31:20.528798 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:31:20.528719    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7rv6g\" (UniqueName: \"kubernetes.io/projected/23647991-ebcc-4db6-a718-869ba4e79736-kube-api-access-7rv6g\") pod \"cert-manager-cainjector-5c57bbd4fc-zxbbx\" (UID: \"23647991-ebcc-4db6-a718-869ba4e79736\") " pod="cert-manager/cert-manager-cainjector-5c57bbd4fc-zxbbx"
Oct 31 17:31:20.528798 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:31:20.528795    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/23647991-ebcc-4db6-a718-869ba4e79736-bound-sa-token\") pod \"cert-manager-cainjector-5c57bbd4fc-zxbbx\" (UID: \"23647991-ebcc-4db6-a718-869ba4e79736\") " pod="cert-manager/cert-manager-cainjector-5c57bbd4fc-zxbbx"
Oct 31 17:31:20.630025 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:31:20.629988    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7rv6g\" (UniqueName: \"kubernetes.io/projected/23647991-ebcc-4db6-a718-869ba4e79736-kube-api-access-7rv6g\") pod \"cert-manager-cainjector-5c57bbd4fc-zxbbx\" (UID: \"23647991-ebcc-4db6-a718-869ba4e79736\") " pod="cert-manager/cert-manager-cainjector-5c57bbd4fc-zxbbx"
Oct 31 17:31:20.630193 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:31:20.630038    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/23647991-ebcc-4db6-a718-869ba4e79736-bound-sa-token\") pod \"cert-manager-cainjector-5c57bbd4fc-zxbbx\" (UID: \"23647991-ebcc-4db6-a718-869ba4e79736\") " pod="cert-manager/cert-manager-cainjector-5c57bbd4fc-zxbbx"
Oct 31 17:31:20.658298 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:31:20.658270    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/23647991-ebcc-4db6-a718-869ba4e79736-bound-sa-token\") pod \"cert-manager-cainjector-5c57bbd4fc-zxbbx\" (UID: \"23647991-ebcc-4db6-a718-869ba4e79736\") " pod="cert-manager/cert-manager-cainjector-5c57bbd4fc-zxbbx"
Oct 31 17:31:20.658443 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:31:20.658410    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7rv6g\" (UniqueName: \"kubernetes.io/projected/23647991-ebcc-4db6-a718-869ba4e79736-kube-api-access-7rv6g\") pod \"cert-manager-cainjector-5c57bbd4fc-zxbbx\" (UID: \"23647991-ebcc-4db6-a718-869ba4e79736\") " pod="cert-manager/cert-manager-cainjector-5c57bbd4fc-zxbbx"
Oct 31 17:31:20.757825 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:31:20.757759    5003 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-5c57bbd4fc-zxbbx"
Oct 31 17:31:21.057176 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:31:21.057138    5003 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-5c57bbd4fc-zxbbx"]
Oct 31 17:31:21.061849 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:31:21.061806    5003 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod23647991_ebcc_4db6_a718_869ba4e79736.slice/crio-72554d5347080d611bbba408087eb72df776016eeeb4da7d704ce9d0619e5758 WatchSource:0}: Error finding container 72554d5347080d611bbba408087eb72df776016eeeb4da7d704ce9d0619e5758: Status 404 returned error can't find the container with id 72554d5347080d611bbba408087eb72df776016eeeb4da7d704ce9d0619e5758
Oct 31 17:31:21.397310 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:31:21.397268    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-8557cbdb84-vmqpq" event={"ID":"82b3225d-4b28-457f-b41b-284758aaf104","Type":"ContainerStarted","Data":"aaa242ca7638be03f26755c3af809ac56756c1ef65ea4c4af684c41d40dc93fc"}
Oct 31 17:31:21.398853 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:31:21.398826    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-5c57bbd4fc-zxbbx" event={"ID":"23647991-ebcc-4db6-a718-869ba4e79736","Type":"ContainerStarted","Data":"72554d5347080d611bbba408087eb72df776016eeeb4da7d704ce9d0619e5758"}
Oct 31 17:31:22.403613 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:31:22.403577    5003 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-8557cbdb84-vmqpq"
Oct 31 17:31:22.444909 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:31:22.444606    5003 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-8557cbdb84-vmqpq" podStartSLOduration=2.324485275 podStartE2EDuration="6.444590149s" totalImagesPullingTime="4.120104874s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 17:31:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 17:31:22.442021518 +0000 UTC m=+250.696876064" watchObservedRunningTime="2026-10-31 17:31:22.444590149 +0000 UTC m=+250.699444691"
Oct 31 17:31:24.415100 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:31:24.415070    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-5c57bbd4fc-zxbbx" event={"ID":"23647991-ebcc-4db6-a718-869ba4e79736","Type":"ContainerStarted","Data":"152edacfad8963640d1ec02f453667d594ceb4ebfdf2b6bc8493faca398b4432"}
Oct 31 17:31:24.452436 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:31:24.452387    5003 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-5c57bbd4fc-zxbbx" podStartSLOduration=1.937606379 podStartE2EDuration="4.452374949s" totalImagesPullingTime="2.51476857s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 17:31:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 17:31:24.450981042 +0000 UTC m=+252.705835609" watchObservedRunningTime="2026-10-31 17:31:24.452374949 +0000 UTC m=+252.707229491"
Oct 31 17:31:28.096184 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:31:28.096146    5003 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-74dfcfb894-kvr2j"]
Oct 31 17:31:28.100083 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:31:28.100058    5003 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-74dfcfb894-kvr2j"
Oct 31 17:31:28.119830 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:31:28.119793    5003 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-74dfcfb894-kvr2j"]
Oct 31 17:31:28.164473 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:31:28.164446    5003 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-7brdk\""
Oct 31 17:31:28.188037 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:31:28.188003    5003 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Oct 31 17:31:28.201407 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:31:28.201379    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4c7zq\" (UniqueName: \"kubernetes.io/projected/52bedeae-2632-49ca-bdd4-94a2fe603f8f-kube-api-access-4c7zq\") pod \"limitador-limitador-74dfcfb894-kvr2j\" (UID: \"52bedeae-2632-49ca-bdd4-94a2fe603f8f\") " pod="kuadrant-system/limitador-limitador-74dfcfb894-kvr2j"
Oct 31 17:31:28.201546 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:31:28.201422    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/52bedeae-2632-49ca-bdd4-94a2fe603f8f-config-file\") pod \"limitador-limitador-74dfcfb894-kvr2j\" (UID: \"52bedeae-2632-49ca-bdd4-94a2fe603f8f\") " pod="kuadrant-system/limitador-limitador-74dfcfb894-kvr2j"
Oct 31 17:31:28.221753 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:31:28.221719    5003 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-858f55f4d98wwvr"]
Oct 31 17:31:28.225303 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:31:28.225277    5003 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-858f55f4d98wwvr"
Oct 31 17:31:28.226287 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:31:28.226238    5003 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-74dfcfb894-kvr2j"]
Oct 31 17:31:28.250629 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:31:28.250587    5003 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-858f55f4d98wwvr"]
Oct 31 17:31:28.252303 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:31:28.252278    5003 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-5nxdj\""
Oct 31 17:31:28.302705 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:31:28.302675    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4c7zq\" (UniqueName: \"kubernetes.io/projected/52bedeae-2632-49ca-bdd4-94a2fe603f8f-kube-api-access-4c7zq\") pod \"limitador-limitador-74dfcfb894-kvr2j\" (UID: \"52bedeae-2632-49ca-bdd4-94a2fe603f8f\") " pod="kuadrant-system/limitador-limitador-74dfcfb894-kvr2j"
Oct 31 17:31:28.302860 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:31:28.302713    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/52bedeae-2632-49ca-bdd4-94a2fe603f8f-config-file\") pod \"limitador-limitador-74dfcfb894-kvr2j\" (UID: \"52bedeae-2632-49ca-bdd4-94a2fe603f8f\") " pod="kuadrant-system/limitador-limitador-74dfcfb894-kvr2j"
Oct 31 17:31:28.303280 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:31:28.303262    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/52bedeae-2632-49ca-bdd4-94a2fe603f8f-config-file\") pod \"limitador-limitador-74dfcfb894-kvr2j\" (UID: \"52bedeae-2632-49ca-bdd4-94a2fe603f8f\") " pod="kuadrant-system/limitador-limitador-74dfcfb894-kvr2j"
Oct 31 17:31:28.329309 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:31:28.329278    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4c7zq\" (UniqueName: \"kubernetes.io/projected/52bedeae-2632-49ca-bdd4-94a2fe603f8f-kube-api-access-4c7zq\") pod \"limitador-limitador-74dfcfb894-kvr2j\" (UID: \"52bedeae-2632-49ca-bdd4-94a2fe603f8f\") " pod="kuadrant-system/limitador-limitador-74dfcfb894-kvr2j"
Oct 31 17:31:28.404013 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:31:28.403937    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0bb9875d-53a6-4105-89da-16e0bbd2c3a1-istio-data\") pod \"data-science-gateway-data-science-gateway-class-858f55f4d98wwvr\" (UID: \"0bb9875d-53a6-4105-89da-16e0bbd2c3a1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-858f55f4d98wwvr"
Oct 31 17:31:28.404013 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:31:28.403973    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0bb9875d-53a6-4105-89da-16e0bbd2c3a1-istio-token\") pod \"data-science-gateway-data-science-gateway-class-858f55f4d98wwvr\" (UID: \"0bb9875d-53a6-4105-89da-16e0bbd2c3a1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-858f55f4d98wwvr"
Oct 31 17:31:28.404013 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:31:28.403998    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0bb9875d-53a6-4105-89da-16e0bbd2c3a1-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-858f55f4d98wwvr\" (UID: \"0bb9875d-53a6-4105-89da-16e0bbd2c3a1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-858f55f4d98wwvr"
Oct 31 17:31:28.404218 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:31:28.404102    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0bb9875d-53a6-4105-89da-16e0bbd2c3a1-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-858f55f4d98wwvr\" (UID: \"0bb9875d-53a6-4105-89da-16e0bbd2c3a1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-858f55f4d98wwvr"
Oct 31 17:31:28.404218 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:31:28.404137    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wd82g\" (UniqueName: \"kubernetes.io/projected/0bb9875d-53a6-4105-89da-16e0bbd2c3a1-kube-api-access-wd82g\") pod \"data-science-gateway-data-science-gateway-class-858f55f4d98wwvr\" (UID: \"0bb9875d-53a6-4105-89da-16e0bbd2c3a1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-858f55f4d98wwvr"
Oct 31 17:31:28.404218 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:31:28.404194    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0bb9875d-53a6-4105-89da-16e0bbd2c3a1-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-858f55f4d98wwvr\" (UID: \"0bb9875d-53a6-4105-89da-16e0bbd2c3a1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-858f55f4d98wwvr"
Oct 31 17:31:28.404316 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:31:28.404252    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0bb9875d-53a6-4105-89da-16e0bbd2c3a1-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-858f55f4d98wwvr\" (UID: \"0bb9875d-53a6-4105-89da-16e0bbd2c3a1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-858f55f4d98wwvr"
Oct 31 17:31:28.404316 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:31:28.404281    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0bb9875d-53a6-4105-89da-16e0bbd2c3a1-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-858f55f4d98wwvr\" (UID: \"0bb9875d-53a6-4105-89da-16e0bbd2c3a1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-858f55f4d98wwvr"
Oct 31 17:31:28.404383 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:31:28.404331    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0bb9875d-53a6-4105-89da-16e0bbd2c3a1-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-858f55f4d98wwvr\" (UID: \"0bb9875d-53a6-4105-89da-16e0bbd2c3a1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-858f55f4d98wwvr"
Oct 31 17:31:28.412830 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:31:28.412810    5003 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-74dfcfb894-kvr2j"
Oct 31 17:31:28.505469 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:31:28.505413    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0bb9875d-53a6-4105-89da-16e0bbd2c3a1-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-858f55f4d98wwvr\" (UID: \"0bb9875d-53a6-4105-89da-16e0bbd2c3a1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-858f55f4d98wwvr"
Oct 31 17:31:28.505656 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:31:28.505478    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0bb9875d-53a6-4105-89da-16e0bbd2c3a1-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-858f55f4d98wwvr\" (UID: \"0bb9875d-53a6-4105-89da-16e0bbd2c3a1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-858f55f4d98wwvr"
Oct 31 17:31:28.505656 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:31:28.505518    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wd82g\" (UniqueName: \"kubernetes.io/projected/0bb9875d-53a6-4105-89da-16e0bbd2c3a1-kube-api-access-wd82g\") pod \"data-science-gateway-data-science-gateway-class-858f55f4d98wwvr\" (UID: \"0bb9875d-53a6-4105-89da-16e0bbd2c3a1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-858f55f4d98wwvr"
Oct 31 17:31:28.505656 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:31:28.505544    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0bb9875d-53a6-4105-89da-16e0bbd2c3a1-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-858f55f4d98wwvr\" (UID: \"0bb9875d-53a6-4105-89da-16e0bbd2c3a1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-858f55f4d98wwvr"
Oct 31 17:31:28.505656 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:31:28.505604    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0bb9875d-53a6-4105-89da-16e0bbd2c3a1-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-858f55f4d98wwvr\" (UID: \"0bb9875d-53a6-4105-89da-16e0bbd2c3a1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-858f55f4d98wwvr"
Oct 31 17:31:28.505656 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:31:28.505631    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0bb9875d-53a6-4105-89da-16e0bbd2c3a1-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-858f55f4d98wwvr\" (UID: \"0bb9875d-53a6-4105-89da-16e0bbd2c3a1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-858f55f4d98wwvr"
Oct 31 17:31:28.505848 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:31:28.505673    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0bb9875d-53a6-4105-89da-16e0bbd2c3a1-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-858f55f4d98wwvr\" (UID: \"0bb9875d-53a6-4105-89da-16e0bbd2c3a1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-858f55f4d98wwvr"
Oct 31 17:31:28.505848 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:31:28.505709    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0bb9875d-53a6-4105-89da-16e0bbd2c3a1-istio-data\") pod \"data-science-gateway-data-science-gateway-class-858f55f4d98wwvr\" (UID: \"0bb9875d-53a6-4105-89da-16e0bbd2c3a1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-858f55f4d98wwvr"
Oct 31 17:31:28.505848 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:31:28.505727    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0bb9875d-53a6-4105-89da-16e0bbd2c3a1-istio-token\") pod \"data-science-gateway-data-science-gateway-class-858f55f4d98wwvr\" (UID: \"0bb9875d-53a6-4105-89da-16e0bbd2c3a1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-858f55f4d98wwvr"
Oct 31 17:31:28.506441 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:31:28.506412    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0bb9875d-53a6-4105-89da-16e0bbd2c3a1-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-858f55f4d98wwvr\" (UID: \"0bb9875d-53a6-4105-89da-16e0bbd2c3a1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-858f55f4d98wwvr"
Oct 31 17:31:28.506576 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:31:28.506438    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0bb9875d-53a6-4105-89da-16e0bbd2c3a1-istio-data\") pod \"data-science-gateway-data-science-gateway-class-858f55f4d98wwvr\" (UID: \"0bb9875d-53a6-4105-89da-16e0bbd2c3a1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-858f55f4d98wwvr"
Oct 31 17:31:28.506776 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:31:28.506750    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0bb9875d-53a6-4105-89da-16e0bbd2c3a1-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-858f55f4d98wwvr\" (UID: \"0bb9875d-53a6-4105-89da-16e0bbd2c3a1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-858f55f4d98wwvr"
Oct 31 17:31:28.506875 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:31:28.506750    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0bb9875d-53a6-4105-89da-16e0bbd2c3a1-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-858f55f4d98wwvr\" (UID: \"0bb9875d-53a6-4105-89da-16e0bbd2c3a1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-858f55f4d98wwvr"
Oct 31 17:31:28.506875 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:31:28.506843    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0bb9875d-53a6-4105-89da-16e0bbd2c3a1-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-858f55f4d98wwvr\" (UID: \"0bb9875d-53a6-4105-89da-16e0bbd2c3a1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-858f55f4d98wwvr"
Oct 31 17:31:28.508839 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:31:28.508821    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0bb9875d-53a6-4105-89da-16e0bbd2c3a1-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-858f55f4d98wwvr\" (UID: \"0bb9875d-53a6-4105-89da-16e0bbd2c3a1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-858f55f4d98wwvr"
Oct 31 17:31:28.509040 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:31:28.509018    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0bb9875d-53a6-4105-89da-16e0bbd2c3a1-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-858f55f4d98wwvr\" (UID: \"0bb9875d-53a6-4105-89da-16e0bbd2c3a1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-858f55f4d98wwvr"
Oct 31 17:31:28.527296 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:31:28.527274    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0bb9875d-53a6-4105-89da-16e0bbd2c3a1-istio-token\") pod \"data-science-gateway-data-science-gateway-class-858f55f4d98wwvr\" (UID: \"0bb9875d-53a6-4105-89da-16e0bbd2c3a1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-858f55f4d98wwvr"
Oct 31 17:31:28.527584 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:31:28.527563    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wd82g\" (UniqueName: \"kubernetes.io/projected/0bb9875d-53a6-4105-89da-16e0bbd2c3a1-kube-api-access-wd82g\") pod \"data-science-gateway-data-science-gateway-class-858f55f4d98wwvr\" (UID: \"0bb9875d-53a6-4105-89da-16e0bbd2c3a1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-858f55f4d98wwvr"
Oct 31 17:31:28.538221 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:31:28.538200    5003 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-858f55f4d98wwvr"
Oct 31 17:31:28.709060 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:31:28.708980    5003 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-74dfcfb894-kvr2j"]
Oct 31 17:31:28.712612 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:31:28.712586    5003 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod52bedeae_2632_49ca_bdd4_94a2fe603f8f.slice/crio-718f1f1fc55e432eb4e59ee54ab72ffc647a258518bde71ed80702a62f627c2b WatchSource:0}: Error finding container 718f1f1fc55e432eb4e59ee54ab72ffc647a258518bde71ed80702a62f627c2b: Status 404 returned error can't find the container with id 718f1f1fc55e432eb4e59ee54ab72ffc647a258518bde71ed80702a62f627c2b
Oct 31 17:31:28.841214 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:31:28.841175    5003 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-858f55f4d98wwvr"]
Oct 31 17:31:28.845034 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:31:28.844998    5003 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0bb9875d_53a6_4105_89da_16e0bbd2c3a1.slice/crio-3405bbff23f51e436259e4bb2d540a6f9101ee9a03e3dc40a4ec866753560924 WatchSource:0}: Error finding container 3405bbff23f51e436259e4bb2d540a6f9101ee9a03e3dc40a4ec866753560924: Status 404 returned error can't find the container with id 3405bbff23f51e436259e4bb2d540a6f9101ee9a03e3dc40a4ec866753560924
Oct 31 17:31:28.847367 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:31:28.847330    5003 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Oct 31 17:31:28.847475 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:31:28.847412    5003 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Oct 31 17:31:28.847475 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:31:28.847445    5003 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Oct 31 17:31:29.314898 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:31:29.314867    5003 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-56c6c9ddd5-zmb79"]
Oct 31 17:31:29.318966 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:31:29.318944    5003 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-56c6c9ddd5-zmb79"
Oct 31 17:31:29.338382 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:31:29.338350    5003 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-56c6c9ddd5-zmb79"]
Oct 31 17:31:29.412177 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:31:29.412142    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rxv2z\" (UniqueName: \"kubernetes.io/projected/25a2aa20-adbc-45e2-92b0-63293c1e15fe-kube-api-access-rxv2z\") pod \"authorino-56c6c9ddd5-zmb79\" (UID: \"25a2aa20-adbc-45e2-92b0-63293c1e15fe\") " pod="kuadrant-system/authorino-56c6c9ddd5-zmb79"
Oct 31 17:31:29.424810 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:31:29.424787    5003 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-jvk7n\""
Oct 31 17:31:29.441982 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:31:29.441950    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-858f55f4d98wwvr" event={"ID":"0bb9875d-53a6-4105-89da-16e0bbd2c3a1","Type":"ContainerStarted","Data":"897c216806bba4fd6015e166842a67272bf2ada9f750cce9097e5e6a34c6c44e"}
Oct 31 17:31:29.442117 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:31:29.442006    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-858f55f4d98wwvr" event={"ID":"0bb9875d-53a6-4105-89da-16e0bbd2c3a1","Type":"ContainerStarted","Data":"3405bbff23f51e436259e4bb2d540a6f9101ee9a03e3dc40a4ec866753560924"}
Oct 31 17:31:29.443195 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:31:29.443167    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-74dfcfb894-kvr2j" event={"ID":"52bedeae-2632-49ca-bdd4-94a2fe603f8f","Type":"ContainerStarted","Data":"718f1f1fc55e432eb4e59ee54ab72ffc647a258518bde71ed80702a62f627c2b"}
Oct 31 17:31:29.484975 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:31:29.484919    5003 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-858f55f4d98wwvr" podStartSLOduration=1.484901052 podStartE2EDuration="1.484901052s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 17:31:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 17:31:29.482312634 +0000 UTC m=+257.737167175" watchObservedRunningTime="2026-10-31 17:31:29.484901052 +0000 UTC m=+257.739755618"
Oct 31 17:31:29.513249 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:31:29.513216    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rxv2z\" (UniqueName: \"kubernetes.io/projected/25a2aa20-adbc-45e2-92b0-63293c1e15fe-kube-api-access-rxv2z\") pod \"authorino-56c6c9ddd5-zmb79\" (UID: \"25a2aa20-adbc-45e2-92b0-63293c1e15fe\") " pod="kuadrant-system/authorino-56c6c9ddd5-zmb79"
Oct 31 17:31:29.532479 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:31:29.532450    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rxv2z\" (UniqueName: \"kubernetes.io/projected/25a2aa20-adbc-45e2-92b0-63293c1e15fe-kube-api-access-rxv2z\") pod \"authorino-56c6c9ddd5-zmb79\" (UID: \"25a2aa20-adbc-45e2-92b0-63293c1e15fe\") " pod="kuadrant-system/authorino-56c6c9ddd5-zmb79"
Oct 31 17:31:29.539323 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:31:29.539299    5003 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-858f55f4d98wwvr"
Oct 31 17:31:29.544098 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:31:29.544077    5003 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-858f55f4d98wwvr"
Oct 31 17:31:29.631264 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:31:29.631193    5003 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-56c6c9ddd5-zmb79"
Oct 31 17:31:29.925660 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:31:29.925559    5003 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-56c6c9ddd5-zmb79"]
Oct 31 17:31:29.929433 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:31:29.929404    5003 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod25a2aa20_adbc_45e2_92b0_63293c1e15fe.slice/crio-9e0139707b1668879cd760bad8e049524bc40cddaf14c7081a73b44c4c690d68 WatchSource:0}: Error finding container 9e0139707b1668879cd760bad8e049524bc40cddaf14c7081a73b44c4c690d68: Status 404 returned error can't find the container with id 9e0139707b1668879cd760bad8e049524bc40cddaf14c7081a73b44c4c690d68
Oct 31 17:31:30.449635 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:31:30.449599    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-56c6c9ddd5-zmb79" event={"ID":"25a2aa20-adbc-45e2-92b0-63293c1e15fe","Type":"ContainerStarted","Data":"9e0139707b1668879cd760bad8e049524bc40cddaf14c7081a73b44c4c690d68"}
Oct 31 17:31:30.451139 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:31:30.451102    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-74dfcfb894-kvr2j" event={"ID":"52bedeae-2632-49ca-bdd4-94a2fe603f8f","Type":"ContainerStarted","Data":"a5af2b99179b1c9ac992e313a4371a394664812ed6f9f8b7409aee7ed4ee8df9"}
Oct 31 17:31:30.451410 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:31:30.451391    5003 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-858f55f4d98wwvr"
Oct 31 17:31:30.452410 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:31:30.452394    5003 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-858f55f4d98wwvr"
Oct 31 17:31:30.488051 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:31:30.488004    5003 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-74dfcfb894-kvr2j" podStartSLOduration=0.866717227 podStartE2EDuration="2.487994673s" totalImagesPullingTime="1.621277446s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 17:31:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 17:31:30.487131792 +0000 UTC m=+258.741986334" watchObservedRunningTime="2026-10-31 17:31:30.487994673 +0000 UTC m=+258.742849219"
Oct 31 17:31:31.456970 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:31:31.456938    5003 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-74dfcfb894-kvr2j"
Oct 31 17:31:33.411376 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:31:33.411348    5003 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-8557cbdb84-vmqpq"
Oct 31 17:31:33.471105 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:31:33.471068    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-56c6c9ddd5-zmb79" event={"ID":"25a2aa20-adbc-45e2-92b0-63293c1e15fe","Type":"ContainerStarted","Data":"b0b7d88e55a3b302552d51815443283a64341995b51d70e0df495dad6885660f"}
Oct 31 17:31:33.507662 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:31:33.507593    5003 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/authorino-56c6c9ddd5-zmb79" podStartSLOduration=1.552596318 podStartE2EDuration="4.507576816s" totalImagesPullingTime="2.954980498s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 17:31:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 17:31:33.50541568 +0000 UTC m=+261.760270223" watchObservedRunningTime="2026-10-31 17:31:33.507576816 +0000 UTC m=+261.762431359"
Oct 31 17:31:40.330823 ip-10-0-138-17 kubenswrapper[5003]: E1031 17:31:40.330774    5003 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-tdzz5" containerName="extractor"
Oct 31 17:31:42.457583 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:31:42.457546    5003 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-74dfcfb894-kvr2j"]
Oct 31 17:31:42.458104 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:31:42.457777    5003 kuberuntime_container.go:898] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-74dfcfb894-kvr2j" podUID="52bedeae-2632-49ca-bdd4-94a2fe603f8f" containerName="limitador" containerID="cri-o://a5af2b99179b1c9ac992e313a4371a394664812ed6f9f8b7409aee7ed4ee8df9" gracePeriod=30
Oct 31 17:31:42.458524 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:31:42.458462    5003 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-74dfcfb894-kvr2j"
Oct 31 17:31:43.005393 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:31:43.005366    5003 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-74dfcfb894-kvr2j"
Oct 31 17:31:43.133913 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:31:43.133869    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/52bedeae-2632-49ca-bdd4-94a2fe603f8f-config-file\" (UniqueName: \"kubernetes.io/configmap/52bedeae-2632-49ca-bdd4-94a2fe603f8f-config-file\") pod \"52bedeae-2632-49ca-bdd4-94a2fe603f8f\" (UID: \"52bedeae-2632-49ca-bdd4-94a2fe603f8f\") "
Oct 31 17:31:43.134092 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:31:43.134059    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/52bedeae-2632-49ca-bdd4-94a2fe603f8f-kube-api-access-4c7zq\" (UniqueName: \"kubernetes.io/projected/52bedeae-2632-49ca-bdd4-94a2fe603f8f-kube-api-access-4c7zq\") pod \"52bedeae-2632-49ca-bdd4-94a2fe603f8f\" (UID: \"52bedeae-2632-49ca-bdd4-94a2fe603f8f\") "
Oct 31 17:31:43.134256 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:31:43.134231    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/52bedeae-2632-49ca-bdd4-94a2fe603f8f-config-file" pod "52bedeae-2632-49ca-bdd4-94a2fe603f8f" (UID: "52bedeae-2632-49ca-bdd4-94a2fe603f8f"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 17:31:43.136321 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:31:43.136294    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/52bedeae-2632-49ca-bdd4-94a2fe603f8f-kube-api-access-4c7zq" pod "52bedeae-2632-49ca-bdd4-94a2fe603f8f" (UID: "52bedeae-2632-49ca-bdd4-94a2fe603f8f"). InnerVolumeSpecName "kube-api-access-4c7zq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 17:31:43.234978 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:31:43.234941    5003 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/52bedeae-2632-49ca-bdd4-94a2fe603f8f-config-file\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:31:43.234978 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:31:43.234974    5003 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4c7zq\" (UniqueName: \"kubernetes.io/projected/52bedeae-2632-49ca-bdd4-94a2fe603f8f-kube-api-access-4c7zq\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:31:43.521147 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:31:43.521048    5003 generic.go:356] "Generic (PLEG): container finished" podID="52bedeae-2632-49ca-bdd4-94a2fe603f8f" containerID="a5af2b99179b1c9ac992e313a4371a394664812ed6f9f8b7409aee7ed4ee8df9" exitCode=0
Oct 31 17:31:43.521147 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:31:43.521101    5003 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-74dfcfb894-kvr2j"
Oct 31 17:31:43.521147 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:31:43.521111    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-74dfcfb894-kvr2j" event={"ID":"52bedeae-2632-49ca-bdd4-94a2fe603f8f","Type":"ContainerDied","Data":"a5af2b99179b1c9ac992e313a4371a394664812ed6f9f8b7409aee7ed4ee8df9"}
Oct 31 17:31:43.521773 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:31:43.521180    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-74dfcfb894-kvr2j" event={"ID":"52bedeae-2632-49ca-bdd4-94a2fe603f8f","Type":"ContainerDied","Data":"718f1f1fc55e432eb4e59ee54ab72ffc647a258518bde71ed80702a62f627c2b"}
Oct 31 17:31:43.521773 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:31:43.521203    5003 scope.go:122] "RemoveContainer" containerID="a5af2b99179b1c9ac992e313a4371a394664812ed6f9f8b7409aee7ed4ee8df9"
Oct 31 17:31:43.531553 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:31:43.531532    5003 scope.go:122] "RemoveContainer" containerID="a5af2b99179b1c9ac992e313a4371a394664812ed6f9f8b7409aee7ed4ee8df9"
Oct 31 17:31:43.531850 ip-10-0-138-17 kubenswrapper[5003]: E1031 17:31:43.531832    5003 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a5af2b99179b1c9ac992e313a4371a394664812ed6f9f8b7409aee7ed4ee8df9\": container with ID starting with a5af2b99179b1c9ac992e313a4371a394664812ed6f9f8b7409aee7ed4ee8df9 not found: ID does not exist" containerID="a5af2b99179b1c9ac992e313a4371a394664812ed6f9f8b7409aee7ed4ee8df9"
Oct 31 17:31:43.531969 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:31:43.531860    5003 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a5af2b99179b1c9ac992e313a4371a394664812ed6f9f8b7409aee7ed4ee8df9"} err="failed to get container status \"a5af2b99179b1c9ac992e313a4371a394664812ed6f9f8b7409aee7ed4ee8df9\": rpc error: code = NotFound desc = could not find container \"a5af2b99179b1c9ac992e313a4371a394664812ed6f9f8b7409aee7ed4ee8df9\": container with ID starting with a5af2b99179b1c9ac992e313a4371a394664812ed6f9f8b7409aee7ed4ee8df9 not found: ID does not exist"
Oct 31 17:31:43.570382 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:31:43.570348    5003 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-74dfcfb894-kvr2j"]
Oct 31 17:31:43.582027 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:31:43.581993    5003 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-74dfcfb894-kvr2j"]
Oct 31 17:31:43.887188 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:31:43.887154    5003 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="52bedeae-2632-49ca-bdd4-94a2fe603f8f" path="/var/lib/kubelet/pods/52bedeae-2632-49ca-bdd4-94a2fe603f8f/volumes"
Oct 31 17:31:45.157845 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:31:45.157807    5003 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-7cdbf6dc44-6lmsj"]
Oct 31 17:31:45.158254 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:31:45.158209    5003 cpu_manager.go:414] "containerMap: removing container" podUID="52bedeae-2632-49ca-bdd4-94a2fe603f8f" containerName="limitador"
Oct 31 17:31:45.158254 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:31:45.158221    5003 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="52bedeae-2632-49ca-bdd4-94a2fe603f8f" containerName="limitador"
Oct 31 17:31:45.158329 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:31:45.158286    5003 memory_manager.go:365] "RemoveStaleState removing state" podUID="52bedeae-2632-49ca-bdd4-94a2fe603f8f" containerName="limitador"
Oct 31 17:31:45.160291 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:31:45.160273    5003 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-6lmsj"
Oct 31 17:31:45.176367 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:31:45.176343    5003 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\""
Oct 31 17:31:45.188537 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:31:45.188510    5003 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-lfh5s\""
Oct 31 17:31:45.191697 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:31:45.191671    5003 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-7cdbf6dc44-6lmsj"]
Oct 31 17:31:45.238815 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:31:45.238782    5003 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Oct 31 17:31:45.238815 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:31:45.238782    5003 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Oct 31 17:31:45.354572 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:31:45.354531    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w42xw\" (UniqueName: \"kubernetes.io/projected/27ecda6a-9b88-4a1b-a89b-bd2cd9d35448-kube-api-access-w42xw\") pod \"postgres-7cdbf6dc44-6lmsj\" (UID: \"27ecda6a-9b88-4a1b-a89b-bd2cd9d35448\") " pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-6lmsj"
Oct 31 17:31:45.354793 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:31:45.354602    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/27ecda6a-9b88-4a1b-a89b-bd2cd9d35448-data\") pod \"postgres-7cdbf6dc44-6lmsj\" (UID: \"27ecda6a-9b88-4a1b-a89b-bd2cd9d35448\") " pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-6lmsj"
Oct 31 17:31:45.455262 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:31:45.455178    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w42xw\" (UniqueName: \"kubernetes.io/projected/27ecda6a-9b88-4a1b-a89b-bd2cd9d35448-kube-api-access-w42xw\") pod \"postgres-7cdbf6dc44-6lmsj\" (UID: \"27ecda6a-9b88-4a1b-a89b-bd2cd9d35448\") " pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-6lmsj"
Oct 31 17:31:45.455262 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:31:45.455235    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/27ecda6a-9b88-4a1b-a89b-bd2cd9d35448-data\") pod \"postgres-7cdbf6dc44-6lmsj\" (UID: \"27ecda6a-9b88-4a1b-a89b-bd2cd9d35448\") " pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-6lmsj"
Oct 31 17:31:45.455571 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:31:45.455555    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/27ecda6a-9b88-4a1b-a89b-bd2cd9d35448-data\") pod \"postgres-7cdbf6dc44-6lmsj\" (UID: \"27ecda6a-9b88-4a1b-a89b-bd2cd9d35448\") " pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-6lmsj"
Oct 31 17:31:45.477398 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:31:45.477361    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w42xw\" (UniqueName: \"kubernetes.io/projected/27ecda6a-9b88-4a1b-a89b-bd2cd9d35448-kube-api-access-w42xw\") pod \"postgres-7cdbf6dc44-6lmsj\" (UID: \"27ecda6a-9b88-4a1b-a89b-bd2cd9d35448\") " pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-6lmsj"
Oct 31 17:31:45.772283 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:31:45.772207    5003 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-6lmsj"
Oct 31 17:31:46.068997 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:31:46.068663    5003 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-7cdbf6dc44-6lmsj"]
Oct 31 17:31:46.074097 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:31:46.074064    5003 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod27ecda6a_9b88_4a1b_a89b_bd2cd9d35448.slice/crio-c071a0233422fafaca1ff10d6c1731d727286c7d2778f3f59fe8a25bbfe4e45c WatchSource:0}: Error finding container c071a0233422fafaca1ff10d6c1731d727286c7d2778f3f59fe8a25bbfe4e45c: Status 404 returned error can't find the container with id c071a0233422fafaca1ff10d6c1731d727286c7d2778f3f59fe8a25bbfe4e45c
Oct 31 17:31:46.544000 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:31:46.543899    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-6lmsj" event={"ID":"27ecda6a-9b88-4a1b-a89b-bd2cd9d35448","Type":"ContainerStarted","Data":"c071a0233422fafaca1ff10d6c1731d727286c7d2778f3f59fe8a25bbfe4e45c"}
Oct 31 17:31:51.576908 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:31:51.576873    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-6lmsj" event={"ID":"27ecda6a-9b88-4a1b-a89b-bd2cd9d35448","Type":"ContainerStarted","Data":"46cd039b0cd21573e3878f09e1e31ffd18ea1ad2852ed00a3f889a8018f6b7a2"}
Oct 31 17:31:51.577422 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:31:51.576939    5003 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-6lmsj"
Oct 31 17:31:51.614230 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:31:51.614173    5003 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-6lmsj" podStartSLOduration=1.694531774 podStartE2EDuration="6.614156543s" totalImagesPullingTime="4.919624769s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 17:31:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 17:31:51.61208085 +0000 UTC m=+279.866935392" watchObservedRunningTime="2026-10-31 17:31:51.614156543 +0000 UTC m=+279.869011084"
Oct 31 17:31:57.611938 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:31:57.611909    5003 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-6lmsj"
Oct 31 17:32:01.466942 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:32:01.466906    5003 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-jobset-operator/jobset-controller-manager-7c59986b9-sv9jz"]
Oct 31 17:32:01.469909 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:32:01.469891    5003 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-jobset-operator/jobset-controller-manager-7c59986b9-sv9jz"
Oct 31 17:32:01.486272 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:32:01.486247    5003 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-jobset-operator\"/\"jobset-controller-manager-dockercfg-t7wv5\""
Oct 31 17:32:01.498373 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:32:01.498341    5003 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-jobset-operator\"/\"kube-root-ca.crt\""
Oct 31 17:32:01.498373 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:32:01.498354    5003 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-jobset-operator\"/\"jobset-manager-config\""
Oct 31 17:32:01.498567 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:32:01.498394    5003 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-jobset-operator\"/\"openshift-service-ca.crt\""
Oct 31 17:32:01.500383 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:32:01.500362    5003 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-jobset-operator/jobset-controller-manager-7c59986b9-sv9jz"]
Oct 31 17:32:01.586369 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:32:01.586344    5003 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-jobset-operator\"/\"metrics-server-cert\""
Oct 31 17:32:01.586369 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:32:01.586371    5003 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-jobset-operator\"/\"webhook-server-cert\""
Oct 31 17:32:01.595988 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:32:01.595958    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/368c56dd-6ea7-44cc-b666-7b4ed0b2d6c7-manager-config\") pod \"jobset-controller-manager-7c59986b9-sv9jz\" (UID: \"368c56dd-6ea7-44cc-b666-7b4ed0b2d6c7\") " pod="openshift-jobset-operator/jobset-controller-manager-7c59986b9-sv9jz"
Oct 31 17:32:01.596089 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:32:01.596063    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/368c56dd-6ea7-44cc-b666-7b4ed0b2d6c7-cert\") pod \"jobset-controller-manager-7c59986b9-sv9jz\" (UID: \"368c56dd-6ea7-44cc-b666-7b4ed0b2d6c7\") " pod="openshift-jobset-operator/jobset-controller-manager-7c59986b9-sv9jz"
Oct 31 17:32:01.596135 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:32:01.596090    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kkd65\" (UniqueName: \"kubernetes.io/projected/368c56dd-6ea7-44cc-b666-7b4ed0b2d6c7-kube-api-access-kkd65\") pod \"jobset-controller-manager-7c59986b9-sv9jz\" (UID: \"368c56dd-6ea7-44cc-b666-7b4ed0b2d6c7\") " pod="openshift-jobset-operator/jobset-controller-manager-7c59986b9-sv9jz"
Oct 31 17:32:01.596181 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:32:01.596165    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/368c56dd-6ea7-44cc-b666-7b4ed0b2d6c7-metrics-certs\") pod \"jobset-controller-manager-7c59986b9-sv9jz\" (UID: \"368c56dd-6ea7-44cc-b666-7b4ed0b2d6c7\") " pod="openshift-jobset-operator/jobset-controller-manager-7c59986b9-sv9jz"
Oct 31 17:32:01.697554 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:32:01.697521    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/368c56dd-6ea7-44cc-b666-7b4ed0b2d6c7-metrics-certs\") pod \"jobset-controller-manager-7c59986b9-sv9jz\" (UID: \"368c56dd-6ea7-44cc-b666-7b4ed0b2d6c7\") " pod="openshift-jobset-operator/jobset-controller-manager-7c59986b9-sv9jz"
Oct 31 17:32:01.697771 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:32:01.697592    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/368c56dd-6ea7-44cc-b666-7b4ed0b2d6c7-manager-config\") pod \"jobset-controller-manager-7c59986b9-sv9jz\" (UID: \"368c56dd-6ea7-44cc-b666-7b4ed0b2d6c7\") " pod="openshift-jobset-operator/jobset-controller-manager-7c59986b9-sv9jz"
Oct 31 17:32:01.697771 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:32:01.697618    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/368c56dd-6ea7-44cc-b666-7b4ed0b2d6c7-cert\") pod \"jobset-controller-manager-7c59986b9-sv9jz\" (UID: \"368c56dd-6ea7-44cc-b666-7b4ed0b2d6c7\") " pod="openshift-jobset-operator/jobset-controller-manager-7c59986b9-sv9jz"
Oct 31 17:32:01.697771 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:32:01.697636    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kkd65\" (UniqueName: \"kubernetes.io/projected/368c56dd-6ea7-44cc-b666-7b4ed0b2d6c7-kube-api-access-kkd65\") pod \"jobset-controller-manager-7c59986b9-sv9jz\" (UID: \"368c56dd-6ea7-44cc-b666-7b4ed0b2d6c7\") " pod="openshift-jobset-operator/jobset-controller-manager-7c59986b9-sv9jz"
Oct 31 17:32:01.698390 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:32:01.698364    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/368c56dd-6ea7-44cc-b666-7b4ed0b2d6c7-manager-config\") pod \"jobset-controller-manager-7c59986b9-sv9jz\" (UID: \"368c56dd-6ea7-44cc-b666-7b4ed0b2d6c7\") " pod="openshift-jobset-operator/jobset-controller-manager-7c59986b9-sv9jz"
Oct 31 17:32:01.700144 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:32:01.700122    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/368c56dd-6ea7-44cc-b666-7b4ed0b2d6c7-metrics-certs\") pod \"jobset-controller-manager-7c59986b9-sv9jz\" (UID: \"368c56dd-6ea7-44cc-b666-7b4ed0b2d6c7\") " pod="openshift-jobset-operator/jobset-controller-manager-7c59986b9-sv9jz"
Oct 31 17:32:01.700254 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:32:01.700153    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/368c56dd-6ea7-44cc-b666-7b4ed0b2d6c7-cert\") pod \"jobset-controller-manager-7c59986b9-sv9jz\" (UID: \"368c56dd-6ea7-44cc-b666-7b4ed0b2d6c7\") " pod="openshift-jobset-operator/jobset-controller-manager-7c59986b9-sv9jz"
Oct 31 17:32:01.716826 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:32:01.716792    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kkd65\" (UniqueName: \"kubernetes.io/projected/368c56dd-6ea7-44cc-b666-7b4ed0b2d6c7-kube-api-access-kkd65\") pod \"jobset-controller-manager-7c59986b9-sv9jz\" (UID: \"368c56dd-6ea7-44cc-b666-7b4ed0b2d6c7\") " pod="openshift-jobset-operator/jobset-controller-manager-7c59986b9-sv9jz"
Oct 31 17:32:01.780755 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:32:01.780665    5003 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-jobset-operator/jobset-controller-manager-7c59986b9-sv9jz"
Oct 31 17:32:02.072611 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:32:02.072575    5003 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-jobset-operator/jobset-controller-manager-7c59986b9-sv9jz"]
Oct 31 17:32:02.076574 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:32:02.076546    5003 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod368c56dd_6ea7_44cc_b666_7b4ed0b2d6c7.slice/crio-6f1dee75408d6510d8043d4c189ebf85b44714de845279aba8a355319caab069 WatchSource:0}: Error finding container 6f1dee75408d6510d8043d4c189ebf85b44714de845279aba8a355319caab069: Status 404 returned error can't find the container with id 6f1dee75408d6510d8043d4c189ebf85b44714de845279aba8a355319caab069
Oct 31 17:32:02.630849 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:32:02.630813    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-jobset-operator/jobset-controller-manager-7c59986b9-sv9jz" event={"ID":"368c56dd-6ea7-44cc-b666-7b4ed0b2d6c7","Type":"ContainerStarted","Data":"6f1dee75408d6510d8043d4c189ebf85b44714de845279aba8a355319caab069"}
Oct 31 17:32:04.644417 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:32:04.644380    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-jobset-operator/jobset-controller-manager-7c59986b9-sv9jz" event={"ID":"368c56dd-6ea7-44cc-b666-7b4ed0b2d6c7","Type":"ContainerStarted","Data":"c2fd98be2465627aeb2f2deb6f3b713d11c847e7e03d97587f506a4d1b9217b4"}
Oct 31 17:32:04.644824 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:32:04.644443    5003 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-jobset-operator/jobset-controller-manager-7c59986b9-sv9jz"
Oct 31 17:32:04.681945 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:32:04.681883    5003 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-jobset-operator/jobset-controller-manager-7c59986b9-sv9jz" podStartSLOduration=1.412304831 podStartE2EDuration="3.681868536s" totalImagesPullingTime="2.269563705s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 17:32:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 17:32:04.680781278 +0000 UTC m=+292.935635820" watchObservedRunningTime="2026-10-31 17:32:04.681868536 +0000 UTC m=+292.936723079"
Oct 31 17:32:10.331152 ip-10-0-138-17 kubenswrapper[5003]: E1031 17:32:10.331114    5003 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-tdzz5" containerName="extractor"
Oct 31 17:32:11.918044 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:32:11.918015    5003 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-b2xxw_f03611db-3bd9-401a-a137-1d4f691b51ea/console-operator/2.log"
Oct 31 17:32:11.919926 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:32:11.919904    5003 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-b2xxw_f03611db-3bd9-401a-a137-1d4f691b51ea/console-operator/2.log"
Oct 31 17:32:15.654898 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:32:15.654865    5003 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-jobset-operator/jobset-controller-manager-7c59986b9-sv9jz"
Oct 31 17:32:40.330525 ip-10-0-138-17 kubenswrapper[5003]: E1031 17:32:40.330447    5003 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-tdzz5" containerName="extractor"
Oct 31 17:32:50.338663 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:32:50.338606    5003 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-6f6944bcdd-q28bs"]
Oct 31 17:32:50.343191 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:32:50.343164    5003 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6f6944bcdd-q28bs"
Oct 31 17:32:50.358422 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:32:50.358389    5003 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6f6944bcdd-q28bs"]
Oct 31 17:32:50.448200 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:32:50.448154    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7tzl2\" (UniqueName: \"kubernetes.io/projected/5b9061b7-4f23-4e0e-a12f-1a2356fef100-kube-api-access-7tzl2\") pod \"authorino-6f6944bcdd-q28bs\" (UID: \"5b9061b7-4f23-4e0e-a12f-1a2356fef100\") " pod="kuadrant-system/authorino-6f6944bcdd-q28bs"
Oct 31 17:32:50.515424 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:32:50.515371    5003 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6f6944bcdd-q28bs"]
Oct 31 17:32:50.522191 ip-10-0-138-17 kubenswrapper[5003]: E1031 17:32:50.515660    5003 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-7tzl2], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-6f6944bcdd-q28bs" podUID="5b9061b7-4f23-4e0e-a12f-1a2356fef100"
Oct 31 17:32:50.547754 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:32:50.547716    5003 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-6889cbd8c4-5vqrc"]
Oct 31 17:32:50.549469 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:32:50.549437    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7tzl2\" (UniqueName: \"kubernetes.io/projected/5b9061b7-4f23-4e0e-a12f-1a2356fef100-kube-api-access-7tzl2\") pod \"authorino-6f6944bcdd-q28bs\" (UID: \"5b9061b7-4f23-4e0e-a12f-1a2356fef100\") " pod="kuadrant-system/authorino-6f6944bcdd-q28bs"
Oct 31 17:32:50.550452 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:32:50.550433    5003 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6889cbd8c4-5vqrc"
Oct 31 17:32:50.570017 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:32:50.569949    5003 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Oct 31 17:32:50.570158 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:32:50.570100    5003 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6889cbd8c4-5vqrc"]
Oct 31 17:32:50.574190 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:32:50.574166    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7tzl2\" (UniqueName: \"kubernetes.io/projected/5b9061b7-4f23-4e0e-a12f-1a2356fef100-kube-api-access-7tzl2\") pod \"authorino-6f6944bcdd-q28bs\" (UID: \"5b9061b7-4f23-4e0e-a12f-1a2356fef100\") " pod="kuadrant-system/authorino-6f6944bcdd-q28bs"
Oct 31 17:32:50.650687 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:32:50.650638    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8xslv\" (UniqueName: \"kubernetes.io/projected/d632b16e-c819-4357-869a-6b6d6ab62ec5-kube-api-access-8xslv\") pod \"authorino-6889cbd8c4-5vqrc\" (UID: \"d632b16e-c819-4357-869a-6b6d6ab62ec5\") " pod="kuadrant-system/authorino-6889cbd8c4-5vqrc"
Oct 31 17:32:50.650805 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:32:50.650710    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/d632b16e-c819-4357-869a-6b6d6ab62ec5-tls-cert\") pod \"authorino-6889cbd8c4-5vqrc\" (UID: \"d632b16e-c819-4357-869a-6b6d6ab62ec5\") " pod="kuadrant-system/authorino-6889cbd8c4-5vqrc"
Oct 31 17:32:50.692678 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:32:50.692635    5003 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6889cbd8c4-5vqrc"]
Oct 31 17:32:50.692898 ip-10-0-138-17 kubenswrapper[5003]: E1031 17:32:50.692877    5003 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-8xslv tls-cert], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-6889cbd8c4-5vqrc" podUID="d632b16e-c819-4357-869a-6b6d6ab62ec5"
Oct 31 17:32:50.751455 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:32:50.751418    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/d632b16e-c819-4357-869a-6b6d6ab62ec5-tls-cert\") pod \"authorino-6889cbd8c4-5vqrc\" (UID: \"d632b16e-c819-4357-869a-6b6d6ab62ec5\") " pod="kuadrant-system/authorino-6889cbd8c4-5vqrc"
Oct 31 17:32:50.751636 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:32:50.751514    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8xslv\" (UniqueName: \"kubernetes.io/projected/d632b16e-c819-4357-869a-6b6d6ab62ec5-kube-api-access-8xslv\") pod \"authorino-6889cbd8c4-5vqrc\" (UID: \"d632b16e-c819-4357-869a-6b6d6ab62ec5\") " pod="kuadrant-system/authorino-6889cbd8c4-5vqrc"
Oct 31 17:32:50.753890 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:32:50.753863    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/d632b16e-c819-4357-869a-6b6d6ab62ec5-tls-cert\") pod \"authorino-6889cbd8c4-5vqrc\" (UID: \"d632b16e-c819-4357-869a-6b6d6ab62ec5\") " pod="kuadrant-system/authorino-6889cbd8c4-5vqrc"
Oct 31 17:32:50.769619 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:32:50.769557    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8xslv\" (UniqueName: \"kubernetes.io/projected/d632b16e-c819-4357-869a-6b6d6ab62ec5-kube-api-access-8xslv\") pod \"authorino-6889cbd8c4-5vqrc\" (UID: \"d632b16e-c819-4357-869a-6b6d6ab62ec5\") " pod="kuadrant-system/authorino-6889cbd8c4-5vqrc"
Oct 31 17:32:50.904799 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:32:50.904721    5003 generic.go:356] "Generic (PLEG): container finished" podID="effd3895-446f-4877-8218-6414ce2e321b" containerID="42427b7babad578a9a20d4e99b8b0dea6132f26202d319aaf2d814ef0642ba23" exitCode=0
Oct 31 17:32:50.904944 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:32:50.904797    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-7smk2" event={"ID":"effd3895-446f-4877-8218-6414ce2e321b","Type":"ContainerDied","Data":"42427b7babad578a9a20d4e99b8b0dea6132f26202d319aaf2d814ef0642ba23"}
Oct 31 17:32:50.904944 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:32:50.904832    5003 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6889cbd8c4-5vqrc"
Oct 31 17:32:50.904944 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:32:50.904834    5003 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6f6944bcdd-q28bs"
Oct 31 17:32:50.905365 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:32:50.905348    5003 scope.go:122] "RemoveContainer" containerID="42427b7babad578a9a20d4e99b8b0dea6132f26202d319aaf2d814ef0642ba23"
Oct 31 17:32:50.906596 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:32:50.906562    5003 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Oct 31 17:32:50.906723 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:32:50.906686    5003 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Oct 31 17:32:50.906782 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:32:50.906725    5003 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Oct 31 17:32:50.911980 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:32:50.911962    5003 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6889cbd8c4-5vqrc"
Oct 31 17:32:50.915017 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:32:50.914999    5003 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6f6944bcdd-q28bs"
Oct 31 17:32:50.953640 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:32:50.953620    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/5b9061b7-4f23-4e0e-a12f-1a2356fef100-kube-api-access-7tzl2\" (UniqueName: \"kubernetes.io/projected/5b9061b7-4f23-4e0e-a12f-1a2356fef100-kube-api-access-7tzl2\") pod \"5b9061b7-4f23-4e0e-a12f-1a2356fef100\" (UID: \"5b9061b7-4f23-4e0e-a12f-1a2356fef100\") "
Oct 31 17:32:50.953782 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:32:50.953692    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/d632b16e-c819-4357-869a-6b6d6ab62ec5-kube-api-access-8xslv\" (UniqueName: \"kubernetes.io/projected/d632b16e-c819-4357-869a-6b6d6ab62ec5-kube-api-access-8xslv\") pod \"d632b16e-c819-4357-869a-6b6d6ab62ec5\" (UID: \"d632b16e-c819-4357-869a-6b6d6ab62ec5\") "
Oct 31 17:32:50.953782 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:32:50.953747    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/d632b16e-c819-4357-869a-6b6d6ab62ec5-tls-cert\" (UniqueName: \"kubernetes.io/secret/d632b16e-c819-4357-869a-6b6d6ab62ec5-tls-cert\") pod \"d632b16e-c819-4357-869a-6b6d6ab62ec5\" (UID: \"d632b16e-c819-4357-869a-6b6d6ab62ec5\") "
Oct 31 17:32:50.956011 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:32:50.955983    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d632b16e-c819-4357-869a-6b6d6ab62ec5-tls-cert" pod "d632b16e-c819-4357-869a-6b6d6ab62ec5" (UID: "d632b16e-c819-4357-869a-6b6d6ab62ec5"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 17:32:50.956177 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:32:50.956152    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5b9061b7-4f23-4e0e-a12f-1a2356fef100-kube-api-access-7tzl2" pod "5b9061b7-4f23-4e0e-a12f-1a2356fef100" (UID: "5b9061b7-4f23-4e0e-a12f-1a2356fef100"). InnerVolumeSpecName "kube-api-access-7tzl2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 17:32:50.956233 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:32:50.956190    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d632b16e-c819-4357-869a-6b6d6ab62ec5-kube-api-access-8xslv" pod "d632b16e-c819-4357-869a-6b6d6ab62ec5" (UID: "d632b16e-c819-4357-869a-6b6d6ab62ec5"). InnerVolumeSpecName "kube-api-access-8xslv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 17:32:51.054984 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:32:51.054946    5003 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8xslv\" (UniqueName: \"kubernetes.io/projected/d632b16e-c819-4357-869a-6b6d6ab62ec5-kube-api-access-8xslv\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:32:51.054984 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:32:51.054986    5003 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/d632b16e-c819-4357-869a-6b6d6ab62ec5-tls-cert\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:32:51.055188 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:32:51.055004    5003 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7tzl2\" (UniqueName: \"kubernetes.io/projected/5b9061b7-4f23-4e0e-a12f-1a2356fef100-kube-api-access-7tzl2\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:32:51.911983 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:32:51.911947    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-7smk2" event={"ID":"effd3895-446f-4877-8218-6414ce2e321b","Type":"ContainerStarted","Data":"c51307093dbe475964768313c50aeceae42d99753ac21672cb5cf969a526a067"}
Oct 31 17:32:51.912323 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:32:51.911993    5003 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6889cbd8c4-5vqrc"
Oct 31 17:32:51.912323 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:32:51.911963    5003 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6f6944bcdd-q28bs"
Oct 31 17:32:52.022468 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:32:52.022437    5003 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6f6944bcdd-q28bs"]
Oct 31 17:32:52.025818 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:32:52.025791    5003 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-6f6944bcdd-q28bs"]
Oct 31 17:32:52.092842 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:32:52.092809    5003 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6889cbd8c4-5vqrc"]
Oct 31 17:32:52.094899 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:32:52.094867    5003 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-6889cbd8c4-5vqrc"]
Oct 31 17:32:52.815138 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:32:52.815100    5003 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-7smk2"
Oct 31 17:32:52.816488 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:32:52.816460    5003 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-7d9897b54c-7smk2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.34:15021/healthz/ready\": dial tcp 10.132.0.34:15021: connect: connection refused" start-of-body=
Oct 31 17:32:52.816606 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:32:52.816524    5003 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-7smk2" podUID="effd3895-446f-4877-8218-6414ce2e321b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.34:15021/healthz/ready\": dial tcp 10.132.0.34:15021: connect: connection refused"
Oct 31 17:32:52.881784 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:32:52.877134    5003 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-7smk2"
Oct 31 17:32:52.917159 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:32:52.917124    5003 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-56c6c9ddd5-zmb79"]
Oct 31 17:32:52.917598 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:32:52.917326    5003 kuberuntime_container.go:898] "Killing container with a grace period" pod="kuadrant-system/authorino-56c6c9ddd5-zmb79" podUID="25a2aa20-adbc-45e2-92b0-63293c1e15fe" containerName="authorino" containerID="cri-o://b0b7d88e55a3b302552d51815443283a64341995b51d70e0df495dad6885660f" gracePeriod=30
Oct 31 17:32:53.200972 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:32:53.200947    5003 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-56c6c9ddd5-zmb79"
Oct 31 17:32:53.292070 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:32:53.292038    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/25a2aa20-adbc-45e2-92b0-63293c1e15fe-kube-api-access-rxv2z\" (UniqueName: \"kubernetes.io/projected/25a2aa20-adbc-45e2-92b0-63293c1e15fe-kube-api-access-rxv2z\") pod \"25a2aa20-adbc-45e2-92b0-63293c1e15fe\" (UID: \"25a2aa20-adbc-45e2-92b0-63293c1e15fe\") "
Oct 31 17:32:53.294026 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:32:53.293970    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/25a2aa20-adbc-45e2-92b0-63293c1e15fe-kube-api-access-rxv2z" pod "25a2aa20-adbc-45e2-92b0-63293c1e15fe" (UID: "25a2aa20-adbc-45e2-92b0-63293c1e15fe"). InnerVolumeSpecName "kube-api-access-rxv2z". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 17:32:53.392816 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:32:53.392743    5003 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rxv2z\" (UniqueName: \"kubernetes.io/projected/25a2aa20-adbc-45e2-92b0-63293c1e15fe-kube-api-access-rxv2z\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:32:53.814635 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:32:53.814600    5003 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-7d9897b54c-7smk2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.34:15021/healthz/ready\": dial tcp 10.132.0.34:15021: connect: connection refused" start-of-body=
Oct 31 17:32:53.814834 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:32:53.814673    5003 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-7smk2" podUID="effd3895-446f-4877-8218-6414ce2e321b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.34:15021/healthz/ready\": dial tcp 10.132.0.34:15021: connect: connection refused"
Oct 31 17:32:53.886988 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:32:53.886954    5003 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="5b9061b7-4f23-4e0e-a12f-1a2356fef100" path="/var/lib/kubelet/pods/5b9061b7-4f23-4e0e-a12f-1a2356fef100/volumes"
Oct 31 17:32:53.887242 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:32:53.887216    5003 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="d632b16e-c819-4357-869a-6b6d6ab62ec5" path="/var/lib/kubelet/pods/d632b16e-c819-4357-869a-6b6d6ab62ec5/volumes"
Oct 31 17:32:53.926794 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:32:53.926761    5003 generic.go:356] "Generic (PLEG): container finished" podID="25a2aa20-adbc-45e2-92b0-63293c1e15fe" containerID="b0b7d88e55a3b302552d51815443283a64341995b51d70e0df495dad6885660f" exitCode=0
Oct 31 17:32:53.927216 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:32:53.926800    5003 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-56c6c9ddd5-zmb79"
Oct 31 17:32:53.927216 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:32:53.926838    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-56c6c9ddd5-zmb79" event={"ID":"25a2aa20-adbc-45e2-92b0-63293c1e15fe","Type":"ContainerDied","Data":"b0b7d88e55a3b302552d51815443283a64341995b51d70e0df495dad6885660f"}
Oct 31 17:32:53.927216 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:32:53.926880    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-56c6c9ddd5-zmb79" event={"ID":"25a2aa20-adbc-45e2-92b0-63293c1e15fe","Type":"ContainerDied","Data":"9e0139707b1668879cd760bad8e049524bc40cddaf14c7081a73b44c4c690d68"}
Oct 31 17:32:53.927216 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:32:53.926897    5003 scope.go:122] "RemoveContainer" containerID="b0b7d88e55a3b302552d51815443283a64341995b51d70e0df495dad6885660f"
Oct 31 17:32:53.935790 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:32:53.935775    5003 scope.go:122] "RemoveContainer" containerID="b0b7d88e55a3b302552d51815443283a64341995b51d70e0df495dad6885660f"
Oct 31 17:32:53.936081 ip-10-0-138-17 kubenswrapper[5003]: E1031 17:32:53.936056    5003 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b0b7d88e55a3b302552d51815443283a64341995b51d70e0df495dad6885660f\": container with ID starting with b0b7d88e55a3b302552d51815443283a64341995b51d70e0df495dad6885660f not found: ID does not exist" containerID="b0b7d88e55a3b302552d51815443283a64341995b51d70e0df495dad6885660f"
Oct 31 17:32:53.936132 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:32:53.936092    5003 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b0b7d88e55a3b302552d51815443283a64341995b51d70e0df495dad6885660f"} err="failed to get container status \"b0b7d88e55a3b302552d51815443283a64341995b51d70e0df495dad6885660f\": rpc error: code = NotFound desc = could not find container \"b0b7d88e55a3b302552d51815443283a64341995b51d70e0df495dad6885660f\": container with ID starting with b0b7d88e55a3b302552d51815443283a64341995b51d70e0df495dad6885660f not found: ID does not exist"
Oct 31 17:32:53.992415 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:32:53.992381    5003 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-56c6c9ddd5-zmb79"]
Oct 31 17:32:53.994252 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:32:53.994223    5003 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-56c6c9ddd5-zmb79"]
Oct 31 17:32:54.815131 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:32:54.815095    5003 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-7d9897b54c-7smk2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.34:15021/healthz/ready\": dial tcp 10.132.0.34:15021: connect: connection refused" start-of-body=
Oct 31 17:32:54.815311 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:32:54.815147    5003 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-7smk2" podUID="effd3895-446f-4877-8218-6414ce2e321b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.34:15021/healthz/ready\": dial tcp 10.132.0.34:15021: connect: connection refused"
Oct 31 17:32:55.814418 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:32:55.814388    5003 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-7d9897b54c-7smk2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.34:15021/healthz/ready\": dial tcp 10.132.0.34:15021: connect: connection refused" start-of-body=
Oct 31 17:32:55.814818 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:32:55.814450    5003 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-7smk2" podUID="effd3895-446f-4877-8218-6414ce2e321b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.34:15021/healthz/ready\": dial tcp 10.132.0.34:15021: connect: connection refused"
Oct 31 17:32:55.887592 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:32:55.887557    5003 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="25a2aa20-adbc-45e2-92b0-63293c1e15fe" path="/var/lib/kubelet/pods/25a2aa20-adbc-45e2-92b0-63293c1e15fe/volumes"
Oct 31 17:32:56.815316 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:32:56.815268    5003 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-7d9897b54c-7smk2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.34:15021/healthz/ready\": dial tcp 10.132.0.34:15021: connect: connection refused" start-of-body=
Oct 31 17:32:56.815849 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:32:56.815327    5003 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-7smk2" podUID="effd3895-446f-4877-8218-6414ce2e321b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.34:15021/healthz/ready\": dial tcp 10.132.0.34:15021: connect: connection refused"
Oct 31 17:32:57.818751 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:32:57.818719    5003 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-7smk2"
Oct 31 17:32:57.819828 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:32:57.819806    5003 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-7smk2"
Oct 31 17:33:10.330896 ip-10-0-138-17 kubenswrapper[5003]: E1031 17:33:10.330856    5003 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-tdzz5" containerName="extractor"
Oct 31 17:33:40.331491 ip-10-0-138-17 kubenswrapper[5003]: E1031 17:33:40.331443    5003 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-tdzz5" containerName="extractor"
Oct 31 17:34:10.330233 ip-10-0-138-17 kubenswrapper[5003]: E1031 17:34:10.330192    5003 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-tdzz5" containerName="extractor"
Oct 31 17:34:30.143289 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:34:30.143252    5003 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["llm/e2e-embedding-simulated-kserve-67bf594cd6-g8sbz"]
Oct 31 17:34:30.143874 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:34:30.143853    5003 cpu_manager.go:414] "containerMap: removing container" podUID="25a2aa20-adbc-45e2-92b0-63293c1e15fe" containerName="authorino"
Oct 31 17:34:30.143958 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:34:30.143877    5003 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="25a2aa20-adbc-45e2-92b0-63293c1e15fe" containerName="authorino"
Oct 31 17:34:30.144010 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:34:30.143974    5003 memory_manager.go:365] "RemoveStaleState removing state" podUID="25a2aa20-adbc-45e2-92b0-63293c1e15fe" containerName="authorino"
Oct 31 17:34:30.147356 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:34:30.147325    5003 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-g8sbz"
Oct 31 17:34:30.166956 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:34:30.166918    5003 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/e2e-embedding-simulated-kserve-67bf594cd6-g8sbz"]
Oct 31 17:34:30.175263 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:34:30.175238    5003 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Oct 31 17:34:30.175486 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:34:30.175463    5003 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-embedding-simulated-kserve-self-signed-certs\""
Oct 31 17:34:30.175560 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:34:30.175490    5003 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Oct 31 17:34:30.175618 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:34:30.175571    5003 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-vhxrl\""
Oct 31 17:34:30.323163 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:34:30.323115    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2bc523a5-fbcd-40d4-a592-9e0898f55d48-dshm\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-g8sbz\" (UID: \"2bc523a5-fbcd-40d4-a592-9e0898f55d48\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-g8sbz"
Oct 31 17:34:30.323336 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:34:30.323210    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2bc523a5-fbcd-40d4-a592-9e0898f55d48-home\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-g8sbz\" (UID: \"2bc523a5-fbcd-40d4-a592-9e0898f55d48\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-g8sbz"
Oct 31 17:34:30.323336 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:34:30.323249    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2bc523a5-fbcd-40d4-a592-9e0898f55d48-tmp-dir\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-g8sbz\" (UID: \"2bc523a5-fbcd-40d4-a592-9e0898f55d48\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-g8sbz"
Oct 31 17:34:30.323336 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:34:30.323281    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2bc523a5-fbcd-40d4-a592-9e0898f55d48-model-cache\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-g8sbz\" (UID: \"2bc523a5-fbcd-40d4-a592-9e0898f55d48\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-g8sbz"
Oct 31 17:34:30.323336 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:34:30.323321    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2bc523a5-fbcd-40d4-a592-9e0898f55d48-tls-certs\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-g8sbz\" (UID: \"2bc523a5-fbcd-40d4-a592-9e0898f55d48\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-g8sbz"
Oct 31 17:34:30.323468 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:34:30.323389    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nq6zr\" (UniqueName: \"kubernetes.io/projected/2bc523a5-fbcd-40d4-a592-9e0898f55d48-kube-api-access-nq6zr\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-g8sbz\" (UID: \"2bc523a5-fbcd-40d4-a592-9e0898f55d48\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-g8sbz"
Oct 31 17:34:30.424671 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:34:30.424540    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2bc523a5-fbcd-40d4-a592-9e0898f55d48-model-cache\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-g8sbz\" (UID: \"2bc523a5-fbcd-40d4-a592-9e0898f55d48\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-g8sbz"
Oct 31 17:34:30.424671 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:34:30.424586    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2bc523a5-fbcd-40d4-a592-9e0898f55d48-tls-certs\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-g8sbz\" (UID: \"2bc523a5-fbcd-40d4-a592-9e0898f55d48\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-g8sbz"
Oct 31 17:34:30.424671 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:34:30.424624    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nq6zr\" (UniqueName: \"kubernetes.io/projected/2bc523a5-fbcd-40d4-a592-9e0898f55d48-kube-api-access-nq6zr\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-g8sbz\" (UID: \"2bc523a5-fbcd-40d4-a592-9e0898f55d48\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-g8sbz"
Oct 31 17:34:30.424671 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:34:30.424674    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2bc523a5-fbcd-40d4-a592-9e0898f55d48-dshm\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-g8sbz\" (UID: \"2bc523a5-fbcd-40d4-a592-9e0898f55d48\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-g8sbz"
Oct 31 17:34:30.425027 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:34:30.424709    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2bc523a5-fbcd-40d4-a592-9e0898f55d48-home\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-g8sbz\" (UID: \"2bc523a5-fbcd-40d4-a592-9e0898f55d48\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-g8sbz"
Oct 31 17:34:30.425027 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:34:30.424835    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2bc523a5-fbcd-40d4-a592-9e0898f55d48-tmp-dir\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-g8sbz\" (UID: \"2bc523a5-fbcd-40d4-a592-9e0898f55d48\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-g8sbz"
Oct 31 17:34:30.425140 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:34:30.425113    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2bc523a5-fbcd-40d4-a592-9e0898f55d48-home\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-g8sbz\" (UID: \"2bc523a5-fbcd-40d4-a592-9e0898f55d48\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-g8sbz"
Oct 31 17:34:30.425195 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:34:30.425156    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2bc523a5-fbcd-40d4-a592-9e0898f55d48-model-cache\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-g8sbz\" (UID: \"2bc523a5-fbcd-40d4-a592-9e0898f55d48\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-g8sbz"
Oct 31 17:34:30.425195 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:34:30.425165    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2bc523a5-fbcd-40d4-a592-9e0898f55d48-tmp-dir\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-g8sbz\" (UID: \"2bc523a5-fbcd-40d4-a592-9e0898f55d48\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-g8sbz"
Oct 31 17:34:30.427031 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:34:30.427008    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2bc523a5-fbcd-40d4-a592-9e0898f55d48-dshm\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-g8sbz\" (UID: \"2bc523a5-fbcd-40d4-a592-9e0898f55d48\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-g8sbz"
Oct 31 17:34:30.427292 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:34:30.427272    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2bc523a5-fbcd-40d4-a592-9e0898f55d48-tls-certs\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-g8sbz\" (UID: \"2bc523a5-fbcd-40d4-a592-9e0898f55d48\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-g8sbz"
Oct 31 17:34:30.443520 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:34:30.443492    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nq6zr\" (UniqueName: \"kubernetes.io/projected/2bc523a5-fbcd-40d4-a592-9e0898f55d48-kube-api-access-nq6zr\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-g8sbz\" (UID: \"2bc523a5-fbcd-40d4-a592-9e0898f55d48\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-g8sbz"
Oct 31 17:34:30.464819 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:34:30.464781    5003 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-g8sbz"
Oct 31 17:34:30.774998 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:34:30.774912    5003 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/e2e-embedding-simulated-kserve-67bf594cd6-g8sbz"]
Oct 31 17:34:30.779151 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:34:30.779123    5003 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2bc523a5_fbcd_40d4_a592_9e0898f55d48.slice/crio-85f340d6f665b401e07b84c69726d3b3bb21e46c67e660d5286c8fcedf10946d WatchSource:0}: Error finding container 85f340d6f665b401e07b84c69726d3b3bb21e46c67e660d5286c8fcedf10946d: Status 404 returned error can't find the container with id 85f340d6f665b401e07b84c69726d3b3bb21e46c67e660d5286c8fcedf10946d
Oct 31 17:34:30.780422 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:34:30.780403    5003 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Oct 31 17:34:31.421174 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:34:31.421129    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-g8sbz" event={"ID":"2bc523a5-fbcd-40d4-a592-9e0898f55d48","Type":"ContainerStarted","Data":"85f340d6f665b401e07b84c69726d3b3bb21e46c67e660d5286c8fcedf10946d"}
Oct 31 17:34:32.427975 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:34:32.427940    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-g8sbz" event={"ID":"2bc523a5-fbcd-40d4-a592-9e0898f55d48","Type":"ContainerStarted","Data":"0c0c93ecfebcda0e30413729c9784694ead4bbee5a9447b731d4bc396acc017a"}
Oct 31 17:34:32.465748 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:34:32.465711    5003 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-g8sbz"
Oct 31 17:34:32.469827 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:34:32.469777    5003 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-g8sbz" podStartSLOduration=1.445479185 podStartE2EDuration="2.469762809s" totalImagesPullingTime="1.024283624s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 17:34:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 17:34:32.467877203 +0000 UTC m=+440.722731767" watchObservedRunningTime="2026-10-31 17:34:32.469762809 +0000 UTC m=+440.724617352"
Oct 31 17:34:34.469428 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:34:34.469386    5003 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8w4lwx"]
Oct 31 17:34:34.473829 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:34:34.473802    5003 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8w4lwx"
Oct 31 17:34:34.488734 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:34:34.488705    5003 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8w4lwx"]
Oct 31 17:34:34.509024 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:34:34.508977    5003 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\""
Oct 31 17:34:34.668110 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:34:34.668072    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/be221e0b-2de3-4826-890e-1bb3182e0d03-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8w4lwx\" (UID: \"be221e0b-2de3-4826-890e-1bb3182e0d03\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8w4lwx"
Oct 31 17:34:34.668284 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:34:34.668125    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/be221e0b-2de3-4826-890e-1bb3182e0d03-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8w4lwx\" (UID: \"be221e0b-2de3-4826-890e-1bb3182e0d03\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8w4lwx"
Oct 31 17:34:34.668284 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:34:34.668151    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/be221e0b-2de3-4826-890e-1bb3182e0d03-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8w4lwx\" (UID: \"be221e0b-2de3-4826-890e-1bb3182e0d03\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8w4lwx"
Oct 31 17:34:34.668284 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:34:34.668239    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hmxzg\" (UniqueName: \"kubernetes.io/projected/be221e0b-2de3-4826-890e-1bb3182e0d03-kube-api-access-hmxzg\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8w4lwx\" (UID: \"be221e0b-2de3-4826-890e-1bb3182e0d03\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8w4lwx"
Oct 31 17:34:34.668284 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:34:34.668279    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/be221e0b-2de3-4826-890e-1bb3182e0d03-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8w4lwx\" (UID: \"be221e0b-2de3-4826-890e-1bb3182e0d03\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8w4lwx"
Oct 31 17:34:34.668421 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:34:34.668385    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/be221e0b-2de3-4826-890e-1bb3182e0d03-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8w4lwx\" (UID: \"be221e0b-2de3-4826-890e-1bb3182e0d03\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8w4lwx"
Oct 31 17:34:34.769594 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:34:34.769511    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/be221e0b-2de3-4826-890e-1bb3182e0d03-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8w4lwx\" (UID: \"be221e0b-2de3-4826-890e-1bb3182e0d03\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8w4lwx"
Oct 31 17:34:34.769594 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:34:34.769560    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/be221e0b-2de3-4826-890e-1bb3182e0d03-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8w4lwx\" (UID: \"be221e0b-2de3-4826-890e-1bb3182e0d03\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8w4lwx"
Oct 31 17:34:34.769594 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:34:34.769593    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/be221e0b-2de3-4826-890e-1bb3182e0d03-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8w4lwx\" (UID: \"be221e0b-2de3-4826-890e-1bb3182e0d03\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8w4lwx"
Oct 31 17:34:34.769820 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:34:34.769618    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/be221e0b-2de3-4826-890e-1bb3182e0d03-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8w4lwx\" (UID: \"be221e0b-2de3-4826-890e-1bb3182e0d03\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8w4lwx"
Oct 31 17:34:34.769820 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:34:34.769640    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hmxzg\" (UniqueName: \"kubernetes.io/projected/be221e0b-2de3-4826-890e-1bb3182e0d03-kube-api-access-hmxzg\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8w4lwx\" (UID: \"be221e0b-2de3-4826-890e-1bb3182e0d03\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8w4lwx"
Oct 31 17:34:34.769820 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:34:34.769685    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/be221e0b-2de3-4826-890e-1bb3182e0d03-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8w4lwx\" (UID: \"be221e0b-2de3-4826-890e-1bb3182e0d03\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8w4lwx"
Oct 31 17:34:34.770171 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:34:34.770145    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/be221e0b-2de3-4826-890e-1bb3182e0d03-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8w4lwx\" (UID: \"be221e0b-2de3-4826-890e-1bb3182e0d03\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8w4lwx"
Oct 31 17:34:34.770244 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:34:34.770173    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/be221e0b-2de3-4826-890e-1bb3182e0d03-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8w4lwx\" (UID: \"be221e0b-2de3-4826-890e-1bb3182e0d03\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8w4lwx"
Oct 31 17:34:34.770244 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:34:34.770204    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/be221e0b-2de3-4826-890e-1bb3182e0d03-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8w4lwx\" (UID: \"be221e0b-2de3-4826-890e-1bb3182e0d03\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8w4lwx"
Oct 31 17:34:34.772005 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:34:34.771979    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/be221e0b-2de3-4826-890e-1bb3182e0d03-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8w4lwx\" (UID: \"be221e0b-2de3-4826-890e-1bb3182e0d03\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8w4lwx"
Oct 31 17:34:34.772213 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:34:34.772196    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/be221e0b-2de3-4826-890e-1bb3182e0d03-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8w4lwx\" (UID: \"be221e0b-2de3-4826-890e-1bb3182e0d03\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8w4lwx"
Oct 31 17:34:34.788260 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:34:34.788239    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hmxzg\" (UniqueName: \"kubernetes.io/projected/be221e0b-2de3-4826-890e-1bb3182e0d03-kube-api-access-hmxzg\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8w4lwx\" (UID: \"be221e0b-2de3-4826-890e-1bb3182e0d03\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8w4lwx"
Oct 31 17:34:34.794116 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:34:34.794095    5003 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8w4lwx"
Oct 31 17:34:35.087196 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:34:35.087166    5003 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8w4lwx"]
Oct 31 17:34:35.090525 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:34:35.090497    5003 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbe221e0b_2de3_4826_890e_1bb3182e0d03.slice/crio-842640a546953554c10ad4d7582259b0fb93ee9764770fbfe632fbedff9802d1 WatchSource:0}: Error finding container 842640a546953554c10ad4d7582259b0fb93ee9764770fbfe632fbedff9802d1: Status 404 returned error can't find the container with id 842640a546953554c10ad4d7582259b0fb93ee9764770fbfe632fbedff9802d1
Oct 31 17:34:35.445631 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:34:35.445550    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8w4lwx" event={"ID":"be221e0b-2de3-4826-890e-1bb3182e0d03","Type":"ContainerStarted","Data":"f8bc0c6bee0b959684110b32b5f79eb6f96b61b94ea469a74ee76f770f883da6"}
Oct 31 17:34:35.445631 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:34:35.445617    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8w4lwx" event={"ID":"be221e0b-2de3-4826-890e-1bb3182e0d03","Type":"ContainerStarted","Data":"842640a546953554c10ad4d7582259b0fb93ee9764770fbfe632fbedff9802d1"}
Oct 31 17:34:35.486611 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:34:35.486558    5003 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8w4lwx" podStartSLOduration=1.309860987 podStartE2EDuration="1.486542723s" totalImagesPullingTime="176.681736ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 17:34:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 17:34:35.48468044 +0000 UTC m=+443.739534981" watchObservedRunningTime="2026-10-31 17:34:35.486542723 +0000 UTC m=+443.741397265"
Oct 31 17:34:35.794789 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:34:35.794713    5003 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8w4lwx"
Oct 31 17:34:40.331446 ip-10-0-138-17 kubenswrapper[5003]: E1031 17:34:40.331414    5003 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-tdzz5" containerName="extractor"
Oct 31 17:34:40.465627 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:34:40.465589    5003 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-g8sbz"
Oct 31 17:34:40.478428 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:34:40.478400    5003 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-g8sbz"
Oct 31 17:34:40.489745 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:34:40.489719    5003 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-g8sbz"
Oct 31 17:34:40.583966 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:34:40.583885    5003 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-84b4ff656c-sjlmb"]
Oct 31 17:34:40.594404 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:34:40.594370    5003 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-sjlmb"
Oct 31 17:34:40.610525 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:34:40.610492    5003 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-84b4ff656c-sjlmb"]
Oct 31 17:34:40.611622 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:34:40.611590    5003 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\""
Oct 31 17:34:40.619254 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:34:40.619218    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/be2d5d86-fcd5-4bbc-b426-ac13ebe3d2cc-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-sjlmb\" (UID: \"be2d5d86-fcd5-4bbc-b426-ac13ebe3d2cc\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-sjlmb"
Oct 31 17:34:40.619390 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:34:40.619276    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mgn9j\" (UniqueName: \"kubernetes.io/projected/be2d5d86-fcd5-4bbc-b426-ac13ebe3d2cc-kube-api-access-mgn9j\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-sjlmb\" (UID: \"be2d5d86-fcd5-4bbc-b426-ac13ebe3d2cc\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-sjlmb"
Oct 31 17:34:40.619390 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:34:40.619353    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/be2d5d86-fcd5-4bbc-b426-ac13ebe3d2cc-home\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-sjlmb\" (UID: \"be2d5d86-fcd5-4bbc-b426-ac13ebe3d2cc\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-sjlmb"
Oct 31 17:34:40.619390 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:34:40.619383    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/be2d5d86-fcd5-4bbc-b426-ac13ebe3d2cc-dshm\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-sjlmb\" (UID: \"be2d5d86-fcd5-4bbc-b426-ac13ebe3d2cc\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-sjlmb"
Oct 31 17:34:40.619574 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:34:40.619454    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/be2d5d86-fcd5-4bbc-b426-ac13ebe3d2cc-model-cache\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-sjlmb\" (UID: \"be2d5d86-fcd5-4bbc-b426-ac13ebe3d2cc\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-sjlmb"
Oct 31 17:34:40.619574 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:34:40.619500    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/be2d5d86-fcd5-4bbc-b426-ac13ebe3d2cc-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-sjlmb\" (UID: \"be2d5d86-fcd5-4bbc-b426-ac13ebe3d2cc\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-sjlmb"
Oct 31 17:34:40.719953 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:34:40.719910    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/be2d5d86-fcd5-4bbc-b426-ac13ebe3d2cc-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-sjlmb\" (UID: \"be2d5d86-fcd5-4bbc-b426-ac13ebe3d2cc\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-sjlmb"
Oct 31 17:34:40.719953 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:34:40.719954    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mgn9j\" (UniqueName: \"kubernetes.io/projected/be2d5d86-fcd5-4bbc-b426-ac13ebe3d2cc-kube-api-access-mgn9j\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-sjlmb\" (UID: \"be2d5d86-fcd5-4bbc-b426-ac13ebe3d2cc\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-sjlmb"
Oct 31 17:34:40.720221 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:34:40.720070    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/be2d5d86-fcd5-4bbc-b426-ac13ebe3d2cc-home\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-sjlmb\" (UID: \"be2d5d86-fcd5-4bbc-b426-ac13ebe3d2cc\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-sjlmb"
Oct 31 17:34:40.720221 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:34:40.720124    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/be2d5d86-fcd5-4bbc-b426-ac13ebe3d2cc-dshm\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-sjlmb\" (UID: \"be2d5d86-fcd5-4bbc-b426-ac13ebe3d2cc\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-sjlmb"
Oct 31 17:34:40.720221 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:34:40.720176    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/be2d5d86-fcd5-4bbc-b426-ac13ebe3d2cc-model-cache\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-sjlmb\" (UID: \"be2d5d86-fcd5-4bbc-b426-ac13ebe3d2cc\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-sjlmb"
Oct 31 17:34:40.720400 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:34:40.720252    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/be2d5d86-fcd5-4bbc-b426-ac13ebe3d2cc-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-sjlmb\" (UID: \"be2d5d86-fcd5-4bbc-b426-ac13ebe3d2cc\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-sjlmb"
Oct 31 17:34:40.720531 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:34:40.720500    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/be2d5d86-fcd5-4bbc-b426-ac13ebe3d2cc-home\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-sjlmb\" (UID: \"be2d5d86-fcd5-4bbc-b426-ac13ebe3d2cc\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-sjlmb"
Oct 31 17:34:40.720691 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:34:40.720602    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/be2d5d86-fcd5-4bbc-b426-ac13ebe3d2cc-model-cache\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-sjlmb\" (UID: \"be2d5d86-fcd5-4bbc-b426-ac13ebe3d2cc\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-sjlmb"
Oct 31 17:34:40.720764 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:34:40.720721    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/be2d5d86-fcd5-4bbc-b426-ac13ebe3d2cc-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-sjlmb\" (UID: \"be2d5d86-fcd5-4bbc-b426-ac13ebe3d2cc\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-sjlmb"
Oct 31 17:34:40.722295 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:34:40.722271    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/be2d5d86-fcd5-4bbc-b426-ac13ebe3d2cc-dshm\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-sjlmb\" (UID: \"be2d5d86-fcd5-4bbc-b426-ac13ebe3d2cc\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-sjlmb"
Oct 31 17:34:40.722544 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:34:40.722524    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/be2d5d86-fcd5-4bbc-b426-ac13ebe3d2cc-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-sjlmb\" (UID: \"be2d5d86-fcd5-4bbc-b426-ac13ebe3d2cc\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-sjlmb"
Oct 31 17:34:40.738231 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:34:40.738206    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mgn9j\" (UniqueName: \"kubernetes.io/projected/be2d5d86-fcd5-4bbc-b426-ac13ebe3d2cc-kube-api-access-mgn9j\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-sjlmb\" (UID: \"be2d5d86-fcd5-4bbc-b426-ac13ebe3d2cc\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-sjlmb"
Oct 31 17:34:40.914496 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:34:40.914390    5003 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-sjlmb"
Oct 31 17:34:41.217838 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:34:41.217739    5003 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-84b4ff656c-sjlmb"]
Oct 31 17:34:41.221674 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:34:41.221630    5003 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbe2d5d86_fcd5_4bbc_b426_ac13ebe3d2cc.slice/crio-5b0a705bcf52bd03cc1fea1dfecdb4e98ce69e445e9c3c1f5474e9e7d0eb747e WatchSource:0}: Error finding container 5b0a705bcf52bd03cc1fea1dfecdb4e98ce69e445e9c3c1f5474e9e7d0eb747e: Status 404 returned error can't find the container with id 5b0a705bcf52bd03cc1fea1dfecdb4e98ce69e445e9c3c1f5474e9e7d0eb747e
Oct 31 17:34:41.484347 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:34:41.483675    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-sjlmb" event={"ID":"be2d5d86-fcd5-4bbc-b426-ac13ebe3d2cc","Type":"ContainerStarted","Data":"48ff562dc27b58ed4752558e673cd19ae789abd63b7d96d28fc697ecd31eccf9"}
Oct 31 17:34:41.484347 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:34:41.483745    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-sjlmb" event={"ID":"be2d5d86-fcd5-4bbc-b426-ac13ebe3d2cc","Type":"ContainerStarted","Data":"5b0a705bcf52bd03cc1fea1dfecdb4e98ce69e445e9c3c1f5474e9e7d0eb747e"}
Oct 31 17:34:41.523826 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:34:41.523771    5003 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-sjlmb" podStartSLOduration=1.354324263 podStartE2EDuration="1.5237534s" totalImagesPullingTime="169.429137ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 17:34:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 17:34:41.520963162 +0000 UTC m=+449.775817706" watchObservedRunningTime="2026-10-31 17:34:41.5237534 +0000 UTC m=+449.778607942"
Oct 31 17:34:41.758369 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:34:41.758279    5003 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-82w89"]
Oct 31 17:34:41.762053 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:34:41.762029    5003 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-82w89"
Oct 31 17:34:41.779155 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:34:41.779124    5003 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\""
Oct 31 17:34:41.792916 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:34:41.792890    5003 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-82w89"]
Oct 31 17:34:41.831330 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:34:41.831297    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ef5a065b-f98e-4d14-810f-2d0c42c58ce6-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5f5c4b459f-82w89\" (UID: \"ef5a065b-f98e-4d14-810f-2d0c42c58ce6\") " pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-82w89"
Oct 31 17:34:41.831475 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:34:41.831336    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ef5a065b-f98e-4d14-810f-2d0c42c58ce6-dshm\") pod \"premium-simulated-simulated-premium-kserve-5f5c4b459f-82w89\" (UID: \"ef5a065b-f98e-4d14-810f-2d0c42c58ce6\") " pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-82w89"
Oct 31 17:34:41.831475 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:34:41.831410    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bdj5n\" (UniqueName: \"kubernetes.io/projected/ef5a065b-f98e-4d14-810f-2d0c42c58ce6-kube-api-access-bdj5n\") pod \"premium-simulated-simulated-premium-kserve-5f5c4b459f-82w89\" (UID: \"ef5a065b-f98e-4d14-810f-2d0c42c58ce6\") " pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-82w89"
Oct 31 17:34:41.831568 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:34:41.831485    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ef5a065b-f98e-4d14-810f-2d0c42c58ce6-home\") pod \"premium-simulated-simulated-premium-kserve-5f5c4b459f-82w89\" (UID: \"ef5a065b-f98e-4d14-810f-2d0c42c58ce6\") " pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-82w89"
Oct 31 17:34:41.831568 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:34:41.831512    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ef5a065b-f98e-4d14-810f-2d0c42c58ce6-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5f5c4b459f-82w89\" (UID: \"ef5a065b-f98e-4d14-810f-2d0c42c58ce6\") " pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-82w89"
Oct 31 17:34:41.831671 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:34:41.831606    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ef5a065b-f98e-4d14-810f-2d0c42c58ce6-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5f5c4b459f-82w89\" (UID: \"ef5a065b-f98e-4d14-810f-2d0c42c58ce6\") " pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-82w89"
Oct 31 17:34:41.914866 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:34:41.914834    5003 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-sjlmb"
Oct 31 17:34:41.932919 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:34:41.932728    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ef5a065b-f98e-4d14-810f-2d0c42c58ce6-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5f5c4b459f-82w89\" (UID: \"ef5a065b-f98e-4d14-810f-2d0c42c58ce6\") " pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-82w89"
Oct 31 17:34:41.932919 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:34:41.932782    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ef5a065b-f98e-4d14-810f-2d0c42c58ce6-dshm\") pod \"premium-simulated-simulated-premium-kserve-5f5c4b459f-82w89\" (UID: \"ef5a065b-f98e-4d14-810f-2d0c42c58ce6\") " pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-82w89"
Oct 31 17:34:41.932919 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:34:41.932822    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bdj5n\" (UniqueName: \"kubernetes.io/projected/ef5a065b-f98e-4d14-810f-2d0c42c58ce6-kube-api-access-bdj5n\") pod \"premium-simulated-simulated-premium-kserve-5f5c4b459f-82w89\" (UID: \"ef5a065b-f98e-4d14-810f-2d0c42c58ce6\") " pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-82w89"
Oct 31 17:34:41.933243 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:34:41.932950    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ef5a065b-f98e-4d14-810f-2d0c42c58ce6-home\") pod \"premium-simulated-simulated-premium-kserve-5f5c4b459f-82w89\" (UID: \"ef5a065b-f98e-4d14-810f-2d0c42c58ce6\") " pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-82w89"
Oct 31 17:34:41.933243 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:34:41.932987    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ef5a065b-f98e-4d14-810f-2d0c42c58ce6-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5f5c4b459f-82w89\" (UID: \"ef5a065b-f98e-4d14-810f-2d0c42c58ce6\") " pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-82w89"
Oct 31 17:34:41.933243 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:34:41.933101    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ef5a065b-f98e-4d14-810f-2d0c42c58ce6-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5f5c4b459f-82w89\" (UID: \"ef5a065b-f98e-4d14-810f-2d0c42c58ce6\") " pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-82w89"
Oct 31 17:34:41.933243 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:34:41.933147    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ef5a065b-f98e-4d14-810f-2d0c42c58ce6-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5f5c4b459f-82w89\" (UID: \"ef5a065b-f98e-4d14-810f-2d0c42c58ce6\") " pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-82w89"
Oct 31 17:34:41.933455 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:34:41.933424    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ef5a065b-f98e-4d14-810f-2d0c42c58ce6-home\") pod \"premium-simulated-simulated-premium-kserve-5f5c4b459f-82w89\" (UID: \"ef5a065b-f98e-4d14-810f-2d0c42c58ce6\") " pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-82w89"
Oct 31 17:34:41.933510 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:34:41.933491    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ef5a065b-f98e-4d14-810f-2d0c42c58ce6-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5f5c4b459f-82w89\" (UID: \"ef5a065b-f98e-4d14-810f-2d0c42c58ce6\") " pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-82w89"
Oct 31 17:34:41.935542 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:34:41.935499    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ef5a065b-f98e-4d14-810f-2d0c42c58ce6-dshm\") pod \"premium-simulated-simulated-premium-kserve-5f5c4b459f-82w89\" (UID: \"ef5a065b-f98e-4d14-810f-2d0c42c58ce6\") " pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-82w89"
Oct 31 17:34:41.936231 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:34:41.936210    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ef5a065b-f98e-4d14-810f-2d0c42c58ce6-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5f5c4b459f-82w89\" (UID: \"ef5a065b-f98e-4d14-810f-2d0c42c58ce6\") " pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-82w89"
Oct 31 17:34:41.951269 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:34:41.951242    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bdj5n\" (UniqueName: \"kubernetes.io/projected/ef5a065b-f98e-4d14-810f-2d0c42c58ce6-kube-api-access-bdj5n\") pod \"premium-simulated-simulated-premium-kserve-5f5c4b459f-82w89\" (UID: \"ef5a065b-f98e-4d14-810f-2d0c42c58ce6\") " pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-82w89"
Oct 31 17:34:42.074768 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:34:42.074732    5003 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-82w89"
Oct 31 17:34:42.375173 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:34:42.375092    5003 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-82w89"]
Oct 31 17:34:42.378676 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:34:42.378628    5003 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podef5a065b_f98e_4d14_810f_2d0c42c58ce6.slice/crio-7f014eb383e8b0479924ee4b21f8db747efe05f6bf9e8da318b3a6988fa2cc8f WatchSource:0}: Error finding container 7f014eb383e8b0479924ee4b21f8db747efe05f6bf9e8da318b3a6988fa2cc8f: Status 404 returned error can't find the container with id 7f014eb383e8b0479924ee4b21f8db747efe05f6bf9e8da318b3a6988fa2cc8f
Oct 31 17:34:42.492706 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:34:42.492668    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-82w89" event={"ID":"ef5a065b-f98e-4d14-810f-2d0c42c58ce6","Type":"ContainerStarted","Data":"7f014eb383e8b0479924ee4b21f8db747efe05f6bf9e8da318b3a6988fa2cc8f"}
Oct 31 17:34:43.503336 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:34:43.503293    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-82w89" event={"ID":"ef5a065b-f98e-4d14-810f-2d0c42c58ce6","Type":"ContainerStarted","Data":"f1be1c45374c4f7140d9c342c6d1cf587d328bf6b2e77e42d638776a030f8049"}
Oct 31 17:34:43.540905 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:34:43.540851    5003 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-82w89" podStartSLOduration=2.373731816 podStartE2EDuration="2.540836015s" totalImagesPullingTime="167.104199ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 17:34:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 17:34:43.54036165 +0000 UTC m=+451.795216202" watchObservedRunningTime="2026-10-31 17:34:43.540836015 +0000 UTC m=+451.795690557"
Oct 31 17:34:44.075061 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:34:44.075007    5003 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-82w89"
Oct 31 17:34:44.795207 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:34:44.795174    5003 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8w4lwx"
Oct 31 17:34:44.807748 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:34:44.807725    5003 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8w4lwx"
Oct 31 17:34:45.530713 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:34:45.530681    5003 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8w4lwx"
Oct 31 17:34:50.915536 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:34:50.915498    5003 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-sjlmb"
Oct 31 17:34:50.928136 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:34:50.928108    5003 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-sjlmb"
Oct 31 17:34:51.557631 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:34:51.557600    5003 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-sjlmb"
Oct 31 17:34:52.075029 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:34:52.074999    5003 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-82w89"
Oct 31 17:34:52.087710 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:34:52.087680    5003 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-82w89"
Oct 31 17:34:52.562923 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:34:52.562898    5003 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-82w89"
Oct 31 17:34:57.100305 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:34:57.100270    5003 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-df4c7dd9c-zpdb8"]
Oct 31 17:34:57.103605 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:34:57.103587    5003 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-df4c7dd9c-zpdb8"
Oct 31 17:34:57.131745 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:34:57.131721    5003 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Oct 31 17:34:57.131745 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:34:57.131739    5003 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-jvk7n\""
Oct 31 17:34:57.135249 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:34:57.135223    5003 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-df4c7dd9c-zpdb8"]
Oct 31 17:34:57.179438 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:34:57.179407    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qr8xg\" (UniqueName: \"kubernetes.io/projected/f3636069-accf-42f5-a091-52838e7a1a72-kube-api-access-qr8xg\") pod \"authorino-df4c7dd9c-zpdb8\" (UID: \"f3636069-accf-42f5-a091-52838e7a1a72\") " pod="kuadrant-system/authorino-df4c7dd9c-zpdb8"
Oct 31 17:34:57.179584 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:34:57.179467    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/f3636069-accf-42f5-a091-52838e7a1a72-tls-cert\") pod \"authorino-df4c7dd9c-zpdb8\" (UID: \"f3636069-accf-42f5-a091-52838e7a1a72\") " pod="kuadrant-system/authorino-df4c7dd9c-zpdb8"
Oct 31 17:34:57.216574 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:34:57.216542    5003 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-z6b99"]
Oct 31 17:34:57.220156 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:34:57.220136    5003 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-z6b99"
Oct 31 17:34:57.244607 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:34:57.244578    5003 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-z6b99"]
Oct 31 17:34:57.280308 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:34:57.280275    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/f3636069-accf-42f5-a091-52838e7a1a72-tls-cert\") pod \"authorino-df4c7dd9c-zpdb8\" (UID: \"f3636069-accf-42f5-a091-52838e7a1a72\") " pod="kuadrant-system/authorino-df4c7dd9c-zpdb8"
Oct 31 17:34:57.280463 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:34:57.280318    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/838478fc-1a24-432e-bb93-15d49ee7e1ed-credential-socket\") pod \"maas-default-gateway-openshift-default-7d9897b54c-z6b99\" (UID: \"838478fc-1a24-432e-bb93-15d49ee7e1ed\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-z6b99"
Oct 31 17:34:57.280463 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:34:57.280337    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fcsxm\" (UniqueName: \"kubernetes.io/projected/838478fc-1a24-432e-bb93-15d49ee7e1ed-kube-api-access-fcsxm\") pod \"maas-default-gateway-openshift-default-7d9897b54c-z6b99\" (UID: \"838478fc-1a24-432e-bb93-15d49ee7e1ed\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-z6b99"
Oct 31 17:34:57.280463 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:34:57.280417    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/838478fc-1a24-432e-bb93-15d49ee7e1ed-workload-socket\") pod \"maas-default-gateway-openshift-default-7d9897b54c-z6b99\" (UID: \"838478fc-1a24-432e-bb93-15d49ee7e1ed\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-z6b99"
Oct 31 17:34:57.280565 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:34:57.280506    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/838478fc-1a24-432e-bb93-15d49ee7e1ed-workload-certs\") pod \"maas-default-gateway-openshift-default-7d9897b54c-z6b99\" (UID: \"838478fc-1a24-432e-bb93-15d49ee7e1ed\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-z6b99"
Oct 31 17:34:57.280565 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:34:57.280556    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qr8xg\" (UniqueName: \"kubernetes.io/projected/f3636069-accf-42f5-a091-52838e7a1a72-kube-api-access-qr8xg\") pod \"authorino-df4c7dd9c-zpdb8\" (UID: \"f3636069-accf-42f5-a091-52838e7a1a72\") " pod="kuadrant-system/authorino-df4c7dd9c-zpdb8"
Oct 31 17:34:57.280630 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:34:57.280579    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/838478fc-1a24-432e-bb93-15d49ee7e1ed-istio-data\") pod \"maas-default-gateway-openshift-default-7d9897b54c-z6b99\" (UID: \"838478fc-1a24-432e-bb93-15d49ee7e1ed\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-z6b99"
Oct 31 17:34:57.280630 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:34:57.280601    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/838478fc-1a24-432e-bb93-15d49ee7e1ed-istio-podinfo\") pod \"maas-default-gateway-openshift-default-7d9897b54c-z6b99\" (UID: \"838478fc-1a24-432e-bb93-15d49ee7e1ed\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-z6b99"
Oct 31 17:34:57.280725 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:34:57.280665    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/838478fc-1a24-432e-bb93-15d49ee7e1ed-istio-token\") pod \"maas-default-gateway-openshift-default-7d9897b54c-z6b99\" (UID: \"838478fc-1a24-432e-bb93-15d49ee7e1ed\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-z6b99"
Oct 31 17:34:57.280768 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:34:57.280722    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/838478fc-1a24-432e-bb93-15d49ee7e1ed-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-7d9897b54c-z6b99\" (UID: \"838478fc-1a24-432e-bb93-15d49ee7e1ed\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-z6b99"
Oct 31 17:34:57.280873 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:34:57.280768    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/838478fc-1a24-432e-bb93-15d49ee7e1ed-istio-envoy\") pod \"maas-default-gateway-openshift-default-7d9897b54c-z6b99\" (UID: \"838478fc-1a24-432e-bb93-15d49ee7e1ed\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-z6b99"
Oct 31 17:34:57.282783 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:34:57.282763    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/f3636069-accf-42f5-a091-52838e7a1a72-tls-cert\") pod \"authorino-df4c7dd9c-zpdb8\" (UID: \"f3636069-accf-42f5-a091-52838e7a1a72\") " pod="kuadrant-system/authorino-df4c7dd9c-zpdb8"
Oct 31 17:34:57.298848 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:34:57.298819    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qr8xg\" (UniqueName: \"kubernetes.io/projected/f3636069-accf-42f5-a091-52838e7a1a72-kube-api-access-qr8xg\") pod \"authorino-df4c7dd9c-zpdb8\" (UID: \"f3636069-accf-42f5-a091-52838e7a1a72\") " pod="kuadrant-system/authorino-df4c7dd9c-zpdb8"
Oct 31 17:34:57.381819 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:34:57.381724    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/838478fc-1a24-432e-bb93-15d49ee7e1ed-workload-socket\") pod \"maas-default-gateway-openshift-default-7d9897b54c-z6b99\" (UID: \"838478fc-1a24-432e-bb93-15d49ee7e1ed\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-z6b99"
Oct 31 17:34:57.381819 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:34:57.381779    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/838478fc-1a24-432e-bb93-15d49ee7e1ed-workload-certs\") pod \"maas-default-gateway-openshift-default-7d9897b54c-z6b99\" (UID: \"838478fc-1a24-432e-bb93-15d49ee7e1ed\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-z6b99"
Oct 31 17:34:57.381819 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:34:57.381820    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/838478fc-1a24-432e-bb93-15d49ee7e1ed-istio-data\") pod \"maas-default-gateway-openshift-default-7d9897b54c-z6b99\" (UID: \"838478fc-1a24-432e-bb93-15d49ee7e1ed\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-z6b99"
Oct 31 17:34:57.382116 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:34:57.381840    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/838478fc-1a24-432e-bb93-15d49ee7e1ed-istio-podinfo\") pod \"maas-default-gateway-openshift-default-7d9897b54c-z6b99\" (UID: \"838478fc-1a24-432e-bb93-15d49ee7e1ed\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-z6b99"
Oct 31 17:34:57.382116 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:34:57.381859    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/838478fc-1a24-432e-bb93-15d49ee7e1ed-istio-token\") pod \"maas-default-gateway-openshift-default-7d9897b54c-z6b99\" (UID: \"838478fc-1a24-432e-bb93-15d49ee7e1ed\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-z6b99"
Oct 31 17:34:57.382116 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:34:57.381881    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/838478fc-1a24-432e-bb93-15d49ee7e1ed-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-7d9897b54c-z6b99\" (UID: \"838478fc-1a24-432e-bb93-15d49ee7e1ed\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-z6b99"
Oct 31 17:34:57.382116 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:34:57.381911    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/838478fc-1a24-432e-bb93-15d49ee7e1ed-istio-envoy\") pod \"maas-default-gateway-openshift-default-7d9897b54c-z6b99\" (UID: \"838478fc-1a24-432e-bb93-15d49ee7e1ed\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-z6b99"
Oct 31 17:34:57.382116 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:34:57.381970    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/838478fc-1a24-432e-bb93-15d49ee7e1ed-credential-socket\") pod \"maas-default-gateway-openshift-default-7d9897b54c-z6b99\" (UID: \"838478fc-1a24-432e-bb93-15d49ee7e1ed\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-z6b99"
Oct 31 17:34:57.382116 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:34:57.382009    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fcsxm\" (UniqueName: \"kubernetes.io/projected/838478fc-1a24-432e-bb93-15d49ee7e1ed-kube-api-access-fcsxm\") pod \"maas-default-gateway-openshift-default-7d9897b54c-z6b99\" (UID: \"838478fc-1a24-432e-bb93-15d49ee7e1ed\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-z6b99"
Oct 31 17:34:57.382398 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:34:57.382211    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/838478fc-1a24-432e-bb93-15d49ee7e1ed-workload-socket\") pod \"maas-default-gateway-openshift-default-7d9897b54c-z6b99\" (UID: \"838478fc-1a24-432e-bb93-15d49ee7e1ed\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-z6b99"
Oct 31 17:34:57.382398 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:34:57.382279    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/838478fc-1a24-432e-bb93-15d49ee7e1ed-workload-certs\") pod \"maas-default-gateway-openshift-default-7d9897b54c-z6b99\" (UID: \"838478fc-1a24-432e-bb93-15d49ee7e1ed\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-z6b99"
Oct 31 17:34:57.382398 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:34:57.382368    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/838478fc-1a24-432e-bb93-15d49ee7e1ed-istio-data\") pod \"maas-default-gateway-openshift-default-7d9897b54c-z6b99\" (UID: \"838478fc-1a24-432e-bb93-15d49ee7e1ed\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-z6b99"
Oct 31 17:34:57.382546 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:34:57.382453    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/838478fc-1a24-432e-bb93-15d49ee7e1ed-credential-socket\") pod \"maas-default-gateway-openshift-default-7d9897b54c-z6b99\" (UID: \"838478fc-1a24-432e-bb93-15d49ee7e1ed\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-z6b99"
Oct 31 17:34:57.382694 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:34:57.382670    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/838478fc-1a24-432e-bb93-15d49ee7e1ed-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-7d9897b54c-z6b99\" (UID: \"838478fc-1a24-432e-bb93-15d49ee7e1ed\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-z6b99"
Oct 31 17:34:57.384207 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:34:57.384186    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/838478fc-1a24-432e-bb93-15d49ee7e1ed-istio-envoy\") pod \"maas-default-gateway-openshift-default-7d9897b54c-z6b99\" (UID: \"838478fc-1a24-432e-bb93-15d49ee7e1ed\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-z6b99"
Oct 31 17:34:57.384433 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:34:57.384411    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/838478fc-1a24-432e-bb93-15d49ee7e1ed-istio-podinfo\") pod \"maas-default-gateway-openshift-default-7d9897b54c-z6b99\" (UID: \"838478fc-1a24-432e-bb93-15d49ee7e1ed\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-z6b99"
Oct 31 17:34:57.400085 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:34:57.400061    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/838478fc-1a24-432e-bb93-15d49ee7e1ed-istio-token\") pod \"maas-default-gateway-openshift-default-7d9897b54c-z6b99\" (UID: \"838478fc-1a24-432e-bb93-15d49ee7e1ed\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-z6b99"
Oct 31 17:34:57.400345 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:34:57.400324    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fcsxm\" (UniqueName: \"kubernetes.io/projected/838478fc-1a24-432e-bb93-15d49ee7e1ed-kube-api-access-fcsxm\") pod \"maas-default-gateway-openshift-default-7d9897b54c-z6b99\" (UID: \"838478fc-1a24-432e-bb93-15d49ee7e1ed\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-z6b99"
Oct 31 17:34:57.416105 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:34:57.416086    5003 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-df4c7dd9c-zpdb8"
Oct 31 17:34:57.533476 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:34:57.533441    5003 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-z6b99"
Oct 31 17:34:57.707555 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:34:57.707473    5003 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-df4c7dd9c-zpdb8"]
Oct 31 17:34:57.711512 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:34:57.711481    5003 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf3636069_accf_42f5_a091_52838e7a1a72.slice/crio-4ebc6ccf36571b2fb85175680a1d6769093a80bb6ff122a835265c7999eb03d6 WatchSource:0}: Error finding container 4ebc6ccf36571b2fb85175680a1d6769093a80bb6ff122a835265c7999eb03d6: Status 404 returned error can't find the container with id 4ebc6ccf36571b2fb85175680a1d6769093a80bb6ff122a835265c7999eb03d6
Oct 31 17:34:57.847606 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:34:57.847570    5003 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-z6b99"]
Oct 31 17:34:57.851629 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:34:57.851592    5003 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod838478fc_1a24_432e_bb93_15d49ee7e1ed.slice/crio-8cfb446d37210dd75866cf02b6e83fab84c9c762906f550d12c763c1bad1aa08 WatchSource:0}: Error finding container 8cfb446d37210dd75866cf02b6e83fab84c9c762906f550d12c763c1bad1aa08: Status 404 returned error can't find the container with id 8cfb446d37210dd75866cf02b6e83fab84c9c762906f550d12c763c1bad1aa08
Oct 31 17:34:57.853833 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:34:57.853799    5003 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Oct 31 17:34:57.853919 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:34:57.853868    5003 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Oct 31 17:34:57.853919 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:34:57.853906    5003 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Oct 31 17:34:58.587774 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:34:58.587739    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-df4c7dd9c-zpdb8" event={"ID":"f3636069-accf-42f5-a091-52838e7a1a72","Type":"ContainerStarted","Data":"5d931bd0642e170f852b74cd6c7c3a5f19864a0d6c1f1fac8775c0c6dad8eb2e"}
Oct 31 17:34:58.588288 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:34:58.587788    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-df4c7dd9c-zpdb8" event={"ID":"f3636069-accf-42f5-a091-52838e7a1a72","Type":"ContainerStarted","Data":"4ebc6ccf36571b2fb85175680a1d6769093a80bb6ff122a835265c7999eb03d6"}
Oct 31 17:34:58.589432 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:34:58.589402    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-z6b99" event={"ID":"838478fc-1a24-432e-bb93-15d49ee7e1ed","Type":"ContainerStarted","Data":"f0cee5966649f190a99c52ea226b6e1cb3a42d400b28e4d6e0b1709ebb4c65f4"}
Oct 31 17:34:58.589576 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:34:58.589461    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-z6b99" event={"ID":"838478fc-1a24-432e-bb93-15d49ee7e1ed","Type":"ContainerStarted","Data":"8cfb446d37210dd75866cf02b6e83fab84c9c762906f550d12c763c1bad1aa08"}
Oct 31 17:34:58.625374 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:34:58.625298    5003 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/authorino-df4c7dd9c-zpdb8" podStartSLOduration=1.169628616 podStartE2EDuration="1.625278494s" totalImagesPullingTime="455.649878ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 17:34:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 17:34:58.623278131 +0000 UTC m=+466.878132673" watchObservedRunningTime="2026-10-31 17:34:58.625278494 +0000 UTC m=+466.880133037"
Oct 31 17:34:58.688314 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:34:58.687617    5003 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-z6b99" podStartSLOduration=1.687593898 podStartE2EDuration="1.687593898s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 17:34:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 17:34:58.668184679 +0000 UTC m=+466.923039255" watchObservedRunningTime="2026-10-31 17:34:58.687593898 +0000 UTC m=+466.942448481"
Oct 31 17:34:59.534495 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:34:59.534461    5003 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-z6b99"
Oct 31 17:34:59.536360 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:34:59.536332    5003 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-7d9897b54c-z6b99 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" start-of-body=
Oct 31 17:34:59.536512 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:34:59.536386    5003 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-z6b99" podUID="838478fc-1a24-432e-bb93-15d49ee7e1ed" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused"
Oct 31 17:35:00.533808 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:35:00.533765    5003 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-7d9897b54c-z6b99 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" start-of-body=
Oct 31 17:35:00.534368 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:35:00.533819    5003 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-z6b99" podUID="838478fc-1a24-432e-bb93-15d49ee7e1ed" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused"
Oct 31 17:35:01.534798 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:35:01.534763    5003 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-7d9897b54c-z6b99 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" start-of-body=
Oct 31 17:35:01.535218 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:35:01.534825    5003 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-z6b99" podUID="838478fc-1a24-432e-bb93-15d49ee7e1ed" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused"
Oct 31 17:35:02.534246 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:35:02.534207    5003 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-7d9897b54c-z6b99 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" start-of-body=
Oct 31 17:35:02.534445 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:35:02.534290    5003 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-z6b99" podUID="838478fc-1a24-432e-bb93-15d49ee7e1ed" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused"
Oct 31 17:35:03.533883 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:35:03.533844    5003 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-7d9897b54c-z6b99 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" start-of-body=
Oct 31 17:35:03.534388 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:35:03.533919    5003 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-z6b99" podUID="838478fc-1a24-432e-bb93-15d49ee7e1ed" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused"
Oct 31 17:35:04.533906 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:35:04.533856    5003 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-7d9897b54c-z6b99 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" start-of-body=
Oct 31 17:35:04.534409 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:35:04.533929    5003 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-z6b99" podUID="838478fc-1a24-432e-bb93-15d49ee7e1ed" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused"
Oct 31 17:35:06.535747 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:35:06.535704    5003 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-7d9897b54c-z6b99 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 31 17:35:06.536258 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:35:06.535772    5003 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-z6b99" podUID="838478fc-1a24-432e-bb93-15d49ee7e1ed" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 31 17:35:07.576829 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:35:07.576783    5003 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-7d9897b54c-z6b99 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 31 17:35:07.577318 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:35:07.576855    5003 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-z6b99" podUID="838478fc-1a24-432e-bb93-15d49ee7e1ed" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 31 17:35:08.365106 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:35:08.365066    5003 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-z6b99"
Oct 31 17:35:08.365548 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:35:08.365518    5003 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-z6b99"
Oct 31 17:35:08.366586 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:35:08.366562    5003 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-z6b99"
Oct 31 17:35:10.331381 ip-10-0-138-17 kubenswrapper[5003]: E1031 17:35:10.331345    5003 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-tdzz5" containerName="extractor"
Oct 31 17:35:40.330973 ip-10-0-138-17 kubenswrapper[5003]: E1031 17:35:40.330885    5003 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-tdzz5" containerName="extractor"
Oct 31 17:36:10.332182 ip-10-0-138-17 kubenswrapper[5003]: E1031 17:36:10.332141    5003 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-tdzz5" containerName="extractor"
Oct 31 17:36:30.808033 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:30.807996    5003 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w5-b78c31-openshift-default-774cb4f6c9-p7lp5"]
Oct 31 17:36:30.811875 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:30.811853    5003 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-b78c31-openshift-default-774cb4f6c9-p7lp5"
Oct 31 17:36:30.826668 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:30.826615    5003 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w5-b78c31-openshift-default-dockercfg-7pl9w\""
Oct 31 17:36:30.840709 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:30.840675    5003 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w5-b78c31-openshift-default-774cb4f6c9-p7lp5"]
Oct 31 17:36:30.859698 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:30.859662    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4482b94f-d7f9-4575-b22e-765dfd4ad693-istio-envoy\") pod \"e2e-worker-w5-b78c31-openshift-default-774cb4f6c9-p7lp5\" (UID: \"4482b94f-d7f9-4575-b22e-765dfd4ad693\") " pod="openshift-ingress/e2e-worker-w5-b78c31-openshift-default-774cb4f6c9-p7lp5"
Oct 31 17:36:30.859856 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:30.859715    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4482b94f-d7f9-4575-b22e-765dfd4ad693-istiod-ca-cert\") pod \"e2e-worker-w5-b78c31-openshift-default-774cb4f6c9-p7lp5\" (UID: \"4482b94f-d7f9-4575-b22e-765dfd4ad693\") " pod="openshift-ingress/e2e-worker-w5-b78c31-openshift-default-774cb4f6c9-p7lp5"
Oct 31 17:36:30.859900 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:30.859865    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4482b94f-d7f9-4575-b22e-765dfd4ad693-istio-podinfo\") pod \"e2e-worker-w5-b78c31-openshift-default-774cb4f6c9-p7lp5\" (UID: \"4482b94f-d7f9-4575-b22e-765dfd4ad693\") " pod="openshift-ingress/e2e-worker-w5-b78c31-openshift-default-774cb4f6c9-p7lp5"
Oct 31 17:36:30.859941 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:30.859907    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4482b94f-d7f9-4575-b22e-765dfd4ad693-istio-token\") pod \"e2e-worker-w5-b78c31-openshift-default-774cb4f6c9-p7lp5\" (UID: \"4482b94f-d7f9-4575-b22e-765dfd4ad693\") " pod="openshift-ingress/e2e-worker-w5-b78c31-openshift-default-774cb4f6c9-p7lp5"
Oct 31 17:36:30.860031 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:30.860012    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4482b94f-d7f9-4575-b22e-765dfd4ad693-credential-socket\") pod \"e2e-worker-w5-b78c31-openshift-default-774cb4f6c9-p7lp5\" (UID: \"4482b94f-d7f9-4575-b22e-765dfd4ad693\") " pod="openshift-ingress/e2e-worker-w5-b78c31-openshift-default-774cb4f6c9-p7lp5"
Oct 31 17:36:30.860093 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:30.860079    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4482b94f-d7f9-4575-b22e-765dfd4ad693-workload-certs\") pod \"e2e-worker-w5-b78c31-openshift-default-774cb4f6c9-p7lp5\" (UID: \"4482b94f-d7f9-4575-b22e-765dfd4ad693\") " pod="openshift-ingress/e2e-worker-w5-b78c31-openshift-default-774cb4f6c9-p7lp5"
Oct 31 17:36:30.860182 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:30.860161    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jrj2f\" (UniqueName: \"kubernetes.io/projected/4482b94f-d7f9-4575-b22e-765dfd4ad693-kube-api-access-jrj2f\") pod \"e2e-worker-w5-b78c31-openshift-default-774cb4f6c9-p7lp5\" (UID: \"4482b94f-d7f9-4575-b22e-765dfd4ad693\") " pod="openshift-ingress/e2e-worker-w5-b78c31-openshift-default-774cb4f6c9-p7lp5"
Oct 31 17:36:30.860230 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:30.860193    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4482b94f-d7f9-4575-b22e-765dfd4ad693-istio-data\") pod \"e2e-worker-w5-b78c31-openshift-default-774cb4f6c9-p7lp5\" (UID: \"4482b94f-d7f9-4575-b22e-765dfd4ad693\") " pod="openshift-ingress/e2e-worker-w5-b78c31-openshift-default-774cb4f6c9-p7lp5"
Oct 31 17:36:30.860230 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:30.860211    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4482b94f-d7f9-4575-b22e-765dfd4ad693-workload-socket\") pod \"e2e-worker-w5-b78c31-openshift-default-774cb4f6c9-p7lp5\" (UID: \"4482b94f-d7f9-4575-b22e-765dfd4ad693\") " pod="openshift-ingress/e2e-worker-w5-b78c31-openshift-default-774cb4f6c9-p7lp5"
Oct 31 17:36:30.960997 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:30.960958    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jrj2f\" (UniqueName: \"kubernetes.io/projected/4482b94f-d7f9-4575-b22e-765dfd4ad693-kube-api-access-jrj2f\") pod \"e2e-worker-w5-b78c31-openshift-default-774cb4f6c9-p7lp5\" (UID: \"4482b94f-d7f9-4575-b22e-765dfd4ad693\") " pod="openshift-ingress/e2e-worker-w5-b78c31-openshift-default-774cb4f6c9-p7lp5"
Oct 31 17:36:30.961182 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:30.961017    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4482b94f-d7f9-4575-b22e-765dfd4ad693-istio-data\") pod \"e2e-worker-w5-b78c31-openshift-default-774cb4f6c9-p7lp5\" (UID: \"4482b94f-d7f9-4575-b22e-765dfd4ad693\") " pod="openshift-ingress/e2e-worker-w5-b78c31-openshift-default-774cb4f6c9-p7lp5"
Oct 31 17:36:30.961182 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:30.961054    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4482b94f-d7f9-4575-b22e-765dfd4ad693-workload-socket\") pod \"e2e-worker-w5-b78c31-openshift-default-774cb4f6c9-p7lp5\" (UID: \"4482b94f-d7f9-4575-b22e-765dfd4ad693\") " pod="openshift-ingress/e2e-worker-w5-b78c31-openshift-default-774cb4f6c9-p7lp5"
Oct 31 17:36:30.961182 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:30.961090    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4482b94f-d7f9-4575-b22e-765dfd4ad693-istio-envoy\") pod \"e2e-worker-w5-b78c31-openshift-default-774cb4f6c9-p7lp5\" (UID: \"4482b94f-d7f9-4575-b22e-765dfd4ad693\") " pod="openshift-ingress/e2e-worker-w5-b78c31-openshift-default-774cb4f6c9-p7lp5"
Oct 31 17:36:30.961182 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:30.961133    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4482b94f-d7f9-4575-b22e-765dfd4ad693-istiod-ca-cert\") pod \"e2e-worker-w5-b78c31-openshift-default-774cb4f6c9-p7lp5\" (UID: \"4482b94f-d7f9-4575-b22e-765dfd4ad693\") " pod="openshift-ingress/e2e-worker-w5-b78c31-openshift-default-774cb4f6c9-p7lp5"
Oct 31 17:36:30.961436 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:30.961200    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4482b94f-d7f9-4575-b22e-765dfd4ad693-istio-podinfo\") pod \"e2e-worker-w5-b78c31-openshift-default-774cb4f6c9-p7lp5\" (UID: \"4482b94f-d7f9-4575-b22e-765dfd4ad693\") " pod="openshift-ingress/e2e-worker-w5-b78c31-openshift-default-774cb4f6c9-p7lp5"
Oct 31 17:36:30.961436 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:30.961233    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4482b94f-d7f9-4575-b22e-765dfd4ad693-istio-token\") pod \"e2e-worker-w5-b78c31-openshift-default-774cb4f6c9-p7lp5\" (UID: \"4482b94f-d7f9-4575-b22e-765dfd4ad693\") " pod="openshift-ingress/e2e-worker-w5-b78c31-openshift-default-774cb4f6c9-p7lp5"
Oct 31 17:36:30.961436 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:30.961271    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4482b94f-d7f9-4575-b22e-765dfd4ad693-credential-socket\") pod \"e2e-worker-w5-b78c31-openshift-default-774cb4f6c9-p7lp5\" (UID: \"4482b94f-d7f9-4575-b22e-765dfd4ad693\") " pod="openshift-ingress/e2e-worker-w5-b78c31-openshift-default-774cb4f6c9-p7lp5"
Oct 31 17:36:30.961436 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:30.961339    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4482b94f-d7f9-4575-b22e-765dfd4ad693-workload-certs\") pod \"e2e-worker-w5-b78c31-openshift-default-774cb4f6c9-p7lp5\" (UID: \"4482b94f-d7f9-4575-b22e-765dfd4ad693\") " pod="openshift-ingress/e2e-worker-w5-b78c31-openshift-default-774cb4f6c9-p7lp5"
Oct 31 17:36:30.961436 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:30.961413    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4482b94f-d7f9-4575-b22e-765dfd4ad693-istio-data\") pod \"e2e-worker-w5-b78c31-openshift-default-774cb4f6c9-p7lp5\" (UID: \"4482b94f-d7f9-4575-b22e-765dfd4ad693\") " pod="openshift-ingress/e2e-worker-w5-b78c31-openshift-default-774cb4f6c9-p7lp5"
Oct 31 17:36:30.961787 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:30.961463    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4482b94f-d7f9-4575-b22e-765dfd4ad693-workload-socket\") pod \"e2e-worker-w5-b78c31-openshift-default-774cb4f6c9-p7lp5\" (UID: \"4482b94f-d7f9-4575-b22e-765dfd4ad693\") " pod="openshift-ingress/e2e-worker-w5-b78c31-openshift-default-774cb4f6c9-p7lp5"
Oct 31 17:36:30.961787 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:30.961730    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4482b94f-d7f9-4575-b22e-765dfd4ad693-workload-certs\") pod \"e2e-worker-w5-b78c31-openshift-default-774cb4f6c9-p7lp5\" (UID: \"4482b94f-d7f9-4575-b22e-765dfd4ad693\") " pod="openshift-ingress/e2e-worker-w5-b78c31-openshift-default-774cb4f6c9-p7lp5"
Oct 31 17:36:30.961961 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:30.961938    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4482b94f-d7f9-4575-b22e-765dfd4ad693-credential-socket\") pod \"e2e-worker-w5-b78c31-openshift-default-774cb4f6c9-p7lp5\" (UID: \"4482b94f-d7f9-4575-b22e-765dfd4ad693\") " pod="openshift-ingress/e2e-worker-w5-b78c31-openshift-default-774cb4f6c9-p7lp5"
Oct 31 17:36:30.962194 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:30.962173    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4482b94f-d7f9-4575-b22e-765dfd4ad693-istiod-ca-cert\") pod \"e2e-worker-w5-b78c31-openshift-default-774cb4f6c9-p7lp5\" (UID: \"4482b94f-d7f9-4575-b22e-765dfd4ad693\") " pod="openshift-ingress/e2e-worker-w5-b78c31-openshift-default-774cb4f6c9-p7lp5"
Oct 31 17:36:30.964255 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:30.964231    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4482b94f-d7f9-4575-b22e-765dfd4ad693-istio-envoy\") pod \"e2e-worker-w5-b78c31-openshift-default-774cb4f6c9-p7lp5\" (UID: \"4482b94f-d7f9-4575-b22e-765dfd4ad693\") " pod="openshift-ingress/e2e-worker-w5-b78c31-openshift-default-774cb4f6c9-p7lp5"
Oct 31 17:36:30.964501 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:30.964478    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4482b94f-d7f9-4575-b22e-765dfd4ad693-istio-podinfo\") pod \"e2e-worker-w5-b78c31-openshift-default-774cb4f6c9-p7lp5\" (UID: \"4482b94f-d7f9-4575-b22e-765dfd4ad693\") " pod="openshift-ingress/e2e-worker-w5-b78c31-openshift-default-774cb4f6c9-p7lp5"
Oct 31 17:36:30.982771 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:30.982731    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4482b94f-d7f9-4575-b22e-765dfd4ad693-istio-token\") pod \"e2e-worker-w5-b78c31-openshift-default-774cb4f6c9-p7lp5\" (UID: \"4482b94f-d7f9-4575-b22e-765dfd4ad693\") " pod="openshift-ingress/e2e-worker-w5-b78c31-openshift-default-774cb4f6c9-p7lp5"
Oct 31 17:36:30.982959 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:30.982937    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jrj2f\" (UniqueName: \"kubernetes.io/projected/4482b94f-d7f9-4575-b22e-765dfd4ad693-kube-api-access-jrj2f\") pod \"e2e-worker-w5-b78c31-openshift-default-774cb4f6c9-p7lp5\" (UID: \"4482b94f-d7f9-4575-b22e-765dfd4ad693\") " pod="openshift-ingress/e2e-worker-w5-b78c31-openshift-default-774cb4f6c9-p7lp5"
Oct 31 17:36:31.080328 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:31.080242    5003 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w6-d80080-openshift-default-956cddf57-x6xxp"]
Oct 31 17:36:31.085136 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:31.085109    5003 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-d80080-openshift-default-956cddf57-x6xxp"
Oct 31 17:36:31.105228 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:31.105200    5003 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w6-d80080-openshift-default-dockercfg-hqzw7\""
Oct 31 17:36:31.108429 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:31.108348    5003 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w6-d80080-openshift-default-956cddf57-x6xxp"]
Oct 31 17:36:31.126353 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:31.126205    5003 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-b78c31-openshift-default-774cb4f6c9-p7lp5"
Oct 31 17:36:31.163669 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:31.163604    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5f2c9613-4b8a-4452-b70a-2ed258063318-istiod-ca-cert\") pod \"e2e-worker-w6-d80080-openshift-default-956cddf57-x6xxp\" (UID: \"5f2c9613-4b8a-4452-b70a-2ed258063318\") " pod="openshift-ingress/e2e-worker-w6-d80080-openshift-default-956cddf57-x6xxp"
Oct 31 17:36:31.163823 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:31.163762    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5f2c9613-4b8a-4452-b70a-2ed258063318-istio-data\") pod \"e2e-worker-w6-d80080-openshift-default-956cddf57-x6xxp\" (UID: \"5f2c9613-4b8a-4452-b70a-2ed258063318\") " pod="openshift-ingress/e2e-worker-w6-d80080-openshift-default-956cddf57-x6xxp"
Oct 31 17:36:31.163823 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:31.163803    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5f2c9613-4b8a-4452-b70a-2ed258063318-istio-podinfo\") pod \"e2e-worker-w6-d80080-openshift-default-956cddf57-x6xxp\" (UID: \"5f2c9613-4b8a-4452-b70a-2ed258063318\") " pod="openshift-ingress/e2e-worker-w6-d80080-openshift-default-956cddf57-x6xxp"
Oct 31 17:36:31.163916 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:31.163829    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zlbc6\" (UniqueName: \"kubernetes.io/projected/5f2c9613-4b8a-4452-b70a-2ed258063318-kube-api-access-zlbc6\") pod \"e2e-worker-w6-d80080-openshift-default-956cddf57-x6xxp\" (UID: \"5f2c9613-4b8a-4452-b70a-2ed258063318\") " pod="openshift-ingress/e2e-worker-w6-d80080-openshift-default-956cddf57-x6xxp"
Oct 31 17:36:31.163987 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:31.163970    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5f2c9613-4b8a-4452-b70a-2ed258063318-workload-socket\") pod \"e2e-worker-w6-d80080-openshift-default-956cddf57-x6xxp\" (UID: \"5f2c9613-4b8a-4452-b70a-2ed258063318\") " pod="openshift-ingress/e2e-worker-w6-d80080-openshift-default-956cddf57-x6xxp"
Oct 31 17:36:31.164026 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:31.163998    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5f2c9613-4b8a-4452-b70a-2ed258063318-istio-token\") pod \"e2e-worker-w6-d80080-openshift-default-956cddf57-x6xxp\" (UID: \"5f2c9613-4b8a-4452-b70a-2ed258063318\") " pod="openshift-ingress/e2e-worker-w6-d80080-openshift-default-956cddf57-x6xxp"
Oct 31 17:36:31.164070 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:31.164026    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5f2c9613-4b8a-4452-b70a-2ed258063318-workload-certs\") pod \"e2e-worker-w6-d80080-openshift-default-956cddf57-x6xxp\" (UID: \"5f2c9613-4b8a-4452-b70a-2ed258063318\") " pod="openshift-ingress/e2e-worker-w6-d80080-openshift-default-956cddf57-x6xxp"
Oct 31 17:36:31.164070 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:31.164044    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5f2c9613-4b8a-4452-b70a-2ed258063318-credential-socket\") pod \"e2e-worker-w6-d80080-openshift-default-956cddf57-x6xxp\" (UID: \"5f2c9613-4b8a-4452-b70a-2ed258063318\") " pod="openshift-ingress/e2e-worker-w6-d80080-openshift-default-956cddf57-x6xxp"
Oct 31 17:36:31.164171 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:31.164149    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5f2c9613-4b8a-4452-b70a-2ed258063318-istio-envoy\") pod \"e2e-worker-w6-d80080-openshift-default-956cddf57-x6xxp\" (UID: \"5f2c9613-4b8a-4452-b70a-2ed258063318\") " pod="openshift-ingress/e2e-worker-w6-d80080-openshift-default-956cddf57-x6xxp"
Oct 31 17:36:31.265729 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:31.265688    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5f2c9613-4b8a-4452-b70a-2ed258063318-istio-data\") pod \"e2e-worker-w6-d80080-openshift-default-956cddf57-x6xxp\" (UID: \"5f2c9613-4b8a-4452-b70a-2ed258063318\") " pod="openshift-ingress/e2e-worker-w6-d80080-openshift-default-956cddf57-x6xxp"
Oct 31 17:36:31.265729 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:31.265733    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5f2c9613-4b8a-4452-b70a-2ed258063318-istio-podinfo\") pod \"e2e-worker-w6-d80080-openshift-default-956cddf57-x6xxp\" (UID: \"5f2c9613-4b8a-4452-b70a-2ed258063318\") " pod="openshift-ingress/e2e-worker-w6-d80080-openshift-default-956cddf57-x6xxp"
Oct 31 17:36:31.265976 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:31.265753    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zlbc6\" (UniqueName: \"kubernetes.io/projected/5f2c9613-4b8a-4452-b70a-2ed258063318-kube-api-access-zlbc6\") pod \"e2e-worker-w6-d80080-openshift-default-956cddf57-x6xxp\" (UID: \"5f2c9613-4b8a-4452-b70a-2ed258063318\") " pod="openshift-ingress/e2e-worker-w6-d80080-openshift-default-956cddf57-x6xxp"
Oct 31 17:36:31.265976 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:31.265799    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5f2c9613-4b8a-4452-b70a-2ed258063318-workload-socket\") pod \"e2e-worker-w6-d80080-openshift-default-956cddf57-x6xxp\" (UID: \"5f2c9613-4b8a-4452-b70a-2ed258063318\") " pod="openshift-ingress/e2e-worker-w6-d80080-openshift-default-956cddf57-x6xxp"
Oct 31 17:36:31.265976 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:31.265820    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5f2c9613-4b8a-4452-b70a-2ed258063318-istio-token\") pod \"e2e-worker-w6-d80080-openshift-default-956cddf57-x6xxp\" (UID: \"5f2c9613-4b8a-4452-b70a-2ed258063318\") " pod="openshift-ingress/e2e-worker-w6-d80080-openshift-default-956cddf57-x6xxp"
Oct 31 17:36:31.265976 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:31.265851    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5f2c9613-4b8a-4452-b70a-2ed258063318-workload-certs\") pod \"e2e-worker-w6-d80080-openshift-default-956cddf57-x6xxp\" (UID: \"5f2c9613-4b8a-4452-b70a-2ed258063318\") " pod="openshift-ingress/e2e-worker-w6-d80080-openshift-default-956cddf57-x6xxp"
Oct 31 17:36:31.265976 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:31.265880    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5f2c9613-4b8a-4452-b70a-2ed258063318-credential-socket\") pod \"e2e-worker-w6-d80080-openshift-default-956cddf57-x6xxp\" (UID: \"5f2c9613-4b8a-4452-b70a-2ed258063318\") " pod="openshift-ingress/e2e-worker-w6-d80080-openshift-default-956cddf57-x6xxp"
Oct 31 17:36:31.265976 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:31.265925    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5f2c9613-4b8a-4452-b70a-2ed258063318-istio-envoy\") pod \"e2e-worker-w6-d80080-openshift-default-956cddf57-x6xxp\" (UID: \"5f2c9613-4b8a-4452-b70a-2ed258063318\") " pod="openshift-ingress/e2e-worker-w6-d80080-openshift-default-956cddf57-x6xxp"
Oct 31 17:36:31.265976 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:31.265971    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5f2c9613-4b8a-4452-b70a-2ed258063318-istiod-ca-cert\") pod \"e2e-worker-w6-d80080-openshift-default-956cddf57-x6xxp\" (UID: \"5f2c9613-4b8a-4452-b70a-2ed258063318\") " pod="openshift-ingress/e2e-worker-w6-d80080-openshift-default-956cddf57-x6xxp"
Oct 31 17:36:31.266318 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:31.266277    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5f2c9613-4b8a-4452-b70a-2ed258063318-istio-data\") pod \"e2e-worker-w6-d80080-openshift-default-956cddf57-x6xxp\" (UID: \"5f2c9613-4b8a-4452-b70a-2ed258063318\") " pod="openshift-ingress/e2e-worker-w6-d80080-openshift-default-956cddf57-x6xxp"
Oct 31 17:36:31.266456 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:31.266427    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5f2c9613-4b8a-4452-b70a-2ed258063318-credential-socket\") pod \"e2e-worker-w6-d80080-openshift-default-956cddf57-x6xxp\" (UID: \"5f2c9613-4b8a-4452-b70a-2ed258063318\") " pod="openshift-ingress/e2e-worker-w6-d80080-openshift-default-956cddf57-x6xxp"
Oct 31 17:36:31.266589 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:31.266485    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5f2c9613-4b8a-4452-b70a-2ed258063318-workload-socket\") pod \"e2e-worker-w6-d80080-openshift-default-956cddf57-x6xxp\" (UID: \"5f2c9613-4b8a-4452-b70a-2ed258063318\") " pod="openshift-ingress/e2e-worker-w6-d80080-openshift-default-956cddf57-x6xxp"
Oct 31 17:36:31.266589 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:31.266501    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5f2c9613-4b8a-4452-b70a-2ed258063318-workload-certs\") pod \"e2e-worker-w6-d80080-openshift-default-956cddf57-x6xxp\" (UID: \"5f2c9613-4b8a-4452-b70a-2ed258063318\") " pod="openshift-ingress/e2e-worker-w6-d80080-openshift-default-956cddf57-x6xxp"
Oct 31 17:36:31.266841 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:31.266819    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5f2c9613-4b8a-4452-b70a-2ed258063318-istiod-ca-cert\") pod \"e2e-worker-w6-d80080-openshift-default-956cddf57-x6xxp\" (UID: \"5f2c9613-4b8a-4452-b70a-2ed258063318\") " pod="openshift-ingress/e2e-worker-w6-d80080-openshift-default-956cddf57-x6xxp"
Oct 31 17:36:31.268243 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:31.268221    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5f2c9613-4b8a-4452-b70a-2ed258063318-istio-envoy\") pod \"e2e-worker-w6-d80080-openshift-default-956cddf57-x6xxp\" (UID: \"5f2c9613-4b8a-4452-b70a-2ed258063318\") " pod="openshift-ingress/e2e-worker-w6-d80080-openshift-default-956cddf57-x6xxp"
Oct 31 17:36:31.268465 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:31.268445    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5f2c9613-4b8a-4452-b70a-2ed258063318-istio-podinfo\") pod \"e2e-worker-w6-d80080-openshift-default-956cddf57-x6xxp\" (UID: \"5f2c9613-4b8a-4452-b70a-2ed258063318\") " pod="openshift-ingress/e2e-worker-w6-d80080-openshift-default-956cddf57-x6xxp"
Oct 31 17:36:31.284020 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:31.283992    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5f2c9613-4b8a-4452-b70a-2ed258063318-istio-token\") pod \"e2e-worker-w6-d80080-openshift-default-956cddf57-x6xxp\" (UID: \"5f2c9613-4b8a-4452-b70a-2ed258063318\") " pod="openshift-ingress/e2e-worker-w6-d80080-openshift-default-956cddf57-x6xxp"
Oct 31 17:36:31.284146 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:31.284117    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zlbc6\" (UniqueName: \"kubernetes.io/projected/5f2c9613-4b8a-4452-b70a-2ed258063318-kube-api-access-zlbc6\") pod \"e2e-worker-w6-d80080-openshift-default-956cddf57-x6xxp\" (UID: \"5f2c9613-4b8a-4452-b70a-2ed258063318\") " pod="openshift-ingress/e2e-worker-w6-d80080-openshift-default-956cddf57-x6xxp"
Oct 31 17:36:31.361442 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:31.361281    5003 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w0-ee816e-openshift-default-c4db85b5c-7pwpp"]
Oct 31 17:36:31.366530 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:31.366501    5003 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-ee816e-openshift-default-c4db85b5c-7pwpp"
Oct 31 17:36:31.383944 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:31.383918    5003 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w0-ee816e-openshift-default-dockercfg-mnsfm\""
Oct 31 17:36:31.387118 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:31.387091    5003 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-ee816e-openshift-default-c4db85b5c-7pwpp"]
Oct 31 17:36:31.400688 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:31.400635    5003 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-d80080-openshift-default-956cddf57-x6xxp"
Oct 31 17:36:31.449553 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:31.449517    5003 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w5-b78c31-openshift-default-774cb4f6c9-p7lp5"]
Oct 31 17:36:31.458487 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:36:31.458459    5003 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4482b94f_d7f9_4575_b22e_765dfd4ad693.slice/crio-7fcb7baa1346d49aff7bc49e9223ea7fec9b19d8cf70c83c964a2b4b5fcbe07e WatchSource:0}: Error finding container 7fcb7baa1346d49aff7bc49e9223ea7fec9b19d8cf70c83c964a2b4b5fcbe07e: Status 404 returned error can't find the container with id 7fcb7baa1346d49aff7bc49e9223ea7fec9b19d8cf70c83c964a2b4b5fcbe07e
Oct 31 17:36:31.461923 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:31.461877    5003 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Oct 31 17:36:31.462063 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:31.461989    5003 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Oct 31 17:36:31.462063 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:31.462039    5003 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Oct 31 17:36:31.467584 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:31.467552    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a79988d8-d286-43ae-914b-bd1f6db3eb11-istio-data\") pod \"e2e-worker-w0-ee816e-openshift-default-c4db85b5c-7pwpp\" (UID: \"a79988d8-d286-43ae-914b-bd1f6db3eb11\") " pod="openshift-ingress/e2e-worker-w0-ee816e-openshift-default-c4db85b5c-7pwpp"
Oct 31 17:36:31.467704 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:31.467614    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a79988d8-d286-43ae-914b-bd1f6db3eb11-istio-podinfo\") pod \"e2e-worker-w0-ee816e-openshift-default-c4db85b5c-7pwpp\" (UID: \"a79988d8-d286-43ae-914b-bd1f6db3eb11\") " pod="openshift-ingress/e2e-worker-w0-ee816e-openshift-default-c4db85b5c-7pwpp"
Oct 31 17:36:31.467704 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:31.467685    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a79988d8-d286-43ae-914b-bd1f6db3eb11-credential-socket\") pod \"e2e-worker-w0-ee816e-openshift-default-c4db85b5c-7pwpp\" (UID: \"a79988d8-d286-43ae-914b-bd1f6db3eb11\") " pod="openshift-ingress/e2e-worker-w0-ee816e-openshift-default-c4db85b5c-7pwpp"
Oct 31 17:36:31.467817 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:31.467714    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a79988d8-d286-43ae-914b-bd1f6db3eb11-istio-token\") pod \"e2e-worker-w0-ee816e-openshift-default-c4db85b5c-7pwpp\" (UID: \"a79988d8-d286-43ae-914b-bd1f6db3eb11\") " pod="openshift-ingress/e2e-worker-w0-ee816e-openshift-default-c4db85b5c-7pwpp"
Oct 31 17:36:31.467876 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:31.467810    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a79988d8-d286-43ae-914b-bd1f6db3eb11-workload-socket\") pod \"e2e-worker-w0-ee816e-openshift-default-c4db85b5c-7pwpp\" (UID: \"a79988d8-d286-43ae-914b-bd1f6db3eb11\") " pod="openshift-ingress/e2e-worker-w0-ee816e-openshift-default-c4db85b5c-7pwpp"
Oct 31 17:36:31.467955 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:31.467927    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a79988d8-d286-43ae-914b-bd1f6db3eb11-istiod-ca-cert\") pod \"e2e-worker-w0-ee816e-openshift-default-c4db85b5c-7pwpp\" (UID: \"a79988d8-d286-43ae-914b-bd1f6db3eb11\") " pod="openshift-ingress/e2e-worker-w0-ee816e-openshift-default-c4db85b5c-7pwpp"
Oct 31 17:36:31.468067 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:31.467984    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a79988d8-d286-43ae-914b-bd1f6db3eb11-workload-certs\") pod \"e2e-worker-w0-ee816e-openshift-default-c4db85b5c-7pwpp\" (UID: \"a79988d8-d286-43ae-914b-bd1f6db3eb11\") " pod="openshift-ingress/e2e-worker-w0-ee816e-openshift-default-c4db85b5c-7pwpp"
Oct 31 17:36:31.468142 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:31.468084    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kb5cs\" (UniqueName: \"kubernetes.io/projected/a79988d8-d286-43ae-914b-bd1f6db3eb11-kube-api-access-kb5cs\") pod \"e2e-worker-w0-ee816e-openshift-default-c4db85b5c-7pwpp\" (UID: \"a79988d8-d286-43ae-914b-bd1f6db3eb11\") " pod="openshift-ingress/e2e-worker-w0-ee816e-openshift-default-c4db85b5c-7pwpp"
Oct 31 17:36:31.468309 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:31.468148    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a79988d8-d286-43ae-914b-bd1f6db3eb11-istio-envoy\") pod \"e2e-worker-w0-ee816e-openshift-default-c4db85b5c-7pwpp\" (UID: \"a79988d8-d286-43ae-914b-bd1f6db3eb11\") " pod="openshift-ingress/e2e-worker-w0-ee816e-openshift-default-c4db85b5c-7pwpp"
Oct 31 17:36:31.569430 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:31.569393    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a79988d8-d286-43ae-914b-bd1f6db3eb11-istio-envoy\") pod \"e2e-worker-w0-ee816e-openshift-default-c4db85b5c-7pwpp\" (UID: \"a79988d8-d286-43ae-914b-bd1f6db3eb11\") " pod="openshift-ingress/e2e-worker-w0-ee816e-openshift-default-c4db85b5c-7pwpp"
Oct 31 17:36:31.569430 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:31.569434    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a79988d8-d286-43ae-914b-bd1f6db3eb11-istio-data\") pod \"e2e-worker-w0-ee816e-openshift-default-c4db85b5c-7pwpp\" (UID: \"a79988d8-d286-43ae-914b-bd1f6db3eb11\") " pod="openshift-ingress/e2e-worker-w0-ee816e-openshift-default-c4db85b5c-7pwpp"
Oct 31 17:36:31.569737 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:31.569466    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a79988d8-d286-43ae-914b-bd1f6db3eb11-istio-podinfo\") pod \"e2e-worker-w0-ee816e-openshift-default-c4db85b5c-7pwpp\" (UID: \"a79988d8-d286-43ae-914b-bd1f6db3eb11\") " pod="openshift-ingress/e2e-worker-w0-ee816e-openshift-default-c4db85b5c-7pwpp"
Oct 31 17:36:31.569737 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:31.569501    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a79988d8-d286-43ae-914b-bd1f6db3eb11-credential-socket\") pod \"e2e-worker-w0-ee816e-openshift-default-c4db85b5c-7pwpp\" (UID: \"a79988d8-d286-43ae-914b-bd1f6db3eb11\") " pod="openshift-ingress/e2e-worker-w0-ee816e-openshift-default-c4db85b5c-7pwpp"
Oct 31 17:36:31.569737 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:31.569518    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a79988d8-d286-43ae-914b-bd1f6db3eb11-istio-token\") pod \"e2e-worker-w0-ee816e-openshift-default-c4db85b5c-7pwpp\" (UID: \"a79988d8-d286-43ae-914b-bd1f6db3eb11\") " pod="openshift-ingress/e2e-worker-w0-ee816e-openshift-default-c4db85b5c-7pwpp"
Oct 31 17:36:31.569737 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:31.569565    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a79988d8-d286-43ae-914b-bd1f6db3eb11-workload-socket\") pod \"e2e-worker-w0-ee816e-openshift-default-c4db85b5c-7pwpp\" (UID: \"a79988d8-d286-43ae-914b-bd1f6db3eb11\") " pod="openshift-ingress/e2e-worker-w0-ee816e-openshift-default-c4db85b5c-7pwpp"
Oct 31 17:36:31.569737 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:31.569599    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a79988d8-d286-43ae-914b-bd1f6db3eb11-istiod-ca-cert\") pod \"e2e-worker-w0-ee816e-openshift-default-c4db85b5c-7pwpp\" (UID: \"a79988d8-d286-43ae-914b-bd1f6db3eb11\") " pod="openshift-ingress/e2e-worker-w0-ee816e-openshift-default-c4db85b5c-7pwpp"
Oct 31 17:36:31.569737 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:31.569638    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a79988d8-d286-43ae-914b-bd1f6db3eb11-workload-certs\") pod \"e2e-worker-w0-ee816e-openshift-default-c4db85b5c-7pwpp\" (UID: \"a79988d8-d286-43ae-914b-bd1f6db3eb11\") " pod="openshift-ingress/e2e-worker-w0-ee816e-openshift-default-c4db85b5c-7pwpp"
Oct 31 17:36:31.569737 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:31.569718    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kb5cs\" (UniqueName: \"kubernetes.io/projected/a79988d8-d286-43ae-914b-bd1f6db3eb11-kube-api-access-kb5cs\") pod \"e2e-worker-w0-ee816e-openshift-default-c4db85b5c-7pwpp\" (UID: \"a79988d8-d286-43ae-914b-bd1f6db3eb11\") " pod="openshift-ingress/e2e-worker-w0-ee816e-openshift-default-c4db85b5c-7pwpp"
Oct 31 17:36:31.570141 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:31.570033    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a79988d8-d286-43ae-914b-bd1f6db3eb11-istio-data\") pod \"e2e-worker-w0-ee816e-openshift-default-c4db85b5c-7pwpp\" (UID: \"a79988d8-d286-43ae-914b-bd1f6db3eb11\") " pod="openshift-ingress/e2e-worker-w0-ee816e-openshift-default-c4db85b5c-7pwpp"
Oct 31 17:36:31.570284 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:31.570256    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a79988d8-d286-43ae-914b-bd1f6db3eb11-workload-socket\") pod \"e2e-worker-w0-ee816e-openshift-default-c4db85b5c-7pwpp\" (UID: \"a79988d8-d286-43ae-914b-bd1f6db3eb11\") " pod="openshift-ingress/e2e-worker-w0-ee816e-openshift-default-c4db85b5c-7pwpp"
Oct 31 17:36:31.570398 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:31.570380    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a79988d8-d286-43ae-914b-bd1f6db3eb11-workload-certs\") pod \"e2e-worker-w0-ee816e-openshift-default-c4db85b5c-7pwpp\" (UID: \"a79988d8-d286-43ae-914b-bd1f6db3eb11\") " pod="openshift-ingress/e2e-worker-w0-ee816e-openshift-default-c4db85b5c-7pwpp"
Oct 31 17:36:31.570591 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:31.570570    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a79988d8-d286-43ae-914b-bd1f6db3eb11-credential-socket\") pod \"e2e-worker-w0-ee816e-openshift-default-c4db85b5c-7pwpp\" (UID: \"a79988d8-d286-43ae-914b-bd1f6db3eb11\") " pod="openshift-ingress/e2e-worker-w0-ee816e-openshift-default-c4db85b5c-7pwpp"
Oct 31 17:36:31.570877 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:31.570856    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a79988d8-d286-43ae-914b-bd1f6db3eb11-istiod-ca-cert\") pod \"e2e-worker-w0-ee816e-openshift-default-c4db85b5c-7pwpp\" (UID: \"a79988d8-d286-43ae-914b-bd1f6db3eb11\") " pod="openshift-ingress/e2e-worker-w0-ee816e-openshift-default-c4db85b5c-7pwpp"
Oct 31 17:36:31.572203 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:31.572179    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a79988d8-d286-43ae-914b-bd1f6db3eb11-istio-envoy\") pod \"e2e-worker-w0-ee816e-openshift-default-c4db85b5c-7pwpp\" (UID: \"a79988d8-d286-43ae-914b-bd1f6db3eb11\") " pod="openshift-ingress/e2e-worker-w0-ee816e-openshift-default-c4db85b5c-7pwpp"
Oct 31 17:36:31.572350 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:31.572330    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a79988d8-d286-43ae-914b-bd1f6db3eb11-istio-podinfo\") pod \"e2e-worker-w0-ee816e-openshift-default-c4db85b5c-7pwpp\" (UID: \"a79988d8-d286-43ae-914b-bd1f6db3eb11\") " pod="openshift-ingress/e2e-worker-w0-ee816e-openshift-default-c4db85b5c-7pwpp"
Oct 31 17:36:31.588910 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:31.588880    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a79988d8-d286-43ae-914b-bd1f6db3eb11-istio-token\") pod \"e2e-worker-w0-ee816e-openshift-default-c4db85b5c-7pwpp\" (UID: \"a79988d8-d286-43ae-914b-bd1f6db3eb11\") " pod="openshift-ingress/e2e-worker-w0-ee816e-openshift-default-c4db85b5c-7pwpp"
Oct 31 17:36:31.589078 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:31.588972    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kb5cs\" (UniqueName: \"kubernetes.io/projected/a79988d8-d286-43ae-914b-bd1f6db3eb11-kube-api-access-kb5cs\") pod \"e2e-worker-w0-ee816e-openshift-default-c4db85b5c-7pwpp\" (UID: \"a79988d8-d286-43ae-914b-bd1f6db3eb11\") " pod="openshift-ingress/e2e-worker-w0-ee816e-openshift-default-c4db85b5c-7pwpp"
Oct 31 17:36:31.681232 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:31.681135    5003 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-ee816e-openshift-default-c4db85b5c-7pwpp"
Oct 31 17:36:31.704772 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:31.704736    5003 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w6-d80080-openshift-default-956cddf57-x6xxp"]
Oct 31 17:36:31.708797 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:36:31.708762    5003 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f2c9613_4b8a_4452_b70a_2ed258063318.slice/crio-2ea88d2127f3bed88a0d2884dac73ebc7f2e112e1f9927525e024973af0c4ec1 WatchSource:0}: Error finding container 2ea88d2127f3bed88a0d2884dac73ebc7f2e112e1f9927525e024973af0c4ec1: Status 404 returned error can't find the container with id 2ea88d2127f3bed88a0d2884dac73ebc7f2e112e1f9927525e024973af0c4ec1
Oct 31 17:36:31.711385 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:31.711348    5003 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Oct 31 17:36:31.711500 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:31.711434    5003 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Oct 31 17:36:31.711500 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:31.711478    5003 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Oct 31 17:36:31.987672 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:31.987625    5003 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-ee816e-openshift-default-c4db85b5c-7pwpp"]
Oct 31 17:36:31.989841 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:36:31.989808    5003 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda79988d8_d286_43ae_914b_bd1f6db3eb11.slice/crio-c1c17d0d66e485901851025cbfb785da8938f388137ab73586f0fcd8e9793ab2 WatchSource:0}: Error finding container c1c17d0d66e485901851025cbfb785da8938f388137ab73586f0fcd8e9793ab2: Status 404 returned error can't find the container with id c1c17d0d66e485901851025cbfb785da8938f388137ab73586f0fcd8e9793ab2
Oct 31 17:36:31.992286 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:31.992238    5003 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Oct 31 17:36:31.992412 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:31.992337    5003 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Oct 31 17:36:31.992412 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:31.992384    5003 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Oct 31 17:36:32.123220 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:32.123180    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-d80080-openshift-default-956cddf57-x6xxp" event={"ID":"5f2c9613-4b8a-4452-b70a-2ed258063318","Type":"ContainerStarted","Data":"bb5ae6599bdfa06eaa315d59a12ddcdeb296955b61ca4d075418d7282d4d0aee"}
Oct 31 17:36:32.123419 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:32.123252    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-d80080-openshift-default-956cddf57-x6xxp" event={"ID":"5f2c9613-4b8a-4452-b70a-2ed258063318","Type":"ContainerStarted","Data":"2ea88d2127f3bed88a0d2884dac73ebc7f2e112e1f9927525e024973af0c4ec1"}
Oct 31 17:36:32.125127 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:32.125101    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-b78c31-openshift-default-774cb4f6c9-p7lp5" event={"ID":"4482b94f-d7f9-4575-b22e-765dfd4ad693","Type":"ContainerStarted","Data":"aceeb7197d496482a276549fd86c94a288836d57009bb94a2513cd606ffd8419"}
Oct 31 17:36:32.125267 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:32.125149    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-b78c31-openshift-default-774cb4f6c9-p7lp5" event={"ID":"4482b94f-d7f9-4575-b22e-765dfd4ad693","Type":"ContainerStarted","Data":"7fcb7baa1346d49aff7bc49e9223ea7fec9b19d8cf70c83c964a2b4b5fcbe07e"}
Oct 31 17:36:32.126363 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:32.126343    5003 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w5-b78c31-openshift-default-774cb4f6c9-p7lp5"
Oct 31 17:36:32.126930 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:32.126891    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-ee816e-openshift-default-c4db85b5c-7pwpp" event={"ID":"a79988d8-d286-43ae-914b-bd1f6db3eb11","Type":"ContainerStarted","Data":"d4a19531fd76d530d4e154e2e9cba4fa36562053b4577b64fafc78b4f6b5c744"}
Oct 31 17:36:32.127024 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:32.126960    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-ee816e-openshift-default-c4db85b5c-7pwpp" event={"ID":"a79988d8-d286-43ae-914b-bd1f6db3eb11","Type":"ContainerStarted","Data":"c1c17d0d66e485901851025cbfb785da8938f388137ab73586f0fcd8e9793ab2"}
Oct 31 17:36:32.131779 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:32.131754    5003 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w5-b78c31-openshift-default-774cb4f6c9-p7lp5"
Oct 31 17:36:32.162714 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:32.162636    5003 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w6-d80080-openshift-default-956cddf57-x6xxp" podStartSLOduration=1.162620499 podStartE2EDuration="1.162620499s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 17:36:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 17:36:32.16230493 +0000 UTC m=+560.417159497" watchObservedRunningTime="2026-10-31 17:36:32.162620499 +0000 UTC m=+560.417475038"
Oct 31 17:36:32.205589 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:32.205531    5003 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w5-b78c31-openshift-default-774cb4f6c9-p7lp5" podStartSLOduration=2.205517455 podStartE2EDuration="2.205517455s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 17:36:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 17:36:32.204984133 +0000 UTC m=+560.459838676" watchObservedRunningTime="2026-10-31 17:36:32.205517455 +0000 UTC m=+560.460372061"
Oct 31 17:36:32.246938 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:32.246708    5003 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w0-ee816e-openshift-default-c4db85b5c-7pwpp" podStartSLOduration=1.246688408 podStartE2EDuration="1.246688408s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 17:36:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 17:36:32.244207703 +0000 UTC m=+560.499062245" watchObservedRunningTime="2026-10-31 17:36:32.246688408 +0000 UTC m=+560.501542952"
Oct 31 17:36:32.401748 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:32.401708    5003 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w6-d80080-openshift-default-956cddf57-x6xxp"
Oct 31 17:36:32.407687 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:32.407637    5003 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w6-d80080-openshift-default-956cddf57-x6xxp"
Oct 31 17:36:32.682087 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:32.682055    5003 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w0-ee816e-openshift-default-c4db85b5c-7pwpp"
Oct 31 17:36:33.133295 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:33.133256    5003 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w5-b78c31-openshift-default-774cb4f6c9-p7lp5"
Oct 31 17:36:33.133749 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:33.133313    5003 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w6-d80080-openshift-default-956cddf57-x6xxp"
Oct 31 17:36:33.134007 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:33.133989    5003 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w5-b78c31-openshift-default-774cb4f6c9-p7lp5"
Oct 31 17:36:33.134237 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:33.134219    5003 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w6-d80080-openshift-default-956cddf57-x6xxp"
Oct 31 17:36:33.688599 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:33.688563    5003 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w0-ee816e-openshift-default-c4db85b5c-7pwpp"
Oct 31 17:36:34.138195 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:34.138161    5003 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w0-ee816e-openshift-default-c4db85b5c-7pwpp"
Oct 31 17:36:34.138959 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:34.138942    5003 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w0-ee816e-openshift-default-c4db85b5c-7pwpp"
Oct 31 17:36:35.973672 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:35.973625    5003 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w3-cf0a86-c788d8d8f-r22w9"]
Oct 31 17:36:35.977678 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:35.977630    5003 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w3-cf0a86-c788d8d8f-r22w9"
Oct 31 17:36:36.004292 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:36.004256    5003 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w3-cf0a86-c788d8d8f-r22w9"]
Oct 31 17:36:36.015581 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:36.015522    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7804a34f-1c95-4057-8131-39e8bec72e57-plugins-config-volume\") pod \"payload-processing-e2e-worker-w3-cf0a86-c788d8d8f-r22w9\" (UID: \"7804a34f-1c95-4057-8131-39e8bec72e57\") " pod="openshift-ingress/payload-processing-e2e-worker-w3-cf0a86-c788d8d8f-r22w9"
Oct 31 17:36:36.015829 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:36.015619    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lqj7l\" (UniqueName: \"kubernetes.io/projected/7804a34f-1c95-4057-8131-39e8bec72e57-kube-api-access-lqj7l\") pod \"payload-processing-e2e-worker-w3-cf0a86-c788d8d8f-r22w9\" (UID: \"7804a34f-1c95-4057-8131-39e8bec72e57\") " pod="openshift-ingress/payload-processing-e2e-worker-w3-cf0a86-c788d8d8f-r22w9"
Oct 31 17:36:36.040619 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:36.040573    5003 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-worker-w3-cf0a86\""
Oct 31 17:36:36.070938 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:36.070909    5003 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-worker-w3-cf0a86-dockercfg-xtfx8\""
Oct 31 17:36:36.116513 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:36.116477    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7804a34f-1c95-4057-8131-39e8bec72e57-plugins-config-volume\") pod \"payload-processing-e2e-worker-w3-cf0a86-c788d8d8f-r22w9\" (UID: \"7804a34f-1c95-4057-8131-39e8bec72e57\") " pod="openshift-ingress/payload-processing-e2e-worker-w3-cf0a86-c788d8d8f-r22w9"
Oct 31 17:36:36.116696 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:36.116556    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lqj7l\" (UniqueName: \"kubernetes.io/projected/7804a34f-1c95-4057-8131-39e8bec72e57-kube-api-access-lqj7l\") pod \"payload-processing-e2e-worker-w3-cf0a86-c788d8d8f-r22w9\" (UID: \"7804a34f-1c95-4057-8131-39e8bec72e57\") " pod="openshift-ingress/payload-processing-e2e-worker-w3-cf0a86-c788d8d8f-r22w9"
Oct 31 17:36:36.117217 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:36.117193    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7804a34f-1c95-4057-8131-39e8bec72e57-plugins-config-volume\") pod \"payload-processing-e2e-worker-w3-cf0a86-c788d8d8f-r22w9\" (UID: \"7804a34f-1c95-4057-8131-39e8bec72e57\") " pod="openshift-ingress/payload-processing-e2e-worker-w3-cf0a86-c788d8d8f-r22w9"
Oct 31 17:36:36.137801 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:36.137774    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lqj7l\" (UniqueName: \"kubernetes.io/projected/7804a34f-1c95-4057-8131-39e8bec72e57-kube-api-access-lqj7l\") pod \"payload-processing-e2e-worker-w3-cf0a86-c788d8d8f-r22w9\" (UID: \"7804a34f-1c95-4057-8131-39e8bec72e57\") " pod="openshift-ingress/payload-processing-e2e-worker-w3-cf0a86-c788d8d8f-r22w9"
Oct 31 17:36:36.291977 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:36.291881    5003 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w3-cf0a86-c788d8d8f-r22w9"
Oct 31 17:36:36.590293 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:36.590260    5003 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w3-cf0a86-c788d8d8f-r22w9"]
Oct 31 17:36:37.159212 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:37.159134    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w3-cf0a86-c788d8d8f-r22w9" event={"ID":"7804a34f-1c95-4057-8131-39e8bec72e57","Type":"ContainerStarted","Data":"f07f174fd80344435a04a565c79614b6f084386b3ab9bb99f72c8c2d1eb72a95"}
Oct 31 17:36:37.687065 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:37.687036    5003 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w6-d80080-7f8f6c66c-btxwt"]
Oct 31 17:36:37.691248 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:37.691228    5003 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w6-d80080-7f8f6c66c-btxwt"
Oct 31 17:36:37.710529 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:37.710502    5003 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w6-d80080-7f8f6c66c-btxwt"]
Oct 31 17:36:37.719182 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:37.719145    5003 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-worker-w6-d80080\""
Oct 31 17:36:37.733938 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:37.733904    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d6d7f818-43c5-4470-9799-6b6e6cebb928-plugins-config-volume\") pod \"payload-processing-e2e-worker-w6-d80080-7f8f6c66c-btxwt\" (UID: \"d6d7f818-43c5-4470-9799-6b6e6cebb928\") " pod="openshift-ingress/payload-processing-e2e-worker-w6-d80080-7f8f6c66c-btxwt"
Oct 31 17:36:37.734277 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:37.734254    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jlvmr\" (UniqueName: \"kubernetes.io/projected/d6d7f818-43c5-4470-9799-6b6e6cebb928-kube-api-access-jlvmr\") pod \"payload-processing-e2e-worker-w6-d80080-7f8f6c66c-btxwt\" (UID: \"d6d7f818-43c5-4470-9799-6b6e6cebb928\") " pod="openshift-ingress/payload-processing-e2e-worker-w6-d80080-7f8f6c66c-btxwt"
Oct 31 17:36:37.840670 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:37.840267    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d6d7f818-43c5-4470-9799-6b6e6cebb928-plugins-config-volume\") pod \"payload-processing-e2e-worker-w6-d80080-7f8f6c66c-btxwt\" (UID: \"d6d7f818-43c5-4470-9799-6b6e6cebb928\") " pod="openshift-ingress/payload-processing-e2e-worker-w6-d80080-7f8f6c66c-btxwt"
Oct 31 17:36:37.840670 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:37.840352    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jlvmr\" (UniqueName: \"kubernetes.io/projected/d6d7f818-43c5-4470-9799-6b6e6cebb928-kube-api-access-jlvmr\") pod \"payload-processing-e2e-worker-w6-d80080-7f8f6c66c-btxwt\" (UID: \"d6d7f818-43c5-4470-9799-6b6e6cebb928\") " pod="openshift-ingress/payload-processing-e2e-worker-w6-d80080-7f8f6c66c-btxwt"
Oct 31 17:36:37.850669 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:37.847858    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d6d7f818-43c5-4470-9799-6b6e6cebb928-plugins-config-volume\") pod \"payload-processing-e2e-worker-w6-d80080-7f8f6c66c-btxwt\" (UID: \"d6d7f818-43c5-4470-9799-6b6e6cebb928\") " pod="openshift-ingress/payload-processing-e2e-worker-w6-d80080-7f8f6c66c-btxwt"
Oct 31 17:36:37.867431 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:37.867397    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jlvmr\" (UniqueName: \"kubernetes.io/projected/d6d7f818-43c5-4470-9799-6b6e6cebb928-kube-api-access-jlvmr\") pod \"payload-processing-e2e-worker-w6-d80080-7f8f6c66c-btxwt\" (UID: \"d6d7f818-43c5-4470-9799-6b6e6cebb928\") " pod="openshift-ingress/payload-processing-e2e-worker-w6-d80080-7f8f6c66c-btxwt"
Oct 31 17:36:38.006909 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:38.006816    5003 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w6-d80080-7f8f6c66c-btxwt"
Oct 31 17:36:38.313926 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:38.313876    5003 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w6-d80080-7f8f6c66c-btxwt"]
Oct 31 17:36:38.321422 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:36:38.321381    5003 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd6d7f818_43c5_4470_9799_6b6e6cebb928.slice/crio-87333d592c8781019769aeb3b522caddb0486a2f110ef0777fe720607e10d1e9 WatchSource:0}: Error finding container 87333d592c8781019769aeb3b522caddb0486a2f110ef0777fe720607e10d1e9: Status 404 returned error can't find the container with id 87333d592c8781019769aeb3b522caddb0486a2f110ef0777fe720607e10d1e9
Oct 31 17:36:38.593204 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:38.593098    5003 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w0-ee816e-7cd5d5699-t92fc"]
Oct 31 17:36:38.597468 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:38.597431    5003 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-ee816e-7cd5d5699-t92fc"
Oct 31 17:36:38.611594 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:38.611570    5003 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-worker-w0-ee816e\""
Oct 31 17:36:38.623606 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:38.623572    5003 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-worker-w0-ee816e-dockercfg-tfbpz\""
Oct 31 17:36:38.627533 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:38.627499    5003 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w0-ee816e-7cd5d5699-t92fc"]
Oct 31 17:36:38.664459 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:38.664424    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d0144654-e609-4e0f-9c06-7522cefcf9f0-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w0-ee816e-7cd5d5699-t92fc\" (UID: \"d0144654-e609-4e0f-9c06-7522cefcf9f0\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-ee816e-7cd5d5699-t92fc"
Oct 31 17:36:38.664624 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:38.664473    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6zbfl\" (UniqueName: \"kubernetes.io/projected/d0144654-e609-4e0f-9c06-7522cefcf9f0-kube-api-access-6zbfl\") pod \"payload-pre-processing-e2e-worker-w0-ee816e-7cd5d5699-t92fc\" (UID: \"d0144654-e609-4e0f-9c06-7522cefcf9f0\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-ee816e-7cd5d5699-t92fc"
Oct 31 17:36:38.694498 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:38.694469    5003 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w0-ee816e-7d6bc48879-mmfcd"]
Oct 31 17:36:38.699818 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:38.699795    5003 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w0-ee816e-7d6bc48879-mmfcd"
Oct 31 17:36:38.716514 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:38.716488    5003 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w0-ee816e-7d6bc48879-mmfcd"]
Oct 31 17:36:38.765776 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:38.765749    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7a49c490-67e7-4f7e-8ce9-11def81392e4-plugins-config-volume\") pod \"payload-processing-e2e-worker-w0-ee816e-7d6bc48879-mmfcd\" (UID: \"7a49c490-67e7-4f7e-8ce9-11def81392e4\") " pod="openshift-ingress/payload-processing-e2e-worker-w0-ee816e-7d6bc48879-mmfcd"
Oct 31 17:36:38.765958 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:38.765797    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d0144654-e609-4e0f-9c06-7522cefcf9f0-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w0-ee816e-7cd5d5699-t92fc\" (UID: \"d0144654-e609-4e0f-9c06-7522cefcf9f0\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-ee816e-7cd5d5699-t92fc"
Oct 31 17:36:38.765958 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:38.765843    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6zbfl\" (UniqueName: \"kubernetes.io/projected/d0144654-e609-4e0f-9c06-7522cefcf9f0-kube-api-access-6zbfl\") pod \"payload-pre-processing-e2e-worker-w0-ee816e-7cd5d5699-t92fc\" (UID: \"d0144654-e609-4e0f-9c06-7522cefcf9f0\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-ee816e-7cd5d5699-t92fc"
Oct 31 17:36:38.765958 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:38.765868    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v5j4p\" (UniqueName: \"kubernetes.io/projected/7a49c490-67e7-4f7e-8ce9-11def81392e4-kube-api-access-v5j4p\") pod \"payload-processing-e2e-worker-w0-ee816e-7d6bc48879-mmfcd\" (UID: \"7a49c490-67e7-4f7e-8ce9-11def81392e4\") " pod="openshift-ingress/payload-processing-e2e-worker-w0-ee816e-7d6bc48879-mmfcd"
Oct 31 17:36:38.766940 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:38.766894    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d0144654-e609-4e0f-9c06-7522cefcf9f0-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w0-ee816e-7cd5d5699-t92fc\" (UID: \"d0144654-e609-4e0f-9c06-7522cefcf9f0\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-ee816e-7cd5d5699-t92fc"
Oct 31 17:36:38.784382 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:38.784359    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6zbfl\" (UniqueName: \"kubernetes.io/projected/d0144654-e609-4e0f-9c06-7522cefcf9f0-kube-api-access-6zbfl\") pod \"payload-pre-processing-e2e-worker-w0-ee816e-7cd5d5699-t92fc\" (UID: \"d0144654-e609-4e0f-9c06-7522cefcf9f0\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-ee816e-7cd5d5699-t92fc"
Oct 31 17:36:38.869064 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:38.868957    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7a49c490-67e7-4f7e-8ce9-11def81392e4-plugins-config-volume\") pod \"payload-processing-e2e-worker-w0-ee816e-7d6bc48879-mmfcd\" (UID: \"7a49c490-67e7-4f7e-8ce9-11def81392e4\") " pod="openshift-ingress/payload-processing-e2e-worker-w0-ee816e-7d6bc48879-mmfcd"
Oct 31 17:36:38.869064 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:38.869041    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v5j4p\" (UniqueName: \"kubernetes.io/projected/7a49c490-67e7-4f7e-8ce9-11def81392e4-kube-api-access-v5j4p\") pod \"payload-processing-e2e-worker-w0-ee816e-7d6bc48879-mmfcd\" (UID: \"7a49c490-67e7-4f7e-8ce9-11def81392e4\") " pod="openshift-ingress/payload-processing-e2e-worker-w0-ee816e-7d6bc48879-mmfcd"
Oct 31 17:36:38.870173 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:38.870116    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7a49c490-67e7-4f7e-8ce9-11def81392e4-plugins-config-volume\") pod \"payload-processing-e2e-worker-w0-ee816e-7d6bc48879-mmfcd\" (UID: \"7a49c490-67e7-4f7e-8ce9-11def81392e4\") " pod="openshift-ingress/payload-processing-e2e-worker-w0-ee816e-7d6bc48879-mmfcd"
Oct 31 17:36:38.894866 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:38.892214    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v5j4p\" (UniqueName: \"kubernetes.io/projected/7a49c490-67e7-4f7e-8ce9-11def81392e4-kube-api-access-v5j4p\") pod \"payload-processing-e2e-worker-w0-ee816e-7d6bc48879-mmfcd\" (UID: \"7a49c490-67e7-4f7e-8ce9-11def81392e4\") " pod="openshift-ingress/payload-processing-e2e-worker-w0-ee816e-7d6bc48879-mmfcd"
Oct 31 17:36:38.914058 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:38.914021    5003 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-ee816e-7cd5d5699-t92fc"
Oct 31 17:36:39.038440 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:39.038409    5003 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w0-ee816e-7d6bc48879-mmfcd"
Oct 31 17:36:39.176729 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:39.176617    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w6-d80080-7f8f6c66c-btxwt" event={"ID":"d6d7f818-43c5-4470-9799-6b6e6cebb928","Type":"ContainerStarted","Data":"6237f9f1f5859ea0ed18d12272273009f471c652f72b1c34a42abecd7c42359f"}
Oct 31 17:36:39.176729 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:39.176719    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w6-d80080-7f8f6c66c-btxwt" event={"ID":"d6d7f818-43c5-4470-9799-6b6e6cebb928","Type":"ContainerStarted","Data":"87333d592c8781019769aeb3b522caddb0486a2f110ef0777fe720607e10d1e9"}
Oct 31 17:36:39.176922 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:39.176753    5003 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-worker-w6-d80080-7f8f6c66c-btxwt"
Oct 31 17:36:39.178423 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:39.178392    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w3-cf0a86-c788d8d8f-r22w9" event={"ID":"7804a34f-1c95-4057-8131-39e8bec72e57","Type":"ContainerStarted","Data":"e62cc85dcfe147870753f54ee06f3070b37a30ab64836a6e78ed1b0c56e41593"}
Oct 31 17:36:39.178553 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:39.178458    5003 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-worker-w3-cf0a86-c788d8d8f-r22w9"
Oct 31 17:36:39.217202 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:39.217170    5003 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w0-ee816e-7cd5d5699-t92fc"]
Oct 31 17:36:39.217508 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:39.217435    5003 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-worker-w6-d80080-7f8f6c66c-btxwt" podStartSLOduration=1.7175445360000001 podStartE2EDuration="2.217418444s" totalImagesPullingTime="499.873908ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 17:36:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 17:36:39.212345925 +0000 UTC m=+567.467200468" watchObservedRunningTime="2026-10-31 17:36:39.217418444 +0000 UTC m=+567.472272988"
Oct 31 17:36:39.217943 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:36:39.217914    5003 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd0144654_e609_4e0f_9c06_7522cefcf9f0.slice/crio-ab97baf78c5708af0cbbf56aac2d69e92aa75f78e87717e143e3ad3532b04767 WatchSource:0}: Error finding container ab97baf78c5708af0cbbf56aac2d69e92aa75f78e87717e143e3ad3532b04767: Status 404 returned error can't find the container with id ab97baf78c5708af0cbbf56aac2d69e92aa75f78e87717e143e3ad3532b04767
Oct 31 17:36:39.252234 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:39.252191    5003 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-worker-w3-cf0a86-c788d8d8f-r22w9" podStartSLOduration=2.161024721 podStartE2EDuration="4.252174574s" totalImagesPullingTime="2.091149853s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 17:36:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 17:36:39.249696598 +0000 UTC m=+567.504551137" watchObservedRunningTime="2026-10-31 17:36:39.252174574 +0000 UTC m=+567.507029118"
Oct 31 17:36:39.338289 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:39.338220    5003 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w0-ee816e-7d6bc48879-mmfcd"]
Oct 31 17:36:39.341957 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:36:39.341929    5003 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7a49c490_67e7_4f7e_8ce9_11def81392e4.slice/crio-4d0ee13e846b53e2a87bfb16f34522f628ee21585ae5bc871417b020a60e1119 WatchSource:0}: Error finding container 4d0ee13e846b53e2a87bfb16f34522f628ee21585ae5bc871417b020a60e1119: Status 404 returned error can't find the container with id 4d0ee13e846b53e2a87bfb16f34522f628ee21585ae5bc871417b020a60e1119
Oct 31 17:36:40.189115 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:40.189056    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-ee816e-7cd5d5699-t92fc" event={"ID":"d0144654-e609-4e0f-9c06-7522cefcf9f0","Type":"ContainerStarted","Data":"e48f4c71eedc524f09c49d937c9b74783151265e70eb1cec84560e88c7ee0e4c"}
Oct 31 17:36:40.189446 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:40.189419    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-ee816e-7cd5d5699-t92fc" event={"ID":"d0144654-e609-4e0f-9c06-7522cefcf9f0","Type":"ContainerStarted","Data":"ab97baf78c5708af0cbbf56aac2d69e92aa75f78e87717e143e3ad3532b04767"}
Oct 31 17:36:40.189680 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:40.189621    5003 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-ee816e-7cd5d5699-t92fc"
Oct 31 17:36:40.194602 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:40.194573    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w0-ee816e-7d6bc48879-mmfcd" event={"ID":"7a49c490-67e7-4f7e-8ce9-11def81392e4","Type":"ContainerStarted","Data":"fa00b801b3196dd63e6b0384954eca3509bdbaf78ed687304fb321ea3ed57e64"}
Oct 31 17:36:40.194776 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:40.194625    5003 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-worker-w0-ee816e-7d6bc48879-mmfcd"
Oct 31 17:36:40.194776 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:40.194665    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w0-ee816e-7d6bc48879-mmfcd" event={"ID":"7a49c490-67e7-4f7e-8ce9-11def81392e4","Type":"ContainerStarted","Data":"4d0ee13e846b53e2a87bfb16f34522f628ee21585ae5bc871417b020a60e1119"}
Oct 31 17:36:40.229316 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:40.229264    5003 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-ee816e-7cd5d5699-t92fc" podStartSLOduration=2.229250957 podStartE2EDuration="2.229250957s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 17:36:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 17:36:40.228220803 +0000 UTC m=+568.483075345" watchObservedRunningTime="2026-10-31 17:36:40.229250957 +0000 UTC m=+568.484105498"
Oct 31 17:36:40.265683 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:40.265616    5003 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-worker-w0-ee816e-7d6bc48879-mmfcd" podStartSLOduration=2.265600986 podStartE2EDuration="2.265600986s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 17:36:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 17:36:40.263454163 +0000 UTC m=+568.518308705" watchObservedRunningTime="2026-10-31 17:36:40.265600986 +0000 UTC m=+568.520455561"
Oct 31 17:36:40.331866 ip-10-0-138-17 kubenswrapper[5003]: E1031 17:36:40.331832    5003 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-tdzz5" containerName="extractor"
Oct 31 17:36:41.219955 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:41.219918    5003 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w5-b78c31-86cdfb657c-m4s5d"]
Oct 31 17:36:41.238148 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:41.238112    5003 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w5-b78c31-86cdfb657c-m4s5d"
Oct 31 17:36:41.244591 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:41.244560    5003 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w5-b78c31-86cdfb657c-m4s5d"]
Oct 31 17:36:41.252355 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:41.252331    5003 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-worker-w5-b78c31\""
Oct 31 17:36:41.264069 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:41.264041    5003 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-worker-w5-b78c31-dockercfg-pzbjt\""
Oct 31 17:36:41.399106 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:41.399069    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/06aa3682-3041-49d8-b240-761092b11dc9-plugins-config-volume\") pod \"payload-processing-e2e-worker-w5-b78c31-86cdfb657c-m4s5d\" (UID: \"06aa3682-3041-49d8-b240-761092b11dc9\") " pod="openshift-ingress/payload-processing-e2e-worker-w5-b78c31-86cdfb657c-m4s5d"
Oct 31 17:36:41.399106 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:41.399113    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wndws\" (UniqueName: \"kubernetes.io/projected/06aa3682-3041-49d8-b240-761092b11dc9-kube-api-access-wndws\") pod \"payload-processing-e2e-worker-w5-b78c31-86cdfb657c-m4s5d\" (UID: \"06aa3682-3041-49d8-b240-761092b11dc9\") " pod="openshift-ingress/payload-processing-e2e-worker-w5-b78c31-86cdfb657c-m4s5d"
Oct 31 17:36:41.500329 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:41.500247    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/06aa3682-3041-49d8-b240-761092b11dc9-plugins-config-volume\") pod \"payload-processing-e2e-worker-w5-b78c31-86cdfb657c-m4s5d\" (UID: \"06aa3682-3041-49d8-b240-761092b11dc9\") " pod="openshift-ingress/payload-processing-e2e-worker-w5-b78c31-86cdfb657c-m4s5d"
Oct 31 17:36:41.500329 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:41.500292    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wndws\" (UniqueName: \"kubernetes.io/projected/06aa3682-3041-49d8-b240-761092b11dc9-kube-api-access-wndws\") pod \"payload-processing-e2e-worker-w5-b78c31-86cdfb657c-m4s5d\" (UID: \"06aa3682-3041-49d8-b240-761092b11dc9\") " pod="openshift-ingress/payload-processing-e2e-worker-w5-b78c31-86cdfb657c-m4s5d"
Oct 31 17:36:41.501010 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:41.500988    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/06aa3682-3041-49d8-b240-761092b11dc9-plugins-config-volume\") pod \"payload-processing-e2e-worker-w5-b78c31-86cdfb657c-m4s5d\" (UID: \"06aa3682-3041-49d8-b240-761092b11dc9\") " pod="openshift-ingress/payload-processing-e2e-worker-w5-b78c31-86cdfb657c-m4s5d"
Oct 31 17:36:41.519408 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:41.519374    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wndws\" (UniqueName: \"kubernetes.io/projected/06aa3682-3041-49d8-b240-761092b11dc9-kube-api-access-wndws\") pod \"payload-processing-e2e-worker-w5-b78c31-86cdfb657c-m4s5d\" (UID: \"06aa3682-3041-49d8-b240-761092b11dc9\") " pod="openshift-ingress/payload-processing-e2e-worker-w5-b78c31-86cdfb657c-m4s5d"
Oct 31 17:36:41.563366 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:41.563335    5003 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w5-b78c31-86cdfb657c-m4s5d"
Oct 31 17:36:41.878362 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:41.878317    5003 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w5-b78c31-86cdfb657c-m4s5d"]
Oct 31 17:36:41.883030 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:36:41.882984    5003 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod06aa3682_3041_49d8_b240_761092b11dc9.slice/crio-5aedf0f6ba78923dcf815947f39f28be2fb643241155f0571ae51732fca25554 WatchSource:0}: Error finding container 5aedf0f6ba78923dcf815947f39f28be2fb643241155f0571ae51732fca25554: Status 404 returned error can't find the container with id 5aedf0f6ba78923dcf815947f39f28be2fb643241155f0571ae51732fca25554
Oct 31 17:36:42.211035 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:42.210941    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w5-b78c31-86cdfb657c-m4s5d" event={"ID":"06aa3682-3041-49d8-b240-761092b11dc9","Type":"ContainerStarted","Data":"695bb9d51a97ef5793c4817e95a5b6a014f7271b66789311a45ca17c2b1256dc"}
Oct 31 17:36:42.211035 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:42.210992    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w5-b78c31-86cdfb657c-m4s5d" event={"ID":"06aa3682-3041-49d8-b240-761092b11dc9","Type":"ContainerStarted","Data":"5aedf0f6ba78923dcf815947f39f28be2fb643241155f0571ae51732fca25554"}
Oct 31 17:36:42.211264 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:42.211053    5003 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-worker-w5-b78c31-86cdfb657c-m4s5d"
Oct 31 17:36:42.250863 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:42.250807    5003 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-worker-w5-b78c31-86cdfb657c-m4s5d" podStartSLOduration=1.250792514 podStartE2EDuration="1.250792514s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 17:36:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 17:36:42.248990164 +0000 UTC m=+570.503844707" watchObservedRunningTime="2026-10-31 17:36:42.250792514 +0000 UTC m=+570.505647059"
Oct 31 17:36:42.805193 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:42.805154    5003 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-1c0bfd-84cbc7675-n2bbv"]
Oct 31 17:36:42.809101 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:42.809084    5003 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-1c0bfd-84cbc7675-n2bbv"
Oct 31 17:36:42.827077 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:42.827051    5003 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-worker-w4-1c0bfd\""
Oct 31 17:36:42.829933 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:42.829904    5003 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-1c0bfd-84cbc7675-n2bbv"]
Oct 31 17:36:42.838718 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:42.838693    5003 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-worker-w4-1c0bfd-dockercfg-jr7wn\""
Oct 31 17:36:42.900516 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:42.900485    5003 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w4-1c0bfd-754b9cb7cf-gpdmq"]
Oct 31 17:36:42.904511 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:42.904481    5003 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w4-1c0bfd-754b9cb7cf-gpdmq"
Oct 31 17:36:42.916065 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:42.916021    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k2mx8\" (UniqueName: \"kubernetes.io/projected/2335abae-520f-4557-8ffd-ab60cbb68812-kube-api-access-k2mx8\") pod \"payload-pre-processing-e2e-worker-w4-1c0bfd-84cbc7675-n2bbv\" (UID: \"2335abae-520f-4557-8ffd-ab60cbb68812\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-1c0bfd-84cbc7675-n2bbv"
Oct 31 17:36:42.916240 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:42.916084    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2335abae-520f-4557-8ffd-ab60cbb68812-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w4-1c0bfd-84cbc7675-n2bbv\" (UID: \"2335abae-520f-4557-8ffd-ab60cbb68812\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-1c0bfd-84cbc7675-n2bbv"
Oct 31 17:36:42.942264 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:42.942227    5003 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w4-1c0bfd-754b9cb7cf-gpdmq"]
Oct 31 17:36:43.017339 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:43.017297    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6eff589e-d19b-4ea9-898e-85009de000eb-plugins-config-volume\") pod \"payload-processing-e2e-worker-w4-1c0bfd-754b9cb7cf-gpdmq\" (UID: \"6eff589e-d19b-4ea9-898e-85009de000eb\") " pod="openshift-ingress/payload-processing-e2e-worker-w4-1c0bfd-754b9cb7cf-gpdmq"
Oct 31 17:36:43.017483 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:43.017360    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6n6bg\" (UniqueName: \"kubernetes.io/projected/6eff589e-d19b-4ea9-898e-85009de000eb-kube-api-access-6n6bg\") pod \"payload-processing-e2e-worker-w4-1c0bfd-754b9cb7cf-gpdmq\" (UID: \"6eff589e-d19b-4ea9-898e-85009de000eb\") " pod="openshift-ingress/payload-processing-e2e-worker-w4-1c0bfd-754b9cb7cf-gpdmq"
Oct 31 17:36:43.017628 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:43.017592    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k2mx8\" (UniqueName: \"kubernetes.io/projected/2335abae-520f-4557-8ffd-ab60cbb68812-kube-api-access-k2mx8\") pod \"payload-pre-processing-e2e-worker-w4-1c0bfd-84cbc7675-n2bbv\" (UID: \"2335abae-520f-4557-8ffd-ab60cbb68812\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-1c0bfd-84cbc7675-n2bbv"
Oct 31 17:36:43.017785 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:43.017638    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2335abae-520f-4557-8ffd-ab60cbb68812-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w4-1c0bfd-84cbc7675-n2bbv\" (UID: \"2335abae-520f-4557-8ffd-ab60cbb68812\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-1c0bfd-84cbc7675-n2bbv"
Oct 31 17:36:43.018403 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:43.018385    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2335abae-520f-4557-8ffd-ab60cbb68812-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w4-1c0bfd-84cbc7675-n2bbv\" (UID: \"2335abae-520f-4557-8ffd-ab60cbb68812\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-1c0bfd-84cbc7675-n2bbv"
Oct 31 17:36:43.036518 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:43.036493    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k2mx8\" (UniqueName: \"kubernetes.io/projected/2335abae-520f-4557-8ffd-ab60cbb68812-kube-api-access-k2mx8\") pod \"payload-pre-processing-e2e-worker-w4-1c0bfd-84cbc7675-n2bbv\" (UID: \"2335abae-520f-4557-8ffd-ab60cbb68812\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-1c0bfd-84cbc7675-n2bbv"
Oct 31 17:36:43.119081 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:43.118998    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6n6bg\" (UniqueName: \"kubernetes.io/projected/6eff589e-d19b-4ea9-898e-85009de000eb-kube-api-access-6n6bg\") pod \"payload-processing-e2e-worker-w4-1c0bfd-754b9cb7cf-gpdmq\" (UID: \"6eff589e-d19b-4ea9-898e-85009de000eb\") " pod="openshift-ingress/payload-processing-e2e-worker-w4-1c0bfd-754b9cb7cf-gpdmq"
Oct 31 17:36:43.119232 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:43.119113    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6eff589e-d19b-4ea9-898e-85009de000eb-plugins-config-volume\") pod \"payload-processing-e2e-worker-w4-1c0bfd-754b9cb7cf-gpdmq\" (UID: \"6eff589e-d19b-4ea9-898e-85009de000eb\") " pod="openshift-ingress/payload-processing-e2e-worker-w4-1c0bfd-754b9cb7cf-gpdmq"
Oct 31 17:36:43.119807 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:43.119787    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6eff589e-d19b-4ea9-898e-85009de000eb-plugins-config-volume\") pod \"payload-processing-e2e-worker-w4-1c0bfd-754b9cb7cf-gpdmq\" (UID: \"6eff589e-d19b-4ea9-898e-85009de000eb\") " pod="openshift-ingress/payload-processing-e2e-worker-w4-1c0bfd-754b9cb7cf-gpdmq"
Oct 31 17:36:43.122827 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:43.122806    5003 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-1c0bfd-84cbc7675-n2bbv"
Oct 31 17:36:43.137775 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:43.137747    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6n6bg\" (UniqueName: \"kubernetes.io/projected/6eff589e-d19b-4ea9-898e-85009de000eb-kube-api-access-6n6bg\") pod \"payload-processing-e2e-worker-w4-1c0bfd-754b9cb7cf-gpdmq\" (UID: \"6eff589e-d19b-4ea9-898e-85009de000eb\") " pod="openshift-ingress/payload-processing-e2e-worker-w4-1c0bfd-754b9cb7cf-gpdmq"
Oct 31 17:36:43.249345 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:43.249303    5003 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w4-1c0bfd-754b9cb7cf-gpdmq"
Oct 31 17:36:43.438952 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:43.438880    5003 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-1c0bfd-84cbc7675-n2bbv"]
Oct 31 17:36:43.442608 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:36:43.442584    5003 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2335abae_520f_4557_8ffd_ab60cbb68812.slice/crio-59abf8bfa16eff662da4f900e79f6bb1fc08c6e79ef54e4296db806d1e4e9fc5 WatchSource:0}: Error finding container 59abf8bfa16eff662da4f900e79f6bb1fc08c6e79ef54e4296db806d1e4e9fc5: Status 404 returned error can't find the container with id 59abf8bfa16eff662da4f900e79f6bb1fc08c6e79ef54e4296db806d1e4e9fc5
Oct 31 17:36:43.588768 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:43.588740    5003 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w4-1c0bfd-754b9cb7cf-gpdmq"]
Oct 31 17:36:43.590815 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:36:43.590787    5003 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6eff589e_d19b_4ea9_898e_85009de000eb.slice/crio-32e7f9fba5b8e6ff7726488d1de22ea6d57a83f683d55ea5ea59e11885f22138 WatchSource:0}: Error finding container 32e7f9fba5b8e6ff7726488d1de22ea6d57a83f683d55ea5ea59e11885f22138: Status 404 returned error can't find the container with id 32e7f9fba5b8e6ff7726488d1de22ea6d57a83f683d55ea5ea59e11885f22138
Oct 31 17:36:43.735710 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:43.735612    5003 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w1-0e59ca-6c6556b595-dq7d4"]
Oct 31 17:36:43.739485 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:43.739468    5003 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w1-0e59ca-6c6556b595-dq7d4"
Oct 31 17:36:43.787410 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:43.787379    5003 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w1-0e59ca-6c6556b595-dq7d4"]
Oct 31 17:36:43.793306 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:43.793252    5003 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-worker-w1-0e59ca-dockercfg-ppc99\""
Oct 31 17:36:43.793507 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:43.793344    5003 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-worker-w1-0e59ca\""
Oct 31 17:36:43.830335 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:43.830290    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c9wxx\" (UniqueName: \"kubernetes.io/projected/5a745358-9cc6-464a-a00d-a25d6b205bab-kube-api-access-c9wxx\") pod \"payload-pre-processing-e2e-worker-w1-0e59ca-6c6556b595-dq7d4\" (UID: \"5a745358-9cc6-464a-a00d-a25d6b205bab\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w1-0e59ca-6c6556b595-dq7d4"
Oct 31 17:36:43.830528 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:43.830422    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5a745358-9cc6-464a-a00d-a25d6b205bab-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w1-0e59ca-6c6556b595-dq7d4\" (UID: \"5a745358-9cc6-464a-a00d-a25d6b205bab\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w1-0e59ca-6c6556b595-dq7d4"
Oct 31 17:36:43.931619 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:43.931583    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c9wxx\" (UniqueName: \"kubernetes.io/projected/5a745358-9cc6-464a-a00d-a25d6b205bab-kube-api-access-c9wxx\") pod \"payload-pre-processing-e2e-worker-w1-0e59ca-6c6556b595-dq7d4\" (UID: \"5a745358-9cc6-464a-a00d-a25d6b205bab\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w1-0e59ca-6c6556b595-dq7d4"
Oct 31 17:36:43.931847 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:43.931640    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5a745358-9cc6-464a-a00d-a25d6b205bab-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w1-0e59ca-6c6556b595-dq7d4\" (UID: \"5a745358-9cc6-464a-a00d-a25d6b205bab\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w1-0e59ca-6c6556b595-dq7d4"
Oct 31 17:36:43.932339 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:43.932317    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5a745358-9cc6-464a-a00d-a25d6b205bab-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w1-0e59ca-6c6556b595-dq7d4\" (UID: \"5a745358-9cc6-464a-a00d-a25d6b205bab\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w1-0e59ca-6c6556b595-dq7d4"
Oct 31 17:36:43.950754 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:43.950724    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c9wxx\" (UniqueName: \"kubernetes.io/projected/5a745358-9cc6-464a-a00d-a25d6b205bab-kube-api-access-c9wxx\") pod \"payload-pre-processing-e2e-worker-w1-0e59ca-6c6556b595-dq7d4\" (UID: \"5a745358-9cc6-464a-a00d-a25d6b205bab\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w1-0e59ca-6c6556b595-dq7d4"
Oct 31 17:36:44.057720 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:44.054847    5003 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w1-0e59ca-6c6556b595-dq7d4"
Oct 31 17:36:44.230694 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:44.230629    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-1c0bfd-84cbc7675-n2bbv" event={"ID":"2335abae-520f-4557-8ffd-ab60cbb68812","Type":"ContainerStarted","Data":"69d0a3b5870d84a0100266dd65465f8556a48de1b8d7402ccc4c954407dcd5d3"}
Oct 31 17:36:44.230877 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:44.230735    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-1c0bfd-84cbc7675-n2bbv" event={"ID":"2335abae-520f-4557-8ffd-ab60cbb68812","Type":"ContainerStarted","Data":"59abf8bfa16eff662da4f900e79f6bb1fc08c6e79ef54e4296db806d1e4e9fc5"}
Oct 31 17:36:44.232402 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:44.232378    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w4-1c0bfd-754b9cb7cf-gpdmq" event={"ID":"6eff589e-d19b-4ea9-898e-85009de000eb","Type":"ContainerStarted","Data":"77c1d72a93c4020e18c5448d9f83ef56527d53248911d93608aa0f6cea15b656"}
Oct 31 17:36:44.232506 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:44.232427    5003 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-worker-w4-1c0bfd-754b9cb7cf-gpdmq"
Oct 31 17:36:44.232506 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:44.232452    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w4-1c0bfd-754b9cb7cf-gpdmq" event={"ID":"6eff589e-d19b-4ea9-898e-85009de000eb","Type":"ContainerStarted","Data":"32e7f9fba5b8e6ff7726488d1de22ea6d57a83f683d55ea5ea59e11885f22138"}
Oct 31 17:36:44.317320 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:44.317196    5003 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-1c0bfd-84cbc7675-n2bbv" podStartSLOduration=2.317182966 podStartE2EDuration="2.317182966s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 17:36:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 17:36:44.278456286 +0000 UTC m=+572.533310830" watchObservedRunningTime="2026-10-31 17:36:44.317182966 +0000 UTC m=+572.572037505"
Oct 31 17:36:44.317320 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:44.317302    5003 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-worker-w4-1c0bfd-754b9cb7cf-gpdmq" podStartSLOduration=2.3172964670000002 podStartE2EDuration="2.317296467s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 17:36:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 17:36:44.315120622 +0000 UTC m=+572.569975164" watchObservedRunningTime="2026-10-31 17:36:44.317296467 +0000 UTC m=+572.572151008"
Oct 31 17:36:44.378716 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:44.378676    5003 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w1-0e59ca-6c6556b595-dq7d4"]
Oct 31 17:36:44.382903 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:36:44.382874    5003 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5a745358_9cc6_464a_a00d_a25d6b205bab.slice/crio-b720c89f6bb573f03883a5ab1ab567aaf837b2b58f76537dc5ea6791e9c2376a WatchSource:0}: Error finding container b720c89f6bb573f03883a5ab1ab567aaf837b2b58f76537dc5ea6791e9c2376a: Status 404 returned error can't find the container with id b720c89f6bb573f03883a5ab1ab567aaf837b2b58f76537dc5ea6791e9c2376a
Oct 31 17:36:44.584460 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:44.584371    5003 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w2-5c446c-748954c4f5-9xwrq"]
Oct 31 17:36:44.588401 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:44.588380    5003 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-5c446c-748954c4f5-9xwrq"
Oct 31 17:36:44.604948 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:44.604923    5003 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-worker-w2-5c446c\""
Oct 31 17:36:44.605110 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:44.605010    5003 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-worker-w2-5c446c-dockercfg-4x4nf\""
Oct 31 17:36:44.608724 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:44.608703    5003 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w2-5c446c-748954c4f5-9xwrq"]
Oct 31 17:36:44.683226 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:44.683190    5003 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w2-5c446c-7c8d75cf57-px9mc"]
Oct 31 17:36:44.687486 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:44.687460    5003 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w2-5c446c-7c8d75cf57-px9mc"
Oct 31 17:36:44.691307 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:44.691275    5003 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w2-5c446c-7c8d75cf57-px9mc"]
Oct 31 17:36:44.738146 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:44.738097    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/801db2fa-c695-4267-a534-5a024d355c57-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w2-5c446c-748954c4f5-9xwrq\" (UID: \"801db2fa-c695-4267-a534-5a024d355c57\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-5c446c-748954c4f5-9xwrq"
Oct 31 17:36:44.738344 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:44.738320    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j2ls4\" (UniqueName: \"kubernetes.io/projected/801db2fa-c695-4267-a534-5a024d355c57-kube-api-access-j2ls4\") pod \"payload-pre-processing-e2e-worker-w2-5c446c-748954c4f5-9xwrq\" (UID: \"801db2fa-c695-4267-a534-5a024d355c57\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-5c446c-748954c4f5-9xwrq"
Oct 31 17:36:44.839212 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:44.839138    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z8s7g\" (UniqueName: \"kubernetes.io/projected/69ade7b0-0eb9-4426-901e-9bb7acdf1c1f-kube-api-access-z8s7g\") pod \"payload-processing-e2e-worker-w2-5c446c-7c8d75cf57-px9mc\" (UID: \"69ade7b0-0eb9-4426-901e-9bb7acdf1c1f\") " pod="openshift-ingress/payload-processing-e2e-worker-w2-5c446c-7c8d75cf57-px9mc"
Oct 31 17:36:44.839369 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:44.839215    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j2ls4\" (UniqueName: \"kubernetes.io/projected/801db2fa-c695-4267-a534-5a024d355c57-kube-api-access-j2ls4\") pod \"payload-pre-processing-e2e-worker-w2-5c446c-748954c4f5-9xwrq\" (UID: \"801db2fa-c695-4267-a534-5a024d355c57\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-5c446c-748954c4f5-9xwrq"
Oct 31 17:36:44.839369 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:44.839271    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/801db2fa-c695-4267-a534-5a024d355c57-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w2-5c446c-748954c4f5-9xwrq\" (UID: \"801db2fa-c695-4267-a534-5a024d355c57\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-5c446c-748954c4f5-9xwrq"
Oct 31 17:36:44.839369 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:44.839311    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/69ade7b0-0eb9-4426-901e-9bb7acdf1c1f-plugins-config-volume\") pod \"payload-processing-e2e-worker-w2-5c446c-7c8d75cf57-px9mc\" (UID: \"69ade7b0-0eb9-4426-901e-9bb7acdf1c1f\") " pod="openshift-ingress/payload-processing-e2e-worker-w2-5c446c-7c8d75cf57-px9mc"
Oct 31 17:36:44.840021 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:44.840001    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/801db2fa-c695-4267-a534-5a024d355c57-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w2-5c446c-748954c4f5-9xwrq\" (UID: \"801db2fa-c695-4267-a534-5a024d355c57\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-5c446c-748954c4f5-9xwrq"
Oct 31 17:36:44.878328 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:44.878298    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j2ls4\" (UniqueName: \"kubernetes.io/projected/801db2fa-c695-4267-a534-5a024d355c57-kube-api-access-j2ls4\") pod \"payload-pre-processing-e2e-worker-w2-5c446c-748954c4f5-9xwrq\" (UID: \"801db2fa-c695-4267-a534-5a024d355c57\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-5c446c-748954c4f5-9xwrq"
Oct 31 17:36:44.901171 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:44.901131    5003 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-5c446c-748954c4f5-9xwrq"
Oct 31 17:36:44.940637 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:44.940595    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z8s7g\" (UniqueName: \"kubernetes.io/projected/69ade7b0-0eb9-4426-901e-9bb7acdf1c1f-kube-api-access-z8s7g\") pod \"payload-processing-e2e-worker-w2-5c446c-7c8d75cf57-px9mc\" (UID: \"69ade7b0-0eb9-4426-901e-9bb7acdf1c1f\") " pod="openshift-ingress/payload-processing-e2e-worker-w2-5c446c-7c8d75cf57-px9mc"
Oct 31 17:36:44.940834 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:44.940734    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/69ade7b0-0eb9-4426-901e-9bb7acdf1c1f-plugins-config-volume\") pod \"payload-processing-e2e-worker-w2-5c446c-7c8d75cf57-px9mc\" (UID: \"69ade7b0-0eb9-4426-901e-9bb7acdf1c1f\") " pod="openshift-ingress/payload-processing-e2e-worker-w2-5c446c-7c8d75cf57-px9mc"
Oct 31 17:36:44.942209 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:44.942178    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/69ade7b0-0eb9-4426-901e-9bb7acdf1c1f-plugins-config-volume\") pod \"payload-processing-e2e-worker-w2-5c446c-7c8d75cf57-px9mc\" (UID: \"69ade7b0-0eb9-4426-901e-9bb7acdf1c1f\") " pod="openshift-ingress/payload-processing-e2e-worker-w2-5c446c-7c8d75cf57-px9mc"
Oct 31 17:36:44.964667 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:44.964549    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z8s7g\" (UniqueName: \"kubernetes.io/projected/69ade7b0-0eb9-4426-901e-9bb7acdf1c1f-kube-api-access-z8s7g\") pod \"payload-processing-e2e-worker-w2-5c446c-7c8d75cf57-px9mc\" (UID: \"69ade7b0-0eb9-4426-901e-9bb7acdf1c1f\") " pod="openshift-ingress/payload-processing-e2e-worker-w2-5c446c-7c8d75cf57-px9mc"
Oct 31 17:36:45.040875 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:45.040838    5003 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w2-5c446c-7c8d75cf57-px9mc"
Oct 31 17:36:45.227480 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:45.227446    5003 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w2-5c446c-748954c4f5-9xwrq"]
Oct 31 17:36:45.230809 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:36:45.230780    5003 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod801db2fa_c695_4267_a534_5a024d355c57.slice/crio-a244b3bdc3c5d42e624f5cca5620394ab727ff9fb9401e1dcdb76806b49411bc WatchSource:0}: Error finding container a244b3bdc3c5d42e624f5cca5620394ab727ff9fb9401e1dcdb76806b49411bc: Status 404 returned error can't find the container with id a244b3bdc3c5d42e624f5cca5620394ab727ff9fb9401e1dcdb76806b49411bc
Oct 31 17:36:45.239928 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:45.239880    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-5c446c-748954c4f5-9xwrq" event={"ID":"801db2fa-c695-4267-a534-5a024d355c57","Type":"ContainerStarted","Data":"a244b3bdc3c5d42e624f5cca5620394ab727ff9fb9401e1dcdb76806b49411bc"}
Oct 31 17:36:45.241466 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:45.241439    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w1-0e59ca-6c6556b595-dq7d4" event={"ID":"5a745358-9cc6-464a-a00d-a25d6b205bab","Type":"ContainerStarted","Data":"bdff0449b0550197d2053d2a03a871c08be721dfda375c12db8c0c9bf37ba338"}
Oct 31 17:36:45.241579 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:45.241484    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w1-0e59ca-6c6556b595-dq7d4" event={"ID":"5a745358-9cc6-464a-a00d-a25d6b205bab","Type":"ContainerStarted","Data":"b720c89f6bb573f03883a5ab1ab567aaf837b2b58f76537dc5ea6791e9c2376a"}
Oct 31 17:36:45.241704 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:45.241689    5003 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-1c0bfd-84cbc7675-n2bbv"
Oct 31 17:36:45.288553 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:45.288505    5003 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-worker-w1-0e59ca-6c6556b595-dq7d4" podStartSLOduration=2.2884916730000002 podStartE2EDuration="2.288491673s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 17:36:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 17:36:45.287179232 +0000 UTC m=+573.542033769" watchObservedRunningTime="2026-10-31 17:36:45.288491673 +0000 UTC m=+573.543346215"
Oct 31 17:36:45.381954 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:45.381795    5003 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w2-5c446c-7c8d75cf57-px9mc"]
Oct 31 17:36:45.382467 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:36:45.382402    5003 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod69ade7b0_0eb9_4426_901e_9bb7acdf1c1f.slice/crio-bcfb46f24fabd11ce85f6a3562141fccf24b04cfe4a9992fc75ac68e0cd2ea99 WatchSource:0}: Error finding container bcfb46f24fabd11ce85f6a3562141fccf24b04cfe4a9992fc75ac68e0cd2ea99: Status 404 returned error can't find the container with id bcfb46f24fabd11ce85f6a3562141fccf24b04cfe4a9992fc75ac68e0cd2ea99
Oct 31 17:36:46.313270 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:46.312842    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-5c446c-748954c4f5-9xwrq" event={"ID":"801db2fa-c695-4267-a534-5a024d355c57","Type":"ContainerStarted","Data":"91976378d344d8840a524b21851cd5bd81c7f885d67070a8d85236e87f75f161"}
Oct 31 17:36:46.327541 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:46.326262    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w2-5c446c-7c8d75cf57-px9mc" event={"ID":"69ade7b0-0eb9-4426-901e-9bb7acdf1c1f","Type":"ContainerStarted","Data":"93ace7d75c2830aac310fe02738439a7e46bd294becee20ab2181bc7e974212b"}
Oct 31 17:36:46.328435 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:46.328412    5003 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w1-0e59ca-6c6556b595-dq7d4"
Oct 31 17:36:46.328564 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:46.328551    5003 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-worker-w2-5c446c-7c8d75cf57-px9mc"
Oct 31 17:36:46.328698 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:46.328681    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w2-5c446c-7c8d75cf57-px9mc" event={"ID":"69ade7b0-0eb9-4426-901e-9bb7acdf1c1f","Type":"ContainerStarted","Data":"bcfb46f24fabd11ce85f6a3562141fccf24b04cfe4a9992fc75ac68e0cd2ea99"}
Oct 31 17:36:46.372675 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:46.372590    5003 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-5c446c-748954c4f5-9xwrq" podStartSLOduration=2.372566362 podStartE2EDuration="2.372566362s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 17:36:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 17:36:46.359143536 +0000 UTC m=+574.613998081" watchObservedRunningTime="2026-10-31 17:36:46.372566362 +0000 UTC m=+574.627420907"
Oct 31 17:36:47.331866 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:47.331832    5003 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-5c446c-748954c4f5-9xwrq"
Oct 31 17:36:49.173787 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:49.173750    5003 patch_prober.go:29] interesting pod/e2e-worker-w6-d80080-openshift-default-956cddf57-x6xxp container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 31 17:36:49.174238 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:49.173820    5003 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w6-d80080-openshift-default-956cddf57-x6xxp" podUID="5f2c9613-4b8a-4452-b70a-2ed258063318" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 31 17:36:50.197844 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:50.197815    5003 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-worker-w3-cf0a86-c788d8d8f-r22w9"
Oct 31 17:36:50.198294 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:50.197887    5003 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-worker-w6-d80080-7f8f6c66c-btxwt"
Oct 31 17:36:50.236875 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:50.236820    5003 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-worker-w2-5c446c-7c8d75cf57-px9mc" podStartSLOduration=6.236807172 podStartE2EDuration="6.236807172s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 17:36:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 17:36:46.413927532 +0000 UTC m=+574.668782075" watchObservedRunningTime="2026-10-31 17:36:50.236807172 +0000 UTC m=+578.491661713"
Oct 31 17:36:50.743165 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:50.743126    5003 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w5-b78c31-5f598f895d-wgvlq"]
Oct 31 17:36:50.746785 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:50.746761    5003 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-b78c31-5f598f895d-wgvlq"
Oct 31 17:36:50.762467 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:50.762437    5003 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-worker-w5-b78c31-serving-cert\""
Oct 31 17:36:50.765702 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:50.765672    5003 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w5-b78c31-5f598f895d-wgvlq"]
Oct 31 17:36:50.774780 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:50.774753    5003 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-4s8xz\""
Oct 31 17:36:50.864910 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:50.864882    5003 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Oct 31 17:36:50.942637 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:50.942606    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/faeea853-aa53-4bb6-9a85-4e55772556b2-maas-api-tls\") pod \"maas-api-e2e-worker-w5-b78c31-5f598f895d-wgvlq\" (UID: \"faeea853-aa53-4bb6-9a85-4e55772556b2\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-b78c31-5f598f895d-wgvlq"
Oct 31 17:36:50.942822 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:50.942732    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/faeea853-aa53-4bb6-9a85-4e55772556b2-openshift-service-ca\") pod \"maas-api-e2e-worker-w5-b78c31-5f598f895d-wgvlq\" (UID: \"faeea853-aa53-4bb6-9a85-4e55772556b2\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-b78c31-5f598f895d-wgvlq"
Oct 31 17:36:50.942822 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:50.942759    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wctt7\" (UniqueName: \"kubernetes.io/projected/faeea853-aa53-4bb6-9a85-4e55772556b2-kube-api-access-wctt7\") pod \"maas-api-e2e-worker-w5-b78c31-5f598f895d-wgvlq\" (UID: \"faeea853-aa53-4bb6-9a85-4e55772556b2\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-b78c31-5f598f895d-wgvlq"
Oct 31 17:36:50.942899 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:50.942874    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/faeea853-aa53-4bb6-9a85-4e55772556b2-metrics-certs\") pod \"maas-api-e2e-worker-w5-b78c31-5f598f895d-wgvlq\" (UID: \"faeea853-aa53-4bb6-9a85-4e55772556b2\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-b78c31-5f598f895d-wgvlq"
Oct 31 17:36:51.044499 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:51.044418    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/faeea853-aa53-4bb6-9a85-4e55772556b2-metrics-certs\") pod \"maas-api-e2e-worker-w5-b78c31-5f598f895d-wgvlq\" (UID: \"faeea853-aa53-4bb6-9a85-4e55772556b2\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-b78c31-5f598f895d-wgvlq"
Oct 31 17:36:51.044683 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:51.044503    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/faeea853-aa53-4bb6-9a85-4e55772556b2-maas-api-tls\") pod \"maas-api-e2e-worker-w5-b78c31-5f598f895d-wgvlq\" (UID: \"faeea853-aa53-4bb6-9a85-4e55772556b2\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-b78c31-5f598f895d-wgvlq"
Oct 31 17:36:51.044683 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:51.044536    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/faeea853-aa53-4bb6-9a85-4e55772556b2-openshift-service-ca\") pod \"maas-api-e2e-worker-w5-b78c31-5f598f895d-wgvlq\" (UID: \"faeea853-aa53-4bb6-9a85-4e55772556b2\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-b78c31-5f598f895d-wgvlq"
Oct 31 17:36:51.044683 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:51.044553    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wctt7\" (UniqueName: \"kubernetes.io/projected/faeea853-aa53-4bb6-9a85-4e55772556b2-kube-api-access-wctt7\") pod \"maas-api-e2e-worker-w5-b78c31-5f598f895d-wgvlq\" (UID: \"faeea853-aa53-4bb6-9a85-4e55772556b2\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-b78c31-5f598f895d-wgvlq"
Oct 31 17:36:51.045327 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:51.045299    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/faeea853-aa53-4bb6-9a85-4e55772556b2-openshift-service-ca\") pod \"maas-api-e2e-worker-w5-b78c31-5f598f895d-wgvlq\" (UID: \"faeea853-aa53-4bb6-9a85-4e55772556b2\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-b78c31-5f598f895d-wgvlq"
Oct 31 17:36:51.046970 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:51.046944    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/faeea853-aa53-4bb6-9a85-4e55772556b2-maas-api-tls\") pod \"maas-api-e2e-worker-w5-b78c31-5f598f895d-wgvlq\" (UID: \"faeea853-aa53-4bb6-9a85-4e55772556b2\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-b78c31-5f598f895d-wgvlq"
Oct 31 17:36:51.047084 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:51.047024    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/faeea853-aa53-4bb6-9a85-4e55772556b2-metrics-certs\") pod \"maas-api-e2e-worker-w5-b78c31-5f598f895d-wgvlq\" (UID: \"faeea853-aa53-4bb6-9a85-4e55772556b2\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-b78c31-5f598f895d-wgvlq"
Oct 31 17:36:51.062483 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:51.062458    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wctt7\" (UniqueName: \"kubernetes.io/projected/faeea853-aa53-4bb6-9a85-4e55772556b2-kube-api-access-wctt7\") pod \"maas-api-e2e-worker-w5-b78c31-5f598f895d-wgvlq\" (UID: \"faeea853-aa53-4bb6-9a85-4e55772556b2\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-b78c31-5f598f895d-wgvlq"
Oct 31 17:36:51.208932 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:51.208904    5003 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-ee816e-7cd5d5699-t92fc"
Oct 31 17:36:51.209320 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:51.208969    5003 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-worker-w0-ee816e-7d6bc48879-mmfcd"
Oct 31 17:36:51.358452 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:51.358419    5003 generic.go:356] "Generic (PLEG): container finished" podID="5f2c9613-4b8a-4452-b70a-2ed258063318" containerID="bb5ae6599bdfa06eaa315d59a12ddcdeb296955b61ca4d075418d7282d4d0aee" exitCode=0
Oct 31 17:36:51.358619 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:51.358486    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-d80080-openshift-default-956cddf57-x6xxp" event={"ID":"5f2c9613-4b8a-4452-b70a-2ed258063318","Type":"ContainerDied","Data":"bb5ae6599bdfa06eaa315d59a12ddcdeb296955b61ca4d075418d7282d4d0aee"}
Oct 31 17:36:51.358916 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:51.358902    5003 scope.go:122] "RemoveContainer" containerID="bb5ae6599bdfa06eaa315d59a12ddcdeb296955b61ca4d075418d7282d4d0aee"
Oct 31 17:36:51.359922 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:51.359821    5003 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-b78c31-5f598f895d-wgvlq"
Oct 31 17:36:51.360357 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:51.360329    5003 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Oct 31 17:36:51.360439 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:51.360400    5003 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Oct 31 17:36:51.360439 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:51.360435    5003 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Oct 31 17:36:51.726276 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:51.725944    5003 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w5-b78c31-5f598f895d-wgvlq"]
Oct 31 17:36:51.729243 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:36:51.729207    5003 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfaeea853_aa53_4bb6_9a85_4e55772556b2.slice/crio-37ad7fd42645750b4ea848a7a82ad60fad9a6b8927c9a348061949c58c53ed13 WatchSource:0}: Error finding container 37ad7fd42645750b4ea848a7a82ad60fad9a6b8927c9a348061949c58c53ed13: Status 404 returned error can't find the container with id 37ad7fd42645750b4ea848a7a82ad60fad9a6b8927c9a348061949c58c53ed13
Oct 31 17:36:52.395228 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:52.394298    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-d80080-openshift-default-956cddf57-x6xxp" event={"ID":"5f2c9613-4b8a-4452-b70a-2ed258063318","Type":"ContainerStarted","Data":"af682b13055f9fa3bfcb813dc3c7f84bd182a1fb9c5d47876115724ffe721500"}
Oct 31 17:36:52.396573 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:52.396498    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-b78c31-5f598f895d-wgvlq" event={"ID":"faeea853-aa53-4bb6-9a85-4e55772556b2","Type":"ContainerStarted","Data":"37ad7fd42645750b4ea848a7a82ad60fad9a6b8927c9a348061949c58c53ed13"}
Oct 31 17:36:52.401712 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:52.401315    5003 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w6-d80080-openshift-default-956cddf57-x6xxp"
Oct 31 17:36:52.401712 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:52.401407    5003 patch_prober.go:29] interesting pod/e2e-worker-w6-d80080-openshift-default-956cddf57-x6xxp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" start-of-body=
Oct 31 17:36:52.401712 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:52.401445    5003 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-d80080-openshift-default-956cddf57-x6xxp" podUID="5f2c9613-4b8a-4452-b70a-2ed258063318" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused"
Oct 31 17:36:53.220869 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:53.220840    5003 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-worker-w5-b78c31-86cdfb657c-m4s5d"
Oct 31 17:36:53.404340 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:53.404047    5003 patch_prober.go:29] interesting pod/e2e-worker-w6-d80080-openshift-default-956cddf57-x6xxp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" start-of-body=
Oct 31 17:36:53.404340 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:53.404096    5003 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-d80080-openshift-default-956cddf57-x6xxp" podUID="5f2c9613-4b8a-4452-b70a-2ed258063318" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused"
Oct 31 17:36:54.407347 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:54.407293    5003 patch_prober.go:29] interesting pod/e2e-worker-w6-d80080-openshift-default-956cddf57-x6xxp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" start-of-body=
Oct 31 17:36:54.407901 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:54.407358    5003 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-d80080-openshift-default-956cddf57-x6xxp" podUID="5f2c9613-4b8a-4452-b70a-2ed258063318" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused"
Oct 31 17:36:55.244850 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:55.244816    5003 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-worker-w4-1c0bfd-754b9cb7cf-gpdmq"
Oct 31 17:36:55.404864 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:55.404065    5003 patch_prober.go:29] interesting pod/e2e-worker-w6-d80080-openshift-default-956cddf57-x6xxp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" start-of-body=
Oct 31 17:36:55.404864 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:55.404116    5003 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-d80080-openshift-default-956cddf57-x6xxp" podUID="5f2c9613-4b8a-4452-b70a-2ed258063318" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused"
Oct 31 17:36:56.332037 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:56.332007    5003 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-1c0bfd-84cbc7675-n2bbv"
Oct 31 17:36:56.403190 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:56.402747    5003 patch_prober.go:29] interesting pod/e2e-worker-w6-d80080-openshift-default-956cddf57-x6xxp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" start-of-body=
Oct 31 17:36:56.403190 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:56.402806    5003 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-d80080-openshift-default-956cddf57-x6xxp" podUID="5f2c9613-4b8a-4452-b70a-2ed258063318" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused"
Oct 31 17:36:57.335087 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:57.335049    5003 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w1-0e59ca-6c6556b595-dq7d4"
Oct 31 17:36:57.335710 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:57.335219    5003 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-worker-w2-5c446c-7c8d75cf57-px9mc"
Oct 31 17:36:57.409959 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:57.409920    5003 patch_prober.go:29] interesting pod/e2e-worker-w6-d80080-openshift-default-956cddf57-x6xxp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" start-of-body=
Oct 31 17:36:57.410230 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:57.410193    5003 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-d80080-openshift-default-956cddf57-x6xxp" podUID="5f2c9613-4b8a-4452-b70a-2ed258063318" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused"
Oct 31 17:36:57.447243 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:57.447203    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-b78c31-5f598f895d-wgvlq" event={"ID":"faeea853-aa53-4bb6-9a85-4e55772556b2","Type":"ContainerStarted","Data":"56e0be58563c6e08a8e4f124cd66b2748cb14aa9316f7d29bb3e29a98b74c66d"}
Oct 31 17:36:58.340670 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:58.340621    5003 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-5c446c-748954c4f5-9xwrq"
Oct 31 17:36:58.403674 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:58.401705    5003 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-b78c31-5f598f895d-wgvlq" podStartSLOduration=3.685878552 podStartE2EDuration="8.401607242s" totalImagesPullingTime="4.71572869s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 17:36:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 17:36:57.507123665 +0000 UTC m=+585.761978221" watchObservedRunningTime="2026-10-31 17:36:58.401607242 +0000 UTC m=+586.656461785"
Oct 31 17:36:58.407567 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:58.407539    5003 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w6-d80080-openshift-default-956cddf57-x6xxp"
Oct 31 17:36:58.408172 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:58.408125    5003 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w6-d80080-openshift-default-956cddf57-x6xxp"
Oct 31 17:36:58.409164 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:58.409141    5003 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w6-d80080-openshift-default-956cddf57-x6xxp"
Oct 31 17:36:58.484677 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:36:58.455568    5003 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-b78c31-5f598f895d-wgvlq"
Oct 31 17:37:03.522638 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:37:03.522604    5003 generic.go:356] "Generic (PLEG): container finished" podID="a79988d8-d286-43ae-914b-bd1f6db3eb11" containerID="d4a19531fd76d530d4e154e2e9cba4fa36562053b4577b64fafc78b4f6b5c744" exitCode=0
Oct 31 17:37:03.523190 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:37:03.522688    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-ee816e-openshift-default-c4db85b5c-7pwpp" event={"ID":"a79988d8-d286-43ae-914b-bd1f6db3eb11","Type":"ContainerDied","Data":"d4a19531fd76d530d4e154e2e9cba4fa36562053b4577b64fafc78b4f6b5c744"}
Oct 31 17:37:03.523268 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:37:03.523202    5003 scope.go:122] "RemoveContainer" containerID="d4a19531fd76d530d4e154e2e9cba4fa36562053b4577b64fafc78b4f6b5c744"
Oct 31 17:37:03.524569 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:37:03.524541    5003 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Oct 31 17:37:03.524669 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:37:03.524609    5003 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Oct 31 17:37:03.524719 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:37:03.524678    5003 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Oct 31 17:37:04.139058 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:37:04.138980    5003 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w0-ee816e-openshift-default-c4db85b5c-7pwpp"
Oct 31 17:37:04.495458 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:37:04.495380    5003 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-b78c31-5f598f895d-wgvlq"
Oct 31 17:37:04.532975 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:37:04.532932    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-ee816e-openshift-default-c4db85b5c-7pwpp" event={"ID":"a79988d8-d286-43ae-914b-bd1f6db3eb11","Type":"ContainerStarted","Data":"b70f11a8fea21a6df296adcd388ee127839103162a8061281174277142cd35b8"}
Oct 31 17:37:04.681780 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:37:04.681729    5003 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w0-ee816e-openshift-default-c4db85b5c-7pwpp"
Oct 31 17:37:04.683111 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:37:04.683081    5003 patch_prober.go:29] interesting pod/e2e-worker-w0-ee816e-openshift-default-c4db85b5c-7pwpp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" start-of-body=
Oct 31 17:37:04.683239 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:37:04.683147    5003 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-ee816e-openshift-default-c4db85b5c-7pwpp" podUID="a79988d8-d286-43ae-914b-bd1f6db3eb11" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused"
Oct 31 17:37:05.682765 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:37:05.682727    5003 patch_prober.go:29] interesting pod/e2e-worker-w0-ee816e-openshift-default-c4db85b5c-7pwpp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" start-of-body=
Oct 31 17:37:05.683238 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:37:05.682788    5003 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-ee816e-openshift-default-c4db85b5c-7pwpp" podUID="a79988d8-d286-43ae-914b-bd1f6db3eb11" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused"
Oct 31 17:37:06.682295 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:37:06.682265    5003 patch_prober.go:29] interesting pod/e2e-worker-w0-ee816e-openshift-default-c4db85b5c-7pwpp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" start-of-body=
Oct 31 17:37:06.682480 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:37:06.682317    5003 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-ee816e-openshift-default-c4db85b5c-7pwpp" podUID="a79988d8-d286-43ae-914b-bd1f6db3eb11" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused"
Oct 31 17:37:07.682036 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:37:07.681961    5003 patch_prober.go:29] interesting pod/e2e-worker-w0-ee816e-openshift-default-c4db85b5c-7pwpp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" start-of-body=
Oct 31 17:37:07.682558 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:37:07.682049    5003 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-ee816e-openshift-default-c4db85b5c-7pwpp" podUID="a79988d8-d286-43ae-914b-bd1f6db3eb11" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused"
Oct 31 17:37:08.587555 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:37:08.587516    5003 generic.go:356] "Generic (PLEG): container finished" podID="4482b94f-d7f9-4575-b22e-765dfd4ad693" containerID="aceeb7197d496482a276549fd86c94a288836d57009bb94a2513cd606ffd8419" exitCode=0
Oct 31 17:37:08.587890 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:37:08.587593    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-b78c31-openshift-default-774cb4f6c9-p7lp5" event={"ID":"4482b94f-d7f9-4575-b22e-765dfd4ad693","Type":"ContainerDied","Data":"aceeb7197d496482a276549fd86c94a288836d57009bb94a2513cd606ffd8419"}
Oct 31 17:37:08.588114 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:37:08.588097    5003 scope.go:122] "RemoveContainer" containerID="aceeb7197d496482a276549fd86c94a288836d57009bb94a2513cd606ffd8419"
Oct 31 17:37:08.589689 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:37:08.589658    5003 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Oct 31 17:37:08.589774 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:37:08.589742    5003 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Oct 31 17:37:08.589810 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:37:08.589785    5003 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Oct 31 17:37:08.684224 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:37:08.684133    5003 patch_prober.go:29] interesting pod/e2e-worker-w0-ee816e-openshift-default-c4db85b5c-7pwpp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" start-of-body=
Oct 31 17:37:08.684224 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:37:08.684196    5003 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-ee816e-openshift-default-c4db85b5c-7pwpp" podUID="a79988d8-d286-43ae-914b-bd1f6db3eb11" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused"
Oct 31 17:37:09.608668 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:37:09.608104    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-b78c31-openshift-default-774cb4f6c9-p7lp5" event={"ID":"4482b94f-d7f9-4575-b22e-765dfd4ad693","Type":"ContainerStarted","Data":"20685a362fdc25a06eac9a749dd142b9951c288dd4f246a73b3820116c4602c2"}
Oct 31 17:37:09.700671 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:37:09.690429    5003 patch_prober.go:29] interesting pod/e2e-worker-w0-ee816e-openshift-default-c4db85b5c-7pwpp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" start-of-body=
Oct 31 17:37:09.700671 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:37:09.690489    5003 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-ee816e-openshift-default-c4db85b5c-7pwpp" podUID="a79988d8-d286-43ae-914b-bd1f6db3eb11" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused"
Oct 31 17:37:10.094181 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:37:10.094143    5003 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w1-0e59ca/simulator-w1-0e59ca-kserve-999765679-zs7kh"]
Oct 31 17:37:10.098376 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:37:10.098321    5003 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w1-0e59ca/simulator-w1-0e59ca-kserve-999765679-zs7kh"
Oct 31 17:37:10.120154 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:37:10.113828    5003 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w1-0e59ca\"/\"openshift-service-ca.crt\""
Oct 31 17:37:10.120154 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:37:10.114555    5003 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w1-0e59ca\"/\"default-dockercfg-pwznp\""
Oct 31 17:37:10.125731 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:37:10.125180    5003 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w1-0e59ca/simulator-w1-0e59ca-kserve-999765679-zs7kh"]
Oct 31 17:37:10.125731 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:37:10.125706    5003 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w1-0e59ca\"/\"kube-root-ca.crt\""
Oct 31 17:37:10.125959 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:37:10.125773    5003 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w1-0e59ca\"/\"simulator-w1-0e59ca-kserve-self-signed-certs\""
Oct 31 17:37:10.126761 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:37:10.126448    5003 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w5-b78c31-openshift-default-774cb4f6c9-p7lp5"
Oct 31 17:37:10.126761 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:37:10.126714    5003 patch_prober.go:29] interesting pod/e2e-worker-w5-b78c31-openshift-default-774cb4f6c9-p7lp5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" start-of-body=
Oct 31 17:37:10.127017 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:37:10.126795    5003 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-b78c31-openshift-default-774cb4f6c9-p7lp5" podUID="4482b94f-d7f9-4575-b22e-765dfd4ad693" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused"
Oct 31 17:37:10.199233 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:37:10.199201    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f5ltq\" (UniqueName: \"kubernetes.io/projected/018d423e-6866-4b61-a4a2-d2e786d82bf0-kube-api-access-f5ltq\") pod \"simulator-w1-0e59ca-kserve-999765679-zs7kh\" (UID: \"018d423e-6866-4b61-a4a2-d2e786d82bf0\") " pod="e2e-models-e2e-worker-w1-0e59ca/simulator-w1-0e59ca-kserve-999765679-zs7kh"
Oct 31 17:37:10.199400 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:37:10.199249    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/018d423e-6866-4b61-a4a2-d2e786d82bf0-model-cache\") pod \"simulator-w1-0e59ca-kserve-999765679-zs7kh\" (UID: \"018d423e-6866-4b61-a4a2-d2e786d82bf0\") " pod="e2e-models-e2e-worker-w1-0e59ca/simulator-w1-0e59ca-kserve-999765679-zs7kh"
Oct 31 17:37:10.199451 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:37:10.199389    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/018d423e-6866-4b61-a4a2-d2e786d82bf0-home\") pod \"simulator-w1-0e59ca-kserve-999765679-zs7kh\" (UID: \"018d423e-6866-4b61-a4a2-d2e786d82bf0\") " pod="e2e-models-e2e-worker-w1-0e59ca/simulator-w1-0e59ca-kserve-999765679-zs7kh"
Oct 31 17:37:10.199486 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:37:10.199450    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/018d423e-6866-4b61-a4a2-d2e786d82bf0-dshm\") pod \"simulator-w1-0e59ca-kserve-999765679-zs7kh\" (UID: \"018d423e-6866-4b61-a4a2-d2e786d82bf0\") " pod="e2e-models-e2e-worker-w1-0e59ca/simulator-w1-0e59ca-kserve-999765679-zs7kh"
Oct 31 17:37:10.199524 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:37:10.199485    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/018d423e-6866-4b61-a4a2-d2e786d82bf0-tls-certs\") pod \"simulator-w1-0e59ca-kserve-999765679-zs7kh\" (UID: \"018d423e-6866-4b61-a4a2-d2e786d82bf0\") " pod="e2e-models-e2e-worker-w1-0e59ca/simulator-w1-0e59ca-kserve-999765679-zs7kh"
Oct 31 17:37:10.199563 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:37:10.199520    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/018d423e-6866-4b61-a4a2-d2e786d82bf0-tmp-dir\") pod \"simulator-w1-0e59ca-kserve-999765679-zs7kh\" (UID: \"018d423e-6866-4b61-a4a2-d2e786d82bf0\") " pod="e2e-models-e2e-worker-w1-0e59ca/simulator-w1-0e59ca-kserve-999765679-zs7kh"
Oct 31 17:37:10.300596 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:37:10.300557    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/018d423e-6866-4b61-a4a2-d2e786d82bf0-tls-certs\") pod \"simulator-w1-0e59ca-kserve-999765679-zs7kh\" (UID: \"018d423e-6866-4b61-a4a2-d2e786d82bf0\") " pod="e2e-models-e2e-worker-w1-0e59ca/simulator-w1-0e59ca-kserve-999765679-zs7kh"
Oct 31 17:37:10.300827 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:37:10.300604    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/018d423e-6866-4b61-a4a2-d2e786d82bf0-tmp-dir\") pod \"simulator-w1-0e59ca-kserve-999765679-zs7kh\" (UID: \"018d423e-6866-4b61-a4a2-d2e786d82bf0\") " pod="e2e-models-e2e-worker-w1-0e59ca/simulator-w1-0e59ca-kserve-999765679-zs7kh"
Oct 31 17:37:10.300827 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:37:10.300752    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f5ltq\" (UniqueName: \"kubernetes.io/projected/018d423e-6866-4b61-a4a2-d2e786d82bf0-kube-api-access-f5ltq\") pod \"simulator-w1-0e59ca-kserve-999765679-zs7kh\" (UID: \"018d423e-6866-4b61-a4a2-d2e786d82bf0\") " pod="e2e-models-e2e-worker-w1-0e59ca/simulator-w1-0e59ca-kserve-999765679-zs7kh"
Oct 31 17:37:10.300827 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:37:10.300791    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/018d423e-6866-4b61-a4a2-d2e786d82bf0-model-cache\") pod \"simulator-w1-0e59ca-kserve-999765679-zs7kh\" (UID: \"018d423e-6866-4b61-a4a2-d2e786d82bf0\") " pod="e2e-models-e2e-worker-w1-0e59ca/simulator-w1-0e59ca-kserve-999765679-zs7kh"
Oct 31 17:37:10.301008 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:37:10.300860    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/018d423e-6866-4b61-a4a2-d2e786d82bf0-home\") pod \"simulator-w1-0e59ca-kserve-999765679-zs7kh\" (UID: \"018d423e-6866-4b61-a4a2-d2e786d82bf0\") " pod="e2e-models-e2e-worker-w1-0e59ca/simulator-w1-0e59ca-kserve-999765679-zs7kh"
Oct 31 17:37:10.301008 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:37:10.300911    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/018d423e-6866-4b61-a4a2-d2e786d82bf0-dshm\") pod \"simulator-w1-0e59ca-kserve-999765679-zs7kh\" (UID: \"018d423e-6866-4b61-a4a2-d2e786d82bf0\") " pod="e2e-models-e2e-worker-w1-0e59ca/simulator-w1-0e59ca-kserve-999765679-zs7kh"
Oct 31 17:37:10.301442 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:37:10.301168    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/018d423e-6866-4b61-a4a2-d2e786d82bf0-tmp-dir\") pod \"simulator-w1-0e59ca-kserve-999765679-zs7kh\" (UID: \"018d423e-6866-4b61-a4a2-d2e786d82bf0\") " pod="e2e-models-e2e-worker-w1-0e59ca/simulator-w1-0e59ca-kserve-999765679-zs7kh"
Oct 31 17:37:10.301442 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:37:10.301221    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/018d423e-6866-4b61-a4a2-d2e786d82bf0-home\") pod \"simulator-w1-0e59ca-kserve-999765679-zs7kh\" (UID: \"018d423e-6866-4b61-a4a2-d2e786d82bf0\") " pod="e2e-models-e2e-worker-w1-0e59ca/simulator-w1-0e59ca-kserve-999765679-zs7kh"
Oct 31 17:37:10.301442 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:37:10.301320    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/018d423e-6866-4b61-a4a2-d2e786d82bf0-model-cache\") pod \"simulator-w1-0e59ca-kserve-999765679-zs7kh\" (UID: \"018d423e-6866-4b61-a4a2-d2e786d82bf0\") " pod="e2e-models-e2e-worker-w1-0e59ca/simulator-w1-0e59ca-kserve-999765679-zs7kh"
Oct 31 17:37:10.303179 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:37:10.303154    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/018d423e-6866-4b61-a4a2-d2e786d82bf0-dshm\") pod \"simulator-w1-0e59ca-kserve-999765679-zs7kh\" (UID: \"018d423e-6866-4b61-a4a2-d2e786d82bf0\") " pod="e2e-models-e2e-worker-w1-0e59ca/simulator-w1-0e59ca-kserve-999765679-zs7kh"
Oct 31 17:37:10.303456 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:37:10.303441    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/018d423e-6866-4b61-a4a2-d2e786d82bf0-tls-certs\") pod \"simulator-w1-0e59ca-kserve-999765679-zs7kh\" (UID: \"018d423e-6866-4b61-a4a2-d2e786d82bf0\") " pod="e2e-models-e2e-worker-w1-0e59ca/simulator-w1-0e59ca-kserve-999765679-zs7kh"
Oct 31 17:37:10.321674 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:37:10.321580    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f5ltq\" (UniqueName: \"kubernetes.io/projected/018d423e-6866-4b61-a4a2-d2e786d82bf0-kube-api-access-f5ltq\") pod \"simulator-w1-0e59ca-kserve-999765679-zs7kh\" (UID: \"018d423e-6866-4b61-a4a2-d2e786d82bf0\") " pod="e2e-models-e2e-worker-w1-0e59ca/simulator-w1-0e59ca-kserve-999765679-zs7kh"
Oct 31 17:37:10.383719 ip-10-0-138-17 kubenswrapper[5003]: E1031 17:37:10.383413    5003 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-tdzz5" containerName="extractor"
Oct 31 17:37:10.432000 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:37:10.431961    5003 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w1-0e59ca/simulator-w1-0e59ca-kserve-999765679-zs7kh"
Oct 31 17:37:10.686631 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:37:10.686558    5003 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w0-ee816e-openshift-default-c4db85b5c-7pwpp"
Oct 31 17:37:10.687006 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:37:10.686989    5003 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w0-ee816e-openshift-default-c4db85b5c-7pwpp"
Oct 31 17:37:10.687858 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:37:10.687840    5003 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w0-ee816e-openshift-default-c4db85b5c-7pwpp"
Oct 31 17:37:10.782715 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:37:10.782684    5003 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w1-0e59ca/simulator-w1-0e59ca-kserve-999765679-zs7kh"]
Oct 31 17:37:10.785635 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:37:10.785584    5003 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod018d423e_6866_4b61_a4a2_d2e786d82bf0.slice/crio-da4391c3290a04ca000b8f7df40995d6dc2f8d17ba558ed89eefdbc828923c6a WatchSource:0}: Error finding container da4391c3290a04ca000b8f7df40995d6dc2f8d17ba558ed89eefdbc828923c6a: Status 404 returned error can't find the container with id da4391c3290a04ca000b8f7df40995d6dc2f8d17ba558ed89eefdbc828923c6a
Oct 31 17:37:11.127508 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:37:11.127472    5003 patch_prober.go:29] interesting pod/e2e-worker-w5-b78c31-openshift-default-774cb4f6c9-p7lp5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" start-of-body=
Oct 31 17:37:11.127724 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:37:11.127528    5003 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-b78c31-openshift-default-774cb4f6c9-p7lp5" podUID="4482b94f-d7f9-4575-b22e-765dfd4ad693" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused"
Oct 31 17:37:11.628396 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:37:11.628354    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w1-0e59ca/simulator-w1-0e59ca-kserve-999765679-zs7kh" event={"ID":"018d423e-6866-4b61-a4a2-d2e786d82bf0","Type":"ContainerStarted","Data":"0db39d22eaf34ae4fd5851858abf89cc8562ec7f0ccc3e2557a58800be6db318"}
Oct 31 17:37:11.628396 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:37:11.628400    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w1-0e59ca/simulator-w1-0e59ca-kserve-999765679-zs7kh" event={"ID":"018d423e-6866-4b61-a4a2-d2e786d82bf0","Type":"ContainerStarted","Data":"da4391c3290a04ca000b8f7df40995d6dc2f8d17ba558ed89eefdbc828923c6a"}
Oct 31 17:37:11.677669 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:37:11.677565    5003 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w1-0e59ca/simulator-w1-0e59ca-kserve-999765679-zs7kh" podStartSLOduration=1.67754453 podStartE2EDuration="1.67754453s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 17:37:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 17:37:11.674098893 +0000 UTC m=+599.928953435" watchObservedRunningTime="2026-10-31 17:37:11.67754453 +0000 UTC m=+599.932399075"
Oct 31 17:37:12.004618 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:37:12.004543    5003 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-b2xxw_f03611db-3bd9-401a-a137-1d4f691b51ea/console-operator/2.log"
Oct 31 17:37:12.009611 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:37:12.009587    5003 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-b2xxw_f03611db-3bd9-401a-a137-1d4f691b51ea/console-operator/2.log"
Oct 31 17:37:12.127468 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:37:12.127428    5003 patch_prober.go:29] interesting pod/e2e-worker-w5-b78c31-openshift-default-774cb4f6c9-p7lp5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" start-of-body=
Oct 31 17:37:12.127678 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:37:12.127489    5003 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-b78c31-openshift-default-774cb4f6c9-p7lp5" podUID="4482b94f-d7f9-4575-b22e-765dfd4ad693" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused"
Oct 31 17:37:12.433077 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:37:12.433036    5003 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w1-0e59ca/simulator-w1-0e59ca-kserve-999765679-zs7kh"
Oct 31 17:37:13.126558 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:37:13.126526    5003 patch_prober.go:29] interesting pod/e2e-worker-w5-b78c31-openshift-default-774cb4f6c9-p7lp5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" start-of-body=
Oct 31 17:37:13.126967 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:37:13.126586    5003 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-b78c31-openshift-default-774cb4f6c9-p7lp5" podUID="4482b94f-d7f9-4575-b22e-765dfd4ad693" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused"
Oct 31 17:37:14.127423 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:37:14.127387    5003 patch_prober.go:29] interesting pod/e2e-worker-w5-b78c31-openshift-default-774cb4f6c9-p7lp5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" start-of-body=
Oct 31 17:37:14.127847 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:37:14.127442    5003 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-b78c31-openshift-default-774cb4f6c9-p7lp5" podUID="4482b94f-d7f9-4575-b22e-765dfd4ad693" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused"
Oct 31 17:37:15.141014 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:37:15.140972    5003 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w5-b78c31-openshift-default-774cb4f6c9-p7lp5"
Oct 31 17:37:15.141717 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:37:15.141683    5003 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w5-b78c31-openshift-default-774cb4f6c9-p7lp5"
Oct 31 17:37:15.142340 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:37:15.142321    5003 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w5-b78c31-openshift-default-774cb4f6c9-p7lp5"
Oct 31 17:37:16.186670 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:37:16.184530    5003 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w0-ee816e/simulator-w0-ee816e-kserve-5bd4657dc-9rlm4"]
Oct 31 17:37:16.230507 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:37:16.230383    5003 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-ee816e/simulator-w0-ee816e-kserve-5bd4657dc-9rlm4"
Oct 31 17:37:16.230880 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:37:16.230814    5003 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-ee816e/simulator-w0-ee816e-kserve-5bd4657dc-9rlm4"]
Oct 31 17:37:16.249593 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:37:16.249566    5003 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w0-ee816e\"/\"default-dockercfg-7pq72\""
Oct 31 17:37:16.249773 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:37:16.249668    5003 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w0-ee816e\"/\"openshift-service-ca.crt\""
Oct 31 17:37:16.249773 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:37:16.249759    5003 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w0-ee816e\"/\"kube-root-ca.crt\""
Oct 31 17:37:16.260983 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:37:16.260957    5003 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w0-ee816e\"/\"simulator-w0-ee816e-kserve-self-signed-certs\""
Oct 31 17:37:16.375860 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:37:16.375822    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/620f499f-36d7-4900-abbe-98ee5cf5d96c-tls-certs\") pod \"simulator-w0-ee816e-kserve-5bd4657dc-9rlm4\" (UID: \"620f499f-36d7-4900-abbe-98ee5cf5d96c\") " pod="e2e-models-e2e-worker-w0-ee816e/simulator-w0-ee816e-kserve-5bd4657dc-9rlm4"
Oct 31 17:37:16.376052 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:37:16.375884    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/620f499f-36d7-4900-abbe-98ee5cf5d96c-model-cache\") pod \"simulator-w0-ee816e-kserve-5bd4657dc-9rlm4\" (UID: \"620f499f-36d7-4900-abbe-98ee5cf5d96c\") " pod="e2e-models-e2e-worker-w0-ee816e/simulator-w0-ee816e-kserve-5bd4657dc-9rlm4"
Oct 31 17:37:16.376052 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:37:16.375990    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/620f499f-36d7-4900-abbe-98ee5cf5d96c-dshm\") pod \"simulator-w0-ee816e-kserve-5bd4657dc-9rlm4\" (UID: \"620f499f-36d7-4900-abbe-98ee5cf5d96c\") " pod="e2e-models-e2e-worker-w0-ee816e/simulator-w0-ee816e-kserve-5bd4657dc-9rlm4"
Oct 31 17:37:16.376148 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:37:16.376103    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/620f499f-36d7-4900-abbe-98ee5cf5d96c-tmp-dir\") pod \"simulator-w0-ee816e-kserve-5bd4657dc-9rlm4\" (UID: \"620f499f-36d7-4900-abbe-98ee5cf5d96c\") " pod="e2e-models-e2e-worker-w0-ee816e/simulator-w0-ee816e-kserve-5bd4657dc-9rlm4"
Oct 31 17:37:16.376218 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:37:16.376152    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7bt8x\" (UniqueName: \"kubernetes.io/projected/620f499f-36d7-4900-abbe-98ee5cf5d96c-kube-api-access-7bt8x\") pod \"simulator-w0-ee816e-kserve-5bd4657dc-9rlm4\" (UID: \"620f499f-36d7-4900-abbe-98ee5cf5d96c\") " pod="e2e-models-e2e-worker-w0-ee816e/simulator-w0-ee816e-kserve-5bd4657dc-9rlm4"
Oct 31 17:37:16.376218 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:37:16.376209    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/620f499f-36d7-4900-abbe-98ee5cf5d96c-home\") pod \"simulator-w0-ee816e-kserve-5bd4657dc-9rlm4\" (UID: \"620f499f-36d7-4900-abbe-98ee5cf5d96c\") " pod="e2e-models-e2e-worker-w0-ee816e/simulator-w0-ee816e-kserve-5bd4657dc-9rlm4"
Oct 31 17:37:16.477446 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:37:16.477345    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/620f499f-36d7-4900-abbe-98ee5cf5d96c-tmp-dir\") pod \"simulator-w0-ee816e-kserve-5bd4657dc-9rlm4\" (UID: \"620f499f-36d7-4900-abbe-98ee5cf5d96c\") " pod="e2e-models-e2e-worker-w0-ee816e/simulator-w0-ee816e-kserve-5bd4657dc-9rlm4"
Oct 31 17:37:16.477446 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:37:16.477393    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7bt8x\" (UniqueName: \"kubernetes.io/projected/620f499f-36d7-4900-abbe-98ee5cf5d96c-kube-api-access-7bt8x\") pod \"simulator-w0-ee816e-kserve-5bd4657dc-9rlm4\" (UID: \"620f499f-36d7-4900-abbe-98ee5cf5d96c\") " pod="e2e-models-e2e-worker-w0-ee816e/simulator-w0-ee816e-kserve-5bd4657dc-9rlm4"
Oct 31 17:37:16.477446 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:37:16.477426    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/620f499f-36d7-4900-abbe-98ee5cf5d96c-home\") pod \"simulator-w0-ee816e-kserve-5bd4657dc-9rlm4\" (UID: \"620f499f-36d7-4900-abbe-98ee5cf5d96c\") " pod="e2e-models-e2e-worker-w0-ee816e/simulator-w0-ee816e-kserve-5bd4657dc-9rlm4"
Oct 31 17:37:16.477774 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:37:16.477504    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/620f499f-36d7-4900-abbe-98ee5cf5d96c-tls-certs\") pod \"simulator-w0-ee816e-kserve-5bd4657dc-9rlm4\" (UID: \"620f499f-36d7-4900-abbe-98ee5cf5d96c\") " pod="e2e-models-e2e-worker-w0-ee816e/simulator-w0-ee816e-kserve-5bd4657dc-9rlm4"
Oct 31 17:37:16.477774 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:37:16.477557    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/620f499f-36d7-4900-abbe-98ee5cf5d96c-model-cache\") pod \"simulator-w0-ee816e-kserve-5bd4657dc-9rlm4\" (UID: \"620f499f-36d7-4900-abbe-98ee5cf5d96c\") " pod="e2e-models-e2e-worker-w0-ee816e/simulator-w0-ee816e-kserve-5bd4657dc-9rlm4"
Oct 31 17:37:16.477774 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:37:16.477587    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/620f499f-36d7-4900-abbe-98ee5cf5d96c-dshm\") pod \"simulator-w0-ee816e-kserve-5bd4657dc-9rlm4\" (UID: \"620f499f-36d7-4900-abbe-98ee5cf5d96c\") " pod="e2e-models-e2e-worker-w0-ee816e/simulator-w0-ee816e-kserve-5bd4657dc-9rlm4"
Oct 31 17:37:16.477935 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:37:16.477873    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/620f499f-36d7-4900-abbe-98ee5cf5d96c-tmp-dir\") pod \"simulator-w0-ee816e-kserve-5bd4657dc-9rlm4\" (UID: \"620f499f-36d7-4900-abbe-98ee5cf5d96c\") " pod="e2e-models-e2e-worker-w0-ee816e/simulator-w0-ee816e-kserve-5bd4657dc-9rlm4"
Oct 31 17:37:16.477935 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:37:16.477913    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/620f499f-36d7-4900-abbe-98ee5cf5d96c-home\") pod \"simulator-w0-ee816e-kserve-5bd4657dc-9rlm4\" (UID: \"620f499f-36d7-4900-abbe-98ee5cf5d96c\") " pod="e2e-models-e2e-worker-w0-ee816e/simulator-w0-ee816e-kserve-5bd4657dc-9rlm4"
Oct 31 17:37:16.478048 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:37:16.477973    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/620f499f-36d7-4900-abbe-98ee5cf5d96c-model-cache\") pod \"simulator-w0-ee816e-kserve-5bd4657dc-9rlm4\" (UID: \"620f499f-36d7-4900-abbe-98ee5cf5d96c\") " pod="e2e-models-e2e-worker-w0-ee816e/simulator-w0-ee816e-kserve-5bd4657dc-9rlm4"
Oct 31 17:37:16.480006 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:37:16.479982    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/620f499f-36d7-4900-abbe-98ee5cf5d96c-dshm\") pod \"simulator-w0-ee816e-kserve-5bd4657dc-9rlm4\" (UID: \"620f499f-36d7-4900-abbe-98ee5cf5d96c\") " pod="e2e-models-e2e-worker-w0-ee816e/simulator-w0-ee816e-kserve-5bd4657dc-9rlm4"
Oct 31 17:37:16.480300 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:37:16.480281    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/620f499f-36d7-4900-abbe-98ee5cf5d96c-tls-certs\") pod \"simulator-w0-ee816e-kserve-5bd4657dc-9rlm4\" (UID: \"620f499f-36d7-4900-abbe-98ee5cf5d96c\") " pod="e2e-models-e2e-worker-w0-ee816e/simulator-w0-ee816e-kserve-5bd4657dc-9rlm4"
Oct 31 17:37:16.503052 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:37:16.503016    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7bt8x\" (UniqueName: \"kubernetes.io/projected/620f499f-36d7-4900-abbe-98ee5cf5d96c-kube-api-access-7bt8x\") pod \"simulator-w0-ee816e-kserve-5bd4657dc-9rlm4\" (UID: \"620f499f-36d7-4900-abbe-98ee5cf5d96c\") " pod="e2e-models-e2e-worker-w0-ee816e/simulator-w0-ee816e-kserve-5bd4657dc-9rlm4"
Oct 31 17:37:16.545345 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:37:16.545303    5003 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-ee816e/simulator-w0-ee816e-kserve-5bd4657dc-9rlm4"
Oct 31 17:37:16.848903 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:37:16.848868    5003 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-ee816e/simulator-w0-ee816e-kserve-5bd4657dc-9rlm4"]
Oct 31 17:37:16.852250 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:37:16.852223    5003 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod620f499f_36d7_4900_abbe_98ee5cf5d96c.slice/crio-eff87f0e3c3f2ab730c626467ac911679272e8aa7e46374cd1a608cbe1e44120 WatchSource:0}: Error finding container eff87f0e3c3f2ab730c626467ac911679272e8aa7e46374cd1a608cbe1e44120: Status 404 returned error can't find the container with id eff87f0e3c3f2ab730c626467ac911679272e8aa7e46374cd1a608cbe1e44120
Oct 31 17:37:17.669536 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:37:17.669495    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-ee816e/simulator-w0-ee816e-kserve-5bd4657dc-9rlm4" event={"ID":"620f499f-36d7-4900-abbe-98ee5cf5d96c","Type":"ContainerStarted","Data":"1a17a8851924632e8cf69c5a657cbcf25016d6fa290fd85247d9e29cca4170fa"}
Oct 31 17:37:17.669536 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:37:17.669542    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-ee816e/simulator-w0-ee816e-kserve-5bd4657dc-9rlm4" event={"ID":"620f499f-36d7-4900-abbe-98ee5cf5d96c","Type":"ContainerStarted","Data":"eff87f0e3c3f2ab730c626467ac911679272e8aa7e46374cd1a608cbe1e44120"}
Oct 31 17:37:17.706692 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:37:17.706608    5003 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w0-ee816e/simulator-w0-ee816e-kserve-5bd4657dc-9rlm4" podStartSLOduration=1.70659557 podStartE2EDuration="1.70659557s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 17:37:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 17:37:17.706249312 +0000 UTC m=+605.961103857" watchObservedRunningTime="2026-10-31 17:37:17.70659557 +0000 UTC m=+605.961450111"
Oct 31 17:37:18.545436 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:37:18.545403    5003 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w0-ee816e/simulator-w0-ee816e-kserve-5bd4657dc-9rlm4"
Oct 31 17:37:20.433105 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:37:20.433069    5003 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w1-0e59ca/simulator-w1-0e59ca-kserve-999765679-zs7kh"
Oct 31 17:37:20.445513 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:37:20.445487    5003 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w1-0e59ca/simulator-w1-0e59ca-kserve-999765679-zs7kh"
Oct 31 17:37:20.700047 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:37:20.699975    5003 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w1-0e59ca/simulator-w1-0e59ca-kserve-999765679-zs7kh"
Oct 31 17:37:25.671036 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:37:25.670995    5003 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w5-b78c31/simulator-w5-b78c31-kserve-95df74778-fpvpr"]
Oct 31 17:37:25.675460 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:37:25.675433    5003 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w5-b78c31/simulator-w5-b78c31-kserve-95df74778-fpvpr"
Oct 31 17:37:25.703077 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:37:25.703046    5003 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w5-b78c31\"/\"openshift-service-ca.crt\""
Oct 31 17:37:25.703317 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:37:25.703304    5003 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w5-b78c31\"/\"kube-root-ca.crt\""
Oct 31 17:37:25.703532 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:37:25.703495    5003 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w5-b78c31\"/\"default-dockercfg-9mrcp\""
Oct 31 17:37:25.704001 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:37:25.703964    5003 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w5-b78c31\"/\"simulator-w5-b78c31-kserve-self-signed-certs\""
Oct 31 17:37:25.708149 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:37:25.708120    5003 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w5-b78c31/simulator-w5-b78c31-kserve-95df74778-fpvpr"]
Oct 31 17:37:25.778769 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:37:25.778731    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nff5q\" (UniqueName: \"kubernetes.io/projected/665d75c7-8ba5-49e1-87a7-51a18ae6f369-kube-api-access-nff5q\") pod \"simulator-w5-b78c31-kserve-95df74778-fpvpr\" (UID: \"665d75c7-8ba5-49e1-87a7-51a18ae6f369\") " pod="e2e-models-e2e-worker-w5-b78c31/simulator-w5-b78c31-kserve-95df74778-fpvpr"
Oct 31 17:37:25.778931 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:37:25.778806    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/665d75c7-8ba5-49e1-87a7-51a18ae6f369-home\") pod \"simulator-w5-b78c31-kserve-95df74778-fpvpr\" (UID: \"665d75c7-8ba5-49e1-87a7-51a18ae6f369\") " pod="e2e-models-e2e-worker-w5-b78c31/simulator-w5-b78c31-kserve-95df74778-fpvpr"
Oct 31 17:37:25.778931 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:37:25.778847    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/665d75c7-8ba5-49e1-87a7-51a18ae6f369-tmp-dir\") pod \"simulator-w5-b78c31-kserve-95df74778-fpvpr\" (UID: \"665d75c7-8ba5-49e1-87a7-51a18ae6f369\") " pod="e2e-models-e2e-worker-w5-b78c31/simulator-w5-b78c31-kserve-95df74778-fpvpr"
Oct 31 17:37:25.778931 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:37:25.778886    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/665d75c7-8ba5-49e1-87a7-51a18ae6f369-dshm\") pod \"simulator-w5-b78c31-kserve-95df74778-fpvpr\" (UID: \"665d75c7-8ba5-49e1-87a7-51a18ae6f369\") " pod="e2e-models-e2e-worker-w5-b78c31/simulator-w5-b78c31-kserve-95df74778-fpvpr"
Oct 31 17:37:25.779066 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:37:25.779026    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/665d75c7-8ba5-49e1-87a7-51a18ae6f369-tls-certs\") pod \"simulator-w5-b78c31-kserve-95df74778-fpvpr\" (UID: \"665d75c7-8ba5-49e1-87a7-51a18ae6f369\") " pod="e2e-models-e2e-worker-w5-b78c31/simulator-w5-b78c31-kserve-95df74778-fpvpr"
Oct 31 17:37:25.779109 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:37:25.779077    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/665d75c7-8ba5-49e1-87a7-51a18ae6f369-model-cache\") pod \"simulator-w5-b78c31-kserve-95df74778-fpvpr\" (UID: \"665d75c7-8ba5-49e1-87a7-51a18ae6f369\") " pod="e2e-models-e2e-worker-w5-b78c31/simulator-w5-b78c31-kserve-95df74778-fpvpr"
Oct 31 17:37:25.880693 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:37:25.880232    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/665d75c7-8ba5-49e1-87a7-51a18ae6f369-home\") pod \"simulator-w5-b78c31-kserve-95df74778-fpvpr\" (UID: \"665d75c7-8ba5-49e1-87a7-51a18ae6f369\") " pod="e2e-models-e2e-worker-w5-b78c31/simulator-w5-b78c31-kserve-95df74778-fpvpr"
Oct 31 17:37:25.880693 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:37:25.880307    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/665d75c7-8ba5-49e1-87a7-51a18ae6f369-tmp-dir\") pod \"simulator-w5-b78c31-kserve-95df74778-fpvpr\" (UID: \"665d75c7-8ba5-49e1-87a7-51a18ae6f369\") " pod="e2e-models-e2e-worker-w5-b78c31/simulator-w5-b78c31-kserve-95df74778-fpvpr"
Oct 31 17:37:25.880693 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:37:25.880358    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/665d75c7-8ba5-49e1-87a7-51a18ae6f369-dshm\") pod \"simulator-w5-b78c31-kserve-95df74778-fpvpr\" (UID: \"665d75c7-8ba5-49e1-87a7-51a18ae6f369\") " pod="e2e-models-e2e-worker-w5-b78c31/simulator-w5-b78c31-kserve-95df74778-fpvpr"
Oct 31 17:37:25.880693 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:37:25.880431    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/665d75c7-8ba5-49e1-87a7-51a18ae6f369-tls-certs\") pod \"simulator-w5-b78c31-kserve-95df74778-fpvpr\" (UID: \"665d75c7-8ba5-49e1-87a7-51a18ae6f369\") " pod="e2e-models-e2e-worker-w5-b78c31/simulator-w5-b78c31-kserve-95df74778-fpvpr"
Oct 31 17:37:25.880693 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:37:25.880472    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/665d75c7-8ba5-49e1-87a7-51a18ae6f369-model-cache\") pod \"simulator-w5-b78c31-kserve-95df74778-fpvpr\" (UID: \"665d75c7-8ba5-49e1-87a7-51a18ae6f369\") " pod="e2e-models-e2e-worker-w5-b78c31/simulator-w5-b78c31-kserve-95df74778-fpvpr"
Oct 31 17:37:25.880693 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:37:25.880542    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nff5q\" (UniqueName: \"kubernetes.io/projected/665d75c7-8ba5-49e1-87a7-51a18ae6f369-kube-api-access-nff5q\") pod \"simulator-w5-b78c31-kserve-95df74778-fpvpr\" (UID: \"665d75c7-8ba5-49e1-87a7-51a18ae6f369\") " pod="e2e-models-e2e-worker-w5-b78c31/simulator-w5-b78c31-kserve-95df74778-fpvpr"
Oct 31 17:37:25.904663 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:37:25.881314    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/665d75c7-8ba5-49e1-87a7-51a18ae6f369-home\") pod \"simulator-w5-b78c31-kserve-95df74778-fpvpr\" (UID: \"665d75c7-8ba5-49e1-87a7-51a18ae6f369\") " pod="e2e-models-e2e-worker-w5-b78c31/simulator-w5-b78c31-kserve-95df74778-fpvpr"
Oct 31 17:37:25.904663 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:37:25.881571    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/665d75c7-8ba5-49e1-87a7-51a18ae6f369-tmp-dir\") pod \"simulator-w5-b78c31-kserve-95df74778-fpvpr\" (UID: \"665d75c7-8ba5-49e1-87a7-51a18ae6f369\") " pod="e2e-models-e2e-worker-w5-b78c31/simulator-w5-b78c31-kserve-95df74778-fpvpr"
Oct 31 17:37:25.904663 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:37:25.895365    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/665d75c7-8ba5-49e1-87a7-51a18ae6f369-model-cache\") pod \"simulator-w5-b78c31-kserve-95df74778-fpvpr\" (UID: \"665d75c7-8ba5-49e1-87a7-51a18ae6f369\") " pod="e2e-models-e2e-worker-w5-b78c31/simulator-w5-b78c31-kserve-95df74778-fpvpr"
Oct 31 17:37:25.921716 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:37:25.916034    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nff5q\" (UniqueName: \"kubernetes.io/projected/665d75c7-8ba5-49e1-87a7-51a18ae6f369-kube-api-access-nff5q\") pod \"simulator-w5-b78c31-kserve-95df74778-fpvpr\" (UID: \"665d75c7-8ba5-49e1-87a7-51a18ae6f369\") " pod="e2e-models-e2e-worker-w5-b78c31/simulator-w5-b78c31-kserve-95df74778-fpvpr"
Oct 31 17:37:25.944671 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:37:25.941315    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/665d75c7-8ba5-49e1-87a7-51a18ae6f369-dshm\") pod \"simulator-w5-b78c31-kserve-95df74778-fpvpr\" (UID: \"665d75c7-8ba5-49e1-87a7-51a18ae6f369\") " pod="e2e-models-e2e-worker-w5-b78c31/simulator-w5-b78c31-kserve-95df74778-fpvpr"
Oct 31 17:37:25.948665 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:37:25.947089    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/665d75c7-8ba5-49e1-87a7-51a18ae6f369-tls-certs\") pod \"simulator-w5-b78c31-kserve-95df74778-fpvpr\" (UID: \"665d75c7-8ba5-49e1-87a7-51a18ae6f369\") " pod="e2e-models-e2e-worker-w5-b78c31/simulator-w5-b78c31-kserve-95df74778-fpvpr"
Oct 31 17:37:25.999896 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:37:25.999856    5003 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w5-b78c31/simulator-w5-b78c31-kserve-95df74778-fpvpr"
Oct 31 17:37:26.388237 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:37:26.388210    5003 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w5-b78c31/simulator-w5-b78c31-kserve-95df74778-fpvpr"]
Oct 31 17:37:26.389741 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:37:26.389701    5003 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod665d75c7_8ba5_49e1_87a7_51a18ae6f369.slice/crio-cba574051ea3b9c794f5c88c87eedd3fa1a3a2f26b82b8066d723a57cc13c1e7 WatchSource:0}: Error finding container cba574051ea3b9c794f5c88c87eedd3fa1a3a2f26b82b8066d723a57cc13c1e7: Status 404 returned error can't find the container with id cba574051ea3b9c794f5c88c87eedd3fa1a3a2f26b82b8066d723a57cc13c1e7
Oct 31 17:37:26.545795 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:37:26.545759    5003 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w0-ee816e/simulator-w0-ee816e-kserve-5bd4657dc-9rlm4"
Oct 31 17:37:26.559213 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:37:26.559182    5003 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w0-ee816e/simulator-w0-ee816e-kserve-5bd4657dc-9rlm4"
Oct 31 17:37:26.731479 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:37:26.731392    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w5-b78c31/simulator-w5-b78c31-kserve-95df74778-fpvpr" event={"ID":"665d75c7-8ba5-49e1-87a7-51a18ae6f369","Type":"ContainerStarted","Data":"077723067de6d165c413d9d4fe52d1a8cc9a99ebb335b1c23df06dd67df67c6b"}
Oct 31 17:37:26.731479 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:37:26.731435    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w5-b78c31/simulator-w5-b78c31-kserve-95df74778-fpvpr" event={"ID":"665d75c7-8ba5-49e1-87a7-51a18ae6f369","Type":"ContainerStarted","Data":"cba574051ea3b9c794f5c88c87eedd3fa1a3a2f26b82b8066d723a57cc13c1e7"}
Oct 31 17:37:26.742919 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:37:26.742894    5003 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w0-ee816e/simulator-w0-ee816e-kserve-5bd4657dc-9rlm4"
Oct 31 17:37:26.772344 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:37:26.772277    5003 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w5-b78c31/simulator-w5-b78c31-kserve-95df74778-fpvpr" podStartSLOduration=1.772258247 podStartE2EDuration="1.772258247s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 17:37:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 17:37:26.767480408 +0000 UTC m=+615.022334950" watchObservedRunningTime="2026-10-31 17:37:26.772258247 +0000 UTC m=+615.027112790"
Oct 31 17:37:27.001455 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:37:27.001375    5003 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w5-b78c31/simulator-w5-b78c31-kserve-95df74778-fpvpr"
Oct 31 17:37:36.001331 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:37:36.001296    5003 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w5-b78c31/simulator-w5-b78c31-kserve-95df74778-fpvpr"
Oct 31 17:37:36.013767 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:37:36.013742    5003 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w5-b78c31/simulator-w5-b78c31-kserve-95df74778-fpvpr"
Oct 31 17:37:36.815429 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:37:36.815398    5003 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w5-b78c31/simulator-w5-b78c31-kserve-95df74778-fpvpr"
Oct 31 17:37:40.332718 ip-10-0-138-17 kubenswrapper[5003]: E1031 17:37:40.332680    5003 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-tdzz5" containerName="extractor"
Oct 31 17:37:42.854510 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:37:42.854476    5003 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w4-1c0bfd/premium-w4-1c0bfd-kserve-d78fbb98-psx55"]
Oct 31 17:37:42.862468 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:37:42.862442    5003 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-1c0bfd/premium-w4-1c0bfd-kserve-d78fbb98-psx55"
Oct 31 17:37:42.877486 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:37:42.877460    5003 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-1c0bfd/premium-w4-1c0bfd-kserve-d78fbb98-psx55"]
Oct 31 17:37:42.885771 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:37:42.885745    5003 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w4-1c0bfd\"/\"openshift-service-ca.crt\""
Oct 31 17:37:42.885929 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:37:42.885825    5003 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w4-1c0bfd\"/\"kube-root-ca.crt\""
Oct 31 17:37:42.888810 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:37:42.888789    5003 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w4-1c0bfd\"/\"default-dockercfg-x4sxr\""
Oct 31 17:37:42.888810 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:37:42.888791    5003 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w4-1c0bfd\"/\"premium-w4-1c0bfd-kserve-self-signed-certs\""
Oct 31 17:37:42.911516 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:37:42.911489    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/34bdffed-87b8-4e7a-b182-f069d081bd62-tls-certs\") pod \"premium-w4-1c0bfd-kserve-d78fbb98-psx55\" (UID: \"34bdffed-87b8-4e7a-b182-f069d081bd62\") " pod="e2e-models-e2e-worker-w4-1c0bfd/premium-w4-1c0bfd-kserve-d78fbb98-psx55"
Oct 31 17:37:42.911697 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:37:42.911679    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4mgwl\" (UniqueName: \"kubernetes.io/projected/34bdffed-87b8-4e7a-b182-f069d081bd62-kube-api-access-4mgwl\") pod \"premium-w4-1c0bfd-kserve-d78fbb98-psx55\" (UID: \"34bdffed-87b8-4e7a-b182-f069d081bd62\") " pod="e2e-models-e2e-worker-w4-1c0bfd/premium-w4-1c0bfd-kserve-d78fbb98-psx55"
Oct 31 17:37:42.911765 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:37:42.911709    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/34bdffed-87b8-4e7a-b182-f069d081bd62-model-cache\") pod \"premium-w4-1c0bfd-kserve-d78fbb98-psx55\" (UID: \"34bdffed-87b8-4e7a-b182-f069d081bd62\") " pod="e2e-models-e2e-worker-w4-1c0bfd/premium-w4-1c0bfd-kserve-d78fbb98-psx55"
Oct 31 17:37:42.911765 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:37:42.911736    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/34bdffed-87b8-4e7a-b182-f069d081bd62-dshm\") pod \"premium-w4-1c0bfd-kserve-d78fbb98-psx55\" (UID: \"34bdffed-87b8-4e7a-b182-f069d081bd62\") " pod="e2e-models-e2e-worker-w4-1c0bfd/premium-w4-1c0bfd-kserve-d78fbb98-psx55"
Oct 31 17:37:42.911765 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:37:42.911751    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/34bdffed-87b8-4e7a-b182-f069d081bd62-tmp-dir\") pod \"premium-w4-1c0bfd-kserve-d78fbb98-psx55\" (UID: \"34bdffed-87b8-4e7a-b182-f069d081bd62\") " pod="e2e-models-e2e-worker-w4-1c0bfd/premium-w4-1c0bfd-kserve-d78fbb98-psx55"
Oct 31 17:37:42.911888 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:37:42.911867    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/34bdffed-87b8-4e7a-b182-f069d081bd62-home\") pod \"premium-w4-1c0bfd-kserve-d78fbb98-psx55\" (UID: \"34bdffed-87b8-4e7a-b182-f069d081bd62\") " pod="e2e-models-e2e-worker-w4-1c0bfd/premium-w4-1c0bfd-kserve-d78fbb98-psx55"
Oct 31 17:37:43.012573 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:37:43.012541    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4mgwl\" (UniqueName: \"kubernetes.io/projected/34bdffed-87b8-4e7a-b182-f069d081bd62-kube-api-access-4mgwl\") pod \"premium-w4-1c0bfd-kserve-d78fbb98-psx55\" (UID: \"34bdffed-87b8-4e7a-b182-f069d081bd62\") " pod="e2e-models-e2e-worker-w4-1c0bfd/premium-w4-1c0bfd-kserve-d78fbb98-psx55"
Oct 31 17:37:43.012770 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:37:43.012582    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/34bdffed-87b8-4e7a-b182-f069d081bd62-model-cache\") pod \"premium-w4-1c0bfd-kserve-d78fbb98-psx55\" (UID: \"34bdffed-87b8-4e7a-b182-f069d081bd62\") " pod="e2e-models-e2e-worker-w4-1c0bfd/premium-w4-1c0bfd-kserve-d78fbb98-psx55"
Oct 31 17:37:43.012770 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:37:43.012617    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/34bdffed-87b8-4e7a-b182-f069d081bd62-dshm\") pod \"premium-w4-1c0bfd-kserve-d78fbb98-psx55\" (UID: \"34bdffed-87b8-4e7a-b182-f069d081bd62\") " pod="e2e-models-e2e-worker-w4-1c0bfd/premium-w4-1c0bfd-kserve-d78fbb98-psx55"
Oct 31 17:37:43.012893 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:37:43.012792    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/34bdffed-87b8-4e7a-b182-f069d081bd62-tmp-dir\") pod \"premium-w4-1c0bfd-kserve-d78fbb98-psx55\" (UID: \"34bdffed-87b8-4e7a-b182-f069d081bd62\") " pod="e2e-models-e2e-worker-w4-1c0bfd/premium-w4-1c0bfd-kserve-d78fbb98-psx55"
Oct 31 17:37:43.012893 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:37:43.012855    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/34bdffed-87b8-4e7a-b182-f069d081bd62-home\") pod \"premium-w4-1c0bfd-kserve-d78fbb98-psx55\" (UID: \"34bdffed-87b8-4e7a-b182-f069d081bd62\") " pod="e2e-models-e2e-worker-w4-1c0bfd/premium-w4-1c0bfd-kserve-d78fbb98-psx55"
Oct 31 17:37:43.012993 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:37:43.012913    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/34bdffed-87b8-4e7a-b182-f069d081bd62-tls-certs\") pod \"premium-w4-1c0bfd-kserve-d78fbb98-psx55\" (UID: \"34bdffed-87b8-4e7a-b182-f069d081bd62\") " pod="e2e-models-e2e-worker-w4-1c0bfd/premium-w4-1c0bfd-kserve-d78fbb98-psx55"
Oct 31 17:37:43.013196 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:37:43.013173    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/34bdffed-87b8-4e7a-b182-f069d081bd62-model-cache\") pod \"premium-w4-1c0bfd-kserve-d78fbb98-psx55\" (UID: \"34bdffed-87b8-4e7a-b182-f069d081bd62\") " pod="e2e-models-e2e-worker-w4-1c0bfd/premium-w4-1c0bfd-kserve-d78fbb98-psx55"
Oct 31 17:37:43.013196 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:37:43.013181    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/34bdffed-87b8-4e7a-b182-f069d081bd62-home\") pod \"premium-w4-1c0bfd-kserve-d78fbb98-psx55\" (UID: \"34bdffed-87b8-4e7a-b182-f069d081bd62\") " pod="e2e-models-e2e-worker-w4-1c0bfd/premium-w4-1c0bfd-kserve-d78fbb98-psx55"
Oct 31 17:37:43.013327 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:37:43.013201    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/34bdffed-87b8-4e7a-b182-f069d081bd62-tmp-dir\") pod \"premium-w4-1c0bfd-kserve-d78fbb98-psx55\" (UID: \"34bdffed-87b8-4e7a-b182-f069d081bd62\") " pod="e2e-models-e2e-worker-w4-1c0bfd/premium-w4-1c0bfd-kserve-d78fbb98-psx55"
Oct 31 17:37:43.014979 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:37:43.014958    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/34bdffed-87b8-4e7a-b182-f069d081bd62-dshm\") pod \"premium-w4-1c0bfd-kserve-d78fbb98-psx55\" (UID: \"34bdffed-87b8-4e7a-b182-f069d081bd62\") " pod="e2e-models-e2e-worker-w4-1c0bfd/premium-w4-1c0bfd-kserve-d78fbb98-psx55"
Oct 31 17:37:43.015321 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:37:43.015305    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/34bdffed-87b8-4e7a-b182-f069d081bd62-tls-certs\") pod \"premium-w4-1c0bfd-kserve-d78fbb98-psx55\" (UID: \"34bdffed-87b8-4e7a-b182-f069d081bd62\") " pod="e2e-models-e2e-worker-w4-1c0bfd/premium-w4-1c0bfd-kserve-d78fbb98-psx55"
Oct 31 17:37:43.030894 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:37:43.030870    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4mgwl\" (UniqueName: \"kubernetes.io/projected/34bdffed-87b8-4e7a-b182-f069d081bd62-kube-api-access-4mgwl\") pod \"premium-w4-1c0bfd-kserve-d78fbb98-psx55\" (UID: \"34bdffed-87b8-4e7a-b182-f069d081bd62\") " pod="e2e-models-e2e-worker-w4-1c0bfd/premium-w4-1c0bfd-kserve-d78fbb98-psx55"
Oct 31 17:37:43.178212 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:37:43.178110    5003 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-1c0bfd/premium-w4-1c0bfd-kserve-d78fbb98-psx55"
Oct 31 17:37:43.475502 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:37:43.475426    5003 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-1c0bfd/premium-w4-1c0bfd-kserve-d78fbb98-psx55"]
Oct 31 17:37:43.478879 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:37:43.478851    5003 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod34bdffed_87b8_4e7a_b182_f069d081bd62.slice/crio-f4acfc644675ebac64edd716324f69e3c3bded63410550e53e39b51a696f4b5c WatchSource:0}: Error finding container f4acfc644675ebac64edd716324f69e3c3bded63410550e53e39b51a696f4b5c: Status 404 returned error can't find the container with id f4acfc644675ebac64edd716324f69e3c3bded63410550e53e39b51a696f4b5c
Oct 31 17:37:43.856304 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:37:43.856270    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-1c0bfd/premium-w4-1c0bfd-kserve-d78fbb98-psx55" event={"ID":"34bdffed-87b8-4e7a-b182-f069d081bd62","Type":"ContainerStarted","Data":"e780db873a69f8c9a7b3c27619a1a620aafd4c76c61a95df8723ee2d402db409"}
Oct 31 17:37:43.856304 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:37:43.856308    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-1c0bfd/premium-w4-1c0bfd-kserve-d78fbb98-psx55" event={"ID":"34bdffed-87b8-4e7a-b182-f069d081bd62","Type":"ContainerStarted","Data":"f4acfc644675ebac64edd716324f69e3c3bded63410550e53e39b51a696f4b5c"}
Oct 31 17:37:43.895771 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:37:43.895724    5003 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w4-1c0bfd/premium-w4-1c0bfd-kserve-d78fbb98-psx55" podStartSLOduration=1.8957093170000001 podStartE2EDuration="1.895709317s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 17:37:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 17:37:43.893553857 +0000 UTC m=+632.148408410" watchObservedRunningTime="2026-10-31 17:37:43.895709317 +0000 UTC m=+632.150563857"
Oct 31 17:37:44.178841 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:37:44.178756    5003 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w4-1c0bfd/premium-w4-1c0bfd-kserve-d78fbb98-psx55"
Oct 31 17:37:53.179125 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:37:53.179088    5003 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w4-1c0bfd/premium-w4-1c0bfd-kserve-d78fbb98-psx55"
Oct 31 17:37:53.192064 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:37:53.192037    5003 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w4-1c0bfd/premium-w4-1c0bfd-kserve-d78fbb98-psx55"
Oct 31 17:37:53.928936 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:37:53.928909    5003 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w4-1c0bfd/premium-w4-1c0bfd-kserve-d78fbb98-psx55"
Oct 31 17:37:56.860237 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:37:56.860201    5003 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w2-5c446c/premium-w2-5c446c-kserve-66f7486c85-f7lk2"]
Oct 31 17:37:56.864106 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:37:56.864086    5003 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w2-5c446c/premium-w2-5c446c-kserve-66f7486c85-f7lk2"
Oct 31 17:37:56.882336 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:37:56.882307    5003 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w2-5c446c/premium-w2-5c446c-kserve-66f7486c85-f7lk2"]
Oct 31 17:37:56.890344 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:37:56.890320    5003 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w2-5c446c\"/\"openshift-service-ca.crt\""
Oct 31 17:37:56.890344 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:37:56.890335    5003 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w2-5c446c\"/\"kube-root-ca.crt\""
Oct 31 17:37:56.890533 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:37:56.890370    5003 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w2-5c446c\"/\"premium-w2-5c446c-kserve-self-signed-certs\""
Oct 31 17:37:56.890533 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:37:56.890381    5003 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w2-5c446c\"/\"default-dockercfg-52ml5\""
Oct 31 17:37:56.973377 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:37:56.973342    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9c2ddfab-2348-4bb0-8844-1fca62460390-tls-certs\") pod \"premium-w2-5c446c-kserve-66f7486c85-f7lk2\" (UID: \"9c2ddfab-2348-4bb0-8844-1fca62460390\") " pod="e2e-models-e2e-worker-w2-5c446c/premium-w2-5c446c-kserve-66f7486c85-f7lk2"
Oct 31 17:37:56.973570 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:37:56.973391    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9c2ddfab-2348-4bb0-8844-1fca62460390-tmp-dir\") pod \"premium-w2-5c446c-kserve-66f7486c85-f7lk2\" (UID: \"9c2ddfab-2348-4bb0-8844-1fca62460390\") " pod="e2e-models-e2e-worker-w2-5c446c/premium-w2-5c446c-kserve-66f7486c85-f7lk2"
Oct 31 17:37:56.973570 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:37:56.973535    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9c2ddfab-2348-4bb0-8844-1fca62460390-dshm\") pod \"premium-w2-5c446c-kserve-66f7486c85-f7lk2\" (UID: \"9c2ddfab-2348-4bb0-8844-1fca62460390\") " pod="e2e-models-e2e-worker-w2-5c446c/premium-w2-5c446c-kserve-66f7486c85-f7lk2"
Oct 31 17:37:56.973835 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:37:56.973807    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gzmxc\" (UniqueName: \"kubernetes.io/projected/9c2ddfab-2348-4bb0-8844-1fca62460390-kube-api-access-gzmxc\") pod \"premium-w2-5c446c-kserve-66f7486c85-f7lk2\" (UID: \"9c2ddfab-2348-4bb0-8844-1fca62460390\") " pod="e2e-models-e2e-worker-w2-5c446c/premium-w2-5c446c-kserve-66f7486c85-f7lk2"
Oct 31 17:37:56.973929 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:37:56.973857    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9c2ddfab-2348-4bb0-8844-1fca62460390-model-cache\") pod \"premium-w2-5c446c-kserve-66f7486c85-f7lk2\" (UID: \"9c2ddfab-2348-4bb0-8844-1fca62460390\") " pod="e2e-models-e2e-worker-w2-5c446c/premium-w2-5c446c-kserve-66f7486c85-f7lk2"
Oct 31 17:37:56.974017 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:37:56.973977    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9c2ddfab-2348-4bb0-8844-1fca62460390-home\") pod \"premium-w2-5c446c-kserve-66f7486c85-f7lk2\" (UID: \"9c2ddfab-2348-4bb0-8844-1fca62460390\") " pod="e2e-models-e2e-worker-w2-5c446c/premium-w2-5c446c-kserve-66f7486c85-f7lk2"
Oct 31 17:37:57.074900 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:37:57.074860    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gzmxc\" (UniqueName: \"kubernetes.io/projected/9c2ddfab-2348-4bb0-8844-1fca62460390-kube-api-access-gzmxc\") pod \"premium-w2-5c446c-kserve-66f7486c85-f7lk2\" (UID: \"9c2ddfab-2348-4bb0-8844-1fca62460390\") " pod="e2e-models-e2e-worker-w2-5c446c/premium-w2-5c446c-kserve-66f7486c85-f7lk2"
Oct 31 17:37:57.074900 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:37:57.074904    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9c2ddfab-2348-4bb0-8844-1fca62460390-model-cache\") pod \"premium-w2-5c446c-kserve-66f7486c85-f7lk2\" (UID: \"9c2ddfab-2348-4bb0-8844-1fca62460390\") " pod="e2e-models-e2e-worker-w2-5c446c/premium-w2-5c446c-kserve-66f7486c85-f7lk2"
Oct 31 17:37:57.075171 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:37:57.074945    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9c2ddfab-2348-4bb0-8844-1fca62460390-home\") pod \"premium-w2-5c446c-kserve-66f7486c85-f7lk2\" (UID: \"9c2ddfab-2348-4bb0-8844-1fca62460390\") " pod="e2e-models-e2e-worker-w2-5c446c/premium-w2-5c446c-kserve-66f7486c85-f7lk2"
Oct 31 17:37:57.075171 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:37:57.074970    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9c2ddfab-2348-4bb0-8844-1fca62460390-tls-certs\") pod \"premium-w2-5c446c-kserve-66f7486c85-f7lk2\" (UID: \"9c2ddfab-2348-4bb0-8844-1fca62460390\") " pod="e2e-models-e2e-worker-w2-5c446c/premium-w2-5c446c-kserve-66f7486c85-f7lk2"
Oct 31 17:37:57.075171 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:37:57.074996    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9c2ddfab-2348-4bb0-8844-1fca62460390-tmp-dir\") pod \"premium-w2-5c446c-kserve-66f7486c85-f7lk2\" (UID: \"9c2ddfab-2348-4bb0-8844-1fca62460390\") " pod="e2e-models-e2e-worker-w2-5c446c/premium-w2-5c446c-kserve-66f7486c85-f7lk2"
Oct 31 17:37:57.075171 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:37:57.075030    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9c2ddfab-2348-4bb0-8844-1fca62460390-dshm\") pod \"premium-w2-5c446c-kserve-66f7486c85-f7lk2\" (UID: \"9c2ddfab-2348-4bb0-8844-1fca62460390\") " pod="e2e-models-e2e-worker-w2-5c446c/premium-w2-5c446c-kserve-66f7486c85-f7lk2"
Oct 31 17:37:57.075447 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:37:57.075424    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9c2ddfab-2348-4bb0-8844-1fca62460390-home\") pod \"premium-w2-5c446c-kserve-66f7486c85-f7lk2\" (UID: \"9c2ddfab-2348-4bb0-8844-1fca62460390\") " pod="e2e-models-e2e-worker-w2-5c446c/premium-w2-5c446c-kserve-66f7486c85-f7lk2"
Oct 31 17:37:57.075518 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:37:57.075436    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9c2ddfab-2348-4bb0-8844-1fca62460390-model-cache\") pod \"premium-w2-5c446c-kserve-66f7486c85-f7lk2\" (UID: \"9c2ddfab-2348-4bb0-8844-1fca62460390\") " pod="e2e-models-e2e-worker-w2-5c446c/premium-w2-5c446c-kserve-66f7486c85-f7lk2"
Oct 31 17:37:57.075518 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:37:57.075491    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9c2ddfab-2348-4bb0-8844-1fca62460390-tmp-dir\") pod \"premium-w2-5c446c-kserve-66f7486c85-f7lk2\" (UID: \"9c2ddfab-2348-4bb0-8844-1fca62460390\") " pod="e2e-models-e2e-worker-w2-5c446c/premium-w2-5c446c-kserve-66f7486c85-f7lk2"
Oct 31 17:37:57.077267 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:37:57.077247    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9c2ddfab-2348-4bb0-8844-1fca62460390-dshm\") pod \"premium-w2-5c446c-kserve-66f7486c85-f7lk2\" (UID: \"9c2ddfab-2348-4bb0-8844-1fca62460390\") " pod="e2e-models-e2e-worker-w2-5c446c/premium-w2-5c446c-kserve-66f7486c85-f7lk2"
Oct 31 17:37:57.077553 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:37:57.077533    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9c2ddfab-2348-4bb0-8844-1fca62460390-tls-certs\") pod \"premium-w2-5c446c-kserve-66f7486c85-f7lk2\" (UID: \"9c2ddfab-2348-4bb0-8844-1fca62460390\") " pod="e2e-models-e2e-worker-w2-5c446c/premium-w2-5c446c-kserve-66f7486c85-f7lk2"
Oct 31 17:37:57.093383 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:37:57.093356    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gzmxc\" (UniqueName: \"kubernetes.io/projected/9c2ddfab-2348-4bb0-8844-1fca62460390-kube-api-access-gzmxc\") pod \"premium-w2-5c446c-kserve-66f7486c85-f7lk2\" (UID: \"9c2ddfab-2348-4bb0-8844-1fca62460390\") " pod="e2e-models-e2e-worker-w2-5c446c/premium-w2-5c446c-kserve-66f7486c85-f7lk2"
Oct 31 17:37:57.179383 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:37:57.179299    5003 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w2-5c446c/premium-w2-5c446c-kserve-66f7486c85-f7lk2"
Oct 31 17:37:57.476909 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:37:57.476838    5003 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w2-5c446c/premium-w2-5c446c-kserve-66f7486c85-f7lk2"]
Oct 31 17:37:57.480535 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:37:57.480505    5003 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9c2ddfab_2348_4bb0_8844_1fca62460390.slice/crio-79d809d0a371ad14025c0512f06192d8e8b4c38470b0a905c60c7a97ef951a5a WatchSource:0}: Error finding container 79d809d0a371ad14025c0512f06192d8e8b4c38470b0a905c60c7a97ef951a5a: Status 404 returned error can't find the container with id 79d809d0a371ad14025c0512f06192d8e8b4c38470b0a905c60c7a97ef951a5a
Oct 31 17:37:57.947061 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:37:57.947023    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w2-5c446c/premium-w2-5c446c-kserve-66f7486c85-f7lk2" event={"ID":"9c2ddfab-2348-4bb0-8844-1fca62460390","Type":"ContainerStarted","Data":"37d78a6b655ea6e4b8252c8c9a5560e084763d2c2a442284252794fa79dc9f66"}
Oct 31 17:37:57.947452 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:37:57.947073    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w2-5c446c/premium-w2-5c446c-kserve-66f7486c85-f7lk2" event={"ID":"9c2ddfab-2348-4bb0-8844-1fca62460390","Type":"ContainerStarted","Data":"79d809d0a371ad14025c0512f06192d8e8b4c38470b0a905c60c7a97ef951a5a"}
Oct 31 17:37:57.985682 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:37:57.985617    5003 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w2-5c446c/premium-w2-5c446c-kserve-66f7486c85-f7lk2" podStartSLOduration=1.985604236 podStartE2EDuration="1.985604236s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 17:37:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 17:37:57.983204175 +0000 UTC m=+646.238058726" watchObservedRunningTime="2026-10-31 17:37:57.985604236 +0000 UTC m=+646.240458803"
Oct 31 17:37:58.179908 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:37:58.179874    5003 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w2-5c446c/premium-w2-5c446c-kserve-66f7486c85-f7lk2"
Oct 31 17:38:07.179814 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:38:07.179780    5003 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w2-5c446c/premium-w2-5c446c-kserve-66f7486c85-f7lk2"
Oct 31 17:38:07.192143 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:38:07.192119    5003 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w2-5c446c/premium-w2-5c446c-kserve-66f7486c85-f7lk2"
Oct 31 17:38:08.026406 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:38:08.026374    5003 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w2-5c446c/premium-w2-5c446c-kserve-66f7486c85-f7lk2"
Oct 31 17:38:10.331413 ip-10-0-138-17 kubenswrapper[5003]: E1031 17:38:10.331373    5003 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-tdzz5" containerName="extractor"
Oct 31 17:38:16.248251 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:38:16.248208    5003 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w4-1c0bfd-openshift-default-f7f657c57-prvbp"]
Oct 31 17:38:16.253683 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:38:16.253629    5003 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-1c0bfd-openshift-default-f7f657c57-prvbp"
Oct 31 17:38:16.267903 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:38:16.267879    5003 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w4-1c0bfd-openshift-default-dockercfg-27xm6\""
Oct 31 17:38:16.284079 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:38:16.284044    5003 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-1c0bfd-openshift-default-f7f657c57-prvbp"]
Oct 31 17:38:16.421062 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:38:16.421022    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8a6f3fb4-846a-43aa-9309-48c6ca558850-istio-data\") pod \"e2e-worker-w4-1c0bfd-openshift-default-f7f657c57-prvbp\" (UID: \"8a6f3fb4-846a-43aa-9309-48c6ca558850\") " pod="openshift-ingress/e2e-worker-w4-1c0bfd-openshift-default-f7f657c57-prvbp"
Oct 31 17:38:16.421245 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:38:16.421071    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8a6f3fb4-846a-43aa-9309-48c6ca558850-istio-token\") pod \"e2e-worker-w4-1c0bfd-openshift-default-f7f657c57-prvbp\" (UID: \"8a6f3fb4-846a-43aa-9309-48c6ca558850\") " pod="openshift-ingress/e2e-worker-w4-1c0bfd-openshift-default-f7f657c57-prvbp"
Oct 31 17:38:16.421245 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:38:16.421158    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8a6f3fb4-846a-43aa-9309-48c6ca558850-credential-socket\") pod \"e2e-worker-w4-1c0bfd-openshift-default-f7f657c57-prvbp\" (UID: \"8a6f3fb4-846a-43aa-9309-48c6ca558850\") " pod="openshift-ingress/e2e-worker-w4-1c0bfd-openshift-default-f7f657c57-prvbp"
Oct 31 17:38:16.421245 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:38:16.421197    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h2zm2\" (UniqueName: \"kubernetes.io/projected/8a6f3fb4-846a-43aa-9309-48c6ca558850-kube-api-access-h2zm2\") pod \"e2e-worker-w4-1c0bfd-openshift-default-f7f657c57-prvbp\" (UID: \"8a6f3fb4-846a-43aa-9309-48c6ca558850\") " pod="openshift-ingress/e2e-worker-w4-1c0bfd-openshift-default-f7f657c57-prvbp"
Oct 31 17:38:16.421245 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:38:16.421216    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8a6f3fb4-846a-43aa-9309-48c6ca558850-istio-podinfo\") pod \"e2e-worker-w4-1c0bfd-openshift-default-f7f657c57-prvbp\" (UID: \"8a6f3fb4-846a-43aa-9309-48c6ca558850\") " pod="openshift-ingress/e2e-worker-w4-1c0bfd-openshift-default-f7f657c57-prvbp"
Oct 31 17:38:16.421408 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:38:16.421372    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8a6f3fb4-846a-43aa-9309-48c6ca558850-istiod-ca-cert\") pod \"e2e-worker-w4-1c0bfd-openshift-default-f7f657c57-prvbp\" (UID: \"8a6f3fb4-846a-43aa-9309-48c6ca558850\") " pod="openshift-ingress/e2e-worker-w4-1c0bfd-openshift-default-f7f657c57-prvbp"
Oct 31 17:38:16.421497 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:38:16.421478    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8a6f3fb4-846a-43aa-9309-48c6ca558850-workload-certs\") pod \"e2e-worker-w4-1c0bfd-openshift-default-f7f657c57-prvbp\" (UID: \"8a6f3fb4-846a-43aa-9309-48c6ca558850\") " pod="openshift-ingress/e2e-worker-w4-1c0bfd-openshift-default-f7f657c57-prvbp"
Oct 31 17:38:16.421682 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:38:16.421662    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8a6f3fb4-846a-43aa-9309-48c6ca558850-istio-envoy\") pod \"e2e-worker-w4-1c0bfd-openshift-default-f7f657c57-prvbp\" (UID: \"8a6f3fb4-846a-43aa-9309-48c6ca558850\") " pod="openshift-ingress/e2e-worker-w4-1c0bfd-openshift-default-f7f657c57-prvbp"
Oct 31 17:38:16.421727 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:38:16.421711    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8a6f3fb4-846a-43aa-9309-48c6ca558850-workload-socket\") pod \"e2e-worker-w4-1c0bfd-openshift-default-f7f657c57-prvbp\" (UID: \"8a6f3fb4-846a-43aa-9309-48c6ca558850\") " pod="openshift-ingress/e2e-worker-w4-1c0bfd-openshift-default-f7f657c57-prvbp"
Oct 31 17:38:16.523013 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:38:16.522926    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8a6f3fb4-846a-43aa-9309-48c6ca558850-workload-certs\") pod \"e2e-worker-w4-1c0bfd-openshift-default-f7f657c57-prvbp\" (UID: \"8a6f3fb4-846a-43aa-9309-48c6ca558850\") " pod="openshift-ingress/e2e-worker-w4-1c0bfd-openshift-default-f7f657c57-prvbp"
Oct 31 17:38:16.523176 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:38:16.523037    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8a6f3fb4-846a-43aa-9309-48c6ca558850-istio-envoy\") pod \"e2e-worker-w4-1c0bfd-openshift-default-f7f657c57-prvbp\" (UID: \"8a6f3fb4-846a-43aa-9309-48c6ca558850\") " pod="openshift-ingress/e2e-worker-w4-1c0bfd-openshift-default-f7f657c57-prvbp"
Oct 31 17:38:16.523176 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:38:16.523062    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8a6f3fb4-846a-43aa-9309-48c6ca558850-workload-socket\") pod \"e2e-worker-w4-1c0bfd-openshift-default-f7f657c57-prvbp\" (UID: \"8a6f3fb4-846a-43aa-9309-48c6ca558850\") " pod="openshift-ingress/e2e-worker-w4-1c0bfd-openshift-default-f7f657c57-prvbp"
Oct 31 17:38:16.523176 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:38:16.523090    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8a6f3fb4-846a-43aa-9309-48c6ca558850-istio-data\") pod \"e2e-worker-w4-1c0bfd-openshift-default-f7f657c57-prvbp\" (UID: \"8a6f3fb4-846a-43aa-9309-48c6ca558850\") " pod="openshift-ingress/e2e-worker-w4-1c0bfd-openshift-default-f7f657c57-prvbp"
Oct 31 17:38:16.523176 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:38:16.523114    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8a6f3fb4-846a-43aa-9309-48c6ca558850-istio-token\") pod \"e2e-worker-w4-1c0bfd-openshift-default-f7f657c57-prvbp\" (UID: \"8a6f3fb4-846a-43aa-9309-48c6ca558850\") " pod="openshift-ingress/e2e-worker-w4-1c0bfd-openshift-default-f7f657c57-prvbp"
Oct 31 17:38:16.523176 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:38:16.523145    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8a6f3fb4-846a-43aa-9309-48c6ca558850-credential-socket\") pod \"e2e-worker-w4-1c0bfd-openshift-default-f7f657c57-prvbp\" (UID: \"8a6f3fb4-846a-43aa-9309-48c6ca558850\") " pod="openshift-ingress/e2e-worker-w4-1c0bfd-openshift-default-f7f657c57-prvbp"
Oct 31 17:38:16.523176 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:38:16.523172    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h2zm2\" (UniqueName: \"kubernetes.io/projected/8a6f3fb4-846a-43aa-9309-48c6ca558850-kube-api-access-h2zm2\") pod \"e2e-worker-w4-1c0bfd-openshift-default-f7f657c57-prvbp\" (UID: \"8a6f3fb4-846a-43aa-9309-48c6ca558850\") " pod="openshift-ingress/e2e-worker-w4-1c0bfd-openshift-default-f7f657c57-prvbp"
Oct 31 17:38:16.523485 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:38:16.523212    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8a6f3fb4-846a-43aa-9309-48c6ca558850-istio-podinfo\") pod \"e2e-worker-w4-1c0bfd-openshift-default-f7f657c57-prvbp\" (UID: \"8a6f3fb4-846a-43aa-9309-48c6ca558850\") " pod="openshift-ingress/e2e-worker-w4-1c0bfd-openshift-default-f7f657c57-prvbp"
Oct 31 17:38:16.523485 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:38:16.523248    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8a6f3fb4-846a-43aa-9309-48c6ca558850-istiod-ca-cert\") pod \"e2e-worker-w4-1c0bfd-openshift-default-f7f657c57-prvbp\" (UID: \"8a6f3fb4-846a-43aa-9309-48c6ca558850\") " pod="openshift-ingress/e2e-worker-w4-1c0bfd-openshift-default-f7f657c57-prvbp"
Oct 31 17:38:16.523485 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:38:16.523448    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8a6f3fb4-846a-43aa-9309-48c6ca558850-workload-certs\") pod \"e2e-worker-w4-1c0bfd-openshift-default-f7f657c57-prvbp\" (UID: \"8a6f3fb4-846a-43aa-9309-48c6ca558850\") " pod="openshift-ingress/e2e-worker-w4-1c0bfd-openshift-default-f7f657c57-prvbp"
Oct 31 17:38:16.523630 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:38:16.523512    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8a6f3fb4-846a-43aa-9309-48c6ca558850-workload-socket\") pod \"e2e-worker-w4-1c0bfd-openshift-default-f7f657c57-prvbp\" (UID: \"8a6f3fb4-846a-43aa-9309-48c6ca558850\") " pod="openshift-ingress/e2e-worker-w4-1c0bfd-openshift-default-f7f657c57-prvbp"
Oct 31 17:38:16.523935 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:38:16.523907    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8a6f3fb4-846a-43aa-9309-48c6ca558850-credential-socket\") pod \"e2e-worker-w4-1c0bfd-openshift-default-f7f657c57-prvbp\" (UID: \"8a6f3fb4-846a-43aa-9309-48c6ca558850\") " pod="openshift-ingress/e2e-worker-w4-1c0bfd-openshift-default-f7f657c57-prvbp"
Oct 31 17:38:16.524055 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:38:16.523983    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8a6f3fb4-846a-43aa-9309-48c6ca558850-istiod-ca-cert\") pod \"e2e-worker-w4-1c0bfd-openshift-default-f7f657c57-prvbp\" (UID: \"8a6f3fb4-846a-43aa-9309-48c6ca558850\") " pod="openshift-ingress/e2e-worker-w4-1c0bfd-openshift-default-f7f657c57-prvbp"
Oct 31 17:38:16.524218 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:38:16.524194    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8a6f3fb4-846a-43aa-9309-48c6ca558850-istio-data\") pod \"e2e-worker-w4-1c0bfd-openshift-default-f7f657c57-prvbp\" (UID: \"8a6f3fb4-846a-43aa-9309-48c6ca558850\") " pod="openshift-ingress/e2e-worker-w4-1c0bfd-openshift-default-f7f657c57-prvbp"
Oct 31 17:38:16.525754 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:38:16.525727    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8a6f3fb4-846a-43aa-9309-48c6ca558850-istio-envoy\") pod \"e2e-worker-w4-1c0bfd-openshift-default-f7f657c57-prvbp\" (UID: \"8a6f3fb4-846a-43aa-9309-48c6ca558850\") " pod="openshift-ingress/e2e-worker-w4-1c0bfd-openshift-default-f7f657c57-prvbp"
Oct 31 17:38:16.527774 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:38:16.527750    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8a6f3fb4-846a-43aa-9309-48c6ca558850-istio-podinfo\") pod \"e2e-worker-w4-1c0bfd-openshift-default-f7f657c57-prvbp\" (UID: \"8a6f3fb4-846a-43aa-9309-48c6ca558850\") " pod="openshift-ingress/e2e-worker-w4-1c0bfd-openshift-default-f7f657c57-prvbp"
Oct 31 17:38:16.529168 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:38:16.529150    5003 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w2-5c446c-openshift-default-797c6dc855-nd8tv"]
Oct 31 17:38:16.533263 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:38:16.533247    5003 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-5c446c-openshift-default-797c6dc855-nd8tv"
Oct 31 17:38:16.542033 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:38:16.542009    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8a6f3fb4-846a-43aa-9309-48c6ca558850-istio-token\") pod \"e2e-worker-w4-1c0bfd-openshift-default-f7f657c57-prvbp\" (UID: \"8a6f3fb4-846a-43aa-9309-48c6ca558850\") " pod="openshift-ingress/e2e-worker-w4-1c0bfd-openshift-default-f7f657c57-prvbp"
Oct 31 17:38:16.542404 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:38:16.542381    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h2zm2\" (UniqueName: \"kubernetes.io/projected/8a6f3fb4-846a-43aa-9309-48c6ca558850-kube-api-access-h2zm2\") pod \"e2e-worker-w4-1c0bfd-openshift-default-f7f657c57-prvbp\" (UID: \"8a6f3fb4-846a-43aa-9309-48c6ca558850\") " pod="openshift-ingress/e2e-worker-w4-1c0bfd-openshift-default-f7f657c57-prvbp"
Oct 31 17:38:16.552201 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:38:16.552175    5003 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w2-5c446c-openshift-default-dockercfg-kfjdh\""
Oct 31 17:38:16.553988 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:38:16.553948    5003 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w2-5c446c-openshift-default-797c6dc855-nd8tv"]
Oct 31 17:38:16.570855 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:38:16.567461    5003 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-1c0bfd-openshift-default-f7f657c57-prvbp"
Oct 31 17:38:16.624576 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:38:16.624542    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6de961b6-2fb6-404d-9db2-594a7ef76ccb-istiod-ca-cert\") pod \"e2e-worker-w2-5c446c-openshift-default-797c6dc855-nd8tv\" (UID: \"6de961b6-2fb6-404d-9db2-594a7ef76ccb\") " pod="openshift-ingress/e2e-worker-w2-5c446c-openshift-default-797c6dc855-nd8tv"
Oct 31 17:38:16.624755 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:38:16.624599    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6de961b6-2fb6-404d-9db2-594a7ef76ccb-istio-envoy\") pod \"e2e-worker-w2-5c446c-openshift-default-797c6dc855-nd8tv\" (UID: \"6de961b6-2fb6-404d-9db2-594a7ef76ccb\") " pod="openshift-ingress/e2e-worker-w2-5c446c-openshift-default-797c6dc855-nd8tv"
Oct 31 17:38:16.624755 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:38:16.624685    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6de961b6-2fb6-404d-9db2-594a7ef76ccb-workload-certs\") pod \"e2e-worker-w2-5c446c-openshift-default-797c6dc855-nd8tv\" (UID: \"6de961b6-2fb6-404d-9db2-594a7ef76ccb\") " pod="openshift-ingress/e2e-worker-w2-5c446c-openshift-default-797c6dc855-nd8tv"
Oct 31 17:38:16.624755 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:38:16.624718    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6de961b6-2fb6-404d-9db2-594a7ef76ccb-credential-socket\") pod \"e2e-worker-w2-5c446c-openshift-default-797c6dc855-nd8tv\" (UID: \"6de961b6-2fb6-404d-9db2-594a7ef76ccb\") " pod="openshift-ingress/e2e-worker-w2-5c446c-openshift-default-797c6dc855-nd8tv"
Oct 31 17:38:16.624755 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:38:16.624738    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2wd8m\" (UniqueName: \"kubernetes.io/projected/6de961b6-2fb6-404d-9db2-594a7ef76ccb-kube-api-access-2wd8m\") pod \"e2e-worker-w2-5c446c-openshift-default-797c6dc855-nd8tv\" (UID: \"6de961b6-2fb6-404d-9db2-594a7ef76ccb\") " pod="openshift-ingress/e2e-worker-w2-5c446c-openshift-default-797c6dc855-nd8tv"
Oct 31 17:38:16.624913 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:38:16.624861    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6de961b6-2fb6-404d-9db2-594a7ef76ccb-istio-data\") pod \"e2e-worker-w2-5c446c-openshift-default-797c6dc855-nd8tv\" (UID: \"6de961b6-2fb6-404d-9db2-594a7ef76ccb\") " pod="openshift-ingress/e2e-worker-w2-5c446c-openshift-default-797c6dc855-nd8tv"
Oct 31 17:38:16.625367 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:38:16.624945    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6de961b6-2fb6-404d-9db2-594a7ef76ccb-workload-socket\") pod \"e2e-worker-w2-5c446c-openshift-default-797c6dc855-nd8tv\" (UID: \"6de961b6-2fb6-404d-9db2-594a7ef76ccb\") " pod="openshift-ingress/e2e-worker-w2-5c446c-openshift-default-797c6dc855-nd8tv"
Oct 31 17:38:16.625367 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:38:16.625094    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6de961b6-2fb6-404d-9db2-594a7ef76ccb-istio-token\") pod \"e2e-worker-w2-5c446c-openshift-default-797c6dc855-nd8tv\" (UID: \"6de961b6-2fb6-404d-9db2-594a7ef76ccb\") " pod="openshift-ingress/e2e-worker-w2-5c446c-openshift-default-797c6dc855-nd8tv"
Oct 31 17:38:16.625367 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:38:16.625175    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6de961b6-2fb6-404d-9db2-594a7ef76ccb-istio-podinfo\") pod \"e2e-worker-w2-5c446c-openshift-default-797c6dc855-nd8tv\" (UID: \"6de961b6-2fb6-404d-9db2-594a7ef76ccb\") " pod="openshift-ingress/e2e-worker-w2-5c446c-openshift-default-797c6dc855-nd8tv"
Oct 31 17:38:16.726268 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:38:16.726224    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6de961b6-2fb6-404d-9db2-594a7ef76ccb-istio-podinfo\") pod \"e2e-worker-w2-5c446c-openshift-default-797c6dc855-nd8tv\" (UID: \"6de961b6-2fb6-404d-9db2-594a7ef76ccb\") " pod="openshift-ingress/e2e-worker-w2-5c446c-openshift-default-797c6dc855-nd8tv"
Oct 31 17:38:16.726463 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:38:16.726310    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6de961b6-2fb6-404d-9db2-594a7ef76ccb-istiod-ca-cert\") pod \"e2e-worker-w2-5c446c-openshift-default-797c6dc855-nd8tv\" (UID: \"6de961b6-2fb6-404d-9db2-594a7ef76ccb\") " pod="openshift-ingress/e2e-worker-w2-5c446c-openshift-default-797c6dc855-nd8tv"
Oct 31 17:38:16.726463 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:38:16.726362    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6de961b6-2fb6-404d-9db2-594a7ef76ccb-istio-envoy\") pod \"e2e-worker-w2-5c446c-openshift-default-797c6dc855-nd8tv\" (UID: \"6de961b6-2fb6-404d-9db2-594a7ef76ccb\") " pod="openshift-ingress/e2e-worker-w2-5c446c-openshift-default-797c6dc855-nd8tv"
Oct 31 17:38:16.726463 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:38:16.726389    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6de961b6-2fb6-404d-9db2-594a7ef76ccb-workload-certs\") pod \"e2e-worker-w2-5c446c-openshift-default-797c6dc855-nd8tv\" (UID: \"6de961b6-2fb6-404d-9db2-594a7ef76ccb\") " pod="openshift-ingress/e2e-worker-w2-5c446c-openshift-default-797c6dc855-nd8tv"
Oct 31 17:38:16.726463 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:38:16.726425    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6de961b6-2fb6-404d-9db2-594a7ef76ccb-credential-socket\") pod \"e2e-worker-w2-5c446c-openshift-default-797c6dc855-nd8tv\" (UID: \"6de961b6-2fb6-404d-9db2-594a7ef76ccb\") " pod="openshift-ingress/e2e-worker-w2-5c446c-openshift-default-797c6dc855-nd8tv"
Oct 31 17:38:16.726463 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:38:16.726451    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2wd8m\" (UniqueName: \"kubernetes.io/projected/6de961b6-2fb6-404d-9db2-594a7ef76ccb-kube-api-access-2wd8m\") pod \"e2e-worker-w2-5c446c-openshift-default-797c6dc855-nd8tv\" (UID: \"6de961b6-2fb6-404d-9db2-594a7ef76ccb\") " pod="openshift-ingress/e2e-worker-w2-5c446c-openshift-default-797c6dc855-nd8tv"
Oct 31 17:38:16.726758 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:38:16.726486    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6de961b6-2fb6-404d-9db2-594a7ef76ccb-istio-data\") pod \"e2e-worker-w2-5c446c-openshift-default-797c6dc855-nd8tv\" (UID: \"6de961b6-2fb6-404d-9db2-594a7ef76ccb\") " pod="openshift-ingress/e2e-worker-w2-5c446c-openshift-default-797c6dc855-nd8tv"
Oct 31 17:38:16.726758 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:38:16.726555    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6de961b6-2fb6-404d-9db2-594a7ef76ccb-workload-socket\") pod \"e2e-worker-w2-5c446c-openshift-default-797c6dc855-nd8tv\" (UID: \"6de961b6-2fb6-404d-9db2-594a7ef76ccb\") " pod="openshift-ingress/e2e-worker-w2-5c446c-openshift-default-797c6dc855-nd8tv"
Oct 31 17:38:16.726758 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:38:16.726595    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6de961b6-2fb6-404d-9db2-594a7ef76ccb-istio-token\") pod \"e2e-worker-w2-5c446c-openshift-default-797c6dc855-nd8tv\" (UID: \"6de961b6-2fb6-404d-9db2-594a7ef76ccb\") " pod="openshift-ingress/e2e-worker-w2-5c446c-openshift-default-797c6dc855-nd8tv"
Oct 31 17:38:16.726943 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:38:16.726916    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6de961b6-2fb6-404d-9db2-594a7ef76ccb-credential-socket\") pod \"e2e-worker-w2-5c446c-openshift-default-797c6dc855-nd8tv\" (UID: \"6de961b6-2fb6-404d-9db2-594a7ef76ccb\") " pod="openshift-ingress/e2e-worker-w2-5c446c-openshift-default-797c6dc855-nd8tv"
Oct 31 17:38:16.727284 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:38:16.727248    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6de961b6-2fb6-404d-9db2-594a7ef76ccb-istio-data\") pod \"e2e-worker-w2-5c446c-openshift-default-797c6dc855-nd8tv\" (UID: \"6de961b6-2fb6-404d-9db2-594a7ef76ccb\") " pod="openshift-ingress/e2e-worker-w2-5c446c-openshift-default-797c6dc855-nd8tv"
Oct 31 17:38:16.727284 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:38:16.727265    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6de961b6-2fb6-404d-9db2-594a7ef76ccb-istiod-ca-cert\") pod \"e2e-worker-w2-5c446c-openshift-default-797c6dc855-nd8tv\" (UID: \"6de961b6-2fb6-404d-9db2-594a7ef76ccb\") " pod="openshift-ingress/e2e-worker-w2-5c446c-openshift-default-797c6dc855-nd8tv"
Oct 31 17:38:16.727433 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:38:16.727351    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6de961b6-2fb6-404d-9db2-594a7ef76ccb-workload-socket\") pod \"e2e-worker-w2-5c446c-openshift-default-797c6dc855-nd8tv\" (UID: \"6de961b6-2fb6-404d-9db2-594a7ef76ccb\") " pod="openshift-ingress/e2e-worker-w2-5c446c-openshift-default-797c6dc855-nd8tv"
Oct 31 17:38:16.727433 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:38:16.727407    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6de961b6-2fb6-404d-9db2-594a7ef76ccb-workload-certs\") pod \"e2e-worker-w2-5c446c-openshift-default-797c6dc855-nd8tv\" (UID: \"6de961b6-2fb6-404d-9db2-594a7ef76ccb\") " pod="openshift-ingress/e2e-worker-w2-5c446c-openshift-default-797c6dc855-nd8tv"
Oct 31 17:38:16.728854 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:38:16.728836    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6de961b6-2fb6-404d-9db2-594a7ef76ccb-istio-podinfo\") pod \"e2e-worker-w2-5c446c-openshift-default-797c6dc855-nd8tv\" (UID: \"6de961b6-2fb6-404d-9db2-594a7ef76ccb\") " pod="openshift-ingress/e2e-worker-w2-5c446c-openshift-default-797c6dc855-nd8tv"
Oct 31 17:38:16.728942 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:38:16.728919    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6de961b6-2fb6-404d-9db2-594a7ef76ccb-istio-envoy\") pod \"e2e-worker-w2-5c446c-openshift-default-797c6dc855-nd8tv\" (UID: \"6de961b6-2fb6-404d-9db2-594a7ef76ccb\") " pod="openshift-ingress/e2e-worker-w2-5c446c-openshift-default-797c6dc855-nd8tv"
Oct 31 17:38:16.745323 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:38:16.745295    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6de961b6-2fb6-404d-9db2-594a7ef76ccb-istio-token\") pod \"e2e-worker-w2-5c446c-openshift-default-797c6dc855-nd8tv\" (UID: \"6de961b6-2fb6-404d-9db2-594a7ef76ccb\") " pod="openshift-ingress/e2e-worker-w2-5c446c-openshift-default-797c6dc855-nd8tv"
Oct 31 17:38:16.745466 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:38:16.745364    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2wd8m\" (UniqueName: \"kubernetes.io/projected/6de961b6-2fb6-404d-9db2-594a7ef76ccb-kube-api-access-2wd8m\") pod \"e2e-worker-w2-5c446c-openshift-default-797c6dc855-nd8tv\" (UID: \"6de961b6-2fb6-404d-9db2-594a7ef76ccb\") " pod="openshift-ingress/e2e-worker-w2-5c446c-openshift-default-797c6dc855-nd8tv"
Oct 31 17:38:16.881762 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:38:16.881724    5003 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-5c446c-openshift-default-797c6dc855-nd8tv"
Oct 31 17:38:16.889079 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:38:16.889055    5003 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-1c0bfd-openshift-default-f7f657c57-prvbp"]
Oct 31 17:38:16.896925 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:38:16.896886    5003 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a6f3fb4_846a_43aa_9309_48c6ca558850.slice/crio-c69f84c4e9bb442b5259f1fd32ce5cc388ef48e199e46b353b01070caf9a6fce WatchSource:0}: Error finding container c69f84c4e9bb442b5259f1fd32ce5cc388ef48e199e46b353b01070caf9a6fce: Status 404 returned error can't find the container with id c69f84c4e9bb442b5259f1fd32ce5cc388ef48e199e46b353b01070caf9a6fce
Oct 31 17:38:16.900182 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:38:16.900138    5003 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Oct 31 17:38:16.900296 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:38:16.900237    5003 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Oct 31 17:38:16.900296 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:38:16.900280    5003 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Oct 31 17:38:17.257535 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:38:17.257504    5003 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w2-5c446c-openshift-default-797c6dc855-nd8tv"]
Oct 31 17:38:17.262633 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:38:17.262036    5003 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Oct 31 17:38:17.262915 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:38:17.262842    5003 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Oct 31 17:38:17.263090 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:38:17.262898    5003 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Oct 31 17:38:17.273877 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:38:17.273850    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-1c0bfd-openshift-default-f7f657c57-prvbp" event={"ID":"8a6f3fb4-846a-43aa-9309-48c6ca558850","Type":"ContainerStarted","Data":"c69f84c4e9bb442b5259f1fd32ce5cc388ef48e199e46b353b01070caf9a6fce"}
Oct 31 17:38:18.306669 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:38:18.305997    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-1c0bfd-openshift-default-f7f657c57-prvbp" event={"ID":"8a6f3fb4-846a-43aa-9309-48c6ca558850","Type":"ContainerStarted","Data":"09984cd9197e55863d415a0834b373a76536d8140f35ed93946cc3db69846837"}
Oct 31 17:38:18.310023 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:38:18.309628    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-5c446c-openshift-default-797c6dc855-nd8tv" event={"ID":"6de961b6-2fb6-404d-9db2-594a7ef76ccb","Type":"ContainerStarted","Data":"52c5c37ad0287ee27616dbe9180e24eb2b511582d0419ad96d3978d8fba03075"}
Oct 31 17:38:18.310023 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:38:18.309716    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-5c446c-openshift-default-797c6dc855-nd8tv" event={"ID":"6de961b6-2fb6-404d-9db2-594a7ef76ccb","Type":"ContainerStarted","Data":"c5e9b80470d33df71dc35a3c8b8c784a19d0c30dd1f089c0a42551c7c24fc22f"}
Oct 31 17:38:18.435514 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:38:18.435452    5003 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w4-1c0bfd-openshift-default-f7f657c57-prvbp" podStartSLOduration=2.435436603 podStartE2EDuration="2.435436603s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 17:38:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 17:38:18.376931378 +0000 UTC m=+666.631785918" watchObservedRunningTime="2026-10-31 17:38:18.435436603 +0000 UTC m=+666.690291153"
Oct 31 17:38:18.437600 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:38:18.437541    5003 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w2-5c446c-openshift-default-797c6dc855-nd8tv" podStartSLOduration=2.437526107 podStartE2EDuration="2.437526107s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 17:38:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 17:38:18.433808955 +0000 UTC m=+666.688663519" watchObservedRunningTime="2026-10-31 17:38:18.437526107 +0000 UTC m=+666.692380648"
Oct 31 17:38:18.589333 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:38:18.589241    5003 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w4-1c0bfd-openshift-default-f7f657c57-prvbp"
Oct 31 17:38:18.589701 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:38:18.589675    5003 patch_prober.go:29] interesting pod/e2e-worker-w4-1c0bfd-openshift-default-f7f657c57-prvbp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused" start-of-body=
Oct 31 17:38:18.590079 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:38:18.590049    5003 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-1c0bfd-openshift-default-f7f657c57-prvbp" podUID="8a6f3fb4-846a-43aa-9309-48c6ca558850" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused"
Oct 31 17:38:18.890111 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:38:18.890020    5003 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w2-5c446c-openshift-default-797c6dc855-nd8tv"
Oct 31 17:38:18.894785 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:38:18.894752    5003 patch_prober.go:29] interesting pod/e2e-worker-w2-5c446c-openshift-default-797c6dc855-nd8tv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused" start-of-body=
Oct 31 17:38:18.895018 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:38:18.894985    5003 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-5c446c-openshift-default-797c6dc855-nd8tv" podUID="6de961b6-2fb6-404d-9db2-594a7ef76ccb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused"
Oct 31 17:38:19.578727 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:38:19.578064    5003 patch_prober.go:29] interesting pod/e2e-worker-w4-1c0bfd-openshift-default-f7f657c57-prvbp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused" start-of-body=
Oct 31 17:38:19.578727 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:38:19.578126    5003 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-1c0bfd-openshift-default-f7f657c57-prvbp" podUID="8a6f3fb4-846a-43aa-9309-48c6ca558850" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused"
Oct 31 17:38:19.897736 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:38:19.897237    5003 patch_prober.go:29] interesting pod/e2e-worker-w2-5c446c-openshift-default-797c6dc855-nd8tv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused" start-of-body=
Oct 31 17:38:19.897736 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:38:19.897300    5003 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-5c446c-openshift-default-797c6dc855-nd8tv" podUID="6de961b6-2fb6-404d-9db2-594a7ef76ccb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused"
Oct 31 17:38:20.582818 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:38:20.582781    5003 patch_prober.go:29] interesting pod/e2e-worker-w4-1c0bfd-openshift-default-f7f657c57-prvbp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused" start-of-body=
Oct 31 17:38:20.583471 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:38:20.583420    5003 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-1c0bfd-openshift-default-f7f657c57-prvbp" podUID="8a6f3fb4-846a-43aa-9309-48c6ca558850" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused"
Oct 31 17:38:20.889837 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:38:20.889742    5003 patch_prober.go:29] interesting pod/e2e-worker-w2-5c446c-openshift-default-797c6dc855-nd8tv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused" start-of-body=
Oct 31 17:38:20.890125 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:38:20.890093    5003 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-5c446c-openshift-default-797c6dc855-nd8tv" podUID="6de961b6-2fb6-404d-9db2-594a7ef76ccb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused"
Oct 31 17:38:21.573668 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:38:21.573582    5003 patch_prober.go:29] interesting pod/e2e-worker-w4-1c0bfd-openshift-default-f7f657c57-prvbp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused" start-of-body=
Oct 31 17:38:21.573668 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:38:21.573658    5003 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-1c0bfd-openshift-default-f7f657c57-prvbp" podUID="8a6f3fb4-846a-43aa-9309-48c6ca558850" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused"
Oct 31 17:38:21.902919 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:38:21.902826    5003 patch_prober.go:29] interesting pod/e2e-worker-w2-5c446c-openshift-default-797c6dc855-nd8tv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused" start-of-body=
Oct 31 17:38:21.903545 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:38:21.903466    5003 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-5c446c-openshift-default-797c6dc855-nd8tv" podUID="6de961b6-2fb6-404d-9db2-594a7ef76ccb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused"
Oct 31 17:38:22.574667 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:38:22.574410    5003 patch_prober.go:29] interesting pod/e2e-worker-w4-1c0bfd-openshift-default-f7f657c57-prvbp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused" start-of-body=
Oct 31 17:38:22.574667 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:38:22.574470    5003 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-1c0bfd-openshift-default-f7f657c57-prvbp" podUID="8a6f3fb4-846a-43aa-9309-48c6ca558850" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused"
Oct 31 17:38:22.889760 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:38:22.889221    5003 patch_prober.go:29] interesting pod/e2e-worker-w2-5c446c-openshift-default-797c6dc855-nd8tv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused" start-of-body=
Oct 31 17:38:22.889760 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:38:22.889282    5003 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-5c446c-openshift-default-797c6dc855-nd8tv" podUID="6de961b6-2fb6-404d-9db2-594a7ef76ccb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused"
Oct 31 17:38:23.568109 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:38:23.568071    5003 patch_prober.go:29] interesting pod/e2e-worker-w4-1c0bfd-openshift-default-f7f657c57-prvbp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused" start-of-body=
Oct 31 17:38:23.568503 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:38:23.568131    5003 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-1c0bfd-openshift-default-f7f657c57-prvbp" podUID="8a6f3fb4-846a-43aa-9309-48c6ca558850" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused"
Oct 31 17:38:24.072511 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:38:24.072468    5003 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w2-5c446c-openshift-default-797c6dc855-nd8tv"
Oct 31 17:38:24.073294 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:38:24.073268    5003 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w2-5c446c-openshift-default-797c6dc855-nd8tv"
Oct 31 17:38:24.074277 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:38:24.074253    5003 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w2-5c446c-openshift-default-797c6dc855-nd8tv"
Oct 31 17:38:24.572463 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:38:24.572433    5003 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w4-1c0bfd-openshift-default-f7f657c57-prvbp"
Oct 31 17:38:24.572974 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:38:24.572820    5003 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w4-1c0bfd-openshift-default-f7f657c57-prvbp"
Oct 31 17:38:24.573372 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:38:24.573354    5003 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w4-1c0bfd-openshift-default-f7f657c57-prvbp"
Oct 31 17:38:31.008725 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:38:31.008688    5003 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w3-cf0a86-openshift-default-595bfdc58c-knt8p"]
Oct 31 17:38:31.013349 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:38:31.013328    5003 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-cf0a86-openshift-default-595bfdc58c-knt8p"
Oct 31 17:38:31.037986 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:38:31.037960    5003 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w3-cf0a86-openshift-default-dockercfg-m2mbq\""
Oct 31 17:38:31.052913 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:38:31.052877    5003 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w3-cf0a86-openshift-default-595bfdc58c-knt8p"]
Oct 31 17:38:31.076634 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:38:31.076604    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ebe4bd91-be4d-4d45-89f7-5aa595b9e2aa-istio-token\") pod \"e2e-worker-w3-cf0a86-openshift-default-595bfdc58c-knt8p\" (UID: \"ebe4bd91-be4d-4d45-89f7-5aa595b9e2aa\") " pod="openshift-ingress/e2e-worker-w3-cf0a86-openshift-default-595bfdc58c-knt8p"
Oct 31 17:38:31.076809 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:38:31.076664    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ebe4bd91-be4d-4d45-89f7-5aa595b9e2aa-istio-podinfo\") pod \"e2e-worker-w3-cf0a86-openshift-default-595bfdc58c-knt8p\" (UID: \"ebe4bd91-be4d-4d45-89f7-5aa595b9e2aa\") " pod="openshift-ingress/e2e-worker-w3-cf0a86-openshift-default-595bfdc58c-knt8p"
Oct 31 17:38:31.076855 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:38:31.076799    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ebe4bd91-be4d-4d45-89f7-5aa595b9e2aa-istiod-ca-cert\") pod \"e2e-worker-w3-cf0a86-openshift-default-595bfdc58c-knt8p\" (UID: \"ebe4bd91-be4d-4d45-89f7-5aa595b9e2aa\") " pod="openshift-ingress/e2e-worker-w3-cf0a86-openshift-default-595bfdc58c-knt8p"
Oct 31 17:38:31.076909 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:38:31.076865    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dkf5d\" (UniqueName: \"kubernetes.io/projected/ebe4bd91-be4d-4d45-89f7-5aa595b9e2aa-kube-api-access-dkf5d\") pod \"e2e-worker-w3-cf0a86-openshift-default-595bfdc58c-knt8p\" (UID: \"ebe4bd91-be4d-4d45-89f7-5aa595b9e2aa\") " pod="openshift-ingress/e2e-worker-w3-cf0a86-openshift-default-595bfdc58c-knt8p"
Oct 31 17:38:31.076909 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:38:31.076898    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ebe4bd91-be4d-4d45-89f7-5aa595b9e2aa-istio-data\") pod \"e2e-worker-w3-cf0a86-openshift-default-595bfdc58c-knt8p\" (UID: \"ebe4bd91-be4d-4d45-89f7-5aa595b9e2aa\") " pod="openshift-ingress/e2e-worker-w3-cf0a86-openshift-default-595bfdc58c-knt8p"
Oct 31 17:38:31.076997 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:38:31.076981    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ebe4bd91-be4d-4d45-89f7-5aa595b9e2aa-istio-envoy\") pod \"e2e-worker-w3-cf0a86-openshift-default-595bfdc58c-knt8p\" (UID: \"ebe4bd91-be4d-4d45-89f7-5aa595b9e2aa\") " pod="openshift-ingress/e2e-worker-w3-cf0a86-openshift-default-595bfdc58c-knt8p"
Oct 31 17:38:31.077061 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:38:31.077048    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ebe4bd91-be4d-4d45-89f7-5aa595b9e2aa-credential-socket\") pod \"e2e-worker-w3-cf0a86-openshift-default-595bfdc58c-knt8p\" (UID: \"ebe4bd91-be4d-4d45-89f7-5aa595b9e2aa\") " pod="openshift-ingress/e2e-worker-w3-cf0a86-openshift-default-595bfdc58c-knt8p"
Oct 31 17:38:31.077114 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:38:31.077100    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ebe4bd91-be4d-4d45-89f7-5aa595b9e2aa-workload-socket\") pod \"e2e-worker-w3-cf0a86-openshift-default-595bfdc58c-knt8p\" (UID: \"ebe4bd91-be4d-4d45-89f7-5aa595b9e2aa\") " pod="openshift-ingress/e2e-worker-w3-cf0a86-openshift-default-595bfdc58c-knt8p"
Oct 31 17:38:31.077153 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:38:31.077134    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ebe4bd91-be4d-4d45-89f7-5aa595b9e2aa-workload-certs\") pod \"e2e-worker-w3-cf0a86-openshift-default-595bfdc58c-knt8p\" (UID: \"ebe4bd91-be4d-4d45-89f7-5aa595b9e2aa\") " pod="openshift-ingress/e2e-worker-w3-cf0a86-openshift-default-595bfdc58c-knt8p"
Oct 31 17:38:31.184668 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:38:31.179875    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ebe4bd91-be4d-4d45-89f7-5aa595b9e2aa-istio-envoy\") pod \"e2e-worker-w3-cf0a86-openshift-default-595bfdc58c-knt8p\" (UID: \"ebe4bd91-be4d-4d45-89f7-5aa595b9e2aa\") " pod="openshift-ingress/e2e-worker-w3-cf0a86-openshift-default-595bfdc58c-knt8p"
Oct 31 17:38:31.184668 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:38:31.179971    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ebe4bd91-be4d-4d45-89f7-5aa595b9e2aa-credential-socket\") pod \"e2e-worker-w3-cf0a86-openshift-default-595bfdc58c-knt8p\" (UID: \"ebe4bd91-be4d-4d45-89f7-5aa595b9e2aa\") " pod="openshift-ingress/e2e-worker-w3-cf0a86-openshift-default-595bfdc58c-knt8p"
Oct 31 17:38:31.184668 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:38:31.180033    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ebe4bd91-be4d-4d45-89f7-5aa595b9e2aa-workload-socket\") pod \"e2e-worker-w3-cf0a86-openshift-default-595bfdc58c-knt8p\" (UID: \"ebe4bd91-be4d-4d45-89f7-5aa595b9e2aa\") " pod="openshift-ingress/e2e-worker-w3-cf0a86-openshift-default-595bfdc58c-knt8p"
Oct 31 17:38:31.184668 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:38:31.180062    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ebe4bd91-be4d-4d45-89f7-5aa595b9e2aa-workload-certs\") pod \"e2e-worker-w3-cf0a86-openshift-default-595bfdc58c-knt8p\" (UID: \"ebe4bd91-be4d-4d45-89f7-5aa595b9e2aa\") " pod="openshift-ingress/e2e-worker-w3-cf0a86-openshift-default-595bfdc58c-knt8p"
Oct 31 17:38:31.184668 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:38:31.180125    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ebe4bd91-be4d-4d45-89f7-5aa595b9e2aa-istio-token\") pod \"e2e-worker-w3-cf0a86-openshift-default-595bfdc58c-knt8p\" (UID: \"ebe4bd91-be4d-4d45-89f7-5aa595b9e2aa\") " pod="openshift-ingress/e2e-worker-w3-cf0a86-openshift-default-595bfdc58c-knt8p"
Oct 31 17:38:31.184668 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:38:31.180166    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ebe4bd91-be4d-4d45-89f7-5aa595b9e2aa-istio-podinfo\") pod \"e2e-worker-w3-cf0a86-openshift-default-595bfdc58c-knt8p\" (UID: \"ebe4bd91-be4d-4d45-89f7-5aa595b9e2aa\") " pod="openshift-ingress/e2e-worker-w3-cf0a86-openshift-default-595bfdc58c-knt8p"
Oct 31 17:38:31.184668 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:38:31.180225    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ebe4bd91-be4d-4d45-89f7-5aa595b9e2aa-istiod-ca-cert\") pod \"e2e-worker-w3-cf0a86-openshift-default-595bfdc58c-knt8p\" (UID: \"ebe4bd91-be4d-4d45-89f7-5aa595b9e2aa\") " pod="openshift-ingress/e2e-worker-w3-cf0a86-openshift-default-595bfdc58c-knt8p"
Oct 31 17:38:31.184668 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:38:31.180283    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dkf5d\" (UniqueName: \"kubernetes.io/projected/ebe4bd91-be4d-4d45-89f7-5aa595b9e2aa-kube-api-access-dkf5d\") pod \"e2e-worker-w3-cf0a86-openshift-default-595bfdc58c-knt8p\" (UID: \"ebe4bd91-be4d-4d45-89f7-5aa595b9e2aa\") " pod="openshift-ingress/e2e-worker-w3-cf0a86-openshift-default-595bfdc58c-knt8p"
Oct 31 17:38:31.184668 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:38:31.180314    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ebe4bd91-be4d-4d45-89f7-5aa595b9e2aa-istio-data\") pod \"e2e-worker-w3-cf0a86-openshift-default-595bfdc58c-knt8p\" (UID: \"ebe4bd91-be4d-4d45-89f7-5aa595b9e2aa\") " pod="openshift-ingress/e2e-worker-w3-cf0a86-openshift-default-595bfdc58c-knt8p"
Oct 31 17:38:31.184668 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:38:31.180828    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ebe4bd91-be4d-4d45-89f7-5aa595b9e2aa-istio-data\") pod \"e2e-worker-w3-cf0a86-openshift-default-595bfdc58c-knt8p\" (UID: \"ebe4bd91-be4d-4d45-89f7-5aa595b9e2aa\") " pod="openshift-ingress/e2e-worker-w3-cf0a86-openshift-default-595bfdc58c-knt8p"
Oct 31 17:38:31.184668 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:38:31.182198    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ebe4bd91-be4d-4d45-89f7-5aa595b9e2aa-istiod-ca-cert\") pod \"e2e-worker-w3-cf0a86-openshift-default-595bfdc58c-knt8p\" (UID: \"ebe4bd91-be4d-4d45-89f7-5aa595b9e2aa\") " pod="openshift-ingress/e2e-worker-w3-cf0a86-openshift-default-595bfdc58c-knt8p"
Oct 31 17:38:31.184668 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:38:31.182460    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ebe4bd91-be4d-4d45-89f7-5aa595b9e2aa-workload-socket\") pod \"e2e-worker-w3-cf0a86-openshift-default-595bfdc58c-knt8p\" (UID: \"ebe4bd91-be4d-4d45-89f7-5aa595b9e2aa\") " pod="openshift-ingress/e2e-worker-w3-cf0a86-openshift-default-595bfdc58c-knt8p"
Oct 31 17:38:31.184668 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:38:31.182720    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ebe4bd91-be4d-4d45-89f7-5aa595b9e2aa-credential-socket\") pod \"e2e-worker-w3-cf0a86-openshift-default-595bfdc58c-knt8p\" (UID: \"ebe4bd91-be4d-4d45-89f7-5aa595b9e2aa\") " pod="openshift-ingress/e2e-worker-w3-cf0a86-openshift-default-595bfdc58c-knt8p"
Oct 31 17:38:31.184668 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:38:31.183163    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ebe4bd91-be4d-4d45-89f7-5aa595b9e2aa-workload-certs\") pod \"e2e-worker-w3-cf0a86-openshift-default-595bfdc58c-knt8p\" (UID: \"ebe4bd91-be4d-4d45-89f7-5aa595b9e2aa\") " pod="openshift-ingress/e2e-worker-w3-cf0a86-openshift-default-595bfdc58c-knt8p"
Oct 31 17:38:31.185854 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:38:31.185159    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ebe4bd91-be4d-4d45-89f7-5aa595b9e2aa-istio-envoy\") pod \"e2e-worker-w3-cf0a86-openshift-default-595bfdc58c-knt8p\" (UID: \"ebe4bd91-be4d-4d45-89f7-5aa595b9e2aa\") " pod="openshift-ingress/e2e-worker-w3-cf0a86-openshift-default-595bfdc58c-knt8p"
Oct 31 17:38:31.186595 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:38:31.186571    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ebe4bd91-be4d-4d45-89f7-5aa595b9e2aa-istio-podinfo\") pod \"e2e-worker-w3-cf0a86-openshift-default-595bfdc58c-knt8p\" (UID: \"ebe4bd91-be4d-4d45-89f7-5aa595b9e2aa\") " pod="openshift-ingress/e2e-worker-w3-cf0a86-openshift-default-595bfdc58c-knt8p"
Oct 31 17:38:31.200355 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:38:31.200325    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dkf5d\" (UniqueName: \"kubernetes.io/projected/ebe4bd91-be4d-4d45-89f7-5aa595b9e2aa-kube-api-access-dkf5d\") pod \"e2e-worker-w3-cf0a86-openshift-default-595bfdc58c-knt8p\" (UID: \"ebe4bd91-be4d-4d45-89f7-5aa595b9e2aa\") " pod="openshift-ingress/e2e-worker-w3-cf0a86-openshift-default-595bfdc58c-knt8p"
Oct 31 17:38:31.200629 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:38:31.200599    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ebe4bd91-be4d-4d45-89f7-5aa595b9e2aa-istio-token\") pod \"e2e-worker-w3-cf0a86-openshift-default-595bfdc58c-knt8p\" (UID: \"ebe4bd91-be4d-4d45-89f7-5aa595b9e2aa\") " pod="openshift-ingress/e2e-worker-w3-cf0a86-openshift-default-595bfdc58c-knt8p"
Oct 31 17:38:31.339594 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:38:31.339557    5003 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-cf0a86-openshift-default-595bfdc58c-knt8p"
Oct 31 17:38:31.665379 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:38:31.665290    5003 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w3-cf0a86-openshift-default-595bfdc58c-knt8p"]
Oct 31 17:38:31.677374 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:38:31.677337    5003 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Oct 31 17:38:31.677489 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:38:31.677403    5003 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Oct 31 17:38:31.677489 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:38:31.677432    5003 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Oct 31 17:38:32.436067 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:38:32.436024    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-cf0a86-openshift-default-595bfdc58c-knt8p" event={"ID":"ebe4bd91-be4d-4d45-89f7-5aa595b9e2aa","Type":"ContainerStarted","Data":"669bf380ab9a48852a83ab1bc90c18f6989affedc423c648fb7ed3c031cc4ff6"}
Oct 31 17:38:32.436458 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:38:32.436085    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-cf0a86-openshift-default-595bfdc58c-knt8p" event={"ID":"ebe4bd91-be4d-4d45-89f7-5aa595b9e2aa","Type":"ContainerStarted","Data":"75a180af3825653ec563c8c1eae578b6a809bbe8531a628c41fb65c47b91a23a"}
Oct 31 17:38:32.503550 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:38:32.503493    5003 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w3-cf0a86-openshift-default-595bfdc58c-knt8p" podStartSLOduration=2.503479197 podStartE2EDuration="2.503479197s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 17:38:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 17:38:32.49041705 +0000 UTC m=+680.745271592" watchObservedRunningTime="2026-10-31 17:38:32.503479197 +0000 UTC m=+680.758333737"
Oct 31 17:38:33.340530 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:38:33.340490    5003 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w3-cf0a86-openshift-default-595bfdc58c-knt8p"
Oct 31 17:38:33.342584 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:38:33.342554    5003 patch_prober.go:29] interesting pod/e2e-worker-w3-cf0a86-openshift-default-595bfdc58c-knt8p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused" start-of-body=
Oct 31 17:38:33.342723 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:38:33.342607    5003 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-cf0a86-openshift-default-595bfdc58c-knt8p" podUID="ebe4bd91-be4d-4d45-89f7-5aa595b9e2aa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused"
Oct 31 17:38:34.340461 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:38:34.340428    5003 patch_prober.go:29] interesting pod/e2e-worker-w3-cf0a86-openshift-default-595bfdc58c-knt8p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused" start-of-body=
Oct 31 17:38:34.340849 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:38:34.340482    5003 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-cf0a86-openshift-default-595bfdc58c-knt8p" podUID="ebe4bd91-be4d-4d45-89f7-5aa595b9e2aa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused"
Oct 31 17:38:35.343679 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:38:35.341495    5003 patch_prober.go:29] interesting pod/e2e-worker-w3-cf0a86-openshift-default-595bfdc58c-knt8p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused" start-of-body=
Oct 31 17:38:35.343679 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:38:35.341551    5003 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-cf0a86-openshift-default-595bfdc58c-knt8p" podUID="ebe4bd91-be4d-4d45-89f7-5aa595b9e2aa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused"
Oct 31 17:38:35.619846 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:38:35.619760    5003 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-bc1ad3da-t9n2g"]
Oct 31 17:38:35.626560 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:38:35.626531    5003 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-bc1ad3da-t9n2g"
Oct 31 17:38:35.642539 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:38:35.642324    5003 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-bc1ad3da-t9n2g"]
Oct 31 17:38:35.642850 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:38:35.642833    5003 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\""
Oct 31 17:38:35.648304 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:38:35.648282    5003 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-mr9x2\""
Oct 31 17:38:35.786564 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:38:35.786330    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/fc448460-87b4-41b3-b2c6-4e00d0b6e25c-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-bc1ad3da-t9n2g\" (UID: \"fc448460-87b4-41b3-b2c6-4e00d0b6e25c\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-bc1ad3da-t9n2g"
Oct 31 17:38:35.786564 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:38:35.786453    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h99wk\" (UniqueName: \"kubernetes.io/projected/fc448460-87b4-41b3-b2c6-4e00d0b6e25c-kube-api-access-h99wk\") pod \"maas-api-revoke-sub-bc1ad3da-t9n2g\" (UID: \"fc448460-87b4-41b3-b2c6-4e00d0b6e25c\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-bc1ad3da-t9n2g"
Oct 31 17:38:35.786564 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:38:35.786478    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/fc448460-87b4-41b3-b2c6-4e00d0b6e25c-maas-api-xks-ca\") pod \"maas-api-revoke-sub-bc1ad3da-t9n2g\" (UID: \"fc448460-87b4-41b3-b2c6-4e00d0b6e25c\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-bc1ad3da-t9n2g"
Oct 31 17:38:35.888736 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:38:35.887924    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h99wk\" (UniqueName: \"kubernetes.io/projected/fc448460-87b4-41b3-b2c6-4e00d0b6e25c-kube-api-access-h99wk\") pod \"maas-api-revoke-sub-bc1ad3da-t9n2g\" (UID: \"fc448460-87b4-41b3-b2c6-4e00d0b6e25c\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-bc1ad3da-t9n2g"
Oct 31 17:38:35.888736 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:38:35.887985    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/fc448460-87b4-41b3-b2c6-4e00d0b6e25c-maas-api-xks-ca\") pod \"maas-api-revoke-sub-bc1ad3da-t9n2g\" (UID: \"fc448460-87b4-41b3-b2c6-4e00d0b6e25c\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-bc1ad3da-t9n2g"
Oct 31 17:38:35.888736 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:38:35.888071    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/fc448460-87b4-41b3-b2c6-4e00d0b6e25c-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-bc1ad3da-t9n2g\" (UID: \"fc448460-87b4-41b3-b2c6-4e00d0b6e25c\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-bc1ad3da-t9n2g"
Oct 31 17:38:35.889008 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:38:35.888941    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/fc448460-87b4-41b3-b2c6-4e00d0b6e25c-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-bc1ad3da-t9n2g\" (UID: \"fc448460-87b4-41b3-b2c6-4e00d0b6e25c\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-bc1ad3da-t9n2g"
Oct 31 17:38:35.892351 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:38:35.892318    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/fc448460-87b4-41b3-b2c6-4e00d0b6e25c-maas-api-xks-ca\") pod \"maas-api-revoke-sub-bc1ad3da-t9n2g\" (UID: \"fc448460-87b4-41b3-b2c6-4e00d0b6e25c\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-bc1ad3da-t9n2g"
Oct 31 17:38:35.912484 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:38:35.912457    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h99wk\" (UniqueName: \"kubernetes.io/projected/fc448460-87b4-41b3-b2c6-4e00d0b6e25c-kube-api-access-h99wk\") pod \"maas-api-revoke-sub-bc1ad3da-t9n2g\" (UID: \"fc448460-87b4-41b3-b2c6-4e00d0b6e25c\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-bc1ad3da-t9n2g"
Oct 31 17:38:35.952179 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:38:35.952153    5003 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-bc1ad3da-t9n2g"
Oct 31 17:38:36.007683 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:38:36.002740    5003 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-d0e7e8d8-gd524"]
Oct 31 17:38:36.011632 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:38:36.011601    5003 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-d0e7e8d8-gd524"
Oct 31 17:38:36.019437 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:38:36.019397    5003 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-d0e7e8d8-gd524"]
Oct 31 17:38:36.193504 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:38:36.193421    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/3155b804-e954-4f24-b64a-4a8e67739528-maas-api-xks-ca\") pod \"maas-api-revoke-sub-d0e7e8d8-gd524\" (UID: \"3155b804-e954-4f24-b64a-4a8e67739528\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-d0e7e8d8-gd524"
Oct 31 17:38:36.193661 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:38:36.193545    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/3155b804-e954-4f24-b64a-4a8e67739528-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-d0e7e8d8-gd524\" (UID: \"3155b804-e954-4f24-b64a-4a8e67739528\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-d0e7e8d8-gd524"
Oct 31 17:38:36.193661 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:38:36.193633    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8skqs\" (UniqueName: \"kubernetes.io/projected/3155b804-e954-4f24-b64a-4a8e67739528-kube-api-access-8skqs\") pod \"maas-api-revoke-sub-d0e7e8d8-gd524\" (UID: \"3155b804-e954-4f24-b64a-4a8e67739528\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-d0e7e8d8-gd524"
Oct 31 17:38:36.295082 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:38:36.295046    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/3155b804-e954-4f24-b64a-4a8e67739528-maas-api-xks-ca\") pod \"maas-api-revoke-sub-d0e7e8d8-gd524\" (UID: \"3155b804-e954-4f24-b64a-4a8e67739528\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-d0e7e8d8-gd524"
Oct 31 17:38:36.295256 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:38:36.295150    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/3155b804-e954-4f24-b64a-4a8e67739528-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-d0e7e8d8-gd524\" (UID: \"3155b804-e954-4f24-b64a-4a8e67739528\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-d0e7e8d8-gd524"
Oct 31 17:38:36.295299 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:38:36.295281    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8skqs\" (UniqueName: \"kubernetes.io/projected/3155b804-e954-4f24-b64a-4a8e67739528-kube-api-access-8skqs\") pod \"maas-api-revoke-sub-d0e7e8d8-gd524\" (UID: \"3155b804-e954-4f24-b64a-4a8e67739528\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-d0e7e8d8-gd524"
Oct 31 17:38:36.295941 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:38:36.295920    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/3155b804-e954-4f24-b64a-4a8e67739528-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-d0e7e8d8-gd524\" (UID: \"3155b804-e954-4f24-b64a-4a8e67739528\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-d0e7e8d8-gd524"
Oct 31 17:38:36.298112 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:38:36.298086    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/3155b804-e954-4f24-b64a-4a8e67739528-maas-api-xks-ca\") pod \"maas-api-revoke-sub-d0e7e8d8-gd524\" (UID: \"3155b804-e954-4f24-b64a-4a8e67739528\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-d0e7e8d8-gd524"
Oct 31 17:38:36.314493 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:38:36.314468    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8skqs\" (UniqueName: \"kubernetes.io/projected/3155b804-e954-4f24-b64a-4a8e67739528-kube-api-access-8skqs\") pod \"maas-api-revoke-sub-d0e7e8d8-gd524\" (UID: \"3155b804-e954-4f24-b64a-4a8e67739528\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-d0e7e8d8-gd524"
Oct 31 17:38:36.332269 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:38:36.332246    5003 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-d0e7e8d8-gd524"
Oct 31 17:38:36.333817 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:38:36.333796    5003 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-bc1ad3da-t9n2g"]
Oct 31 17:38:36.335798 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:38:36.335779    5003 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc448460_87b4_41b3_b2c6_4e00d0b6e25c.slice/crio-39519478e39008c6988f2e4dc6e882d0c6b3d38bac45c214a30c66830aef2098 WatchSource:0}: Error finding container 39519478e39008c6988f2e4dc6e882d0c6b3d38bac45c214a30c66830aef2098: Status 404 returned error can't find the container with id 39519478e39008c6988f2e4dc6e882d0c6b3d38bac45c214a30c66830aef2098
Oct 31 17:38:36.340910 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:38:36.340889    5003 patch_prober.go:29] interesting pod/e2e-worker-w3-cf0a86-openshift-default-595bfdc58c-knt8p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused" start-of-body=
Oct 31 17:38:36.341006 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:38:36.340938    5003 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-cf0a86-openshift-default-595bfdc58c-knt8p" podUID="ebe4bd91-be4d-4d45-89f7-5aa595b9e2aa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused"
Oct 31 17:38:36.500014 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:38:36.499936    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-bc1ad3da-t9n2g" event={"ID":"fc448460-87b4-41b3-b2c6-4e00d0b6e25c","Type":"ContainerStarted","Data":"39519478e39008c6988f2e4dc6e882d0c6b3d38bac45c214a30c66830aef2098"}
Oct 31 17:38:36.679677 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:38:36.679632    5003 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-d0e7e8d8-gd524"]
Oct 31 17:38:36.682263 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:38:36.682229    5003 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3155b804_e954_4f24_b64a_4a8e67739528.slice/crio-5ccb446ef4ee697c2a45cfb06b0bf353ff3a00f19095e52fba71fbb69583e7d4 WatchSource:0}: Error finding container 5ccb446ef4ee697c2a45cfb06b0bf353ff3a00f19095e52fba71fbb69583e7d4: Status 404 returned error can't find the container with id 5ccb446ef4ee697c2a45cfb06b0bf353ff3a00f19095e52fba71fbb69583e7d4
Oct 31 17:38:37.339986 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:38:37.339953    5003 patch_prober.go:29] interesting pod/e2e-worker-w3-cf0a86-openshift-default-595bfdc58c-knt8p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused" start-of-body=
Oct 31 17:38:37.340145 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:38:37.340004    5003 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-cf0a86-openshift-default-595bfdc58c-knt8p" podUID="ebe4bd91-be4d-4d45-89f7-5aa595b9e2aa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused"
Oct 31 17:38:37.515476 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:38:37.515390    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-d0e7e8d8-gd524" event={"ID":"3155b804-e954-4f24-b64a-4a8e67739528","Type":"ContainerStarted","Data":"5ccb446ef4ee697c2a45cfb06b0bf353ff3a00f19095e52fba71fbb69583e7d4"}
Oct 31 17:38:38.341008 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:38:38.340550    5003 patch_prober.go:29] interesting pod/e2e-worker-w3-cf0a86-openshift-default-595bfdc58c-knt8p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused" start-of-body=
Oct 31 17:38:38.341008 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:38:38.340612    5003 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-cf0a86-openshift-default-595bfdc58c-knt8p" podUID="ebe4bd91-be4d-4d45-89f7-5aa595b9e2aa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused"
Oct 31 17:38:39.344864 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:38:39.344840    5003 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w3-cf0a86-openshift-default-595bfdc58c-knt8p"
Oct 31 17:38:39.345249 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:38:39.345229    5003 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w3-cf0a86-openshift-default-595bfdc58c-knt8p"
Oct 31 17:38:39.346041 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:38:39.346024    5003 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w3-cf0a86-openshift-default-595bfdc58c-knt8p"
Oct 31 17:38:40.336546 ip-10-0-138-17 kubenswrapper[5003]: E1031 17:38:40.336507    5003 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-tdzz5" containerName="extractor"
Oct 31 17:38:40.549073 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:38:40.548976    5003 generic.go:356] "Generic (PLEG): container finished" podID="fc448460-87b4-41b3-b2c6-4e00d0b6e25c" containerID="e737295d87d4ee1ef9ca5b078612daaf5f9412bc97606d8aa72583916acc159c" exitCode=0
Oct 31 17:38:40.549513 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:38:40.549074    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-bc1ad3da-t9n2g" event={"ID":"fc448460-87b4-41b3-b2c6-4e00d0b6e25c","Type":"ContainerDied","Data":"e737295d87d4ee1ef9ca5b078612daaf5f9412bc97606d8aa72583916acc159c"}
Oct 31 17:38:40.550871 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:38:40.550850    5003 generic.go:356] "Generic (PLEG): container finished" podID="3155b804-e954-4f24-b64a-4a8e67739528" containerID="cbfe8e5316d5b8fb15ec28e7900ef30104ecc94d6a3a2ddd0fe1422fa5787a2d" exitCode=0
Oct 31 17:38:40.550970 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:38:40.550923    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-d0e7e8d8-gd524" event={"ID":"3155b804-e954-4f24-b64a-4a8e67739528","Type":"ContainerDied","Data":"cbfe8e5316d5b8fb15ec28e7900ef30104ecc94d6a3a2ddd0fe1422fa5787a2d"}
Oct 31 17:38:41.720230 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:38:41.720205    5003 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-bc1ad3da-t9n2g"
Oct 31 17:38:41.750399 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:38:41.750374    5003 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-d0e7e8d8-gd524"
Oct 31 17:38:41.870851 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:38:41.870764    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/fc448460-87b4-41b3-b2c6-4e00d0b6e25c-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/fc448460-87b4-41b3-b2c6-4e00d0b6e25c-maas-api-openshift-ca\") pod \"fc448460-87b4-41b3-b2c6-4e00d0b6e25c\" (UID: \"fc448460-87b4-41b3-b2c6-4e00d0b6e25c\") "
Oct 31 17:38:41.870851 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:38:41.870829    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/3155b804-e954-4f24-b64a-4a8e67739528-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/3155b804-e954-4f24-b64a-4a8e67739528-maas-api-xks-ca\") pod \"3155b804-e954-4f24-b64a-4a8e67739528\" (UID: \"3155b804-e954-4f24-b64a-4a8e67739528\") "
Oct 31 17:38:41.871060 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:38:41.870960    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/3155b804-e954-4f24-b64a-4a8e67739528-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/3155b804-e954-4f24-b64a-4a8e67739528-maas-api-openshift-ca\") pod \"3155b804-e954-4f24-b64a-4a8e67739528\" (UID: \"3155b804-e954-4f24-b64a-4a8e67739528\") "
Oct 31 17:38:41.871060 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:38:41.871028    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/fc448460-87b4-41b3-b2c6-4e00d0b6e25c-kube-api-access-h99wk\" (UniqueName: \"kubernetes.io/projected/fc448460-87b4-41b3-b2c6-4e00d0b6e25c-kube-api-access-h99wk\") pod \"fc448460-87b4-41b3-b2c6-4e00d0b6e25c\" (UID: \"fc448460-87b4-41b3-b2c6-4e00d0b6e25c\") "
Oct 31 17:38:41.871176 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:38:41.871119    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/3155b804-e954-4f24-b64a-4a8e67739528-kube-api-access-8skqs\" (UniqueName: \"kubernetes.io/projected/3155b804-e954-4f24-b64a-4a8e67739528-kube-api-access-8skqs\") pod \"3155b804-e954-4f24-b64a-4a8e67739528\" (UID: \"3155b804-e954-4f24-b64a-4a8e67739528\") "
Oct 31 17:38:41.871237 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:38:41.871189    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/fc448460-87b4-41b3-b2c6-4e00d0b6e25c-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/fc448460-87b4-41b3-b2c6-4e00d0b6e25c-maas-api-xks-ca\") pod \"fc448460-87b4-41b3-b2c6-4e00d0b6e25c\" (UID: \"fc448460-87b4-41b3-b2c6-4e00d0b6e25c\") "
Oct 31 17:38:41.871293 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:38:41.871262    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fc448460-87b4-41b3-b2c6-4e00d0b6e25c-maas-api-openshift-ca" pod "fc448460-87b4-41b3-b2c6-4e00d0b6e25c" (UID: "fc448460-87b4-41b3-b2c6-4e00d0b6e25c"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 17:38:41.871528 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:38:41.871504    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3155b804-e954-4f24-b64a-4a8e67739528-maas-api-openshift-ca" pod "3155b804-e954-4f24-b64a-4a8e67739528" (UID: "3155b804-e954-4f24-b64a-4a8e67739528"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 17:38:41.871776 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:38:41.871722    5003 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/fc448460-87b4-41b3-b2c6-4e00d0b6e25c-maas-api-openshift-ca\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:38:41.871776 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:38:41.871744    5003 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/3155b804-e954-4f24-b64a-4a8e67739528-maas-api-openshift-ca\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:38:41.874986 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:38:41.874941    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3155b804-e954-4f24-b64a-4a8e67739528-kube-api-access-8skqs" pod "3155b804-e954-4f24-b64a-4a8e67739528" (UID: "3155b804-e954-4f24-b64a-4a8e67739528"). InnerVolumeSpecName "kube-api-access-8skqs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 17:38:41.928743 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:38:41.922388    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fc448460-87b4-41b3-b2c6-4e00d0b6e25c-kube-api-access-h99wk" pod "fc448460-87b4-41b3-b2c6-4e00d0b6e25c" (UID: "fc448460-87b4-41b3-b2c6-4e00d0b6e25c"). InnerVolumeSpecName "kube-api-access-h99wk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 17:38:41.928743 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:38:41.922481    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fc448460-87b4-41b3-b2c6-4e00d0b6e25c-maas-api-xks-ca" pod "fc448460-87b4-41b3-b2c6-4e00d0b6e25c" (UID: "fc448460-87b4-41b3-b2c6-4e00d0b6e25c"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 17:38:41.928743 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:38:41.922534    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3155b804-e954-4f24-b64a-4a8e67739528-maas-api-xks-ca" pod "3155b804-e954-4f24-b64a-4a8e67739528" (UID: "3155b804-e954-4f24-b64a-4a8e67739528"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 17:38:41.973069 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:38:41.973028    5003 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h99wk\" (UniqueName: \"kubernetes.io/projected/fc448460-87b4-41b3-b2c6-4e00d0b6e25c-kube-api-access-h99wk\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:38:41.973069 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:38:41.973060    5003 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8skqs\" (UniqueName: \"kubernetes.io/projected/3155b804-e954-4f24-b64a-4a8e67739528-kube-api-access-8skqs\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:38:41.973069 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:38:41.973074    5003 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/fc448460-87b4-41b3-b2c6-4e00d0b6e25c-maas-api-xks-ca\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:38:41.973280 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:38:41.973087    5003 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/3155b804-e954-4f24-b64a-4a8e67739528-maas-api-xks-ca\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:38:42.572469 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:38:42.572425    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-d0e7e8d8-gd524" event={"ID":"3155b804-e954-4f24-b64a-4a8e67739528","Type":"ContainerDied","Data":"5ccb446ef4ee697c2a45cfb06b0bf353ff3a00f19095e52fba71fbb69583e7d4"}
Oct 31 17:38:42.572687 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:38:42.572494    5003 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5ccb446ef4ee697c2a45cfb06b0bf353ff3a00f19095e52fba71fbb69583e7d4"
Oct 31 17:38:42.572687 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:38:42.572574    5003 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-d0e7e8d8-gd524"
Oct 31 17:38:42.574659 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:38:42.574615    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-bc1ad3da-t9n2g" event={"ID":"fc448460-87b4-41b3-b2c6-4e00d0b6e25c","Type":"ContainerDied","Data":"39519478e39008c6988f2e4dc6e882d0c6b3d38bac45c214a30c66830aef2098"}
Oct 31 17:38:42.574835 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:38:42.574815    5003 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="39519478e39008c6988f2e4dc6e882d0c6b3d38bac45c214a30c66830aef2098"
Oct 31 17:38:42.574998 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:38:42.574984    5003 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-bc1ad3da-t9n2g"
Oct 31 17:38:50.271503 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:38:50.271464    5003 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-919cd635-fcsdj"]
Oct 31 17:38:50.272026 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:38:50.272011    5003 cpu_manager.go:414] "containerMap: removing container" podUID="fc448460-87b4-41b3-b2c6-4e00d0b6e25c" containerName="revoke-keys"
Oct 31 17:38:50.272026 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:38:50.272026    5003 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="fc448460-87b4-41b3-b2c6-4e00d0b6e25c" containerName="revoke-keys"
Oct 31 17:38:50.272098 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:38:50.272044    5003 cpu_manager.go:414] "containerMap: removing container" podUID="3155b804-e954-4f24-b64a-4a8e67739528" containerName="revoke-keys"
Oct 31 17:38:50.272098 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:38:50.272049    5003 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="3155b804-e954-4f24-b64a-4a8e67739528" containerName="revoke-keys"
Oct 31 17:38:50.272162 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:38:50.272144    5003 memory_manager.go:365] "RemoveStaleState removing state" podUID="fc448460-87b4-41b3-b2c6-4e00d0b6e25c" containerName="revoke-keys"
Oct 31 17:38:50.272162 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:38:50.272154    5003 memory_manager.go:365] "RemoveStaleState removing state" podUID="3155b804-e954-4f24-b64a-4a8e67739528" containerName="revoke-keys"
Oct 31 17:38:50.277430 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:38:50.277411    5003 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-919cd635-fcsdj"
Oct 31 17:38:50.299742 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:38:50.299714    5003 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\""
Oct 31 17:38:50.299904 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:38:50.299887    5003 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-mr9x2\""
Oct 31 17:38:50.315542 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:38:50.315513    5003 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-919cd635-fcsdj"]
Oct 31 17:38:50.363982 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:38:50.363952    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/a37e40b6-68ba-4367-8cf2-b9b19746a86c-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-919cd635-fcsdj\" (UID: \"a37e40b6-68ba-4367-8cf2-b9b19746a86c\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-919cd635-fcsdj"
Oct 31 17:38:50.364150 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:38:50.364018    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-swqx7\" (UniqueName: \"kubernetes.io/projected/a37e40b6-68ba-4367-8cf2-b9b19746a86c-kube-api-access-swqx7\") pod \"maas-api-revoke-sub-919cd635-fcsdj\" (UID: \"a37e40b6-68ba-4367-8cf2-b9b19746a86c\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-919cd635-fcsdj"
Oct 31 17:38:50.364242 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:38:50.364220    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/a37e40b6-68ba-4367-8cf2-b9b19746a86c-maas-api-xks-ca\") pod \"maas-api-revoke-sub-919cd635-fcsdj\" (UID: \"a37e40b6-68ba-4367-8cf2-b9b19746a86c\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-919cd635-fcsdj"
Oct 31 17:38:50.465122 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:38:50.465086    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/a37e40b6-68ba-4367-8cf2-b9b19746a86c-maas-api-xks-ca\") pod \"maas-api-revoke-sub-919cd635-fcsdj\" (UID: \"a37e40b6-68ba-4367-8cf2-b9b19746a86c\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-919cd635-fcsdj"
Oct 31 17:38:50.465304 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:38:50.465164    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/a37e40b6-68ba-4367-8cf2-b9b19746a86c-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-919cd635-fcsdj\" (UID: \"a37e40b6-68ba-4367-8cf2-b9b19746a86c\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-919cd635-fcsdj"
Oct 31 17:38:50.465304 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:38:50.465206    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-swqx7\" (UniqueName: \"kubernetes.io/projected/a37e40b6-68ba-4367-8cf2-b9b19746a86c-kube-api-access-swqx7\") pod \"maas-api-revoke-sub-919cd635-fcsdj\" (UID: \"a37e40b6-68ba-4367-8cf2-b9b19746a86c\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-919cd635-fcsdj"
Oct 31 17:38:50.465895 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:38:50.465861    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/a37e40b6-68ba-4367-8cf2-b9b19746a86c-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-919cd635-fcsdj\" (UID: \"a37e40b6-68ba-4367-8cf2-b9b19746a86c\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-919cd635-fcsdj"
Oct 31 17:38:50.467496 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:38:50.467473    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/a37e40b6-68ba-4367-8cf2-b9b19746a86c-maas-api-xks-ca\") pod \"maas-api-revoke-sub-919cd635-fcsdj\" (UID: \"a37e40b6-68ba-4367-8cf2-b9b19746a86c\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-919cd635-fcsdj"
Oct 31 17:38:50.485199 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:38:50.485165    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-swqx7\" (UniqueName: \"kubernetes.io/projected/a37e40b6-68ba-4367-8cf2-b9b19746a86c-kube-api-access-swqx7\") pod \"maas-api-revoke-sub-919cd635-fcsdj\" (UID: \"a37e40b6-68ba-4367-8cf2-b9b19746a86c\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-919cd635-fcsdj"
Oct 31 17:38:50.591018 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:38:50.590990    5003 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-919cd635-fcsdj"
Oct 31 17:38:50.890058 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:38:50.889827    5003 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-919cd635-fcsdj"]
Oct 31 17:38:50.892465 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:38:50.892424    5003 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda37e40b6_68ba_4367_8cf2_b9b19746a86c.slice/crio-745ca282534342d37184891e1a9936fae4d1a62272e1d5409d74b1d44775522d WatchSource:0}: Error finding container 745ca282534342d37184891e1a9936fae4d1a62272e1d5409d74b1d44775522d: Status 404 returned error can't find the container with id 745ca282534342d37184891e1a9936fae4d1a62272e1d5409d74b1d44775522d
Oct 31 17:38:51.633734 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:38:51.633689    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-919cd635-fcsdj" event={"ID":"a37e40b6-68ba-4367-8cf2-b9b19746a86c","Type":"ContainerStarted","Data":"99e54b621c20b6501d3c6ed9e27bc9b5e12a81714abcb34c84752a9e69115e6c"}
Oct 31 17:38:51.634165 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:38:51.633755    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-919cd635-fcsdj" event={"ID":"a37e40b6-68ba-4367-8cf2-b9b19746a86c","Type":"ContainerStarted","Data":"745ca282534342d37184891e1a9936fae4d1a62272e1d5409d74b1d44775522d"}
Oct 31 17:38:51.687669 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:38:51.683820    5003 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-sub-919cd635-fcsdj" podStartSLOduration=1.683786529 podStartE2EDuration="1.683786529s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 17:38:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 17:38:51.677884324 +0000 UTC m=+699.932738866" watchObservedRunningTime="2026-10-31 17:38:51.683786529 +0000 UTC m=+699.938641069"
Oct 31 17:38:52.642746 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:38:52.642708    5003 generic.go:356] "Generic (PLEG): container finished" podID="a37e40b6-68ba-4367-8cf2-b9b19746a86c" containerID="99e54b621c20b6501d3c6ed9e27bc9b5e12a81714abcb34c84752a9e69115e6c" exitCode=0
Oct 31 17:38:52.643146 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:38:52.642782    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-919cd635-fcsdj" event={"ID":"a37e40b6-68ba-4367-8cf2-b9b19746a86c","Type":"ContainerDied","Data":"99e54b621c20b6501d3c6ed9e27bc9b5e12a81714abcb34c84752a9e69115e6c"}
Oct 31 17:38:52.740696 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:38:52.740662    5003 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-2889a968-f6cjs"]
Oct 31 17:38:52.745914 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:38:52.745854    5003 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-2889a968-f6cjs"
Oct 31 17:38:52.762277 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:38:52.762245    5003 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-2889a968-f6cjs"]
Oct 31 17:38:52.840689 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:38:52.840631    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/648faf0c-2e71-4e54-a4e6-272fe66e3ff5-maas-api-xks-ca\") pod \"maas-api-revoke-sub-2889a968-f6cjs\" (UID: \"648faf0c-2e71-4e54-a4e6-272fe66e3ff5\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-2889a968-f6cjs"
Oct 31 17:38:52.840852 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:38:52.840790    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/648faf0c-2e71-4e54-a4e6-272fe66e3ff5-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-2889a968-f6cjs\" (UID: \"648faf0c-2e71-4e54-a4e6-272fe66e3ff5\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-2889a968-f6cjs"
Oct 31 17:38:52.840852 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:38:52.840832    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mprk7\" (UniqueName: \"kubernetes.io/projected/648faf0c-2e71-4e54-a4e6-272fe66e3ff5-kube-api-access-mprk7\") pod \"maas-api-revoke-sub-2889a968-f6cjs\" (UID: \"648faf0c-2e71-4e54-a4e6-272fe66e3ff5\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-2889a968-f6cjs"
Oct 31 17:38:52.942735 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:38:52.942600    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/648faf0c-2e71-4e54-a4e6-272fe66e3ff5-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-2889a968-f6cjs\" (UID: \"648faf0c-2e71-4e54-a4e6-272fe66e3ff5\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-2889a968-f6cjs"
Oct 31 17:38:52.942735 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:38:52.942663    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mprk7\" (UniqueName: \"kubernetes.io/projected/648faf0c-2e71-4e54-a4e6-272fe66e3ff5-kube-api-access-mprk7\") pod \"maas-api-revoke-sub-2889a968-f6cjs\" (UID: \"648faf0c-2e71-4e54-a4e6-272fe66e3ff5\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-2889a968-f6cjs"
Oct 31 17:38:52.942971 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:38:52.942812    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/648faf0c-2e71-4e54-a4e6-272fe66e3ff5-maas-api-xks-ca\") pod \"maas-api-revoke-sub-2889a968-f6cjs\" (UID: \"648faf0c-2e71-4e54-a4e6-272fe66e3ff5\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-2889a968-f6cjs"
Oct 31 17:38:52.943403 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:38:52.943372    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/648faf0c-2e71-4e54-a4e6-272fe66e3ff5-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-2889a968-f6cjs\" (UID: \"648faf0c-2e71-4e54-a4e6-272fe66e3ff5\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-2889a968-f6cjs"
Oct 31 17:38:52.945146 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:38:52.945125    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/648faf0c-2e71-4e54-a4e6-272fe66e3ff5-maas-api-xks-ca\") pod \"maas-api-revoke-sub-2889a968-f6cjs\" (UID: \"648faf0c-2e71-4e54-a4e6-272fe66e3ff5\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-2889a968-f6cjs"
Oct 31 17:38:52.960928 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:38:52.960898    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mprk7\" (UniqueName: \"kubernetes.io/projected/648faf0c-2e71-4e54-a4e6-272fe66e3ff5-kube-api-access-mprk7\") pod \"maas-api-revoke-sub-2889a968-f6cjs\" (UID: \"648faf0c-2e71-4e54-a4e6-272fe66e3ff5\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-2889a968-f6cjs"
Oct 31 17:38:53.060619 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:38:53.060585    5003 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-2889a968-f6cjs"
Oct 31 17:38:53.372662 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:38:53.372613    5003 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-2889a968-f6cjs"]
Oct 31 17:38:53.376379 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:38:53.376336    5003 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod648faf0c_2e71_4e54_a4e6_272fe66e3ff5.slice/crio-0aeb49fa55233b4332c6ce559d4f943d6ae320c8391b257d98f7a55fb314c88f WatchSource:0}: Error finding container 0aeb49fa55233b4332c6ce559d4f943d6ae320c8391b257d98f7a55fb314c88f: Status 404 returned error can't find the container with id 0aeb49fa55233b4332c6ce559d4f943d6ae320c8391b257d98f7a55fb314c88f
Oct 31 17:38:53.650851 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:38:53.650756    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-2889a968-f6cjs" event={"ID":"648faf0c-2e71-4e54-a4e6-272fe66e3ff5","Type":"ContainerStarted","Data":"0aeb49fa55233b4332c6ce559d4f943d6ae320c8391b257d98f7a55fb314c88f"}
Oct 31 17:38:53.789052 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:38:53.789024    5003 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-919cd635-fcsdj"
Oct 31 17:38:53.953723 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:38:53.953608    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/a37e40b6-68ba-4367-8cf2-b9b19746a86c-kube-api-access-swqx7\" (UniqueName: \"kubernetes.io/projected/a37e40b6-68ba-4367-8cf2-b9b19746a86c-kube-api-access-swqx7\") pod \"a37e40b6-68ba-4367-8cf2-b9b19746a86c\" (UID: \"a37e40b6-68ba-4367-8cf2-b9b19746a86c\") "
Oct 31 17:38:53.953896 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:38:53.953729    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/a37e40b6-68ba-4367-8cf2-b9b19746a86c-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/a37e40b6-68ba-4367-8cf2-b9b19746a86c-maas-api-openshift-ca\") pod \"a37e40b6-68ba-4367-8cf2-b9b19746a86c\" (UID: \"a37e40b6-68ba-4367-8cf2-b9b19746a86c\") "
Oct 31 17:38:53.953958 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:38:53.953898    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/a37e40b6-68ba-4367-8cf2-b9b19746a86c-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/a37e40b6-68ba-4367-8cf2-b9b19746a86c-maas-api-xks-ca\") pod \"a37e40b6-68ba-4367-8cf2-b9b19746a86c\" (UID: \"a37e40b6-68ba-4367-8cf2-b9b19746a86c\") "
Oct 31 17:38:53.954174 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:38:53.954139    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a37e40b6-68ba-4367-8cf2-b9b19746a86c-maas-api-openshift-ca" pod "a37e40b6-68ba-4367-8cf2-b9b19746a86c" (UID: "a37e40b6-68ba-4367-8cf2-b9b19746a86c"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 17:38:53.954505 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:38:53.954421    5003 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/a37e40b6-68ba-4367-8cf2-b9b19746a86c-maas-api-openshift-ca\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:38:53.956397 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:38:53.956356    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a37e40b6-68ba-4367-8cf2-b9b19746a86c-maas-api-xks-ca" pod "a37e40b6-68ba-4367-8cf2-b9b19746a86c" (UID: "a37e40b6-68ba-4367-8cf2-b9b19746a86c"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 17:38:53.956502 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:38:53.956479    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a37e40b6-68ba-4367-8cf2-b9b19746a86c-kube-api-access-swqx7" pod "a37e40b6-68ba-4367-8cf2-b9b19746a86c" (UID: "a37e40b6-68ba-4367-8cf2-b9b19746a86c"). InnerVolumeSpecName "kube-api-access-swqx7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 17:38:54.055299 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:38:54.055268    5003 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/a37e40b6-68ba-4367-8cf2-b9b19746a86c-maas-api-xks-ca\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:38:54.055299 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:38:54.055298    5003 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-swqx7\" (UniqueName: \"kubernetes.io/projected/a37e40b6-68ba-4367-8cf2-b9b19746a86c-kube-api-access-swqx7\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:38:54.659512 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:38:54.659467    5003 generic.go:356] "Generic (PLEG): container finished" podID="648faf0c-2e71-4e54-a4e6-272fe66e3ff5" containerID="764b8a3bbab58627f298e3275d2a9071b3f1631daee74e65c189e648e2815d0a" exitCode=0
Oct 31 17:38:54.659512 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:38:54.659505    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-2889a968-f6cjs" event={"ID":"648faf0c-2e71-4e54-a4e6-272fe66e3ff5","Type":"ContainerDied","Data":"764b8a3bbab58627f298e3275d2a9071b3f1631daee74e65c189e648e2815d0a"}
Oct 31 17:38:54.661542 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:38:54.661522    5003 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-919cd635-fcsdj"
Oct 31 17:38:54.661704 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:38:54.661558    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-919cd635-fcsdj" event={"ID":"a37e40b6-68ba-4367-8cf2-b9b19746a86c","Type":"ContainerDied","Data":"745ca282534342d37184891e1a9936fae4d1a62272e1d5409d74b1d44775522d"}
Oct 31 17:38:54.661704 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:38:54.661602    5003 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="745ca282534342d37184891e1a9936fae4d1a62272e1d5409d74b1d44775522d"
Oct 31 17:38:55.816447 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:38:55.816423    5003 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-2889a968-f6cjs"
Oct 31 17:38:55.975484 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:38:55.975407    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/648faf0c-2e71-4e54-a4e6-272fe66e3ff5-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/648faf0c-2e71-4e54-a4e6-272fe66e3ff5-maas-api-openshift-ca\") pod \"648faf0c-2e71-4e54-a4e6-272fe66e3ff5\" (UID: \"648faf0c-2e71-4e54-a4e6-272fe66e3ff5\") "
Oct 31 17:38:55.975484 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:38:55.975463    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/648faf0c-2e71-4e54-a4e6-272fe66e3ff5-kube-api-access-mprk7\" (UniqueName: \"kubernetes.io/projected/648faf0c-2e71-4e54-a4e6-272fe66e3ff5-kube-api-access-mprk7\") pod \"648faf0c-2e71-4e54-a4e6-272fe66e3ff5\" (UID: \"648faf0c-2e71-4e54-a4e6-272fe66e3ff5\") "
Oct 31 17:38:55.975696 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:38:55.975563    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/648faf0c-2e71-4e54-a4e6-272fe66e3ff5-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/648faf0c-2e71-4e54-a4e6-272fe66e3ff5-maas-api-xks-ca\") pod \"648faf0c-2e71-4e54-a4e6-272fe66e3ff5\" (UID: \"648faf0c-2e71-4e54-a4e6-272fe66e3ff5\") "
Oct 31 17:38:55.975873 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:38:55.975843    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/648faf0c-2e71-4e54-a4e6-272fe66e3ff5-maas-api-openshift-ca" pod "648faf0c-2e71-4e54-a4e6-272fe66e3ff5" (UID: "648faf0c-2e71-4e54-a4e6-272fe66e3ff5"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 17:38:55.976046 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:38:55.976019    5003 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/648faf0c-2e71-4e54-a4e6-272fe66e3ff5-maas-api-openshift-ca\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:38:55.977681 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:38:55.977631    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/648faf0c-2e71-4e54-a4e6-272fe66e3ff5-kube-api-access-mprk7" pod "648faf0c-2e71-4e54-a4e6-272fe66e3ff5" (UID: "648faf0c-2e71-4e54-a4e6-272fe66e3ff5"). InnerVolumeSpecName "kube-api-access-mprk7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 17:38:55.977792 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:38:55.977689    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/648faf0c-2e71-4e54-a4e6-272fe66e3ff5-maas-api-xks-ca" pod "648faf0c-2e71-4e54-a4e6-272fe66e3ff5" (UID: "648faf0c-2e71-4e54-a4e6-272fe66e3ff5"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 17:38:56.076967 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:38:56.076938    5003 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mprk7\" (UniqueName: \"kubernetes.io/projected/648faf0c-2e71-4e54-a4e6-272fe66e3ff5-kube-api-access-mprk7\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:38:56.076967 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:38:56.076965    5003 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/648faf0c-2e71-4e54-a4e6-272fe66e3ff5-maas-api-xks-ca\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:38:56.674839 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:38:56.674810    5003 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-2889a968-f6cjs"
Oct 31 17:38:56.675009 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:38:56.674847    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-2889a968-f6cjs" event={"ID":"648faf0c-2e71-4e54-a4e6-272fe66e3ff5","Type":"ContainerDied","Data":"0aeb49fa55233b4332c6ce559d4f943d6ae320c8391b257d98f7a55fb314c88f"}
Oct 31 17:38:56.675009 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:38:56.674937    5003 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0aeb49fa55233b4332c6ce559d4f943d6ae320c8391b257d98f7a55fb314c88f"
Oct 31 17:38:57.337161 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:38:57.337131    5003 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-8ad4e6ed-xlf2v"]
Oct 31 17:38:57.337686 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:38:57.337671    5003 cpu_manager.go:414] "containerMap: removing container" podUID="648faf0c-2e71-4e54-a4e6-272fe66e3ff5" containerName="revoke-keys"
Oct 31 17:38:57.337736 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:38:57.337687    5003 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="648faf0c-2e71-4e54-a4e6-272fe66e3ff5" containerName="revoke-keys"
Oct 31 17:38:57.337736 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:38:57.337704    5003 cpu_manager.go:414] "containerMap: removing container" podUID="a37e40b6-68ba-4367-8cf2-b9b19746a86c" containerName="revoke-keys"
Oct 31 17:38:57.337736 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:38:57.337709    5003 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="a37e40b6-68ba-4367-8cf2-b9b19746a86c" containerName="revoke-keys"
Oct 31 17:38:57.337834 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:38:57.337811    5003 memory_manager.go:365] "RemoveStaleState removing state" podUID="648faf0c-2e71-4e54-a4e6-272fe66e3ff5" containerName="revoke-keys"
Oct 31 17:38:57.337834 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:38:57.337821    5003 memory_manager.go:365] "RemoveStaleState removing state" podUID="a37e40b6-68ba-4367-8cf2-b9b19746a86c" containerName="revoke-keys"
Oct 31 17:38:57.343562 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:38:57.343536    5003 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-8ad4e6ed-xlf2v"
Oct 31 17:38:57.360313 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:38:57.360283    5003 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-8ad4e6ed-xlf2v"]
Oct 31 17:38:57.366946 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:38:57.366920    5003 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-mr9x2\""
Oct 31 17:38:57.367159 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:38:57.367143    5003 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\""
Oct 31 17:38:57.493044 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:38:57.493004    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/1d7b028c-1d18-4968-88ec-de1d9819ecb0-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-8ad4e6ed-xlf2v\" (UID: \"1d7b028c-1d18-4968-88ec-de1d9819ecb0\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-8ad4e6ed-xlf2v"
Oct 31 17:38:57.493218 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:38:57.493075    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jcsfd\" (UniqueName: \"kubernetes.io/projected/1d7b028c-1d18-4968-88ec-de1d9819ecb0-kube-api-access-jcsfd\") pod \"maas-api-revoke-sub-8ad4e6ed-xlf2v\" (UID: \"1d7b028c-1d18-4968-88ec-de1d9819ecb0\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-8ad4e6ed-xlf2v"
Oct 31 17:38:57.493218 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:38:57.493138    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/1d7b028c-1d18-4968-88ec-de1d9819ecb0-maas-api-xks-ca\") pod \"maas-api-revoke-sub-8ad4e6ed-xlf2v\" (UID: \"1d7b028c-1d18-4968-88ec-de1d9819ecb0\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-8ad4e6ed-xlf2v"
Oct 31 17:38:57.594176 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:38:57.594105    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/1d7b028c-1d18-4968-88ec-de1d9819ecb0-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-8ad4e6ed-xlf2v\" (UID: \"1d7b028c-1d18-4968-88ec-de1d9819ecb0\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-8ad4e6ed-xlf2v"
Oct 31 17:38:57.594176 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:38:57.594169    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jcsfd\" (UniqueName: \"kubernetes.io/projected/1d7b028c-1d18-4968-88ec-de1d9819ecb0-kube-api-access-jcsfd\") pod \"maas-api-revoke-sub-8ad4e6ed-xlf2v\" (UID: \"1d7b028c-1d18-4968-88ec-de1d9819ecb0\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-8ad4e6ed-xlf2v"
Oct 31 17:38:57.594402 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:38:57.594210    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/1d7b028c-1d18-4968-88ec-de1d9819ecb0-maas-api-xks-ca\") pod \"maas-api-revoke-sub-8ad4e6ed-xlf2v\" (UID: \"1d7b028c-1d18-4968-88ec-de1d9819ecb0\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-8ad4e6ed-xlf2v"
Oct 31 17:38:57.594826 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:38:57.594800    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/1d7b028c-1d18-4968-88ec-de1d9819ecb0-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-8ad4e6ed-xlf2v\" (UID: \"1d7b028c-1d18-4968-88ec-de1d9819ecb0\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-8ad4e6ed-xlf2v"
Oct 31 17:38:57.596559 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:38:57.596533    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/1d7b028c-1d18-4968-88ec-de1d9819ecb0-maas-api-xks-ca\") pod \"maas-api-revoke-sub-8ad4e6ed-xlf2v\" (UID: \"1d7b028c-1d18-4968-88ec-de1d9819ecb0\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-8ad4e6ed-xlf2v"
Oct 31 17:38:57.612418 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:38:57.612393    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jcsfd\" (UniqueName: \"kubernetes.io/projected/1d7b028c-1d18-4968-88ec-de1d9819ecb0-kube-api-access-jcsfd\") pod \"maas-api-revoke-sub-8ad4e6ed-xlf2v\" (UID: \"1d7b028c-1d18-4968-88ec-de1d9819ecb0\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-8ad4e6ed-xlf2v"
Oct 31 17:38:57.661582 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:38:57.661550    5003 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-8ad4e6ed-xlf2v"
Oct 31 17:38:57.973790 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:38:57.973709    5003 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-8ad4e6ed-xlf2v"]
Oct 31 17:38:57.978058 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:38:57.978012    5003 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1d7b028c_1d18_4968_88ec_de1d9819ecb0.slice/crio-93cfa2aa86792c881c8df52b94e01f6f624e28e94354ba644a8a8b2d79c05a14 WatchSource:0}: Error finding container 93cfa2aa86792c881c8df52b94e01f6f624e28e94354ba644a8a8b2d79c05a14: Status 404 returned error can't find the container with id 93cfa2aa86792c881c8df52b94e01f6f624e28e94354ba644a8a8b2d79c05a14
Oct 31 17:38:58.690496 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:38:58.690457    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-8ad4e6ed-xlf2v" event={"ID":"1d7b028c-1d18-4968-88ec-de1d9819ecb0","Type":"ContainerStarted","Data":"793e072a4a88cf9226e1b2c71f264307d507ebd3c4a49af84f79e15ab7fa0cb8"}
Oct 31 17:38:58.691005 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:38:58.690524    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-8ad4e6ed-xlf2v" event={"ID":"1d7b028c-1d18-4968-88ec-de1d9819ecb0","Type":"ContainerStarted","Data":"93cfa2aa86792c881c8df52b94e01f6f624e28e94354ba644a8a8b2d79c05a14"}
Oct 31 17:38:58.726474 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:38:58.726426    5003 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-sub-8ad4e6ed-xlf2v" podStartSLOduration=1.7264139269999998 podStartE2EDuration="1.726413927s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 17:38:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 17:38:58.725866438 +0000 UTC m=+706.980720979" watchObservedRunningTime="2026-10-31 17:38:58.726413927 +0000 UTC m=+706.981268460"
Oct 31 17:38:59.700049 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:38:59.700013    5003 generic.go:356] "Generic (PLEG): container finished" podID="1d7b028c-1d18-4968-88ec-de1d9819ecb0" containerID="793e072a4a88cf9226e1b2c71f264307d507ebd3c4a49af84f79e15ab7fa0cb8" exitCode=0
Oct 31 17:38:59.700782 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:38:59.700096    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-8ad4e6ed-xlf2v" event={"ID":"1d7b028c-1d18-4968-88ec-de1d9819ecb0","Type":"ContainerDied","Data":"793e072a4a88cf9226e1b2c71f264307d507ebd3c4a49af84f79e15ab7fa0cb8"}
Oct 31 17:39:00.880815 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:00.880788    5003 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-8ad4e6ed-xlf2v"
Oct 31 17:39:01.032548 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:01.032468    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/1d7b028c-1d18-4968-88ec-de1d9819ecb0-kube-api-access-jcsfd\" (UniqueName: \"kubernetes.io/projected/1d7b028c-1d18-4968-88ec-de1d9819ecb0-kube-api-access-jcsfd\") pod \"1d7b028c-1d18-4968-88ec-de1d9819ecb0\" (UID: \"1d7b028c-1d18-4968-88ec-de1d9819ecb0\") "
Oct 31 17:39:01.032721 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:01.032605    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/1d7b028c-1d18-4968-88ec-de1d9819ecb0-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/1d7b028c-1d18-4968-88ec-de1d9819ecb0-maas-api-xks-ca\") pod \"1d7b028c-1d18-4968-88ec-de1d9819ecb0\" (UID: \"1d7b028c-1d18-4968-88ec-de1d9819ecb0\") "
Oct 31 17:39:01.032721 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:01.032695    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/1d7b028c-1d18-4968-88ec-de1d9819ecb0-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/1d7b028c-1d18-4968-88ec-de1d9819ecb0-maas-api-openshift-ca\") pod \"1d7b028c-1d18-4968-88ec-de1d9819ecb0\" (UID: \"1d7b028c-1d18-4968-88ec-de1d9819ecb0\") "
Oct 31 17:39:01.033073 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:01.033045    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1d7b028c-1d18-4968-88ec-de1d9819ecb0-maas-api-openshift-ca" pod "1d7b028c-1d18-4968-88ec-de1d9819ecb0" (UID: "1d7b028c-1d18-4968-88ec-de1d9819ecb0"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 17:39:01.034707 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:01.034679    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1d7b028c-1d18-4968-88ec-de1d9819ecb0-kube-api-access-jcsfd" pod "1d7b028c-1d18-4968-88ec-de1d9819ecb0" (UID: "1d7b028c-1d18-4968-88ec-de1d9819ecb0"). InnerVolumeSpecName "kube-api-access-jcsfd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 17:39:01.034850 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:01.034826    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1d7b028c-1d18-4968-88ec-de1d9819ecb0-maas-api-xks-ca" pod "1d7b028c-1d18-4968-88ec-de1d9819ecb0" (UID: "1d7b028c-1d18-4968-88ec-de1d9819ecb0"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 17:39:01.135043 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:01.134231    5003 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/1d7b028c-1d18-4968-88ec-de1d9819ecb0-maas-api-openshift-ca\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:39:01.135043 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:01.134274    5003 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jcsfd\" (UniqueName: \"kubernetes.io/projected/1d7b028c-1d18-4968-88ec-de1d9819ecb0-kube-api-access-jcsfd\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:39:01.135043 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:01.134289    5003 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/1d7b028c-1d18-4968-88ec-de1d9819ecb0-maas-api-xks-ca\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:39:01.714210 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:01.714179    5003 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-8ad4e6ed-xlf2v"
Oct 31 17:39:01.714389 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:01.714212    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-8ad4e6ed-xlf2v" event={"ID":"1d7b028c-1d18-4968-88ec-de1d9819ecb0","Type":"ContainerDied","Data":"93cfa2aa86792c881c8df52b94e01f6f624e28e94354ba644a8a8b2d79c05a14"}
Oct 31 17:39:01.714389 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:01.714261    5003 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="93cfa2aa86792c881c8df52b94e01f6f624e28e94354ba644a8a8b2d79c05a14"
Oct 31 17:39:01.904001 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:01.903969    5003 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-bpm5b"]
Oct 31 17:39:01.904508 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:01.904495    5003 cpu_manager.go:414] "containerMap: removing container" podUID="1d7b028c-1d18-4968-88ec-de1d9819ecb0" containerName="revoke-keys"
Oct 31 17:39:01.904564 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:01.904509    5003 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="1d7b028c-1d18-4968-88ec-de1d9819ecb0" containerName="revoke-keys"
Oct 31 17:39:01.904672 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:01.904640    5003 memory_manager.go:365] "RemoveStaleState removing state" podUID="1d7b028c-1d18-4968-88ec-de1d9819ecb0" containerName="revoke-keys"
Oct 31 17:39:01.908229 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:01.908209    5003 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-bpm5b"
Oct 31 17:39:01.928676 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:01.928629    5003 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w1-0e59ca-openshift-default-dockercfg-75hsv\""
Oct 31 17:39:01.946075 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:01.946037    5003 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-bpm5b"]
Oct 31 17:39:02.047592 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:02.047493    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9bf16293-fd1c-421b-9f91-3c7178ed7cd3-workload-certs\") pod \"e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-bpm5b\" (UID: \"9bf16293-fd1c-421b-9f91-3c7178ed7cd3\") " pod="openshift-ingress/e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-bpm5b"
Oct 31 17:39:02.047592 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:02.047535    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tp8dz\" (UniqueName: \"kubernetes.io/projected/9bf16293-fd1c-421b-9f91-3c7178ed7cd3-kube-api-access-tp8dz\") pod \"e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-bpm5b\" (UID: \"9bf16293-fd1c-421b-9f91-3c7178ed7cd3\") " pod="openshift-ingress/e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-bpm5b"
Oct 31 17:39:02.047592 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:02.047574    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9bf16293-fd1c-421b-9f91-3c7178ed7cd3-istio-data\") pod \"e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-bpm5b\" (UID: \"9bf16293-fd1c-421b-9f91-3c7178ed7cd3\") " pod="openshift-ingress/e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-bpm5b"
Oct 31 17:39:02.047943 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:02.047731    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9bf16293-fd1c-421b-9f91-3c7178ed7cd3-istio-podinfo\") pod \"e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-bpm5b\" (UID: \"9bf16293-fd1c-421b-9f91-3c7178ed7cd3\") " pod="openshift-ingress/e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-bpm5b"
Oct 31 17:39:02.047943 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:02.047851    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9bf16293-fd1c-421b-9f91-3c7178ed7cd3-istiod-ca-cert\") pod \"e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-bpm5b\" (UID: \"9bf16293-fd1c-421b-9f91-3c7178ed7cd3\") " pod="openshift-ingress/e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-bpm5b"
Oct 31 17:39:02.047943 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:02.047893    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9bf16293-fd1c-421b-9f91-3c7178ed7cd3-workload-socket\") pod \"e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-bpm5b\" (UID: \"9bf16293-fd1c-421b-9f91-3c7178ed7cd3\") " pod="openshift-ingress/e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-bpm5b"
Oct 31 17:39:02.048113 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:02.048018    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9bf16293-fd1c-421b-9f91-3c7178ed7cd3-istio-token\") pod \"e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-bpm5b\" (UID: \"9bf16293-fd1c-421b-9f91-3c7178ed7cd3\") " pod="openshift-ingress/e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-bpm5b"
Oct 31 17:39:02.048113 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:02.048046    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9bf16293-fd1c-421b-9f91-3c7178ed7cd3-istio-envoy\") pod \"e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-bpm5b\" (UID: \"9bf16293-fd1c-421b-9f91-3c7178ed7cd3\") " pod="openshift-ingress/e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-bpm5b"
Oct 31 17:39:02.048113 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:02.048066    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9bf16293-fd1c-421b-9f91-3c7178ed7cd3-credential-socket\") pod \"e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-bpm5b\" (UID: \"9bf16293-fd1c-421b-9f91-3c7178ed7cd3\") " pod="openshift-ingress/e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-bpm5b"
Oct 31 17:39:02.149752 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:02.149714    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9bf16293-fd1c-421b-9f91-3c7178ed7cd3-istio-token\") pod \"e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-bpm5b\" (UID: \"9bf16293-fd1c-421b-9f91-3c7178ed7cd3\") " pod="openshift-ingress/e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-bpm5b"
Oct 31 17:39:02.149953 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:02.149769    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9bf16293-fd1c-421b-9f91-3c7178ed7cd3-istio-envoy\") pod \"e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-bpm5b\" (UID: \"9bf16293-fd1c-421b-9f91-3c7178ed7cd3\") " pod="openshift-ingress/e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-bpm5b"
Oct 31 17:39:02.149953 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:02.149802    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9bf16293-fd1c-421b-9f91-3c7178ed7cd3-credential-socket\") pod \"e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-bpm5b\" (UID: \"9bf16293-fd1c-421b-9f91-3c7178ed7cd3\") " pod="openshift-ingress/e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-bpm5b"
Oct 31 17:39:02.149953 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:02.149884    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9bf16293-fd1c-421b-9f91-3c7178ed7cd3-workload-certs\") pod \"e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-bpm5b\" (UID: \"9bf16293-fd1c-421b-9f91-3c7178ed7cd3\") " pod="openshift-ingress/e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-bpm5b"
Oct 31 17:39:02.149953 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:02.149921    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tp8dz\" (UniqueName: \"kubernetes.io/projected/9bf16293-fd1c-421b-9f91-3c7178ed7cd3-kube-api-access-tp8dz\") pod \"e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-bpm5b\" (UID: \"9bf16293-fd1c-421b-9f91-3c7178ed7cd3\") " pod="openshift-ingress/e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-bpm5b"
Oct 31 17:39:02.150138 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:02.149983    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9bf16293-fd1c-421b-9f91-3c7178ed7cd3-istio-data\") pod \"e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-bpm5b\" (UID: \"9bf16293-fd1c-421b-9f91-3c7178ed7cd3\") " pod="openshift-ingress/e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-bpm5b"
Oct 31 17:39:02.150138 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:02.150020    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9bf16293-fd1c-421b-9f91-3c7178ed7cd3-istio-podinfo\") pod \"e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-bpm5b\" (UID: \"9bf16293-fd1c-421b-9f91-3c7178ed7cd3\") " pod="openshift-ingress/e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-bpm5b"
Oct 31 17:39:02.150414 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:02.150387    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9bf16293-fd1c-421b-9f91-3c7178ed7cd3-credential-socket\") pod \"e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-bpm5b\" (UID: \"9bf16293-fd1c-421b-9f91-3c7178ed7cd3\") " pod="openshift-ingress/e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-bpm5b"
Oct 31 17:39:02.150550 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:02.150429    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9bf16293-fd1c-421b-9f91-3c7178ed7cd3-istio-data\") pod \"e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-bpm5b\" (UID: \"9bf16293-fd1c-421b-9f91-3c7178ed7cd3\") " pod="openshift-ingress/e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-bpm5b"
Oct 31 17:39:02.150622 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:02.150472    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9bf16293-fd1c-421b-9f91-3c7178ed7cd3-workload-certs\") pod \"e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-bpm5b\" (UID: \"9bf16293-fd1c-421b-9f91-3c7178ed7cd3\") " pod="openshift-ingress/e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-bpm5b"
Oct 31 17:39:02.150622 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:02.150503    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9bf16293-fd1c-421b-9f91-3c7178ed7cd3-istiod-ca-cert\") pod \"e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-bpm5b\" (UID: \"9bf16293-fd1c-421b-9f91-3c7178ed7cd3\") " pod="openshift-ingress/e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-bpm5b"
Oct 31 17:39:02.150785 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:02.150688    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9bf16293-fd1c-421b-9f91-3c7178ed7cd3-workload-socket\") pod \"e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-bpm5b\" (UID: \"9bf16293-fd1c-421b-9f91-3c7178ed7cd3\") " pod="openshift-ingress/e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-bpm5b"
Oct 31 17:39:02.151046 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:02.151029    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9bf16293-fd1c-421b-9f91-3c7178ed7cd3-istiod-ca-cert\") pod \"e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-bpm5b\" (UID: \"9bf16293-fd1c-421b-9f91-3c7178ed7cd3\") " pod="openshift-ingress/e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-bpm5b"
Oct 31 17:39:02.151111 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:02.151055    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9bf16293-fd1c-421b-9f91-3c7178ed7cd3-workload-socket\") pod \"e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-bpm5b\" (UID: \"9bf16293-fd1c-421b-9f91-3c7178ed7cd3\") " pod="openshift-ingress/e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-bpm5b"
Oct 31 17:39:02.152395 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:02.152371    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9bf16293-fd1c-421b-9f91-3c7178ed7cd3-istio-envoy\") pod \"e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-bpm5b\" (UID: \"9bf16293-fd1c-421b-9f91-3c7178ed7cd3\") " pod="openshift-ingress/e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-bpm5b"
Oct 31 17:39:02.152522 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:02.152505    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9bf16293-fd1c-421b-9f91-3c7178ed7cd3-istio-podinfo\") pod \"e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-bpm5b\" (UID: \"9bf16293-fd1c-421b-9f91-3c7178ed7cd3\") " pod="openshift-ingress/e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-bpm5b"
Oct 31 17:39:02.171196 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:02.171166    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tp8dz\" (UniqueName: \"kubernetes.io/projected/9bf16293-fd1c-421b-9f91-3c7178ed7cd3-kube-api-access-tp8dz\") pod \"e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-bpm5b\" (UID: \"9bf16293-fd1c-421b-9f91-3c7178ed7cd3\") " pod="openshift-ingress/e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-bpm5b"
Oct 31 17:39:02.171517 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:02.171492    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9bf16293-fd1c-421b-9f91-3c7178ed7cd3-istio-token\") pod \"e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-bpm5b\" (UID: \"9bf16293-fd1c-421b-9f91-3c7178ed7cd3\") " pod="openshift-ingress/e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-bpm5b"
Oct 31 17:39:02.222439 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:02.222404    5003 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-bpm5b"
Oct 31 17:39:02.545458 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:02.545311    5003 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-bpm5b"]
Oct 31 17:39:02.548771 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:39:02.548738    5003 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9bf16293_fd1c_421b_9f91_3c7178ed7cd3.slice/crio-944d8228854620fccd160cc90e04cf1a9af9465170053f1b2c906edc12ba903c WatchSource:0}: Error finding container 944d8228854620fccd160cc90e04cf1a9af9465170053f1b2c906edc12ba903c: Status 404 returned error can't find the container with id 944d8228854620fccd160cc90e04cf1a9af9465170053f1b2c906edc12ba903c
Oct 31 17:39:02.551380 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:02.551337    5003 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Oct 31 17:39:02.551486 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:02.551415    5003 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Oct 31 17:39:02.551486 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:02.551447    5003 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Oct 31 17:39:02.725551 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:02.725512    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-bpm5b" event={"ID":"9bf16293-fd1c-421b-9f91-3c7178ed7cd3","Type":"ContainerStarted","Data":"78ca469a468ffb32a72aae916b4608a505f9d720a4103418099ff4684025deeb"}
Oct 31 17:39:02.725758 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:02.725571    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-bpm5b" event={"ID":"9bf16293-fd1c-421b-9f91-3c7178ed7cd3","Type":"ContainerStarted","Data":"944d8228854620fccd160cc90e04cf1a9af9465170053f1b2c906edc12ba903c"}
Oct 31 17:39:02.765423 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:02.765366    5003 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-bpm5b" podStartSLOduration=1.765351362 podStartE2EDuration="1.765351362s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 17:39:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 17:39:02.764414999 +0000 UTC m=+711.019269553" watchObservedRunningTime="2026-10-31 17:39:02.765351362 +0000 UTC m=+711.020205903"
Oct 31 17:39:03.223551 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:03.223517    5003 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-bpm5b"
Oct 31 17:39:03.225145 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:03.225118    5003 patch_prober.go:29] interesting pod/e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-bpm5b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.84:15021/healthz/ready\": dial tcp 10.132.0.84:15021: connect: connection refused" start-of-body=
Oct 31 17:39:03.225273 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:03.225167    5003 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-bpm5b" podUID="9bf16293-fd1c-421b-9f91-3c7178ed7cd3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.84:15021/healthz/ready\": dial tcp 10.132.0.84:15021: connect: connection refused"
Oct 31 17:39:03.593869 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:03.593836    5003 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-704f6c6f-ckzl2"]
Oct 31 17:39:03.598401 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:03.598377    5003 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-704f6c6f-ckzl2"
Oct 31 17:39:03.631093 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:03.631022    5003 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-704f6c6f-ckzl2"]
Oct 31 17:39:03.637894 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:03.637857    5003 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\""
Oct 31 17:39:03.638038 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:03.637986    5003 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-mr9x2\""
Oct 31 17:39:03.791671 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:03.787366    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/2f3905d1-f623-4b53-ac3d-559fb3962829-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-704f6c6f-ckzl2\" (UID: \"2f3905d1-f623-4b53-ac3d-559fb3962829\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-704f6c6f-ckzl2"
Oct 31 17:39:03.791671 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:03.787504    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ndqcb\" (UniqueName: \"kubernetes.io/projected/2f3905d1-f623-4b53-ac3d-559fb3962829-kube-api-access-ndqcb\") pod \"maas-api-revoke-sub-704f6c6f-ckzl2\" (UID: \"2f3905d1-f623-4b53-ac3d-559fb3962829\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-704f6c6f-ckzl2"
Oct 31 17:39:03.791671 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:03.787561    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/2f3905d1-f623-4b53-ac3d-559fb3962829-maas-api-xks-ca\") pod \"maas-api-revoke-sub-704f6c6f-ckzl2\" (UID: \"2f3905d1-f623-4b53-ac3d-559fb3962829\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-704f6c6f-ckzl2"
Oct 31 17:39:03.894754 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:03.894665    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/2f3905d1-f623-4b53-ac3d-559fb3962829-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-704f6c6f-ckzl2\" (UID: \"2f3905d1-f623-4b53-ac3d-559fb3962829\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-704f6c6f-ckzl2"
Oct 31 17:39:03.894945 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:03.894773    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ndqcb\" (UniqueName: \"kubernetes.io/projected/2f3905d1-f623-4b53-ac3d-559fb3962829-kube-api-access-ndqcb\") pod \"maas-api-revoke-sub-704f6c6f-ckzl2\" (UID: \"2f3905d1-f623-4b53-ac3d-559fb3962829\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-704f6c6f-ckzl2"
Oct 31 17:39:03.895445 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:03.895412    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/2f3905d1-f623-4b53-ac3d-559fb3962829-maas-api-xks-ca\") pod \"maas-api-revoke-sub-704f6c6f-ckzl2\" (UID: \"2f3905d1-f623-4b53-ac3d-559fb3962829\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-704f6c6f-ckzl2"
Oct 31 17:39:03.895538 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:03.895519    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/2f3905d1-f623-4b53-ac3d-559fb3962829-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-704f6c6f-ckzl2\" (UID: \"2f3905d1-f623-4b53-ac3d-559fb3962829\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-704f6c6f-ckzl2"
Oct 31 17:39:03.898171 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:03.898138    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/2f3905d1-f623-4b53-ac3d-559fb3962829-maas-api-xks-ca\") pod \"maas-api-revoke-sub-704f6c6f-ckzl2\" (UID: \"2f3905d1-f623-4b53-ac3d-559fb3962829\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-704f6c6f-ckzl2"
Oct 31 17:39:03.916828 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:03.916800    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ndqcb\" (UniqueName: \"kubernetes.io/projected/2f3905d1-f623-4b53-ac3d-559fb3962829-kube-api-access-ndqcb\") pod \"maas-api-revoke-sub-704f6c6f-ckzl2\" (UID: \"2f3905d1-f623-4b53-ac3d-559fb3962829\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-704f6c6f-ckzl2"
Oct 31 17:39:04.228726 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:04.216839    5003 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-704f6c6f-ckzl2"
Oct 31 17:39:04.235718 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:04.230060    5003 patch_prober.go:29] interesting pod/e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-bpm5b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.84:15021/healthz/ready\": dial tcp 10.132.0.84:15021: connect: connection refused" start-of-body=
Oct 31 17:39:04.235718 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:04.230128    5003 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-bpm5b" podUID="9bf16293-fd1c-421b-9f91-3c7178ed7cd3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.84:15021/healthz/ready\": dial tcp 10.132.0.84:15021: connect: connection refused"
Oct 31 17:39:05.231394 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:05.231320    5003 patch_prober.go:29] interesting pod/e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-bpm5b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.84:15021/healthz/ready\": dial tcp 10.132.0.84:15021: connect: connection refused" start-of-body=
Oct 31 17:39:05.231394 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:05.231385    5003 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-bpm5b" podUID="9bf16293-fd1c-421b-9f91-3c7178ed7cd3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.84:15021/healthz/ready\": dial tcp 10.132.0.84:15021: connect: connection refused"
Oct 31 17:39:05.687670 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:05.667883    5003 prober.go:122] "Probe failed" probeType="Readiness" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-82w89" podUID="ef5a065b-f98e-4d14-810f-2d0c42c58ce6" containerName="main" probeResult="failure" output="Get \"https://10.132.0.54:8000/ready\": context deadline exceeded"
Oct 31 17:39:05.703798 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:05.697721    5003 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-0e59ca/simulator-w1-0e59ca-kserve-999765679-zs7kh" podUID="018d423e-6866-4b61-a4a2-d2e786d82bf0" containerName="main" probeResult="failure" output="Get \"https://10.132.0.71:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 31 17:39:05.786229 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:05.785383    5003 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-ee816e/simulator-w0-ee816e-kserve-5bd4657dc-9rlm4" podUID="620f499f-36d7-4900-abbe-98ee5cf5d96c" containerName="main" probeResult="failure" output="Get \"https://10.132.0.72:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 31 17:39:05.809590 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:05.808744    5003 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-b78c31/simulator-w5-b78c31-kserve-95df74778-fpvpr" podUID="665d75c7-8ba5-49e1-87a7-51a18ae6f369" containerName="main" probeResult="failure" output="Get \"https://10.132.0.73:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 31 17:39:05.927806 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:05.927746    5003 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-1c0bfd/premium-w4-1c0bfd-kserve-d78fbb98-psx55" podUID="34bdffed-87b8-4e7a-b182-f069d081bd62" containerName="main" probeResult="failure" output="Get \"https://10.132.0.74:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 31 17:39:06.034261 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:06.034217    5003 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-5c446c/premium-w2-5c446c-kserve-66f7486c85-f7lk2" podUID="9c2ddfab-2348-4bb0-8844-1fca62460390" containerName="main" probeResult="failure" output="Get \"https://10.132.0.75:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 31 17:39:06.119720 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:06.068406    5003 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-704f6c6f-ckzl2"]
Oct 31 17:39:06.173672 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:06.146525    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-704f6c6f-ckzl2" event={"ID":"2f3905d1-f623-4b53-ac3d-559fb3962829","Type":"ContainerStarted","Data":"5f5adfa1d6adedeadbeafc5b4f72c221a58339bfc70b86e311856e7a092cedc4"}
Oct 31 17:39:06.223739 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:06.223691    5003 patch_prober.go:29] interesting pod/e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-bpm5b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.84:15021/healthz/ready\": dial tcp 10.132.0.84:15021: connect: connection refused" start-of-body=
Oct 31 17:39:06.223915 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:06.223764    5003 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-bpm5b" podUID="9bf16293-fd1c-421b-9f91-3c7178ed7cd3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.84:15021/healthz/ready\": dial tcp 10.132.0.84:15021: connect: connection refused"
Oct 31 17:39:07.169220 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:07.169175    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-704f6c6f-ckzl2" event={"ID":"2f3905d1-f623-4b53-ac3d-559fb3962829","Type":"ContainerStarted","Data":"15e886f00aa6a0ed7040cb0af5068ed0497d6f082c572753bebe5c0502d8a720"}
Oct 31 17:39:07.223268 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:07.223230    5003 patch_prober.go:29] interesting pod/e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-bpm5b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.84:15021/healthz/ready\": dial tcp 10.132.0.84:15021: connect: connection refused" start-of-body=
Oct 31 17:39:07.223543 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:07.223509    5003 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-bpm5b" podUID="9bf16293-fd1c-421b-9f91-3c7178ed7cd3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.84:15021/healthz/ready\": dial tcp 10.132.0.84:15021: connect: connection refused"
Oct 31 17:39:07.226258 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:07.226203    5003 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-sub-704f6c6f-ckzl2" podStartSLOduration=4.226186121 podStartE2EDuration="4.226186121s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 17:39:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 17:39:07.222906736 +0000 UTC m=+715.477761292" watchObservedRunningTime="2026-10-31 17:39:07.226186121 +0000 UTC m=+715.481040664"
Oct 31 17:39:08.183823 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:08.183784    5003 generic.go:356] "Generic (PLEG): container finished" podID="2f3905d1-f623-4b53-ac3d-559fb3962829" containerID="15e886f00aa6a0ed7040cb0af5068ed0497d6f082c572753bebe5c0502d8a720" exitCode=0
Oct 31 17:39:08.184233 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:08.183874    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-704f6c6f-ckzl2" event={"ID":"2f3905d1-f623-4b53-ac3d-559fb3962829","Type":"ContainerDied","Data":"15e886f00aa6a0ed7040cb0af5068ed0497d6f082c572753bebe5c0502d8a720"}
Oct 31 17:39:08.223151 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:08.223118    5003 patch_prober.go:29] interesting pod/e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-bpm5b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.84:15021/healthz/ready\": dial tcp 10.132.0.84:15021: connect: connection refused" start-of-body=
Oct 31 17:39:08.223347 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:08.223166    5003 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-bpm5b" podUID="9bf16293-fd1c-421b-9f91-3c7178ed7cd3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.84:15021/healthz/ready\": dial tcp 10.132.0.84:15021: connect: connection refused"
Oct 31 17:39:09.223263 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:09.223227    5003 patch_prober.go:29] interesting pod/e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-bpm5b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.84:15021/healthz/ready\": dial tcp 10.132.0.84:15021: connect: connection refused" start-of-body=
Oct 31 17:39:09.223669 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:09.223287    5003 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-bpm5b" podUID="9bf16293-fd1c-421b-9f91-3c7178ed7cd3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.84:15021/healthz/ready\": dial tcp 10.132.0.84:15021: connect: connection refused"
Oct 31 17:39:09.349730 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:09.349701    5003 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-704f6c6f-ckzl2"
Oct 31 17:39:09.404478 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:09.404444    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/2f3905d1-f623-4b53-ac3d-559fb3962829-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/2f3905d1-f623-4b53-ac3d-559fb3962829-maas-api-xks-ca\") pod \"2f3905d1-f623-4b53-ac3d-559fb3962829\" (UID: \"2f3905d1-f623-4b53-ac3d-559fb3962829\") "
Oct 31 17:39:09.404675 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:09.404576    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/2f3905d1-f623-4b53-ac3d-559fb3962829-kube-api-access-ndqcb\" (UniqueName: \"kubernetes.io/projected/2f3905d1-f623-4b53-ac3d-559fb3962829-kube-api-access-ndqcb\") pod \"2f3905d1-f623-4b53-ac3d-559fb3962829\" (UID: \"2f3905d1-f623-4b53-ac3d-559fb3962829\") "
Oct 31 17:39:09.404765 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:09.404748    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/2f3905d1-f623-4b53-ac3d-559fb3962829-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/2f3905d1-f623-4b53-ac3d-559fb3962829-maas-api-openshift-ca\") pod \"2f3905d1-f623-4b53-ac3d-559fb3962829\" (UID: \"2f3905d1-f623-4b53-ac3d-559fb3962829\") "
Oct 31 17:39:09.405231 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:09.405188    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2f3905d1-f623-4b53-ac3d-559fb3962829-maas-api-openshift-ca" pod "2f3905d1-f623-4b53-ac3d-559fb3962829" (UID: "2f3905d1-f623-4b53-ac3d-559fb3962829"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 17:39:09.406858 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:09.406837    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2f3905d1-f623-4b53-ac3d-559fb3962829-maas-api-xks-ca" pod "2f3905d1-f623-4b53-ac3d-559fb3962829" (UID: "2f3905d1-f623-4b53-ac3d-559fb3962829"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 17:39:09.407787 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:09.407763    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2f3905d1-f623-4b53-ac3d-559fb3962829-kube-api-access-ndqcb" pod "2f3905d1-f623-4b53-ac3d-559fb3962829" (UID: "2f3905d1-f623-4b53-ac3d-559fb3962829"). InnerVolumeSpecName "kube-api-access-ndqcb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 17:39:09.505966 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:09.505879    5003 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ndqcb\" (UniqueName: \"kubernetes.io/projected/2f3905d1-f623-4b53-ac3d-559fb3962829-kube-api-access-ndqcb\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:39:09.505966 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:09.505914    5003 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/2f3905d1-f623-4b53-ac3d-559fb3962829-maas-api-openshift-ca\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:39:09.505966 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:09.505924    5003 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/2f3905d1-f623-4b53-ac3d-559fb3962829-maas-api-xks-ca\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:39:10.200542 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:10.200452    5003 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-704f6c6f-ckzl2"
Oct 31 17:39:10.200542 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:10.200480    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-704f6c6f-ckzl2" event={"ID":"2f3905d1-f623-4b53-ac3d-559fb3962829","Type":"ContainerDied","Data":"5f5adfa1d6adedeadbeafc5b4f72c221a58339bfc70b86e311856e7a092cedc4"}
Oct 31 17:39:10.200542 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:10.200529    5003 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5f5adfa1d6adedeadbeafc5b4f72c221a58339bfc70b86e311856e7a092cedc4"
Oct 31 17:39:10.329628 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:10.329595    5003 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-bdc4aed9-92pw2"]
Oct 31 17:39:10.330232 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:10.330216    5003 cpu_manager.go:414] "containerMap: removing container" podUID="2f3905d1-f623-4b53-ac3d-559fb3962829" containerName="revoke-keys"
Oct 31 17:39:10.330285 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:10.330233    5003 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="2f3905d1-f623-4b53-ac3d-559fb3962829" containerName="revoke-keys"
Oct 31 17:39:10.330370 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:10.330360    5003 memory_manager.go:365] "RemoveStaleState removing state" podUID="2f3905d1-f623-4b53-ac3d-559fb3962829" containerName="revoke-keys"
Oct 31 17:39:10.341351 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:10.338212    5003 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-bdc4aed9-92pw2"
Oct 31 17:39:10.343799 ip-10-0-138-17 kubenswrapper[5003]: E1031 17:39:10.343757    5003 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-tdzz5" containerName="extractor"
Oct 31 17:39:10.353663 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:10.352930    5003 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-mr9x2\""
Oct 31 17:39:10.353663 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:10.352972    5003 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\""
Oct 31 17:39:10.353868 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:10.353722    5003 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-bdc4aed9-92pw2"]
Oct 31 17:39:10.424306 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:10.424251    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/cfc1b6b5-4f20-4900-9ad3-6cd1e7d8ce00-maas-api-xks-ca\") pod \"maas-api-revoke-sub-bdc4aed9-92pw2\" (UID: \"cfc1b6b5-4f20-4900-9ad3-6cd1e7d8ce00\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-bdc4aed9-92pw2"
Oct 31 17:39:10.424501 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:10.424458    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/cfc1b6b5-4f20-4900-9ad3-6cd1e7d8ce00-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-bdc4aed9-92pw2\" (UID: \"cfc1b6b5-4f20-4900-9ad3-6cd1e7d8ce00\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-bdc4aed9-92pw2"
Oct 31 17:39:10.424579 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:10.424516    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kjfhs\" (UniqueName: \"kubernetes.io/projected/cfc1b6b5-4f20-4900-9ad3-6cd1e7d8ce00-kube-api-access-kjfhs\") pod \"maas-api-revoke-sub-bdc4aed9-92pw2\" (UID: \"cfc1b6b5-4f20-4900-9ad3-6cd1e7d8ce00\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-bdc4aed9-92pw2"
Oct 31 17:39:10.526149 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:10.526057    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/cfc1b6b5-4f20-4900-9ad3-6cd1e7d8ce00-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-bdc4aed9-92pw2\" (UID: \"cfc1b6b5-4f20-4900-9ad3-6cd1e7d8ce00\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-bdc4aed9-92pw2"
Oct 31 17:39:10.526149 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:10.526114    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kjfhs\" (UniqueName: \"kubernetes.io/projected/cfc1b6b5-4f20-4900-9ad3-6cd1e7d8ce00-kube-api-access-kjfhs\") pod \"maas-api-revoke-sub-bdc4aed9-92pw2\" (UID: \"cfc1b6b5-4f20-4900-9ad3-6cd1e7d8ce00\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-bdc4aed9-92pw2"
Oct 31 17:39:10.526386 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:10.526181    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/cfc1b6b5-4f20-4900-9ad3-6cd1e7d8ce00-maas-api-xks-ca\") pod \"maas-api-revoke-sub-bdc4aed9-92pw2\" (UID: \"cfc1b6b5-4f20-4900-9ad3-6cd1e7d8ce00\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-bdc4aed9-92pw2"
Oct 31 17:39:10.526733 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:10.526707    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/cfc1b6b5-4f20-4900-9ad3-6cd1e7d8ce00-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-bdc4aed9-92pw2\" (UID: \"cfc1b6b5-4f20-4900-9ad3-6cd1e7d8ce00\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-bdc4aed9-92pw2"
Oct 31 17:39:10.528569 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:10.528546    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/cfc1b6b5-4f20-4900-9ad3-6cd1e7d8ce00-maas-api-xks-ca\") pod \"maas-api-revoke-sub-bdc4aed9-92pw2\" (UID: \"cfc1b6b5-4f20-4900-9ad3-6cd1e7d8ce00\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-bdc4aed9-92pw2"
Oct 31 17:39:10.545151 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:10.545119    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kjfhs\" (UniqueName: \"kubernetes.io/projected/cfc1b6b5-4f20-4900-9ad3-6cd1e7d8ce00-kube-api-access-kjfhs\") pod \"maas-api-revoke-sub-bdc4aed9-92pw2\" (UID: \"cfc1b6b5-4f20-4900-9ad3-6cd1e7d8ce00\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-bdc4aed9-92pw2"
Oct 31 17:39:10.655958 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:10.655914    5003 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-bdc4aed9-92pw2"
Oct 31 17:39:10.853206 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:10.853168    5003 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-bpm5b"
Oct 31 17:39:10.853784 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:10.853756    5003 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-bpm5b"
Oct 31 17:39:10.854596 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:10.854574    5003 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-bpm5b"
Oct 31 17:39:10.983908 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:10.980508    5003 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-bdc4aed9-92pw2"]
Oct 31 17:39:10.986312 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:39:10.986246    5003 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcfc1b6b5_4f20_4900_9ad3_6cd1e7d8ce00.slice/crio-27a95ee14a880732cfd1a361af8c7b04331f746caf2ff69a46700b83a7f35c05 WatchSource:0}: Error finding container 27a95ee14a880732cfd1a361af8c7b04331f746caf2ff69a46700b83a7f35c05: Status 404 returned error can't find the container with id 27a95ee14a880732cfd1a361af8c7b04331f746caf2ff69a46700b83a7f35c05
Oct 31 17:39:11.209065 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:11.209029    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-bdc4aed9-92pw2" event={"ID":"cfc1b6b5-4f20-4900-9ad3-6cd1e7d8ce00","Type":"ContainerStarted","Data":"27a95ee14a880732cfd1a361af8c7b04331f746caf2ff69a46700b83a7f35c05"}
Oct 31 17:39:12.218067 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:12.218032    5003 generic.go:356] "Generic (PLEG): container finished" podID="cfc1b6b5-4f20-4900-9ad3-6cd1e7d8ce00" containerID="b7aa287e8f013f2518d0316752dc13ae5a08a2fb41745f70c4db7c995a24773e" exitCode=0
Oct 31 17:39:12.218535 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:12.218106    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-bdc4aed9-92pw2" event={"ID":"cfc1b6b5-4f20-4900-9ad3-6cd1e7d8ce00","Type":"ContainerDied","Data":"b7aa287e8f013f2518d0316752dc13ae5a08a2fb41745f70c4db7c995a24773e"}
Oct 31 17:39:13.381244 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:13.381216    5003 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-bdc4aed9-92pw2"
Oct 31 17:39:13.465253 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:13.465220    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/cfc1b6b5-4f20-4900-9ad3-6cd1e7d8ce00-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/cfc1b6b5-4f20-4900-9ad3-6cd1e7d8ce00-maas-api-xks-ca\") pod \"cfc1b6b5-4f20-4900-9ad3-6cd1e7d8ce00\" (UID: \"cfc1b6b5-4f20-4900-9ad3-6cd1e7d8ce00\") "
Oct 31 17:39:13.465414 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:13.465350    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/cfc1b6b5-4f20-4900-9ad3-6cd1e7d8ce00-kube-api-access-kjfhs\" (UniqueName: \"kubernetes.io/projected/cfc1b6b5-4f20-4900-9ad3-6cd1e7d8ce00-kube-api-access-kjfhs\") pod \"cfc1b6b5-4f20-4900-9ad3-6cd1e7d8ce00\" (UID: \"cfc1b6b5-4f20-4900-9ad3-6cd1e7d8ce00\") "
Oct 31 17:39:13.465508 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:13.465491    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/cfc1b6b5-4f20-4900-9ad3-6cd1e7d8ce00-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/cfc1b6b5-4f20-4900-9ad3-6cd1e7d8ce00-maas-api-openshift-ca\") pod \"cfc1b6b5-4f20-4900-9ad3-6cd1e7d8ce00\" (UID: \"cfc1b6b5-4f20-4900-9ad3-6cd1e7d8ce00\") "
Oct 31 17:39:13.465882 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:13.465853    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cfc1b6b5-4f20-4900-9ad3-6cd1e7d8ce00-maas-api-openshift-ca" pod "cfc1b6b5-4f20-4900-9ad3-6cd1e7d8ce00" (UID: "cfc1b6b5-4f20-4900-9ad3-6cd1e7d8ce00"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 17:39:13.467422 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:13.467392    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cfc1b6b5-4f20-4900-9ad3-6cd1e7d8ce00-maas-api-xks-ca" pod "cfc1b6b5-4f20-4900-9ad3-6cd1e7d8ce00" (UID: "cfc1b6b5-4f20-4900-9ad3-6cd1e7d8ce00"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 17:39:13.467422 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:13.467405    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cfc1b6b5-4f20-4900-9ad3-6cd1e7d8ce00-kube-api-access-kjfhs" pod "cfc1b6b5-4f20-4900-9ad3-6cd1e7d8ce00" (UID: "cfc1b6b5-4f20-4900-9ad3-6cd1e7d8ce00"). InnerVolumeSpecName "kube-api-access-kjfhs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 17:39:13.566706 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:13.566676    5003 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kjfhs\" (UniqueName: \"kubernetes.io/projected/cfc1b6b5-4f20-4900-9ad3-6cd1e7d8ce00-kube-api-access-kjfhs\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:39:13.566706 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:13.566706    5003 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/cfc1b6b5-4f20-4900-9ad3-6cd1e7d8ce00-maas-api-openshift-ca\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:39:13.566912 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:13.566720    5003 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/cfc1b6b5-4f20-4900-9ad3-6cd1e7d8ce00-maas-api-xks-ca\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:39:14.231909 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:14.231823    5003 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-bdc4aed9-92pw2"
Oct 31 17:39:14.231909 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:14.231863    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-bdc4aed9-92pw2" event={"ID":"cfc1b6b5-4f20-4900-9ad3-6cd1e7d8ce00","Type":"ContainerDied","Data":"27a95ee14a880732cfd1a361af8c7b04331f746caf2ff69a46700b83a7f35c05"}
Oct 31 17:39:14.232169 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:14.231946    5003 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="27a95ee14a880732cfd1a361af8c7b04331f746caf2ff69a46700b83a7f35c05"
Oct 31 17:39:15.711403 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:15.711365    5003 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-6a23a398-h96sh"]
Oct 31 17:39:15.711998 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:15.711979    5003 cpu_manager.go:414] "containerMap: removing container" podUID="cfc1b6b5-4f20-4900-9ad3-6cd1e7d8ce00" containerName="revoke-keys"
Oct 31 17:39:15.711998 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:15.711998    5003 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="cfc1b6b5-4f20-4900-9ad3-6cd1e7d8ce00" containerName="revoke-keys"
Oct 31 17:39:15.712146 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:15.712140    5003 memory_manager.go:365] "RemoveStaleState removing state" podUID="cfc1b6b5-4f20-4900-9ad3-6cd1e7d8ce00" containerName="revoke-keys"
Oct 31 17:39:15.715932 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:15.715910    5003 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-6a23a398-h96sh"
Oct 31 17:39:15.736104 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:15.736060    5003 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-6a23a398-h96sh"]
Oct 31 17:39:15.742769 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:15.742735    5003 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\""
Oct 31 17:39:15.742955 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:15.742907    5003 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-mr9x2\""
Oct 31 17:39:15.791011 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:15.790974    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/88300b82-aa25-4290-8b52-9b6847c953d8-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-6a23a398-h96sh\" (UID: \"88300b82-aa25-4290-8b52-9b6847c953d8\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-6a23a398-h96sh"
Oct 31 17:39:15.791227 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:15.791168    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/88300b82-aa25-4290-8b52-9b6847c953d8-maas-api-xks-ca\") pod \"maas-api-revoke-sub-6a23a398-h96sh\" (UID: \"88300b82-aa25-4290-8b52-9b6847c953d8\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-6a23a398-h96sh"
Oct 31 17:39:15.791307 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:15.791257    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lv76g\" (UniqueName: \"kubernetes.io/projected/88300b82-aa25-4290-8b52-9b6847c953d8-kube-api-access-lv76g\") pod \"maas-api-revoke-sub-6a23a398-h96sh\" (UID: \"88300b82-aa25-4290-8b52-9b6847c953d8\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-6a23a398-h96sh"
Oct 31 17:39:15.892360 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:15.892310    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lv76g\" (UniqueName: \"kubernetes.io/projected/88300b82-aa25-4290-8b52-9b6847c953d8-kube-api-access-lv76g\") pod \"maas-api-revoke-sub-6a23a398-h96sh\" (UID: \"88300b82-aa25-4290-8b52-9b6847c953d8\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-6a23a398-h96sh"
Oct 31 17:39:15.892567 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:15.892530    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/88300b82-aa25-4290-8b52-9b6847c953d8-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-6a23a398-h96sh\" (UID: \"88300b82-aa25-4290-8b52-9b6847c953d8\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-6a23a398-h96sh"
Oct 31 17:39:15.892702 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:15.892615    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/88300b82-aa25-4290-8b52-9b6847c953d8-maas-api-xks-ca\") pod \"maas-api-revoke-sub-6a23a398-h96sh\" (UID: \"88300b82-aa25-4290-8b52-9b6847c953d8\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-6a23a398-h96sh"
Oct 31 17:39:15.893908 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:15.893872    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/88300b82-aa25-4290-8b52-9b6847c953d8-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-6a23a398-h96sh\" (UID: \"88300b82-aa25-4290-8b52-9b6847c953d8\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-6a23a398-h96sh"
Oct 31 17:39:15.895995 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:15.895942    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/88300b82-aa25-4290-8b52-9b6847c953d8-maas-api-xks-ca\") pod \"maas-api-revoke-sub-6a23a398-h96sh\" (UID: \"88300b82-aa25-4290-8b52-9b6847c953d8\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-6a23a398-h96sh"
Oct 31 17:39:15.917798 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:15.917760    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lv76g\" (UniqueName: \"kubernetes.io/projected/88300b82-aa25-4290-8b52-9b6847c953d8-kube-api-access-lv76g\") pod \"maas-api-revoke-sub-6a23a398-h96sh\" (UID: \"88300b82-aa25-4290-8b52-9b6847c953d8\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-6a23a398-h96sh"
Oct 31 17:39:16.031590 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:16.031510    5003 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-6a23a398-h96sh"
Oct 31 17:39:16.574636 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:16.573266    5003 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-6a23a398-h96sh"]
Oct 31 17:39:16.630806 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:39:16.610728    5003 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod88300b82_aa25_4290_8b52_9b6847c953d8.slice/crio-5e52efd48e3a5fd1bc0f06dba880f835cefcd23670f32d78273b9526731446ee WatchSource:0}: Error finding container 5e52efd48e3a5fd1bc0f06dba880f835cefcd23670f32d78273b9526731446ee: Status 404 returned error can't find the container with id 5e52efd48e3a5fd1bc0f06dba880f835cefcd23670f32d78273b9526731446ee
Oct 31 17:39:17.618967 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:17.618926    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-6a23a398-h96sh" event={"ID":"88300b82-aa25-4290-8b52-9b6847c953d8","Type":"ContainerStarted","Data":"c085f0061c274aaa79fb45e51788e4a1d836daf5a24c386be4a1cf4bc49e13cf"}
Oct 31 17:39:17.619441 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:17.618988    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-6a23a398-h96sh" event={"ID":"88300b82-aa25-4290-8b52-9b6847c953d8","Type":"ContainerStarted","Data":"5e52efd48e3a5fd1bc0f06dba880f835cefcd23670f32d78273b9526731446ee"}
Oct 31 17:39:17.655726 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:17.655672    5003 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-sub-6a23a398-h96sh" podStartSLOduration=2.655658884 podStartE2EDuration="2.655658884s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 17:39:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 17:39:17.65482242 +0000 UTC m=+725.909676963" watchObservedRunningTime="2026-10-31 17:39:17.655658884 +0000 UTC m=+725.910513416"
Oct 31 17:39:18.627759 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:18.627726    5003 generic.go:356] "Generic (PLEG): container finished" podID="88300b82-aa25-4290-8b52-9b6847c953d8" containerID="c085f0061c274aaa79fb45e51788e4a1d836daf5a24c386be4a1cf4bc49e13cf" exitCode=0
Oct 31 17:39:18.628148 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:18.627826    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-6a23a398-h96sh" event={"ID":"88300b82-aa25-4290-8b52-9b6847c953d8","Type":"ContainerDied","Data":"c085f0061c274aaa79fb45e51788e4a1d836daf5a24c386be4a1cf4bc49e13cf"}
Oct 31 17:39:19.796130 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:19.796106    5003 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-6a23a398-h96sh"
Oct 31 17:39:19.887363 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:19.887279    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/88300b82-aa25-4290-8b52-9b6847c953d8-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/88300b82-aa25-4290-8b52-9b6847c953d8-maas-api-xks-ca\") pod \"88300b82-aa25-4290-8b52-9b6847c953d8\" (UID: \"88300b82-aa25-4290-8b52-9b6847c953d8\") "
Oct 31 17:39:19.887545 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:19.887432    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/88300b82-aa25-4290-8b52-9b6847c953d8-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/88300b82-aa25-4290-8b52-9b6847c953d8-maas-api-openshift-ca\") pod \"88300b82-aa25-4290-8b52-9b6847c953d8\" (UID: \"88300b82-aa25-4290-8b52-9b6847c953d8\") "
Oct 31 17:39:19.887545 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:19.887463    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/88300b82-aa25-4290-8b52-9b6847c953d8-kube-api-access-lv76g\" (UniqueName: \"kubernetes.io/projected/88300b82-aa25-4290-8b52-9b6847c953d8-kube-api-access-lv76g\") pod \"88300b82-aa25-4290-8b52-9b6847c953d8\" (UID: \"88300b82-aa25-4290-8b52-9b6847c953d8\") "
Oct 31 17:39:19.887901 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:19.887868    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/88300b82-aa25-4290-8b52-9b6847c953d8-maas-api-openshift-ca" pod "88300b82-aa25-4290-8b52-9b6847c953d8" (UID: "88300b82-aa25-4290-8b52-9b6847c953d8"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 17:39:19.888038 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:19.887999    5003 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/88300b82-aa25-4290-8b52-9b6847c953d8-maas-api-openshift-ca\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:39:19.889592 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:19.889564    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/88300b82-aa25-4290-8b52-9b6847c953d8-maas-api-xks-ca" pod "88300b82-aa25-4290-8b52-9b6847c953d8" (UID: "88300b82-aa25-4290-8b52-9b6847c953d8"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 17:39:19.889722 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:19.889669    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/88300b82-aa25-4290-8b52-9b6847c953d8-kube-api-access-lv76g" pod "88300b82-aa25-4290-8b52-9b6847c953d8" (UID: "88300b82-aa25-4290-8b52-9b6847c953d8"). InnerVolumeSpecName "kube-api-access-lv76g". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 17:39:19.988912 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:19.988874    5003 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lv76g\" (UniqueName: \"kubernetes.io/projected/88300b82-aa25-4290-8b52-9b6847c953d8-kube-api-access-lv76g\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:39:19.988912 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:19.988905    5003 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/88300b82-aa25-4290-8b52-9b6847c953d8-maas-api-xks-ca\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:39:20.642623 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:20.642590    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-6a23a398-h96sh" event={"ID":"88300b82-aa25-4290-8b52-9b6847c953d8","Type":"ContainerDied","Data":"5e52efd48e3a5fd1bc0f06dba880f835cefcd23670f32d78273b9526731446ee"}
Oct 31 17:39:20.642843 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:20.642653    5003 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5e52efd48e3a5fd1bc0f06dba880f835cefcd23670f32d78273b9526731446ee"
Oct 31 17:39:20.642843 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:20.642590    5003 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-6a23a398-h96sh"
Oct 31 17:39:27.842360 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:27.842321    5003 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-9t8k2"]
Oct 31 17:39:27.842908 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:27.842892    5003 cpu_manager.go:414] "containerMap: removing container" podUID="88300b82-aa25-4290-8b52-9b6847c953d8" containerName="revoke-keys"
Oct 31 17:39:27.842953 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:27.842909    5003 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="88300b82-aa25-4290-8b52-9b6847c953d8" containerName="revoke-keys"
Oct 31 17:39:27.843041 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:27.843031    5003 memory_manager.go:365] "RemoveStaleState removing state" podUID="88300b82-aa25-4290-8b52-9b6847c953d8" containerName="revoke-keys"
Oct 31 17:39:27.847469 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:27.847439    5003 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-9t8k2"
Oct 31 17:39:27.873395 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:27.873269    5003 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-9t8k2"]
Oct 31 17:39:27.887498 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:27.887464    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c8d0a165-562c-4602-95fe-35a62229fa4f-workload-certs\") pod \"maas-default-gateway-openshift-default-7d9897b54c-9t8k2\" (UID: \"c8d0a165-562c-4602-95fe-35a62229fa4f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-9t8k2"
Oct 31 17:39:27.887693 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:27.887526    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c8d0a165-562c-4602-95fe-35a62229fa4f-workload-socket\") pod \"maas-default-gateway-openshift-default-7d9897b54c-9t8k2\" (UID: \"c8d0a165-562c-4602-95fe-35a62229fa4f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-9t8k2"
Oct 31 17:39:27.887693 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:27.887550    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c8d0a165-562c-4602-95fe-35a62229fa4f-istio-data\") pod \"maas-default-gateway-openshift-default-7d9897b54c-9t8k2\" (UID: \"c8d0a165-562c-4602-95fe-35a62229fa4f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-9t8k2"
Oct 31 17:39:27.887693 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:27.887591    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c8d0a165-562c-4602-95fe-35a62229fa4f-istio-token\") pod \"maas-default-gateway-openshift-default-7d9897b54c-9t8k2\" (UID: \"c8d0a165-562c-4602-95fe-35a62229fa4f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-9t8k2"
Oct 31 17:39:27.887892 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:27.887700    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9qmrp\" (UniqueName: \"kubernetes.io/projected/c8d0a165-562c-4602-95fe-35a62229fa4f-kube-api-access-9qmrp\") pod \"maas-default-gateway-openshift-default-7d9897b54c-9t8k2\" (UID: \"c8d0a165-562c-4602-95fe-35a62229fa4f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-9t8k2"
Oct 31 17:39:27.887892 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:27.887729    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c8d0a165-562c-4602-95fe-35a62229fa4f-istio-envoy\") pod \"maas-default-gateway-openshift-default-7d9897b54c-9t8k2\" (UID: \"c8d0a165-562c-4602-95fe-35a62229fa4f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-9t8k2"
Oct 31 17:39:27.888136 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:27.888113    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c8d0a165-562c-4602-95fe-35a62229fa4f-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-7d9897b54c-9t8k2\" (UID: \"c8d0a165-562c-4602-95fe-35a62229fa4f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-9t8k2"
Oct 31 17:39:27.888238 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:27.888162    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c8d0a165-562c-4602-95fe-35a62229fa4f-istio-podinfo\") pod \"maas-default-gateway-openshift-default-7d9897b54c-9t8k2\" (UID: \"c8d0a165-562c-4602-95fe-35a62229fa4f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-9t8k2"
Oct 31 17:39:27.888326 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:27.888272    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c8d0a165-562c-4602-95fe-35a62229fa4f-credential-socket\") pod \"maas-default-gateway-openshift-default-7d9897b54c-9t8k2\" (UID: \"c8d0a165-562c-4602-95fe-35a62229fa4f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-9t8k2"
Oct 31 17:39:27.989342 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:27.989238    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9qmrp\" (UniqueName: \"kubernetes.io/projected/c8d0a165-562c-4602-95fe-35a62229fa4f-kube-api-access-9qmrp\") pod \"maas-default-gateway-openshift-default-7d9897b54c-9t8k2\" (UID: \"c8d0a165-562c-4602-95fe-35a62229fa4f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-9t8k2"
Oct 31 17:39:27.989342 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:27.989279    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c8d0a165-562c-4602-95fe-35a62229fa4f-istio-envoy\") pod \"maas-default-gateway-openshift-default-7d9897b54c-9t8k2\" (UID: \"c8d0a165-562c-4602-95fe-35a62229fa4f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-9t8k2"
Oct 31 17:39:27.989342 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:27.989331    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c8d0a165-562c-4602-95fe-35a62229fa4f-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-7d9897b54c-9t8k2\" (UID: \"c8d0a165-562c-4602-95fe-35a62229fa4f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-9t8k2"
Oct 31 17:39:27.989733 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:27.989368    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c8d0a165-562c-4602-95fe-35a62229fa4f-istio-podinfo\") pod \"maas-default-gateway-openshift-default-7d9897b54c-9t8k2\" (UID: \"c8d0a165-562c-4602-95fe-35a62229fa4f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-9t8k2"
Oct 31 17:39:27.989733 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:27.989598    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c8d0a165-562c-4602-95fe-35a62229fa4f-credential-socket\") pod \"maas-default-gateway-openshift-default-7d9897b54c-9t8k2\" (UID: \"c8d0a165-562c-4602-95fe-35a62229fa4f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-9t8k2"
Oct 31 17:39:27.989733 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:27.989685    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c8d0a165-562c-4602-95fe-35a62229fa4f-workload-certs\") pod \"maas-default-gateway-openshift-default-7d9897b54c-9t8k2\" (UID: \"c8d0a165-562c-4602-95fe-35a62229fa4f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-9t8k2"
Oct 31 17:39:27.989917 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:27.989770    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c8d0a165-562c-4602-95fe-35a62229fa4f-workload-socket\") pod \"maas-default-gateway-openshift-default-7d9897b54c-9t8k2\" (UID: \"c8d0a165-562c-4602-95fe-35a62229fa4f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-9t8k2"
Oct 31 17:39:27.989917 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:27.989804    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c8d0a165-562c-4602-95fe-35a62229fa4f-istio-data\") pod \"maas-default-gateway-openshift-default-7d9897b54c-9t8k2\" (UID: \"c8d0a165-562c-4602-95fe-35a62229fa4f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-9t8k2"
Oct 31 17:39:27.989917 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:27.989845    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c8d0a165-562c-4602-95fe-35a62229fa4f-istio-token\") pod \"maas-default-gateway-openshift-default-7d9897b54c-9t8k2\" (UID: \"c8d0a165-562c-4602-95fe-35a62229fa4f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-9t8k2"
Oct 31 17:39:27.990075 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:27.990036    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c8d0a165-562c-4602-95fe-35a62229fa4f-credential-socket\") pod \"maas-default-gateway-openshift-default-7d9897b54c-9t8k2\" (UID: \"c8d0a165-562c-4602-95fe-35a62229fa4f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-9t8k2"
Oct 31 17:39:27.990127 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:27.990105    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c8d0a165-562c-4602-95fe-35a62229fa4f-workload-certs\") pod \"maas-default-gateway-openshift-default-7d9897b54c-9t8k2\" (UID: \"c8d0a165-562c-4602-95fe-35a62229fa4f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-9t8k2"
Oct 31 17:39:27.990187 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:27.990164    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c8d0a165-562c-4602-95fe-35a62229fa4f-workload-socket\") pod \"maas-default-gateway-openshift-default-7d9897b54c-9t8k2\" (UID: \"c8d0a165-562c-4602-95fe-35a62229fa4f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-9t8k2"
Oct 31 17:39:27.990256 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:27.990234    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c8d0a165-562c-4602-95fe-35a62229fa4f-istio-data\") pod \"maas-default-gateway-openshift-default-7d9897b54c-9t8k2\" (UID: \"c8d0a165-562c-4602-95fe-35a62229fa4f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-9t8k2"
Oct 31 17:39:27.990432 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:27.990413    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c8d0a165-562c-4602-95fe-35a62229fa4f-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-7d9897b54c-9t8k2\" (UID: \"c8d0a165-562c-4602-95fe-35a62229fa4f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-9t8k2"
Oct 31 17:39:27.991838 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:27.991811    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c8d0a165-562c-4602-95fe-35a62229fa4f-istio-envoy\") pod \"maas-default-gateway-openshift-default-7d9897b54c-9t8k2\" (UID: \"c8d0a165-562c-4602-95fe-35a62229fa4f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-9t8k2"
Oct 31 17:39:27.992105 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:27.992089    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c8d0a165-562c-4602-95fe-35a62229fa4f-istio-podinfo\") pod \"maas-default-gateway-openshift-default-7d9897b54c-9t8k2\" (UID: \"c8d0a165-562c-4602-95fe-35a62229fa4f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-9t8k2"
Oct 31 17:39:28.008519 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:28.008492    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c8d0a165-562c-4602-95fe-35a62229fa4f-istio-token\") pod \"maas-default-gateway-openshift-default-7d9897b54c-9t8k2\" (UID: \"c8d0a165-562c-4602-95fe-35a62229fa4f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-9t8k2"
Oct 31 17:39:28.008763 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:28.008729    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9qmrp\" (UniqueName: \"kubernetes.io/projected/c8d0a165-562c-4602-95fe-35a62229fa4f-kube-api-access-9qmrp\") pod \"maas-default-gateway-openshift-default-7d9897b54c-9t8k2\" (UID: \"c8d0a165-562c-4602-95fe-35a62229fa4f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-9t8k2"
Oct 31 17:39:28.162611 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:28.162513    5003 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-9t8k2"
Oct 31 17:39:28.482286 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:28.482238    5003 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-9t8k2"]
Oct 31 17:39:28.484767 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:39:28.484739    5003 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc8d0a165_562c_4602_95fe_35a62229fa4f.slice/crio-8b8dae02b2cdc20f16a466b0d91b5185815dff5857af27034a0e1b160e4fbdc8 WatchSource:0}: Error finding container 8b8dae02b2cdc20f16a466b0d91b5185815dff5857af27034a0e1b160e4fbdc8: Status 404 returned error can't find the container with id 8b8dae02b2cdc20f16a466b0d91b5185815dff5857af27034a0e1b160e4fbdc8
Oct 31 17:39:28.487220 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:28.487189    5003 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Oct 31 17:39:28.487300 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:28.487252    5003 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Oct 31 17:39:28.487300 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:28.487290    5003 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Oct 31 17:39:28.701181 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:28.701144    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-9t8k2" event={"ID":"c8d0a165-562c-4602-95fe-35a62229fa4f","Type":"ContainerStarted","Data":"750b2133b47edd4b41676373badffd68d59f5ae43e5bb6f39a9ca2247e640203"}
Oct 31 17:39:28.701358 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:28.701205    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-9t8k2" event={"ID":"c8d0a165-562c-4602-95fe-35a62229fa4f","Type":"ContainerStarted","Data":"8b8dae02b2cdc20f16a466b0d91b5185815dff5857af27034a0e1b160e4fbdc8"}
Oct 31 17:39:28.744936 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:28.744826    5003 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-9t8k2" podStartSLOduration=1.7448122499999998 podStartE2EDuration="1.74481225s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 17:39:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 17:39:28.740325602 +0000 UTC m=+736.995180145" watchObservedRunningTime="2026-10-31 17:39:28.74481225 +0000 UTC m=+736.999666791"
Oct 31 17:39:29.163229 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:29.163185    5003 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-9t8k2"
Oct 31 17:39:29.165067 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:29.165040    5003 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-7d9897b54c-9t8k2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.88:15021/healthz/ready\": dial tcp 10.132.0.88:15021: connect: connection refused" start-of-body=
Oct 31 17:39:29.165188 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:29.165090    5003 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-9t8k2" podUID="c8d0a165-562c-4602-95fe-35a62229fa4f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.88:15021/healthz/ready\": dial tcp 10.132.0.88:15021: connect: connection refused"
Oct 31 17:39:30.174671 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:30.174113    5003 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-7d9897b54c-9t8k2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.88:15021/healthz/ready\": dial tcp 10.132.0.88:15021: connect: connection refused" start-of-body=
Oct 31 17:39:30.174671 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:30.174212    5003 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-9t8k2" podUID="c8d0a165-562c-4602-95fe-35a62229fa4f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.88:15021/healthz/ready\": dial tcp 10.132.0.88:15021: connect: connection refused"
Oct 31 17:39:31.168670 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:31.165036    5003 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-7d9897b54c-9t8k2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.88:15021/healthz/ready\": dial tcp 10.132.0.88:15021: connect: connection refused" start-of-body=
Oct 31 17:39:31.168670 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:31.165115    5003 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-9t8k2" podUID="c8d0a165-562c-4602-95fe-35a62229fa4f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.88:15021/healthz/ready\": dial tcp 10.132.0.88:15021: connect: connection refused"
Oct 31 17:39:31.635247 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:31.635207    5003 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w6-d80080-openshift-default-956cddf57-5f59v"]
Oct 31 17:39:31.639397 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:31.639378    5003 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-d80080-openshift-default-956cddf57-5f59v"
Oct 31 17:39:31.691670 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:31.690718    5003 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w6-d80080-openshift-default-956cddf57-5f59v"]
Oct 31 17:39:31.735092 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:31.735060    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/503ff30a-8065-430d-a685-89ff4ec49f7c-workload-socket\") pod \"e2e-worker-w6-d80080-openshift-default-956cddf57-5f59v\" (UID: \"503ff30a-8065-430d-a685-89ff4ec49f7c\") " pod="openshift-ingress/e2e-worker-w6-d80080-openshift-default-956cddf57-5f59v"
Oct 31 17:39:31.735092 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:31.735096    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/503ff30a-8065-430d-a685-89ff4ec49f7c-istio-podinfo\") pod \"e2e-worker-w6-d80080-openshift-default-956cddf57-5f59v\" (UID: \"503ff30a-8065-430d-a685-89ff4ec49f7c\") " pod="openshift-ingress/e2e-worker-w6-d80080-openshift-default-956cddf57-5f59v"
Oct 31 17:39:31.735355 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:31.735209    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2v8gn\" (UniqueName: \"kubernetes.io/projected/503ff30a-8065-430d-a685-89ff4ec49f7c-kube-api-access-2v8gn\") pod \"e2e-worker-w6-d80080-openshift-default-956cddf57-5f59v\" (UID: \"503ff30a-8065-430d-a685-89ff4ec49f7c\") " pod="openshift-ingress/e2e-worker-w6-d80080-openshift-default-956cddf57-5f59v"
Oct 31 17:39:31.735355 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:31.735244    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/503ff30a-8065-430d-a685-89ff4ec49f7c-istio-data\") pod \"e2e-worker-w6-d80080-openshift-default-956cddf57-5f59v\" (UID: \"503ff30a-8065-430d-a685-89ff4ec49f7c\") " pod="openshift-ingress/e2e-worker-w6-d80080-openshift-default-956cddf57-5f59v"
Oct 31 17:39:31.735462 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:31.735375    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/503ff30a-8065-430d-a685-89ff4ec49f7c-istio-envoy\") pod \"e2e-worker-w6-d80080-openshift-default-956cddf57-5f59v\" (UID: \"503ff30a-8065-430d-a685-89ff4ec49f7c\") " pod="openshift-ingress/e2e-worker-w6-d80080-openshift-default-956cddf57-5f59v"
Oct 31 17:39:31.735462 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:31.735396    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/503ff30a-8065-430d-a685-89ff4ec49f7c-istio-token\") pod \"e2e-worker-w6-d80080-openshift-default-956cddf57-5f59v\" (UID: \"503ff30a-8065-430d-a685-89ff4ec49f7c\") " pod="openshift-ingress/e2e-worker-w6-d80080-openshift-default-956cddf57-5f59v"
Oct 31 17:39:31.735462 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:31.735411    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/503ff30a-8065-430d-a685-89ff4ec49f7c-istiod-ca-cert\") pod \"e2e-worker-w6-d80080-openshift-default-956cddf57-5f59v\" (UID: \"503ff30a-8065-430d-a685-89ff4ec49f7c\") " pod="openshift-ingress/e2e-worker-w6-d80080-openshift-default-956cddf57-5f59v"
Oct 31 17:39:31.735462 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:31.735436    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/503ff30a-8065-430d-a685-89ff4ec49f7c-workload-certs\") pod \"e2e-worker-w6-d80080-openshift-default-956cddf57-5f59v\" (UID: \"503ff30a-8065-430d-a685-89ff4ec49f7c\") " pod="openshift-ingress/e2e-worker-w6-d80080-openshift-default-956cddf57-5f59v"
Oct 31 17:39:31.735678 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:31.735502    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/503ff30a-8065-430d-a685-89ff4ec49f7c-credential-socket\") pod \"e2e-worker-w6-d80080-openshift-default-956cddf57-5f59v\" (UID: \"503ff30a-8065-430d-a685-89ff4ec49f7c\") " pod="openshift-ingress/e2e-worker-w6-d80080-openshift-default-956cddf57-5f59v"
Oct 31 17:39:31.743713 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:31.743667    5003 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w2-5c446c-openshift-default-797c6dc855-v5k9r"]
Oct 31 17:39:31.748454 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:31.748434    5003 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-5c446c-openshift-default-797c6dc855-v5k9r"
Oct 31 17:39:31.789745 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:31.789708    5003 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w2-5c446c-openshift-default-797c6dc855-v5k9r"]
Oct 31 17:39:31.836892 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:31.836856    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/503ff30a-8065-430d-a685-89ff4ec49f7c-istio-envoy\") pod \"e2e-worker-w6-d80080-openshift-default-956cddf57-5f59v\" (UID: \"503ff30a-8065-430d-a685-89ff4ec49f7c\") " pod="openshift-ingress/e2e-worker-w6-d80080-openshift-default-956cddf57-5f59v"
Oct 31 17:39:31.836892 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:31.836895    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/503ff30a-8065-430d-a685-89ff4ec49f7c-istio-token\") pod \"e2e-worker-w6-d80080-openshift-default-956cddf57-5f59v\" (UID: \"503ff30a-8065-430d-a685-89ff4ec49f7c\") " pod="openshift-ingress/e2e-worker-w6-d80080-openshift-default-956cddf57-5f59v"
Oct 31 17:39:31.837088 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:31.836911    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/503ff30a-8065-430d-a685-89ff4ec49f7c-istiod-ca-cert\") pod \"e2e-worker-w6-d80080-openshift-default-956cddf57-5f59v\" (UID: \"503ff30a-8065-430d-a685-89ff4ec49f7c\") " pod="openshift-ingress/e2e-worker-w6-d80080-openshift-default-956cddf57-5f59v"
Oct 31 17:39:31.837088 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:31.837024    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ef941538-5385-4d44-98cd-ffddd91e9dc5-istio-envoy\") pod \"e2e-worker-w2-5c446c-openshift-default-797c6dc855-v5k9r\" (UID: \"ef941538-5385-4d44-98cd-ffddd91e9dc5\") " pod="openshift-ingress/e2e-worker-w2-5c446c-openshift-default-797c6dc855-v5k9r"
Oct 31 17:39:31.837088 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:31.837056    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/503ff30a-8065-430d-a685-89ff4ec49f7c-workload-certs\") pod \"e2e-worker-w6-d80080-openshift-default-956cddf57-5f59v\" (UID: \"503ff30a-8065-430d-a685-89ff4ec49f7c\") " pod="openshift-ingress/e2e-worker-w6-d80080-openshift-default-956cddf57-5f59v"
Oct 31 17:39:31.837182 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:31.837094    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/503ff30a-8065-430d-a685-89ff4ec49f7c-credential-socket\") pod \"e2e-worker-w6-d80080-openshift-default-956cddf57-5f59v\" (UID: \"503ff30a-8065-430d-a685-89ff4ec49f7c\") " pod="openshift-ingress/e2e-worker-w6-d80080-openshift-default-956cddf57-5f59v"
Oct 31 17:39:31.837254 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:31.837228    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ef941538-5385-4d44-98cd-ffddd91e9dc5-workload-certs\") pod \"e2e-worker-w2-5c446c-openshift-default-797c6dc855-v5k9r\" (UID: \"ef941538-5385-4d44-98cd-ffddd91e9dc5\") " pod="openshift-ingress/e2e-worker-w2-5c446c-openshift-default-797c6dc855-v5k9r"
Oct 31 17:39:31.837346 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:31.837315    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ef941538-5385-4d44-98cd-ffddd91e9dc5-credential-socket\") pod \"e2e-worker-w2-5c446c-openshift-default-797c6dc855-v5k9r\" (UID: \"ef941538-5385-4d44-98cd-ffddd91e9dc5\") " pod="openshift-ingress/e2e-worker-w2-5c446c-openshift-default-797c6dc855-v5k9r"
Oct 31 17:39:31.837398 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:31.837369    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/503ff30a-8065-430d-a685-89ff4ec49f7c-credential-socket\") pod \"e2e-worker-w6-d80080-openshift-default-956cddf57-5f59v\" (UID: \"503ff30a-8065-430d-a685-89ff4ec49f7c\") " pod="openshift-ingress/e2e-worker-w6-d80080-openshift-default-956cddf57-5f59v"
Oct 31 17:39:31.837466 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:31.837448    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/503ff30a-8065-430d-a685-89ff4ec49f7c-workload-certs\") pod \"e2e-worker-w6-d80080-openshift-default-956cddf57-5f59v\" (UID: \"503ff30a-8065-430d-a685-89ff4ec49f7c\") " pod="openshift-ingress/e2e-worker-w6-d80080-openshift-default-956cddf57-5f59v"
Oct 31 17:39:31.837521 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:31.837467    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ef941538-5385-4d44-98cd-ffddd91e9dc5-istio-podinfo\") pod \"e2e-worker-w2-5c446c-openshift-default-797c6dc855-v5k9r\" (UID: \"ef941538-5385-4d44-98cd-ffddd91e9dc5\") " pod="openshift-ingress/e2e-worker-w2-5c446c-openshift-default-797c6dc855-v5k9r"
Oct 31 17:39:31.837521 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:31.837492    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/503ff30a-8065-430d-a685-89ff4ec49f7c-workload-socket\") pod \"e2e-worker-w6-d80080-openshift-default-956cddf57-5f59v\" (UID: \"503ff30a-8065-430d-a685-89ff4ec49f7c\") " pod="openshift-ingress/e2e-worker-w6-d80080-openshift-default-956cddf57-5f59v"
Oct 31 17:39:31.837521 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:31.837514    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/503ff30a-8065-430d-a685-89ff4ec49f7c-istio-podinfo\") pod \"e2e-worker-w6-d80080-openshift-default-956cddf57-5f59v\" (UID: \"503ff30a-8065-430d-a685-89ff4ec49f7c\") " pod="openshift-ingress/e2e-worker-w6-d80080-openshift-default-956cddf57-5f59v"
Oct 31 17:39:31.837696 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:31.837580    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ef941538-5385-4d44-98cd-ffddd91e9dc5-istiod-ca-cert\") pod \"e2e-worker-w2-5c446c-openshift-default-797c6dc855-v5k9r\" (UID: \"ef941538-5385-4d44-98cd-ffddd91e9dc5\") " pod="openshift-ingress/e2e-worker-w2-5c446c-openshift-default-797c6dc855-v5k9r"
Oct 31 17:39:31.837756 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:31.837698    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2v8gn\" (UniqueName: \"kubernetes.io/projected/503ff30a-8065-430d-a685-89ff4ec49f7c-kube-api-access-2v8gn\") pod \"e2e-worker-w6-d80080-openshift-default-956cddf57-5f59v\" (UID: \"503ff30a-8065-430d-a685-89ff4ec49f7c\") " pod="openshift-ingress/e2e-worker-w6-d80080-openshift-default-956cddf57-5f59v"
Oct 31 17:39:31.837756 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:31.837707    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/503ff30a-8065-430d-a685-89ff4ec49f7c-istiod-ca-cert\") pod \"e2e-worker-w6-d80080-openshift-default-956cddf57-5f59v\" (UID: \"503ff30a-8065-430d-a685-89ff4ec49f7c\") " pod="openshift-ingress/e2e-worker-w6-d80080-openshift-default-956cddf57-5f59v"
Oct 31 17:39:31.837756 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:31.837723    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w55mk\" (UniqueName: \"kubernetes.io/projected/ef941538-5385-4d44-98cd-ffddd91e9dc5-kube-api-access-w55mk\") pod \"e2e-worker-w2-5c446c-openshift-default-797c6dc855-v5k9r\" (UID: \"ef941538-5385-4d44-98cd-ffddd91e9dc5\") " pod="openshift-ingress/e2e-worker-w2-5c446c-openshift-default-797c6dc855-v5k9r"
Oct 31 17:39:31.837922 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:31.837802    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/503ff30a-8065-430d-a685-89ff4ec49f7c-istio-data\") pod \"e2e-worker-w6-d80080-openshift-default-956cddf57-5f59v\" (UID: \"503ff30a-8065-430d-a685-89ff4ec49f7c\") " pod="openshift-ingress/e2e-worker-w6-d80080-openshift-default-956cddf57-5f59v"
Oct 31 17:39:31.837922 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:31.837846    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/503ff30a-8065-430d-a685-89ff4ec49f7c-workload-socket\") pod \"e2e-worker-w6-d80080-openshift-default-956cddf57-5f59v\" (UID: \"503ff30a-8065-430d-a685-89ff4ec49f7c\") " pod="openshift-ingress/e2e-worker-w6-d80080-openshift-default-956cddf57-5f59v"
Oct 31 17:39:31.837922 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:31.837849    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ef941538-5385-4d44-98cd-ffddd91e9dc5-istio-data\") pod \"e2e-worker-w2-5c446c-openshift-default-797c6dc855-v5k9r\" (UID: \"ef941538-5385-4d44-98cd-ffddd91e9dc5\") " pod="openshift-ingress/e2e-worker-w2-5c446c-openshift-default-797c6dc855-v5k9r"
Oct 31 17:39:31.838100 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:31.837957    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ef941538-5385-4d44-98cd-ffddd91e9dc5-istio-token\") pod \"e2e-worker-w2-5c446c-openshift-default-797c6dc855-v5k9r\" (UID: \"ef941538-5385-4d44-98cd-ffddd91e9dc5\") " pod="openshift-ingress/e2e-worker-w2-5c446c-openshift-default-797c6dc855-v5k9r"
Oct 31 17:39:31.838100 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:31.837986    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ef941538-5385-4d44-98cd-ffddd91e9dc5-workload-socket\") pod \"e2e-worker-w2-5c446c-openshift-default-797c6dc855-v5k9r\" (UID: \"ef941538-5385-4d44-98cd-ffddd91e9dc5\") " pod="openshift-ingress/e2e-worker-w2-5c446c-openshift-default-797c6dc855-v5k9r"
Oct 31 17:39:31.838100 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:31.838087    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/503ff30a-8065-430d-a685-89ff4ec49f7c-istio-data\") pod \"e2e-worker-w6-d80080-openshift-default-956cddf57-5f59v\" (UID: \"503ff30a-8065-430d-a685-89ff4ec49f7c\") " pod="openshift-ingress/e2e-worker-w6-d80080-openshift-default-956cddf57-5f59v"
Oct 31 17:39:31.839267 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:31.839248    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/503ff30a-8065-430d-a685-89ff4ec49f7c-istio-envoy\") pod \"e2e-worker-w6-d80080-openshift-default-956cddf57-5f59v\" (UID: \"503ff30a-8065-430d-a685-89ff4ec49f7c\") " pod="openshift-ingress/e2e-worker-w6-d80080-openshift-default-956cddf57-5f59v"
Oct 31 17:39:31.839759 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:31.839742    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/503ff30a-8065-430d-a685-89ff4ec49f7c-istio-podinfo\") pod \"e2e-worker-w6-d80080-openshift-default-956cddf57-5f59v\" (UID: \"503ff30a-8065-430d-a685-89ff4ec49f7c\") " pod="openshift-ingress/e2e-worker-w6-d80080-openshift-default-956cddf57-5f59v"
Oct 31 17:39:31.885346 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:31.885270    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/503ff30a-8065-430d-a685-89ff4ec49f7c-istio-token\") pod \"e2e-worker-w6-d80080-openshift-default-956cddf57-5f59v\" (UID: \"503ff30a-8065-430d-a685-89ff4ec49f7c\") " pod="openshift-ingress/e2e-worker-w6-d80080-openshift-default-956cddf57-5f59v"
Oct 31 17:39:31.885762 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:31.885735    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2v8gn\" (UniqueName: \"kubernetes.io/projected/503ff30a-8065-430d-a685-89ff4ec49f7c-kube-api-access-2v8gn\") pod \"e2e-worker-w6-d80080-openshift-default-956cddf57-5f59v\" (UID: \"503ff30a-8065-430d-a685-89ff4ec49f7c\") " pod="openshift-ingress/e2e-worker-w6-d80080-openshift-default-956cddf57-5f59v"
Oct 31 17:39:31.939139 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:31.939101    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ef941538-5385-4d44-98cd-ffddd91e9dc5-istio-token\") pod \"e2e-worker-w2-5c446c-openshift-default-797c6dc855-v5k9r\" (UID: \"ef941538-5385-4d44-98cd-ffddd91e9dc5\") " pod="openshift-ingress/e2e-worker-w2-5c446c-openshift-default-797c6dc855-v5k9r"
Oct 31 17:39:31.939331 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:31.939148    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ef941538-5385-4d44-98cd-ffddd91e9dc5-workload-socket\") pod \"e2e-worker-w2-5c446c-openshift-default-797c6dc855-v5k9r\" (UID: \"ef941538-5385-4d44-98cd-ffddd91e9dc5\") " pod="openshift-ingress/e2e-worker-w2-5c446c-openshift-default-797c6dc855-v5k9r"
Oct 31 17:39:31.939331 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:31.939187    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ef941538-5385-4d44-98cd-ffddd91e9dc5-istio-envoy\") pod \"e2e-worker-w2-5c446c-openshift-default-797c6dc855-v5k9r\" (UID: \"ef941538-5385-4d44-98cd-ffddd91e9dc5\") " pod="openshift-ingress/e2e-worker-w2-5c446c-openshift-default-797c6dc855-v5k9r"
Oct 31 17:39:31.939331 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:31.939220    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ef941538-5385-4d44-98cd-ffddd91e9dc5-workload-certs\") pod \"e2e-worker-w2-5c446c-openshift-default-797c6dc855-v5k9r\" (UID: \"ef941538-5385-4d44-98cd-ffddd91e9dc5\") " pod="openshift-ingress/e2e-worker-w2-5c446c-openshift-default-797c6dc855-v5k9r"
Oct 31 17:39:31.939331 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:31.939242    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ef941538-5385-4d44-98cd-ffddd91e9dc5-credential-socket\") pod \"e2e-worker-w2-5c446c-openshift-default-797c6dc855-v5k9r\" (UID: \"ef941538-5385-4d44-98cd-ffddd91e9dc5\") " pod="openshift-ingress/e2e-worker-w2-5c446c-openshift-default-797c6dc855-v5k9r"
Oct 31 17:39:31.939331 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:31.939309    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ef941538-5385-4d44-98cd-ffddd91e9dc5-istio-podinfo\") pod \"e2e-worker-w2-5c446c-openshift-default-797c6dc855-v5k9r\" (UID: \"ef941538-5385-4d44-98cd-ffddd91e9dc5\") " pod="openshift-ingress/e2e-worker-w2-5c446c-openshift-default-797c6dc855-v5k9r"
Oct 31 17:39:31.939605 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:31.939361    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ef941538-5385-4d44-98cd-ffddd91e9dc5-istiod-ca-cert\") pod \"e2e-worker-w2-5c446c-openshift-default-797c6dc855-v5k9r\" (UID: \"ef941538-5385-4d44-98cd-ffddd91e9dc5\") " pod="openshift-ingress/e2e-worker-w2-5c446c-openshift-default-797c6dc855-v5k9r"
Oct 31 17:39:31.939605 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:31.939419    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w55mk\" (UniqueName: \"kubernetes.io/projected/ef941538-5385-4d44-98cd-ffddd91e9dc5-kube-api-access-w55mk\") pod \"e2e-worker-w2-5c446c-openshift-default-797c6dc855-v5k9r\" (UID: \"ef941538-5385-4d44-98cd-ffddd91e9dc5\") " pod="openshift-ingress/e2e-worker-w2-5c446c-openshift-default-797c6dc855-v5k9r"
Oct 31 17:39:31.939605 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:31.939461    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ef941538-5385-4d44-98cd-ffddd91e9dc5-istio-data\") pod \"e2e-worker-w2-5c446c-openshift-default-797c6dc855-v5k9r\" (UID: \"ef941538-5385-4d44-98cd-ffddd91e9dc5\") " pod="openshift-ingress/e2e-worker-w2-5c446c-openshift-default-797c6dc855-v5k9r"
Oct 31 17:39:31.939776 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:31.939714    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ef941538-5385-4d44-98cd-ffddd91e9dc5-workload-socket\") pod \"e2e-worker-w2-5c446c-openshift-default-797c6dc855-v5k9r\" (UID: \"ef941538-5385-4d44-98cd-ffddd91e9dc5\") " pod="openshift-ingress/e2e-worker-w2-5c446c-openshift-default-797c6dc855-v5k9r"
Oct 31 17:39:31.939776 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:31.939736    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ef941538-5385-4d44-98cd-ffddd91e9dc5-workload-certs\") pod \"e2e-worker-w2-5c446c-openshift-default-797c6dc855-v5k9r\" (UID: \"ef941538-5385-4d44-98cd-ffddd91e9dc5\") " pod="openshift-ingress/e2e-worker-w2-5c446c-openshift-default-797c6dc855-v5k9r"
Oct 31 17:39:31.939907 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:31.939880    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ef941538-5385-4d44-98cd-ffddd91e9dc5-istio-data\") pod \"e2e-worker-w2-5c446c-openshift-default-797c6dc855-v5k9r\" (UID: \"ef941538-5385-4d44-98cd-ffddd91e9dc5\") " pod="openshift-ingress/e2e-worker-w2-5c446c-openshift-default-797c6dc855-v5k9r"
Oct 31 17:39:31.940024 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:31.939972    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ef941538-5385-4d44-98cd-ffddd91e9dc5-credential-socket\") pod \"e2e-worker-w2-5c446c-openshift-default-797c6dc855-v5k9r\" (UID: \"ef941538-5385-4d44-98cd-ffddd91e9dc5\") " pod="openshift-ingress/e2e-worker-w2-5c446c-openshift-default-797c6dc855-v5k9r"
Oct 31 17:39:31.940153 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:31.940131    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ef941538-5385-4d44-98cd-ffddd91e9dc5-istiod-ca-cert\") pod \"e2e-worker-w2-5c446c-openshift-default-797c6dc855-v5k9r\" (UID: \"ef941538-5385-4d44-98cd-ffddd91e9dc5\") " pod="openshift-ingress/e2e-worker-w2-5c446c-openshift-default-797c6dc855-v5k9r"
Oct 31 17:39:31.941707 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:31.941686    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ef941538-5385-4d44-98cd-ffddd91e9dc5-istio-envoy\") pod \"e2e-worker-w2-5c446c-openshift-default-797c6dc855-v5k9r\" (UID: \"ef941538-5385-4d44-98cd-ffddd91e9dc5\") " pod="openshift-ingress/e2e-worker-w2-5c446c-openshift-default-797c6dc855-v5k9r"
Oct 31 17:39:31.941906 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:31.941880    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ef941538-5385-4d44-98cd-ffddd91e9dc5-istio-podinfo\") pod \"e2e-worker-w2-5c446c-openshift-default-797c6dc855-v5k9r\" (UID: \"ef941538-5385-4d44-98cd-ffddd91e9dc5\") " pod="openshift-ingress/e2e-worker-w2-5c446c-openshift-default-797c6dc855-v5k9r"
Oct 31 17:39:31.977670 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:31.977356    5003 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-d80080-openshift-default-956cddf57-5f59v"
Oct 31 17:39:31.980360 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:31.980327    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ef941538-5385-4d44-98cd-ffddd91e9dc5-istio-token\") pod \"e2e-worker-w2-5c446c-openshift-default-797c6dc855-v5k9r\" (UID: \"ef941538-5385-4d44-98cd-ffddd91e9dc5\") " pod="openshift-ingress/e2e-worker-w2-5c446c-openshift-default-797c6dc855-v5k9r"
Oct 31 17:39:31.980569 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:31.980549    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w55mk\" (UniqueName: \"kubernetes.io/projected/ef941538-5385-4d44-98cd-ffddd91e9dc5-kube-api-access-w55mk\") pod \"e2e-worker-w2-5c446c-openshift-default-797c6dc855-v5k9r\" (UID: \"ef941538-5385-4d44-98cd-ffddd91e9dc5\") " pod="openshift-ingress/e2e-worker-w2-5c446c-openshift-default-797c6dc855-v5k9r"
Oct 31 17:39:32.025077 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:32.022724    5003 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w0-ee816e/distinct-w0-ee816e-kserve-564f897f89-kglpl"]
Oct 31 17:39:32.028911 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:32.028862    5003 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-ee816e/distinct-w0-ee816e-kserve-564f897f89-kglpl"
Oct 31 17:39:32.046521 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:32.046491    5003 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-ee816e/distinct-w0-ee816e-kserve-564f897f89-kglpl"]
Oct 31 17:39:32.101838 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:32.101481    5003 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-5c446c-openshift-default-797c6dc855-v5k9r"
Oct 31 17:39:32.129699 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:32.129631    5003 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w0-ee816e\"/\"distinct-w0-ee816e-kserve-self-signed-certs\""
Oct 31 17:39:32.143263 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:32.142673    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/82b982f8-de44-449d-b4a6-dc8f5824bf35-tmp-dir\") pod \"distinct-w0-ee816e-kserve-564f897f89-kglpl\" (UID: \"82b982f8-de44-449d-b4a6-dc8f5824bf35\") " pod="e2e-models-e2e-worker-w0-ee816e/distinct-w0-ee816e-kserve-564f897f89-kglpl"
Oct 31 17:39:32.143263 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:32.142787    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/82b982f8-de44-449d-b4a6-dc8f5824bf35-dshm\") pod \"distinct-w0-ee816e-kserve-564f897f89-kglpl\" (UID: \"82b982f8-de44-449d-b4a6-dc8f5824bf35\") " pod="e2e-models-e2e-worker-w0-ee816e/distinct-w0-ee816e-kserve-564f897f89-kglpl"
Oct 31 17:39:32.143263 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:32.142817    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/82b982f8-de44-449d-b4a6-dc8f5824bf35-model-cache\") pod \"distinct-w0-ee816e-kserve-564f897f89-kglpl\" (UID: \"82b982f8-de44-449d-b4a6-dc8f5824bf35\") " pod="e2e-models-e2e-worker-w0-ee816e/distinct-w0-ee816e-kserve-564f897f89-kglpl"
Oct 31 17:39:32.143263 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:32.142884    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/82b982f8-de44-449d-b4a6-dc8f5824bf35-home\") pod \"distinct-w0-ee816e-kserve-564f897f89-kglpl\" (UID: \"82b982f8-de44-449d-b4a6-dc8f5824bf35\") " pod="e2e-models-e2e-worker-w0-ee816e/distinct-w0-ee816e-kserve-564f897f89-kglpl"
Oct 31 17:39:32.143263 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:32.142962    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-flgwf\" (UniqueName: \"kubernetes.io/projected/82b982f8-de44-449d-b4a6-dc8f5824bf35-kube-api-access-flgwf\") pod \"distinct-w0-ee816e-kserve-564f897f89-kglpl\" (UID: \"82b982f8-de44-449d-b4a6-dc8f5824bf35\") " pod="e2e-models-e2e-worker-w0-ee816e/distinct-w0-ee816e-kserve-564f897f89-kglpl"
Oct 31 17:39:32.143263 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:32.143000    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/82b982f8-de44-449d-b4a6-dc8f5824bf35-tls-certs\") pod \"distinct-w0-ee816e-kserve-564f897f89-kglpl\" (UID: \"82b982f8-de44-449d-b4a6-dc8f5824bf35\") " pod="e2e-models-e2e-worker-w0-ee816e/distinct-w0-ee816e-kserve-564f897f89-kglpl"
Oct 31 17:39:32.172435 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:32.171972    5003 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-7d9897b54c-9t8k2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.88:15021/healthz/ready\": dial tcp 10.132.0.88:15021: connect: connection refused" start-of-body=
Oct 31 17:39:32.172435 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:32.172030    5003 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-9t8k2" podUID="c8d0a165-562c-4602-95fe-35a62229fa4f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.88:15021/healthz/ready\": dial tcp 10.132.0.88:15021: connect: connection refused"
Oct 31 17:39:32.246337 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:32.245280    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/82b982f8-de44-449d-b4a6-dc8f5824bf35-tmp-dir\") pod \"distinct-w0-ee816e-kserve-564f897f89-kglpl\" (UID: \"82b982f8-de44-449d-b4a6-dc8f5824bf35\") " pod="e2e-models-e2e-worker-w0-ee816e/distinct-w0-ee816e-kserve-564f897f89-kglpl"
Oct 31 17:39:32.246337 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:32.245388    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/82b982f8-de44-449d-b4a6-dc8f5824bf35-dshm\") pod \"distinct-w0-ee816e-kserve-564f897f89-kglpl\" (UID: \"82b982f8-de44-449d-b4a6-dc8f5824bf35\") " pod="e2e-models-e2e-worker-w0-ee816e/distinct-w0-ee816e-kserve-564f897f89-kglpl"
Oct 31 17:39:32.246337 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:32.245417    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/82b982f8-de44-449d-b4a6-dc8f5824bf35-model-cache\") pod \"distinct-w0-ee816e-kserve-564f897f89-kglpl\" (UID: \"82b982f8-de44-449d-b4a6-dc8f5824bf35\") " pod="e2e-models-e2e-worker-w0-ee816e/distinct-w0-ee816e-kserve-564f897f89-kglpl"
Oct 31 17:39:32.246337 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:32.245488    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/82b982f8-de44-449d-b4a6-dc8f5824bf35-home\") pod \"distinct-w0-ee816e-kserve-564f897f89-kglpl\" (UID: \"82b982f8-de44-449d-b4a6-dc8f5824bf35\") " pod="e2e-models-e2e-worker-w0-ee816e/distinct-w0-ee816e-kserve-564f897f89-kglpl"
Oct 31 17:39:32.246337 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:32.245615    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-flgwf\" (UniqueName: \"kubernetes.io/projected/82b982f8-de44-449d-b4a6-dc8f5824bf35-kube-api-access-flgwf\") pod \"distinct-w0-ee816e-kserve-564f897f89-kglpl\" (UID: \"82b982f8-de44-449d-b4a6-dc8f5824bf35\") " pod="e2e-models-e2e-worker-w0-ee816e/distinct-w0-ee816e-kserve-564f897f89-kglpl"
Oct 31 17:39:32.246337 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:32.245667    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/82b982f8-de44-449d-b4a6-dc8f5824bf35-tls-certs\") pod \"distinct-w0-ee816e-kserve-564f897f89-kglpl\" (UID: \"82b982f8-de44-449d-b4a6-dc8f5824bf35\") " pod="e2e-models-e2e-worker-w0-ee816e/distinct-w0-ee816e-kserve-564f897f89-kglpl"
Oct 31 17:39:32.249730 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:32.248957    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/82b982f8-de44-449d-b4a6-dc8f5824bf35-home\") pod \"distinct-w0-ee816e-kserve-564f897f89-kglpl\" (UID: \"82b982f8-de44-449d-b4a6-dc8f5824bf35\") " pod="e2e-models-e2e-worker-w0-ee816e/distinct-w0-ee816e-kserve-564f897f89-kglpl"
Oct 31 17:39:32.249730 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:32.249686    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/82b982f8-de44-449d-b4a6-dc8f5824bf35-tmp-dir\") pod \"distinct-w0-ee816e-kserve-564f897f89-kglpl\" (UID: \"82b982f8-de44-449d-b4a6-dc8f5824bf35\") " pod="e2e-models-e2e-worker-w0-ee816e/distinct-w0-ee816e-kserve-564f897f89-kglpl"
Oct 31 17:39:32.250193 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:32.250173    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/82b982f8-de44-449d-b4a6-dc8f5824bf35-model-cache\") pod \"distinct-w0-ee816e-kserve-564f897f89-kglpl\" (UID: \"82b982f8-de44-449d-b4a6-dc8f5824bf35\") " pod="e2e-models-e2e-worker-w0-ee816e/distinct-w0-ee816e-kserve-564f897f89-kglpl"
Oct 31 17:39:32.295286 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:32.295246    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/82b982f8-de44-449d-b4a6-dc8f5824bf35-dshm\") pod \"distinct-w0-ee816e-kserve-564f897f89-kglpl\" (UID: \"82b982f8-de44-449d-b4a6-dc8f5824bf35\") " pod="e2e-models-e2e-worker-w0-ee816e/distinct-w0-ee816e-kserve-564f897f89-kglpl"
Oct 31 17:39:32.297739 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:32.297706    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/82b982f8-de44-449d-b4a6-dc8f5824bf35-tls-certs\") pod \"distinct-w0-ee816e-kserve-564f897f89-kglpl\" (UID: \"82b982f8-de44-449d-b4a6-dc8f5824bf35\") " pod="e2e-models-e2e-worker-w0-ee816e/distinct-w0-ee816e-kserve-564f897f89-kglpl"
Oct 31 17:39:32.299979 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:32.299925    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-flgwf\" (UniqueName: \"kubernetes.io/projected/82b982f8-de44-449d-b4a6-dc8f5824bf35-kube-api-access-flgwf\") pod \"distinct-w0-ee816e-kserve-564f897f89-kglpl\" (UID: \"82b982f8-de44-449d-b4a6-dc8f5824bf35\") " pod="e2e-models-e2e-worker-w0-ee816e/distinct-w0-ee816e-kserve-564f897f89-kglpl"
Oct 31 17:39:32.340260 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:32.340231    5003 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w6-d80080-openshift-default-956cddf57-5f59v"]
Oct 31 17:39:32.343524 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:39:32.343486    5003 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod503ff30a_8065_430d_a685_89ff4ec49f7c.slice/crio-fa352262ad4303017f0576c2e25f4449334a5700194562b3d8d27b7f3d673a24 WatchSource:0}: Error finding container fa352262ad4303017f0576c2e25f4449334a5700194562b3d8d27b7f3d673a24: Status 404 returned error can't find the container with id fa352262ad4303017f0576c2e25f4449334a5700194562b3d8d27b7f3d673a24
Oct 31 17:39:32.345930 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:32.345881    5003 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Oct 31 17:39:32.346031 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:32.345977    5003 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Oct 31 17:39:32.346031 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:32.346015    5003 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Oct 31 17:39:32.390305 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:32.390271    5003 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-ee816e/distinct-w0-ee816e-kserve-564f897f89-kglpl"
Oct 31 17:39:32.497759 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:32.495041    5003 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w2-5c446c-openshift-default-797c6dc855-v5k9r"]
Oct 31 17:39:32.511882 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:32.511834    5003 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Oct 31 17:39:32.511981 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:32.511940    5003 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Oct 31 17:39:32.512027 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:32.511988    5003 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Oct 31 17:39:32.732311 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:32.732192    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-5c446c-openshift-default-797c6dc855-v5k9r" event={"ID":"ef941538-5385-4d44-98cd-ffddd91e9dc5","Type":"ContainerStarted","Data":"30c12535f0c7c5fa7b42e42386e0219a6c8fb87af5a09c9aac4edac282a087b1"}
Oct 31 17:39:32.732311 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:32.732274    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-5c446c-openshift-default-797c6dc855-v5k9r" event={"ID":"ef941538-5385-4d44-98cd-ffddd91e9dc5","Type":"ContainerStarted","Data":"78acb7f55486d10f16593f4acef02e7f7bfa6c2434b34b6004f18794475959e1"}
Oct 31 17:39:32.740063 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:32.739405    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-d80080-openshift-default-956cddf57-5f59v" event={"ID":"503ff30a-8065-430d-a685-89ff4ec49f7c","Type":"ContainerStarted","Data":"930ee319f56552eab82e08d8295978dd5d31efa037697ee5b6f837684ca1b6d6"}
Oct 31 17:39:32.740063 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:32.739469    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-d80080-openshift-default-956cddf57-5f59v" event={"ID":"503ff30a-8065-430d-a685-89ff4ec49f7c","Type":"ContainerStarted","Data":"fa352262ad4303017f0576c2e25f4449334a5700194562b3d8d27b7f3d673a24"}
Oct 31 17:39:32.740063 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:32.739530    5003 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-ee816e/distinct-w0-ee816e-kserve-564f897f89-kglpl"]
Oct 31 17:39:32.796318 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:32.793697    5003 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w2-5c446c-openshift-default-797c6dc855-v5k9r" podStartSLOduration=1.793675699 podStartE2EDuration="1.793675699s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 17:39:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 17:39:32.776032943 +0000 UTC m=+741.030887487" watchObservedRunningTime="2026-10-31 17:39:32.793675699 +0000 UTC m=+741.048530242"
Oct 31 17:39:32.830702 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:32.830400    5003 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w6-d80080-openshift-default-956cddf57-5f59v" podStartSLOduration=1.830381482 podStartE2EDuration="1.830381482s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 17:39:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 17:39:32.827270785 +0000 UTC m=+741.082125329" watchObservedRunningTime="2026-10-31 17:39:32.830381482 +0000 UTC m=+741.085236025"
Oct 31 17:39:32.984745 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:32.984501    5003 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w6-d80080-openshift-default-956cddf57-5f59v"
Oct 31 17:39:33.102265 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:33.102230    5003 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w2-5c446c-openshift-default-797c6dc855-v5k9r"
Oct 31 17:39:33.103903 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:33.103863    5003 patch_prober.go:29] interesting pod/e2e-worker-w2-5c446c-openshift-default-797c6dc855-v5k9r container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused" start-of-body=
Oct 31 17:39:33.104035 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:33.103926    5003 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-5c446c-openshift-default-797c6dc855-v5k9r" podUID="ef941538-5385-4d44-98cd-ffddd91e9dc5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused"
Oct 31 17:39:33.174670 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:33.174077    5003 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-7d9897b54c-9t8k2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.88:15021/healthz/ready\": dial tcp 10.132.0.88:15021: connect: connection refused" start-of-body=
Oct 31 17:39:33.174670 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:33.174144    5003 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-9t8k2" podUID="c8d0a165-562c-4602-95fe-35a62229fa4f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.88:15021/healthz/ready\": dial tcp 10.132.0.88:15021: connect: connection refused"
Oct 31 17:39:33.844082 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:33.843061    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-ee816e/distinct-w0-ee816e-kserve-564f897f89-kglpl" event={"ID":"82b982f8-de44-449d-b4a6-dc8f5824bf35","Type":"ContainerStarted","Data":"5ba6b2db40dd0fae9c50b42561f442c785684a1b1b1c9e5508407fdc625ed92a"}
Oct 31 17:39:33.844082 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:33.843102    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-ee816e/distinct-w0-ee816e-kserve-564f897f89-kglpl" event={"ID":"82b982f8-de44-449d-b4a6-dc8f5824bf35","Type":"ContainerStarted","Data":"33374cfd8b1b9adf6e7351e1cff6bb02413a8420934e2be8ab5c4b516c27d92c"}
Oct 31 17:39:34.007672 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:33.989766    5003 patch_prober.go:29] interesting pod/e2e-worker-w6-d80080-openshift-default-956cddf57-5f59v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.89:15021/healthz/ready\": dial tcp 10.132.0.89:15021: connect: connection refused" start-of-body=
Oct 31 17:39:34.007672 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:33.989833    5003 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-d80080-openshift-default-956cddf57-5f59v" podUID="503ff30a-8065-430d-a685-89ff4ec49f7c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.89:15021/healthz/ready\": dial tcp 10.132.0.89:15021: connect: connection refused"
Oct 31 17:39:34.104628 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:34.104536    5003 patch_prober.go:29] interesting pod/e2e-worker-w2-5c446c-openshift-default-797c6dc855-v5k9r container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused" start-of-body=
Oct 31 17:39:34.104905 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:34.104873    5003 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-5c446c-openshift-default-797c6dc855-v5k9r" podUID="ef941538-5385-4d44-98cd-ffddd91e9dc5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused"
Oct 31 17:39:34.169671 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:34.163060    5003 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-7d9897b54c-9t8k2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.88:15021/healthz/ready\": dial tcp 10.132.0.88:15021: connect: connection refused" start-of-body=
Oct 31 17:39:34.169671 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:34.163126    5003 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-9t8k2" podUID="c8d0a165-562c-4602-95fe-35a62229fa4f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.88:15021/healthz/ready\": dial tcp 10.132.0.88:15021: connect: connection refused"
Oct 31 17:39:34.395731 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:34.390744    5003 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w0-ee816e/distinct-w0-ee816e-kserve-564f897f89-kglpl"
Oct 31 17:39:34.988382 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:34.988344    5003 patch_prober.go:29] interesting pod/e2e-worker-w6-d80080-openshift-default-956cddf57-5f59v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.89:15021/healthz/ready\": dial tcp 10.132.0.89:15021: connect: connection refused" start-of-body=
Oct 31 17:39:34.989012 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:34.988975    5003 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-d80080-openshift-default-956cddf57-5f59v" podUID="503ff30a-8065-430d-a685-89ff4ec49f7c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.89:15021/healthz/ready\": dial tcp 10.132.0.89:15021: connect: connection refused"
Oct 31 17:39:35.111080 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:35.111043    5003 patch_prober.go:29] interesting pod/e2e-worker-w2-5c446c-openshift-default-797c6dc855-v5k9r container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused" start-of-body=
Oct 31 17:39:35.111853 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:35.111817    5003 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-5c446c-openshift-default-797c6dc855-v5k9r" podUID="ef941538-5385-4d44-98cd-ffddd91e9dc5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused"
Oct 31 17:39:35.172671 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:35.172060    5003 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-7d9897b54c-9t8k2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.88:15021/healthz/ready\": dial tcp 10.132.0.88:15021: connect: connection refused" start-of-body=
Oct 31 17:39:35.172671 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:35.172126    5003 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-9t8k2" podUID="c8d0a165-562c-4602-95fe-35a62229fa4f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.88:15021/healthz/ready\": dial tcp 10.132.0.88:15021: connect: connection refused"
Oct 31 17:39:35.808791 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:35.808741    5003 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-b78c31/simulator-w5-b78c31-kserve-95df74778-fpvpr" podUID="665d75c7-8ba5-49e1-87a7-51a18ae6f369" containerName="main" probeResult="failure" output="Get \"https://10.132.0.73:8000/ready\": context deadline exceeded"
Oct 31 17:39:35.925296 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:35.925251    5003 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-1c0bfd/premium-w4-1c0bfd-kserve-d78fbb98-psx55" podUID="34bdffed-87b8-4e7a-b182-f069d081bd62" containerName="main" probeResult="failure" output="Get \"https://10.132.0.74:8000/ready\": context deadline exceeded"
Oct 31 17:39:36.033672 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:36.013579    5003 patch_prober.go:29] interesting pod/e2e-worker-w6-d80080-openshift-default-956cddf57-5f59v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.89:15021/healthz/ready\": dial tcp 10.132.0.89:15021: connect: connection refused" start-of-body=
Oct 31 17:39:36.033672 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:36.013635    5003 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-d80080-openshift-default-956cddf57-5f59v" podUID="503ff30a-8065-430d-a685-89ff4ec49f7c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.89:15021/healthz/ready\": dial tcp 10.132.0.89:15021: connect: connection refused"
Oct 31 17:39:36.033672 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:36.022099    5003 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-5c446c/premium-w2-5c446c-kserve-66f7486c85-f7lk2" podUID="9c2ddfab-2348-4bb0-8844-1fca62460390" containerName="main" probeResult="failure" output="Get \"https://10.132.0.75:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 31 17:39:36.131725 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:36.102259    5003 patch_prober.go:29] interesting pod/e2e-worker-w2-5c446c-openshift-default-797c6dc855-v5k9r container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused" start-of-body=
Oct 31 17:39:36.131725 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:36.102334    5003 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-5c446c-openshift-default-797c6dc855-v5k9r" podUID="ef941538-5385-4d44-98cd-ffddd91e9dc5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused"
Oct 31 17:39:36.165134 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:36.165000    5003 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-7d9897b54c-9t8k2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.88:15021/healthz/ready\": dial tcp 10.132.0.88:15021: connect: connection refused" start-of-body=
Oct 31 17:39:36.165134 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:36.165066    5003 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-9t8k2" podUID="c8d0a165-562c-4602-95fe-35a62229fa4f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.88:15021/healthz/ready\": dial tcp 10.132.0.88:15021: connect: connection refused"
Oct 31 17:39:36.616124 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:36.613876    5003 prober.go:122] "Probe failed" probeType="Readiness" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-82w89" podUID="ef5a065b-f98e-4d14-810f-2d0c42c58ce6" containerName="main" probeResult="failure" output="Get \"https://10.132.0.54:8000/ready\": context deadline exceeded"
Oct 31 17:39:36.726729 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:36.718197    5003 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-0e59ca/simulator-w1-0e59ca-kserve-999765679-zs7kh" podUID="018d423e-6866-4b61-a4a2-d2e786d82bf0" containerName="main" probeResult="failure" output="Get \"https://10.132.0.71:8000/ready\": context deadline exceeded"
Oct 31 17:39:36.982378 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:36.982172    5003 patch_prober.go:29] interesting pod/e2e-worker-w6-d80080-openshift-default-956cddf57-5f59v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.89:15021/healthz/ready\": dial tcp 10.132.0.89:15021: connect: connection refused" start-of-body=
Oct 31 17:39:36.982684 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:36.982624    5003 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-d80080-openshift-default-956cddf57-5f59v" podUID="503ff30a-8065-430d-a685-89ff4ec49f7c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.89:15021/healthz/ready\": dial tcp 10.132.0.89:15021: connect: connection refused"
Oct 31 17:39:37.105120 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:37.105076    5003 patch_prober.go:29] interesting pod/e2e-worker-w2-5c446c-openshift-default-797c6dc855-v5k9r container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused" start-of-body=
Oct 31 17:39:37.105720 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:37.105686    5003 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-5c446c-openshift-default-797c6dc855-v5k9r" podUID="ef941538-5385-4d44-98cd-ffddd91e9dc5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused"
Oct 31 17:39:37.163239 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:37.163192    5003 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-7d9897b54c-9t8k2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.88:15021/healthz/ready\": dial tcp 10.132.0.88:15021: connect: connection refused" start-of-body=
Oct 31 17:39:37.163548 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:37.163502    5003 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-9t8k2" podUID="c8d0a165-562c-4602-95fe-35a62229fa4f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.88:15021/healthz/ready\": dial tcp 10.132.0.88:15021: connect: connection refused"
Oct 31 17:39:37.981164 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:37.981119    5003 patch_prober.go:29] interesting pod/e2e-worker-w6-d80080-openshift-default-956cddf57-5f59v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.89:15021/healthz/ready\": dial tcp 10.132.0.89:15021: connect: connection refused" start-of-body=
Oct 31 17:39:37.981458 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:37.981430    5003 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-d80080-openshift-default-956cddf57-5f59v" podUID="503ff30a-8065-430d-a685-89ff4ec49f7c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.89:15021/healthz/ready\": dial tcp 10.132.0.89:15021: connect: connection refused"
Oct 31 17:39:38.106058 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:38.106019    5003 patch_prober.go:29] interesting pod/e2e-worker-w2-5c446c-openshift-default-797c6dc855-v5k9r container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused" start-of-body=
Oct 31 17:39:38.106637 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:38.106603    5003 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-5c446c-openshift-default-797c6dc855-v5k9r" podUID="ef941538-5385-4d44-98cd-ffddd91e9dc5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused"
Oct 31 17:39:39.004670 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:39.003911    5003 patch_prober.go:29] interesting pod/e2e-worker-w6-d80080-openshift-default-956cddf57-5f59v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.89:15021/healthz/ready\": dial tcp 10.132.0.89:15021: connect: connection refused" start-of-body=
Oct 31 17:39:39.004670 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:39.003991    5003 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-d80080-openshift-default-956cddf57-5f59v" podUID="503ff30a-8065-430d-a685-89ff4ec49f7c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.89:15021/healthz/ready\": dial tcp 10.132.0.89:15021: connect: connection refused"
Oct 31 17:39:39.107161 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:39.107121    5003 patch_prober.go:29] interesting pod/e2e-worker-w2-5c446c-openshift-default-797c6dc855-v5k9r container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused" start-of-body=
Oct 31 17:39:39.107820 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:39.107773    5003 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-5c446c-openshift-default-797c6dc855-v5k9r" podUID="ef941538-5385-4d44-98cd-ffddd91e9dc5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused"
Oct 31 17:39:39.170775 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:39.170735    5003 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-7d9897b54c-9t8k2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.88:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 31 17:39:39.171064 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:39.171036    5003 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-9t8k2" podUID="c8d0a165-562c-4602-95fe-35a62229fa4f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.88:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 31 17:39:39.242372 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:39.242341    5003 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-9t8k2"
Oct 31 17:39:39.242708 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:39.242679    5003 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-9t8k2"
Oct 31 17:39:39.243763 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:39.243745    5003 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-9t8k2"
Oct 31 17:39:39.317113 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:39.317059    5003 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w0-ee816e/distinct-w0-ee816e-kserve-564f897f89-kglpl" podStartSLOduration=8.317044544 podStartE2EDuration="8.317044544s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 17:39:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 17:39:33.890946736 +0000 UTC m=+742.145801279" watchObservedRunningTime="2026-10-31 17:39:39.317044544 +0000 UTC m=+747.571899136"
Oct 31 17:39:40.102858 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:40.102824    5003 patch_prober.go:29] interesting pod/e2e-worker-w2-5c446c-openshift-default-797c6dc855-v5k9r container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused" start-of-body=
Oct 31 17:39:40.103079 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:40.102877    5003 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-5c446c-openshift-default-797c6dc855-v5k9r" podUID="ef941538-5385-4d44-98cd-ffddd91e9dc5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused"
Oct 31 17:39:40.256045 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:40.256012    5003 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w6-d80080-openshift-default-956cddf57-5f59v"
Oct 31 17:39:40.256862 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:40.256838    5003 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w6-d80080-openshift-default-956cddf57-5f59v"
Oct 31 17:39:40.258224 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:40.258158    5003 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w6-d80080-openshift-default-956cddf57-5f59v"
Oct 31 17:39:40.339975 ip-10-0-138-17 kubenswrapper[5003]: E1031 17:39:40.339928    5003 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-tdzz5" containerName="extractor"
Oct 31 17:39:41.428257 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:41.428223    5003 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w2-5c446c-openshift-default-797c6dc855-v5k9r"
Oct 31 17:39:41.428782 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:41.428592    5003 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w2-5c446c-openshift-default-797c6dc855-v5k9r"
Oct 31 17:39:41.430154 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:41.430128    5003 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w2-5c446c-openshift-default-797c6dc855-v5k9r"
Oct 31 17:39:42.391715 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:42.391680    5003 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w0-ee816e/distinct-w0-ee816e-kserve-564f897f89-kglpl"
Oct 31 17:39:42.404843 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:42.404812    5003 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w0-ee816e/distinct-w0-ee816e-kserve-564f897f89-kglpl"
Oct 31 17:39:43.155834 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:43.155804    5003 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w0-ee816e/distinct-w0-ee816e-kserve-564f897f89-kglpl"
Oct 31 17:39:47.026011 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:47.025972    5003 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-64dkg"]
Oct 31 17:39:47.031362 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:47.031339    5003 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-64dkg"
Oct 31 17:39:47.058848 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:47.058816    5003 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-64dkg"]
Oct 31 17:39:47.091691 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:47.091632    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/73f3a3b3-a5dd-4054-be25-5e23a820c5fe-workload-certs\") pod \"e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-64dkg\" (UID: \"73f3a3b3-a5dd-4054-be25-5e23a820c5fe\") " pod="openshift-ingress/e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-64dkg"
Oct 31 17:39:47.091893 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:47.091702    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/73f3a3b3-a5dd-4054-be25-5e23a820c5fe-istio-envoy\") pod \"e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-64dkg\" (UID: \"73f3a3b3-a5dd-4054-be25-5e23a820c5fe\") " pod="openshift-ingress/e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-64dkg"
Oct 31 17:39:47.091893 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:47.091749    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/73f3a3b3-a5dd-4054-be25-5e23a820c5fe-istio-podinfo\") pod \"e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-64dkg\" (UID: \"73f3a3b3-a5dd-4054-be25-5e23a820c5fe\") " pod="openshift-ingress/e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-64dkg"
Oct 31 17:39:47.091893 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:47.091872    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/73f3a3b3-a5dd-4054-be25-5e23a820c5fe-workload-socket\") pod \"e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-64dkg\" (UID: \"73f3a3b3-a5dd-4054-be25-5e23a820c5fe\") " pod="openshift-ingress/e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-64dkg"
Oct 31 17:39:47.092066 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:47.091940    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/73f3a3b3-a5dd-4054-be25-5e23a820c5fe-credential-socket\") pod \"e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-64dkg\" (UID: \"73f3a3b3-a5dd-4054-be25-5e23a820c5fe\") " pod="openshift-ingress/e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-64dkg"
Oct 31 17:39:47.092125 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:47.092080    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/73f3a3b3-a5dd-4054-be25-5e23a820c5fe-istiod-ca-cert\") pod \"e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-64dkg\" (UID: \"73f3a3b3-a5dd-4054-be25-5e23a820c5fe\") " pod="openshift-ingress/e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-64dkg"
Oct 31 17:39:47.092181 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:47.092122    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/73f3a3b3-a5dd-4054-be25-5e23a820c5fe-istio-token\") pod \"e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-64dkg\" (UID: \"73f3a3b3-a5dd-4054-be25-5e23a820c5fe\") " pod="openshift-ingress/e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-64dkg"
Oct 31 17:39:47.092181 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:47.092159    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4rgfh\" (UniqueName: \"kubernetes.io/projected/73f3a3b3-a5dd-4054-be25-5e23a820c5fe-kube-api-access-4rgfh\") pod \"e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-64dkg\" (UID: \"73f3a3b3-a5dd-4054-be25-5e23a820c5fe\") " pod="openshift-ingress/e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-64dkg"
Oct 31 17:39:47.092306 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:47.092286    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/73f3a3b3-a5dd-4054-be25-5e23a820c5fe-istio-data\") pod \"e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-64dkg\" (UID: \"73f3a3b3-a5dd-4054-be25-5e23a820c5fe\") " pod="openshift-ingress/e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-64dkg"
Oct 31 17:39:47.193384 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:47.193340    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/73f3a3b3-a5dd-4054-be25-5e23a820c5fe-istio-data\") pod \"e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-64dkg\" (UID: \"73f3a3b3-a5dd-4054-be25-5e23a820c5fe\") " pod="openshift-ingress/e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-64dkg"
Oct 31 17:39:47.193384 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:47.193388    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/73f3a3b3-a5dd-4054-be25-5e23a820c5fe-workload-certs\") pod \"e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-64dkg\" (UID: \"73f3a3b3-a5dd-4054-be25-5e23a820c5fe\") " pod="openshift-ingress/e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-64dkg"
Oct 31 17:39:47.193626 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:47.193404    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/73f3a3b3-a5dd-4054-be25-5e23a820c5fe-istio-envoy\") pod \"e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-64dkg\" (UID: \"73f3a3b3-a5dd-4054-be25-5e23a820c5fe\") " pod="openshift-ingress/e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-64dkg"
Oct 31 17:39:47.193626 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:47.193442    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/73f3a3b3-a5dd-4054-be25-5e23a820c5fe-istio-podinfo\") pod \"e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-64dkg\" (UID: \"73f3a3b3-a5dd-4054-be25-5e23a820c5fe\") " pod="openshift-ingress/e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-64dkg"
Oct 31 17:39:47.193626 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:47.193471    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/73f3a3b3-a5dd-4054-be25-5e23a820c5fe-workload-socket\") pod \"e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-64dkg\" (UID: \"73f3a3b3-a5dd-4054-be25-5e23a820c5fe\") " pod="openshift-ingress/e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-64dkg"
Oct 31 17:39:47.193626 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:47.193517    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/73f3a3b3-a5dd-4054-be25-5e23a820c5fe-credential-socket\") pod \"e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-64dkg\" (UID: \"73f3a3b3-a5dd-4054-be25-5e23a820c5fe\") " pod="openshift-ingress/e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-64dkg"
Oct 31 17:39:47.193626 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:47.193605    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/73f3a3b3-a5dd-4054-be25-5e23a820c5fe-istiod-ca-cert\") pod \"e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-64dkg\" (UID: \"73f3a3b3-a5dd-4054-be25-5e23a820c5fe\") " pod="openshift-ingress/e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-64dkg"
Oct 31 17:39:47.193896 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:47.193636    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/73f3a3b3-a5dd-4054-be25-5e23a820c5fe-istio-token\") pod \"e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-64dkg\" (UID: \"73f3a3b3-a5dd-4054-be25-5e23a820c5fe\") " pod="openshift-ingress/e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-64dkg"
Oct 31 17:39:47.193896 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:47.193689    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4rgfh\" (UniqueName: \"kubernetes.io/projected/73f3a3b3-a5dd-4054-be25-5e23a820c5fe-kube-api-access-4rgfh\") pod \"e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-64dkg\" (UID: \"73f3a3b3-a5dd-4054-be25-5e23a820c5fe\") " pod="openshift-ingress/e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-64dkg"
Oct 31 17:39:47.193896 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:47.193847    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/73f3a3b3-a5dd-4054-be25-5e23a820c5fe-istio-data\") pod \"e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-64dkg\" (UID: \"73f3a3b3-a5dd-4054-be25-5e23a820c5fe\") " pod="openshift-ingress/e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-64dkg"
Oct 31 17:39:47.193896 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:47.193866    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/73f3a3b3-a5dd-4054-be25-5e23a820c5fe-workload-certs\") pod \"e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-64dkg\" (UID: \"73f3a3b3-a5dd-4054-be25-5e23a820c5fe\") " pod="openshift-ingress/e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-64dkg"
Oct 31 17:39:47.194120 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:47.194087    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/73f3a3b3-a5dd-4054-be25-5e23a820c5fe-workload-socket\") pod \"e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-64dkg\" (UID: \"73f3a3b3-a5dd-4054-be25-5e23a820c5fe\") " pod="openshift-ingress/e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-64dkg"
Oct 31 17:39:47.194208 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:47.194176    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/73f3a3b3-a5dd-4054-be25-5e23a820c5fe-credential-socket\") pod \"e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-64dkg\" (UID: \"73f3a3b3-a5dd-4054-be25-5e23a820c5fe\") " pod="openshift-ingress/e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-64dkg"
Oct 31 17:39:47.194505 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:47.194482    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/73f3a3b3-a5dd-4054-be25-5e23a820c5fe-istiod-ca-cert\") pod \"e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-64dkg\" (UID: \"73f3a3b3-a5dd-4054-be25-5e23a820c5fe\") " pod="openshift-ingress/e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-64dkg"
Oct 31 17:39:47.195870 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:47.195846    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/73f3a3b3-a5dd-4054-be25-5e23a820c5fe-istio-envoy\") pod \"e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-64dkg\" (UID: \"73f3a3b3-a5dd-4054-be25-5e23a820c5fe\") " pod="openshift-ingress/e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-64dkg"
Oct 31 17:39:47.196238 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:47.196215    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/73f3a3b3-a5dd-4054-be25-5e23a820c5fe-istio-podinfo\") pod \"e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-64dkg\" (UID: \"73f3a3b3-a5dd-4054-be25-5e23a820c5fe\") " pod="openshift-ingress/e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-64dkg"
Oct 31 17:39:47.212073 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:47.212045    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/73f3a3b3-a5dd-4054-be25-5e23a820c5fe-istio-token\") pod \"e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-64dkg\" (UID: \"73f3a3b3-a5dd-4054-be25-5e23a820c5fe\") " pod="openshift-ingress/e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-64dkg"
Oct 31 17:39:47.212297 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:47.212268    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4rgfh\" (UniqueName: \"kubernetes.io/projected/73f3a3b3-a5dd-4054-be25-5e23a820c5fe-kube-api-access-4rgfh\") pod \"e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-64dkg\" (UID: \"73f3a3b3-a5dd-4054-be25-5e23a820c5fe\") " pod="openshift-ingress/e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-64dkg"
Oct 31 17:39:47.346641 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:47.346609    5003 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-64dkg"
Oct 31 17:39:47.662609 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:47.662579    5003 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-64dkg"]
Oct 31 17:39:47.665527 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:39:47.665499    5003 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod73f3a3b3_a5dd_4054_be25_5e23a820c5fe.slice/crio-c1f0656bd77d7ec34910d3eac35ec4c49ca8b384400104b632d0c04932719be0 WatchSource:0}: Error finding container c1f0656bd77d7ec34910d3eac35ec4c49ca8b384400104b632d0c04932719be0: Status 404 returned error can't find the container with id c1f0656bd77d7ec34910d3eac35ec4c49ca8b384400104b632d0c04932719be0
Oct 31 17:39:47.667810 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:47.667777    5003 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Oct 31 17:39:47.667908 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:47.667841    5003 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Oct 31 17:39:47.667908 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:47.667869    5003 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Oct 31 17:39:48.187457 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:48.187423    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-64dkg" event={"ID":"73f3a3b3-a5dd-4054-be25-5e23a820c5fe","Type":"ContainerStarted","Data":"6980e2f4859dd66f13efe444e15d8017e4212565c288f08348e4220c18fa54fa"}
Oct 31 17:39:48.187875 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:48.187477    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-64dkg" event={"ID":"73f3a3b3-a5dd-4054-be25-5e23a820c5fe","Type":"ContainerStarted","Data":"c1f0656bd77d7ec34910d3eac35ec4c49ca8b384400104b632d0c04932719be0"}
Oct 31 17:39:48.232170 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:48.232115    5003 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-64dkg" podStartSLOduration=1.2321011259999999 podStartE2EDuration="1.232101126s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 17:39:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 17:39:48.228844566 +0000 UTC m=+756.483699108" watchObservedRunningTime="2026-10-31 17:39:48.232101126 +0000 UTC m=+756.486955668"
Oct 31 17:39:48.347132 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:48.347098    5003 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-64dkg"
Oct 31 17:39:48.348557 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:48.348525    5003 patch_prober.go:29] interesting pod/e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-64dkg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.92:15021/healthz/ready\": dial tcp 10.132.0.92:15021: connect: connection refused" start-of-body=
Oct 31 17:39:48.348708 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:48.348570    5003 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-64dkg" podUID="73f3a3b3-a5dd-4054-be25-5e23a820c5fe" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.92:15021/healthz/ready\": dial tcp 10.132.0.92:15021: connect: connection refused"
Oct 31 17:39:49.348067 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:49.348024    5003 patch_prober.go:29] interesting pod/e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-64dkg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.92:15021/healthz/ready\": dial tcp 10.132.0.92:15021: connect: connection refused" start-of-body=
Oct 31 17:39:49.348559 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:49.348116    5003 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-64dkg" podUID="73f3a3b3-a5dd-4054-be25-5e23a820c5fe" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.92:15021/healthz/ready\": dial tcp 10.132.0.92:15021: connect: connection refused"
Oct 31 17:39:50.347737 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:50.347701    5003 patch_prober.go:29] interesting pod/e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-64dkg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.92:15021/healthz/ready\": dial tcp 10.132.0.92:15021: connect: connection refused" start-of-body=
Oct 31 17:39:50.347923 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:50.347760    5003 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-64dkg" podUID="73f3a3b3-a5dd-4054-be25-5e23a820c5fe" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.92:15021/healthz/ready\": dial tcp 10.132.0.92:15021: connect: connection refused"
Oct 31 17:39:51.347483 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:51.347448    5003 patch_prober.go:29] interesting pod/e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-64dkg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.92:15021/healthz/ready\": dial tcp 10.132.0.92:15021: connect: connection refused" start-of-body=
Oct 31 17:39:51.347942 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:51.347501    5003 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-64dkg" podUID="73f3a3b3-a5dd-4054-be25-5e23a820c5fe" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.92:15021/healthz/ready\": dial tcp 10.132.0.92:15021: connect: connection refused"
Oct 31 17:39:52.347932 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:52.347898    5003 patch_prober.go:29] interesting pod/e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-64dkg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.92:15021/healthz/ready\": dial tcp 10.132.0.92:15021: connect: connection refused" start-of-body=
Oct 31 17:39:52.348340 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:52.347956    5003 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-64dkg" podUID="73f3a3b3-a5dd-4054-be25-5e23a820c5fe" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.92:15021/healthz/ready\": dial tcp 10.132.0.92:15021: connect: connection refused"
Oct 31 17:39:53.353959 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:53.353925    5003 patch_prober.go:29] interesting pod/e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-64dkg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.92:15021/healthz/ready\": dial tcp 10.132.0.92:15021: connect: connection refused" start-of-body=
Oct 31 17:39:53.354543 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:53.354505    5003 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-64dkg" podUID="73f3a3b3-a5dd-4054-be25-5e23a820c5fe" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.92:15021/healthz/ready\": dial tcp 10.132.0.92:15021: connect: connection refused"
Oct 31 17:39:54.350346 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:54.350293    5003 patch_prober.go:29] interesting pod/e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-64dkg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.92:15021/healthz/ready\": dial tcp 10.132.0.92:15021: connect: connection refused" start-of-body=
Oct 31 17:39:54.350672 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:54.350613    5003 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-64dkg" podUID="73f3a3b3-a5dd-4054-be25-5e23a820c5fe" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.92:15021/healthz/ready\": dial tcp 10.132.0.92:15021: connect: connection refused"
Oct 31 17:39:55.078180 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:55.078143    5003 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w5-b78c31/distinct-w5-b78c31-kserve-77ccb69d98-p2zct"]
Oct 31 17:39:55.086414 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:55.084224    5003 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w5-b78c31/distinct-w5-b78c31-kserve-77ccb69d98-p2zct"
Oct 31 17:39:55.118476 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:55.118431    5003 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w5-b78c31/distinct-w5-b78c31-kserve-77ccb69d98-p2zct"]
Oct 31 17:39:55.123608 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:55.123583    5003 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w5-b78c31\"/\"distinct-w5-b78c31-kserve-self-signed-certs\""
Oct 31 17:39:55.255759 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:55.255717    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fcf01e9c-57fb-42db-848d-d314c615bd67-home\") pod \"distinct-w5-b78c31-kserve-77ccb69d98-p2zct\" (UID: \"fcf01e9c-57fb-42db-848d-d314c615bd67\") " pod="e2e-models-e2e-worker-w5-b78c31/distinct-w5-b78c31-kserve-77ccb69d98-p2zct"
Oct 31 17:39:55.255936 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:55.255805    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4p9pl\" (UniqueName: \"kubernetes.io/projected/fcf01e9c-57fb-42db-848d-d314c615bd67-kube-api-access-4p9pl\") pod \"distinct-w5-b78c31-kserve-77ccb69d98-p2zct\" (UID: \"fcf01e9c-57fb-42db-848d-d314c615bd67\") " pod="e2e-models-e2e-worker-w5-b78c31/distinct-w5-b78c31-kserve-77ccb69d98-p2zct"
Oct 31 17:39:55.255936 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:55.255868    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fcf01e9c-57fb-42db-848d-d314c615bd67-tmp-dir\") pod \"distinct-w5-b78c31-kserve-77ccb69d98-p2zct\" (UID: \"fcf01e9c-57fb-42db-848d-d314c615bd67\") " pod="e2e-models-e2e-worker-w5-b78c31/distinct-w5-b78c31-kserve-77ccb69d98-p2zct"
Oct 31 17:39:55.256129 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:55.256090    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fcf01e9c-57fb-42db-848d-d314c615bd67-dshm\") pod \"distinct-w5-b78c31-kserve-77ccb69d98-p2zct\" (UID: \"fcf01e9c-57fb-42db-848d-d314c615bd67\") " pod="e2e-models-e2e-worker-w5-b78c31/distinct-w5-b78c31-kserve-77ccb69d98-p2zct"
Oct 31 17:39:55.256272 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:55.256249    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fcf01e9c-57fb-42db-848d-d314c615bd67-model-cache\") pod \"distinct-w5-b78c31-kserve-77ccb69d98-p2zct\" (UID: \"fcf01e9c-57fb-42db-848d-d314c615bd67\") " pod="e2e-models-e2e-worker-w5-b78c31/distinct-w5-b78c31-kserve-77ccb69d98-p2zct"
Oct 31 17:39:55.256342 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:55.256290    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fcf01e9c-57fb-42db-848d-d314c615bd67-tls-certs\") pod \"distinct-w5-b78c31-kserve-77ccb69d98-p2zct\" (UID: \"fcf01e9c-57fb-42db-848d-d314c615bd67\") " pod="e2e-models-e2e-worker-w5-b78c31/distinct-w5-b78c31-kserve-77ccb69d98-p2zct"
Oct 31 17:39:55.353178 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:55.353013    5003 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-64dkg"
Oct 31 17:39:55.353557 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:55.353537    5003 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-64dkg"
Oct 31 17:39:55.354482 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:55.354459    5003 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-64dkg"
Oct 31 17:39:55.357273 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:55.357243    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fcf01e9c-57fb-42db-848d-d314c615bd67-dshm\") pod \"distinct-w5-b78c31-kserve-77ccb69d98-p2zct\" (UID: \"fcf01e9c-57fb-42db-848d-d314c615bd67\") " pod="e2e-models-e2e-worker-w5-b78c31/distinct-w5-b78c31-kserve-77ccb69d98-p2zct"
Oct 31 17:39:55.357413 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:55.357356    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fcf01e9c-57fb-42db-848d-d314c615bd67-model-cache\") pod \"distinct-w5-b78c31-kserve-77ccb69d98-p2zct\" (UID: \"fcf01e9c-57fb-42db-848d-d314c615bd67\") " pod="e2e-models-e2e-worker-w5-b78c31/distinct-w5-b78c31-kserve-77ccb69d98-p2zct"
Oct 31 17:39:55.357413 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:55.357388    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fcf01e9c-57fb-42db-848d-d314c615bd67-tls-certs\") pod \"distinct-w5-b78c31-kserve-77ccb69d98-p2zct\" (UID: \"fcf01e9c-57fb-42db-848d-d314c615bd67\") " pod="e2e-models-e2e-worker-w5-b78c31/distinct-w5-b78c31-kserve-77ccb69d98-p2zct"
Oct 31 17:39:55.357486 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:55.357437    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fcf01e9c-57fb-42db-848d-d314c615bd67-home\") pod \"distinct-w5-b78c31-kserve-77ccb69d98-p2zct\" (UID: \"fcf01e9c-57fb-42db-848d-d314c615bd67\") " pod="e2e-models-e2e-worker-w5-b78c31/distinct-w5-b78c31-kserve-77ccb69d98-p2zct"
Oct 31 17:39:55.357536 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:55.357486    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4p9pl\" (UniqueName: \"kubernetes.io/projected/fcf01e9c-57fb-42db-848d-d314c615bd67-kube-api-access-4p9pl\") pod \"distinct-w5-b78c31-kserve-77ccb69d98-p2zct\" (UID: \"fcf01e9c-57fb-42db-848d-d314c615bd67\") " pod="e2e-models-e2e-worker-w5-b78c31/distinct-w5-b78c31-kserve-77ccb69d98-p2zct"
Oct 31 17:39:55.357589 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:55.357536    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fcf01e9c-57fb-42db-848d-d314c615bd67-tmp-dir\") pod \"distinct-w5-b78c31-kserve-77ccb69d98-p2zct\" (UID: \"fcf01e9c-57fb-42db-848d-d314c615bd67\") " pod="e2e-models-e2e-worker-w5-b78c31/distinct-w5-b78c31-kserve-77ccb69d98-p2zct"
Oct 31 17:39:55.357745 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:55.357724    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fcf01e9c-57fb-42db-848d-d314c615bd67-model-cache\") pod \"distinct-w5-b78c31-kserve-77ccb69d98-p2zct\" (UID: \"fcf01e9c-57fb-42db-848d-d314c615bd67\") " pod="e2e-models-e2e-worker-w5-b78c31/distinct-w5-b78c31-kserve-77ccb69d98-p2zct"
Oct 31 17:39:55.357910 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:55.357857    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fcf01e9c-57fb-42db-848d-d314c615bd67-home\") pod \"distinct-w5-b78c31-kserve-77ccb69d98-p2zct\" (UID: \"fcf01e9c-57fb-42db-848d-d314c615bd67\") " pod="e2e-models-e2e-worker-w5-b78c31/distinct-w5-b78c31-kserve-77ccb69d98-p2zct"
Oct 31 17:39:55.358033 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:55.358013    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fcf01e9c-57fb-42db-848d-d314c615bd67-tmp-dir\") pod \"distinct-w5-b78c31-kserve-77ccb69d98-p2zct\" (UID: \"fcf01e9c-57fb-42db-848d-d314c615bd67\") " pod="e2e-models-e2e-worker-w5-b78c31/distinct-w5-b78c31-kserve-77ccb69d98-p2zct"
Oct 31 17:39:55.359681 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:55.359580    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fcf01e9c-57fb-42db-848d-d314c615bd67-dshm\") pod \"distinct-w5-b78c31-kserve-77ccb69d98-p2zct\" (UID: \"fcf01e9c-57fb-42db-848d-d314c615bd67\") " pod="e2e-models-e2e-worker-w5-b78c31/distinct-w5-b78c31-kserve-77ccb69d98-p2zct"
Oct 31 17:39:55.360030 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:55.360012    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fcf01e9c-57fb-42db-848d-d314c615bd67-tls-certs\") pod \"distinct-w5-b78c31-kserve-77ccb69d98-p2zct\" (UID: \"fcf01e9c-57fb-42db-848d-d314c615bd67\") " pod="e2e-models-e2e-worker-w5-b78c31/distinct-w5-b78c31-kserve-77ccb69d98-p2zct"
Oct 31 17:39:55.379395 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:55.379353    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4p9pl\" (UniqueName: \"kubernetes.io/projected/fcf01e9c-57fb-42db-848d-d314c615bd67-kube-api-access-4p9pl\") pod \"distinct-w5-b78c31-kserve-77ccb69d98-p2zct\" (UID: \"fcf01e9c-57fb-42db-848d-d314c615bd67\") " pod="e2e-models-e2e-worker-w5-b78c31/distinct-w5-b78c31-kserve-77ccb69d98-p2zct"
Oct 31 17:39:55.435750 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:55.435706    5003 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w5-b78c31/distinct-w5-b78c31-kserve-77ccb69d98-p2zct"
Oct 31 17:39:55.770549 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:55.770516    5003 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w5-b78c31/distinct-w5-b78c31-kserve-77ccb69d98-p2zct"]
Oct 31 17:39:56.355855 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:56.355811    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w5-b78c31/distinct-w5-b78c31-kserve-77ccb69d98-p2zct" event={"ID":"fcf01e9c-57fb-42db-848d-d314c615bd67","Type":"ContainerStarted","Data":"8ec4032c3e41e43dd8aab3fb1c9200d548ed26e84398fd0b61c2784d7e286aac"}
Oct 31 17:39:56.356276 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:56.355866    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w5-b78c31/distinct-w5-b78c31-kserve-77ccb69d98-p2zct" event={"ID":"fcf01e9c-57fb-42db-848d-d314c615bd67","Type":"ContainerStarted","Data":"05a191c43af6dd6029573980603d59e61de2fa21455d9264e966f7993a788ed3"}
Oct 31 17:39:56.395811 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:56.395747    5003 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w5-b78c31/distinct-w5-b78c31-kserve-77ccb69d98-p2zct" podStartSLOduration=1.395726335 podStartE2EDuration="1.395726335s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 17:39:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 17:39:56.393628222 +0000 UTC m=+764.648482765" watchObservedRunningTime="2026-10-31 17:39:56.395726335 +0000 UTC m=+764.650580878"
Oct 31 17:39:56.435909 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:39:56.435873    5003 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w5-b78c31/distinct-w5-b78c31-kserve-77ccb69d98-p2zct"
Oct 31 17:40:05.436413 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:05.436368    5003 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w5-b78c31/distinct-w5-b78c31-kserve-77ccb69d98-p2zct"
Oct 31 17:40:05.514697 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:05.510586    5003 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w5-b78c31/distinct-w5-b78c31-kserve-77ccb69d98-p2zct"
Oct 31 17:40:05.550173 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:05.550143    5003 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w5-b78c31/distinct-w5-b78c31-kserve-77ccb69d98-p2zct"
Oct 31 17:40:07.726072 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:07.726036    5003 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w4-1c0bfd/distinct-w4-1c0bfd-kserve-867858548f-46gwg"]
Oct 31 17:40:07.732056 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:07.732007    5003 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-1c0bfd/distinct-w4-1c0bfd-kserve-867858548f-46gwg"
Oct 31 17:40:07.752590 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:07.752551    5003 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-1c0bfd/distinct-w4-1c0bfd-kserve-867858548f-46gwg"]
Oct 31 17:40:07.756909 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:07.756883    5003 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w4-1c0bfd\"/\"distinct-w4-1c0bfd-kserve-self-signed-certs\""
Oct 31 17:40:07.758397 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:07.758374    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/93f16294-fc40-477d-90b3-d02640037d5b-home\") pod \"distinct-w4-1c0bfd-kserve-867858548f-46gwg\" (UID: \"93f16294-fc40-477d-90b3-d02640037d5b\") " pod="e2e-models-e2e-worker-w4-1c0bfd/distinct-w4-1c0bfd-kserve-867858548f-46gwg"
Oct 31 17:40:07.758498 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:07.758475    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/93f16294-fc40-477d-90b3-d02640037d5b-model-cache\") pod \"distinct-w4-1c0bfd-kserve-867858548f-46gwg\" (UID: \"93f16294-fc40-477d-90b3-d02640037d5b\") " pod="e2e-models-e2e-worker-w4-1c0bfd/distinct-w4-1c0bfd-kserve-867858548f-46gwg"
Oct 31 17:40:07.758555 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:07.758534    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k652l\" (UniqueName: \"kubernetes.io/projected/93f16294-fc40-477d-90b3-d02640037d5b-kube-api-access-k652l\") pod \"distinct-w4-1c0bfd-kserve-867858548f-46gwg\" (UID: \"93f16294-fc40-477d-90b3-d02640037d5b\") " pod="e2e-models-e2e-worker-w4-1c0bfd/distinct-w4-1c0bfd-kserve-867858548f-46gwg"
Oct 31 17:40:07.758729 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:07.758708    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/93f16294-fc40-477d-90b3-d02640037d5b-dshm\") pod \"distinct-w4-1c0bfd-kserve-867858548f-46gwg\" (UID: \"93f16294-fc40-477d-90b3-d02640037d5b\") " pod="e2e-models-e2e-worker-w4-1c0bfd/distinct-w4-1c0bfd-kserve-867858548f-46gwg"
Oct 31 17:40:07.758808 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:07.758769    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/93f16294-fc40-477d-90b3-d02640037d5b-tls-certs\") pod \"distinct-w4-1c0bfd-kserve-867858548f-46gwg\" (UID: \"93f16294-fc40-477d-90b3-d02640037d5b\") " pod="e2e-models-e2e-worker-w4-1c0bfd/distinct-w4-1c0bfd-kserve-867858548f-46gwg"
Oct 31 17:40:07.758928 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:07.758889    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/93f16294-fc40-477d-90b3-d02640037d5b-tmp-dir\") pod \"distinct-w4-1c0bfd-kserve-867858548f-46gwg\" (UID: \"93f16294-fc40-477d-90b3-d02640037d5b\") " pod="e2e-models-e2e-worker-w4-1c0bfd/distinct-w4-1c0bfd-kserve-867858548f-46gwg"
Oct 31 17:40:07.860602 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:07.860559    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/93f16294-fc40-477d-90b3-d02640037d5b-dshm\") pod \"distinct-w4-1c0bfd-kserve-867858548f-46gwg\" (UID: \"93f16294-fc40-477d-90b3-d02640037d5b\") " pod="e2e-models-e2e-worker-w4-1c0bfd/distinct-w4-1c0bfd-kserve-867858548f-46gwg"
Oct 31 17:40:07.860827 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:07.860614    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/93f16294-fc40-477d-90b3-d02640037d5b-tls-certs\") pod \"distinct-w4-1c0bfd-kserve-867858548f-46gwg\" (UID: \"93f16294-fc40-477d-90b3-d02640037d5b\") " pod="e2e-models-e2e-worker-w4-1c0bfd/distinct-w4-1c0bfd-kserve-867858548f-46gwg"
Oct 31 17:40:07.860827 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:07.860730    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/93f16294-fc40-477d-90b3-d02640037d5b-tmp-dir\") pod \"distinct-w4-1c0bfd-kserve-867858548f-46gwg\" (UID: \"93f16294-fc40-477d-90b3-d02640037d5b\") " pod="e2e-models-e2e-worker-w4-1c0bfd/distinct-w4-1c0bfd-kserve-867858548f-46gwg"
Oct 31 17:40:07.860827 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:07.860780    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/93f16294-fc40-477d-90b3-d02640037d5b-home\") pod \"distinct-w4-1c0bfd-kserve-867858548f-46gwg\" (UID: \"93f16294-fc40-477d-90b3-d02640037d5b\") " pod="e2e-models-e2e-worker-w4-1c0bfd/distinct-w4-1c0bfd-kserve-867858548f-46gwg"
Oct 31 17:40:07.860827 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:07.860801    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/93f16294-fc40-477d-90b3-d02640037d5b-model-cache\") pod \"distinct-w4-1c0bfd-kserve-867858548f-46gwg\" (UID: \"93f16294-fc40-477d-90b3-d02640037d5b\") " pod="e2e-models-e2e-worker-w4-1c0bfd/distinct-w4-1c0bfd-kserve-867858548f-46gwg"
Oct 31 17:40:07.860827 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:07.860819    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k652l\" (UniqueName: \"kubernetes.io/projected/93f16294-fc40-477d-90b3-d02640037d5b-kube-api-access-k652l\") pod \"distinct-w4-1c0bfd-kserve-867858548f-46gwg\" (UID: \"93f16294-fc40-477d-90b3-d02640037d5b\") " pod="e2e-models-e2e-worker-w4-1c0bfd/distinct-w4-1c0bfd-kserve-867858548f-46gwg"
Oct 31 17:40:07.861185 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:07.861152    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/93f16294-fc40-477d-90b3-d02640037d5b-tmp-dir\") pod \"distinct-w4-1c0bfd-kserve-867858548f-46gwg\" (UID: \"93f16294-fc40-477d-90b3-d02640037d5b\") " pod="e2e-models-e2e-worker-w4-1c0bfd/distinct-w4-1c0bfd-kserve-867858548f-46gwg"
Oct 31 17:40:07.861303 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:07.861225    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/93f16294-fc40-477d-90b3-d02640037d5b-model-cache\") pod \"distinct-w4-1c0bfd-kserve-867858548f-46gwg\" (UID: \"93f16294-fc40-477d-90b3-d02640037d5b\") " pod="e2e-models-e2e-worker-w4-1c0bfd/distinct-w4-1c0bfd-kserve-867858548f-46gwg"
Oct 31 17:40:07.861303 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:07.861236    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/93f16294-fc40-477d-90b3-d02640037d5b-home\") pod \"distinct-w4-1c0bfd-kserve-867858548f-46gwg\" (UID: \"93f16294-fc40-477d-90b3-d02640037d5b\") " pod="e2e-models-e2e-worker-w4-1c0bfd/distinct-w4-1c0bfd-kserve-867858548f-46gwg"
Oct 31 17:40:07.863155 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:07.863134    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/93f16294-fc40-477d-90b3-d02640037d5b-dshm\") pod \"distinct-w4-1c0bfd-kserve-867858548f-46gwg\" (UID: \"93f16294-fc40-477d-90b3-d02640037d5b\") " pod="e2e-models-e2e-worker-w4-1c0bfd/distinct-w4-1c0bfd-kserve-867858548f-46gwg"
Oct 31 17:40:07.863495 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:07.863473    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/93f16294-fc40-477d-90b3-d02640037d5b-tls-certs\") pod \"distinct-w4-1c0bfd-kserve-867858548f-46gwg\" (UID: \"93f16294-fc40-477d-90b3-d02640037d5b\") " pod="e2e-models-e2e-worker-w4-1c0bfd/distinct-w4-1c0bfd-kserve-867858548f-46gwg"
Oct 31 17:40:07.879358 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:07.879324    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k652l\" (UniqueName: \"kubernetes.io/projected/93f16294-fc40-477d-90b3-d02640037d5b-kube-api-access-k652l\") pod \"distinct-w4-1c0bfd-kserve-867858548f-46gwg\" (UID: \"93f16294-fc40-477d-90b3-d02640037d5b\") " pod="e2e-models-e2e-worker-w4-1c0bfd/distinct-w4-1c0bfd-kserve-867858548f-46gwg"
Oct 31 17:40:08.053569 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:08.053478    5003 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-1c0bfd/distinct-w4-1c0bfd-kserve-867858548f-46gwg"
Oct 31 17:40:08.358400 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:08.358377    5003 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-1c0bfd/distinct-w4-1c0bfd-kserve-867858548f-46gwg"]
Oct 31 17:40:08.360832 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:40:08.360801    5003 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod93f16294_fc40_477d_90b3_d02640037d5b.slice/crio-463c8db5622eeeafa8d291da7a8aa755ab807762d9f0820185e85d39195a8a35 WatchSource:0}: Error finding container 463c8db5622eeeafa8d291da7a8aa755ab807762d9f0820185e85d39195a8a35: Status 404 returned error can't find the container with id 463c8db5622eeeafa8d291da7a8aa755ab807762d9f0820185e85d39195a8a35
Oct 31 17:40:08.491338 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:08.491300    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-1c0bfd/distinct-w4-1c0bfd-kserve-867858548f-46gwg" event={"ID":"93f16294-fc40-477d-90b3-d02640037d5b","Type":"ContainerStarted","Data":"3c88eb21e2c9f22f24802e047713e8ac735028ced9afeb22f315dc365eacd1dc"}
Oct 31 17:40:08.491521 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:08.491351    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-1c0bfd/distinct-w4-1c0bfd-kserve-867858548f-46gwg" event={"ID":"93f16294-fc40-477d-90b3-d02640037d5b","Type":"ContainerStarted","Data":"463c8db5622eeeafa8d291da7a8aa755ab807762d9f0820185e85d39195a8a35"}
Oct 31 17:40:08.531700 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:08.531616    5003 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w4-1c0bfd/distinct-w4-1c0bfd-kserve-867858548f-46gwg" podStartSLOduration=1.531602186 podStartE2EDuration="1.531602186s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 17:40:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 17:40:08.528599314 +0000 UTC m=+776.783453857" watchObservedRunningTime="2026-10-31 17:40:08.531602186 +0000 UTC m=+776.786456727"
Oct 31 17:40:09.054109 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:09.054066    5003 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w4-1c0bfd/distinct-w4-1c0bfd-kserve-867858548f-46gwg"
Oct 31 17:40:10.331536 ip-10-0-138-17 kubenswrapper[5003]: E1031 17:40:10.331500    5003 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-tdzz5" containerName="extractor"
Oct 31 17:40:16.265428 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:16.265392    5003 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w3-cf0a86-openshift-default-595bfdc58c-jwvk2"]
Oct 31 17:40:16.270115 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:16.270091    5003 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-cf0a86-openshift-default-595bfdc58c-jwvk2"
Oct 31 17:40:16.297355 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:16.297328    5003 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w3-cf0a86-openshift-default-595bfdc58c-jwvk2"]
Oct 31 17:40:16.358372 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:16.358333    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3dac59b3-ae83-496f-87cb-16c7fd249497-istio-podinfo\") pod \"e2e-worker-w3-cf0a86-openshift-default-595bfdc58c-jwvk2\" (UID: \"3dac59b3-ae83-496f-87cb-16c7fd249497\") " pod="openshift-ingress/e2e-worker-w3-cf0a86-openshift-default-595bfdc58c-jwvk2"
Oct 31 17:40:16.358559 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:16.358394    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3dac59b3-ae83-496f-87cb-16c7fd249497-istiod-ca-cert\") pod \"e2e-worker-w3-cf0a86-openshift-default-595bfdc58c-jwvk2\" (UID: \"3dac59b3-ae83-496f-87cb-16c7fd249497\") " pod="openshift-ingress/e2e-worker-w3-cf0a86-openshift-default-595bfdc58c-jwvk2"
Oct 31 17:40:16.358559 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:16.358535    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3dac59b3-ae83-496f-87cb-16c7fd249497-istio-data\") pod \"e2e-worker-w3-cf0a86-openshift-default-595bfdc58c-jwvk2\" (UID: \"3dac59b3-ae83-496f-87cb-16c7fd249497\") " pod="openshift-ingress/e2e-worker-w3-cf0a86-openshift-default-595bfdc58c-jwvk2"
Oct 31 17:40:16.358675 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:16.358603    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3dac59b3-ae83-496f-87cb-16c7fd249497-credential-socket\") pod \"e2e-worker-w3-cf0a86-openshift-default-595bfdc58c-jwvk2\" (UID: \"3dac59b3-ae83-496f-87cb-16c7fd249497\") " pod="openshift-ingress/e2e-worker-w3-cf0a86-openshift-default-595bfdc58c-jwvk2"
Oct 31 17:40:16.358727 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:16.358690    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3dac59b3-ae83-496f-87cb-16c7fd249497-istio-token\") pod \"e2e-worker-w3-cf0a86-openshift-default-595bfdc58c-jwvk2\" (UID: \"3dac59b3-ae83-496f-87cb-16c7fd249497\") " pod="openshift-ingress/e2e-worker-w3-cf0a86-openshift-default-595bfdc58c-jwvk2"
Oct 31 17:40:16.358808 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:16.358784    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5lht5\" (UniqueName: \"kubernetes.io/projected/3dac59b3-ae83-496f-87cb-16c7fd249497-kube-api-access-5lht5\") pod \"e2e-worker-w3-cf0a86-openshift-default-595bfdc58c-jwvk2\" (UID: \"3dac59b3-ae83-496f-87cb-16c7fd249497\") " pod="openshift-ingress/e2e-worker-w3-cf0a86-openshift-default-595bfdc58c-jwvk2"
Oct 31 17:40:16.358854 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:16.358825    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3dac59b3-ae83-496f-87cb-16c7fd249497-workload-socket\") pod \"e2e-worker-w3-cf0a86-openshift-default-595bfdc58c-jwvk2\" (UID: \"3dac59b3-ae83-496f-87cb-16c7fd249497\") " pod="openshift-ingress/e2e-worker-w3-cf0a86-openshift-default-595bfdc58c-jwvk2"
Oct 31 17:40:16.358854 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:16.358844    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3dac59b3-ae83-496f-87cb-16c7fd249497-istio-envoy\") pod \"e2e-worker-w3-cf0a86-openshift-default-595bfdc58c-jwvk2\" (UID: \"3dac59b3-ae83-496f-87cb-16c7fd249497\") " pod="openshift-ingress/e2e-worker-w3-cf0a86-openshift-default-595bfdc58c-jwvk2"
Oct 31 17:40:16.358921 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:16.358864    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3dac59b3-ae83-496f-87cb-16c7fd249497-workload-certs\") pod \"e2e-worker-w3-cf0a86-openshift-default-595bfdc58c-jwvk2\" (UID: \"3dac59b3-ae83-496f-87cb-16c7fd249497\") " pod="openshift-ingress/e2e-worker-w3-cf0a86-openshift-default-595bfdc58c-jwvk2"
Oct 31 17:40:16.460557 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:16.460515    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3dac59b3-ae83-496f-87cb-16c7fd249497-istio-token\") pod \"e2e-worker-w3-cf0a86-openshift-default-595bfdc58c-jwvk2\" (UID: \"3dac59b3-ae83-496f-87cb-16c7fd249497\") " pod="openshift-ingress/e2e-worker-w3-cf0a86-openshift-default-595bfdc58c-jwvk2"
Oct 31 17:40:16.460904 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:16.460627    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5lht5\" (UniqueName: \"kubernetes.io/projected/3dac59b3-ae83-496f-87cb-16c7fd249497-kube-api-access-5lht5\") pod \"e2e-worker-w3-cf0a86-openshift-default-595bfdc58c-jwvk2\" (UID: \"3dac59b3-ae83-496f-87cb-16c7fd249497\") " pod="openshift-ingress/e2e-worker-w3-cf0a86-openshift-default-595bfdc58c-jwvk2"
Oct 31 17:40:16.460904 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:16.460703    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3dac59b3-ae83-496f-87cb-16c7fd249497-workload-socket\") pod \"e2e-worker-w3-cf0a86-openshift-default-595bfdc58c-jwvk2\" (UID: \"3dac59b3-ae83-496f-87cb-16c7fd249497\") " pod="openshift-ingress/e2e-worker-w3-cf0a86-openshift-default-595bfdc58c-jwvk2"
Oct 31 17:40:16.460904 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:16.460730    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3dac59b3-ae83-496f-87cb-16c7fd249497-istio-envoy\") pod \"e2e-worker-w3-cf0a86-openshift-default-595bfdc58c-jwvk2\" (UID: \"3dac59b3-ae83-496f-87cb-16c7fd249497\") " pod="openshift-ingress/e2e-worker-w3-cf0a86-openshift-default-595bfdc58c-jwvk2"
Oct 31 17:40:16.460904 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:16.460760    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3dac59b3-ae83-496f-87cb-16c7fd249497-workload-certs\") pod \"e2e-worker-w3-cf0a86-openshift-default-595bfdc58c-jwvk2\" (UID: \"3dac59b3-ae83-496f-87cb-16c7fd249497\") " pod="openshift-ingress/e2e-worker-w3-cf0a86-openshift-default-595bfdc58c-jwvk2"
Oct 31 17:40:16.460904 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:16.460813    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3dac59b3-ae83-496f-87cb-16c7fd249497-istio-podinfo\") pod \"e2e-worker-w3-cf0a86-openshift-default-595bfdc58c-jwvk2\" (UID: \"3dac59b3-ae83-496f-87cb-16c7fd249497\") " pod="openshift-ingress/e2e-worker-w3-cf0a86-openshift-default-595bfdc58c-jwvk2"
Oct 31 17:40:16.460904 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:16.460868    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3dac59b3-ae83-496f-87cb-16c7fd249497-istiod-ca-cert\") pod \"e2e-worker-w3-cf0a86-openshift-default-595bfdc58c-jwvk2\" (UID: \"3dac59b3-ae83-496f-87cb-16c7fd249497\") " pod="openshift-ingress/e2e-worker-w3-cf0a86-openshift-default-595bfdc58c-jwvk2"
Oct 31 17:40:16.461423 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:16.460975    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3dac59b3-ae83-496f-87cb-16c7fd249497-istio-data\") pod \"e2e-worker-w3-cf0a86-openshift-default-595bfdc58c-jwvk2\" (UID: \"3dac59b3-ae83-496f-87cb-16c7fd249497\") " pod="openshift-ingress/e2e-worker-w3-cf0a86-openshift-default-595bfdc58c-jwvk2"
Oct 31 17:40:16.461423 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:16.461061    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3dac59b3-ae83-496f-87cb-16c7fd249497-credential-socket\") pod \"e2e-worker-w3-cf0a86-openshift-default-595bfdc58c-jwvk2\" (UID: \"3dac59b3-ae83-496f-87cb-16c7fd249497\") " pod="openshift-ingress/e2e-worker-w3-cf0a86-openshift-default-595bfdc58c-jwvk2"
Oct 31 17:40:16.461423 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:16.461175    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3dac59b3-ae83-496f-87cb-16c7fd249497-workload-socket\") pod \"e2e-worker-w3-cf0a86-openshift-default-595bfdc58c-jwvk2\" (UID: \"3dac59b3-ae83-496f-87cb-16c7fd249497\") " pod="openshift-ingress/e2e-worker-w3-cf0a86-openshift-default-595bfdc58c-jwvk2"
Oct 31 17:40:16.461591 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:16.461533    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3dac59b3-ae83-496f-87cb-16c7fd249497-credential-socket\") pod \"e2e-worker-w3-cf0a86-openshift-default-595bfdc58c-jwvk2\" (UID: \"3dac59b3-ae83-496f-87cb-16c7fd249497\") " pod="openshift-ingress/e2e-worker-w3-cf0a86-openshift-default-595bfdc58c-jwvk2"
Oct 31 17:40:16.462130 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:16.462105    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3dac59b3-ae83-496f-87cb-16c7fd249497-istiod-ca-cert\") pod \"e2e-worker-w3-cf0a86-openshift-default-595bfdc58c-jwvk2\" (UID: \"3dac59b3-ae83-496f-87cb-16c7fd249497\") " pod="openshift-ingress/e2e-worker-w3-cf0a86-openshift-default-595bfdc58c-jwvk2"
Oct 31 17:40:16.462358 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:16.462337    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3dac59b3-ae83-496f-87cb-16c7fd249497-istio-data\") pod \"e2e-worker-w3-cf0a86-openshift-default-595bfdc58c-jwvk2\" (UID: \"3dac59b3-ae83-496f-87cb-16c7fd249497\") " pod="openshift-ingress/e2e-worker-w3-cf0a86-openshift-default-595bfdc58c-jwvk2"
Oct 31 17:40:16.462678 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:16.462581    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3dac59b3-ae83-496f-87cb-16c7fd249497-workload-certs\") pod \"e2e-worker-w3-cf0a86-openshift-default-595bfdc58c-jwvk2\" (UID: \"3dac59b3-ae83-496f-87cb-16c7fd249497\") " pod="openshift-ingress/e2e-worker-w3-cf0a86-openshift-default-595bfdc58c-jwvk2"
Oct 31 17:40:16.463937 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:16.463917    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3dac59b3-ae83-496f-87cb-16c7fd249497-istio-envoy\") pod \"e2e-worker-w3-cf0a86-openshift-default-595bfdc58c-jwvk2\" (UID: \"3dac59b3-ae83-496f-87cb-16c7fd249497\") " pod="openshift-ingress/e2e-worker-w3-cf0a86-openshift-default-595bfdc58c-jwvk2"
Oct 31 17:40:16.464298 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:16.464282    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3dac59b3-ae83-496f-87cb-16c7fd249497-istio-podinfo\") pod \"e2e-worker-w3-cf0a86-openshift-default-595bfdc58c-jwvk2\" (UID: \"3dac59b3-ae83-496f-87cb-16c7fd249497\") " pod="openshift-ingress/e2e-worker-w3-cf0a86-openshift-default-595bfdc58c-jwvk2"
Oct 31 17:40:16.478917 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:16.478885    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3dac59b3-ae83-496f-87cb-16c7fd249497-istio-token\") pod \"e2e-worker-w3-cf0a86-openshift-default-595bfdc58c-jwvk2\" (UID: \"3dac59b3-ae83-496f-87cb-16c7fd249497\") " pod="openshift-ingress/e2e-worker-w3-cf0a86-openshift-default-595bfdc58c-jwvk2"
Oct 31 17:40:16.479474 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:16.479451    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5lht5\" (UniqueName: \"kubernetes.io/projected/3dac59b3-ae83-496f-87cb-16c7fd249497-kube-api-access-5lht5\") pod \"e2e-worker-w3-cf0a86-openshift-default-595bfdc58c-jwvk2\" (UID: \"3dac59b3-ae83-496f-87cb-16c7fd249497\") " pod="openshift-ingress/e2e-worker-w3-cf0a86-openshift-default-595bfdc58c-jwvk2"
Oct 31 17:40:16.584075 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:16.584035    5003 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-cf0a86-openshift-default-595bfdc58c-jwvk2"
Oct 31 17:40:16.865190 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:16.865085    5003 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w2-5c446c-openshift-default-797c6dc855-w477z"]
Oct 31 17:40:16.870989 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:16.870964    5003 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-5c446c-openshift-default-797c6dc855-w477z"
Oct 31 17:40:16.893860 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:16.893825    5003 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w2-5c446c-openshift-default-797c6dc855-w477z"]
Oct 31 17:40:16.917710 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:16.917675    5003 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w3-cf0a86-openshift-default-595bfdc58c-jwvk2"]
Oct 31 17:40:16.918922 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:40:16.918892    5003 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3dac59b3_ae83_496f_87cb_16c7fd249497.slice/crio-6a3553278b5b512e49ae592c9f04990dc4ab6baccf84265b65e9d16b0b278bf4 WatchSource:0}: Error finding container 6a3553278b5b512e49ae592c9f04990dc4ab6baccf84265b65e9d16b0b278bf4: Status 404 returned error can't find the container with id 6a3553278b5b512e49ae592c9f04990dc4ab6baccf84265b65e9d16b0b278bf4
Oct 31 17:40:16.922526 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:16.922482    5003 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Oct 31 17:40:16.922639 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:16.922577    5003 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Oct 31 17:40:16.922639 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:16.922620    5003 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Oct 31 17:40:16.968401 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:16.968370    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a92e2f56-5eb4-4b64-9947-25e1f0d51c30-istio-token\") pod \"e2e-worker-w2-5c446c-openshift-default-797c6dc855-w477z\" (UID: \"a92e2f56-5eb4-4b64-9947-25e1f0d51c30\") " pod="openshift-ingress/e2e-worker-w2-5c446c-openshift-default-797c6dc855-w477z"
Oct 31 17:40:16.968544 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:16.968476    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a92e2f56-5eb4-4b64-9947-25e1f0d51c30-istio-data\") pod \"e2e-worker-w2-5c446c-openshift-default-797c6dc855-w477z\" (UID: \"a92e2f56-5eb4-4b64-9947-25e1f0d51c30\") " pod="openshift-ingress/e2e-worker-w2-5c446c-openshift-default-797c6dc855-w477z"
Oct 31 17:40:16.968544 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:16.968524    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a92e2f56-5eb4-4b64-9947-25e1f0d51c30-credential-socket\") pod \"e2e-worker-w2-5c446c-openshift-default-797c6dc855-w477z\" (UID: \"a92e2f56-5eb4-4b64-9947-25e1f0d51c30\") " pod="openshift-ingress/e2e-worker-w2-5c446c-openshift-default-797c6dc855-w477z"
Oct 31 17:40:16.968668 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:16.968564    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a92e2f56-5eb4-4b64-9947-25e1f0d51c30-istio-podinfo\") pod \"e2e-worker-w2-5c446c-openshift-default-797c6dc855-w477z\" (UID: \"a92e2f56-5eb4-4b64-9947-25e1f0d51c30\") " pod="openshift-ingress/e2e-worker-w2-5c446c-openshift-default-797c6dc855-w477z"
Oct 31 17:40:16.968759 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:16.968742    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a92e2f56-5eb4-4b64-9947-25e1f0d51c30-workload-certs\") pod \"e2e-worker-w2-5c446c-openshift-default-797c6dc855-w477z\" (UID: \"a92e2f56-5eb4-4b64-9947-25e1f0d51c30\") " pod="openshift-ingress/e2e-worker-w2-5c446c-openshift-default-797c6dc855-w477z"
Oct 31 17:40:16.968799 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:16.968769    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dvwrv\" (UniqueName: \"kubernetes.io/projected/a92e2f56-5eb4-4b64-9947-25e1f0d51c30-kube-api-access-dvwrv\") pod \"e2e-worker-w2-5c446c-openshift-default-797c6dc855-w477z\" (UID: \"a92e2f56-5eb4-4b64-9947-25e1f0d51c30\") " pod="openshift-ingress/e2e-worker-w2-5c446c-openshift-default-797c6dc855-w477z"
Oct 31 17:40:16.968832 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:16.968797    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a92e2f56-5eb4-4b64-9947-25e1f0d51c30-workload-socket\") pod \"e2e-worker-w2-5c446c-openshift-default-797c6dc855-w477z\" (UID: \"a92e2f56-5eb4-4b64-9947-25e1f0d51c30\") " pod="openshift-ingress/e2e-worker-w2-5c446c-openshift-default-797c6dc855-w477z"
Oct 31 17:40:16.968872 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:16.968828    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a92e2f56-5eb4-4b64-9947-25e1f0d51c30-istiod-ca-cert\") pod \"e2e-worker-w2-5c446c-openshift-default-797c6dc855-w477z\" (UID: \"a92e2f56-5eb4-4b64-9947-25e1f0d51c30\") " pod="openshift-ingress/e2e-worker-w2-5c446c-openshift-default-797c6dc855-w477z"
Oct 31 17:40:16.968916 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:16.968891    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a92e2f56-5eb4-4b64-9947-25e1f0d51c30-istio-envoy\") pod \"e2e-worker-w2-5c446c-openshift-default-797c6dc855-w477z\" (UID: \"a92e2f56-5eb4-4b64-9947-25e1f0d51c30\") " pod="openshift-ingress/e2e-worker-w2-5c446c-openshift-default-797c6dc855-w477z"
Oct 31 17:40:16.969765 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:16.969744    5003 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w0-ee816e-openshift-default-c4db85b5c-qm655"]
Oct 31 17:40:16.975703 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:16.975682    5003 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-ee816e-openshift-default-c4db85b5c-qm655"
Oct 31 17:40:16.999398 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:16.999371    5003 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-ee816e-openshift-default-c4db85b5c-qm655"]
Oct 31 17:40:17.070712 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:17.070628    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a92e2f56-5eb4-4b64-9947-25e1f0d51c30-workload-certs\") pod \"e2e-worker-w2-5c446c-openshift-default-797c6dc855-w477z\" (UID: \"a92e2f56-5eb4-4b64-9947-25e1f0d51c30\") " pod="openshift-ingress/e2e-worker-w2-5c446c-openshift-default-797c6dc855-w477z"
Oct 31 17:40:17.070712 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:17.070694    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dvwrv\" (UniqueName: \"kubernetes.io/projected/a92e2f56-5eb4-4b64-9947-25e1f0d51c30-kube-api-access-dvwrv\") pod \"e2e-worker-w2-5c446c-openshift-default-797c6dc855-w477z\" (UID: \"a92e2f56-5eb4-4b64-9947-25e1f0d51c30\") " pod="openshift-ingress/e2e-worker-w2-5c446c-openshift-default-797c6dc855-w477z"
Oct 31 17:40:17.070957 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:17.070732    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d2652cf4-9d2a-480e-ad8a-946d0d4b90f3-istio-envoy\") pod \"e2e-worker-w0-ee816e-openshift-default-c4db85b5c-qm655\" (UID: \"d2652cf4-9d2a-480e-ad8a-946d0d4b90f3\") " pod="openshift-ingress/e2e-worker-w0-ee816e-openshift-default-c4db85b5c-qm655"
Oct 31 17:40:17.070957 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:17.070767    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a92e2f56-5eb4-4b64-9947-25e1f0d51c30-workload-socket\") pod \"e2e-worker-w2-5c446c-openshift-default-797c6dc855-w477z\" (UID: \"a92e2f56-5eb4-4b64-9947-25e1f0d51c30\") " pod="openshift-ingress/e2e-worker-w2-5c446c-openshift-default-797c6dc855-w477z"
Oct 31 17:40:17.070957 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:17.070860    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a92e2f56-5eb4-4b64-9947-25e1f0d51c30-istiod-ca-cert\") pod \"e2e-worker-w2-5c446c-openshift-default-797c6dc855-w477z\" (UID: \"a92e2f56-5eb4-4b64-9947-25e1f0d51c30\") " pod="openshift-ingress/e2e-worker-w2-5c446c-openshift-default-797c6dc855-w477z"
Oct 31 17:40:17.070957 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:17.070909    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a92e2f56-5eb4-4b64-9947-25e1f0d51c30-istio-envoy\") pod \"e2e-worker-w2-5c446c-openshift-default-797c6dc855-w477z\" (UID: \"a92e2f56-5eb4-4b64-9947-25e1f0d51c30\") " pod="openshift-ingress/e2e-worker-w2-5c446c-openshift-default-797c6dc855-w477z"
Oct 31 17:40:17.070957 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:17.070937    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d2652cf4-9d2a-480e-ad8a-946d0d4b90f3-workload-certs\") pod \"e2e-worker-w0-ee816e-openshift-default-c4db85b5c-qm655\" (UID: \"d2652cf4-9d2a-480e-ad8a-946d0d4b90f3\") " pod="openshift-ingress/e2e-worker-w0-ee816e-openshift-default-c4db85b5c-qm655"
Oct 31 17:40:17.071232 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:17.071027    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a92e2f56-5eb4-4b64-9947-25e1f0d51c30-workload-certs\") pod \"e2e-worker-w2-5c446c-openshift-default-797c6dc855-w477z\" (UID: \"a92e2f56-5eb4-4b64-9947-25e1f0d51c30\") " pod="openshift-ingress/e2e-worker-w2-5c446c-openshift-default-797c6dc855-w477z"
Oct 31 17:40:17.071232 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:17.071114    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d2652cf4-9d2a-480e-ad8a-946d0d4b90f3-credential-socket\") pod \"e2e-worker-w0-ee816e-openshift-default-c4db85b5c-qm655\" (UID: \"d2652cf4-9d2a-480e-ad8a-946d0d4b90f3\") " pod="openshift-ingress/e2e-worker-w0-ee816e-openshift-default-c4db85b5c-qm655"
Oct 31 17:40:17.071232 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:17.071151    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a92e2f56-5eb4-4b64-9947-25e1f0d51c30-istio-token\") pod \"e2e-worker-w2-5c446c-openshift-default-797c6dc855-w477z\" (UID: \"a92e2f56-5eb4-4b64-9947-25e1f0d51c30\") " pod="openshift-ingress/e2e-worker-w2-5c446c-openshift-default-797c6dc855-w477z"
Oct 31 17:40:17.071232 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:17.071187    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d2652cf4-9d2a-480e-ad8a-946d0d4b90f3-istio-data\") pod \"e2e-worker-w0-ee816e-openshift-default-c4db85b5c-qm655\" (UID: \"d2652cf4-9d2a-480e-ad8a-946d0d4b90f3\") " pod="openshift-ingress/e2e-worker-w0-ee816e-openshift-default-c4db85b5c-qm655"
Oct 31 17:40:17.071232 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:17.071225    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a92e2f56-5eb4-4b64-9947-25e1f0d51c30-workload-socket\") pod \"e2e-worker-w2-5c446c-openshift-default-797c6dc855-w477z\" (UID: \"a92e2f56-5eb4-4b64-9947-25e1f0d51c30\") " pod="openshift-ingress/e2e-worker-w2-5c446c-openshift-default-797c6dc855-w477z"
Oct 31 17:40:17.071514 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:17.071244    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a92e2f56-5eb4-4b64-9947-25e1f0d51c30-istio-data\") pod \"e2e-worker-w2-5c446c-openshift-default-797c6dc855-w477z\" (UID: \"a92e2f56-5eb4-4b64-9947-25e1f0d51c30\") " pod="openshift-ingress/e2e-worker-w2-5c446c-openshift-default-797c6dc855-w477z"
Oct 31 17:40:17.071514 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:17.071296    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d2652cf4-9d2a-480e-ad8a-946d0d4b90f3-istiod-ca-cert\") pod \"e2e-worker-w0-ee816e-openshift-default-c4db85b5c-qm655\" (UID: \"d2652cf4-9d2a-480e-ad8a-946d0d4b90f3\") " pod="openshift-ingress/e2e-worker-w0-ee816e-openshift-default-c4db85b5c-qm655"
Oct 31 17:40:17.071514 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:17.071324    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d2652cf4-9d2a-480e-ad8a-946d0d4b90f3-istio-podinfo\") pod \"e2e-worker-w0-ee816e-openshift-default-c4db85b5c-qm655\" (UID: \"d2652cf4-9d2a-480e-ad8a-946d0d4b90f3\") " pod="openshift-ingress/e2e-worker-w0-ee816e-openshift-default-c4db85b5c-qm655"
Oct 31 17:40:17.071514 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:17.071367    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a92e2f56-5eb4-4b64-9947-25e1f0d51c30-credential-socket\") pod \"e2e-worker-w2-5c446c-openshift-default-797c6dc855-w477z\" (UID: \"a92e2f56-5eb4-4b64-9947-25e1f0d51c30\") " pod="openshift-ingress/e2e-worker-w2-5c446c-openshift-default-797c6dc855-w477z"
Oct 31 17:40:17.071514 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:17.071462    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a92e2f56-5eb4-4b64-9947-25e1f0d51c30-istio-podinfo\") pod \"e2e-worker-w2-5c446c-openshift-default-797c6dc855-w477z\" (UID: \"a92e2f56-5eb4-4b64-9947-25e1f0d51c30\") " pod="openshift-ingress/e2e-worker-w2-5c446c-openshift-default-797c6dc855-w477z"
Oct 31 17:40:17.071514 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:17.071488    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d2652cf4-9d2a-480e-ad8a-946d0d4b90f3-workload-socket\") pod \"e2e-worker-w0-ee816e-openshift-default-c4db85b5c-qm655\" (UID: \"d2652cf4-9d2a-480e-ad8a-946d0d4b90f3\") " pod="openshift-ingress/e2e-worker-w0-ee816e-openshift-default-c4db85b5c-qm655"
Oct 31 17:40:17.071802 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:17.071544    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d2652cf4-9d2a-480e-ad8a-946d0d4b90f3-istio-token\") pod \"e2e-worker-w0-ee816e-openshift-default-c4db85b5c-qm655\" (UID: \"d2652cf4-9d2a-480e-ad8a-946d0d4b90f3\") " pod="openshift-ingress/e2e-worker-w0-ee816e-openshift-default-c4db85b5c-qm655"
Oct 31 17:40:17.071802 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:17.071606    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a92e2f56-5eb4-4b64-9947-25e1f0d51c30-istio-data\") pod \"e2e-worker-w2-5c446c-openshift-default-797c6dc855-w477z\" (UID: \"a92e2f56-5eb4-4b64-9947-25e1f0d51c30\") " pod="openshift-ingress/e2e-worker-w2-5c446c-openshift-default-797c6dc855-w477z"
Oct 31 17:40:17.071802 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:17.071598    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7jpb7\" (UniqueName: \"kubernetes.io/projected/d2652cf4-9d2a-480e-ad8a-946d0d4b90f3-kube-api-access-7jpb7\") pod \"e2e-worker-w0-ee816e-openshift-default-c4db85b5c-qm655\" (UID: \"d2652cf4-9d2a-480e-ad8a-946d0d4b90f3\") " pod="openshift-ingress/e2e-worker-w0-ee816e-openshift-default-c4db85b5c-qm655"
Oct 31 17:40:17.071802 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:17.071606    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a92e2f56-5eb4-4b64-9947-25e1f0d51c30-istiod-ca-cert\") pod \"e2e-worker-w2-5c446c-openshift-default-797c6dc855-w477z\" (UID: \"a92e2f56-5eb4-4b64-9947-25e1f0d51c30\") " pod="openshift-ingress/e2e-worker-w2-5c446c-openshift-default-797c6dc855-w477z"
Oct 31 17:40:17.071802 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:17.071628    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a92e2f56-5eb4-4b64-9947-25e1f0d51c30-credential-socket\") pod \"e2e-worker-w2-5c446c-openshift-default-797c6dc855-w477z\" (UID: \"a92e2f56-5eb4-4b64-9947-25e1f0d51c30\") " pod="openshift-ingress/e2e-worker-w2-5c446c-openshift-default-797c6dc855-w477z"
Oct 31 17:40:17.073235 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:17.073211    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a92e2f56-5eb4-4b64-9947-25e1f0d51c30-istio-envoy\") pod \"e2e-worker-w2-5c446c-openshift-default-797c6dc855-w477z\" (UID: \"a92e2f56-5eb4-4b64-9947-25e1f0d51c30\") " pod="openshift-ingress/e2e-worker-w2-5c446c-openshift-default-797c6dc855-w477z"
Oct 31 17:40:17.073788 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:17.073769    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a92e2f56-5eb4-4b64-9947-25e1f0d51c30-istio-podinfo\") pod \"e2e-worker-w2-5c446c-openshift-default-797c6dc855-w477z\" (UID: \"a92e2f56-5eb4-4b64-9947-25e1f0d51c30\") " pod="openshift-ingress/e2e-worker-w2-5c446c-openshift-default-797c6dc855-w477z"
Oct 31 17:40:17.089855 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:17.089821    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a92e2f56-5eb4-4b64-9947-25e1f0d51c30-istio-token\") pod \"e2e-worker-w2-5c446c-openshift-default-797c6dc855-w477z\" (UID: \"a92e2f56-5eb4-4b64-9947-25e1f0d51c30\") " pod="openshift-ingress/e2e-worker-w2-5c446c-openshift-default-797c6dc855-w477z"
Oct 31 17:40:17.089994 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:17.089974    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dvwrv\" (UniqueName: \"kubernetes.io/projected/a92e2f56-5eb4-4b64-9947-25e1f0d51c30-kube-api-access-dvwrv\") pod \"e2e-worker-w2-5c446c-openshift-default-797c6dc855-w477z\" (UID: \"a92e2f56-5eb4-4b64-9947-25e1f0d51c30\") " pod="openshift-ingress/e2e-worker-w2-5c446c-openshift-default-797c6dc855-w477z"
Oct 31 17:40:17.173040 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:17.172943    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d2652cf4-9d2a-480e-ad8a-946d0d4b90f3-istio-envoy\") pod \"e2e-worker-w0-ee816e-openshift-default-c4db85b5c-qm655\" (UID: \"d2652cf4-9d2a-480e-ad8a-946d0d4b90f3\") " pod="openshift-ingress/e2e-worker-w0-ee816e-openshift-default-c4db85b5c-qm655"
Oct 31 17:40:17.173040 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:17.173025    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d2652cf4-9d2a-480e-ad8a-946d0d4b90f3-workload-certs\") pod \"e2e-worker-w0-ee816e-openshift-default-c4db85b5c-qm655\" (UID: \"d2652cf4-9d2a-480e-ad8a-946d0d4b90f3\") " pod="openshift-ingress/e2e-worker-w0-ee816e-openshift-default-c4db85b5c-qm655"
Oct 31 17:40:17.173267 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:17.173121    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d2652cf4-9d2a-480e-ad8a-946d0d4b90f3-credential-socket\") pod \"e2e-worker-w0-ee816e-openshift-default-c4db85b5c-qm655\" (UID: \"d2652cf4-9d2a-480e-ad8a-946d0d4b90f3\") " pod="openshift-ingress/e2e-worker-w0-ee816e-openshift-default-c4db85b5c-qm655"
Oct 31 17:40:17.173267 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:17.173151    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d2652cf4-9d2a-480e-ad8a-946d0d4b90f3-istio-data\") pod \"e2e-worker-w0-ee816e-openshift-default-c4db85b5c-qm655\" (UID: \"d2652cf4-9d2a-480e-ad8a-946d0d4b90f3\") " pod="openshift-ingress/e2e-worker-w0-ee816e-openshift-default-c4db85b5c-qm655"
Oct 31 17:40:17.173267 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:17.173194    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d2652cf4-9d2a-480e-ad8a-946d0d4b90f3-istiod-ca-cert\") pod \"e2e-worker-w0-ee816e-openshift-default-c4db85b5c-qm655\" (UID: \"d2652cf4-9d2a-480e-ad8a-946d0d4b90f3\") " pod="openshift-ingress/e2e-worker-w0-ee816e-openshift-default-c4db85b5c-qm655"
Oct 31 17:40:17.173267 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:17.173226    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d2652cf4-9d2a-480e-ad8a-946d0d4b90f3-istio-podinfo\") pod \"e2e-worker-w0-ee816e-openshift-default-c4db85b5c-qm655\" (UID: \"d2652cf4-9d2a-480e-ad8a-946d0d4b90f3\") " pod="openshift-ingress/e2e-worker-w0-ee816e-openshift-default-c4db85b5c-qm655"
Oct 31 17:40:17.173484 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:17.173275    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d2652cf4-9d2a-480e-ad8a-946d0d4b90f3-workload-socket\") pod \"e2e-worker-w0-ee816e-openshift-default-c4db85b5c-qm655\" (UID: \"d2652cf4-9d2a-480e-ad8a-946d0d4b90f3\") " pod="openshift-ingress/e2e-worker-w0-ee816e-openshift-default-c4db85b5c-qm655"
Oct 31 17:40:17.173484 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:17.173325    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d2652cf4-9d2a-480e-ad8a-946d0d4b90f3-istio-token\") pod \"e2e-worker-w0-ee816e-openshift-default-c4db85b5c-qm655\" (UID: \"d2652cf4-9d2a-480e-ad8a-946d0d4b90f3\") " pod="openshift-ingress/e2e-worker-w0-ee816e-openshift-default-c4db85b5c-qm655"
Oct 31 17:40:17.173484 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:17.173352    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7jpb7\" (UniqueName: \"kubernetes.io/projected/d2652cf4-9d2a-480e-ad8a-946d0d4b90f3-kube-api-access-7jpb7\") pod \"e2e-worker-w0-ee816e-openshift-default-c4db85b5c-qm655\" (UID: \"d2652cf4-9d2a-480e-ad8a-946d0d4b90f3\") " pod="openshift-ingress/e2e-worker-w0-ee816e-openshift-default-c4db85b5c-qm655"
Oct 31 17:40:17.173636 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:17.173524    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d2652cf4-9d2a-480e-ad8a-946d0d4b90f3-workload-certs\") pod \"e2e-worker-w0-ee816e-openshift-default-c4db85b5c-qm655\" (UID: \"d2652cf4-9d2a-480e-ad8a-946d0d4b90f3\") " pod="openshift-ingress/e2e-worker-w0-ee816e-openshift-default-c4db85b5c-qm655"
Oct 31 17:40:17.173991 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:17.173963    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d2652cf4-9d2a-480e-ad8a-946d0d4b90f3-istiod-ca-cert\") pod \"e2e-worker-w0-ee816e-openshift-default-c4db85b5c-qm655\" (UID: \"d2652cf4-9d2a-480e-ad8a-946d0d4b90f3\") " pod="openshift-ingress/e2e-worker-w0-ee816e-openshift-default-c4db85b5c-qm655"
Oct 31 17:40:17.174106 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:17.174003    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d2652cf4-9d2a-480e-ad8a-946d0d4b90f3-istio-data\") pod \"e2e-worker-w0-ee816e-openshift-default-c4db85b5c-qm655\" (UID: \"d2652cf4-9d2a-480e-ad8a-946d0d4b90f3\") " pod="openshift-ingress/e2e-worker-w0-ee816e-openshift-default-c4db85b5c-qm655"
Oct 31 17:40:17.174172 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:17.174097    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d2652cf4-9d2a-480e-ad8a-946d0d4b90f3-workload-socket\") pod \"e2e-worker-w0-ee816e-openshift-default-c4db85b5c-qm655\" (UID: \"d2652cf4-9d2a-480e-ad8a-946d0d4b90f3\") " pod="openshift-ingress/e2e-worker-w0-ee816e-openshift-default-c4db85b5c-qm655"
Oct 31 17:40:17.174172 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:17.174165    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d2652cf4-9d2a-480e-ad8a-946d0d4b90f3-credential-socket\") pod \"e2e-worker-w0-ee816e-openshift-default-c4db85b5c-qm655\" (UID: \"d2652cf4-9d2a-480e-ad8a-946d0d4b90f3\") " pod="openshift-ingress/e2e-worker-w0-ee816e-openshift-default-c4db85b5c-qm655"
Oct 31 17:40:17.175323 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:17.175303    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d2652cf4-9d2a-480e-ad8a-946d0d4b90f3-istio-envoy\") pod \"e2e-worker-w0-ee816e-openshift-default-c4db85b5c-qm655\" (UID: \"d2652cf4-9d2a-480e-ad8a-946d0d4b90f3\") " pod="openshift-ingress/e2e-worker-w0-ee816e-openshift-default-c4db85b5c-qm655"
Oct 31 17:40:17.175615 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:17.175597    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d2652cf4-9d2a-480e-ad8a-946d0d4b90f3-istio-podinfo\") pod \"e2e-worker-w0-ee816e-openshift-default-c4db85b5c-qm655\" (UID: \"d2652cf4-9d2a-480e-ad8a-946d0d4b90f3\") " pod="openshift-ingress/e2e-worker-w0-ee816e-openshift-default-c4db85b5c-qm655"
Oct 31 17:40:17.191825 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:17.191793    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7jpb7\" (UniqueName: \"kubernetes.io/projected/d2652cf4-9d2a-480e-ad8a-946d0d4b90f3-kube-api-access-7jpb7\") pod \"e2e-worker-w0-ee816e-openshift-default-c4db85b5c-qm655\" (UID: \"d2652cf4-9d2a-480e-ad8a-946d0d4b90f3\") " pod="openshift-ingress/e2e-worker-w0-ee816e-openshift-default-c4db85b5c-qm655"
Oct 31 17:40:17.192057 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:17.192035    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d2652cf4-9d2a-480e-ad8a-946d0d4b90f3-istio-token\") pod \"e2e-worker-w0-ee816e-openshift-default-c4db85b5c-qm655\" (UID: \"d2652cf4-9d2a-480e-ad8a-946d0d4b90f3\") " pod="openshift-ingress/e2e-worker-w0-ee816e-openshift-default-c4db85b5c-qm655"
Oct 31 17:40:17.200540 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:17.200520    5003 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-5c446c-openshift-default-797c6dc855-w477z"
Oct 31 17:40:17.292060 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:17.292027    5003 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-ee816e-openshift-default-c4db85b5c-qm655"
Oct 31 17:40:17.511360 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:17.511332    5003 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w2-5c446c-openshift-default-797c6dc855-w477z"]
Oct 31 17:40:17.513490 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:40:17.513461    5003 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda92e2f56_5eb4_4b64_9947_25e1f0d51c30.slice/crio-ef750e3e0012bb27a6414dfb9dbad9a4a855f31e127f5674e64d2e450a3f6c8a WatchSource:0}: Error finding container ef750e3e0012bb27a6414dfb9dbad9a4a855f31e127f5674e64d2e450a3f6c8a: Status 404 returned error can't find the container with id ef750e3e0012bb27a6414dfb9dbad9a4a855f31e127f5674e64d2e450a3f6c8a
Oct 31 17:40:17.516300 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:17.516264    5003 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Oct 31 17:40:17.516415 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:17.516351    5003 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Oct 31 17:40:17.516415 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:17.516396    5003 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Oct 31 17:40:17.570484 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:17.570449    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-5c446c-openshift-default-797c6dc855-w477z" event={"ID":"a92e2f56-5eb4-4b64-9947-25e1f0d51c30","Type":"ContainerStarted","Data":"ef750e3e0012bb27a6414dfb9dbad9a4a855f31e127f5674e64d2e450a3f6c8a"}
Oct 31 17:40:17.572545 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:17.572514    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-cf0a86-openshift-default-595bfdc58c-jwvk2" event={"ID":"3dac59b3-ae83-496f-87cb-16c7fd249497","Type":"ContainerStarted","Data":"13e041a079399f46c303c38488c6ecb78bf58d112509e980ab7c81f5263337e7"}
Oct 31 17:40:17.572702 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:17.572562    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-cf0a86-openshift-default-595bfdc58c-jwvk2" event={"ID":"3dac59b3-ae83-496f-87cb-16c7fd249497","Type":"ContainerStarted","Data":"6a3553278b5b512e49ae592c9f04990dc4ab6baccf84265b65e9d16b0b278bf4"}
Oct 31 17:40:17.584615 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:17.584594    5003 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w3-cf0a86-openshift-default-595bfdc58c-jwvk2"
Oct 31 17:40:17.586827 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:17.586802    5003 patch_prober.go:29] interesting pod/e2e-worker-w3-cf0a86-openshift-default-595bfdc58c-jwvk2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.95:15021/healthz/ready\": dial tcp 10.132.0.95:15021: connect: connection refused" start-of-body=
Oct 31 17:40:17.586904 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:17.586846    5003 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-cf0a86-openshift-default-595bfdc58c-jwvk2" podUID="3dac59b3-ae83-496f-87cb-16c7fd249497" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.95:15021/healthz/ready\": dial tcp 10.132.0.95:15021: connect: connection refused"
Oct 31 17:40:17.615730 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:17.612697    5003 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-ee816e-openshift-default-c4db85b5c-qm655"]
Oct 31 17:40:17.627509 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:17.627455    5003 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w3-cf0a86-openshift-default-595bfdc58c-jwvk2" podStartSLOduration=1.627441144 podStartE2EDuration="1.627441144s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 17:40:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 17:40:17.62618458 +0000 UTC m=+785.881039127" watchObservedRunningTime="2026-10-31 17:40:17.627441144 +0000 UTC m=+785.882295685"
Oct 31 17:40:17.629151 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:40:17.629083    5003 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd2652cf4_9d2a_480e_ad8a_946d0d4b90f3.slice/crio-734daf0235946b34258e2ef05b0628f9dbc40700cb7d94ec3a8618136c7d8d34 WatchSource:0}: Error finding container 734daf0235946b34258e2ef05b0628f9dbc40700cb7d94ec3a8618136c7d8d34: Status 404 returned error can't find the container with id 734daf0235946b34258e2ef05b0628f9dbc40700cb7d94ec3a8618136c7d8d34
Oct 31 17:40:17.631378 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:17.631331    5003 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Oct 31 17:40:17.631492 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:17.631421    5003 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Oct 31 17:40:17.631492 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:17.631460    5003 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Oct 31 17:40:18.062679 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:18.062044    5003 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w4-1c0bfd/distinct-w4-1c0bfd-kserve-867858548f-46gwg"
Oct 31 17:40:18.097274 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:18.097246    5003 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w4-1c0bfd/distinct-w4-1c0bfd-kserve-867858548f-46gwg"
Oct 31 17:40:18.587113 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:18.587076    5003 patch_prober.go:29] interesting pod/e2e-worker-w3-cf0a86-openshift-default-595bfdc58c-jwvk2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.95:15021/healthz/ready\": dial tcp 10.132.0.95:15021: connect: connection refused" start-of-body=
Oct 31 17:40:18.587741 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:18.587707    5003 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-cf0a86-openshift-default-595bfdc58c-jwvk2" podUID="3dac59b3-ae83-496f-87cb-16c7fd249497" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.95:15021/healthz/ready\": dial tcp 10.132.0.95:15021: connect: connection refused"
Oct 31 17:40:18.609706 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:18.609473    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-5c446c-openshift-default-797c6dc855-w477z" event={"ID":"a92e2f56-5eb4-4b64-9947-25e1f0d51c30","Type":"ContainerStarted","Data":"88f32c22ff949f40ab5613152bad312210dc8e101df7d91e55a418b417b6426d"}
Oct 31 17:40:18.611701 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:18.611674    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-ee816e-openshift-default-c4db85b5c-qm655" event={"ID":"d2652cf4-9d2a-480e-ad8a-946d0d4b90f3","Type":"ContainerStarted","Data":"c4ff4c810940412d9a1ff9122542f6410610dbb972e3da5152726e556a9c8a14"}
Oct 31 17:40:18.611775 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:18.611728    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-ee816e-openshift-default-c4db85b5c-qm655" event={"ID":"d2652cf4-9d2a-480e-ad8a-946d0d4b90f3","Type":"ContainerStarted","Data":"734daf0235946b34258e2ef05b0628f9dbc40700cb7d94ec3a8618136c7d8d34"}
Oct 31 17:40:18.623448 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:18.623425    5003 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w4-1c0bfd/distinct-w4-1c0bfd-kserve-867858548f-46gwg"
Oct 31 17:40:18.707154 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:18.707090    5003 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w2-5c446c-openshift-default-797c6dc855-w477z" podStartSLOduration=2.707067899 podStartE2EDuration="2.707067899s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 17:40:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 17:40:18.660675182 +0000 UTC m=+786.915529728" watchObservedRunningTime="2026-10-31 17:40:18.707067899 +0000 UTC m=+786.961922442"
Oct 31 17:40:18.712445 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:18.712390    5003 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w0-ee816e-openshift-default-c4db85b5c-qm655" podStartSLOduration=2.71237556 podStartE2EDuration="2.71237556s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 17:40:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 17:40:18.7093787 +0000 UTC m=+786.964233228" watchObservedRunningTime="2026-10-31 17:40:18.71237556 +0000 UTC m=+786.967230149"
Oct 31 17:40:19.207247 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:19.205004    5003 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w2-5c446c-openshift-default-797c6dc855-w477z"
Oct 31 17:40:19.207609 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:19.207580    5003 patch_prober.go:29] interesting pod/e2e-worker-w2-5c446c-openshift-default-797c6dc855-w477z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.96:15021/healthz/ready\": dial tcp 10.132.0.96:15021: connect: connection refused" start-of-body=
Oct 31 17:40:19.207983 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:19.207943    5003 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-5c446c-openshift-default-797c6dc855-w477z" podUID="a92e2f56-5eb4-4b64-9947-25e1f0d51c30" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.96:15021/healthz/ready\": dial tcp 10.132.0.96:15021: connect: connection refused"
Oct 31 17:40:19.297918 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:19.297871    5003 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w0-ee816e-openshift-default-c4db85b5c-qm655"
Oct 31 17:40:19.298277 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:19.298252    5003 patch_prober.go:29] interesting pod/e2e-worker-w0-ee816e-openshift-default-c4db85b5c-qm655 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.97:15021/healthz/ready\": dial tcp 10.132.0.97:15021: connect: connection refused" start-of-body=
Oct 31 17:40:19.298453 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:19.298428    5003 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-ee816e-openshift-default-c4db85b5c-qm655" podUID="d2652cf4-9d2a-480e-ad8a-946d0d4b90f3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.97:15021/healthz/ready\": dial tcp 10.132.0.97:15021: connect: connection refused"
Oct 31 17:40:19.585446 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:19.585012    5003 patch_prober.go:29] interesting pod/e2e-worker-w3-cf0a86-openshift-default-595bfdc58c-jwvk2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.95:15021/healthz/ready\": dial tcp 10.132.0.95:15021: connect: connection refused" start-of-body=
Oct 31 17:40:19.585446 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:19.585075    5003 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-cf0a86-openshift-default-595bfdc58c-jwvk2" podUID="3dac59b3-ae83-496f-87cb-16c7fd249497" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.95:15021/healthz/ready\": dial tcp 10.132.0.95:15021: connect: connection refused"
Oct 31 17:40:20.202389 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:20.202351    5003 patch_prober.go:29] interesting pod/e2e-worker-w2-5c446c-openshift-default-797c6dc855-w477z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.96:15021/healthz/ready\": dial tcp 10.132.0.96:15021: connect: connection refused" start-of-body=
Oct 31 17:40:20.203018 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:20.202985    5003 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-5c446c-openshift-default-797c6dc855-w477z" podUID="a92e2f56-5eb4-4b64-9947-25e1f0d51c30" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.96:15021/healthz/ready\": dial tcp 10.132.0.96:15021: connect: connection refused"
Oct 31 17:40:20.293082 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:20.293043    5003 patch_prober.go:29] interesting pod/e2e-worker-w0-ee816e-openshift-default-c4db85b5c-qm655 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.97:15021/healthz/ready\": dial tcp 10.132.0.97:15021: connect: connection refused" start-of-body=
Oct 31 17:40:20.293353 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:20.293324    5003 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-ee816e-openshift-default-c4db85b5c-qm655" podUID="d2652cf4-9d2a-480e-ad8a-946d0d4b90f3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.97:15021/healthz/ready\": dial tcp 10.132.0.97:15021: connect: connection refused"
Oct 31 17:40:20.595342 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:20.595306    5003 patch_prober.go:29] interesting pod/e2e-worker-w3-cf0a86-openshift-default-595bfdc58c-jwvk2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.95:15021/healthz/ready\": dial tcp 10.132.0.95:15021: connect: connection refused" start-of-body=
Oct 31 17:40:20.595668 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:20.595614    5003 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-cf0a86-openshift-default-595bfdc58c-jwvk2" podUID="3dac59b3-ae83-496f-87cb-16c7fd249497" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.95:15021/healthz/ready\": dial tcp 10.132.0.95:15021: connect: connection refused"
Oct 31 17:40:21.206668 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:21.206052    5003 patch_prober.go:29] interesting pod/e2e-worker-w2-5c446c-openshift-default-797c6dc855-w477z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.96:15021/healthz/ready\": dial tcp 10.132.0.96:15021: connect: connection refused" start-of-body=
Oct 31 17:40:21.206668 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:21.206115    5003 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-5c446c-openshift-default-797c6dc855-w477z" podUID="a92e2f56-5eb4-4b64-9947-25e1f0d51c30" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.96:15021/healthz/ready\": dial tcp 10.132.0.96:15021: connect: connection refused"
Oct 31 17:40:21.298673 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:21.298060    5003 patch_prober.go:29] interesting pod/e2e-worker-w0-ee816e-openshift-default-c4db85b5c-qm655 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.97:15021/healthz/ready\": dial tcp 10.132.0.97:15021: connect: connection refused" start-of-body=
Oct 31 17:40:21.298673 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:21.298124    5003 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-ee816e-openshift-default-c4db85b5c-qm655" podUID="d2652cf4-9d2a-480e-ad8a-946d0d4b90f3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.97:15021/healthz/ready\": dial tcp 10.132.0.97:15021: connect: connection refused"
Oct 31 17:40:21.592170 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:21.592130    5003 patch_prober.go:29] interesting pod/e2e-worker-w3-cf0a86-openshift-default-595bfdc58c-jwvk2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.95:15021/healthz/ready\": dial tcp 10.132.0.95:15021: connect: connection refused" start-of-body=
Oct 31 17:40:21.592493 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:21.592461    5003 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-cf0a86-openshift-default-595bfdc58c-jwvk2" podUID="3dac59b3-ae83-496f-87cb-16c7fd249497" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.95:15021/healthz/ready\": dial tcp 10.132.0.95:15021: connect: connection refused"
Oct 31 17:40:22.201133 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:22.201088    5003 patch_prober.go:29] interesting pod/e2e-worker-w2-5c446c-openshift-default-797c6dc855-w477z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.96:15021/healthz/ready\": dial tcp 10.132.0.96:15021: connect: connection refused" start-of-body=
Oct 31 17:40:22.201454 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:22.201422    5003 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-5c446c-openshift-default-797c6dc855-w477z" podUID="a92e2f56-5eb4-4b64-9947-25e1f0d51c30" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.96:15021/healthz/ready\": dial tcp 10.132.0.96:15021: connect: connection refused"
Oct 31 17:40:22.294232 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:22.294180    5003 patch_prober.go:29] interesting pod/e2e-worker-w0-ee816e-openshift-default-c4db85b5c-qm655 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.97:15021/healthz/ready\": dial tcp 10.132.0.97:15021: connect: connection refused" start-of-body=
Oct 31 17:40:22.294927 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:22.294875    5003 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-ee816e-openshift-default-c4db85b5c-qm655" podUID="d2652cf4-9d2a-480e-ad8a-946d0d4b90f3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.97:15021/healthz/ready\": dial tcp 10.132.0.97:15021: connect: connection refused"
Oct 31 17:40:22.587672 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:22.585146    5003 patch_prober.go:29] interesting pod/e2e-worker-w3-cf0a86-openshift-default-595bfdc58c-jwvk2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.95:15021/healthz/ready\": dial tcp 10.132.0.95:15021: connect: connection refused" start-of-body=
Oct 31 17:40:22.587672 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:22.585218    5003 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-cf0a86-openshift-default-595bfdc58c-jwvk2" podUID="3dac59b3-ae83-496f-87cb-16c7fd249497" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.95:15021/healthz/ready\": dial tcp 10.132.0.95:15021: connect: connection refused"
Oct 31 17:40:23.214671 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:23.208635    5003 patch_prober.go:29] interesting pod/e2e-worker-w2-5c446c-openshift-default-797c6dc855-w477z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.96:15021/healthz/ready\": dial tcp 10.132.0.96:15021: connect: connection refused" start-of-body=
Oct 31 17:40:23.214671 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:23.208714    5003 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-5c446c-openshift-default-797c6dc855-w477z" podUID="a92e2f56-5eb4-4b64-9947-25e1f0d51c30" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.96:15021/healthz/ready\": dial tcp 10.132.0.96:15021: connect: connection refused"
Oct 31 17:40:23.302859 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:23.302802    5003 patch_prober.go:29] interesting pod/e2e-worker-w0-ee816e-openshift-default-c4db85b5c-qm655 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.97:15021/healthz/ready\": dial tcp 10.132.0.97:15021: connect: connection refused" start-of-body=
Oct 31 17:40:23.303526 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:23.303474    5003 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-ee816e-openshift-default-c4db85b5c-qm655" podUID="d2652cf4-9d2a-480e-ad8a-946d0d4b90f3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.97:15021/healthz/ready\": dial tcp 10.132.0.97:15021: connect: connection refused"
Oct 31 17:40:23.586396 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:23.586352    5003 patch_prober.go:29] interesting pod/e2e-worker-w3-cf0a86-openshift-default-595bfdc58c-jwvk2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.95:15021/healthz/ready\": dial tcp 10.132.0.95:15021: connect: connection refused" start-of-body=
Oct 31 17:40:23.586708 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:23.586677    5003 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-cf0a86-openshift-default-595bfdc58c-jwvk2" podUID="3dac59b3-ae83-496f-87cb-16c7fd249497" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.95:15021/healthz/ready\": dial tcp 10.132.0.95:15021: connect: connection refused"
Oct 31 17:40:24.182843 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:24.182787    5003 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w4-1c0bfd/premium-w4-1c0bfd-kserve-d78fbb98-psx55" podUID="34bdffed-87b8-4e7a-b182-f069d081bd62" containerName="main" probeResult="failure" output="Get \"https://10.132.0.74:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 31 17:40:24.201331 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:24.201182    5003 patch_prober.go:29] interesting pod/e2e-worker-w2-5c446c-openshift-default-797c6dc855-w477z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.96:15021/healthz/ready\": dial tcp 10.132.0.96:15021: connect: connection refused" start-of-body=
Oct 31 17:40:24.201331 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:24.201261    5003 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-5c446c-openshift-default-797c6dc855-w477z" podUID="a92e2f56-5eb4-4b64-9947-25e1f0d51c30" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.96:15021/healthz/ready\": dial tcp 10.132.0.96:15021: connect: connection refused"
Oct 31 17:40:24.296499 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:24.296452    5003 patch_prober.go:29] interesting pod/e2e-worker-w0-ee816e-openshift-default-c4db85b5c-qm655 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.97:15021/healthz/ready\": dial tcp 10.132.0.97:15021: connect: connection refused" start-of-body=
Oct 31 17:40:24.296842 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:24.296810    5003 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-ee816e-openshift-default-c4db85b5c-qm655" podUID="d2652cf4-9d2a-480e-ad8a-946d0d4b90f3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.97:15021/healthz/ready\": dial tcp 10.132.0.97:15021: connect: connection refused"
Oct 31 17:40:25.301668 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:25.298413    5003 patch_prober.go:29] interesting pod/e2e-worker-w0-ee816e-openshift-default-c4db85b5c-qm655 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.97:15021/healthz/ready\": dial tcp 10.132.0.97:15021: connect: connection refused" start-of-body=
Oct 31 17:40:25.301668 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:25.298501    5003 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-ee816e-openshift-default-c4db85b5c-qm655" podUID="d2652cf4-9d2a-480e-ad8a-946d0d4b90f3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.97:15021/healthz/ready\": dial tcp 10.132.0.97:15021: connect: connection refused"
Oct 31 17:40:25.637670 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:25.636751    5003 patch_prober.go:29] interesting pod/e2e-worker-w3-cf0a86-openshift-default-595bfdc58c-jwvk2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.95:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 31 17:40:25.637670 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:25.636833    5003 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-cf0a86-openshift-default-595bfdc58c-jwvk2" podUID="3dac59b3-ae83-496f-87cb-16c7fd249497" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.95:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 31 17:40:25.744078 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:25.742551    5003 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w2-5c446c-openshift-default-797c6dc855-w477z"
Oct 31 17:40:25.744697 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:25.744532    5003 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w2-5c446c-openshift-default-797c6dc855-w477z"
Oct 31 17:40:25.745563 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:25.745521    5003 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w2-5c446c-openshift-default-797c6dc855-w477z"
Oct 31 17:40:26.183287 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:26.183096    5003 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w3-cf0a86-openshift-default-595bfdc58c-jwvk2"
Oct 31 17:40:26.183623 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:26.183591    5003 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w3-cf0a86-openshift-default-595bfdc58c-jwvk2"
Oct 31 17:40:26.184575 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:26.184546    5003 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w3-cf0a86-openshift-default-595bfdc58c-jwvk2"
Oct 31 17:40:26.298989 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:26.298947    5003 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w0-ee816e-openshift-default-c4db85b5c-qm655"
Oct 31 17:40:26.300251 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:26.300193    5003 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w0-ee816e-openshift-default-c4db85b5c-qm655"
Oct 31 17:40:26.304141 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:26.304103    5003 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w0-ee816e-openshift-default-c4db85b5c-qm655"
Oct 31 17:40:39.018780 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:39.018730    5003 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-5c446c/premium-w2-5c446c-kserve-66f7486c85-f7lk2" podUID="9c2ddfab-2348-4bb0-8844-1fca62460390" containerName="main" probeResult="failure" output="Get \"https://10.132.0.75:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 31 17:40:39.061809 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:39.061760    5003 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w4-1c0bfd/distinct-w4-1c0bfd-kserve-867858548f-46gwg" podUID="93f16294-fc40-477d-90b3-d02640037d5b" containerName="main" probeResult="failure" output="Get \"https://10.132.0.94:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 31 17:40:39.171670 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:39.159908    5003 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-ee816e/distinct-w0-ee816e-kserve-564f897f89-kglpl" podUID="82b982f8-de44-449d-b4a6-dc8f5824bf35" containerName="main" probeResult="failure" output="Get \"https://10.132.0.91:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 31 17:40:40.332050 ip-10-0-138-17 kubenswrapper[5003]: E1031 17:40:40.332010    5003 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-tdzz5" containerName="extractor"
Oct 31 17:40:43.127389 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:43.127354    5003 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-3e6bdf19-928d7"]
Oct 31 17:40:43.131708 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:43.131691    5003 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-3e6bdf19-928d7"
Oct 31 17:40:43.149546 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:43.149517    5003 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-3e6bdf19-928d7"]
Oct 31 17:40:43.156551 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:43.156527    5003 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\""
Oct 31 17:40:43.156718 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:43.156559    5003 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-mr9x2\""
Oct 31 17:40:43.264443 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:43.264412    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/bd0dcfdf-0457-4f63-a89a-41733ac10ca9-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-3e6bdf19-928d7\" (UID: \"bd0dcfdf-0457-4f63-a89a-41733ac10ca9\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-3e6bdf19-928d7"
Oct 31 17:40:43.264616 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:43.264583    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/bd0dcfdf-0457-4f63-a89a-41733ac10ca9-maas-api-xks-ca\") pod \"maas-api-revoke-sub-3e6bdf19-928d7\" (UID: \"bd0dcfdf-0457-4f63-a89a-41733ac10ca9\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-3e6bdf19-928d7"
Oct 31 17:40:43.264714 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:43.264640    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fv55p\" (UniqueName: \"kubernetes.io/projected/bd0dcfdf-0457-4f63-a89a-41733ac10ca9-kube-api-access-fv55p\") pod \"maas-api-revoke-sub-3e6bdf19-928d7\" (UID: \"bd0dcfdf-0457-4f63-a89a-41733ac10ca9\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-3e6bdf19-928d7"
Oct 31 17:40:43.366479 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:43.366441    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fv55p\" (UniqueName: \"kubernetes.io/projected/bd0dcfdf-0457-4f63-a89a-41733ac10ca9-kube-api-access-fv55p\") pod \"maas-api-revoke-sub-3e6bdf19-928d7\" (UID: \"bd0dcfdf-0457-4f63-a89a-41733ac10ca9\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-3e6bdf19-928d7"
Oct 31 17:40:43.366733 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:43.366559    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/bd0dcfdf-0457-4f63-a89a-41733ac10ca9-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-3e6bdf19-928d7\" (UID: \"bd0dcfdf-0457-4f63-a89a-41733ac10ca9\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-3e6bdf19-928d7"
Oct 31 17:40:43.366827 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:43.366762    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/bd0dcfdf-0457-4f63-a89a-41733ac10ca9-maas-api-xks-ca\") pod \"maas-api-revoke-sub-3e6bdf19-928d7\" (UID: \"bd0dcfdf-0457-4f63-a89a-41733ac10ca9\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-3e6bdf19-928d7"
Oct 31 17:40:43.367292 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:43.367270    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/bd0dcfdf-0457-4f63-a89a-41733ac10ca9-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-3e6bdf19-928d7\" (UID: \"bd0dcfdf-0457-4f63-a89a-41733ac10ca9\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-3e6bdf19-928d7"
Oct 31 17:40:43.369129 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:43.369104    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/bd0dcfdf-0457-4f63-a89a-41733ac10ca9-maas-api-xks-ca\") pod \"maas-api-revoke-sub-3e6bdf19-928d7\" (UID: \"bd0dcfdf-0457-4f63-a89a-41733ac10ca9\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-3e6bdf19-928d7"
Oct 31 17:40:43.385371 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:43.385309    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fv55p\" (UniqueName: \"kubernetes.io/projected/bd0dcfdf-0457-4f63-a89a-41733ac10ca9-kube-api-access-fv55p\") pod \"maas-api-revoke-sub-3e6bdf19-928d7\" (UID: \"bd0dcfdf-0457-4f63-a89a-41733ac10ca9\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-3e6bdf19-928d7"
Oct 31 17:40:43.445844 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:43.445809    5003 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-3e6bdf19-928d7"
Oct 31 17:40:43.751390 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:43.751360    5003 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-3e6bdf19-928d7"]
Oct 31 17:40:43.753233 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:40:43.753204    5003 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbd0dcfdf_0457_4f63_a89a_41733ac10ca9.slice/crio-d5089bae283f877862381bdf101474c03d3cfdf2fba54913b61f101ff1d4f7b7 WatchSource:0}: Error finding container d5089bae283f877862381bdf101474c03d3cfdf2fba54913b61f101ff1d4f7b7: Status 404 returned error can't find the container with id d5089bae283f877862381bdf101474c03d3cfdf2fba54913b61f101ff1d4f7b7
Oct 31 17:40:44.036394 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:44.036306    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-3e6bdf19-928d7" event={"ID":"bd0dcfdf-0457-4f63-a89a-41733ac10ca9","Type":"ContainerStarted","Data":"d5089bae283f877862381bdf101474c03d3cfdf2fba54913b61f101ff1d4f7b7"}
Oct 31 17:40:44.436707 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:44.436672    5003 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w5-b78c31/distinct-2-w5-b78c31-kserve-5f4f9d4bb5-ss7g2"]
Oct 31 17:40:44.441476 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:44.441450    5003 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w5-b78c31/distinct-2-w5-b78c31-kserve-5f4f9d4bb5-ss7g2"
Oct 31 17:40:44.464328 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:44.464293    5003 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w5-b78c31/distinct-2-w5-b78c31-kserve-5f4f9d4bb5-ss7g2"]
Oct 31 17:40:44.465175 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:44.465153    5003 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w5-b78c31\"/\"distinct-2-w5-b78c31-kserve-self-signed-certs\""
Oct 31 17:40:44.582932 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:44.582898    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9cc6d7e8-30de-4173-9974-1f1a4fd08e1c-model-cache\") pod \"distinct-2-w5-b78c31-kserve-5f4f9d4bb5-ss7g2\" (UID: \"9cc6d7e8-30de-4173-9974-1f1a4fd08e1c\") " pod="e2e-models-e2e-worker-w5-b78c31/distinct-2-w5-b78c31-kserve-5f4f9d4bb5-ss7g2"
Oct 31 17:40:44.583109 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:44.582948    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wmjk8\" (UniqueName: \"kubernetes.io/projected/9cc6d7e8-30de-4173-9974-1f1a4fd08e1c-kube-api-access-wmjk8\") pod \"distinct-2-w5-b78c31-kserve-5f4f9d4bb5-ss7g2\" (UID: \"9cc6d7e8-30de-4173-9974-1f1a4fd08e1c\") " pod="e2e-models-e2e-worker-w5-b78c31/distinct-2-w5-b78c31-kserve-5f4f9d4bb5-ss7g2"
Oct 31 17:40:44.583109 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:44.582979    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9cc6d7e8-30de-4173-9974-1f1a4fd08e1c-dshm\") pod \"distinct-2-w5-b78c31-kserve-5f4f9d4bb5-ss7g2\" (UID: \"9cc6d7e8-30de-4173-9974-1f1a4fd08e1c\") " pod="e2e-models-e2e-worker-w5-b78c31/distinct-2-w5-b78c31-kserve-5f4f9d4bb5-ss7g2"
Oct 31 17:40:44.583109 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:44.583089    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9cc6d7e8-30de-4173-9974-1f1a4fd08e1c-home\") pod \"distinct-2-w5-b78c31-kserve-5f4f9d4bb5-ss7g2\" (UID: \"9cc6d7e8-30de-4173-9974-1f1a4fd08e1c\") " pod="e2e-models-e2e-worker-w5-b78c31/distinct-2-w5-b78c31-kserve-5f4f9d4bb5-ss7g2"
Oct 31 17:40:44.583245 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:44.583225    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9cc6d7e8-30de-4173-9974-1f1a4fd08e1c-tls-certs\") pod \"distinct-2-w5-b78c31-kserve-5f4f9d4bb5-ss7g2\" (UID: \"9cc6d7e8-30de-4173-9974-1f1a4fd08e1c\") " pod="e2e-models-e2e-worker-w5-b78c31/distinct-2-w5-b78c31-kserve-5f4f9d4bb5-ss7g2"
Oct 31 17:40:44.583294 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:44.583267    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9cc6d7e8-30de-4173-9974-1f1a4fd08e1c-tmp-dir\") pod \"distinct-2-w5-b78c31-kserve-5f4f9d4bb5-ss7g2\" (UID: \"9cc6d7e8-30de-4173-9974-1f1a4fd08e1c\") " pod="e2e-models-e2e-worker-w5-b78c31/distinct-2-w5-b78c31-kserve-5f4f9d4bb5-ss7g2"
Oct 31 17:40:44.684283 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:44.684248    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9cc6d7e8-30de-4173-9974-1f1a4fd08e1c-model-cache\") pod \"distinct-2-w5-b78c31-kserve-5f4f9d4bb5-ss7g2\" (UID: \"9cc6d7e8-30de-4173-9974-1f1a4fd08e1c\") " pod="e2e-models-e2e-worker-w5-b78c31/distinct-2-w5-b78c31-kserve-5f4f9d4bb5-ss7g2"
Oct 31 17:40:44.684433 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:44.684300    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wmjk8\" (UniqueName: \"kubernetes.io/projected/9cc6d7e8-30de-4173-9974-1f1a4fd08e1c-kube-api-access-wmjk8\") pod \"distinct-2-w5-b78c31-kserve-5f4f9d4bb5-ss7g2\" (UID: \"9cc6d7e8-30de-4173-9974-1f1a4fd08e1c\") " pod="e2e-models-e2e-worker-w5-b78c31/distinct-2-w5-b78c31-kserve-5f4f9d4bb5-ss7g2"
Oct 31 17:40:44.684476 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:44.684433    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9cc6d7e8-30de-4173-9974-1f1a4fd08e1c-dshm\") pod \"distinct-2-w5-b78c31-kserve-5f4f9d4bb5-ss7g2\" (UID: \"9cc6d7e8-30de-4173-9974-1f1a4fd08e1c\") " pod="e2e-models-e2e-worker-w5-b78c31/distinct-2-w5-b78c31-kserve-5f4f9d4bb5-ss7g2"
Oct 31 17:40:44.684544 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:44.684499    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9cc6d7e8-30de-4173-9974-1f1a4fd08e1c-home\") pod \"distinct-2-w5-b78c31-kserve-5f4f9d4bb5-ss7g2\" (UID: \"9cc6d7e8-30de-4173-9974-1f1a4fd08e1c\") " pod="e2e-models-e2e-worker-w5-b78c31/distinct-2-w5-b78c31-kserve-5f4f9d4bb5-ss7g2"
Oct 31 17:40:44.684678 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:44.684631    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9cc6d7e8-30de-4173-9974-1f1a4fd08e1c-tls-certs\") pod \"distinct-2-w5-b78c31-kserve-5f4f9d4bb5-ss7g2\" (UID: \"9cc6d7e8-30de-4173-9974-1f1a4fd08e1c\") " pod="e2e-models-e2e-worker-w5-b78c31/distinct-2-w5-b78c31-kserve-5f4f9d4bb5-ss7g2"
Oct 31 17:40:44.684782 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:44.684704    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9cc6d7e8-30de-4173-9974-1f1a4fd08e1c-tmp-dir\") pod \"distinct-2-w5-b78c31-kserve-5f4f9d4bb5-ss7g2\" (UID: \"9cc6d7e8-30de-4173-9974-1f1a4fd08e1c\") " pod="e2e-models-e2e-worker-w5-b78c31/distinct-2-w5-b78c31-kserve-5f4f9d4bb5-ss7g2"
Oct 31 17:40:44.684840 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:44.684786    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9cc6d7e8-30de-4173-9974-1f1a4fd08e1c-model-cache\") pod \"distinct-2-w5-b78c31-kserve-5f4f9d4bb5-ss7g2\" (UID: \"9cc6d7e8-30de-4173-9974-1f1a4fd08e1c\") " pod="e2e-models-e2e-worker-w5-b78c31/distinct-2-w5-b78c31-kserve-5f4f9d4bb5-ss7g2"
Oct 31 17:40:44.685020 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:44.684995    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9cc6d7e8-30de-4173-9974-1f1a4fd08e1c-home\") pod \"distinct-2-w5-b78c31-kserve-5f4f9d4bb5-ss7g2\" (UID: \"9cc6d7e8-30de-4173-9974-1f1a4fd08e1c\") " pod="e2e-models-e2e-worker-w5-b78c31/distinct-2-w5-b78c31-kserve-5f4f9d4bb5-ss7g2"
Oct 31 17:40:44.685225 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:44.685209    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9cc6d7e8-30de-4173-9974-1f1a4fd08e1c-tmp-dir\") pod \"distinct-2-w5-b78c31-kserve-5f4f9d4bb5-ss7g2\" (UID: \"9cc6d7e8-30de-4173-9974-1f1a4fd08e1c\") " pod="e2e-models-e2e-worker-w5-b78c31/distinct-2-w5-b78c31-kserve-5f4f9d4bb5-ss7g2"
Oct 31 17:40:44.686889 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:44.686838    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9cc6d7e8-30de-4173-9974-1f1a4fd08e1c-dshm\") pod \"distinct-2-w5-b78c31-kserve-5f4f9d4bb5-ss7g2\" (UID: \"9cc6d7e8-30de-4173-9974-1f1a4fd08e1c\") " pod="e2e-models-e2e-worker-w5-b78c31/distinct-2-w5-b78c31-kserve-5f4f9d4bb5-ss7g2"
Oct 31 17:40:44.687492 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:44.687460    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9cc6d7e8-30de-4173-9974-1f1a4fd08e1c-tls-certs\") pod \"distinct-2-w5-b78c31-kserve-5f4f9d4bb5-ss7g2\" (UID: \"9cc6d7e8-30de-4173-9974-1f1a4fd08e1c\") " pod="e2e-models-e2e-worker-w5-b78c31/distinct-2-w5-b78c31-kserve-5f4f9d4bb5-ss7g2"
Oct 31 17:40:44.702848 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:44.702816    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wmjk8\" (UniqueName: \"kubernetes.io/projected/9cc6d7e8-30de-4173-9974-1f1a4fd08e1c-kube-api-access-wmjk8\") pod \"distinct-2-w5-b78c31-kserve-5f4f9d4bb5-ss7g2\" (UID: \"9cc6d7e8-30de-4173-9974-1f1a4fd08e1c\") " pod="e2e-models-e2e-worker-w5-b78c31/distinct-2-w5-b78c31-kserve-5f4f9d4bb5-ss7g2"
Oct 31 17:40:44.757756 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:44.757725    5003 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w5-b78c31/distinct-2-w5-b78c31-kserve-5f4f9d4bb5-ss7g2"
Oct 31 17:40:45.045137 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:45.045050    5003 generic.go:356] "Generic (PLEG): container finished" podID="bd0dcfdf-0457-4f63-a89a-41733ac10ca9" containerID="20b0f24b4fae04407216857d8b4d5688951e298b4493792e86207328fe3fe7a5" exitCode=0
Oct 31 17:40:45.045304 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:45.045132    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-3e6bdf19-928d7" event={"ID":"bd0dcfdf-0457-4f63-a89a-41733ac10ca9","Type":"ContainerDied","Data":"20b0f24b4fae04407216857d8b4d5688951e298b4493792e86207328fe3fe7a5"}
Oct 31 17:40:45.066375 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:40:45.066341    5003 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9cc6d7e8_30de_4173_9974_1f1a4fd08e1c.slice/crio-6686b395eb38b9065e585574a85284f819784a6eb0db69fe31c839be238e88bd WatchSource:0}: Error finding container 6686b395eb38b9065e585574a85284f819784a6eb0db69fe31c839be238e88bd: Status 404 returned error can't find the container with id 6686b395eb38b9065e585574a85284f819784a6eb0db69fe31c839be238e88bd
Oct 31 17:40:45.075747 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:45.075725    5003 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w5-b78c31/distinct-2-w5-b78c31-kserve-5f4f9d4bb5-ss7g2"]
Oct 31 17:40:46.055029 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:46.054990    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w5-b78c31/distinct-2-w5-b78c31-kserve-5f4f9d4bb5-ss7g2" event={"ID":"9cc6d7e8-30de-4173-9974-1f1a4fd08e1c","Type":"ContainerStarted","Data":"d5784dbef515bf6d57b395bed5f0579e48dc680622a22131fbee541d3795ea23"}
Oct 31 17:40:46.055482 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:46.055042    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w5-b78c31/distinct-2-w5-b78c31-kserve-5f4f9d4bb5-ss7g2" event={"ID":"9cc6d7e8-30de-4173-9974-1f1a4fd08e1c","Type":"ContainerStarted","Data":"6686b395eb38b9065e585574a85284f819784a6eb0db69fe31c839be238e88bd"}
Oct 31 17:40:46.095916 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:46.095863    5003 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w5-b78c31/distinct-2-w5-b78c31-kserve-5f4f9d4bb5-ss7g2" podStartSLOduration=2.09584871 podStartE2EDuration="2.09584871s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 17:40:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 17:40:46.091558134 +0000 UTC m=+814.346412677" watchObservedRunningTime="2026-10-31 17:40:46.09584871 +0000 UTC m=+814.350703251"
Oct 31 17:40:46.213424 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:46.213388    5003 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-3e6bdf19-928d7"
Oct 31 17:40:46.309502 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:46.309466    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/bd0dcfdf-0457-4f63-a89a-41733ac10ca9-kube-api-access-fv55p\" (UniqueName: \"kubernetes.io/projected/bd0dcfdf-0457-4f63-a89a-41733ac10ca9-kube-api-access-fv55p\") pod \"bd0dcfdf-0457-4f63-a89a-41733ac10ca9\" (UID: \"bd0dcfdf-0457-4f63-a89a-41733ac10ca9\") "
Oct 31 17:40:46.309775 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:46.309546    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/bd0dcfdf-0457-4f63-a89a-41733ac10ca9-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/bd0dcfdf-0457-4f63-a89a-41733ac10ca9-maas-api-xks-ca\") pod \"bd0dcfdf-0457-4f63-a89a-41733ac10ca9\" (UID: \"bd0dcfdf-0457-4f63-a89a-41733ac10ca9\") "
Oct 31 17:40:46.309775 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:46.309594    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/bd0dcfdf-0457-4f63-a89a-41733ac10ca9-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/bd0dcfdf-0457-4f63-a89a-41733ac10ca9-maas-api-openshift-ca\") pod \"bd0dcfdf-0457-4f63-a89a-41733ac10ca9\" (UID: \"bd0dcfdf-0457-4f63-a89a-41733ac10ca9\") "
Oct 31 17:40:46.310062 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:46.310035    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bd0dcfdf-0457-4f63-a89a-41733ac10ca9-maas-api-openshift-ca" pod "bd0dcfdf-0457-4f63-a89a-41733ac10ca9" (UID: "bd0dcfdf-0457-4f63-a89a-41733ac10ca9"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 17:40:46.310589 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:46.310541    5003 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/bd0dcfdf-0457-4f63-a89a-41733ac10ca9-maas-api-openshift-ca\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:40:46.312070 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:46.312047    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bd0dcfdf-0457-4f63-a89a-41733ac10ca9-maas-api-xks-ca" pod "bd0dcfdf-0457-4f63-a89a-41733ac10ca9" (UID: "bd0dcfdf-0457-4f63-a89a-41733ac10ca9"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 17:40:46.312766 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:46.312738    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bd0dcfdf-0457-4f63-a89a-41733ac10ca9-kube-api-access-fv55p" pod "bd0dcfdf-0457-4f63-a89a-41733ac10ca9" (UID: "bd0dcfdf-0457-4f63-a89a-41733ac10ca9"). InnerVolumeSpecName "kube-api-access-fv55p". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 17:40:46.412147 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:46.412113    5003 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fv55p\" (UniqueName: \"kubernetes.io/projected/bd0dcfdf-0457-4f63-a89a-41733ac10ca9-kube-api-access-fv55p\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:40:46.412147 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:46.412143    5003 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/bd0dcfdf-0457-4f63-a89a-41733ac10ca9-maas-api-xks-ca\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:40:46.639835 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:46.639754    5003 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w4-1c0bfd-openshift-default-f7f657c57-wxm7h"]
Oct 31 17:40:46.640358 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:46.640344    5003 cpu_manager.go:414] "containerMap: removing container" podUID="bd0dcfdf-0457-4f63-a89a-41733ac10ca9" containerName="revoke-keys"
Oct 31 17:40:46.640404 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:46.640360    5003 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="bd0dcfdf-0457-4f63-a89a-41733ac10ca9" containerName="revoke-keys"
Oct 31 17:40:46.640488 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:46.640479    5003 memory_manager.go:365] "RemoveStaleState removing state" podUID="bd0dcfdf-0457-4f63-a89a-41733ac10ca9" containerName="revoke-keys"
Oct 31 17:40:46.644260 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:46.644242    5003 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-1c0bfd-openshift-default-f7f657c57-wxm7h"
Oct 31 17:40:46.675958 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:46.675927    5003 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-1c0bfd-openshift-default-f7f657c57-wxm7h"]
Oct 31 17:40:46.757807 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:46.757775    5003 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w5-b78c31/distinct-2-w5-b78c31-kserve-5f4f9d4bb5-ss7g2"
Oct 31 17:40:46.819328 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:46.819283    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/92a031e7-6d59-4493-b15d-7dc213289f55-istiod-ca-cert\") pod \"e2e-worker-w4-1c0bfd-openshift-default-f7f657c57-wxm7h\" (UID: \"92a031e7-6d59-4493-b15d-7dc213289f55\") " pod="openshift-ingress/e2e-worker-w4-1c0bfd-openshift-default-f7f657c57-wxm7h"
Oct 31 17:40:46.819517 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:46.819350    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/92a031e7-6d59-4493-b15d-7dc213289f55-istio-token\") pod \"e2e-worker-w4-1c0bfd-openshift-default-f7f657c57-wxm7h\" (UID: \"92a031e7-6d59-4493-b15d-7dc213289f55\") " pod="openshift-ingress/e2e-worker-w4-1c0bfd-openshift-default-f7f657c57-wxm7h"
Oct 31 17:40:46.819517 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:46.819441    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lzs42\" (UniqueName: \"kubernetes.io/projected/92a031e7-6d59-4493-b15d-7dc213289f55-kube-api-access-lzs42\") pod \"e2e-worker-w4-1c0bfd-openshift-default-f7f657c57-wxm7h\" (UID: \"92a031e7-6d59-4493-b15d-7dc213289f55\") " pod="openshift-ingress/e2e-worker-w4-1c0bfd-openshift-default-f7f657c57-wxm7h"
Oct 31 17:40:46.819517 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:46.819485    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/92a031e7-6d59-4493-b15d-7dc213289f55-istio-envoy\") pod \"e2e-worker-w4-1c0bfd-openshift-default-f7f657c57-wxm7h\" (UID: \"92a031e7-6d59-4493-b15d-7dc213289f55\") " pod="openshift-ingress/e2e-worker-w4-1c0bfd-openshift-default-f7f657c57-wxm7h"
Oct 31 17:40:46.824793 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:46.824754    5003 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w6-d80080-openshift-default-956cddf57-rdglw"]
Oct 31 17:40:46.826628 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:46.819533    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/92a031e7-6d59-4493-b15d-7dc213289f55-credential-socket\") pod \"e2e-worker-w4-1c0bfd-openshift-default-f7f657c57-wxm7h\" (UID: \"92a031e7-6d59-4493-b15d-7dc213289f55\") " pod="openshift-ingress/e2e-worker-w4-1c0bfd-openshift-default-f7f657c57-wxm7h"
Oct 31 17:40:46.827039 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:46.827015    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/92a031e7-6d59-4493-b15d-7dc213289f55-workload-certs\") pod \"e2e-worker-w4-1c0bfd-openshift-default-f7f657c57-wxm7h\" (UID: \"92a031e7-6d59-4493-b15d-7dc213289f55\") " pod="openshift-ingress/e2e-worker-w4-1c0bfd-openshift-default-f7f657c57-wxm7h"
Oct 31 17:40:46.827300 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:46.827274    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/92a031e7-6d59-4493-b15d-7dc213289f55-istio-podinfo\") pod \"e2e-worker-w4-1c0bfd-openshift-default-f7f657c57-wxm7h\" (UID: \"92a031e7-6d59-4493-b15d-7dc213289f55\") " pod="openshift-ingress/e2e-worker-w4-1c0bfd-openshift-default-f7f657c57-wxm7h"
Oct 31 17:40:46.827450 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:46.827421    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/92a031e7-6d59-4493-b15d-7dc213289f55-istio-data\") pod \"e2e-worker-w4-1c0bfd-openshift-default-f7f657c57-wxm7h\" (UID: \"92a031e7-6d59-4493-b15d-7dc213289f55\") " pod="openshift-ingress/e2e-worker-w4-1c0bfd-openshift-default-f7f657c57-wxm7h"
Oct 31 17:40:46.827510 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:46.827490    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/92a031e7-6d59-4493-b15d-7dc213289f55-workload-socket\") pod \"e2e-worker-w4-1c0bfd-openshift-default-f7f657c57-wxm7h\" (UID: \"92a031e7-6d59-4493-b15d-7dc213289f55\") " pod="openshift-ingress/e2e-worker-w4-1c0bfd-openshift-default-f7f657c57-wxm7h"
Oct 31 17:40:46.832684 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:46.831072    5003 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-d80080-openshift-default-956cddf57-rdglw"
Oct 31 17:40:46.847688 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:46.847276    5003 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w6-d80080-openshift-default-956cddf57-rdglw"]
Oct 31 17:40:46.928299 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:46.928208    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/92a031e7-6d59-4493-b15d-7dc213289f55-istio-podinfo\") pod \"e2e-worker-w4-1c0bfd-openshift-default-f7f657c57-wxm7h\" (UID: \"92a031e7-6d59-4493-b15d-7dc213289f55\") " pod="openshift-ingress/e2e-worker-w4-1c0bfd-openshift-default-f7f657c57-wxm7h"
Oct 31 17:40:46.928299 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:46.928280    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/92a031e7-6d59-4493-b15d-7dc213289f55-istio-data\") pod \"e2e-worker-w4-1c0bfd-openshift-default-f7f657c57-wxm7h\" (UID: \"92a031e7-6d59-4493-b15d-7dc213289f55\") " pod="openshift-ingress/e2e-worker-w4-1c0bfd-openshift-default-f7f657c57-wxm7h"
Oct 31 17:40:46.928527 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:46.928301    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/eeb8afc2-1a66-4c38-9fb3-04ccd09083a2-workload-certs\") pod \"e2e-worker-w6-d80080-openshift-default-956cddf57-rdglw\" (UID: \"eeb8afc2-1a66-4c38-9fb3-04ccd09083a2\") " pod="openshift-ingress/e2e-worker-w6-d80080-openshift-default-956cddf57-rdglw"
Oct 31 17:40:46.928527 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:46.928337    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/eeb8afc2-1a66-4c38-9fb3-04ccd09083a2-istiod-ca-cert\") pod \"e2e-worker-w6-d80080-openshift-default-956cddf57-rdglw\" (UID: \"eeb8afc2-1a66-4c38-9fb3-04ccd09083a2\") " pod="openshift-ingress/e2e-worker-w6-d80080-openshift-default-956cddf57-rdglw"
Oct 31 17:40:46.928527 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:46.928363    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/92a031e7-6d59-4493-b15d-7dc213289f55-workload-socket\") pod \"e2e-worker-w4-1c0bfd-openshift-default-f7f657c57-wxm7h\" (UID: \"92a031e7-6d59-4493-b15d-7dc213289f55\") " pod="openshift-ingress/e2e-worker-w4-1c0bfd-openshift-default-f7f657c57-wxm7h"
Oct 31 17:40:46.928527 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:46.928426    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/eeb8afc2-1a66-4c38-9fb3-04ccd09083a2-workload-socket\") pod \"e2e-worker-w6-d80080-openshift-default-956cddf57-rdglw\" (UID: \"eeb8afc2-1a66-4c38-9fb3-04ccd09083a2\") " pod="openshift-ingress/e2e-worker-w6-d80080-openshift-default-956cddf57-rdglw"
Oct 31 17:40:46.928527 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:46.928470    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/92a031e7-6d59-4493-b15d-7dc213289f55-istiod-ca-cert\") pod \"e2e-worker-w4-1c0bfd-openshift-default-f7f657c57-wxm7h\" (UID: \"92a031e7-6d59-4493-b15d-7dc213289f55\") " pod="openshift-ingress/e2e-worker-w4-1c0bfd-openshift-default-f7f657c57-wxm7h"
Oct 31 17:40:46.928527 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:46.928504    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/92a031e7-6d59-4493-b15d-7dc213289f55-istio-token\") pod \"e2e-worker-w4-1c0bfd-openshift-default-f7f657c57-wxm7h\" (UID: \"92a031e7-6d59-4493-b15d-7dc213289f55\") " pod="openshift-ingress/e2e-worker-w4-1c0bfd-openshift-default-f7f657c57-wxm7h"
Oct 31 17:40:46.928846 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:46.928595    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lzs42\" (UniqueName: \"kubernetes.io/projected/92a031e7-6d59-4493-b15d-7dc213289f55-kube-api-access-lzs42\") pod \"e2e-worker-w4-1c0bfd-openshift-default-f7f657c57-wxm7h\" (UID: \"92a031e7-6d59-4493-b15d-7dc213289f55\") " pod="openshift-ingress/e2e-worker-w4-1c0bfd-openshift-default-f7f657c57-wxm7h"
Oct 31 17:40:46.928846 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:46.928624    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/eeb8afc2-1a66-4c38-9fb3-04ccd09083a2-istio-data\") pod \"e2e-worker-w6-d80080-openshift-default-956cddf57-rdglw\" (UID: \"eeb8afc2-1a66-4c38-9fb3-04ccd09083a2\") " pod="openshift-ingress/e2e-worker-w6-d80080-openshift-default-956cddf57-rdglw"
Oct 31 17:40:46.928846 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:46.928673    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/eeb8afc2-1a66-4c38-9fb3-04ccd09083a2-credential-socket\") pod \"e2e-worker-w6-d80080-openshift-default-956cddf57-rdglw\" (UID: \"eeb8afc2-1a66-4c38-9fb3-04ccd09083a2\") " pod="openshift-ingress/e2e-worker-w6-d80080-openshift-default-956cddf57-rdglw"
Oct 31 17:40:46.928846 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:46.928708    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/92a031e7-6d59-4493-b15d-7dc213289f55-istio-envoy\") pod \"e2e-worker-w4-1c0bfd-openshift-default-f7f657c57-wxm7h\" (UID: \"92a031e7-6d59-4493-b15d-7dc213289f55\") " pod="openshift-ingress/e2e-worker-w4-1c0bfd-openshift-default-f7f657c57-wxm7h"
Oct 31 17:40:46.928846 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:46.928725    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/92a031e7-6d59-4493-b15d-7dc213289f55-istio-data\") pod \"e2e-worker-w4-1c0bfd-openshift-default-f7f657c57-wxm7h\" (UID: \"92a031e7-6d59-4493-b15d-7dc213289f55\") " pod="openshift-ingress/e2e-worker-w4-1c0bfd-openshift-default-f7f657c57-wxm7h"
Oct 31 17:40:46.928846 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:46.928736    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/eeb8afc2-1a66-4c38-9fb3-04ccd09083a2-istio-envoy\") pod \"e2e-worker-w6-d80080-openshift-default-956cddf57-rdglw\" (UID: \"eeb8afc2-1a66-4c38-9fb3-04ccd09083a2\") " pod="openshift-ingress/e2e-worker-w6-d80080-openshift-default-956cddf57-rdglw"
Oct 31 17:40:46.928846 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:46.928749    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/92a031e7-6d59-4493-b15d-7dc213289f55-workload-socket\") pod \"e2e-worker-w4-1c0bfd-openshift-default-f7f657c57-wxm7h\" (UID: \"92a031e7-6d59-4493-b15d-7dc213289f55\") " pod="openshift-ingress/e2e-worker-w4-1c0bfd-openshift-default-f7f657c57-wxm7h"
Oct 31 17:40:46.928846 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:46.928802    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/eeb8afc2-1a66-4c38-9fb3-04ccd09083a2-istio-podinfo\") pod \"e2e-worker-w6-d80080-openshift-default-956cddf57-rdglw\" (UID: \"eeb8afc2-1a66-4c38-9fb3-04ccd09083a2\") " pod="openshift-ingress/e2e-worker-w6-d80080-openshift-default-956cddf57-rdglw"
Oct 31 17:40:46.929221 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:46.928980    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bbd9f\" (UniqueName: \"kubernetes.io/projected/eeb8afc2-1a66-4c38-9fb3-04ccd09083a2-kube-api-access-bbd9f\") pod \"e2e-worker-w6-d80080-openshift-default-956cddf57-rdglw\" (UID: \"eeb8afc2-1a66-4c38-9fb3-04ccd09083a2\") " pod="openshift-ingress/e2e-worker-w6-d80080-openshift-default-956cddf57-rdglw"
Oct 31 17:40:46.929221 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:46.929053    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/92a031e7-6d59-4493-b15d-7dc213289f55-credential-socket\") pod \"e2e-worker-w4-1c0bfd-openshift-default-f7f657c57-wxm7h\" (UID: \"92a031e7-6d59-4493-b15d-7dc213289f55\") " pod="openshift-ingress/e2e-worker-w4-1c0bfd-openshift-default-f7f657c57-wxm7h"
Oct 31 17:40:46.929221 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:46.929133    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/92a031e7-6d59-4493-b15d-7dc213289f55-workload-certs\") pod \"e2e-worker-w4-1c0bfd-openshift-default-f7f657c57-wxm7h\" (UID: \"92a031e7-6d59-4493-b15d-7dc213289f55\") " pod="openshift-ingress/e2e-worker-w4-1c0bfd-openshift-default-f7f657c57-wxm7h"
Oct 31 17:40:46.929221 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:46.929192    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/92a031e7-6d59-4493-b15d-7dc213289f55-istiod-ca-cert\") pod \"e2e-worker-w4-1c0bfd-openshift-default-f7f657c57-wxm7h\" (UID: \"92a031e7-6d59-4493-b15d-7dc213289f55\") " pod="openshift-ingress/e2e-worker-w4-1c0bfd-openshift-default-f7f657c57-wxm7h"
Oct 31 17:40:46.929407 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:46.929224    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/eeb8afc2-1a66-4c38-9fb3-04ccd09083a2-istio-token\") pod \"e2e-worker-w6-d80080-openshift-default-956cddf57-rdglw\" (UID: \"eeb8afc2-1a66-4c38-9fb3-04ccd09083a2\") " pod="openshift-ingress/e2e-worker-w6-d80080-openshift-default-956cddf57-rdglw"
Oct 31 17:40:46.929407 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:46.929382    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/92a031e7-6d59-4493-b15d-7dc213289f55-credential-socket\") pod \"e2e-worker-w4-1c0bfd-openshift-default-f7f657c57-wxm7h\" (UID: \"92a031e7-6d59-4493-b15d-7dc213289f55\") " pod="openshift-ingress/e2e-worker-w4-1c0bfd-openshift-default-f7f657c57-wxm7h"
Oct 31 17:40:46.929484 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:46.929455    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/92a031e7-6d59-4493-b15d-7dc213289f55-workload-certs\") pod \"e2e-worker-w4-1c0bfd-openshift-default-f7f657c57-wxm7h\" (UID: \"92a031e7-6d59-4493-b15d-7dc213289f55\") " pod="openshift-ingress/e2e-worker-w4-1c0bfd-openshift-default-f7f657c57-wxm7h"
Oct 31 17:40:46.930950 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:46.930933    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/92a031e7-6d59-4493-b15d-7dc213289f55-istio-envoy\") pod \"e2e-worker-w4-1c0bfd-openshift-default-f7f657c57-wxm7h\" (UID: \"92a031e7-6d59-4493-b15d-7dc213289f55\") " pod="openshift-ingress/e2e-worker-w4-1c0bfd-openshift-default-f7f657c57-wxm7h"
Oct 31 17:40:46.931009 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:46.930985    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/92a031e7-6d59-4493-b15d-7dc213289f55-istio-podinfo\") pod \"e2e-worker-w4-1c0bfd-openshift-default-f7f657c57-wxm7h\" (UID: \"92a031e7-6d59-4493-b15d-7dc213289f55\") " pod="openshift-ingress/e2e-worker-w4-1c0bfd-openshift-default-f7f657c57-wxm7h"
Oct 31 17:40:46.946234 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:46.946207    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/92a031e7-6d59-4493-b15d-7dc213289f55-istio-token\") pod \"e2e-worker-w4-1c0bfd-openshift-default-f7f657c57-wxm7h\" (UID: \"92a031e7-6d59-4493-b15d-7dc213289f55\") " pod="openshift-ingress/e2e-worker-w4-1c0bfd-openshift-default-f7f657c57-wxm7h"
Oct 31 17:40:46.946571 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:46.946554    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lzs42\" (UniqueName: \"kubernetes.io/projected/92a031e7-6d59-4493-b15d-7dc213289f55-kube-api-access-lzs42\") pod \"e2e-worker-w4-1c0bfd-openshift-default-f7f657c57-wxm7h\" (UID: \"92a031e7-6d59-4493-b15d-7dc213289f55\") " pod="openshift-ingress/e2e-worker-w4-1c0bfd-openshift-default-f7f657c57-wxm7h"
Oct 31 17:40:46.959403 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:46.959383    5003 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-1c0bfd-openshift-default-f7f657c57-wxm7h"
Oct 31 17:40:47.032055 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:47.031337    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/eeb8afc2-1a66-4c38-9fb3-04ccd09083a2-istio-podinfo\") pod \"e2e-worker-w6-d80080-openshift-default-956cddf57-rdglw\" (UID: \"eeb8afc2-1a66-4c38-9fb3-04ccd09083a2\") " pod="openshift-ingress/e2e-worker-w6-d80080-openshift-default-956cddf57-rdglw"
Oct 31 17:40:47.032055 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:47.031406    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bbd9f\" (UniqueName: \"kubernetes.io/projected/eeb8afc2-1a66-4c38-9fb3-04ccd09083a2-kube-api-access-bbd9f\") pod \"e2e-worker-w6-d80080-openshift-default-956cddf57-rdglw\" (UID: \"eeb8afc2-1a66-4c38-9fb3-04ccd09083a2\") " pod="openshift-ingress/e2e-worker-w6-d80080-openshift-default-956cddf57-rdglw"
Oct 31 17:40:47.032055 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:47.031536    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/eeb8afc2-1a66-4c38-9fb3-04ccd09083a2-istio-token\") pod \"e2e-worker-w6-d80080-openshift-default-956cddf57-rdglw\" (UID: \"eeb8afc2-1a66-4c38-9fb3-04ccd09083a2\") " pod="openshift-ingress/e2e-worker-w6-d80080-openshift-default-956cddf57-rdglw"
Oct 31 17:40:47.032055 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:47.031697    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/eeb8afc2-1a66-4c38-9fb3-04ccd09083a2-workload-certs\") pod \"e2e-worker-w6-d80080-openshift-default-956cddf57-rdglw\" (UID: \"eeb8afc2-1a66-4c38-9fb3-04ccd09083a2\") " pod="openshift-ingress/e2e-worker-w6-d80080-openshift-default-956cddf57-rdglw"
Oct 31 17:40:47.032055 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:47.031756    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/eeb8afc2-1a66-4c38-9fb3-04ccd09083a2-istiod-ca-cert\") pod \"e2e-worker-w6-d80080-openshift-default-956cddf57-rdglw\" (UID: \"eeb8afc2-1a66-4c38-9fb3-04ccd09083a2\") " pod="openshift-ingress/e2e-worker-w6-d80080-openshift-default-956cddf57-rdglw"
Oct 31 17:40:47.032055 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:47.031802    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/eeb8afc2-1a66-4c38-9fb3-04ccd09083a2-workload-socket\") pod \"e2e-worker-w6-d80080-openshift-default-956cddf57-rdglw\" (UID: \"eeb8afc2-1a66-4c38-9fb3-04ccd09083a2\") " pod="openshift-ingress/e2e-worker-w6-d80080-openshift-default-956cddf57-rdglw"
Oct 31 17:40:47.032055 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:47.031908    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/eeb8afc2-1a66-4c38-9fb3-04ccd09083a2-istio-data\") pod \"e2e-worker-w6-d80080-openshift-default-956cddf57-rdglw\" (UID: \"eeb8afc2-1a66-4c38-9fb3-04ccd09083a2\") " pod="openshift-ingress/e2e-worker-w6-d80080-openshift-default-956cddf57-rdglw"
Oct 31 17:40:47.032055 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:47.031942    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/eeb8afc2-1a66-4c38-9fb3-04ccd09083a2-credential-socket\") pod \"e2e-worker-w6-d80080-openshift-default-956cddf57-rdglw\" (UID: \"eeb8afc2-1a66-4c38-9fb3-04ccd09083a2\") " pod="openshift-ingress/e2e-worker-w6-d80080-openshift-default-956cddf57-rdglw"
Oct 31 17:40:47.032581 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:47.032452    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/eeb8afc2-1a66-4c38-9fb3-04ccd09083a2-workload-certs\") pod \"e2e-worker-w6-d80080-openshift-default-956cddf57-rdglw\" (UID: \"eeb8afc2-1a66-4c38-9fb3-04ccd09083a2\") " pod="openshift-ingress/e2e-worker-w6-d80080-openshift-default-956cddf57-rdglw"
Oct 31 17:40:47.032712 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:47.032682    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/eeb8afc2-1a66-4c38-9fb3-04ccd09083a2-istio-envoy\") pod \"e2e-worker-w6-d80080-openshift-default-956cddf57-rdglw\" (UID: \"eeb8afc2-1a66-4c38-9fb3-04ccd09083a2\") " pod="openshift-ingress/e2e-worker-w6-d80080-openshift-default-956cddf57-rdglw"
Oct 31 17:40:47.034014 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:47.033937    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/eeb8afc2-1a66-4c38-9fb3-04ccd09083a2-istio-data\") pod \"e2e-worker-w6-d80080-openshift-default-956cddf57-rdglw\" (UID: \"eeb8afc2-1a66-4c38-9fb3-04ccd09083a2\") " pod="openshift-ingress/e2e-worker-w6-d80080-openshift-default-956cddf57-rdglw"
Oct 31 17:40:47.034014 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:47.033943    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/eeb8afc2-1a66-4c38-9fb3-04ccd09083a2-istiod-ca-cert\") pod \"e2e-worker-w6-d80080-openshift-default-956cddf57-rdglw\" (UID: \"eeb8afc2-1a66-4c38-9fb3-04ccd09083a2\") " pod="openshift-ingress/e2e-worker-w6-d80080-openshift-default-956cddf57-rdglw"
Oct 31 17:40:47.034224 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:47.034180    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/eeb8afc2-1a66-4c38-9fb3-04ccd09083a2-credential-socket\") pod \"e2e-worker-w6-d80080-openshift-default-956cddf57-rdglw\" (UID: \"eeb8afc2-1a66-4c38-9fb3-04ccd09083a2\") " pod="openshift-ingress/e2e-worker-w6-d80080-openshift-default-956cddf57-rdglw"
Oct 31 17:40:47.034603 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:47.034577    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/eeb8afc2-1a66-4c38-9fb3-04ccd09083a2-workload-socket\") pod \"e2e-worker-w6-d80080-openshift-default-956cddf57-rdglw\" (UID: \"eeb8afc2-1a66-4c38-9fb3-04ccd09083a2\") " pod="openshift-ingress/e2e-worker-w6-d80080-openshift-default-956cddf57-rdglw"
Oct 31 17:40:47.035688 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:47.035618    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/eeb8afc2-1a66-4c38-9fb3-04ccd09083a2-istio-podinfo\") pod \"e2e-worker-w6-d80080-openshift-default-956cddf57-rdglw\" (UID: \"eeb8afc2-1a66-4c38-9fb3-04ccd09083a2\") " pod="openshift-ingress/e2e-worker-w6-d80080-openshift-default-956cddf57-rdglw"
Oct 31 17:40:47.035688 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:47.035634    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/eeb8afc2-1a66-4c38-9fb3-04ccd09083a2-istio-envoy\") pod \"e2e-worker-w6-d80080-openshift-default-956cddf57-rdglw\" (UID: \"eeb8afc2-1a66-4c38-9fb3-04ccd09083a2\") " pod="openshift-ingress/e2e-worker-w6-d80080-openshift-default-956cddf57-rdglw"
Oct 31 17:40:47.050531 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:47.050482    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/eeb8afc2-1a66-4c38-9fb3-04ccd09083a2-istio-token\") pod \"e2e-worker-w6-d80080-openshift-default-956cddf57-rdglw\" (UID: \"eeb8afc2-1a66-4c38-9fb3-04ccd09083a2\") " pod="openshift-ingress/e2e-worker-w6-d80080-openshift-default-956cddf57-rdglw"
Oct 31 17:40:47.052382 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:47.052361    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bbd9f\" (UniqueName: \"kubernetes.io/projected/eeb8afc2-1a66-4c38-9fb3-04ccd09083a2-kube-api-access-bbd9f\") pod \"e2e-worker-w6-d80080-openshift-default-956cddf57-rdglw\" (UID: \"eeb8afc2-1a66-4c38-9fb3-04ccd09083a2\") " pod="openshift-ingress/e2e-worker-w6-d80080-openshift-default-956cddf57-rdglw"
Oct 31 17:40:47.065107 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:47.065080    5003 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-3e6bdf19-928d7"
Oct 31 17:40:47.065493 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:47.065222    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-3e6bdf19-928d7" event={"ID":"bd0dcfdf-0457-4f63-a89a-41733ac10ca9","Type":"ContainerDied","Data":"d5089bae283f877862381bdf101474c03d3cfdf2fba54913b61f101ff1d4f7b7"}
Oct 31 17:40:47.065493 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:47.065269    5003 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d5089bae283f877862381bdf101474c03d3cfdf2fba54913b61f101ff1d4f7b7"
Oct 31 17:40:47.152559 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:47.152526    5003 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-d80080-openshift-default-956cddf57-rdglw"
Oct 31 17:40:47.282888 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:40:47.282856    5003 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod92a031e7_6d59_4493_b15d_7dc213289f55.slice/crio-0d8ed850f673b9785193c572a462913331d9f0244aaaf9d265a828037f0265cd WatchSource:0}: Error finding container 0d8ed850f673b9785193c572a462913331d9f0244aaaf9d265a828037f0265cd: Status 404 returned error can't find the container with id 0d8ed850f673b9785193c572a462913331d9f0244aaaf9d265a828037f0265cd
Oct 31 17:40:47.285408 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:47.285381    5003 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-1c0bfd-openshift-default-f7f657c57-wxm7h"]
Oct 31 17:40:47.286025 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:47.285992    5003 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Oct 31 17:40:47.286124 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:47.286077    5003 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Oct 31 17:40:47.286186 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:47.286125    5003 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Oct 31 17:40:47.460715 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:47.460686    5003 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w6-d80080-openshift-default-956cddf57-rdglw"]
Oct 31 17:40:47.463323 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:40:47.463290    5003 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeeb8afc2_1a66_4c38_9fb3_04ccd09083a2.slice/crio-1d0f7f5002977c44ed2bbf16139ffb1511ce6e250d55283e5cd12ae16469c630 WatchSource:0}: Error finding container 1d0f7f5002977c44ed2bbf16139ffb1511ce6e250d55283e5cd12ae16469c630: Status 404 returned error can't find the container with id 1d0f7f5002977c44ed2bbf16139ffb1511ce6e250d55283e5cd12ae16469c630
Oct 31 17:40:47.466346 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:47.466302    5003 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Oct 31 17:40:47.466443 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:47.466377    5003 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Oct 31 17:40:47.466443 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:47.466411    5003 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Oct 31 17:40:48.092478 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:48.092437    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-1c0bfd-openshift-default-f7f657c57-wxm7h" event={"ID":"92a031e7-6d59-4493-b15d-7dc213289f55","Type":"ContainerStarted","Data":"93e4421d727b7815d166afafabc67fa9fb7bb501d3b58c093af850d439339a81"}
Oct 31 17:40:48.093173 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:48.093147    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-1c0bfd-openshift-default-f7f657c57-wxm7h" event={"ID":"92a031e7-6d59-4493-b15d-7dc213289f55","Type":"ContainerStarted","Data":"0d8ed850f673b9785193c572a462913331d9f0244aaaf9d265a828037f0265cd"}
Oct 31 17:40:48.098045 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:48.098013    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-d80080-openshift-default-956cddf57-rdglw" event={"ID":"eeb8afc2-1a66-4c38-9fb3-04ccd09083a2","Type":"ContainerStarted","Data":"be1050371aa22276cd09f5b713b4e73dc04fb13672cd698f040abcd330a127b8"}
Oct 31 17:40:48.098277 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:48.098254    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-d80080-openshift-default-956cddf57-rdglw" event={"ID":"eeb8afc2-1a66-4c38-9fb3-04ccd09083a2","Type":"ContainerStarted","Data":"1d0f7f5002977c44ed2bbf16139ffb1511ce6e250d55283e5cd12ae16469c630"}
Oct 31 17:40:48.136788 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:48.136732    5003 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w4-1c0bfd-openshift-default-f7f657c57-wxm7h" podStartSLOduration=2.136717954 podStartE2EDuration="2.136717954s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 17:40:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 17:40:48.132861702 +0000 UTC m=+816.387716244" watchObservedRunningTime="2026-10-31 17:40:48.136717954 +0000 UTC m=+816.391572554"
Oct 31 17:40:48.179005 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:48.178961    5003 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w6-d80080-openshift-default-956cddf57-rdglw"
Oct 31 17:40:48.192669 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:48.179340    5003 patch_prober.go:29] interesting pod/e2e-worker-w6-d80080-openshift-default-956cddf57-rdglw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.101:15021/healthz/ready\": dial tcp 10.132.0.101:15021: connect: connection refused" start-of-body=
Oct 31 17:40:48.193001 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:48.192961    5003 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-d80080-openshift-default-956cddf57-rdglw" podUID="eeb8afc2-1a66-4c38-9fb3-04ccd09083a2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.101:15021/healthz/ready\": dial tcp 10.132.0.101:15021: connect: connection refused"
Oct 31 17:40:48.197666 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:48.174606    5003 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w6-d80080-openshift-default-956cddf57-rdglw" podStartSLOduration=2.174585851 podStartE2EDuration="2.174585851s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 17:40:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 17:40:48.171154799 +0000 UTC m=+816.426009370" watchObservedRunningTime="2026-10-31 17:40:48.174585851 +0000 UTC m=+816.429440394"
Oct 31 17:40:48.976668 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:48.975999    5003 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w4-1c0bfd-openshift-default-f7f657c57-wxm7h"
Oct 31 17:40:48.976668 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:48.976142    5003 patch_prober.go:29] interesting pod/e2e-worker-w4-1c0bfd-openshift-default-f7f657c57-wxm7h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.100:15021/healthz/ready\": dial tcp 10.132.0.100:15021: connect: connection refused" start-of-body=
Oct 31 17:40:48.976668 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:48.976186    5003 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-1c0bfd-openshift-default-f7f657c57-wxm7h" podUID="92a031e7-6d59-4493-b15d-7dc213289f55" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.100:15021/healthz/ready\": dial tcp 10.132.0.100:15021: connect: connection refused"
Oct 31 17:40:49.173731 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:49.173694    5003 patch_prober.go:29] interesting pod/e2e-worker-w6-d80080-openshift-default-956cddf57-rdglw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.101:15021/healthz/ready\": dial tcp 10.132.0.101:15021: connect: connection refused" start-of-body=
Oct 31 17:40:49.174334 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:49.174303    5003 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-d80080-openshift-default-956cddf57-rdglw" podUID="eeb8afc2-1a66-4c38-9fb3-04ccd09083a2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.101:15021/healthz/ready\": dial tcp 10.132.0.101:15021: connect: connection refused"
Oct 31 17:40:49.964671 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:49.961053    5003 patch_prober.go:29] interesting pod/e2e-worker-w4-1c0bfd-openshift-default-f7f657c57-wxm7h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.100:15021/healthz/ready\": dial tcp 10.132.0.100:15021: connect: connection refused" start-of-body=
Oct 31 17:40:49.964671 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:49.961112    5003 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-1c0bfd-openshift-default-f7f657c57-wxm7h" podUID="92a031e7-6d59-4493-b15d-7dc213289f55" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.100:15021/healthz/ready\": dial tcp 10.132.0.100:15021: connect: connection refused"
Oct 31 17:40:50.171670 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:50.165079    5003 patch_prober.go:29] interesting pod/e2e-worker-w6-d80080-openshift-default-956cddf57-rdglw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.101:15021/healthz/ready\": dial tcp 10.132.0.101:15021: connect: connection refused" start-of-body=
Oct 31 17:40:50.171670 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:50.165139    5003 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-d80080-openshift-default-956cddf57-rdglw" podUID="eeb8afc2-1a66-4c38-9fb3-04ccd09083a2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.101:15021/healthz/ready\": dial tcp 10.132.0.101:15021: connect: connection refused"
Oct 31 17:40:50.978669 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:50.975092    5003 patch_prober.go:29] interesting pod/e2e-worker-w4-1c0bfd-openshift-default-f7f657c57-wxm7h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.100:15021/healthz/ready\": dial tcp 10.132.0.100:15021: connect: connection refused" start-of-body=
Oct 31 17:40:50.978669 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:50.975156    5003 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-1c0bfd-openshift-default-f7f657c57-wxm7h" podUID="92a031e7-6d59-4493-b15d-7dc213289f55" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.100:15021/healthz/ready\": dial tcp 10.132.0.100:15021: connect: connection refused"
Oct 31 17:40:51.161670 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:51.161080    5003 patch_prober.go:29] interesting pod/e2e-worker-w6-d80080-openshift-default-956cddf57-rdglw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.101:15021/healthz/ready\": dial tcp 10.132.0.101:15021: connect: connection refused" start-of-body=
Oct 31 17:40:51.161670 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:51.161143    5003 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-d80080-openshift-default-956cddf57-rdglw" podUID="eeb8afc2-1a66-4c38-9fb3-04ccd09083a2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.101:15021/healthz/ready\": dial tcp 10.132.0.101:15021: connect: connection refused"
Oct 31 17:40:51.969671 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:51.966138    5003 patch_prober.go:29] interesting pod/e2e-worker-w4-1c0bfd-openshift-default-f7f657c57-wxm7h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.100:15021/healthz/ready\": dial tcp 10.132.0.100:15021: connect: connection refused" start-of-body=
Oct 31 17:40:51.969671 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:51.966209    5003 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-1c0bfd-openshift-default-f7f657c57-wxm7h" podUID="92a031e7-6d59-4493-b15d-7dc213289f55" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.100:15021/healthz/ready\": dial tcp 10.132.0.100:15021: connect: connection refused"
Oct 31 17:40:52.193668 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:52.192778    5003 patch_prober.go:29] interesting pod/e2e-worker-w6-d80080-openshift-default-956cddf57-rdglw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.101:15021/healthz/ready\": dial tcp 10.132.0.101:15021: connect: connection refused" start-of-body=
Oct 31 17:40:52.193668 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:52.192846    5003 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-d80080-openshift-default-956cddf57-rdglw" podUID="eeb8afc2-1a66-4c38-9fb3-04ccd09083a2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.101:15021/healthz/ready\": dial tcp 10.132.0.101:15021: connect: connection refused"
Oct 31 17:40:52.977669 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:52.973035    5003 patch_prober.go:29] interesting pod/e2e-worker-w4-1c0bfd-openshift-default-f7f657c57-wxm7h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.100:15021/healthz/ready\": dial tcp 10.132.0.100:15021: connect: connection refused" start-of-body=
Oct 31 17:40:52.977669 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:52.973102    5003 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-1c0bfd-openshift-default-f7f657c57-wxm7h" podUID="92a031e7-6d59-4493-b15d-7dc213289f55" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.100:15021/healthz/ready\": dial tcp 10.132.0.100:15021: connect: connection refused"
Oct 31 17:40:53.160793 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:53.160751    5003 patch_prober.go:29] interesting pod/e2e-worker-w6-d80080-openshift-default-956cddf57-rdglw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.101:15021/healthz/ready\": dial tcp 10.132.0.101:15021: connect: connection refused" start-of-body=
Oct 31 17:40:53.161056 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:53.161021    5003 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-d80080-openshift-default-956cddf57-rdglw" podUID="eeb8afc2-1a66-4c38-9fb3-04ccd09083a2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.101:15021/healthz/ready\": dial tcp 10.132.0.101:15021: connect: connection refused"
Oct 31 17:40:53.959904 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:53.959867    5003 patch_prober.go:29] interesting pod/e2e-worker-w4-1c0bfd-openshift-default-f7f657c57-wxm7h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.100:15021/healthz/ready\": dial tcp 10.132.0.100:15021: connect: connection refused" start-of-body=
Oct 31 17:40:53.960334 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:53.959923    5003 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-1c0bfd-openshift-default-f7f657c57-wxm7h" podUID="92a031e7-6d59-4493-b15d-7dc213289f55" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.100:15021/healthz/ready\": dial tcp 10.132.0.100:15021: connect: connection refused"
Oct 31 17:40:54.153407 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:54.153365    5003 patch_prober.go:29] interesting pod/e2e-worker-w6-d80080-openshift-default-956cddf57-rdglw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.101:15021/healthz/ready\": dial tcp 10.132.0.101:15021: connect: connection refused" start-of-body=
Oct 31 17:40:54.153610 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:54.153431    5003 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-d80080-openshift-default-956cddf57-rdglw" podUID="eeb8afc2-1a66-4c38-9fb3-04ccd09083a2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.101:15021/healthz/ready\": dial tcp 10.132.0.101:15021: connect: connection refused"
Oct 31 17:40:54.758930 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:54.758888    5003 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w5-b78c31/distinct-2-w5-b78c31-kserve-5f4f9d4bb5-ss7g2"
Oct 31 17:40:54.777873 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:54.777841    5003 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w5-b78c31/distinct-2-w5-b78c31-kserve-5f4f9d4bb5-ss7g2"
Oct 31 17:40:54.964759 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:54.964729    5003 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w4-1c0bfd-openshift-default-f7f657c57-wxm7h"
Oct 31 17:40:54.965196 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:54.965143    5003 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w4-1c0bfd-openshift-default-f7f657c57-wxm7h"
Oct 31 17:40:54.965872 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:54.965853    5003 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w4-1c0bfd-openshift-default-f7f657c57-wxm7h"
Oct 31 17:40:55.157570 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:55.157540    5003 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w6-d80080-openshift-default-956cddf57-rdglw"
Oct 31 17:40:55.158066 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:55.158043    5003 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w6-d80080-openshift-default-956cddf57-rdglw"
Oct 31 17:40:55.158914 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:55.158890    5003 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w6-d80080-openshift-default-956cddf57-rdglw"
Oct 31 17:40:55.183103 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:40:55.183068    5003 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w5-b78c31/distinct-2-w5-b78c31-kserve-5f4f9d4bb5-ss7g2"
Oct 31 17:41:02.174670 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:02.170752    5003 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w0-ee816e-openshift-default-c4db85b5c-j7pfz"]
Oct 31 17:41:02.806669 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:02.806211    5003 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-b78c31/simulator-w5-b78c31-kserve-95df74778-fpvpr" podUID="665d75c7-8ba5-49e1-87a7-51a18ae6f369" containerName="main" probeResult="failure" output="Get \"https://10.132.0.73:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 31 17:41:02.911971 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:02.911932    5003 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-ee816e-openshift-default-c4db85b5c-j7pfz"]
Oct 31 17:41:02.912217 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:02.912198    5003 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-mst4q"]
Oct 31 17:41:02.945672 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:02.917700    5003 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-ee816e-openshift-default-c4db85b5c-j7pfz"
Oct 31 17:41:03.009670 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:03.009498    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6c7cacb3-7045-4e9d-a2d6-9fabaa50af3d-istio-podinfo\") pod \"e2e-worker-w0-ee816e-openshift-default-c4db85b5c-j7pfz\" (UID: \"6c7cacb3-7045-4e9d-a2d6-9fabaa50af3d\") " pod="openshift-ingress/e2e-worker-w0-ee816e-openshift-default-c4db85b5c-j7pfz"
Oct 31 17:41:03.009670 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:03.009667    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6c7cacb3-7045-4e9d-a2d6-9fabaa50af3d-istio-token\") pod \"e2e-worker-w0-ee816e-openshift-default-c4db85b5c-j7pfz\" (UID: \"6c7cacb3-7045-4e9d-a2d6-9fabaa50af3d\") " pod="openshift-ingress/e2e-worker-w0-ee816e-openshift-default-c4db85b5c-j7pfz"
Oct 31 17:41:03.009910 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:03.009696    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9d2bq\" (UniqueName: \"kubernetes.io/projected/6c7cacb3-7045-4e9d-a2d6-9fabaa50af3d-kube-api-access-9d2bq\") pod \"e2e-worker-w0-ee816e-openshift-default-c4db85b5c-j7pfz\" (UID: \"6c7cacb3-7045-4e9d-a2d6-9fabaa50af3d\") " pod="openshift-ingress/e2e-worker-w0-ee816e-openshift-default-c4db85b5c-j7pfz"
Oct 31 17:41:03.009910 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:03.009778    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6c7cacb3-7045-4e9d-a2d6-9fabaa50af3d-istio-envoy\") pod \"e2e-worker-w0-ee816e-openshift-default-c4db85b5c-j7pfz\" (UID: \"6c7cacb3-7045-4e9d-a2d6-9fabaa50af3d\") " pod="openshift-ingress/e2e-worker-w0-ee816e-openshift-default-c4db85b5c-j7pfz"
Oct 31 17:41:03.009910 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:03.009844    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6c7cacb3-7045-4e9d-a2d6-9fabaa50af3d-istio-data\") pod \"e2e-worker-w0-ee816e-openshift-default-c4db85b5c-j7pfz\" (UID: \"6c7cacb3-7045-4e9d-a2d6-9fabaa50af3d\") " pod="openshift-ingress/e2e-worker-w0-ee816e-openshift-default-c4db85b5c-j7pfz"
Oct 31 17:41:03.010118 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:03.009929    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6c7cacb3-7045-4e9d-a2d6-9fabaa50af3d-credential-socket\") pod \"e2e-worker-w0-ee816e-openshift-default-c4db85b5c-j7pfz\" (UID: \"6c7cacb3-7045-4e9d-a2d6-9fabaa50af3d\") " pod="openshift-ingress/e2e-worker-w0-ee816e-openshift-default-c4db85b5c-j7pfz"
Oct 31 17:41:03.010118 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:03.010050    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6c7cacb3-7045-4e9d-a2d6-9fabaa50af3d-workload-socket\") pod \"e2e-worker-w0-ee816e-openshift-default-c4db85b5c-j7pfz\" (UID: \"6c7cacb3-7045-4e9d-a2d6-9fabaa50af3d\") " pod="openshift-ingress/e2e-worker-w0-ee816e-openshift-default-c4db85b5c-j7pfz"
Oct 31 17:41:03.010228 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:03.010188    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6c7cacb3-7045-4e9d-a2d6-9fabaa50af3d-istiod-ca-cert\") pod \"e2e-worker-w0-ee816e-openshift-default-c4db85b5c-j7pfz\" (UID: \"6c7cacb3-7045-4e9d-a2d6-9fabaa50af3d\") " pod="openshift-ingress/e2e-worker-w0-ee816e-openshift-default-c4db85b5c-j7pfz"
Oct 31 17:41:03.010290 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:03.010263    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6c7cacb3-7045-4e9d-a2d6-9fabaa50af3d-workload-certs\") pod \"e2e-worker-w0-ee816e-openshift-default-c4db85b5c-j7pfz\" (UID: \"6c7cacb3-7045-4e9d-a2d6-9fabaa50af3d\") " pod="openshift-ingress/e2e-worker-w0-ee816e-openshift-default-c4db85b5c-j7pfz"
Oct 31 17:41:03.023325 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:03.023280    5003 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-5c446c/premium-w2-5c446c-kserve-66f7486c85-f7lk2" podUID="9c2ddfab-2348-4bb0-8844-1fca62460390" containerName="main" probeResult="failure" output="Get \"https://10.132.0.75:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 31 17:41:03.039694 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:03.039577    5003 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-mst4q"]
Oct 31 17:41:03.039865 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:03.039749    5003 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-mst4q"
Oct 31 17:41:03.094692 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:03.089244    5003 prober.go:122] "Probe failed" probeType="Liveness" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-82w89" podUID="ef5a065b-f98e-4d14-810f-2d0c42c58ce6" containerName="main" probeResult="failure" output="Get \"https://10.132.0.54:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 31 17:41:03.119046 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:03.112958    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fa5b3d0d-4ae9-4f60-8af5-571df26ba157-workload-certs\") pod \"e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-mst4q\" (UID: \"fa5b3d0d-4ae9-4f60-8af5-571df26ba157\") " pod="openshift-ingress/e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-mst4q"
Oct 31 17:41:03.119046 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:03.113020    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6c7cacb3-7045-4e9d-a2d6-9fabaa50af3d-istio-envoy\") pod \"e2e-worker-w0-ee816e-openshift-default-c4db85b5c-j7pfz\" (UID: \"6c7cacb3-7045-4e9d-a2d6-9fabaa50af3d\") " pod="openshift-ingress/e2e-worker-w0-ee816e-openshift-default-c4db85b5c-j7pfz"
Oct 31 17:41:03.119046 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:03.113052    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pf5kr\" (UniqueName: \"kubernetes.io/projected/fa5b3d0d-4ae9-4f60-8af5-571df26ba157-kube-api-access-pf5kr\") pod \"e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-mst4q\" (UID: \"fa5b3d0d-4ae9-4f60-8af5-571df26ba157\") " pod="openshift-ingress/e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-mst4q"
Oct 31 17:41:03.119046 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:03.113101    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6c7cacb3-7045-4e9d-a2d6-9fabaa50af3d-istio-data\") pod \"e2e-worker-w0-ee816e-openshift-default-c4db85b5c-j7pfz\" (UID: \"6c7cacb3-7045-4e9d-a2d6-9fabaa50af3d\") " pod="openshift-ingress/e2e-worker-w0-ee816e-openshift-default-c4db85b5c-j7pfz"
Oct 31 17:41:03.119046 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:03.113135    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fa5b3d0d-4ae9-4f60-8af5-571df26ba157-istio-envoy\") pod \"e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-mst4q\" (UID: \"fa5b3d0d-4ae9-4f60-8af5-571df26ba157\") " pod="openshift-ingress/e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-mst4q"
Oct 31 17:41:03.119046 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:03.113179    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6c7cacb3-7045-4e9d-a2d6-9fabaa50af3d-credential-socket\") pod \"e2e-worker-w0-ee816e-openshift-default-c4db85b5c-j7pfz\" (UID: \"6c7cacb3-7045-4e9d-a2d6-9fabaa50af3d\") " pod="openshift-ingress/e2e-worker-w0-ee816e-openshift-default-c4db85b5c-j7pfz"
Oct 31 17:41:03.119046 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:03.113257    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fa5b3d0d-4ae9-4f60-8af5-571df26ba157-credential-socket\") pod \"e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-mst4q\" (UID: \"fa5b3d0d-4ae9-4f60-8af5-571df26ba157\") " pod="openshift-ingress/e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-mst4q"
Oct 31 17:41:03.119046 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:03.113304    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6c7cacb3-7045-4e9d-a2d6-9fabaa50af3d-workload-socket\") pod \"e2e-worker-w0-ee816e-openshift-default-c4db85b5c-j7pfz\" (UID: \"6c7cacb3-7045-4e9d-a2d6-9fabaa50af3d\") " pod="openshift-ingress/e2e-worker-w0-ee816e-openshift-default-c4db85b5c-j7pfz"
Oct 31 17:41:03.119046 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:03.113370    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fa5b3d0d-4ae9-4f60-8af5-571df26ba157-workload-socket\") pod \"e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-mst4q\" (UID: \"fa5b3d0d-4ae9-4f60-8af5-571df26ba157\") " pod="openshift-ingress/e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-mst4q"
Oct 31 17:41:03.119046 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:03.113448    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fa5b3d0d-4ae9-4f60-8af5-571df26ba157-istio-token\") pod \"e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-mst4q\" (UID: \"fa5b3d0d-4ae9-4f60-8af5-571df26ba157\") " pod="openshift-ingress/e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-mst4q"
Oct 31 17:41:03.119046 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:03.113484    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6c7cacb3-7045-4e9d-a2d6-9fabaa50af3d-istiod-ca-cert\") pod \"e2e-worker-w0-ee816e-openshift-default-c4db85b5c-j7pfz\" (UID: \"6c7cacb3-7045-4e9d-a2d6-9fabaa50af3d\") " pod="openshift-ingress/e2e-worker-w0-ee816e-openshift-default-c4db85b5c-j7pfz"
Oct 31 17:41:03.119046 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:03.113532    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6c7cacb3-7045-4e9d-a2d6-9fabaa50af3d-workload-certs\") pod \"e2e-worker-w0-ee816e-openshift-default-c4db85b5c-j7pfz\" (UID: \"6c7cacb3-7045-4e9d-a2d6-9fabaa50af3d\") " pod="openshift-ingress/e2e-worker-w0-ee816e-openshift-default-c4db85b5c-j7pfz"
Oct 31 17:41:03.119046 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:03.113585    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6c7cacb3-7045-4e9d-a2d6-9fabaa50af3d-istio-podinfo\") pod \"e2e-worker-w0-ee816e-openshift-default-c4db85b5c-j7pfz\" (UID: \"6c7cacb3-7045-4e9d-a2d6-9fabaa50af3d\") " pod="openshift-ingress/e2e-worker-w0-ee816e-openshift-default-c4db85b5c-j7pfz"
Oct 31 17:41:03.119046 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:03.113680    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fa5b3d0d-4ae9-4f60-8af5-571df26ba157-istiod-ca-cert\") pod \"e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-mst4q\" (UID: \"fa5b3d0d-4ae9-4f60-8af5-571df26ba157\") " pod="openshift-ingress/e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-mst4q"
Oct 31 17:41:03.119046 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:03.113733    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6c7cacb3-7045-4e9d-a2d6-9fabaa50af3d-istio-token\") pod \"e2e-worker-w0-ee816e-openshift-default-c4db85b5c-j7pfz\" (UID: \"6c7cacb3-7045-4e9d-a2d6-9fabaa50af3d\") " pod="openshift-ingress/e2e-worker-w0-ee816e-openshift-default-c4db85b5c-j7pfz"
Oct 31 17:41:03.119046 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:03.113764    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9d2bq\" (UniqueName: \"kubernetes.io/projected/6c7cacb3-7045-4e9d-a2d6-9fabaa50af3d-kube-api-access-9d2bq\") pod \"e2e-worker-w0-ee816e-openshift-default-c4db85b5c-j7pfz\" (UID: \"6c7cacb3-7045-4e9d-a2d6-9fabaa50af3d\") " pod="openshift-ingress/e2e-worker-w0-ee816e-openshift-default-c4db85b5c-j7pfz"
Oct 31 17:41:03.119046 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:03.113800    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fa5b3d0d-4ae9-4f60-8af5-571df26ba157-istio-data\") pod \"e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-mst4q\" (UID: \"fa5b3d0d-4ae9-4f60-8af5-571df26ba157\") " pod="openshift-ingress/e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-mst4q"
Oct 31 17:41:03.119046 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:03.113833    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fa5b3d0d-4ae9-4f60-8af5-571df26ba157-istio-podinfo\") pod \"e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-mst4q\" (UID: \"fa5b3d0d-4ae9-4f60-8af5-571df26ba157\") " pod="openshift-ingress/e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-mst4q"
Oct 31 17:41:03.132671 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:03.131637    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6c7cacb3-7045-4e9d-a2d6-9fabaa50af3d-istio-data\") pod \"e2e-worker-w0-ee816e-openshift-default-c4db85b5c-j7pfz\" (UID: \"6c7cacb3-7045-4e9d-a2d6-9fabaa50af3d\") " pod="openshift-ingress/e2e-worker-w0-ee816e-openshift-default-c4db85b5c-j7pfz"
Oct 31 17:41:03.132671 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:03.132072    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6c7cacb3-7045-4e9d-a2d6-9fabaa50af3d-credential-socket\") pod \"e2e-worker-w0-ee816e-openshift-default-c4db85b5c-j7pfz\" (UID: \"6c7cacb3-7045-4e9d-a2d6-9fabaa50af3d\") " pod="openshift-ingress/e2e-worker-w0-ee816e-openshift-default-c4db85b5c-j7pfz"
Oct 31 17:41:03.132671 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:03.132427    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6c7cacb3-7045-4e9d-a2d6-9fabaa50af3d-workload-socket\") pod \"e2e-worker-w0-ee816e-openshift-default-c4db85b5c-j7pfz\" (UID: \"6c7cacb3-7045-4e9d-a2d6-9fabaa50af3d\") " pod="openshift-ingress/e2e-worker-w0-ee816e-openshift-default-c4db85b5c-j7pfz"
Oct 31 17:41:03.136672 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:03.135406    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6c7cacb3-7045-4e9d-a2d6-9fabaa50af3d-istiod-ca-cert\") pod \"e2e-worker-w0-ee816e-openshift-default-c4db85b5c-j7pfz\" (UID: \"6c7cacb3-7045-4e9d-a2d6-9fabaa50af3d\") " pod="openshift-ingress/e2e-worker-w0-ee816e-openshift-default-c4db85b5c-j7pfz"
Oct 31 17:41:03.136672 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:03.135812    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6c7cacb3-7045-4e9d-a2d6-9fabaa50af3d-workload-certs\") pod \"e2e-worker-w0-ee816e-openshift-default-c4db85b5c-j7pfz\" (UID: \"6c7cacb3-7045-4e9d-a2d6-9fabaa50af3d\") " pod="openshift-ingress/e2e-worker-w0-ee816e-openshift-default-c4db85b5c-j7pfz"
Oct 31 17:41:03.146680 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:03.145976    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6c7cacb3-7045-4e9d-a2d6-9fabaa50af3d-istio-envoy\") pod \"e2e-worker-w0-ee816e-openshift-default-c4db85b5c-j7pfz\" (UID: \"6c7cacb3-7045-4e9d-a2d6-9fabaa50af3d\") " pod="openshift-ingress/e2e-worker-w0-ee816e-openshift-default-c4db85b5c-j7pfz"
Oct 31 17:41:03.151674 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:03.150755    5003 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-ee816e/distinct-w0-ee816e-kserve-564f897f89-kglpl" podUID="82b982f8-de44-449d-b4a6-dc8f5824bf35" containerName="main" probeResult="failure" output="Get \"https://10.132.0.91:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 31 17:41:03.263669 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:03.224496    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fa5b3d0d-4ae9-4f60-8af5-571df26ba157-workload-certs\") pod \"e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-mst4q\" (UID: \"fa5b3d0d-4ae9-4f60-8af5-571df26ba157\") " pod="openshift-ingress/e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-mst4q"
Oct 31 17:41:03.266154 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:03.232202    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fa5b3d0d-4ae9-4f60-8af5-571df26ba157-workload-certs\") pod \"e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-mst4q\" (UID: \"fa5b3d0d-4ae9-4f60-8af5-571df26ba157\") " pod="openshift-ingress/e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-mst4q"
Oct 31 17:41:03.266383 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:03.236627    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9d2bq\" (UniqueName: \"kubernetes.io/projected/6c7cacb3-7045-4e9d-a2d6-9fabaa50af3d-kube-api-access-9d2bq\") pod \"e2e-worker-w0-ee816e-openshift-default-c4db85b5c-j7pfz\" (UID: \"6c7cacb3-7045-4e9d-a2d6-9fabaa50af3d\") " pod="openshift-ingress/e2e-worker-w0-ee816e-openshift-default-c4db85b5c-j7pfz"
Oct 31 17:41:03.266505 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:03.266244    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pf5kr\" (UniqueName: \"kubernetes.io/projected/fa5b3d0d-4ae9-4f60-8af5-571df26ba157-kube-api-access-pf5kr\") pod \"e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-mst4q\" (UID: \"fa5b3d0d-4ae9-4f60-8af5-571df26ba157\") " pod="openshift-ingress/e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-mst4q"
Oct 31 17:41:03.270667 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:03.266677    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fa5b3d0d-4ae9-4f60-8af5-571df26ba157-istio-envoy\") pod \"e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-mst4q\" (UID: \"fa5b3d0d-4ae9-4f60-8af5-571df26ba157\") " pod="openshift-ingress/e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-mst4q"
Oct 31 17:41:03.270908 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:03.269718    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6c7cacb3-7045-4e9d-a2d6-9fabaa50af3d-istio-podinfo\") pod \"e2e-worker-w0-ee816e-openshift-default-c4db85b5c-j7pfz\" (UID: \"6c7cacb3-7045-4e9d-a2d6-9fabaa50af3d\") " pod="openshift-ingress/e2e-worker-w0-ee816e-openshift-default-c4db85b5c-j7pfz"
Oct 31 17:41:03.271139 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:03.271114    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fa5b3d0d-4ae9-4f60-8af5-571df26ba157-credential-socket\") pod \"e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-mst4q\" (UID: \"fa5b3d0d-4ae9-4f60-8af5-571df26ba157\") " pod="openshift-ingress/e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-mst4q"
Oct 31 17:41:03.287889 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:03.287850    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fa5b3d0d-4ae9-4f60-8af5-571df26ba157-workload-socket\") pod \"e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-mst4q\" (UID: \"fa5b3d0d-4ae9-4f60-8af5-571df26ba157\") " pod="openshift-ingress/e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-mst4q"
Oct 31 17:41:03.288568 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:03.288541    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fa5b3d0d-4ae9-4f60-8af5-571df26ba157-istio-token\") pod \"e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-mst4q\" (UID: \"fa5b3d0d-4ae9-4f60-8af5-571df26ba157\") " pod="openshift-ingress/e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-mst4q"
Oct 31 17:41:03.289210 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:03.289185    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fa5b3d0d-4ae9-4f60-8af5-571df26ba157-istiod-ca-cert\") pod \"e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-mst4q\" (UID: \"fa5b3d0d-4ae9-4f60-8af5-571df26ba157\") " pod="openshift-ingress/e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-mst4q"
Oct 31 17:41:03.295791 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:03.295759    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fa5b3d0d-4ae9-4f60-8af5-571df26ba157-istio-data\") pod \"e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-mst4q\" (UID: \"fa5b3d0d-4ae9-4f60-8af5-571df26ba157\") " pod="openshift-ingress/e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-mst4q"
Oct 31 17:41:03.323852 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:03.272153    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fa5b3d0d-4ae9-4f60-8af5-571df26ba157-istio-envoy\") pod \"e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-mst4q\" (UID: \"fa5b3d0d-4ae9-4f60-8af5-571df26ba157\") " pod="openshift-ingress/e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-mst4q"
Oct 31 17:41:03.323852 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:03.271934    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fa5b3d0d-4ae9-4f60-8af5-571df26ba157-credential-socket\") pod \"e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-mst4q\" (UID: \"fa5b3d0d-4ae9-4f60-8af5-571df26ba157\") " pod="openshift-ingress/e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-mst4q"
Oct 31 17:41:03.323852 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:03.290115    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fa5b3d0d-4ae9-4f60-8af5-571df26ba157-istiod-ca-cert\") pod \"e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-mst4q\" (UID: \"fa5b3d0d-4ae9-4f60-8af5-571df26ba157\") " pod="openshift-ingress/e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-mst4q"
Oct 31 17:41:03.323852 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:03.288431    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fa5b3d0d-4ae9-4f60-8af5-571df26ba157-workload-socket\") pod \"e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-mst4q\" (UID: \"fa5b3d0d-4ae9-4f60-8af5-571df26ba157\") " pod="openshift-ingress/e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-mst4q"
Oct 31 17:41:03.324168 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:03.296264    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fa5b3d0d-4ae9-4f60-8af5-571df26ba157-istio-data\") pod \"e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-mst4q\" (UID: \"fa5b3d0d-4ae9-4f60-8af5-571df26ba157\") " pod="openshift-ingress/e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-mst4q"
Oct 31 17:41:03.324168 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:03.297454    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6c7cacb3-7045-4e9d-a2d6-9fabaa50af3d-istio-token\") pod \"e2e-worker-w0-ee816e-openshift-default-c4db85b5c-j7pfz\" (UID: \"6c7cacb3-7045-4e9d-a2d6-9fabaa50af3d\") " pod="openshift-ingress/e2e-worker-w0-ee816e-openshift-default-c4db85b5c-j7pfz"
Oct 31 17:41:03.324168 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:03.320387    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pf5kr\" (UniqueName: \"kubernetes.io/projected/fa5b3d0d-4ae9-4f60-8af5-571df26ba157-kube-api-access-pf5kr\") pod \"e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-mst4q\" (UID: \"fa5b3d0d-4ae9-4f60-8af5-571df26ba157\") " pod="openshift-ingress/e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-mst4q"
Oct 31 17:41:03.367745 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:03.345733    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fa5b3d0d-4ae9-4f60-8af5-571df26ba157-istio-podinfo\") pod \"e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-mst4q\" (UID: \"fa5b3d0d-4ae9-4f60-8af5-571df26ba157\") " pod="openshift-ingress/e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-mst4q"
Oct 31 17:41:03.375743 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:03.370218    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fa5b3d0d-4ae9-4f60-8af5-571df26ba157-istio-token\") pod \"e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-mst4q\" (UID: \"fa5b3d0d-4ae9-4f60-8af5-571df26ba157\") " pod="openshift-ingress/e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-mst4q"
Oct 31 17:41:03.394677 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:03.392015    5003 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w0-ee816e/distinct-w0-ee816e-kserve-564f897f89-kglpl" podUID="82b982f8-de44-449d-b4a6-dc8f5824bf35" containerName="main" probeResult="failure" output="Get \"https://10.132.0.91:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 31 17:41:03.434032 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:03.433985    5003 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-b78c31/distinct-2-w5-b78c31-kserve-5f4f9d4bb5-ss7g2" podUID="9cc6d7e8-30de-4173-9974-1f1a4fd08e1c" containerName="main" probeResult="failure" output="Get \"https://10.132.0.99:8000/ready\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)"
Oct 31 17:41:03.510301 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:03.510036    5003 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-ee816e-openshift-default-c4db85b5c-j7pfz"
Oct 31 17:41:03.518676 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:03.511016    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fa5b3d0d-4ae9-4f60-8af5-571df26ba157-istio-podinfo\") pod \"e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-mst4q\" (UID: \"fa5b3d0d-4ae9-4f60-8af5-571df26ba157\") " pod="openshift-ingress/e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-mst4q"
Oct 31 17:41:03.548233 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:03.548178    5003 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-b78c31/distinct-w5-b78c31-kserve-77ccb69d98-p2zct" podUID="fcf01e9c-57fb-42db-848d-d314c615bd67" containerName="main" probeResult="failure" output="Get \"https://10.132.0.93:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 31 17:41:03.578954 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:03.577131    5003 prober.go:122] "Probe failed" probeType="Readiness" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-82w89" podUID="ef5a065b-f98e-4d14-810f-2d0c42c58ce6" containerName="main" probeResult="failure" output="Get \"https://10.132.0.54:8000/ready\": context deadline exceeded"
Oct 31 17:41:03.665689 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:03.659733    5003 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-1c0bfd/distinct-w4-1c0bfd-kserve-867858548f-46gwg" podUID="93f16294-fc40-477d-90b3-d02640037d5b" containerName="main" probeResult="failure" output="Get \"https://10.132.0.94:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 31 17:41:03.705191 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:03.705155    5003 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-mst4q"
Oct 31 17:41:03.765879 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:03.761688    5003 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-0e59ca/simulator-w1-0e59ca-kserve-999765679-zs7kh" podUID="018d423e-6866-4b61-a4a2-d2e786d82bf0" containerName="main" probeResult="failure" output="Get \"https://10.132.0.71:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 31 17:41:03.809667 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:03.804922    5003 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-ee816e/simulator-w0-ee816e-kserve-5bd4657dc-9rlm4" podUID="620f499f-36d7-4900-abbe-98ee5cf5d96c" containerName="main" probeResult="failure" output="Get \"https://10.132.0.72:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 31 17:41:03.811725 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:03.809874    5003 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-b78c31/simulator-w5-b78c31-kserve-95df74778-fpvpr" podUID="665d75c7-8ba5-49e1-87a7-51a18ae6f369" containerName="main" probeResult="failure" output="Get \"https://10.132.0.73:8000/ready\": context deadline exceeded"
Oct 31 17:41:03.811725 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:03.810234    5003 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w5-b78c31/simulator-w5-b78c31-kserve-95df74778-fpvpr"
Oct 31 17:41:03.958189 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:03.947923    5003 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-1c0bfd/premium-w4-1c0bfd-kserve-d78fbb98-psx55" podUID="34bdffed-87b8-4e7a-b182-f069d081bd62" containerName="main" probeResult="failure" output="Get \"https://10.132.0.74:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 31 17:41:04.194861 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:04.194795    5003 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-ee816e/distinct-w0-ee816e-kserve-564f897f89-kglpl" podUID="82b982f8-de44-449d-b4a6-dc8f5824bf35" containerName="main" probeResult="failure" output="Get \"https://10.132.0.91:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 31 17:41:04.196789 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:04.196769    5003 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w0-ee816e/distinct-w0-ee816e-kserve-564f897f89-kglpl"
Oct 31 17:41:04.363697 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:04.363635    5003 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w0-ee816e/distinct-w0-ee816e-kserve-564f897f89-kglpl"
Oct 31 17:41:04.365583 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:04.365559    5003 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w5-b78c31/simulator-w5-b78c31-kserve-95df74778-fpvpr"
Oct 31 17:41:04.563264 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:04.563230    5003 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-mst4q"]
Oct 31 17:41:04.567707 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:41:04.567680    5003 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfa5b3d0d_4ae9_4f60_8af5_571df26ba157.slice/crio-078e59ba83319e8fd016b44343af2f0f913a61b9a98a579dbd774c1bab29fff1 WatchSource:0}: Error finding container 078e59ba83319e8fd016b44343af2f0f913a61b9a98a579dbd774c1bab29fff1: Status 404 returned error can't find the container with id 078e59ba83319e8fd016b44343af2f0f913a61b9a98a579dbd774c1bab29fff1
Oct 31 17:41:04.571858 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:04.571191    5003 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Oct 31 17:41:04.571858 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:04.571273    5003 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Oct 31 17:41:04.571858 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:04.571311    5003 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Oct 31 17:41:04.651390 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:04.650989    5003 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-ee816e-openshift-default-c4db85b5c-j7pfz"]
Oct 31 17:41:04.652769 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:41:04.652743    5003 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6c7cacb3_7045_4e9d_a2d6_9fabaa50af3d.slice/crio-56e7a69fab53f5efbdaa002da438f74f2d2c50b0edb1099fb9b9aaa122d74be2 WatchSource:0}: Error finding container 56e7a69fab53f5efbdaa002da438f74f2d2c50b0edb1099fb9b9aaa122d74be2: Status 404 returned error can't find the container with id 56e7a69fab53f5efbdaa002da438f74f2d2c50b0edb1099fb9b9aaa122d74be2
Oct 31 17:41:04.657917 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:04.657873    5003 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Oct 31 17:41:04.658024 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:04.657974    5003 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Oct 31 17:41:04.658086 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:04.658023    5003 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Oct 31 17:41:05.312360 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:05.312314    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-ee816e-openshift-default-c4db85b5c-j7pfz" event={"ID":"6c7cacb3-7045-4e9d-a2d6-9fabaa50af3d","Type":"ContainerStarted","Data":"60ce9522dc18b66c7ac96aca043fb8b211a05ce8556e834bff095cc29f4c834f"}
Oct 31 17:41:05.312668 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:05.312629    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-ee816e-openshift-default-c4db85b5c-j7pfz" event={"ID":"6c7cacb3-7045-4e9d-a2d6-9fabaa50af3d","Type":"ContainerStarted","Data":"56e7a69fab53f5efbdaa002da438f74f2d2c50b0edb1099fb9b9aaa122d74be2"}
Oct 31 17:41:05.317883 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:05.317805    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-mst4q" event={"ID":"fa5b3d0d-4ae9-4f60-8af5-571df26ba157","Type":"ContainerStarted","Data":"a005f0f8ec631a78f1a1a23eed30e31fb1003883e3697da4d31aa9419acfaa03"}
Oct 31 17:41:05.319287 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:05.319227    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-mst4q" event={"ID":"fa5b3d0d-4ae9-4f60-8af5-571df26ba157","Type":"ContainerStarted","Data":"078e59ba83319e8fd016b44343af2f0f913a61b9a98a579dbd774c1bab29fff1"}
Oct 31 17:41:05.324407 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:05.324384    5003 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-36fa73e9-268gh"]
Oct 31 17:41:05.329224 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:05.329203    5003 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-36fa73e9-268gh"
Oct 31 17:41:05.343457 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:05.343374    5003 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-36fa73e9-268gh"]
Oct 31 17:41:05.343812 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:05.343792    5003 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\""
Oct 31 17:41:05.343971 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:05.343953    5003 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-mr9x2\""
Oct 31 17:41:05.441520 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:05.441461    5003 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w0-ee816e-openshift-default-c4db85b5c-j7pfz" podStartSLOduration=3.441442089 podStartE2EDuration="3.441442089s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 17:41:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 17:41:05.401070476 +0000 UTC m=+833.655925020" watchObservedRunningTime="2026-10-31 17:41:05.441442089 +0000 UTC m=+833.696296638"
Oct 31 17:41:05.504507 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:05.504438    5003 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-mst4q" podStartSLOduration=3.504416978 podStartE2EDuration="3.504416978s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 17:41:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 17:41:05.50306801 +0000 UTC m=+833.757922552" watchObservedRunningTime="2026-10-31 17:41:05.504416978 +0000 UTC m=+833.759271523"
Oct 31 17:41:05.509879 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:05.509841    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j5b2g\" (UniqueName: \"kubernetes.io/projected/98b1e280-c5e1-4ee1-a50a-7326ff715da8-kube-api-access-j5b2g\") pod \"maas-api-revoke-sub-36fa73e9-268gh\" (UID: \"98b1e280-c5e1-4ee1-a50a-7326ff715da8\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-36fa73e9-268gh"
Oct 31 17:41:05.510785 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:05.510209    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/98b1e280-c5e1-4ee1-a50a-7326ff715da8-maas-api-xks-ca\") pod \"maas-api-revoke-sub-36fa73e9-268gh\" (UID: \"98b1e280-c5e1-4ee1-a50a-7326ff715da8\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-36fa73e9-268gh"
Oct 31 17:41:05.510785 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:05.510675    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/98b1e280-c5e1-4ee1-a50a-7326ff715da8-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-36fa73e9-268gh\" (UID: \"98b1e280-c5e1-4ee1-a50a-7326ff715da8\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-36fa73e9-268gh"
Oct 31 17:41:05.520670 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:05.520044    5003 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w0-ee816e-openshift-default-c4db85b5c-j7pfz"
Oct 31 17:41:05.521308 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:05.521290    5003 patch_prober.go:29] interesting pod/e2e-worker-w0-ee816e-openshift-default-c4db85b5c-j7pfz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.102:15021/healthz/ready\": dial tcp 10.132.0.102:15021: connect: connection refused" start-of-body=
Oct 31 17:41:05.521377 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:05.521328    5003 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-ee816e-openshift-default-c4db85b5c-j7pfz" podUID="6c7cacb3-7045-4e9d-a2d6-9fabaa50af3d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.102:15021/healthz/ready\": dial tcp 10.132.0.102:15021: connect: connection refused"
Oct 31 17:41:05.612346 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:05.612255    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/98b1e280-c5e1-4ee1-a50a-7326ff715da8-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-36fa73e9-268gh\" (UID: \"98b1e280-c5e1-4ee1-a50a-7326ff715da8\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-36fa73e9-268gh"
Oct 31 17:41:05.612524 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:05.612379    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j5b2g\" (UniqueName: \"kubernetes.io/projected/98b1e280-c5e1-4ee1-a50a-7326ff715da8-kube-api-access-j5b2g\") pod \"maas-api-revoke-sub-36fa73e9-268gh\" (UID: \"98b1e280-c5e1-4ee1-a50a-7326ff715da8\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-36fa73e9-268gh"
Oct 31 17:41:05.612524 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:05.612460    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/98b1e280-c5e1-4ee1-a50a-7326ff715da8-maas-api-xks-ca\") pod \"maas-api-revoke-sub-36fa73e9-268gh\" (UID: \"98b1e280-c5e1-4ee1-a50a-7326ff715da8\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-36fa73e9-268gh"
Oct 31 17:41:05.613088 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:05.613057    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/98b1e280-c5e1-4ee1-a50a-7326ff715da8-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-36fa73e9-268gh\" (UID: \"98b1e280-c5e1-4ee1-a50a-7326ff715da8\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-36fa73e9-268gh"
Oct 31 17:41:05.616666 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:05.616627    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/98b1e280-c5e1-4ee1-a50a-7326ff715da8-maas-api-xks-ca\") pod \"maas-api-revoke-sub-36fa73e9-268gh\" (UID: \"98b1e280-c5e1-4ee1-a50a-7326ff715da8\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-36fa73e9-268gh"
Oct 31 17:41:05.633426 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:05.633402    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j5b2g\" (UniqueName: \"kubernetes.io/projected/98b1e280-c5e1-4ee1-a50a-7326ff715da8-kube-api-access-j5b2g\") pod \"maas-api-revoke-sub-36fa73e9-268gh\" (UID: \"98b1e280-c5e1-4ee1-a50a-7326ff715da8\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-36fa73e9-268gh"
Oct 31 17:41:05.644104 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:05.644002    5003 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-36fa73e9-268gh"
Oct 31 17:41:05.711390 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:05.708846    5003 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-mst4q"
Oct 31 17:41:05.711390 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:05.710403    5003 patch_prober.go:29] interesting pod/e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-mst4q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.103:15021/healthz/ready\": dial tcp 10.132.0.103:15021: connect: connection refused" start-of-body=
Oct 31 17:41:05.711390 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:05.710457    5003 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-mst4q" podUID="fa5b3d0d-4ae9-4f60-8af5-571df26ba157" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.103:15021/healthz/ready\": dial tcp 10.132.0.103:15021: connect: connection refused"
Oct 31 17:41:06.052515 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:06.052488    5003 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-36fa73e9-268gh"]
Oct 31 17:41:06.076803 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:41:06.076743    5003 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod98b1e280_c5e1_4ee1_a50a_7326ff715da8.slice/crio-18a332bdb7843d64d7f799da3450291c08eec3331a0f4db0ad63e2f813f2ad97 WatchSource:0}: Error finding container 18a332bdb7843d64d7f799da3450291c08eec3331a0f4db0ad63e2f813f2ad97: Status 404 returned error can't find the container with id 18a332bdb7843d64d7f799da3450291c08eec3331a0f4db0ad63e2f813f2ad97
Oct 31 17:41:06.328044 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:06.328010    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-36fa73e9-268gh" event={"ID":"98b1e280-c5e1-4ee1-a50a-7326ff715da8","Type":"ContainerStarted","Data":"18a332bdb7843d64d7f799da3450291c08eec3331a0f4db0ad63e2f813f2ad97"}
Oct 31 17:41:06.522147 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:06.522101    5003 patch_prober.go:29] interesting pod/e2e-worker-w0-ee816e-openshift-default-c4db85b5c-j7pfz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.102:15021/healthz/ready\": dial tcp 10.132.0.102:15021: connect: connection refused" start-of-body=
Oct 31 17:41:06.522628 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:06.522173    5003 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-ee816e-openshift-default-c4db85b5c-j7pfz" podUID="6c7cacb3-7045-4e9d-a2d6-9fabaa50af3d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.102:15021/healthz/ready\": dial tcp 10.132.0.102:15021: connect: connection refused"
Oct 31 17:41:06.707116 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:06.707088    5003 patch_prober.go:29] interesting pod/e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-mst4q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.103:15021/healthz/ready\": dial tcp 10.132.0.103:15021: connect: connection refused" start-of-body=
Oct 31 17:41:06.707335 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:06.707314    5003 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-mst4q" podUID="fa5b3d0d-4ae9-4f60-8af5-571df26ba157" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.103:15021/healthz/ready\": dial tcp 10.132.0.103:15021: connect: connection refused"
Oct 31 17:41:07.341553 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:07.341512    5003 generic.go:356] "Generic (PLEG): container finished" podID="98b1e280-c5e1-4ee1-a50a-7326ff715da8" containerID="b1b5e46095e81436698b9ad4bb989b730d6c565c3134d075ed41d9cf9fe37079" exitCode=0
Oct 31 17:41:07.342118 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:07.342085    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-36fa73e9-268gh" event={"ID":"98b1e280-c5e1-4ee1-a50a-7326ff715da8","Type":"ContainerDied","Data":"b1b5e46095e81436698b9ad4bb989b730d6c565c3134d075ed41d9cf9fe37079"}
Oct 31 17:41:07.522255 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:07.522159    5003 patch_prober.go:29] interesting pod/e2e-worker-w0-ee816e-openshift-default-c4db85b5c-j7pfz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.102:15021/healthz/ready\": dial tcp 10.132.0.102:15021: connect: connection refused" start-of-body=
Oct 31 17:41:07.522255 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:07.522224    5003 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-ee816e-openshift-default-c4db85b5c-j7pfz" podUID="6c7cacb3-7045-4e9d-a2d6-9fabaa50af3d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.102:15021/healthz/ready\": dial tcp 10.132.0.102:15021: connect: connection refused"
Oct 31 17:41:07.706075 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:07.706036    5003 patch_prober.go:29] interesting pod/e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-mst4q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.103:15021/healthz/ready\": dial tcp 10.132.0.103:15021: connect: connection refused" start-of-body=
Oct 31 17:41:07.706335 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:07.706302    5003 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-mst4q" podUID="fa5b3d0d-4ae9-4f60-8af5-571df26ba157" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.103:15021/healthz/ready\": dial tcp 10.132.0.103:15021: connect: connection refused"
Oct 31 17:41:08.519713 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:08.519667    5003 patch_prober.go:29] interesting pod/e2e-worker-w0-ee816e-openshift-default-c4db85b5c-j7pfz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.102:15021/healthz/ready\": dial tcp 10.132.0.102:15021: connect: connection refused" start-of-body=
Oct 31 17:41:08.519988 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:08.519956    5003 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-ee816e-openshift-default-c4db85b5c-j7pfz" podUID="6c7cacb3-7045-4e9d-a2d6-9fabaa50af3d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.102:15021/healthz/ready\": dial tcp 10.132.0.102:15021: connect: connection refused"
Oct 31 17:41:08.707206 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:08.707047    5003 patch_prober.go:29] interesting pod/e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-mst4q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.103:15021/healthz/ready\": dial tcp 10.132.0.103:15021: connect: connection refused" start-of-body=
Oct 31 17:41:08.707206 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:08.707108    5003 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-mst4q" podUID="fa5b3d0d-4ae9-4f60-8af5-571df26ba157" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.103:15021/healthz/ready\": dial tcp 10.132.0.103:15021: connect: connection refused"
Oct 31 17:41:08.710291 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:08.710255    5003 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-36fa73e9-268gh"
Oct 31 17:41:08.823673 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:08.822306    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/98b1e280-c5e1-4ee1-a50a-7326ff715da8-kube-api-access-j5b2g\" (UniqueName: \"kubernetes.io/projected/98b1e280-c5e1-4ee1-a50a-7326ff715da8-kube-api-access-j5b2g\") pod \"98b1e280-c5e1-4ee1-a50a-7326ff715da8\" (UID: \"98b1e280-c5e1-4ee1-a50a-7326ff715da8\") "
Oct 31 17:41:08.824117 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:08.824082    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/98b1e280-c5e1-4ee1-a50a-7326ff715da8-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/98b1e280-c5e1-4ee1-a50a-7326ff715da8-maas-api-openshift-ca\") pod \"98b1e280-c5e1-4ee1-a50a-7326ff715da8\" (UID: \"98b1e280-c5e1-4ee1-a50a-7326ff715da8\") "
Oct 31 17:41:08.824463 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:08.824440    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/98b1e280-c5e1-4ee1-a50a-7326ff715da8-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/98b1e280-c5e1-4ee1-a50a-7326ff715da8-maas-api-xks-ca\") pod \"98b1e280-c5e1-4ee1-a50a-7326ff715da8\" (UID: \"98b1e280-c5e1-4ee1-a50a-7326ff715da8\") "
Oct 31 17:41:08.824980 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:08.824954    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/98b1e280-c5e1-4ee1-a50a-7326ff715da8-maas-api-openshift-ca" pod "98b1e280-c5e1-4ee1-a50a-7326ff715da8" (UID: "98b1e280-c5e1-4ee1-a50a-7326ff715da8"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 17:41:08.825522 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:08.825499    5003 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/98b1e280-c5e1-4ee1-a50a-7326ff715da8-maas-api-openshift-ca\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:41:08.841133 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:08.836783    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/98b1e280-c5e1-4ee1-a50a-7326ff715da8-kube-api-access-j5b2g" pod "98b1e280-c5e1-4ee1-a50a-7326ff715da8" (UID: "98b1e280-c5e1-4ee1-a50a-7326ff715da8"). InnerVolumeSpecName "kube-api-access-j5b2g". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 17:41:08.841133 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:08.837804    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/98b1e280-c5e1-4ee1-a50a-7326ff715da8-maas-api-xks-ca" pod "98b1e280-c5e1-4ee1-a50a-7326ff715da8" (UID: "98b1e280-c5e1-4ee1-a50a-7326ff715da8"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 17:41:08.927040 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:08.927003    5003 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/98b1e280-c5e1-4ee1-a50a-7326ff715da8-maas-api-xks-ca\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:41:08.927040 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:08.927038    5003 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j5b2g\" (UniqueName: \"kubernetes.io/projected/98b1e280-c5e1-4ee1-a50a-7326ff715da8-kube-api-access-j5b2g\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:41:09.411665 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:09.410892    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-36fa73e9-268gh" event={"ID":"98b1e280-c5e1-4ee1-a50a-7326ff715da8","Type":"ContainerDied","Data":"18a332bdb7843d64d7f799da3450291c08eec3331a0f4db0ad63e2f813f2ad97"}
Oct 31 17:41:09.411665 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:09.410942    5003 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="18a332bdb7843d64d7f799da3450291c08eec3331a0f4db0ad63e2f813f2ad97"
Oct 31 17:41:09.411665 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:09.410995    5003 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-36fa73e9-268gh"
Oct 31 17:41:09.519998 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:09.519965    5003 patch_prober.go:29] interesting pod/e2e-worker-w0-ee816e-openshift-default-c4db85b5c-j7pfz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.102:15021/healthz/ready\": dial tcp 10.132.0.102:15021: connect: connection refused" start-of-body=
Oct 31 17:41:09.520161 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:09.520022    5003 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-ee816e-openshift-default-c4db85b5c-j7pfz" podUID="6c7cacb3-7045-4e9d-a2d6-9fabaa50af3d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.102:15021/healthz/ready\": dial tcp 10.132.0.102:15021: connect: connection refused"
Oct 31 17:41:09.706381 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:09.705837    5003 patch_prober.go:29] interesting pod/e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-mst4q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.103:15021/healthz/ready\": dial tcp 10.132.0.103:15021: connect: connection refused" start-of-body=
Oct 31 17:41:09.706381 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:09.705896    5003 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-mst4q" podUID="fa5b3d0d-4ae9-4f60-8af5-571df26ba157" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.103:15021/healthz/ready\": dial tcp 10.132.0.103:15021: connect: connection refused"
Oct 31 17:41:09.915759 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:09.915726    5003 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-0491c971-xzm5r"]
Oct 31 17:41:09.916385 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:09.916365    5003 cpu_manager.go:414] "containerMap: removing container" podUID="98b1e280-c5e1-4ee1-a50a-7326ff715da8" containerName="revoke-keys"
Oct 31 17:41:09.916507 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:09.916389    5003 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="98b1e280-c5e1-4ee1-a50a-7326ff715da8" containerName="revoke-keys"
Oct 31 17:41:09.916584 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:09.916521    5003 memory_manager.go:365] "RemoveStaleState removing state" podUID="98b1e280-c5e1-4ee1-a50a-7326ff715da8" containerName="revoke-keys"
Oct 31 17:41:09.922269 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:09.921539    5003 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-0491c971-xzm5r"
Oct 31 17:41:09.926119 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:09.925267    5003 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-0491c971-xzm5r"]
Oct 31 17:41:09.942865 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:09.941783    5003 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\""
Oct 31 17:41:09.942865 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:09.942537    5003 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-mr9x2\""
Oct 31 17:41:10.045052 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:10.044970    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-24c4x\" (UniqueName: \"kubernetes.io/projected/9f845581-2357-4edf-ae5f-4f34d26b2174-kube-api-access-24c4x\") pod \"maas-api-revoke-sub-0491c971-xzm5r\" (UID: \"9f845581-2357-4edf-ae5f-4f34d26b2174\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-0491c971-xzm5r"
Oct 31 17:41:10.045220 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:10.045079    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/9f845581-2357-4edf-ae5f-4f34d26b2174-maas-api-xks-ca\") pod \"maas-api-revoke-sub-0491c971-xzm5r\" (UID: \"9f845581-2357-4edf-ae5f-4f34d26b2174\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-0491c971-xzm5r"
Oct 31 17:41:10.045270 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:10.045213    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/9f845581-2357-4edf-ae5f-4f34d26b2174-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-0491c971-xzm5r\" (UID: \"9f845581-2357-4edf-ae5f-4f34d26b2174\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-0491c971-xzm5r"
Oct 31 17:41:10.146378 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:10.146328    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-24c4x\" (UniqueName: \"kubernetes.io/projected/9f845581-2357-4edf-ae5f-4f34d26b2174-kube-api-access-24c4x\") pod \"maas-api-revoke-sub-0491c971-xzm5r\" (UID: \"9f845581-2357-4edf-ae5f-4f34d26b2174\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-0491c971-xzm5r"
Oct 31 17:41:10.146378 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:10.146382    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/9f845581-2357-4edf-ae5f-4f34d26b2174-maas-api-xks-ca\") pod \"maas-api-revoke-sub-0491c971-xzm5r\" (UID: \"9f845581-2357-4edf-ae5f-4f34d26b2174\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-0491c971-xzm5r"
Oct 31 17:41:10.146738 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:10.146480    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/9f845581-2357-4edf-ae5f-4f34d26b2174-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-0491c971-xzm5r\" (UID: \"9f845581-2357-4edf-ae5f-4f34d26b2174\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-0491c971-xzm5r"
Oct 31 17:41:10.147217 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:10.147196    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/9f845581-2357-4edf-ae5f-4f34d26b2174-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-0491c971-xzm5r\" (UID: \"9f845581-2357-4edf-ae5f-4f34d26b2174\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-0491c971-xzm5r"
Oct 31 17:41:10.148842 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:10.148821    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/9f845581-2357-4edf-ae5f-4f34d26b2174-maas-api-xks-ca\") pod \"maas-api-revoke-sub-0491c971-xzm5r\" (UID: \"9f845581-2357-4edf-ae5f-4f34d26b2174\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-0491c971-xzm5r"
Oct 31 17:41:10.205671 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:10.202616    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-24c4x\" (UniqueName: \"kubernetes.io/projected/9f845581-2357-4edf-ae5f-4f34d26b2174-kube-api-access-24c4x\") pod \"maas-api-revoke-sub-0491c971-xzm5r\" (UID: \"9f845581-2357-4edf-ae5f-4f34d26b2174\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-0491c971-xzm5r"
Oct 31 17:41:10.245324 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:10.245287    5003 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-0491c971-xzm5r"
Oct 31 17:41:10.347519 ip-10-0-138-17 kubenswrapper[5003]: E1031 17:41:10.347473    5003 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-tdzz5" containerName="extractor"
Oct 31 17:41:10.520700 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:10.520540    5003 patch_prober.go:29] interesting pod/e2e-worker-w0-ee816e-openshift-default-c4db85b5c-j7pfz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.102:15021/healthz/ready\": dial tcp 10.132.0.102:15021: connect: connection refused" start-of-body=
Oct 31 17:41:10.520891 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:10.520730    5003 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-ee816e-openshift-default-c4db85b5c-j7pfz" podUID="6c7cacb3-7045-4e9d-a2d6-9fabaa50af3d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.102:15021/healthz/ready\": dial tcp 10.132.0.102:15021: connect: connection refused"
Oct 31 17:41:10.707731 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:10.706013    5003 patch_prober.go:29] interesting pod/e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-mst4q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.103:15021/healthz/ready\": dial tcp 10.132.0.103:15021: connect: connection refused" start-of-body=
Oct 31 17:41:10.707731 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:10.706072    5003 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-mst4q" podUID="fa5b3d0d-4ae9-4f60-8af5-571df26ba157" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.103:15021/healthz/ready\": dial tcp 10.132.0.103:15021: connect: connection refused"
Oct 31 17:41:10.709277 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:41:10.709249    5003 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9f845581_2357_4edf_ae5f_4f34d26b2174.slice/crio-8bea7420953448d58c2d318e5e7d0f2eb912a5c7f969076ab66ade3f1e837233 WatchSource:0}: Error finding container 8bea7420953448d58c2d318e5e7d0f2eb912a5c7f969076ab66ade3f1e837233: Status 404 returned error can't find the container with id 8bea7420953448d58c2d318e5e7d0f2eb912a5c7f969076ab66ade3f1e837233
Oct 31 17:41:10.711896 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:10.711872    5003 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-0491c971-xzm5r"]
Oct 31 17:41:11.436871 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:11.436780    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-0491c971-xzm5r" event={"ID":"9f845581-2357-4edf-ae5f-4f34d26b2174","Type":"ContainerStarted","Data":"2c246c66604fae139b041fc37a48dce9f4b97865f301b2dedaabef2bc78b9d22"}
Oct 31 17:41:11.436871 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:11.436866    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-0491c971-xzm5r" event={"ID":"9f845581-2357-4edf-ae5f-4f34d26b2174","Type":"ContainerStarted","Data":"8bea7420953448d58c2d318e5e7d0f2eb912a5c7f969076ab66ade3f1e837233"}
Oct 31 17:41:11.474781 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:11.474717    5003 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-sub-0491c971-xzm5r" podStartSLOduration=2.474697719 podStartE2EDuration="2.474697719s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 17:41:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 17:41:11.47250032 +0000 UTC m=+839.727354865" watchObservedRunningTime="2026-10-31 17:41:11.474697719 +0000 UTC m=+839.729552265"
Oct 31 17:41:11.520247 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:11.520212    5003 patch_prober.go:29] interesting pod/e2e-worker-w0-ee816e-openshift-default-c4db85b5c-j7pfz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.102:15021/healthz/ready\": dial tcp 10.132.0.102:15021: connect: connection refused" start-of-body=
Oct 31 17:41:11.520455 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:11.520283    5003 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-ee816e-openshift-default-c4db85b5c-j7pfz" podUID="6c7cacb3-7045-4e9d-a2d6-9fabaa50af3d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.102:15021/healthz/ready\": dial tcp 10.132.0.102:15021: connect: connection refused"
Oct 31 17:41:12.163190 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:12.163154    5003 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-mst4q"
Oct 31 17:41:12.164265 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:12.164242    5003 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-mst4q"
Oct 31 17:41:12.165033 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:12.164880    5003 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-mst4q"
Oct 31 17:41:12.446618 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:12.446519    5003 generic.go:356] "Generic (PLEG): container finished" podID="9f845581-2357-4edf-ae5f-4f34d26b2174" containerID="2c246c66604fae139b041fc37a48dce9f4b97865f301b2dedaabef2bc78b9d22" exitCode=0
Oct 31 17:41:12.447120 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:12.446608    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-0491c971-xzm5r" event={"ID":"9f845581-2357-4edf-ae5f-4f34d26b2174","Type":"ContainerDied","Data":"2c246c66604fae139b041fc37a48dce9f4b97865f301b2dedaabef2bc78b9d22"}
Oct 31 17:41:12.525281 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:12.525253    5003 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w0-ee816e-openshift-default-c4db85b5c-j7pfz"
Oct 31 17:41:12.525780 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:12.525762    5003 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w0-ee816e-openshift-default-c4db85b5c-j7pfz"
Oct 31 17:41:12.526758 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:12.526737    5003 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w0-ee816e-openshift-default-c4db85b5c-j7pfz"
Oct 31 17:41:13.625459 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:13.625428    5003 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-0491c971-xzm5r"
Oct 31 17:41:13.738504 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:13.738416    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/9f845581-2357-4edf-ae5f-4f34d26b2174-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/9f845581-2357-4edf-ae5f-4f34d26b2174-maas-api-xks-ca\") pod \"9f845581-2357-4edf-ae5f-4f34d26b2174\" (UID: \"9f845581-2357-4edf-ae5f-4f34d26b2174\") "
Oct 31 17:41:13.738504 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:13.738468    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/9f845581-2357-4edf-ae5f-4f34d26b2174-kube-api-access-24c4x\" (UniqueName: \"kubernetes.io/projected/9f845581-2357-4edf-ae5f-4f34d26b2174-kube-api-access-24c4x\") pod \"9f845581-2357-4edf-ae5f-4f34d26b2174\" (UID: \"9f845581-2357-4edf-ae5f-4f34d26b2174\") "
Oct 31 17:41:13.738804 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:13.738608    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/9f845581-2357-4edf-ae5f-4f34d26b2174-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/9f845581-2357-4edf-ae5f-4f34d26b2174-maas-api-openshift-ca\") pod \"9f845581-2357-4edf-ae5f-4f34d26b2174\" (UID: \"9f845581-2357-4edf-ae5f-4f34d26b2174\") "
Oct 31 17:41:13.738993 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:13.738963    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9f845581-2357-4edf-ae5f-4f34d26b2174-maas-api-openshift-ca" pod "9f845581-2357-4edf-ae5f-4f34d26b2174" (UID: "9f845581-2357-4edf-ae5f-4f34d26b2174"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 17:41:13.739296 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:13.739280    5003 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/9f845581-2357-4edf-ae5f-4f34d26b2174-maas-api-openshift-ca\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:41:13.740710 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:13.740685    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9f845581-2357-4edf-ae5f-4f34d26b2174-maas-api-xks-ca" pod "9f845581-2357-4edf-ae5f-4f34d26b2174" (UID: "9f845581-2357-4edf-ae5f-4f34d26b2174"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 17:41:13.740793 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:13.740740    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9f845581-2357-4edf-ae5f-4f34d26b2174-kube-api-access-24c4x" pod "9f845581-2357-4edf-ae5f-4f34d26b2174" (UID: "9f845581-2357-4edf-ae5f-4f34d26b2174"). InnerVolumeSpecName "kube-api-access-24c4x". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 17:41:13.841058 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:13.841025    5003 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/9f845581-2357-4edf-ae5f-4f34d26b2174-maas-api-xks-ca\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:41:13.841058 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:13.841054    5003 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-24c4x\" (UniqueName: \"kubernetes.io/projected/9f845581-2357-4edf-ae5f-4f34d26b2174-kube-api-access-24c4x\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:41:14.464067 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:14.464034    5003 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-0491c971-xzm5r"
Oct 31 17:41:14.464239 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:14.464065    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-0491c971-xzm5r" event={"ID":"9f845581-2357-4edf-ae5f-4f34d26b2174","Type":"ContainerDied","Data":"8bea7420953448d58c2d318e5e7d0f2eb912a5c7f969076ab66ade3f1e837233"}
Oct 31 17:41:14.464239 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:14.464119    5003 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8bea7420953448d58c2d318e5e7d0f2eb912a5c7f969076ab66ade3f1e837233"
Oct 31 17:41:17.022679 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:17.022626    5003 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w2-5c446c-openshift-default-797c6dc855-rtzkv"]
Oct 31 17:41:17.023324 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:17.023307    5003 cpu_manager.go:414] "containerMap: removing container" podUID="9f845581-2357-4edf-ae5f-4f34d26b2174" containerName="revoke-keys"
Oct 31 17:41:17.023384 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:17.023325    5003 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="9f845581-2357-4edf-ae5f-4f34d26b2174" containerName="revoke-keys"
Oct 31 17:41:17.023463 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:17.023454    5003 memory_manager.go:365] "RemoveStaleState removing state" podUID="9f845581-2357-4edf-ae5f-4f34d26b2174" containerName="revoke-keys"
Oct 31 17:41:17.027292 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:17.027270    5003 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-5c446c-openshift-default-797c6dc855-rtzkv"
Oct 31 17:41:17.062126 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:17.062088    5003 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w2-5c446c-openshift-default-797c6dc855-rtzkv"]
Oct 31 17:41:17.087033 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:17.086998    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vtmwx\" (UniqueName: \"kubernetes.io/projected/80900980-7b5e-4d15-a9db-279185d25b57-kube-api-access-vtmwx\") pod \"e2e-worker-w2-5c446c-openshift-default-797c6dc855-rtzkv\" (UID: \"80900980-7b5e-4d15-a9db-279185d25b57\") " pod="openshift-ingress/e2e-worker-w2-5c446c-openshift-default-797c6dc855-rtzkv"
Oct 31 17:41:17.087203 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:17.087134    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/80900980-7b5e-4d15-a9db-279185d25b57-istio-podinfo\") pod \"e2e-worker-w2-5c446c-openshift-default-797c6dc855-rtzkv\" (UID: \"80900980-7b5e-4d15-a9db-279185d25b57\") " pod="openshift-ingress/e2e-worker-w2-5c446c-openshift-default-797c6dc855-rtzkv"
Oct 31 17:41:17.087283 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:17.087214    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/80900980-7b5e-4d15-a9db-279185d25b57-istio-token\") pod \"e2e-worker-w2-5c446c-openshift-default-797c6dc855-rtzkv\" (UID: \"80900980-7b5e-4d15-a9db-279185d25b57\") " pod="openshift-ingress/e2e-worker-w2-5c446c-openshift-default-797c6dc855-rtzkv"
Oct 31 17:41:17.087340 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:17.087288    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/80900980-7b5e-4d15-a9db-279185d25b57-workload-socket\") pod \"e2e-worker-w2-5c446c-openshift-default-797c6dc855-rtzkv\" (UID: \"80900980-7b5e-4d15-a9db-279185d25b57\") " pod="openshift-ingress/e2e-worker-w2-5c446c-openshift-default-797c6dc855-rtzkv"
Oct 31 17:41:17.087400 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:17.087349    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/80900980-7b5e-4d15-a9db-279185d25b57-istiod-ca-cert\") pod \"e2e-worker-w2-5c446c-openshift-default-797c6dc855-rtzkv\" (UID: \"80900980-7b5e-4d15-a9db-279185d25b57\") " pod="openshift-ingress/e2e-worker-w2-5c446c-openshift-default-797c6dc855-rtzkv"
Oct 31 17:41:17.087455 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:17.087419    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/80900980-7b5e-4d15-a9db-279185d25b57-workload-certs\") pod \"e2e-worker-w2-5c446c-openshift-default-797c6dc855-rtzkv\" (UID: \"80900980-7b5e-4d15-a9db-279185d25b57\") " pod="openshift-ingress/e2e-worker-w2-5c446c-openshift-default-797c6dc855-rtzkv"
Oct 31 17:41:17.087455 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:17.087446    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/80900980-7b5e-4d15-a9db-279185d25b57-istio-envoy\") pod \"e2e-worker-w2-5c446c-openshift-default-797c6dc855-rtzkv\" (UID: \"80900980-7b5e-4d15-a9db-279185d25b57\") " pod="openshift-ingress/e2e-worker-w2-5c446c-openshift-default-797c6dc855-rtzkv"
Oct 31 17:41:17.087936 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:17.087782    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/80900980-7b5e-4d15-a9db-279185d25b57-credential-socket\") pod \"e2e-worker-w2-5c446c-openshift-default-797c6dc855-rtzkv\" (UID: \"80900980-7b5e-4d15-a9db-279185d25b57\") " pod="openshift-ingress/e2e-worker-w2-5c446c-openshift-default-797c6dc855-rtzkv"
Oct 31 17:41:17.087936 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:17.087830    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/80900980-7b5e-4d15-a9db-279185d25b57-istio-data\") pod \"e2e-worker-w2-5c446c-openshift-default-797c6dc855-rtzkv\" (UID: \"80900980-7b5e-4d15-a9db-279185d25b57\") " pod="openshift-ingress/e2e-worker-w2-5c446c-openshift-default-797c6dc855-rtzkv"
Oct 31 17:41:17.188892 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:17.188858    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/80900980-7b5e-4d15-a9db-279185d25b57-istio-podinfo\") pod \"e2e-worker-w2-5c446c-openshift-default-797c6dc855-rtzkv\" (UID: \"80900980-7b5e-4d15-a9db-279185d25b57\") " pod="openshift-ingress/e2e-worker-w2-5c446c-openshift-default-797c6dc855-rtzkv"
Oct 31 17:41:17.189060 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:17.188928    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/80900980-7b5e-4d15-a9db-279185d25b57-istio-token\") pod \"e2e-worker-w2-5c446c-openshift-default-797c6dc855-rtzkv\" (UID: \"80900980-7b5e-4d15-a9db-279185d25b57\") " pod="openshift-ingress/e2e-worker-w2-5c446c-openshift-default-797c6dc855-rtzkv"
Oct 31 17:41:17.189060 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:17.188988    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/80900980-7b5e-4d15-a9db-279185d25b57-workload-socket\") pod \"e2e-worker-w2-5c446c-openshift-default-797c6dc855-rtzkv\" (UID: \"80900980-7b5e-4d15-a9db-279185d25b57\") " pod="openshift-ingress/e2e-worker-w2-5c446c-openshift-default-797c6dc855-rtzkv"
Oct 31 17:41:17.189060 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:17.189034    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/80900980-7b5e-4d15-a9db-279185d25b57-istiod-ca-cert\") pod \"e2e-worker-w2-5c446c-openshift-default-797c6dc855-rtzkv\" (UID: \"80900980-7b5e-4d15-a9db-279185d25b57\") " pod="openshift-ingress/e2e-worker-w2-5c446c-openshift-default-797c6dc855-rtzkv"
Oct 31 17:41:17.189233 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:17.189067    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/80900980-7b5e-4d15-a9db-279185d25b57-workload-certs\") pod \"e2e-worker-w2-5c446c-openshift-default-797c6dc855-rtzkv\" (UID: \"80900980-7b5e-4d15-a9db-279185d25b57\") " pod="openshift-ingress/e2e-worker-w2-5c446c-openshift-default-797c6dc855-rtzkv"
Oct 31 17:41:17.189233 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:17.189096    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/80900980-7b5e-4d15-a9db-279185d25b57-istio-envoy\") pod \"e2e-worker-w2-5c446c-openshift-default-797c6dc855-rtzkv\" (UID: \"80900980-7b5e-4d15-a9db-279185d25b57\") " pod="openshift-ingress/e2e-worker-w2-5c446c-openshift-default-797c6dc855-rtzkv"
Oct 31 17:41:17.189344 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:17.189230    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/80900980-7b5e-4d15-a9db-279185d25b57-credential-socket\") pod \"e2e-worker-w2-5c446c-openshift-default-797c6dc855-rtzkv\" (UID: \"80900980-7b5e-4d15-a9db-279185d25b57\") " pod="openshift-ingress/e2e-worker-w2-5c446c-openshift-default-797c6dc855-rtzkv"
Oct 31 17:41:17.189344 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:17.189265    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/80900980-7b5e-4d15-a9db-279185d25b57-istio-data\") pod \"e2e-worker-w2-5c446c-openshift-default-797c6dc855-rtzkv\" (UID: \"80900980-7b5e-4d15-a9db-279185d25b57\") " pod="openshift-ingress/e2e-worker-w2-5c446c-openshift-default-797c6dc855-rtzkv"
Oct 31 17:41:17.189443 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:17.189376    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vtmwx\" (UniqueName: \"kubernetes.io/projected/80900980-7b5e-4d15-a9db-279185d25b57-kube-api-access-vtmwx\") pod \"e2e-worker-w2-5c446c-openshift-default-797c6dc855-rtzkv\" (UID: \"80900980-7b5e-4d15-a9db-279185d25b57\") " pod="openshift-ingress/e2e-worker-w2-5c446c-openshift-default-797c6dc855-rtzkv"
Oct 31 17:41:17.189656 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:17.189591    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/80900980-7b5e-4d15-a9db-279185d25b57-workload-certs\") pod \"e2e-worker-w2-5c446c-openshift-default-797c6dc855-rtzkv\" (UID: \"80900980-7b5e-4d15-a9db-279185d25b57\") " pod="openshift-ingress/e2e-worker-w2-5c446c-openshift-default-797c6dc855-rtzkv"
Oct 31 17:41:17.189785 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:17.189699    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/80900980-7b5e-4d15-a9db-279185d25b57-credential-socket\") pod \"e2e-worker-w2-5c446c-openshift-default-797c6dc855-rtzkv\" (UID: \"80900980-7b5e-4d15-a9db-279185d25b57\") " pod="openshift-ingress/e2e-worker-w2-5c446c-openshift-default-797c6dc855-rtzkv"
Oct 31 17:41:17.189862 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:17.189790    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/80900980-7b5e-4d15-a9db-279185d25b57-istio-data\") pod \"e2e-worker-w2-5c446c-openshift-default-797c6dc855-rtzkv\" (UID: \"80900980-7b5e-4d15-a9db-279185d25b57\") " pod="openshift-ingress/e2e-worker-w2-5c446c-openshift-default-797c6dc855-rtzkv"
Oct 31 17:41:17.190008 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:17.189981    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/80900980-7b5e-4d15-a9db-279185d25b57-istiod-ca-cert\") pod \"e2e-worker-w2-5c446c-openshift-default-797c6dc855-rtzkv\" (UID: \"80900980-7b5e-4d15-a9db-279185d25b57\") " pod="openshift-ingress/e2e-worker-w2-5c446c-openshift-default-797c6dc855-rtzkv"
Oct 31 17:41:17.190253 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:17.190230    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/80900980-7b5e-4d15-a9db-279185d25b57-workload-socket\") pod \"e2e-worker-w2-5c446c-openshift-default-797c6dc855-rtzkv\" (UID: \"80900980-7b5e-4d15-a9db-279185d25b57\") " pod="openshift-ingress/e2e-worker-w2-5c446c-openshift-default-797c6dc855-rtzkv"
Oct 31 17:41:17.192905 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:17.191763    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/80900980-7b5e-4d15-a9db-279185d25b57-istio-envoy\") pod \"e2e-worker-w2-5c446c-openshift-default-797c6dc855-rtzkv\" (UID: \"80900980-7b5e-4d15-a9db-279185d25b57\") " pod="openshift-ingress/e2e-worker-w2-5c446c-openshift-default-797c6dc855-rtzkv"
Oct 31 17:41:17.192905 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:17.191943    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/80900980-7b5e-4d15-a9db-279185d25b57-istio-podinfo\") pod \"e2e-worker-w2-5c446c-openshift-default-797c6dc855-rtzkv\" (UID: \"80900980-7b5e-4d15-a9db-279185d25b57\") " pod="openshift-ingress/e2e-worker-w2-5c446c-openshift-default-797c6dc855-rtzkv"
Oct 31 17:41:17.207244 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:17.207214    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/80900980-7b5e-4d15-a9db-279185d25b57-istio-token\") pod \"e2e-worker-w2-5c446c-openshift-default-797c6dc855-rtzkv\" (UID: \"80900980-7b5e-4d15-a9db-279185d25b57\") " pod="openshift-ingress/e2e-worker-w2-5c446c-openshift-default-797c6dc855-rtzkv"
Oct 31 17:41:17.208292 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:17.208266    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vtmwx\" (UniqueName: \"kubernetes.io/projected/80900980-7b5e-4d15-a9db-279185d25b57-kube-api-access-vtmwx\") pod \"e2e-worker-w2-5c446c-openshift-default-797c6dc855-rtzkv\" (UID: \"80900980-7b5e-4d15-a9db-279185d25b57\") " pod="openshift-ingress/e2e-worker-w2-5c446c-openshift-default-797c6dc855-rtzkv"
Oct 31 17:41:17.381187 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:17.381156    5003 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-5c446c-openshift-default-797c6dc855-rtzkv"
Oct 31 17:41:17.699630 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:17.699596    5003 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w2-5c446c-openshift-default-797c6dc855-rtzkv"]
Oct 31 17:41:17.701552 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:41:17.701523    5003 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod80900980_7b5e_4d15_a9db_279185d25b57.slice/crio-b44bddaaa36e4a55159d5ad187508002f81f9a5714031313869850d8a1769513 WatchSource:0}: Error finding container b44bddaaa36e4a55159d5ad187508002f81f9a5714031313869850d8a1769513: Status 404 returned error can't find the container with id b44bddaaa36e4a55159d5ad187508002f81f9a5714031313869850d8a1769513
Oct 31 17:41:17.704054 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:17.704015    5003 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Oct 31 17:41:17.704157 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:17.704084    5003 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Oct 31 17:41:17.704157 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:17.704116    5003 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Oct 31 17:41:18.509381 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:18.509338    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-5c446c-openshift-default-797c6dc855-rtzkv" event={"ID":"80900980-7b5e-4d15-a9db-279185d25b57","Type":"ContainerStarted","Data":"1f3b2bf06f9049ce80d34c68d2cf5be1c701f068ac3e2d6d9ee9d5463b12eb29"}
Oct 31 17:41:18.509816 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:18.509443    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-5c446c-openshift-default-797c6dc855-rtzkv" event={"ID":"80900980-7b5e-4d15-a9db-279185d25b57","Type":"ContainerStarted","Data":"b44bddaaa36e4a55159d5ad187508002f81f9a5714031313869850d8a1769513"}
Oct 31 17:41:18.566314 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:18.565425    5003 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w2-5c446c-openshift-default-797c6dc855-rtzkv" podStartSLOduration=2.565402413 podStartE2EDuration="2.565402413s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 17:41:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 17:41:18.5615271 +0000 UTC m=+846.816381666" watchObservedRunningTime="2026-10-31 17:41:18.565402413 +0000 UTC m=+846.820256957"
Oct 31 17:41:19.382062 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:19.382023    5003 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w2-5c446c-openshift-default-797c6dc855-rtzkv"
Oct 31 17:41:19.384066 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:19.384037    5003 patch_prober.go:29] interesting pod/e2e-worker-w2-5c446c-openshift-default-797c6dc855-rtzkv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.106:15021/healthz/ready\": dial tcp 10.132.0.106:15021: connect: connection refused" start-of-body=
Oct 31 17:41:19.384200 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:19.384099    5003 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-5c446c-openshift-default-797c6dc855-rtzkv" podUID="80900980-7b5e-4d15-a9db-279185d25b57" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.106:15021/healthz/ready\": dial tcp 10.132.0.106:15021: connect: connection refused"
Oct 31 17:41:20.195476 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:20.195439    5003 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-3705b2f7-xc7d9"]
Oct 31 17:41:20.199995 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:20.199974    5003 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-3705b2f7-xc7d9"
Oct 31 17:41:20.216474 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:20.216449    5003 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-3705b2f7-xc7d9"]
Oct 31 17:41:20.223321 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:20.223295    5003 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\""
Oct 31 17:41:20.223546 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:20.223526    5003 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-mr9x2\""
Oct 31 17:41:20.232557 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:20.232534    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/a5fb95e3-c3f5-4a7f-be50-57dbe873b509-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-3705b2f7-xc7d9\" (UID: \"a5fb95e3-c3f5-4a7f-be50-57dbe873b509\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-3705b2f7-xc7d9"
Oct 31 17:41:20.232841 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:20.232818    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kcjn2\" (UniqueName: \"kubernetes.io/projected/a5fb95e3-c3f5-4a7f-be50-57dbe873b509-kube-api-access-kcjn2\") pod \"maas-api-revoke-sub-3705b2f7-xc7d9\" (UID: \"a5fb95e3-c3f5-4a7f-be50-57dbe873b509\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-3705b2f7-xc7d9"
Oct 31 17:41:20.232983 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:20.232967    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/a5fb95e3-c3f5-4a7f-be50-57dbe873b509-maas-api-xks-ca\") pod \"maas-api-revoke-sub-3705b2f7-xc7d9\" (UID: \"a5fb95e3-c3f5-4a7f-be50-57dbe873b509\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-3705b2f7-xc7d9"
Oct 31 17:41:20.334103 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:20.334063    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/a5fb95e3-c3f5-4a7f-be50-57dbe873b509-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-3705b2f7-xc7d9\" (UID: \"a5fb95e3-c3f5-4a7f-be50-57dbe873b509\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-3705b2f7-xc7d9"
Oct 31 17:41:20.334308 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:20.334245    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kcjn2\" (UniqueName: \"kubernetes.io/projected/a5fb95e3-c3f5-4a7f-be50-57dbe873b509-kube-api-access-kcjn2\") pod \"maas-api-revoke-sub-3705b2f7-xc7d9\" (UID: \"a5fb95e3-c3f5-4a7f-be50-57dbe873b509\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-3705b2f7-xc7d9"
Oct 31 17:41:20.334388 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:20.334343    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/a5fb95e3-c3f5-4a7f-be50-57dbe873b509-maas-api-xks-ca\") pod \"maas-api-revoke-sub-3705b2f7-xc7d9\" (UID: \"a5fb95e3-c3f5-4a7f-be50-57dbe873b509\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-3705b2f7-xc7d9"
Oct 31 17:41:20.334829 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:20.334800    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/a5fb95e3-c3f5-4a7f-be50-57dbe873b509-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-3705b2f7-xc7d9\" (UID: \"a5fb95e3-c3f5-4a7f-be50-57dbe873b509\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-3705b2f7-xc7d9"
Oct 31 17:41:20.336752 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:20.336730    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/a5fb95e3-c3f5-4a7f-be50-57dbe873b509-maas-api-xks-ca\") pod \"maas-api-revoke-sub-3705b2f7-xc7d9\" (UID: \"a5fb95e3-c3f5-4a7f-be50-57dbe873b509\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-3705b2f7-xc7d9"
Oct 31 17:41:20.380562 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:20.380498    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kcjn2\" (UniqueName: \"kubernetes.io/projected/a5fb95e3-c3f5-4a7f-be50-57dbe873b509-kube-api-access-kcjn2\") pod \"maas-api-revoke-sub-3705b2f7-xc7d9\" (UID: \"a5fb95e3-c3f5-4a7f-be50-57dbe873b509\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-3705b2f7-xc7d9"
Oct 31 17:41:20.382382 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:20.382353    5003 patch_prober.go:29] interesting pod/e2e-worker-w2-5c446c-openshift-default-797c6dc855-rtzkv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.106:15021/healthz/ready\": dial tcp 10.132.0.106:15021: connect: connection refused" start-of-body=
Oct 31 17:41:20.382505 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:20.382421    5003 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-5c446c-openshift-default-797c6dc855-rtzkv" podUID="80900980-7b5e-4d15-a9db-279185d25b57" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.106:15021/healthz/ready\": dial tcp 10.132.0.106:15021: connect: connection refused"
Oct 31 17:41:20.514873 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:20.514789    5003 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-3705b2f7-xc7d9"
Oct 31 17:41:20.850849 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:20.850778    5003 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-3705b2f7-xc7d9"]
Oct 31 17:41:21.384090 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:21.384051    5003 patch_prober.go:29] interesting pod/e2e-worker-w2-5c446c-openshift-default-797c6dc855-rtzkv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.106:15021/healthz/ready\": dial tcp 10.132.0.106:15021: connect: connection refused" start-of-body=
Oct 31 17:41:21.384578 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:21.384117    5003 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-5c446c-openshift-default-797c6dc855-rtzkv" podUID="80900980-7b5e-4d15-a9db-279185d25b57" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.106:15021/healthz/ready\": dial tcp 10.132.0.106:15021: connect: connection refused"
Oct 31 17:41:21.534455 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:21.534414    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-3705b2f7-xc7d9" event={"ID":"a5fb95e3-c3f5-4a7f-be50-57dbe873b509","Type":"ContainerStarted","Data":"5a25a847de92635875231168a3e91a82070867a446a1bd020b185e6ba3dda605"}
Oct 31 17:41:21.534687 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:21.534482    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-3705b2f7-xc7d9" event={"ID":"a5fb95e3-c3f5-4a7f-be50-57dbe873b509","Type":"ContainerStarted","Data":"e64446ab048e849832dcf32aebbc4eaf6be4d994fe84c3b09c4fc6d0e7c6d140"}
Oct 31 17:41:21.580027 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:21.579971    5003 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-sub-3705b2f7-xc7d9" podStartSLOduration=1.5799575959999999 podStartE2EDuration="1.579957596s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 17:41:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 17:41:21.579564954 +0000 UTC m=+849.834419497" watchObservedRunningTime="2026-10-31 17:41:21.579957596 +0000 UTC m=+849.834812173"
Oct 31 17:41:22.382339 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:22.382201    5003 patch_prober.go:29] interesting pod/e2e-worker-w2-5c446c-openshift-default-797c6dc855-rtzkv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.106:15021/healthz/ready\": dial tcp 10.132.0.106:15021: connect: connection refused" start-of-body=
Oct 31 17:41:22.382339 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:22.382269    5003 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-5c446c-openshift-default-797c6dc855-rtzkv" podUID="80900980-7b5e-4d15-a9db-279185d25b57" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.106:15021/healthz/ready\": dial tcp 10.132.0.106:15021: connect: connection refused"
Oct 31 17:41:22.543838 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:22.543798    5003 generic.go:356] "Generic (PLEG): container finished" podID="a5fb95e3-c3f5-4a7f-be50-57dbe873b509" containerID="5a25a847de92635875231168a3e91a82070867a446a1bd020b185e6ba3dda605" exitCode=0
Oct 31 17:41:22.544215 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:22.543834    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-3705b2f7-xc7d9" event={"ID":"a5fb95e3-c3f5-4a7f-be50-57dbe873b509","Type":"ContainerDied","Data":"5a25a847de92635875231168a3e91a82070867a446a1bd020b185e6ba3dda605"}
Oct 31 17:41:23.385669 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:23.385043    5003 patch_prober.go:29] interesting pod/e2e-worker-w2-5c446c-openshift-default-797c6dc855-rtzkv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.106:15021/healthz/ready\": dial tcp 10.132.0.106:15021: connect: connection refused" start-of-body=
Oct 31 17:41:23.385669 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:23.385123    5003 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-5c446c-openshift-default-797c6dc855-rtzkv" podUID="80900980-7b5e-4d15-a9db-279185d25b57" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.106:15021/healthz/ready\": dial tcp 10.132.0.106:15021: connect: connection refused"
Oct 31 17:41:23.962019 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:23.961978    5003 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-3705b2f7-xc7d9"
Oct 31 17:41:24.061414 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:24.061363    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/a5fb95e3-c3f5-4a7f-be50-57dbe873b509-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/a5fb95e3-c3f5-4a7f-be50-57dbe873b509-maas-api-openshift-ca\") pod \"a5fb95e3-c3f5-4a7f-be50-57dbe873b509\" (UID: \"a5fb95e3-c3f5-4a7f-be50-57dbe873b509\") "
Oct 31 17:41:24.061598 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:24.061500    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/a5fb95e3-c3f5-4a7f-be50-57dbe873b509-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/a5fb95e3-c3f5-4a7f-be50-57dbe873b509-maas-api-xks-ca\") pod \"a5fb95e3-c3f5-4a7f-be50-57dbe873b509\" (UID: \"a5fb95e3-c3f5-4a7f-be50-57dbe873b509\") "
Oct 31 17:41:24.061598 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:24.061587    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/a5fb95e3-c3f5-4a7f-be50-57dbe873b509-kube-api-access-kcjn2\" (UniqueName: \"kubernetes.io/projected/a5fb95e3-c3f5-4a7f-be50-57dbe873b509-kube-api-access-kcjn2\") pod \"a5fb95e3-c3f5-4a7f-be50-57dbe873b509\" (UID: \"a5fb95e3-c3f5-4a7f-be50-57dbe873b509\") "
Oct 31 17:41:24.062915 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:24.062831    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a5fb95e3-c3f5-4a7f-be50-57dbe873b509-maas-api-openshift-ca" pod "a5fb95e3-c3f5-4a7f-be50-57dbe873b509" (UID: "a5fb95e3-c3f5-4a7f-be50-57dbe873b509"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 17:41:24.065057 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:24.064982    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a5fb95e3-c3f5-4a7f-be50-57dbe873b509-kube-api-access-kcjn2" pod "a5fb95e3-c3f5-4a7f-be50-57dbe873b509" (UID: "a5fb95e3-c3f5-4a7f-be50-57dbe873b509"). InnerVolumeSpecName "kube-api-access-kcjn2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 17:41:24.065667 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:24.065621    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a5fb95e3-c3f5-4a7f-be50-57dbe873b509-maas-api-xks-ca" pod "a5fb95e3-c3f5-4a7f-be50-57dbe873b509" (UID: "a5fb95e3-c3f5-4a7f-be50-57dbe873b509"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 17:41:24.164008 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:24.163961    5003 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kcjn2\" (UniqueName: \"kubernetes.io/projected/a5fb95e3-c3f5-4a7f-be50-57dbe873b509-kube-api-access-kcjn2\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:41:24.164008 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:24.164001    5003 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/a5fb95e3-c3f5-4a7f-be50-57dbe873b509-maas-api-openshift-ca\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:41:24.164008 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:24.164017    5003 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/a5fb95e3-c3f5-4a7f-be50-57dbe873b509-maas-api-xks-ca\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:41:24.382206 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:24.382108    5003 patch_prober.go:29] interesting pod/e2e-worker-w2-5c446c-openshift-default-797c6dc855-rtzkv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.106:15021/healthz/ready\": dial tcp 10.132.0.106:15021: connect: connection refused" start-of-body=
Oct 31 17:41:24.382625 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:24.382590    5003 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-5c446c-openshift-default-797c6dc855-rtzkv" podUID="80900980-7b5e-4d15-a9db-279185d25b57" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.106:15021/healthz/ready\": dial tcp 10.132.0.106:15021: connect: connection refused"
Oct 31 17:41:24.677227 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:24.665532    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-3705b2f7-xc7d9" event={"ID":"a5fb95e3-c3f5-4a7f-be50-57dbe873b509","Type":"ContainerDied","Data":"e64446ab048e849832dcf32aebbc4eaf6be4d994fe84c3b09c4fc6d0e7c6d140"}
Oct 31 17:41:24.677227 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:24.665601    5003 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e64446ab048e849832dcf32aebbc4eaf6be4d994fe84c3b09c4fc6d0e7c6d140"
Oct 31 17:41:24.677227 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:24.665695    5003 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-3705b2f7-xc7d9"
Oct 31 17:41:25.127669 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:25.120789    5003 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-dbda3009-9f59b"]
Oct 31 17:41:25.160019 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:25.159987    5003 cpu_manager.go:414] "containerMap: removing container" podUID="a5fb95e3-c3f5-4a7f-be50-57dbe873b509" containerName="revoke-keys"
Oct 31 17:41:25.203671 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:25.181370    5003 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="a5fb95e3-c3f5-4a7f-be50-57dbe873b509" containerName="revoke-keys"
Oct 31 17:41:25.203671 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:25.181663    5003 memory_manager.go:365] "RemoveStaleState removing state" podUID="a5fb95e3-c3f5-4a7f-be50-57dbe873b509" containerName="revoke-keys"
Oct 31 17:41:25.203671 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:25.200889    5003 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-dbda3009-9f59b"]
Oct 31 17:41:25.203671 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:25.201804    5003 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-dbda3009-9f59b"
Oct 31 17:41:25.298672 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:25.253510    5003 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\""
Oct 31 17:41:25.319437 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:25.269580    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l65b4\" (UniqueName: \"kubernetes.io/projected/f7cd4b4e-96aa-4c97-806b-0737872186e1-kube-api-access-l65b4\") pod \"maas-api-revoke-sub-dbda3009-9f59b\" (UID: \"f7cd4b4e-96aa-4c97-806b-0737872186e1\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-dbda3009-9f59b"
Oct 31 17:41:25.602780 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:25.602733    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/f7cd4b4e-96aa-4c97-806b-0737872186e1-maas-api-xks-ca\") pod \"maas-api-revoke-sub-dbda3009-9f59b\" (UID: \"f7cd4b4e-96aa-4c97-806b-0737872186e1\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-dbda3009-9f59b"
Oct 31 17:41:25.603281 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:25.603253    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/f7cd4b4e-96aa-4c97-806b-0737872186e1-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-dbda3009-9f59b\" (UID: \"f7cd4b4e-96aa-4c97-806b-0737872186e1\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-dbda3009-9f59b"
Oct 31 17:41:25.611669 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:25.269851    5003 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-mr9x2\""
Oct 31 17:41:25.818706 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:25.744588    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l65b4\" (UniqueName: \"kubernetes.io/projected/f7cd4b4e-96aa-4c97-806b-0737872186e1-kube-api-access-l65b4\") pod \"maas-api-revoke-sub-dbda3009-9f59b\" (UID: \"f7cd4b4e-96aa-4c97-806b-0737872186e1\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-dbda3009-9f59b"
Oct 31 17:41:25.819036 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:25.819003    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/f7cd4b4e-96aa-4c97-806b-0737872186e1-maas-api-xks-ca\") pod \"maas-api-revoke-sub-dbda3009-9f59b\" (UID: \"f7cd4b4e-96aa-4c97-806b-0737872186e1\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-dbda3009-9f59b"
Oct 31 17:41:25.819488 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:25.819460    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/f7cd4b4e-96aa-4c97-806b-0737872186e1-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-dbda3009-9f59b\" (UID: \"f7cd4b4e-96aa-4c97-806b-0737872186e1\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-dbda3009-9f59b"
Oct 31 17:41:25.846548 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:25.845772    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/f7cd4b4e-96aa-4c97-806b-0737872186e1-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-dbda3009-9f59b\" (UID: \"f7cd4b4e-96aa-4c97-806b-0737872186e1\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-dbda3009-9f59b"
Oct 31 17:41:25.943294 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:25.943214    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/f7cd4b4e-96aa-4c97-806b-0737872186e1-maas-api-xks-ca\") pod \"maas-api-revoke-sub-dbda3009-9f59b\" (UID: \"f7cd4b4e-96aa-4c97-806b-0737872186e1\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-dbda3009-9f59b"
Oct 31 17:41:25.943596 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:25.943560    5003 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-1c0bfd/premium-w4-1c0bfd-kserve-d78fbb98-psx55" podUID="34bdffed-87b8-4e7a-b182-f069d081bd62" containerName="main" probeResult="failure" output="Get \"https://10.132.0.74:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 31 17:41:26.010671 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:25.990574    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l65b4\" (UniqueName: \"kubernetes.io/projected/f7cd4b4e-96aa-4c97-806b-0737872186e1-kube-api-access-l65b4\") pod \"maas-api-revoke-sub-dbda3009-9f59b\" (UID: \"f7cd4b4e-96aa-4c97-806b-0737872186e1\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-dbda3009-9f59b"
Oct 31 17:41:26.215726 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:26.215542    5003 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-b78c31/distinct-2-w5-b78c31-kserve-5f4f9d4bb5-ss7g2" podUID="9cc6d7e8-30de-4173-9974-1f1a4fd08e1c" containerName="main" probeResult="failure" output="Get \"https://10.132.0.99:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 31 17:41:26.278936 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:26.278725    5003 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-5c446c/premium-w2-5c446c-kserve-66f7486c85-f7lk2" podUID="9c2ddfab-2348-4bb0-8844-1fca62460390" containerName="main" probeResult="failure" output="Get \"https://10.132.0.75:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 31 17:41:26.431673 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:26.370513    5003 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-dbda3009-9f59b"
Oct 31 17:41:26.578034 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:26.577983    5003 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-b78c31/simulator-w5-b78c31-kserve-95df74778-fpvpr" podUID="665d75c7-8ba5-49e1-87a7-51a18ae6f369" containerName="main" probeResult="failure" output="Get \"https://10.132.0.73:8000/ready\": context deadline exceeded"
Oct 31 17:41:26.589671 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:26.578616    5003 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w5-b78c31/distinct-w5-b78c31-kserve-77ccb69d98-p2zct" podUID="fcf01e9c-57fb-42db-848d-d314c615bd67" containerName="main" probeResult="failure" output="Get \"https://10.132.0.93:8000/health\": context deadline exceeded"
Oct 31 17:41:26.604680 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:26.591061    5003 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-ee816e/distinct-w0-ee816e-kserve-564f897f89-kglpl" podUID="82b982f8-de44-449d-b4a6-dc8f5824bf35" containerName="main" probeResult="failure" output="Get \"https://10.132.0.91:8000/ready\": context deadline exceeded"
Oct 31 17:41:26.663930 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:26.663876    5003 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-b78c31/distinct-w5-b78c31-kserve-77ccb69d98-p2zct" podUID="fcf01e9c-57fb-42db-848d-d314c615bd67" containerName="main" probeResult="failure" output="Get \"https://10.132.0.93:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 31 17:41:26.743672 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:26.713795    5003 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-0e59ca/simulator-w1-0e59ca-kserve-999765679-zs7kh" podUID="018d423e-6866-4b61-a4a2-d2e786d82bf0" containerName="main" probeResult="failure" output="Get \"https://10.132.0.71:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 31 17:41:26.743672 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:26.732029    5003 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-ee816e/simulator-w0-ee816e-kserve-5bd4657dc-9rlm4" podUID="620f499f-36d7-4900-abbe-98ee5cf5d96c" containerName="main" probeResult="failure" output="Get \"https://10.132.0.72:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 31 17:41:26.744112 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:26.676378    5003 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-1c0bfd/distinct-w4-1c0bfd-kserve-867858548f-46gwg" podUID="93f16294-fc40-477d-90b3-d02640037d5b" containerName="main" probeResult="failure" output="Get \"https://10.132.0.94:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 31 17:41:26.799671 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:26.788015    5003 prober.go:122] "Probe failed" probeType="Readiness" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-82w89" podUID="ef5a065b-f98e-4d14-810f-2d0c42c58ce6" containerName="main" probeResult="failure" output="Get \"https://10.132.0.54:8000/ready\": context deadline exceeded"
Oct 31 17:41:26.871918 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:26.871822    5003 patch_prober.go:29] interesting pod/e2e-worker-w2-5c446c-openshift-default-797c6dc855-rtzkv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.106:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 31 17:41:26.872172 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:26.872140    5003 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-5c446c-openshift-default-797c6dc855-rtzkv" podUID="80900980-7b5e-4d15-a9db-279185d25b57" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.106:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 31 17:41:26.966293 ip-10-0-138-17 kubenswrapper[5003]: E1031 17:41:26.966255    5003 kubelet.go:2711] "Housekeeping took longer than expected" err="housekeeping took too long" expected="1s" actual="1.034s"
Oct 31 17:41:27.188670 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:27.005720    5003 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-1c0bfd/premium-w4-1c0bfd-kserve-d78fbb98-psx55" podUID="34bdffed-87b8-4e7a-b182-f069d081bd62" containerName="main" probeResult="failure" output="Get \"https://10.132.0.74:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 31 17:41:27.214829 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:27.214787    5003 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w4-1c0bfd/premium-w4-1c0bfd-kserve-d78fbb98-psx55"
Oct 31 17:41:27.215289 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:27.016444    5003 patch_prober.go:29] interesting pod/e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-bpm5b container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.84:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 31 17:41:27.215414 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:27.215328    5003 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-bpm5b" podUID="9bf16293-fd1c-421b-9f91-3c7178ed7cd3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.84:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 31 17:41:27.215414 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:27.013708    5003 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w5-b78c31/simulator-w5-b78c31-kserve-95df74778-fpvpr" podUID="665d75c7-8ba5-49e1-87a7-51a18ae6f369" containerName="main" probeResult="failure" output="Get \"https://10.132.0.73:8000/health\": context deadline exceeded"
Oct 31 17:41:27.340468 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:27.340423    5003 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-5c446c/premium-w2-5c446c-kserve-66f7486c85-f7lk2" podUID="9c2ddfab-2348-4bb0-8844-1fca62460390" containerName="main" probeResult="failure" output="Get \"https://10.132.0.75:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 31 17:41:27.368389 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:27.368345    5003 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-b78c31/distinct-2-w5-b78c31-kserve-5f4f9d4bb5-ss7g2" podUID="9cc6d7e8-30de-4173-9974-1f1a4fd08e1c" containerName="main" probeResult="failure" output="Get \"https://10.132.0.99:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 31 17:41:27.380675 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:27.369231    5003 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w2-5c446c/premium-w2-5c446c-kserve-66f7486c85-f7lk2"
Oct 31 17:41:27.384673 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:27.380983    5003 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w5-b78c31/distinct-2-w5-b78c31-kserve-5f4f9d4bb5-ss7g2"
Oct 31 17:41:27.617721 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:27.617664    5003 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-ee816e/distinct-w0-ee816e-kserve-564f897f89-kglpl" podUID="82b982f8-de44-449d-b4a6-dc8f5824bf35" containerName="main" probeResult="failure" output="Get \"https://10.132.0.91:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 31 17:41:27.619877 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:27.618383    5003 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-b78c31/simulator-w5-b78c31-kserve-95df74778-fpvpr" podUID="665d75c7-8ba5-49e1-87a7-51a18ae6f369" containerName="main" probeResult="failure" output="Get \"https://10.132.0.73:8000/ready\": context deadline exceeded"
Oct 31 17:41:27.619877 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:27.618853    5003 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w0-ee816e/distinct-w0-ee816e-kserve-564f897f89-kglpl"
Oct 31 17:41:27.619877 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:27.618915    5003 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w5-b78c31/simulator-w5-b78c31-kserve-95df74778-fpvpr"
Oct 31 17:41:27.661773 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:27.661734    5003 patch_prober.go:29] interesting pod/e2e-worker-w0-ee816e-openshift-default-c4db85b5c-qm655 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.97:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 31 17:41:27.662085 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:27.662050    5003 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w0-ee816e-openshift-default-c4db85b5c-qm655" podUID="d2652cf4-9d2a-480e-ad8a-946d0d4b90f3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.97:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 31 17:41:27.719750 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:27.714828    5003 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-0e59ca/simulator-w1-0e59ca-kserve-999765679-zs7kh" podUID="018d423e-6866-4b61-a4a2-d2e786d82bf0" containerName="main" probeResult="failure" output="Get \"https://10.132.0.71:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 31 17:41:27.719750 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:27.715093    5003 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w1-0e59ca/simulator-w1-0e59ca-kserve-999765679-zs7kh"
Oct 31 17:41:27.783733 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:27.760344    5003 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-1c0bfd/distinct-w4-1c0bfd-kserve-867858548f-46gwg" podUID="93f16294-fc40-477d-90b3-d02640037d5b" containerName="main" probeResult="failure" output="Get \"https://10.132.0.94:8000/ready\": context deadline exceeded"
Oct 31 17:41:27.783733 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:27.760671    5003 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w4-1c0bfd/distinct-w4-1c0bfd-kserve-867858548f-46gwg"
Oct 31 17:41:27.832671 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:27.814736    5003 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w0-ee816e/simulator-w0-ee816e-kserve-5bd4657dc-9rlm4" podUID="620f499f-36d7-4900-abbe-98ee5cf5d96c" containerName="main" probeResult="failure" output="Get \"https://10.132.0.72:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 31 17:41:27.985119 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:27.985082    5003 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w2-5c446c-openshift-default-797c6dc855-rtzkv"
Oct 31 17:41:28.161754 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:28.092754    5003 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-b78c31/distinct-w5-b78c31-kserve-77ccb69d98-p2zct" podUID="fcf01e9c-57fb-42db-848d-d314c615bd67" containerName="main" probeResult="failure" output="Get \"https://10.132.0.93:8000/ready\": context deadline exceeded"
Oct 31 17:41:28.161754 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:28.123027    5003 prober.go:122] "Probe failed" probeType="Readiness" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-82w89" podUID="ef5a065b-f98e-4d14-810f-2d0c42c58ce6" containerName="main" probeResult="failure" output="Get \"https://10.132.0.54:8000/ready\": context deadline exceeded"
Oct 31 17:41:28.161754 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:28.148254    5003 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w2-5c446c-openshift-default-797c6dc855-rtzkv"
Oct 31 17:41:28.161754 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:28.149332    5003 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w5-b78c31/distinct-w5-b78c31-kserve-77ccb69d98-p2zct"
Oct 31 17:41:28.259753 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:28.191730    5003 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w2-5c446c/premium-w2-5c446c-kserve-66f7486c85-f7lk2" podUID="9c2ddfab-2348-4bb0-8844-1fca62460390" containerName="main" probeResult="failure" output="Get \"https://10.132.0.75:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 31 17:41:28.259753 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:28.195687    5003 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-ee816e/simulator-w0-ee816e-kserve-5bd4657dc-9rlm4" podUID="620f499f-36d7-4900-abbe-98ee5cf5d96c" containerName="main" probeResult="failure" output="Get \"https://10.132.0.72:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 31 17:41:28.259753 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:28.238868    5003 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-1c0bfd/premium-w4-1c0bfd-kserve-d78fbb98-psx55" podUID="34bdffed-87b8-4e7a-b182-f069d081bd62" containerName="main" probeResult="failure" output="Get \"https://10.132.0.74:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 31 17:41:28.405684 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:28.403787    5003 patch_prober.go:29] interesting pod/e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-mst4q container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.103:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 31 17:41:28.405684 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:28.403862    5003 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-mst4q" podUID="fa5b3d0d-4ae9-4f60-8af5-571df26ba157" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.103:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 31 17:41:28.414820 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:28.414716    5003 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-b78c31/distinct-2-w5-b78c31-kserve-5f4f9d4bb5-ss7g2" podUID="9cc6d7e8-30de-4173-9974-1f1a4fd08e1c" containerName="main" probeResult="failure" output="Get \"https://10.132.0.99:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 31 17:41:28.838670 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:28.420818    5003 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-5c446c/premium-w2-5c446c-kserve-66f7486c85-f7lk2" podUID="9c2ddfab-2348-4bb0-8844-1fca62460390" containerName="main" probeResult="failure" output="Get \"https://10.132.0.75:8000/ready\": context deadline exceeded"
Oct 31 17:41:28.838670 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:28.585740    5003 patch_prober.go:29] interesting pod/e2e-worker-w0-ee816e-openshift-default-c4db85b5c-j7pfz container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.102:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 31 17:41:28.838670 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:28.789527    5003 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w0-ee816e-openshift-default-c4db85b5c-j7pfz" podUID="6c7cacb3-7045-4e9d-a2d6-9fabaa50af3d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.102:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 31 17:41:28.838670 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:28.625383    5003 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-ee816e/distinct-w0-ee816e-kserve-564f897f89-kglpl" podUID="82b982f8-de44-449d-b4a6-dc8f5824bf35" containerName="main" probeResult="failure" output="Get \"https://10.132.0.91:8000/ready\": context deadline exceeded"
Oct 31 17:41:28.838670 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:28.625116    5003 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-b78c31/simulator-w5-b78c31-kserve-95df74778-fpvpr" podUID="665d75c7-8ba5-49e1-87a7-51a18ae6f369" containerName="main" probeResult="failure" output="Get \"https://10.132.0.73:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 31 17:41:28.838670 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:28.726711    5003 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-0e59ca/simulator-w1-0e59ca-kserve-999765679-zs7kh" podUID="018d423e-6866-4b61-a4a2-d2e786d82bf0" containerName="main" probeResult="failure" output="Get \"https://10.132.0.71:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 31 17:41:28.838670 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:28.770004    5003 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-1c0bfd/distinct-w4-1c0bfd-kserve-867858548f-46gwg" podUID="93f16294-fc40-477d-90b3-d02640037d5b" containerName="main" probeResult="failure" output="Get \"https://10.132.0.94:8000/ready\": context deadline exceeded"
Oct 31 17:41:29.114765 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:29.098224    5003 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-b78c31/distinct-w5-b78c31-kserve-77ccb69d98-p2zct" podUID="fcf01e9c-57fb-42db-848d-d314c615bd67" containerName="main" probeResult="failure" output="Get \"https://10.132.0.93:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 31 17:41:29.158475 ip-10-0-138-17 kubenswrapper[5003]: E1031 17:41:29.152712    5003 kubelet.go:2711] "Housekeeping took longer than expected" err="housekeeping took too long" expected="1s" actual="1.003s"
Oct 31 17:41:29.158475 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:29.155711    5003 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-82w89"
Oct 31 17:41:29.158475 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:29.155797    5003 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w0-ee816e/simulator-w0-ee816e-kserve-5bd4657dc-9rlm4"
Oct 31 17:41:29.158475 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:29.155850    5003 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w2-5c446c-openshift-default-797c6dc855-rtzkv"
Oct 31 17:41:29.159271 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:29.159234    5003 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w4-1c0bfd/distinct-w4-1c0bfd-kserve-867858548f-46gwg" podUID="93f16294-fc40-477d-90b3-d02640037d5b" containerName="main" probeResult="failure" output="Get \"https://10.132.0.94:8000/health\": context deadline exceeded"
Oct 31 17:41:29.207229 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:29.207175    5003 prober.go:122] "Probe failed" probeType="Readiness" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-82w89" podUID="ef5a065b-f98e-4d14-810f-2d0c42c58ce6" containerName="main" probeResult="failure" output="Get \"https://10.132.0.54:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 31 17:41:29.224714 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:29.210737    5003 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-ee816e/simulator-w0-ee816e-kserve-5bd4657dc-9rlm4" podUID="620f499f-36d7-4900-abbe-98ee5cf5d96c" containerName="main" probeResult="failure" output="Get \"https://10.132.0.72:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 31 17:41:29.251775 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:29.251723    5003 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-1c0bfd/premium-w4-1c0bfd-kserve-d78fbb98-psx55" podUID="34bdffed-87b8-4e7a-b182-f069d081bd62" containerName="main" probeResult="failure" output="Get \"https://10.132.0.74:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 31 17:41:29.789818 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:29.789773    5003 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-5c446c/premium-w2-5c446c-kserve-66f7486c85-f7lk2" podUID="9c2ddfab-2348-4bb0-8844-1fca62460390" containerName="main" probeResult="failure" output="Get \"https://10.132.0.75:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 31 17:41:29.800100 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:29.793150    5003 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-0e59ca/simulator-w1-0e59ca-kserve-999765679-zs7kh" podUID="018d423e-6866-4b61-a4a2-d2e786d82bf0" containerName="main" probeResult="failure" output="Get \"https://10.132.0.71:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 31 17:41:29.800100 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:29.793879    5003 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-ee816e/distinct-w0-ee816e-kserve-564f897f89-kglpl" podUID="82b982f8-de44-449d-b4a6-dc8f5824bf35" containerName="main" probeResult="failure" output="Get \"https://10.132.0.91:8000/ready\": context deadline exceeded"
Oct 31 17:41:29.800422 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:29.800395    5003 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-b78c31/distinct-2-w5-b78c31-kserve-5f4f9d4bb5-ss7g2" podUID="9cc6d7e8-30de-4173-9974-1f1a4fd08e1c" containerName="main" probeResult="failure" output="Get \"https://10.132.0.99:8000/ready\": context deadline exceeded"
Oct 31 17:41:29.811668 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:29.802708    5003 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-b78c31/simulator-w5-b78c31-kserve-95df74778-fpvpr" podUID="665d75c7-8ba5-49e1-87a7-51a18ae6f369" containerName="main" probeResult="failure" output="Get \"https://10.132.0.73:8000/ready\": context deadline exceeded"
Oct 31 17:41:29.981615 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:29.946284    5003 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-1c0bfd/distinct-w4-1c0bfd-kserve-867858548f-46gwg" podUID="93f16294-fc40-477d-90b3-d02640037d5b" containerName="main" probeResult="failure" output="Get \"https://10.132.0.94:8000/ready\": context deadline exceeded"
Oct 31 17:41:30.169623 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:30.169595    5003 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-82w89"
Oct 31 17:41:30.169868 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:30.169854    5003 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w1-0e59ca/simulator-w1-0e59ca-kserve-999765679-zs7kh"
Oct 31 17:41:30.170058 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:30.170047    5003 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w5-b78c31/distinct-w5-b78c31-kserve-77ccb69d98-p2zct"
Oct 31 17:41:30.170186 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:30.170177    5003 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w0-ee816e/distinct-w0-ee816e-kserve-564f897f89-kglpl"
Oct 31 17:41:30.170299 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:30.170291    5003 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w5-b78c31/distinct-2-w5-b78c31-kserve-5f4f9d4bb5-ss7g2"
Oct 31 17:41:30.170411 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:30.170403    5003 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w0-ee816e/simulator-w0-ee816e-kserve-5bd4657dc-9rlm4"
Oct 31 17:41:30.170524 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:30.170516    5003 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w4-1c0bfd/distinct-w4-1c0bfd-kserve-867858548f-46gwg"
Oct 31 17:41:30.170684 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:30.170633    5003 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w2-5c446c/premium-w2-5c446c-kserve-66f7486c85-f7lk2"
Oct 31 17:41:30.192864 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:30.192837    5003 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w4-1c0bfd/premium-w4-1c0bfd-kserve-d78fbb98-psx55"
Oct 31 17:41:30.194586 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:30.194425    5003 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w5-b78c31/simulator-w5-b78c31-kserve-95df74778-fpvpr"
Oct 31 17:41:30.203195 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:30.203151    5003 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-dbda3009-9f59b"]
Oct 31 17:41:30.266055 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:30.265970    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-dbda3009-9f59b" event={"ID":"f7cd4b4e-96aa-4c97-806b-0737872186e1","Type":"ContainerStarted","Data":"fcf9745b9ae62a38fe13507fca8d7bdd1fbf72afcbe8daab19e385d844e08a8c"}
Oct 31 17:41:31.275803 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:31.275769    5003 generic.go:356] "Generic (PLEG): container finished" podID="f7cd4b4e-96aa-4c97-806b-0737872186e1" containerID="6bb022f8689624891554c0ad4e79a4d42f91c2e37c7cb2db9f5449a73fa9b965" exitCode=0
Oct 31 17:41:31.276180 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:31.275860    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-dbda3009-9f59b" event={"ID":"f7cd4b4e-96aa-4c97-806b-0737872186e1","Type":"ContainerDied","Data":"6bb022f8689624891554c0ad4e79a4d42f91c2e37c7cb2db9f5449a73fa9b965"}
Oct 31 17:41:31.708512 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:31.708476    5003 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w5-b78c31-openshift-default-774cb4f6c9-dr2b8"]
Oct 31 17:41:31.713111 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:31.713089    5003 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-b78c31-openshift-default-774cb4f6c9-dr2b8"
Oct 31 17:41:31.756823 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:31.756762    5003 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w5-b78c31-openshift-default-774cb4f6c9-dr2b8"]
Oct 31 17:41:31.861701 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:31.861668    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0711a80f-6f89-4949-aef2-a3281e637712-credential-socket\") pod \"e2e-worker-w5-b78c31-openshift-default-774cb4f6c9-dr2b8\" (UID: \"0711a80f-6f89-4949-aef2-a3281e637712\") " pod="openshift-ingress/e2e-worker-w5-b78c31-openshift-default-774cb4f6c9-dr2b8"
Oct 31 17:41:31.861886 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:31.861776    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0711a80f-6f89-4949-aef2-a3281e637712-workload-socket\") pod \"e2e-worker-w5-b78c31-openshift-default-774cb4f6c9-dr2b8\" (UID: \"0711a80f-6f89-4949-aef2-a3281e637712\") " pod="openshift-ingress/e2e-worker-w5-b78c31-openshift-default-774cb4f6c9-dr2b8"
Oct 31 17:41:31.861886 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:31.861804    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0711a80f-6f89-4949-aef2-a3281e637712-istiod-ca-cert\") pod \"e2e-worker-w5-b78c31-openshift-default-774cb4f6c9-dr2b8\" (UID: \"0711a80f-6f89-4949-aef2-a3281e637712\") " pod="openshift-ingress/e2e-worker-w5-b78c31-openshift-default-774cb4f6c9-dr2b8"
Oct 31 17:41:31.861886 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:31.861874    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0711a80f-6f89-4949-aef2-a3281e637712-workload-certs\") pod \"e2e-worker-w5-b78c31-openshift-default-774cb4f6c9-dr2b8\" (UID: \"0711a80f-6f89-4949-aef2-a3281e637712\") " pod="openshift-ingress/e2e-worker-w5-b78c31-openshift-default-774cb4f6c9-dr2b8"
Oct 31 17:41:31.862036 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:31.861925    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rjcgn\" (UniqueName: \"kubernetes.io/projected/0711a80f-6f89-4949-aef2-a3281e637712-kube-api-access-rjcgn\") pod \"e2e-worker-w5-b78c31-openshift-default-774cb4f6c9-dr2b8\" (UID: \"0711a80f-6f89-4949-aef2-a3281e637712\") " pod="openshift-ingress/e2e-worker-w5-b78c31-openshift-default-774cb4f6c9-dr2b8"
Oct 31 17:41:31.862036 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:31.861950    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0711a80f-6f89-4949-aef2-a3281e637712-istio-token\") pod \"e2e-worker-w5-b78c31-openshift-default-774cb4f6c9-dr2b8\" (UID: \"0711a80f-6f89-4949-aef2-a3281e637712\") " pod="openshift-ingress/e2e-worker-w5-b78c31-openshift-default-774cb4f6c9-dr2b8"
Oct 31 17:41:31.862114 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:31.862038    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0711a80f-6f89-4949-aef2-a3281e637712-istio-envoy\") pod \"e2e-worker-w5-b78c31-openshift-default-774cb4f6c9-dr2b8\" (UID: \"0711a80f-6f89-4949-aef2-a3281e637712\") " pod="openshift-ingress/e2e-worker-w5-b78c31-openshift-default-774cb4f6c9-dr2b8"
Oct 31 17:41:31.862114 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:31.862089    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0711a80f-6f89-4949-aef2-a3281e637712-istio-data\") pod \"e2e-worker-w5-b78c31-openshift-default-774cb4f6c9-dr2b8\" (UID: \"0711a80f-6f89-4949-aef2-a3281e637712\") " pod="openshift-ingress/e2e-worker-w5-b78c31-openshift-default-774cb4f6c9-dr2b8"
Oct 31 17:41:31.862186 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:31.862167    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0711a80f-6f89-4949-aef2-a3281e637712-istio-podinfo\") pod \"e2e-worker-w5-b78c31-openshift-default-774cb4f6c9-dr2b8\" (UID: \"0711a80f-6f89-4949-aef2-a3281e637712\") " pod="openshift-ingress/e2e-worker-w5-b78c31-openshift-default-774cb4f6c9-dr2b8"
Oct 31 17:41:31.964070 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:31.963984    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0711a80f-6f89-4949-aef2-a3281e637712-istio-podinfo\") pod \"e2e-worker-w5-b78c31-openshift-default-774cb4f6c9-dr2b8\" (UID: \"0711a80f-6f89-4949-aef2-a3281e637712\") " pod="openshift-ingress/e2e-worker-w5-b78c31-openshift-default-774cb4f6c9-dr2b8"
Oct 31 17:41:31.964219 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:31.964144    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0711a80f-6f89-4949-aef2-a3281e637712-credential-socket\") pod \"e2e-worker-w5-b78c31-openshift-default-774cb4f6c9-dr2b8\" (UID: \"0711a80f-6f89-4949-aef2-a3281e637712\") " pod="openshift-ingress/e2e-worker-w5-b78c31-openshift-default-774cb4f6c9-dr2b8"
Oct 31 17:41:31.964219 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:31.964197    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0711a80f-6f89-4949-aef2-a3281e637712-workload-socket\") pod \"e2e-worker-w5-b78c31-openshift-default-774cb4f6c9-dr2b8\" (UID: \"0711a80f-6f89-4949-aef2-a3281e637712\") " pod="openshift-ingress/e2e-worker-w5-b78c31-openshift-default-774cb4f6c9-dr2b8"
Oct 31 17:41:31.964219 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:31.964213    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0711a80f-6f89-4949-aef2-a3281e637712-istiod-ca-cert\") pod \"e2e-worker-w5-b78c31-openshift-default-774cb4f6c9-dr2b8\" (UID: \"0711a80f-6f89-4949-aef2-a3281e637712\") " pod="openshift-ingress/e2e-worker-w5-b78c31-openshift-default-774cb4f6c9-dr2b8"
Oct 31 17:41:31.964347 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:31.964253    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0711a80f-6f89-4949-aef2-a3281e637712-workload-certs\") pod \"e2e-worker-w5-b78c31-openshift-default-774cb4f6c9-dr2b8\" (UID: \"0711a80f-6f89-4949-aef2-a3281e637712\") " pod="openshift-ingress/e2e-worker-w5-b78c31-openshift-default-774cb4f6c9-dr2b8"
Oct 31 17:41:31.964347 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:31.964285    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rjcgn\" (UniqueName: \"kubernetes.io/projected/0711a80f-6f89-4949-aef2-a3281e637712-kube-api-access-rjcgn\") pod \"e2e-worker-w5-b78c31-openshift-default-774cb4f6c9-dr2b8\" (UID: \"0711a80f-6f89-4949-aef2-a3281e637712\") " pod="openshift-ingress/e2e-worker-w5-b78c31-openshift-default-774cb4f6c9-dr2b8"
Oct 31 17:41:31.964347 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:31.964316    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0711a80f-6f89-4949-aef2-a3281e637712-istio-token\") pod \"e2e-worker-w5-b78c31-openshift-default-774cb4f6c9-dr2b8\" (UID: \"0711a80f-6f89-4949-aef2-a3281e637712\") " pod="openshift-ingress/e2e-worker-w5-b78c31-openshift-default-774cb4f6c9-dr2b8"
Oct 31 17:41:31.964493 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:31.964365    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0711a80f-6f89-4949-aef2-a3281e637712-istio-envoy\") pod \"e2e-worker-w5-b78c31-openshift-default-774cb4f6c9-dr2b8\" (UID: \"0711a80f-6f89-4949-aef2-a3281e637712\") " pod="openshift-ingress/e2e-worker-w5-b78c31-openshift-default-774cb4f6c9-dr2b8"
Oct 31 17:41:31.964493 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:31.964438    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0711a80f-6f89-4949-aef2-a3281e637712-istio-data\") pod \"e2e-worker-w5-b78c31-openshift-default-774cb4f6c9-dr2b8\" (UID: \"0711a80f-6f89-4949-aef2-a3281e637712\") " pod="openshift-ingress/e2e-worker-w5-b78c31-openshift-default-774cb4f6c9-dr2b8"
Oct 31 17:41:31.964626 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:31.964603    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0711a80f-6f89-4949-aef2-a3281e637712-workload-socket\") pod \"e2e-worker-w5-b78c31-openshift-default-774cb4f6c9-dr2b8\" (UID: \"0711a80f-6f89-4949-aef2-a3281e637712\") " pod="openshift-ingress/e2e-worker-w5-b78c31-openshift-default-774cb4f6c9-dr2b8"
Oct 31 17:41:31.964715 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:31.964628    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0711a80f-6f89-4949-aef2-a3281e637712-credential-socket\") pod \"e2e-worker-w5-b78c31-openshift-default-774cb4f6c9-dr2b8\" (UID: \"0711a80f-6f89-4949-aef2-a3281e637712\") " pod="openshift-ingress/e2e-worker-w5-b78c31-openshift-default-774cb4f6c9-dr2b8"
Oct 31 17:41:31.964772 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:31.964758    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0711a80f-6f89-4949-aef2-a3281e637712-workload-certs\") pod \"e2e-worker-w5-b78c31-openshift-default-774cb4f6c9-dr2b8\" (UID: \"0711a80f-6f89-4949-aef2-a3281e637712\") " pod="openshift-ingress/e2e-worker-w5-b78c31-openshift-default-774cb4f6c9-dr2b8"
Oct 31 17:41:31.964904 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:31.964882    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0711a80f-6f89-4949-aef2-a3281e637712-istio-data\") pod \"e2e-worker-w5-b78c31-openshift-default-774cb4f6c9-dr2b8\" (UID: \"0711a80f-6f89-4949-aef2-a3281e637712\") " pod="openshift-ingress/e2e-worker-w5-b78c31-openshift-default-774cb4f6c9-dr2b8"
Oct 31 17:41:31.965090 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:31.965070    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0711a80f-6f89-4949-aef2-a3281e637712-istiod-ca-cert\") pod \"e2e-worker-w5-b78c31-openshift-default-774cb4f6c9-dr2b8\" (UID: \"0711a80f-6f89-4949-aef2-a3281e637712\") " pod="openshift-ingress/e2e-worker-w5-b78c31-openshift-default-774cb4f6c9-dr2b8"
Oct 31 17:41:31.966516 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:31.966494    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0711a80f-6f89-4949-aef2-a3281e637712-istio-podinfo\") pod \"e2e-worker-w5-b78c31-openshift-default-774cb4f6c9-dr2b8\" (UID: \"0711a80f-6f89-4949-aef2-a3281e637712\") " pod="openshift-ingress/e2e-worker-w5-b78c31-openshift-default-774cb4f6c9-dr2b8"
Oct 31 17:41:31.966656 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:31.966627    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0711a80f-6f89-4949-aef2-a3281e637712-istio-envoy\") pod \"e2e-worker-w5-b78c31-openshift-default-774cb4f6c9-dr2b8\" (UID: \"0711a80f-6f89-4949-aef2-a3281e637712\") " pod="openshift-ingress/e2e-worker-w5-b78c31-openshift-default-774cb4f6c9-dr2b8"
Oct 31 17:41:31.983498 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:31.983463    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0711a80f-6f89-4949-aef2-a3281e637712-istio-token\") pod \"e2e-worker-w5-b78c31-openshift-default-774cb4f6c9-dr2b8\" (UID: \"0711a80f-6f89-4949-aef2-a3281e637712\") " pod="openshift-ingress/e2e-worker-w5-b78c31-openshift-default-774cb4f6c9-dr2b8"
Oct 31 17:41:31.983604 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:31.983561    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rjcgn\" (UniqueName: \"kubernetes.io/projected/0711a80f-6f89-4949-aef2-a3281e637712-kube-api-access-rjcgn\") pod \"e2e-worker-w5-b78c31-openshift-default-774cb4f6c9-dr2b8\" (UID: \"0711a80f-6f89-4949-aef2-a3281e637712\") " pod="openshift-ingress/e2e-worker-w5-b78c31-openshift-default-774cb4f6c9-dr2b8"
Oct 31 17:41:32.028246 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:32.028217    5003 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-b78c31-openshift-default-774cb4f6c9-dr2b8"
Oct 31 17:41:32.357002 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:32.353199    5003 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w5-b78c31-openshift-default-774cb4f6c9-dr2b8"]
Oct 31 17:41:32.357002 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:41:32.354377    5003 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0711a80f_6f89_4949_aef2_a3281e637712.slice/crio-04eee82aed612b61f02c7b9c3be688377866d91e80bf168a6139f019c5f2ba8a WatchSource:0}: Error finding container 04eee82aed612b61f02c7b9c3be688377866d91e80bf168a6139f019c5f2ba8a: Status 404 returned error can't find the container with id 04eee82aed612b61f02c7b9c3be688377866d91e80bf168a6139f019c5f2ba8a
Oct 31 17:41:32.357758 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:32.357711    5003 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Oct 31 17:41:32.357874 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:32.357809    5003 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Oct 31 17:41:32.357874 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:32.357852    5003 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Oct 31 17:41:32.469443 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:32.469420    5003 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-dbda3009-9f59b"
Oct 31 17:41:32.573513 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:32.572759    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/f7cd4b4e-96aa-4c97-806b-0737872186e1-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/f7cd4b4e-96aa-4c97-806b-0737872186e1-maas-api-openshift-ca\") pod \"f7cd4b4e-96aa-4c97-806b-0737872186e1\" (UID: \"f7cd4b4e-96aa-4c97-806b-0737872186e1\") "
Oct 31 17:41:32.573513 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:32.572833    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/f7cd4b4e-96aa-4c97-806b-0737872186e1-kube-api-access-l65b4\" (UniqueName: \"kubernetes.io/projected/f7cd4b4e-96aa-4c97-806b-0737872186e1-kube-api-access-l65b4\") pod \"f7cd4b4e-96aa-4c97-806b-0737872186e1\" (UID: \"f7cd4b4e-96aa-4c97-806b-0737872186e1\") "
Oct 31 17:41:32.573513 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:32.573065    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/f7cd4b4e-96aa-4c97-806b-0737872186e1-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/f7cd4b4e-96aa-4c97-806b-0737872186e1-maas-api-xks-ca\") pod \"f7cd4b4e-96aa-4c97-806b-0737872186e1\" (UID: \"f7cd4b4e-96aa-4c97-806b-0737872186e1\") "
Oct 31 17:41:32.574820 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:32.574498    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f7cd4b4e-96aa-4c97-806b-0737872186e1-maas-api-openshift-ca" pod "f7cd4b4e-96aa-4c97-806b-0737872186e1" (UID: "f7cd4b4e-96aa-4c97-806b-0737872186e1"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 17:41:32.578989 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:32.578961    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f7cd4b4e-96aa-4c97-806b-0737872186e1-maas-api-xks-ca" pod "f7cd4b4e-96aa-4c97-806b-0737872186e1" (UID: "f7cd4b4e-96aa-4c97-806b-0737872186e1"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 17:41:32.581535 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:32.581505    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f7cd4b4e-96aa-4c97-806b-0737872186e1-kube-api-access-l65b4" pod "f7cd4b4e-96aa-4c97-806b-0737872186e1" (UID: "f7cd4b4e-96aa-4c97-806b-0737872186e1"). InnerVolumeSpecName "kube-api-access-l65b4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 17:41:32.675395 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:32.675357    5003 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/f7cd4b4e-96aa-4c97-806b-0737872186e1-maas-api-openshift-ca\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:41:32.675395 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:32.675389    5003 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l65b4\" (UniqueName: \"kubernetes.io/projected/f7cd4b4e-96aa-4c97-806b-0737872186e1-kube-api-access-l65b4\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:41:32.675395 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:32.675399    5003 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/f7cd4b4e-96aa-4c97-806b-0737872186e1-maas-api-xks-ca\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:41:33.298253 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:33.298207    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-b78c31-openshift-default-774cb4f6c9-dr2b8" event={"ID":"0711a80f-6f89-4949-aef2-a3281e637712","Type":"ContainerStarted","Data":"f94f4c34ce94c5da7fc3c8c1940338451d54e1dc9d60bd40a6596f5371384269"}
Oct 31 17:41:33.298472 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:33.298278    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-b78c31-openshift-default-774cb4f6c9-dr2b8" event={"ID":"0711a80f-6f89-4949-aef2-a3281e637712","Type":"ContainerStarted","Data":"04eee82aed612b61f02c7b9c3be688377866d91e80bf168a6139f019c5f2ba8a"}
Oct 31 17:41:33.300148 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:33.300117    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-dbda3009-9f59b" event={"ID":"f7cd4b4e-96aa-4c97-806b-0737872186e1","Type":"ContainerDied","Data":"fcf9745b9ae62a38fe13507fca8d7bdd1fbf72afcbe8daab19e385d844e08a8c"}
Oct 31 17:41:33.300289 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:33.300172    5003 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="fcf9745b9ae62a38fe13507fca8d7bdd1fbf72afcbe8daab19e385d844e08a8c"
Oct 31 17:41:33.300289 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:33.300232    5003 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-dbda3009-9f59b"
Oct 31 17:41:33.372746 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:33.352902    5003 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w5-b78c31-openshift-default-774cb4f6c9-dr2b8" podStartSLOduration=2.352882927 podStartE2EDuration="2.352882927s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 17:41:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 17:41:33.351658235 +0000 UTC m=+861.606512767" watchObservedRunningTime="2026-10-31 17:41:33.352882927 +0000 UTC m=+861.607737469"
Oct 31 17:41:34.029311 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:34.029278    5003 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w5-b78c31-openshift-default-774cb4f6c9-dr2b8"
Oct 31 17:41:34.031140 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:34.031114    5003 patch_prober.go:29] interesting pod/e2e-worker-w5-b78c31-openshift-default-774cb4f6c9-dr2b8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.109:15021/healthz/ready\": dial tcp 10.132.0.109:15021: connect: connection refused" start-of-body=
Oct 31 17:41:34.031268 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:34.031163    5003 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-b78c31-openshift-default-774cb4f6c9-dr2b8" podUID="0711a80f-6f89-4949-aef2-a3281e637712" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.109:15021/healthz/ready\": dial tcp 10.132.0.109:15021: connect: connection refused"
Oct 31 17:41:34.797126 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:34.797091    5003 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-be112520-xtwpk"]
Oct 31 17:41:34.798159 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:34.798137    5003 cpu_manager.go:414] "containerMap: removing container" podUID="f7cd4b4e-96aa-4c97-806b-0737872186e1" containerName="revoke-keys"
Oct 31 17:41:34.798159 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:34.798158    5003 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="f7cd4b4e-96aa-4c97-806b-0737872186e1" containerName="revoke-keys"
Oct 31 17:41:34.798387 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:34.798367    5003 memory_manager.go:365] "RemoveStaleState removing state" podUID="f7cd4b4e-96aa-4c97-806b-0737872186e1" containerName="revoke-keys"
Oct 31 17:41:34.803854 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:34.803832    5003 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-be112520-xtwpk"
Oct 31 17:41:34.815762 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:34.815737    5003 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-be112520-xtwpk"]
Oct 31 17:41:34.821404 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:34.821381    5003 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\""
Oct 31 17:41:34.821564 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:34.821544    5003 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-mr9x2\""
Oct 31 17:41:34.932738 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:34.932695    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/4843ce8c-d62a-41ca-9002-78ab574484bb-maas-api-xks-ca\") pod \"maas-api-revoke-sub-be112520-xtwpk\" (UID: \"4843ce8c-d62a-41ca-9002-78ab574484bb\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-be112520-xtwpk"
Oct 31 17:41:34.932918 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:34.932760    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5vgmg\" (UniqueName: \"kubernetes.io/projected/4843ce8c-d62a-41ca-9002-78ab574484bb-kube-api-access-5vgmg\") pod \"maas-api-revoke-sub-be112520-xtwpk\" (UID: \"4843ce8c-d62a-41ca-9002-78ab574484bb\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-be112520-xtwpk"
Oct 31 17:41:34.932918 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:34.932862    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/4843ce8c-d62a-41ca-9002-78ab574484bb-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-be112520-xtwpk\" (UID: \"4843ce8c-d62a-41ca-9002-78ab574484bb\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-be112520-xtwpk"
Oct 31 17:41:35.029213 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:35.029168    5003 patch_prober.go:29] interesting pod/e2e-worker-w5-b78c31-openshift-default-774cb4f6c9-dr2b8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.109:15021/healthz/ready\": dial tcp 10.132.0.109:15021: connect: connection refused" start-of-body=
Oct 31 17:41:35.029380 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:35.029238    5003 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-b78c31-openshift-default-774cb4f6c9-dr2b8" podUID="0711a80f-6f89-4949-aef2-a3281e637712" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.109:15021/healthz/ready\": dial tcp 10.132.0.109:15021: connect: connection refused"
Oct 31 17:41:35.033985 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:35.033941    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/4843ce8c-d62a-41ca-9002-78ab574484bb-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-be112520-xtwpk\" (UID: \"4843ce8c-d62a-41ca-9002-78ab574484bb\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-be112520-xtwpk"
Oct 31 17:41:35.034220 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:35.034204    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/4843ce8c-d62a-41ca-9002-78ab574484bb-maas-api-xks-ca\") pod \"maas-api-revoke-sub-be112520-xtwpk\" (UID: \"4843ce8c-d62a-41ca-9002-78ab574484bb\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-be112520-xtwpk"
Oct 31 17:41:35.034298 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:35.034236    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5vgmg\" (UniqueName: \"kubernetes.io/projected/4843ce8c-d62a-41ca-9002-78ab574484bb-kube-api-access-5vgmg\") pod \"maas-api-revoke-sub-be112520-xtwpk\" (UID: \"4843ce8c-d62a-41ca-9002-78ab574484bb\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-be112520-xtwpk"
Oct 31 17:41:35.034611 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:35.034586    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/4843ce8c-d62a-41ca-9002-78ab574484bb-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-be112520-xtwpk\" (UID: \"4843ce8c-d62a-41ca-9002-78ab574484bb\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-be112520-xtwpk"
Oct 31 17:41:35.036528 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:35.036505    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/4843ce8c-d62a-41ca-9002-78ab574484bb-maas-api-xks-ca\") pod \"maas-api-revoke-sub-be112520-xtwpk\" (UID: \"4843ce8c-d62a-41ca-9002-78ab574484bb\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-be112520-xtwpk"
Oct 31 17:41:35.078670 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:35.068877    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5vgmg\" (UniqueName: \"kubernetes.io/projected/4843ce8c-d62a-41ca-9002-78ab574484bb-kube-api-access-5vgmg\") pod \"maas-api-revoke-sub-be112520-xtwpk\" (UID: \"4843ce8c-d62a-41ca-9002-78ab574484bb\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-be112520-xtwpk"
Oct 31 17:41:35.120360 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:35.120328    5003 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-be112520-xtwpk"
Oct 31 17:41:35.447576 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:35.447548    5003 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-be112520-xtwpk"]
Oct 31 17:41:35.450146 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:41:35.450116    5003 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4843ce8c_d62a_41ca_9002_78ab574484bb.slice/crio-b7703c6254d55fbcf7fa1e62e65bcd2dd02cca1a8d12ad49659a3abd05be9f2c WatchSource:0}: Error finding container b7703c6254d55fbcf7fa1e62e65bcd2dd02cca1a8d12ad49659a3abd05be9f2c: Status 404 returned error can't find the container with id b7703c6254d55fbcf7fa1e62e65bcd2dd02cca1a8d12ad49659a3abd05be9f2c
Oct 31 17:41:36.030206 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:36.030168    5003 patch_prober.go:29] interesting pod/e2e-worker-w5-b78c31-openshift-default-774cb4f6c9-dr2b8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.109:15021/healthz/ready\": dial tcp 10.132.0.109:15021: connect: connection refused" start-of-body=
Oct 31 17:41:36.030597 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:36.030239    5003 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-b78c31-openshift-default-774cb4f6c9-dr2b8" podUID="0711a80f-6f89-4949-aef2-a3281e637712" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.109:15021/healthz/ready\": dial tcp 10.132.0.109:15021: connect: connection refused"
Oct 31 17:41:36.331706 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:36.331663    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-be112520-xtwpk" event={"ID":"4843ce8c-d62a-41ca-9002-78ab574484bb","Type":"ContainerStarted","Data":"cea4309b51bbb0cfc4ddd57871c6baef7e356a3dfbe408058f4c358caf69d8b8"}
Oct 31 17:41:36.331894 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:36.331738    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-be112520-xtwpk" event={"ID":"4843ce8c-d62a-41ca-9002-78ab574484bb","Type":"ContainerStarted","Data":"b7703c6254d55fbcf7fa1e62e65bcd2dd02cca1a8d12ad49659a3abd05be9f2c"}
Oct 31 17:41:37.029390 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:37.029309    5003 patch_prober.go:29] interesting pod/e2e-worker-w5-b78c31-openshift-default-774cb4f6c9-dr2b8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.109:15021/healthz/ready\": dial tcp 10.132.0.109:15021: connect: connection refused" start-of-body=
Oct 31 17:41:37.029390 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:37.029358    5003 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-b78c31-openshift-default-774cb4f6c9-dr2b8" podUID="0711a80f-6f89-4949-aef2-a3281e637712" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.109:15021/healthz/ready\": dial tcp 10.132.0.109:15021: connect: connection refused"
Oct 31 17:41:37.341313 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:37.341282    5003 generic.go:356] "Generic (PLEG): container finished" podID="4843ce8c-d62a-41ca-9002-78ab574484bb" containerID="cea4309b51bbb0cfc4ddd57871c6baef7e356a3dfbe408058f4c358caf69d8b8" exitCode=0
Oct 31 17:41:37.341736 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:37.341365    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-be112520-xtwpk" event={"ID":"4843ce8c-d62a-41ca-9002-78ab574484bb","Type":"ContainerDied","Data":"cea4309b51bbb0cfc4ddd57871c6baef7e356a3dfbe408058f4c358caf69d8b8"}
Oct 31 17:41:38.029345 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:38.029310    5003 patch_prober.go:29] interesting pod/e2e-worker-w5-b78c31-openshift-default-774cb4f6c9-dr2b8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.109:15021/healthz/ready\": dial tcp 10.132.0.109:15021: connect: connection refused" start-of-body=
Oct 31 17:41:38.029528 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:38.029363    5003 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-b78c31-openshift-default-774cb4f6c9-dr2b8" podUID="0711a80f-6f89-4949-aef2-a3281e637712" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.109:15021/healthz/ready\": dial tcp 10.132.0.109:15021: connect: connection refused"
Oct 31 17:41:38.589319 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:38.589290    5003 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-be112520-xtwpk"
Oct 31 17:41:38.605695 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:38.605606    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/4843ce8c-d62a-41ca-9002-78ab574484bb-kube-api-access-5vgmg\" (UniqueName: \"kubernetes.io/projected/4843ce8c-d62a-41ca-9002-78ab574484bb-kube-api-access-5vgmg\") pod \"4843ce8c-d62a-41ca-9002-78ab574484bb\" (UID: \"4843ce8c-d62a-41ca-9002-78ab574484bb\") "
Oct 31 17:41:38.605862 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:38.605742    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/4843ce8c-d62a-41ca-9002-78ab574484bb-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/4843ce8c-d62a-41ca-9002-78ab574484bb-maas-api-openshift-ca\") pod \"4843ce8c-d62a-41ca-9002-78ab574484bb\" (UID: \"4843ce8c-d62a-41ca-9002-78ab574484bb\") "
Oct 31 17:41:38.605862 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:38.605775    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/4843ce8c-d62a-41ca-9002-78ab574484bb-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/4843ce8c-d62a-41ca-9002-78ab574484bb-maas-api-xks-ca\") pod \"4843ce8c-d62a-41ca-9002-78ab574484bb\" (UID: \"4843ce8c-d62a-41ca-9002-78ab574484bb\") "
Oct 31 17:41:38.606175 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:38.606142    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4843ce8c-d62a-41ca-9002-78ab574484bb-maas-api-openshift-ca" pod "4843ce8c-d62a-41ca-9002-78ab574484bb" (UID: "4843ce8c-d62a-41ca-9002-78ab574484bb"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 17:41:38.606383 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:38.606366    5003 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/4843ce8c-d62a-41ca-9002-78ab574484bb-maas-api-openshift-ca\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:41:38.607927 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:38.607899    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4843ce8c-d62a-41ca-9002-78ab574484bb-maas-api-xks-ca" pod "4843ce8c-d62a-41ca-9002-78ab574484bb" (UID: "4843ce8c-d62a-41ca-9002-78ab574484bb"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 17:41:38.608037 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:38.608013    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4843ce8c-d62a-41ca-9002-78ab574484bb-kube-api-access-5vgmg" pod "4843ce8c-d62a-41ca-9002-78ab574484bb" (UID: "4843ce8c-d62a-41ca-9002-78ab574484bb"). InnerVolumeSpecName "kube-api-access-5vgmg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 17:41:38.707807 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:38.707773    5003 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/4843ce8c-d62a-41ca-9002-78ab574484bb-maas-api-xks-ca\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:41:38.707807 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:38.707803    5003 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5vgmg\" (UniqueName: \"kubernetes.io/projected/4843ce8c-d62a-41ca-9002-78ab574484bb-kube-api-access-5vgmg\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:41:39.029412 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:39.029328    5003 patch_prober.go:29] interesting pod/e2e-worker-w5-b78c31-openshift-default-774cb4f6c9-dr2b8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.109:15021/healthz/ready\": dial tcp 10.132.0.109:15021: connect: connection refused" start-of-body=
Oct 31 17:41:39.029412 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:39.029390    5003 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-b78c31-openshift-default-774cb4f6c9-dr2b8" podUID="0711a80f-6f89-4949-aef2-a3281e637712" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.109:15021/healthz/ready\": dial tcp 10.132.0.109:15021: connect: connection refused"
Oct 31 17:41:39.359367 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:39.359337    5003 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-be112520-xtwpk"
Oct 31 17:41:39.359367 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:39.359359    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-be112520-xtwpk" event={"ID":"4843ce8c-d62a-41ca-9002-78ab574484bb","Type":"ContainerDied","Data":"b7703c6254d55fbcf7fa1e62e65bcd2dd02cca1a8d12ad49659a3abd05be9f2c"}
Oct 31 17:41:39.359544 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:39.359408    5003 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b7703c6254d55fbcf7fa1e62e65bcd2dd02cca1a8d12ad49659a3abd05be9f2c"
Oct 31 17:41:39.505839 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:39.505795    5003 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-d1ea8e75-vr5s4"]
Oct 31 17:41:39.506975 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:39.506938    5003 cpu_manager.go:414] "containerMap: removing container" podUID="4843ce8c-d62a-41ca-9002-78ab574484bb" containerName="revoke-keys"
Oct 31 17:41:39.506975 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:39.506963    5003 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="4843ce8c-d62a-41ca-9002-78ab574484bb" containerName="revoke-keys"
Oct 31 17:41:39.507220 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:39.507206    5003 memory_manager.go:365] "RemoveStaleState removing state" podUID="4843ce8c-d62a-41ca-9002-78ab574484bb" containerName="revoke-keys"
Oct 31 17:41:39.511413 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:39.511389    5003 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-d1ea8e75-vr5s4"
Oct 31 17:41:39.524414 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:39.524390    5003 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-d1ea8e75-vr5s4"]
Oct 31 17:41:39.526916 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:39.526894    5003 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\""
Oct 31 17:41:39.527079 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:39.526904    5003 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-mr9x2\""
Oct 31 17:41:39.625477 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:39.625384    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zgjbj\" (UniqueName: \"kubernetes.io/projected/1ba61bb8-6c32-451b-ab2c-07b23395d08d-kube-api-access-zgjbj\") pod \"maas-api-revoke-sub-d1ea8e75-vr5s4\" (UID: \"1ba61bb8-6c32-451b-ab2c-07b23395d08d\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-d1ea8e75-vr5s4"
Oct 31 17:41:39.625477 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:39.625447    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/1ba61bb8-6c32-451b-ab2c-07b23395d08d-maas-api-xks-ca\") pod \"maas-api-revoke-sub-d1ea8e75-vr5s4\" (UID: \"1ba61bb8-6c32-451b-ab2c-07b23395d08d\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-d1ea8e75-vr5s4"
Oct 31 17:41:39.626020 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:39.625689    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/1ba61bb8-6c32-451b-ab2c-07b23395d08d-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-d1ea8e75-vr5s4\" (UID: \"1ba61bb8-6c32-451b-ab2c-07b23395d08d\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-d1ea8e75-vr5s4"
Oct 31 17:41:39.727627 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:39.727588    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zgjbj\" (UniqueName: \"kubernetes.io/projected/1ba61bb8-6c32-451b-ab2c-07b23395d08d-kube-api-access-zgjbj\") pod \"maas-api-revoke-sub-d1ea8e75-vr5s4\" (UID: \"1ba61bb8-6c32-451b-ab2c-07b23395d08d\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-d1ea8e75-vr5s4"
Oct 31 17:41:39.727801 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:39.727682    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/1ba61bb8-6c32-451b-ab2c-07b23395d08d-maas-api-xks-ca\") pod \"maas-api-revoke-sub-d1ea8e75-vr5s4\" (UID: \"1ba61bb8-6c32-451b-ab2c-07b23395d08d\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-d1ea8e75-vr5s4"
Oct 31 17:41:39.727801 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:39.727786    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/1ba61bb8-6c32-451b-ab2c-07b23395d08d-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-d1ea8e75-vr5s4\" (UID: \"1ba61bb8-6c32-451b-ab2c-07b23395d08d\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-d1ea8e75-vr5s4"
Oct 31 17:41:39.728505 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:39.728471    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/1ba61bb8-6c32-451b-ab2c-07b23395d08d-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-d1ea8e75-vr5s4\" (UID: \"1ba61bb8-6c32-451b-ab2c-07b23395d08d\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-d1ea8e75-vr5s4"
Oct 31 17:41:39.730513 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:39.730435    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/1ba61bb8-6c32-451b-ab2c-07b23395d08d-maas-api-xks-ca\") pod \"maas-api-revoke-sub-d1ea8e75-vr5s4\" (UID: \"1ba61bb8-6c32-451b-ab2c-07b23395d08d\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-d1ea8e75-vr5s4"
Oct 31 17:41:39.747478 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:39.747422    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zgjbj\" (UniqueName: \"kubernetes.io/projected/1ba61bb8-6c32-451b-ab2c-07b23395d08d-kube-api-access-zgjbj\") pod \"maas-api-revoke-sub-d1ea8e75-vr5s4\" (UID: \"1ba61bb8-6c32-451b-ab2c-07b23395d08d\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-d1ea8e75-vr5s4"
Oct 31 17:41:39.830437 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:39.830398    5003 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-d1ea8e75-vr5s4"
Oct 31 17:41:40.033041 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:40.033012    5003 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w5-b78c31-openshift-default-774cb4f6c9-dr2b8"
Oct 31 17:41:40.033466 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:40.033444    5003 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w5-b78c31-openshift-default-774cb4f6c9-dr2b8"
Oct 31 17:41:40.034254 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:40.034237    5003 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w5-b78c31-openshift-default-774cb4f6c9-dr2b8"
Oct 31 17:41:40.145141 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:40.145106    5003 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-d1ea8e75-vr5s4"]
Oct 31 17:41:40.331540 ip-10-0-138-17 kubenswrapper[5003]: E1031 17:41:40.331507    5003 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-tdzz5" containerName="extractor"
Oct 31 17:41:40.368270 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:40.368238    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-d1ea8e75-vr5s4" event={"ID":"1ba61bb8-6c32-451b-ab2c-07b23395d08d","Type":"ContainerStarted","Data":"07980af7dd7ce6ef15e08d55e8fa45b8e55e164f0e3cbed3f9c779a38589c050"}
Oct 31 17:41:41.377729 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:41.377692    5003 generic.go:356] "Generic (PLEG): container finished" podID="1ba61bb8-6c32-451b-ab2c-07b23395d08d" containerID="dd606934b53a741e49badbbba755c9d9067de86cfeb95525bc22671e70ce6e1a" exitCode=0
Oct 31 17:41:41.378339 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:41.377781    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-d1ea8e75-vr5s4" event={"ID":"1ba61bb8-6c32-451b-ab2c-07b23395d08d","Type":"ContainerDied","Data":"dd606934b53a741e49badbbba755c9d9067de86cfeb95525bc22671e70ce6e1a"}
Oct 31 17:41:41.709834 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:41.709745    5003 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-24584738-5hnhv"]
Oct 31 17:41:41.714156 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:41.714132    5003 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-24584738-5hnhv"
Oct 31 17:41:41.720721 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:41.720695    5003 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-24584738-5hnhv"]
Oct 31 17:41:41.760176 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:41.760137    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7xd4q\" (UniqueName: \"kubernetes.io/projected/1d105e9a-34e9-4888-8433-3e2e20b06aea-kube-api-access-7xd4q\") pod \"maas-api-revoke-sub-24584738-5hnhv\" (UID: \"1d105e9a-34e9-4888-8433-3e2e20b06aea\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-24584738-5hnhv"
Oct 31 17:41:41.760331 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:41.760203    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/1d105e9a-34e9-4888-8433-3e2e20b06aea-maas-api-xks-ca\") pod \"maas-api-revoke-sub-24584738-5hnhv\" (UID: \"1d105e9a-34e9-4888-8433-3e2e20b06aea\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-24584738-5hnhv"
Oct 31 17:41:41.760398 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:41.760382    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/1d105e9a-34e9-4888-8433-3e2e20b06aea-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-24584738-5hnhv\" (UID: \"1d105e9a-34e9-4888-8433-3e2e20b06aea\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-24584738-5hnhv"
Oct 31 17:41:41.861861 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:41.861827    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7xd4q\" (UniqueName: \"kubernetes.io/projected/1d105e9a-34e9-4888-8433-3e2e20b06aea-kube-api-access-7xd4q\") pod \"maas-api-revoke-sub-24584738-5hnhv\" (UID: \"1d105e9a-34e9-4888-8433-3e2e20b06aea\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-24584738-5hnhv"
Oct 31 17:41:41.862074 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:41.861887    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/1d105e9a-34e9-4888-8433-3e2e20b06aea-maas-api-xks-ca\") pod \"maas-api-revoke-sub-24584738-5hnhv\" (UID: \"1d105e9a-34e9-4888-8433-3e2e20b06aea\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-24584738-5hnhv"
Oct 31 17:41:41.862074 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:41.862037    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/1d105e9a-34e9-4888-8433-3e2e20b06aea-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-24584738-5hnhv\" (UID: \"1d105e9a-34e9-4888-8433-3e2e20b06aea\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-24584738-5hnhv"
Oct 31 17:41:41.862715 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:41.862685    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/1d105e9a-34e9-4888-8433-3e2e20b06aea-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-24584738-5hnhv\" (UID: \"1d105e9a-34e9-4888-8433-3e2e20b06aea\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-24584738-5hnhv"
Oct 31 17:41:41.864224 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:41.864206    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/1d105e9a-34e9-4888-8433-3e2e20b06aea-maas-api-xks-ca\") pod \"maas-api-revoke-sub-24584738-5hnhv\" (UID: \"1d105e9a-34e9-4888-8433-3e2e20b06aea\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-24584738-5hnhv"
Oct 31 17:41:41.880081 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:41.880057    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7xd4q\" (UniqueName: \"kubernetes.io/projected/1d105e9a-34e9-4888-8433-3e2e20b06aea-kube-api-access-7xd4q\") pod \"maas-api-revoke-sub-24584738-5hnhv\" (UID: \"1d105e9a-34e9-4888-8433-3e2e20b06aea\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-24584738-5hnhv"
Oct 31 17:41:42.032131 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:42.032055    5003 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-24584738-5hnhv"
Oct 31 17:41:42.338965 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:42.338938    5003 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-24584738-5hnhv"]
Oct 31 17:41:42.340510 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:41:42.340479    5003 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1d105e9a_34e9_4888_8433_3e2e20b06aea.slice/crio-2dbb4a2e9426d8bb74a6d044d0e85fccff87a4f8ffa7b260e638fe12810fc33a WatchSource:0}: Error finding container 2dbb4a2e9426d8bb74a6d044d0e85fccff87a4f8ffa7b260e638fe12810fc33a: Status 404 returned error can't find the container with id 2dbb4a2e9426d8bb74a6d044d0e85fccff87a4f8ffa7b260e638fe12810fc33a
Oct 31 17:41:42.387062 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:42.387029    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-24584738-5hnhv" event={"ID":"1d105e9a-34e9-4888-8433-3e2e20b06aea","Type":"ContainerStarted","Data":"2dbb4a2e9426d8bb74a6d044d0e85fccff87a4f8ffa7b260e638fe12810fc33a"}
Oct 31 17:41:42.574545 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:42.574520    5003 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-d1ea8e75-vr5s4"
Oct 31 17:41:42.671981 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:42.671901    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/1ba61bb8-6c32-451b-ab2c-07b23395d08d-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/1ba61bb8-6c32-451b-ab2c-07b23395d08d-maas-api-openshift-ca\") pod \"1ba61bb8-6c32-451b-ab2c-07b23395d08d\" (UID: \"1ba61bb8-6c32-451b-ab2c-07b23395d08d\") "
Oct 31 17:41:42.671981 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:42.671950    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/1ba61bb8-6c32-451b-ab2c-07b23395d08d-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/1ba61bb8-6c32-451b-ab2c-07b23395d08d-maas-api-xks-ca\") pod \"1ba61bb8-6c32-451b-ab2c-07b23395d08d\" (UID: \"1ba61bb8-6c32-451b-ab2c-07b23395d08d\") "
Oct 31 17:41:42.672216 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:42.672202    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/1ba61bb8-6c32-451b-ab2c-07b23395d08d-kube-api-access-zgjbj\" (UniqueName: \"kubernetes.io/projected/1ba61bb8-6c32-451b-ab2c-07b23395d08d-kube-api-access-zgjbj\") pod \"1ba61bb8-6c32-451b-ab2c-07b23395d08d\" (UID: \"1ba61bb8-6c32-451b-ab2c-07b23395d08d\") "
Oct 31 17:41:42.672317 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:42.672294    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1ba61bb8-6c32-451b-ab2c-07b23395d08d-maas-api-openshift-ca" pod "1ba61bb8-6c32-451b-ab2c-07b23395d08d" (UID: "1ba61bb8-6c32-451b-ab2c-07b23395d08d"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 17:41:42.672803 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:42.672785    5003 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/1ba61bb8-6c32-451b-ab2c-07b23395d08d-maas-api-openshift-ca\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:41:42.753325 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:42.753285    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1ba61bb8-6c32-451b-ab2c-07b23395d08d-maas-api-xks-ca" pod "1ba61bb8-6c32-451b-ab2c-07b23395d08d" (UID: "1ba61bb8-6c32-451b-ab2c-07b23395d08d"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 17:41:42.753521 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:42.753500    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1ba61bb8-6c32-451b-ab2c-07b23395d08d-kube-api-access-zgjbj" pod "1ba61bb8-6c32-451b-ab2c-07b23395d08d" (UID: "1ba61bb8-6c32-451b-ab2c-07b23395d08d"). InnerVolumeSpecName "kube-api-access-zgjbj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 17:41:42.774950 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:42.774917    5003 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zgjbj\" (UniqueName: \"kubernetes.io/projected/1ba61bb8-6c32-451b-ab2c-07b23395d08d-kube-api-access-zgjbj\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:41:42.774950 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:42.774947    5003 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/1ba61bb8-6c32-451b-ab2c-07b23395d08d-maas-api-xks-ca\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:41:43.396764 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:43.396728    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-d1ea8e75-vr5s4" event={"ID":"1ba61bb8-6c32-451b-ab2c-07b23395d08d","Type":"ContainerDied","Data":"07980af7dd7ce6ef15e08d55e8fa45b8e55e164f0e3cbed3f9c779a38589c050"}
Oct 31 17:41:43.397165 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:43.396789    5003 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="07980af7dd7ce6ef15e08d55e8fa45b8e55e164f0e3cbed3f9c779a38589c050"
Oct 31 17:41:43.397165 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:43.396747    5003 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-d1ea8e75-vr5s4"
Oct 31 17:41:43.398433 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:43.398406    5003 generic.go:356] "Generic (PLEG): container finished" podID="1d105e9a-34e9-4888-8433-3e2e20b06aea" containerID="73ef962c7f0534b9dfa62cbb0dc7f4b88cfb5e4ee2d46ff702257022ce3a8959" exitCode=0
Oct 31 17:41:43.398527 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:43.398480    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-24584738-5hnhv" event={"ID":"1d105e9a-34e9-4888-8433-3e2e20b06aea","Type":"ContainerDied","Data":"73ef962c7f0534b9dfa62cbb0dc7f4b88cfb5e4ee2d46ff702257022ce3a8959"}
Oct 31 17:41:44.586395 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:44.586368    5003 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-24584738-5hnhv"
Oct 31 17:41:44.704112 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:44.704031    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/1d105e9a-34e9-4888-8433-3e2e20b06aea-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/1d105e9a-34e9-4888-8433-3e2e20b06aea-maas-api-xks-ca\") pod \"1d105e9a-34e9-4888-8433-3e2e20b06aea\" (UID: \"1d105e9a-34e9-4888-8433-3e2e20b06aea\") "
Oct 31 17:41:44.704256 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:44.704236    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/1d105e9a-34e9-4888-8433-3e2e20b06aea-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/1d105e9a-34e9-4888-8433-3e2e20b06aea-maas-api-openshift-ca\") pod \"1d105e9a-34e9-4888-8433-3e2e20b06aea\" (UID: \"1d105e9a-34e9-4888-8433-3e2e20b06aea\") "
Oct 31 17:41:44.704376 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:44.704364    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/1d105e9a-34e9-4888-8433-3e2e20b06aea-kube-api-access-7xd4q\" (UniqueName: \"kubernetes.io/projected/1d105e9a-34e9-4888-8433-3e2e20b06aea-kube-api-access-7xd4q\") pod \"1d105e9a-34e9-4888-8433-3e2e20b06aea\" (UID: \"1d105e9a-34e9-4888-8433-3e2e20b06aea\") "
Oct 31 17:41:44.704607 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:44.704581    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1d105e9a-34e9-4888-8433-3e2e20b06aea-maas-api-openshift-ca" pod "1d105e9a-34e9-4888-8433-3e2e20b06aea" (UID: "1d105e9a-34e9-4888-8433-3e2e20b06aea"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 17:41:44.704884 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:44.704868    5003 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/1d105e9a-34e9-4888-8433-3e2e20b06aea-maas-api-openshift-ca\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:41:44.706132 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:44.706112    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1d105e9a-34e9-4888-8433-3e2e20b06aea-maas-api-xks-ca" pod "1d105e9a-34e9-4888-8433-3e2e20b06aea" (UID: "1d105e9a-34e9-4888-8433-3e2e20b06aea"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 17:41:44.706334 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:44.706312    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1d105e9a-34e9-4888-8433-3e2e20b06aea-kube-api-access-7xd4q" pod "1d105e9a-34e9-4888-8433-3e2e20b06aea" (UID: "1d105e9a-34e9-4888-8433-3e2e20b06aea"). InnerVolumeSpecName "kube-api-access-7xd4q". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 17:41:44.806814 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:44.806778    5003 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7xd4q\" (UniqueName: \"kubernetes.io/projected/1d105e9a-34e9-4888-8433-3e2e20b06aea-kube-api-access-7xd4q\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:41:44.806814 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:44.806814    5003 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/1d105e9a-34e9-4888-8433-3e2e20b06aea-maas-api-xks-ca\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:41:45.417662 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:45.417623    5003 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-24584738-5hnhv"
Oct 31 17:41:45.417984 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:45.417676    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-24584738-5hnhv" event={"ID":"1d105e9a-34e9-4888-8433-3e2e20b06aea","Type":"ContainerDied","Data":"2dbb4a2e9426d8bb74a6d044d0e85fccff87a4f8ffa7b260e638fe12810fc33a"}
Oct 31 17:41:45.417984 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:45.417729    5003 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2dbb4a2e9426d8bb74a6d044d0e85fccff87a4f8ffa7b260e638fe12810fc33a"
Oct 31 17:41:46.559503 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:46.559473    5003 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w3-cf0a86-openshift-default-595bfdc58c-jg25b"]
Oct 31 17:41:46.560303 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:46.560277    5003 cpu_manager.go:414] "containerMap: removing container" podUID="1d105e9a-34e9-4888-8433-3e2e20b06aea" containerName="revoke-keys"
Oct 31 17:41:46.560303 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:46.560299    5003 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="1d105e9a-34e9-4888-8433-3e2e20b06aea" containerName="revoke-keys"
Oct 31 17:41:46.560452 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:46.560316    5003 cpu_manager.go:414] "containerMap: removing container" podUID="1ba61bb8-6c32-451b-ab2c-07b23395d08d" containerName="revoke-keys"
Oct 31 17:41:46.560452 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:46.560320    5003 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="1ba61bb8-6c32-451b-ab2c-07b23395d08d" containerName="revoke-keys"
Oct 31 17:41:46.560452 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:46.560433    5003 memory_manager.go:365] "RemoveStaleState removing state" podUID="1d105e9a-34e9-4888-8433-3e2e20b06aea" containerName="revoke-keys"
Oct 31 17:41:46.560452 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:46.560442    5003 memory_manager.go:365] "RemoveStaleState removing state" podUID="1ba61bb8-6c32-451b-ab2c-07b23395d08d" containerName="revoke-keys"
Oct 31 17:41:46.564701 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:46.564677    5003 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-cf0a86-openshift-default-595bfdc58c-jg25b"
Oct 31 17:41:46.594600 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:46.594569    5003 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w3-cf0a86-openshift-default-595bfdc58c-jg25b"]
Oct 31 17:41:46.633185 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:46.633140    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/61193be6-6ada-48ff-9e96-700c73f018dd-credential-socket\") pod \"e2e-worker-w3-cf0a86-openshift-default-595bfdc58c-jg25b\" (UID: \"61193be6-6ada-48ff-9e96-700c73f018dd\") " pod="openshift-ingress/e2e-worker-w3-cf0a86-openshift-default-595bfdc58c-jg25b"
Oct 31 17:41:46.633385 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:46.633203    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/61193be6-6ada-48ff-9e96-700c73f018dd-istiod-ca-cert\") pod \"e2e-worker-w3-cf0a86-openshift-default-595bfdc58c-jg25b\" (UID: \"61193be6-6ada-48ff-9e96-700c73f018dd\") " pod="openshift-ingress/e2e-worker-w3-cf0a86-openshift-default-595bfdc58c-jg25b"
Oct 31 17:41:46.633385 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:46.633295    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/61193be6-6ada-48ff-9e96-700c73f018dd-istio-data\") pod \"e2e-worker-w3-cf0a86-openshift-default-595bfdc58c-jg25b\" (UID: \"61193be6-6ada-48ff-9e96-700c73f018dd\") " pod="openshift-ingress/e2e-worker-w3-cf0a86-openshift-default-595bfdc58c-jg25b"
Oct 31 17:41:46.633385 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:46.633337    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/61193be6-6ada-48ff-9e96-700c73f018dd-workload-certs\") pod \"e2e-worker-w3-cf0a86-openshift-default-595bfdc58c-jg25b\" (UID: \"61193be6-6ada-48ff-9e96-700c73f018dd\") " pod="openshift-ingress/e2e-worker-w3-cf0a86-openshift-default-595bfdc58c-jg25b"
Oct 31 17:41:46.633539 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:46.633423    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/61193be6-6ada-48ff-9e96-700c73f018dd-istio-podinfo\") pod \"e2e-worker-w3-cf0a86-openshift-default-595bfdc58c-jg25b\" (UID: \"61193be6-6ada-48ff-9e96-700c73f018dd\") " pod="openshift-ingress/e2e-worker-w3-cf0a86-openshift-default-595bfdc58c-jg25b"
Oct 31 17:41:46.633539 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:46.633505    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/61193be6-6ada-48ff-9e96-700c73f018dd-istio-envoy\") pod \"e2e-worker-w3-cf0a86-openshift-default-595bfdc58c-jg25b\" (UID: \"61193be6-6ada-48ff-9e96-700c73f018dd\") " pod="openshift-ingress/e2e-worker-w3-cf0a86-openshift-default-595bfdc58c-jg25b"
Oct 31 17:41:46.633724 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:46.633708    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/61193be6-6ada-48ff-9e96-700c73f018dd-istio-token\") pod \"e2e-worker-w3-cf0a86-openshift-default-595bfdc58c-jg25b\" (UID: \"61193be6-6ada-48ff-9e96-700c73f018dd\") " pod="openshift-ingress/e2e-worker-w3-cf0a86-openshift-default-595bfdc58c-jg25b"
Oct 31 17:41:46.633835 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:46.633744    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/61193be6-6ada-48ff-9e96-700c73f018dd-workload-socket\") pod \"e2e-worker-w3-cf0a86-openshift-default-595bfdc58c-jg25b\" (UID: \"61193be6-6ada-48ff-9e96-700c73f018dd\") " pod="openshift-ingress/e2e-worker-w3-cf0a86-openshift-default-595bfdc58c-jg25b"
Oct 31 17:41:46.633835 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:46.633800    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-frxtv\" (UniqueName: \"kubernetes.io/projected/61193be6-6ada-48ff-9e96-700c73f018dd-kube-api-access-frxtv\") pod \"e2e-worker-w3-cf0a86-openshift-default-595bfdc58c-jg25b\" (UID: \"61193be6-6ada-48ff-9e96-700c73f018dd\") " pod="openshift-ingress/e2e-worker-w3-cf0a86-openshift-default-595bfdc58c-jg25b"
Oct 31 17:41:46.734950 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:46.734914    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/61193be6-6ada-48ff-9e96-700c73f018dd-istio-envoy\") pod \"e2e-worker-w3-cf0a86-openshift-default-595bfdc58c-jg25b\" (UID: \"61193be6-6ada-48ff-9e96-700c73f018dd\") " pod="openshift-ingress/e2e-worker-w3-cf0a86-openshift-default-595bfdc58c-jg25b"
Oct 31 17:41:46.735114 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:46.735035    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/61193be6-6ada-48ff-9e96-700c73f018dd-istio-token\") pod \"e2e-worker-w3-cf0a86-openshift-default-595bfdc58c-jg25b\" (UID: \"61193be6-6ada-48ff-9e96-700c73f018dd\") " pod="openshift-ingress/e2e-worker-w3-cf0a86-openshift-default-595bfdc58c-jg25b"
Oct 31 17:41:46.735114 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:46.735057    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/61193be6-6ada-48ff-9e96-700c73f018dd-workload-socket\") pod \"e2e-worker-w3-cf0a86-openshift-default-595bfdc58c-jg25b\" (UID: \"61193be6-6ada-48ff-9e96-700c73f018dd\") " pod="openshift-ingress/e2e-worker-w3-cf0a86-openshift-default-595bfdc58c-jg25b"
Oct 31 17:41:46.735114 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:46.735077    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-frxtv\" (UniqueName: \"kubernetes.io/projected/61193be6-6ada-48ff-9e96-700c73f018dd-kube-api-access-frxtv\") pod \"e2e-worker-w3-cf0a86-openshift-default-595bfdc58c-jg25b\" (UID: \"61193be6-6ada-48ff-9e96-700c73f018dd\") " pod="openshift-ingress/e2e-worker-w3-cf0a86-openshift-default-595bfdc58c-jg25b"
Oct 31 17:41:46.735291 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:46.735163    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/61193be6-6ada-48ff-9e96-700c73f018dd-credential-socket\") pod \"e2e-worker-w3-cf0a86-openshift-default-595bfdc58c-jg25b\" (UID: \"61193be6-6ada-48ff-9e96-700c73f018dd\") " pod="openshift-ingress/e2e-worker-w3-cf0a86-openshift-default-595bfdc58c-jg25b"
Oct 31 17:41:46.735291 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:46.735192    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/61193be6-6ada-48ff-9e96-700c73f018dd-istiod-ca-cert\") pod \"e2e-worker-w3-cf0a86-openshift-default-595bfdc58c-jg25b\" (UID: \"61193be6-6ada-48ff-9e96-700c73f018dd\") " pod="openshift-ingress/e2e-worker-w3-cf0a86-openshift-default-595bfdc58c-jg25b"
Oct 31 17:41:46.735291 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:46.735235    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/61193be6-6ada-48ff-9e96-700c73f018dd-istio-data\") pod \"e2e-worker-w3-cf0a86-openshift-default-595bfdc58c-jg25b\" (UID: \"61193be6-6ada-48ff-9e96-700c73f018dd\") " pod="openshift-ingress/e2e-worker-w3-cf0a86-openshift-default-595bfdc58c-jg25b"
Oct 31 17:41:46.735291 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:46.735277    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/61193be6-6ada-48ff-9e96-700c73f018dd-workload-certs\") pod \"e2e-worker-w3-cf0a86-openshift-default-595bfdc58c-jg25b\" (UID: \"61193be6-6ada-48ff-9e96-700c73f018dd\") " pod="openshift-ingress/e2e-worker-w3-cf0a86-openshift-default-595bfdc58c-jg25b"
Oct 31 17:41:46.735501 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:46.735339    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/61193be6-6ada-48ff-9e96-700c73f018dd-istio-podinfo\") pod \"e2e-worker-w3-cf0a86-openshift-default-595bfdc58c-jg25b\" (UID: \"61193be6-6ada-48ff-9e96-700c73f018dd\") " pod="openshift-ingress/e2e-worker-w3-cf0a86-openshift-default-595bfdc58c-jg25b"
Oct 31 17:41:46.735552 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:46.735494    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/61193be6-6ada-48ff-9e96-700c73f018dd-workload-socket\") pod \"e2e-worker-w3-cf0a86-openshift-default-595bfdc58c-jg25b\" (UID: \"61193be6-6ada-48ff-9e96-700c73f018dd\") " pod="openshift-ingress/e2e-worker-w3-cf0a86-openshift-default-595bfdc58c-jg25b"
Oct 31 17:41:46.735637 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:46.735612    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/61193be6-6ada-48ff-9e96-700c73f018dd-credential-socket\") pod \"e2e-worker-w3-cf0a86-openshift-default-595bfdc58c-jg25b\" (UID: \"61193be6-6ada-48ff-9e96-700c73f018dd\") " pod="openshift-ingress/e2e-worker-w3-cf0a86-openshift-default-595bfdc58c-jg25b"
Oct 31 17:41:46.735820 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:46.735795    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/61193be6-6ada-48ff-9e96-700c73f018dd-workload-certs\") pod \"e2e-worker-w3-cf0a86-openshift-default-595bfdc58c-jg25b\" (UID: \"61193be6-6ada-48ff-9e96-700c73f018dd\") " pod="openshift-ingress/e2e-worker-w3-cf0a86-openshift-default-595bfdc58c-jg25b"
Oct 31 17:41:46.735882 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:46.735715    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/61193be6-6ada-48ff-9e96-700c73f018dd-istio-data\") pod \"e2e-worker-w3-cf0a86-openshift-default-595bfdc58c-jg25b\" (UID: \"61193be6-6ada-48ff-9e96-700c73f018dd\") " pod="openshift-ingress/e2e-worker-w3-cf0a86-openshift-default-595bfdc58c-jg25b"
Oct 31 17:41:46.736047 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:46.736021    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/61193be6-6ada-48ff-9e96-700c73f018dd-istiod-ca-cert\") pod \"e2e-worker-w3-cf0a86-openshift-default-595bfdc58c-jg25b\" (UID: \"61193be6-6ada-48ff-9e96-700c73f018dd\") " pod="openshift-ingress/e2e-worker-w3-cf0a86-openshift-default-595bfdc58c-jg25b"
Oct 31 17:41:46.737343 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:46.737322    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/61193be6-6ada-48ff-9e96-700c73f018dd-istio-envoy\") pod \"e2e-worker-w3-cf0a86-openshift-default-595bfdc58c-jg25b\" (UID: \"61193be6-6ada-48ff-9e96-700c73f018dd\") " pod="openshift-ingress/e2e-worker-w3-cf0a86-openshift-default-595bfdc58c-jg25b"
Oct 31 17:41:46.737763 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:46.737744    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/61193be6-6ada-48ff-9e96-700c73f018dd-istio-podinfo\") pod \"e2e-worker-w3-cf0a86-openshift-default-595bfdc58c-jg25b\" (UID: \"61193be6-6ada-48ff-9e96-700c73f018dd\") " pod="openshift-ingress/e2e-worker-w3-cf0a86-openshift-default-595bfdc58c-jg25b"
Oct 31 17:41:46.753596 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:46.753572    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/61193be6-6ada-48ff-9e96-700c73f018dd-istio-token\") pod \"e2e-worker-w3-cf0a86-openshift-default-595bfdc58c-jg25b\" (UID: \"61193be6-6ada-48ff-9e96-700c73f018dd\") " pod="openshift-ingress/e2e-worker-w3-cf0a86-openshift-default-595bfdc58c-jg25b"
Oct 31 17:41:46.753804 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:46.753787    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-frxtv\" (UniqueName: \"kubernetes.io/projected/61193be6-6ada-48ff-9e96-700c73f018dd-kube-api-access-frxtv\") pod \"e2e-worker-w3-cf0a86-openshift-default-595bfdc58c-jg25b\" (UID: \"61193be6-6ada-48ff-9e96-700c73f018dd\") " pod="openshift-ingress/e2e-worker-w3-cf0a86-openshift-default-595bfdc58c-jg25b"
Oct 31 17:41:46.821780 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:46.821697    5003 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w4-1c0bfd-openshift-default-f7f657c57-hp2wj"]
Oct 31 17:41:46.828438 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:46.828411    5003 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-1c0bfd-openshift-default-f7f657c57-hp2wj"
Oct 31 17:41:46.848141 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:46.848115    5003 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-1c0bfd-openshift-default-f7f657c57-hp2wj"]
Oct 31 17:41:46.881152 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:46.881113    5003 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-cf0a86-openshift-default-595bfdc58c-jg25b"
Oct 31 17:41:46.938746 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:46.938707    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/679da5c1-9c28-4f80-a210-185350147f11-istio-envoy\") pod \"e2e-worker-w4-1c0bfd-openshift-default-f7f657c57-hp2wj\" (UID: \"679da5c1-9c28-4f80-a210-185350147f11\") " pod="openshift-ingress/e2e-worker-w4-1c0bfd-openshift-default-f7f657c57-hp2wj"
Oct 31 17:41:46.938936 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:46.938776    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/679da5c1-9c28-4f80-a210-185350147f11-istio-podinfo\") pod \"e2e-worker-w4-1c0bfd-openshift-default-f7f657c57-hp2wj\" (UID: \"679da5c1-9c28-4f80-a210-185350147f11\") " pod="openshift-ingress/e2e-worker-w4-1c0bfd-openshift-default-f7f657c57-hp2wj"
Oct 31 17:41:46.938936 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:46.938807    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s4pgj\" (UniqueName: \"kubernetes.io/projected/679da5c1-9c28-4f80-a210-185350147f11-kube-api-access-s4pgj\") pod \"e2e-worker-w4-1c0bfd-openshift-default-f7f657c57-hp2wj\" (UID: \"679da5c1-9c28-4f80-a210-185350147f11\") " pod="openshift-ingress/e2e-worker-w4-1c0bfd-openshift-default-f7f657c57-hp2wj"
Oct 31 17:41:46.938936 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:46.938902    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/679da5c1-9c28-4f80-a210-185350147f11-credential-socket\") pod \"e2e-worker-w4-1c0bfd-openshift-default-f7f657c57-hp2wj\" (UID: \"679da5c1-9c28-4f80-a210-185350147f11\") " pod="openshift-ingress/e2e-worker-w4-1c0bfd-openshift-default-f7f657c57-hp2wj"
Oct 31 17:41:46.938936 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:46.938933    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/679da5c1-9c28-4f80-a210-185350147f11-workload-socket\") pod \"e2e-worker-w4-1c0bfd-openshift-default-f7f657c57-hp2wj\" (UID: \"679da5c1-9c28-4f80-a210-185350147f11\") " pod="openshift-ingress/e2e-worker-w4-1c0bfd-openshift-default-f7f657c57-hp2wj"
Oct 31 17:41:46.939172 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:46.938981    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/679da5c1-9c28-4f80-a210-185350147f11-istiod-ca-cert\") pod \"e2e-worker-w4-1c0bfd-openshift-default-f7f657c57-hp2wj\" (UID: \"679da5c1-9c28-4f80-a210-185350147f11\") " pod="openshift-ingress/e2e-worker-w4-1c0bfd-openshift-default-f7f657c57-hp2wj"
Oct 31 17:41:46.939172 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:46.939052    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/679da5c1-9c28-4f80-a210-185350147f11-istio-data\") pod \"e2e-worker-w4-1c0bfd-openshift-default-f7f657c57-hp2wj\" (UID: \"679da5c1-9c28-4f80-a210-185350147f11\") " pod="openshift-ingress/e2e-worker-w4-1c0bfd-openshift-default-f7f657c57-hp2wj"
Oct 31 17:41:46.939172 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:46.939116    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/679da5c1-9c28-4f80-a210-185350147f11-workload-certs\") pod \"e2e-worker-w4-1c0bfd-openshift-default-f7f657c57-hp2wj\" (UID: \"679da5c1-9c28-4f80-a210-185350147f11\") " pod="openshift-ingress/e2e-worker-w4-1c0bfd-openshift-default-f7f657c57-hp2wj"
Oct 31 17:41:46.939317 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:46.939243    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/679da5c1-9c28-4f80-a210-185350147f11-istio-token\") pod \"e2e-worker-w4-1c0bfd-openshift-default-f7f657c57-hp2wj\" (UID: \"679da5c1-9c28-4f80-a210-185350147f11\") " pod="openshift-ingress/e2e-worker-w4-1c0bfd-openshift-default-f7f657c57-hp2wj"
Oct 31 17:41:47.040384 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:47.040344    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/679da5c1-9c28-4f80-a210-185350147f11-istio-envoy\") pod \"e2e-worker-w4-1c0bfd-openshift-default-f7f657c57-hp2wj\" (UID: \"679da5c1-9c28-4f80-a210-185350147f11\") " pod="openshift-ingress/e2e-worker-w4-1c0bfd-openshift-default-f7f657c57-hp2wj"
Oct 31 17:41:47.040582 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:47.040395    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/679da5c1-9c28-4f80-a210-185350147f11-istio-podinfo\") pod \"e2e-worker-w4-1c0bfd-openshift-default-f7f657c57-hp2wj\" (UID: \"679da5c1-9c28-4f80-a210-185350147f11\") " pod="openshift-ingress/e2e-worker-w4-1c0bfd-openshift-default-f7f657c57-hp2wj"
Oct 31 17:41:47.040582 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:47.040419    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s4pgj\" (UniqueName: \"kubernetes.io/projected/679da5c1-9c28-4f80-a210-185350147f11-kube-api-access-s4pgj\") pod \"e2e-worker-w4-1c0bfd-openshift-default-f7f657c57-hp2wj\" (UID: \"679da5c1-9c28-4f80-a210-185350147f11\") " pod="openshift-ingress/e2e-worker-w4-1c0bfd-openshift-default-f7f657c57-hp2wj"
Oct 31 17:41:47.040582 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:47.040501    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/679da5c1-9c28-4f80-a210-185350147f11-credential-socket\") pod \"e2e-worker-w4-1c0bfd-openshift-default-f7f657c57-hp2wj\" (UID: \"679da5c1-9c28-4f80-a210-185350147f11\") " pod="openshift-ingress/e2e-worker-w4-1c0bfd-openshift-default-f7f657c57-hp2wj"
Oct 31 17:41:47.040582 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:47.040533    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/679da5c1-9c28-4f80-a210-185350147f11-workload-socket\") pod \"e2e-worker-w4-1c0bfd-openshift-default-f7f657c57-hp2wj\" (UID: \"679da5c1-9c28-4f80-a210-185350147f11\") " pod="openshift-ingress/e2e-worker-w4-1c0bfd-openshift-default-f7f657c57-hp2wj"
Oct 31 17:41:47.040582 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:47.040578    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/679da5c1-9c28-4f80-a210-185350147f11-istiod-ca-cert\") pod \"e2e-worker-w4-1c0bfd-openshift-default-f7f657c57-hp2wj\" (UID: \"679da5c1-9c28-4f80-a210-185350147f11\") " pod="openshift-ingress/e2e-worker-w4-1c0bfd-openshift-default-f7f657c57-hp2wj"
Oct 31 17:41:47.040888 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:47.040658    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/679da5c1-9c28-4f80-a210-185350147f11-istio-data\") pod \"e2e-worker-w4-1c0bfd-openshift-default-f7f657c57-hp2wj\" (UID: \"679da5c1-9c28-4f80-a210-185350147f11\") " pod="openshift-ingress/e2e-worker-w4-1c0bfd-openshift-default-f7f657c57-hp2wj"
Oct 31 17:41:47.040888 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:47.040728    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/679da5c1-9c28-4f80-a210-185350147f11-workload-certs\") pod \"e2e-worker-w4-1c0bfd-openshift-default-f7f657c57-hp2wj\" (UID: \"679da5c1-9c28-4f80-a210-185350147f11\") " pod="openshift-ingress/e2e-worker-w4-1c0bfd-openshift-default-f7f657c57-hp2wj"
Oct 31 17:41:47.040888 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:47.040846    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/679da5c1-9c28-4f80-a210-185350147f11-istio-token\") pod \"e2e-worker-w4-1c0bfd-openshift-default-f7f657c57-hp2wj\" (UID: \"679da5c1-9c28-4f80-a210-185350147f11\") " pod="openshift-ingress/e2e-worker-w4-1c0bfd-openshift-default-f7f657c57-hp2wj"
Oct 31 17:41:47.041137 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:47.041108    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/679da5c1-9c28-4f80-a210-185350147f11-workload-socket\") pod \"e2e-worker-w4-1c0bfd-openshift-default-f7f657c57-hp2wj\" (UID: \"679da5c1-9c28-4f80-a210-185350147f11\") " pod="openshift-ingress/e2e-worker-w4-1c0bfd-openshift-default-f7f657c57-hp2wj"
Oct 31 17:41:47.041407 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:47.041384    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/679da5c1-9c28-4f80-a210-185350147f11-istio-data\") pod \"e2e-worker-w4-1c0bfd-openshift-default-f7f657c57-hp2wj\" (UID: \"679da5c1-9c28-4f80-a210-185350147f11\") " pod="openshift-ingress/e2e-worker-w4-1c0bfd-openshift-default-f7f657c57-hp2wj"
Oct 31 17:41:47.041515 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:47.041490    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/679da5c1-9c28-4f80-a210-185350147f11-workload-certs\") pod \"e2e-worker-w4-1c0bfd-openshift-default-f7f657c57-hp2wj\" (UID: \"679da5c1-9c28-4f80-a210-185350147f11\") " pod="openshift-ingress/e2e-worker-w4-1c0bfd-openshift-default-f7f657c57-hp2wj"
Oct 31 17:41:47.041736 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:47.041714    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/679da5c1-9c28-4f80-a210-185350147f11-credential-socket\") pod \"e2e-worker-w4-1c0bfd-openshift-default-f7f657c57-hp2wj\" (UID: \"679da5c1-9c28-4f80-a210-185350147f11\") " pod="openshift-ingress/e2e-worker-w4-1c0bfd-openshift-default-f7f657c57-hp2wj"
Oct 31 17:41:47.042324 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:47.042110    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/679da5c1-9c28-4f80-a210-185350147f11-istiod-ca-cert\") pod \"e2e-worker-w4-1c0bfd-openshift-default-f7f657c57-hp2wj\" (UID: \"679da5c1-9c28-4f80-a210-185350147f11\") " pod="openshift-ingress/e2e-worker-w4-1c0bfd-openshift-default-f7f657c57-hp2wj"
Oct 31 17:41:47.042956 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:47.042935    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/679da5c1-9c28-4f80-a210-185350147f11-istio-envoy\") pod \"e2e-worker-w4-1c0bfd-openshift-default-f7f657c57-hp2wj\" (UID: \"679da5c1-9c28-4f80-a210-185350147f11\") " pod="openshift-ingress/e2e-worker-w4-1c0bfd-openshift-default-f7f657c57-hp2wj"
Oct 31 17:41:47.043225 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:47.043208    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/679da5c1-9c28-4f80-a210-185350147f11-istio-podinfo\") pod \"e2e-worker-w4-1c0bfd-openshift-default-f7f657c57-hp2wj\" (UID: \"679da5c1-9c28-4f80-a210-185350147f11\") " pod="openshift-ingress/e2e-worker-w4-1c0bfd-openshift-default-f7f657c57-hp2wj"
Oct 31 17:41:47.059427 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:47.059400    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/679da5c1-9c28-4f80-a210-185350147f11-istio-token\") pod \"e2e-worker-w4-1c0bfd-openshift-default-f7f657c57-hp2wj\" (UID: \"679da5c1-9c28-4f80-a210-185350147f11\") " pod="openshift-ingress/e2e-worker-w4-1c0bfd-openshift-default-f7f657c57-hp2wj"
Oct 31 17:41:47.059747 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:47.059728    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s4pgj\" (UniqueName: \"kubernetes.io/projected/679da5c1-9c28-4f80-a210-185350147f11-kube-api-access-s4pgj\") pod \"e2e-worker-w4-1c0bfd-openshift-default-f7f657c57-hp2wj\" (UID: \"679da5c1-9c28-4f80-a210-185350147f11\") " pod="openshift-ingress/e2e-worker-w4-1c0bfd-openshift-default-f7f657c57-hp2wj"
Oct 31 17:41:47.145208 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:47.145136    5003 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-1c0bfd-openshift-default-f7f657c57-hp2wj"
Oct 31 17:41:47.215580 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:47.215549    5003 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w3-cf0a86-openshift-default-595bfdc58c-jg25b"]
Oct 31 17:41:47.238181 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:47.238156    5003 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w0-ee816e-openshift-default-c4db85b5c-dz8kv"]
Oct 31 17:41:47.238276 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:47.238150    5003 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Oct 31 17:41:47.238324 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:47.238299    5003 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Oct 31 17:41:47.238359 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:47.238331    5003 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Oct 31 17:41:47.248311 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:47.248288    5003 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-ee816e-openshift-default-c4db85b5c-dz8kv"
Oct 31 17:41:47.278368 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:47.278338    5003 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-ee816e-openshift-default-c4db85b5c-dz8kv"]
Oct 31 17:41:47.355388 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:47.346189    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6dbed28d-b3b9-4af1-82b7-40151ba418c1-istio-data\") pod \"e2e-worker-w0-ee816e-openshift-default-c4db85b5c-dz8kv\" (UID: \"6dbed28d-b3b9-4af1-82b7-40151ba418c1\") " pod="openshift-ingress/e2e-worker-w0-ee816e-openshift-default-c4db85b5c-dz8kv"
Oct 31 17:41:47.355388 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:47.346246    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6dbed28d-b3b9-4af1-82b7-40151ba418c1-credential-socket\") pod \"e2e-worker-w0-ee816e-openshift-default-c4db85b5c-dz8kv\" (UID: \"6dbed28d-b3b9-4af1-82b7-40151ba418c1\") " pod="openshift-ingress/e2e-worker-w0-ee816e-openshift-default-c4db85b5c-dz8kv"
Oct 31 17:41:47.355388 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:47.346309    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6dbed28d-b3b9-4af1-82b7-40151ba418c1-istiod-ca-cert\") pod \"e2e-worker-w0-ee816e-openshift-default-c4db85b5c-dz8kv\" (UID: \"6dbed28d-b3b9-4af1-82b7-40151ba418c1\") " pod="openshift-ingress/e2e-worker-w0-ee816e-openshift-default-c4db85b5c-dz8kv"
Oct 31 17:41:47.355388 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:47.346388    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6dbed28d-b3b9-4af1-82b7-40151ba418c1-istio-token\") pod \"e2e-worker-w0-ee816e-openshift-default-c4db85b5c-dz8kv\" (UID: \"6dbed28d-b3b9-4af1-82b7-40151ba418c1\") " pod="openshift-ingress/e2e-worker-w0-ee816e-openshift-default-c4db85b5c-dz8kv"
Oct 31 17:41:47.355388 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:47.346430    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6dbed28d-b3b9-4af1-82b7-40151ba418c1-workload-certs\") pod \"e2e-worker-w0-ee816e-openshift-default-c4db85b5c-dz8kv\" (UID: \"6dbed28d-b3b9-4af1-82b7-40151ba418c1\") " pod="openshift-ingress/e2e-worker-w0-ee816e-openshift-default-c4db85b5c-dz8kv"
Oct 31 17:41:47.355388 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:47.346487    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6dbed28d-b3b9-4af1-82b7-40151ba418c1-istio-podinfo\") pod \"e2e-worker-w0-ee816e-openshift-default-c4db85b5c-dz8kv\" (UID: \"6dbed28d-b3b9-4af1-82b7-40151ba418c1\") " pod="openshift-ingress/e2e-worker-w0-ee816e-openshift-default-c4db85b5c-dz8kv"
Oct 31 17:41:47.355388 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:47.346716    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6dbed28d-b3b9-4af1-82b7-40151ba418c1-workload-socket\") pod \"e2e-worker-w0-ee816e-openshift-default-c4db85b5c-dz8kv\" (UID: \"6dbed28d-b3b9-4af1-82b7-40151ba418c1\") " pod="openshift-ingress/e2e-worker-w0-ee816e-openshift-default-c4db85b5c-dz8kv"
Oct 31 17:41:47.355388 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:47.346806    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-29wtw\" (UniqueName: \"kubernetes.io/projected/6dbed28d-b3b9-4af1-82b7-40151ba418c1-kube-api-access-29wtw\") pod \"e2e-worker-w0-ee816e-openshift-default-c4db85b5c-dz8kv\" (UID: \"6dbed28d-b3b9-4af1-82b7-40151ba418c1\") " pod="openshift-ingress/e2e-worker-w0-ee816e-openshift-default-c4db85b5c-dz8kv"
Oct 31 17:41:47.355388 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:47.349425    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6dbed28d-b3b9-4af1-82b7-40151ba418c1-istio-envoy\") pod \"e2e-worker-w0-ee816e-openshift-default-c4db85b5c-dz8kv\" (UID: \"6dbed28d-b3b9-4af1-82b7-40151ba418c1\") " pod="openshift-ingress/e2e-worker-w0-ee816e-openshift-default-c4db85b5c-dz8kv"
Oct 31 17:41:47.367211 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:47.367147    5003 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-9rlpc"]
Oct 31 17:41:47.374752 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:47.374725    5003 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-9rlpc"
Oct 31 17:41:47.400917 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:47.398525    5003 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-9rlpc"]
Oct 31 17:41:47.441505 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:47.441462    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-cf0a86-openshift-default-595bfdc58c-jg25b" event={"ID":"61193be6-6ada-48ff-9e96-700c73f018dd","Type":"ContainerStarted","Data":"15223b5a03fae4c192405ab90afbea6bc329c562bbc20103f6a231f371f1d23e"}
Oct 31 17:41:47.441758 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:47.441540    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-cf0a86-openshift-default-595bfdc58c-jg25b" event={"ID":"61193be6-6ada-48ff-9e96-700c73f018dd","Type":"ContainerStarted","Data":"01fc905e40cc6a5789df8d17f25033cb71a9b2553f7847ef43b288a0c1b8bdc3"}
Oct 31 17:41:47.450630 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:47.450600    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6dbed28d-b3b9-4af1-82b7-40151ba418c1-istio-token\") pod \"e2e-worker-w0-ee816e-openshift-default-c4db85b5c-dz8kv\" (UID: \"6dbed28d-b3b9-4af1-82b7-40151ba418c1\") " pod="openshift-ingress/e2e-worker-w0-ee816e-openshift-default-c4db85b5c-dz8kv"
Oct 31 17:41:47.451116 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:47.451093    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a115d540-ac87-497f-97f8-bd2e52d066f7-istiod-ca-cert\") pod \"e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-9rlpc\" (UID: \"a115d540-ac87-497f-97f8-bd2e52d066f7\") " pod="openshift-ingress/e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-9rlpc"
Oct 31 17:41:47.451481 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:47.451456    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-97vf9\" (UniqueName: \"kubernetes.io/projected/a115d540-ac87-497f-97f8-bd2e52d066f7-kube-api-access-97vf9\") pod \"e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-9rlpc\" (UID: \"a115d540-ac87-497f-97f8-bd2e52d066f7\") " pod="openshift-ingress/e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-9rlpc"
Oct 31 17:41:47.451692 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:47.451674    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6dbed28d-b3b9-4af1-82b7-40151ba418c1-workload-certs\") pod \"e2e-worker-w0-ee816e-openshift-default-c4db85b5c-dz8kv\" (UID: \"6dbed28d-b3b9-4af1-82b7-40151ba418c1\") " pod="openshift-ingress/e2e-worker-w0-ee816e-openshift-default-c4db85b5c-dz8kv"
Oct 31 17:41:47.454048 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:47.454031    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6dbed28d-b3b9-4af1-82b7-40151ba418c1-istio-podinfo\") pod \"e2e-worker-w0-ee816e-openshift-default-c4db85b5c-dz8kv\" (UID: \"6dbed28d-b3b9-4af1-82b7-40151ba418c1\") " pod="openshift-ingress/e2e-worker-w0-ee816e-openshift-default-c4db85b5c-dz8kv"
Oct 31 17:41:47.454583 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:47.454563    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6dbed28d-b3b9-4af1-82b7-40151ba418c1-workload-socket\") pod \"e2e-worker-w0-ee816e-openshift-default-c4db85b5c-dz8kv\" (UID: \"6dbed28d-b3b9-4af1-82b7-40151ba418c1\") " pod="openshift-ingress/e2e-worker-w0-ee816e-openshift-default-c4db85b5c-dz8kv"
Oct 31 17:41:47.454954 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:47.454940    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a115d540-ac87-497f-97f8-bd2e52d066f7-istio-data\") pod \"e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-9rlpc\" (UID: \"a115d540-ac87-497f-97f8-bd2e52d066f7\") " pod="openshift-ingress/e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-9rlpc"
Oct 31 17:41:47.455077 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:47.455066    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a115d540-ac87-497f-97f8-bd2e52d066f7-istio-podinfo\") pod \"e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-9rlpc\" (UID: \"a115d540-ac87-497f-97f8-bd2e52d066f7\") " pod="openshift-ingress/e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-9rlpc"
Oct 31 17:41:47.455206 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:47.455197    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a115d540-ac87-497f-97f8-bd2e52d066f7-istio-envoy\") pod \"e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-9rlpc\" (UID: \"a115d540-ac87-497f-97f8-bd2e52d066f7\") " pod="openshift-ingress/e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-9rlpc"
Oct 31 17:41:47.455321 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:47.455308    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-29wtw\" (UniqueName: \"kubernetes.io/projected/6dbed28d-b3b9-4af1-82b7-40151ba418c1-kube-api-access-29wtw\") pod \"e2e-worker-w0-ee816e-openshift-default-c4db85b5c-dz8kv\" (UID: \"6dbed28d-b3b9-4af1-82b7-40151ba418c1\") " pod="openshift-ingress/e2e-worker-w0-ee816e-openshift-default-c4db85b5c-dz8kv"
Oct 31 17:41:47.455719 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:47.455702    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a115d540-ac87-497f-97f8-bd2e52d066f7-workload-certs\") pod \"e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-9rlpc\" (UID: \"a115d540-ac87-497f-97f8-bd2e52d066f7\") " pod="openshift-ingress/e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-9rlpc"
Oct 31 17:41:47.455879 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:47.455861    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a115d540-ac87-497f-97f8-bd2e52d066f7-credential-socket\") pod \"e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-9rlpc\" (UID: \"a115d540-ac87-497f-97f8-bd2e52d066f7\") " pod="openshift-ingress/e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-9rlpc"
Oct 31 17:41:47.456073 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:47.456054    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6dbed28d-b3b9-4af1-82b7-40151ba418c1-istio-envoy\") pod \"e2e-worker-w0-ee816e-openshift-default-c4db85b5c-dz8kv\" (UID: \"6dbed28d-b3b9-4af1-82b7-40151ba418c1\") " pod="openshift-ingress/e2e-worker-w0-ee816e-openshift-default-c4db85b5c-dz8kv"
Oct 31 17:41:47.457153 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:47.457087    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a115d540-ac87-497f-97f8-bd2e52d066f7-istio-token\") pod \"e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-9rlpc\" (UID: \"a115d540-ac87-497f-97f8-bd2e52d066f7\") " pod="openshift-ingress/e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-9rlpc"
Oct 31 17:41:47.458443 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:47.458426    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6dbed28d-b3b9-4af1-82b7-40151ba418c1-istio-data\") pod \"e2e-worker-w0-ee816e-openshift-default-c4db85b5c-dz8kv\" (UID: \"6dbed28d-b3b9-4af1-82b7-40151ba418c1\") " pod="openshift-ingress/e2e-worker-w0-ee816e-openshift-default-c4db85b5c-dz8kv"
Oct 31 17:41:47.458839 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:47.458825    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6dbed28d-b3b9-4af1-82b7-40151ba418c1-credential-socket\") pod \"e2e-worker-w0-ee816e-openshift-default-c4db85b5c-dz8kv\" (UID: \"6dbed28d-b3b9-4af1-82b7-40151ba418c1\") " pod="openshift-ingress/e2e-worker-w0-ee816e-openshift-default-c4db85b5c-dz8kv"
Oct 31 17:41:47.459237 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:47.459225    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6dbed28d-b3b9-4af1-82b7-40151ba418c1-istiod-ca-cert\") pod \"e2e-worker-w0-ee816e-openshift-default-c4db85b5c-dz8kv\" (UID: \"6dbed28d-b3b9-4af1-82b7-40151ba418c1\") " pod="openshift-ingress/e2e-worker-w0-ee816e-openshift-default-c4db85b5c-dz8kv"
Oct 31 17:41:47.460188 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:47.460170    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a115d540-ac87-497f-97f8-bd2e52d066f7-workload-socket\") pod \"e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-9rlpc\" (UID: \"a115d540-ac87-497f-97f8-bd2e52d066f7\") " pod="openshift-ingress/e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-9rlpc"
Oct 31 17:41:47.460485 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:47.459135    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6dbed28d-b3b9-4af1-82b7-40151ba418c1-credential-socket\") pod \"e2e-worker-w0-ee816e-openshift-default-c4db85b5c-dz8kv\" (UID: \"6dbed28d-b3b9-4af1-82b7-40151ba418c1\") " pod="openshift-ingress/e2e-worker-w0-ee816e-openshift-default-c4db85b5c-dz8kv"
Oct 31 17:41:47.460590 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:47.452872    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6dbed28d-b3b9-4af1-82b7-40151ba418c1-workload-certs\") pod \"e2e-worker-w0-ee816e-openshift-default-c4db85b5c-dz8kv\" (UID: \"6dbed28d-b3b9-4af1-82b7-40151ba418c1\") " pod="openshift-ingress/e2e-worker-w0-ee816e-openshift-default-c4db85b5c-dz8kv"
Oct 31 17:41:47.460674 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:47.459952    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6dbed28d-b3b9-4af1-82b7-40151ba418c1-istiod-ca-cert\") pod \"e2e-worker-w0-ee816e-openshift-default-c4db85b5c-dz8kv\" (UID: \"6dbed28d-b3b9-4af1-82b7-40151ba418c1\") " pod="openshift-ingress/e2e-worker-w0-ee816e-openshift-default-c4db85b5c-dz8kv"
Oct 31 17:41:47.460750 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:47.458771    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6dbed28d-b3b9-4af1-82b7-40151ba418c1-istio-data\") pod \"e2e-worker-w0-ee816e-openshift-default-c4db85b5c-dz8kv\" (UID: \"6dbed28d-b3b9-4af1-82b7-40151ba418c1\") " pod="openshift-ingress/e2e-worker-w0-ee816e-openshift-default-c4db85b5c-dz8kv"
Oct 31 17:41:47.460807 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:47.454896    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6dbed28d-b3b9-4af1-82b7-40151ba418c1-workload-socket\") pod \"e2e-worker-w0-ee816e-openshift-default-c4db85b5c-dz8kv\" (UID: \"6dbed28d-b3b9-4af1-82b7-40151ba418c1\") " pod="openshift-ingress/e2e-worker-w0-ee816e-openshift-default-c4db85b5c-dz8kv"
Oct 31 17:41:47.476472 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:47.475568    5003 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-1c0bfd-openshift-default-f7f657c57-hp2wj"]
Oct 31 17:41:47.476472 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:47.476178    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6dbed28d-b3b9-4af1-82b7-40151ba418c1-istio-token\") pod \"e2e-worker-w0-ee816e-openshift-default-c4db85b5c-dz8kv\" (UID: \"6dbed28d-b3b9-4af1-82b7-40151ba418c1\") " pod="openshift-ingress/e2e-worker-w0-ee816e-openshift-default-c4db85b5c-dz8kv"
Oct 31 17:41:47.476472 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:47.476255    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6dbed28d-b3b9-4af1-82b7-40151ba418c1-istio-podinfo\") pod \"e2e-worker-w0-ee816e-openshift-default-c4db85b5c-dz8kv\" (UID: \"6dbed28d-b3b9-4af1-82b7-40151ba418c1\") " pod="openshift-ingress/e2e-worker-w0-ee816e-openshift-default-c4db85b5c-dz8kv"
Oct 31 17:41:47.476936 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:47.476919    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6dbed28d-b3b9-4af1-82b7-40151ba418c1-istio-envoy\") pod \"e2e-worker-w0-ee816e-openshift-default-c4db85b5c-dz8kv\" (UID: \"6dbed28d-b3b9-4af1-82b7-40151ba418c1\") " pod="openshift-ingress/e2e-worker-w0-ee816e-openshift-default-c4db85b5c-dz8kv"
Oct 31 17:41:47.479802 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:41:47.479772    5003 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod679da5c1_9c28_4f80_a210_185350147f11.slice/crio-b501a46539a9ff1efdd382af2125d4040b7f66c7edf6ff3350d2efbdd01332be WatchSource:0}: Error finding container b501a46539a9ff1efdd382af2125d4040b7f66c7edf6ff3350d2efbdd01332be: Status 404 returned error can't find the container with id b501a46539a9ff1efdd382af2125d4040b7f66c7edf6ff3350d2efbdd01332be
Oct 31 17:41:47.479916 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:47.479886    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-29wtw\" (UniqueName: \"kubernetes.io/projected/6dbed28d-b3b9-4af1-82b7-40151ba418c1-kube-api-access-29wtw\") pod \"e2e-worker-w0-ee816e-openshift-default-c4db85b5c-dz8kv\" (UID: \"6dbed28d-b3b9-4af1-82b7-40151ba418c1\") " pod="openshift-ingress/e2e-worker-w0-ee816e-openshift-default-c4db85b5c-dz8kv"
Oct 31 17:41:47.482516 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:47.482479    5003 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Oct 31 17:41:47.482575 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:47.482562    5003 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Oct 31 17:41:47.482623 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:47.482609    5003 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Oct 31 17:41:47.495528 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:47.495477    5003 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w3-cf0a86-openshift-default-595bfdc58c-jg25b" podStartSLOduration=1.495458908 podStartE2EDuration="1.495458908s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 17:41:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 17:41:47.483518977 +0000 UTC m=+875.738373522" watchObservedRunningTime="2026-10-31 17:41:47.495458908 +0000 UTC m=+875.750313450"
Oct 31 17:41:47.562012 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:47.561982    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a115d540-ac87-497f-97f8-bd2e52d066f7-istiod-ca-cert\") pod \"e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-9rlpc\" (UID: \"a115d540-ac87-497f-97f8-bd2e52d066f7\") " pod="openshift-ingress/e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-9rlpc"
Oct 31 17:41:47.562399 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:47.562031    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-97vf9\" (UniqueName: \"kubernetes.io/projected/a115d540-ac87-497f-97f8-bd2e52d066f7-kube-api-access-97vf9\") pod \"e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-9rlpc\" (UID: \"a115d540-ac87-497f-97f8-bd2e52d066f7\") " pod="openshift-ingress/e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-9rlpc"
Oct 31 17:41:47.562514 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:47.562491    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a115d540-ac87-497f-97f8-bd2e52d066f7-istio-data\") pod \"e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-9rlpc\" (UID: \"a115d540-ac87-497f-97f8-bd2e52d066f7\") " pod="openshift-ingress/e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-9rlpc"
Oct 31 17:41:47.562580 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:47.562528    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a115d540-ac87-497f-97f8-bd2e52d066f7-istio-podinfo\") pod \"e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-9rlpc\" (UID: \"a115d540-ac87-497f-97f8-bd2e52d066f7\") " pod="openshift-ingress/e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-9rlpc"
Oct 31 17:41:47.562634 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:47.562576    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a115d540-ac87-497f-97f8-bd2e52d066f7-istio-envoy\") pod \"e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-9rlpc\" (UID: \"a115d540-ac87-497f-97f8-bd2e52d066f7\") " pod="openshift-ingress/e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-9rlpc"
Oct 31 17:41:47.562750 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:47.562736    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a115d540-ac87-497f-97f8-bd2e52d066f7-workload-certs\") pod \"e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-9rlpc\" (UID: \"a115d540-ac87-497f-97f8-bd2e52d066f7\") " pod="openshift-ingress/e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-9rlpc"
Oct 31 17:41:47.562808 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:47.562784    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a115d540-ac87-497f-97f8-bd2e52d066f7-credential-socket\") pod \"e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-9rlpc\" (UID: \"a115d540-ac87-497f-97f8-bd2e52d066f7\") " pod="openshift-ingress/e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-9rlpc"
Oct 31 17:41:47.562858 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:47.562836    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a115d540-ac87-497f-97f8-bd2e52d066f7-istiod-ca-cert\") pod \"e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-9rlpc\" (UID: \"a115d540-ac87-497f-97f8-bd2e52d066f7\") " pod="openshift-ingress/e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-9rlpc"
Oct 31 17:41:47.562907 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:47.562859    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a115d540-ac87-497f-97f8-bd2e52d066f7-istio-data\") pod \"e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-9rlpc\" (UID: \"a115d540-ac87-497f-97f8-bd2e52d066f7\") " pod="openshift-ingress/e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-9rlpc"
Oct 31 17:41:47.563474 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:47.563086    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a115d540-ac87-497f-97f8-bd2e52d066f7-istio-token\") pod \"e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-9rlpc\" (UID: \"a115d540-ac87-497f-97f8-bd2e52d066f7\") " pod="openshift-ingress/e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-9rlpc"
Oct 31 17:41:47.563474 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:47.563105    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a115d540-ac87-497f-97f8-bd2e52d066f7-credential-socket\") pod \"e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-9rlpc\" (UID: \"a115d540-ac87-497f-97f8-bd2e52d066f7\") " pod="openshift-ingress/e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-9rlpc"
Oct 31 17:41:47.563474 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:47.563171    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a115d540-ac87-497f-97f8-bd2e52d066f7-workload-certs\") pod \"e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-9rlpc\" (UID: \"a115d540-ac87-497f-97f8-bd2e52d066f7\") " pod="openshift-ingress/e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-9rlpc"
Oct 31 17:41:47.563474 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:47.563284    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a115d540-ac87-497f-97f8-bd2e52d066f7-workload-socket\") pod \"e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-9rlpc\" (UID: \"a115d540-ac87-497f-97f8-bd2e52d066f7\") " pod="openshift-ingress/e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-9rlpc"
Oct 31 17:41:47.563783 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:47.563637    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a115d540-ac87-497f-97f8-bd2e52d066f7-workload-socket\") pod \"e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-9rlpc\" (UID: \"a115d540-ac87-497f-97f8-bd2e52d066f7\") " pod="openshift-ingress/e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-9rlpc"
Oct 31 17:41:47.565654 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:47.565617    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a115d540-ac87-497f-97f8-bd2e52d066f7-istio-envoy\") pod \"e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-9rlpc\" (UID: \"a115d540-ac87-497f-97f8-bd2e52d066f7\") " pod="openshift-ingress/e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-9rlpc"
Oct 31 17:41:47.565904 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:47.565885    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a115d540-ac87-497f-97f8-bd2e52d066f7-istio-podinfo\") pod \"e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-9rlpc\" (UID: \"a115d540-ac87-497f-97f8-bd2e52d066f7\") " pod="openshift-ingress/e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-9rlpc"
Oct 31 17:41:47.582527 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:47.582491    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-97vf9\" (UniqueName: \"kubernetes.io/projected/a115d540-ac87-497f-97f8-bd2e52d066f7-kube-api-access-97vf9\") pod \"e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-9rlpc\" (UID: \"a115d540-ac87-497f-97f8-bd2e52d066f7\") " pod="openshift-ingress/e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-9rlpc"
Oct 31 17:41:47.582764 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:47.582600    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a115d540-ac87-497f-97f8-bd2e52d066f7-istio-token\") pod \"e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-9rlpc\" (UID: \"a115d540-ac87-497f-97f8-bd2e52d066f7\") " pod="openshift-ingress/e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-9rlpc"
Oct 31 17:41:47.599615 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:47.599577    5003 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-ee816e-openshift-default-c4db85b5c-dz8kv"
Oct 31 17:41:47.712337 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:47.712168    5003 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-9rlpc"
Oct 31 17:41:47.883538 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:47.883462    5003 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w3-cf0a86-openshift-default-595bfdc58c-jg25b"
Oct 31 17:41:47.942776 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:41:47.942741    5003 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6dbed28d_b3b9_4af1_82b7_40151ba418c1.slice/crio-4ec8d8397936df066501c9f711fb4dac900da42b38f73a52ff18e8b7a36f003c WatchSource:0}: Error finding container 4ec8d8397936df066501c9f711fb4dac900da42b38f73a52ff18e8b7a36f003c: Status 404 returned error can't find the container with id 4ec8d8397936df066501c9f711fb4dac900da42b38f73a52ff18e8b7a36f003c
Oct 31 17:41:47.943081 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:47.943054    5003 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-ee816e-openshift-default-c4db85b5c-dz8kv"]
Oct 31 17:41:47.945205 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:47.945171    5003 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Oct 31 17:41:47.945303 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:47.945235    5003 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Oct 31 17:41:47.945303 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:47.945264    5003 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Oct 31 17:41:48.060671 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:41:48.049806    5003 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda115d540_ac87_497f_97f8_bd2e52d066f7.slice/crio-b1e81a80593e94af836e5421898bd8b5a422aa7551c35dbc231bf19d34a51bf1 WatchSource:0}: Error finding container b1e81a80593e94af836e5421898bd8b5a422aa7551c35dbc231bf19d34a51bf1: Status 404 returned error can't find the container with id b1e81a80593e94af836e5421898bd8b5a422aa7551c35dbc231bf19d34a51bf1
Oct 31 17:41:48.060671 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:48.050658    5003 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-9rlpc"]
Oct 31 17:41:48.068033 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:48.063367    5003 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Oct 31 17:41:48.068033 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:48.063467    5003 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Oct 31 17:41:48.068033 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:48.063505    5003 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Oct 31 17:41:48.530201 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:48.528392    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-ee816e-openshift-default-c4db85b5c-dz8kv" event={"ID":"6dbed28d-b3b9-4af1-82b7-40151ba418c1","Type":"ContainerStarted","Data":"8c1bb55797c58b272d9659652198809f486df56cb182f4b46d80d863ecddd72b"}
Oct 31 17:41:48.530201 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:48.528470    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-ee816e-openshift-default-c4db85b5c-dz8kv" event={"ID":"6dbed28d-b3b9-4af1-82b7-40151ba418c1","Type":"ContainerStarted","Data":"4ec8d8397936df066501c9f711fb4dac900da42b38f73a52ff18e8b7a36f003c"}
Oct 31 17:41:48.531013 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:48.530961    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-9rlpc" event={"ID":"a115d540-ac87-497f-97f8-bd2e52d066f7","Type":"ContainerStarted","Data":"ddb2cb22d217daf6a7ea2d32877c8ae9d586aa3974ac305c3a99a4fc6c9d460f"}
Oct 31 17:41:48.531129 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:48.531039    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-9rlpc" event={"ID":"a115d540-ac87-497f-97f8-bd2e52d066f7","Type":"ContainerStarted","Data":"b1e81a80593e94af836e5421898bd8b5a422aa7551c35dbc231bf19d34a51bf1"}
Oct 31 17:41:48.533499 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:48.533474    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-1c0bfd-openshift-default-f7f657c57-hp2wj" event={"ID":"679da5c1-9c28-4f80-a210-185350147f11","Type":"ContainerStarted","Data":"ed209a24e1203b5578ab5fddc515a3543dedaa851d14aa9fed738fe591800a6f"}
Oct 31 17:41:48.533596 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:48.533515    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-1c0bfd-openshift-default-f7f657c57-hp2wj" event={"ID":"679da5c1-9c28-4f80-a210-185350147f11","Type":"ContainerStarted","Data":"b501a46539a9ff1efdd382af2125d4040b7f66c7edf6ff3350d2efbdd01332be"}
Oct 31 17:41:48.580089 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:48.580022    5003 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w0-ee816e-openshift-default-c4db85b5c-dz8kv" podStartSLOduration=1.580005385 podStartE2EDuration="1.580005385s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 17:41:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 17:41:48.57713629 +0000 UTC m=+876.831990849" watchObservedRunningTime="2026-10-31 17:41:48.580005385 +0000 UTC m=+876.834859927"
Oct 31 17:41:48.606750 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:48.606715    5003 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w0-ee816e-openshift-default-c4db85b5c-dz8kv"
Oct 31 17:41:48.636265 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:48.636078    5003 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-9rlpc" podStartSLOduration=1.636062657 podStartE2EDuration="1.636062657s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 17:41:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 17:41:48.631714708 +0000 UTC m=+876.886569249" watchObservedRunningTime="2026-10-31 17:41:48.636062657 +0000 UTC m=+876.890917198"
Oct 31 17:41:48.714838 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:48.714786    5003 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-9rlpc"
Oct 31 17:41:48.915494 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:48.915451    5003 patch_prober.go:29] interesting pod/e2e-worker-w3-cf0a86-openshift-default-595bfdc58c-jg25b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.113:15021/healthz/ready\": dial tcp 10.132.0.113:15021: connect: connection refused" start-of-body=
Oct 31 17:41:48.915798 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:48.915770    5003 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-cf0a86-openshift-default-595bfdc58c-jg25b" podUID="61193be6-6ada-48ff-9e96-700c73f018dd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.113:15021/healthz/ready\": dial tcp 10.132.0.113:15021: connect: connection refused"
Oct 31 17:41:49.146755 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:49.146719    5003 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w4-1c0bfd-openshift-default-f7f657c57-hp2wj"
Oct 31 17:41:49.169726 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:49.151579    5003 patch_prober.go:29] interesting pod/e2e-worker-w4-1c0bfd-openshift-default-f7f657c57-hp2wj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.114:15021/healthz/ready\": dial tcp 10.132.0.114:15021: connect: connection refused" start-of-body=
Oct 31 17:41:49.170061 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:49.170020    5003 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-1c0bfd-openshift-default-f7f657c57-hp2wj" podUID="679da5c1-9c28-4f80-a210-185350147f11" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.114:15021/healthz/ready\": dial tcp 10.132.0.114:15021: connect: connection refused"
Oct 31 17:41:49.619729 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:49.619695    5003 patch_prober.go:29] interesting pod/e2e-worker-w0-ee816e-openshift-default-c4db85b5c-dz8kv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.115:15021/healthz/ready\": dial tcp 10.132.0.115:15021: connect: connection refused" start-of-body=
Oct 31 17:41:49.620952 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:49.620916    5003 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-ee816e-openshift-default-c4db85b5c-dz8kv" podUID="6dbed28d-b3b9-4af1-82b7-40151ba418c1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.115:15021/healthz/ready\": dial tcp 10.132.0.115:15021: connect: connection refused"
Oct 31 17:41:49.726578 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:49.726540    5003 patch_prober.go:29] interesting pod/e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-9rlpc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.116:15021/healthz/ready\": dial tcp 10.132.0.116:15021: connect: connection refused" start-of-body=
Oct 31 17:41:49.746802 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:49.733716    5003 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-9rlpc" podUID="a115d540-ac87-497f-97f8-bd2e52d066f7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.116:15021/healthz/ready\": dial tcp 10.132.0.116:15021: connect: connection refused"
Oct 31 17:41:49.883215 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:49.883107    5003 patch_prober.go:29] interesting pod/e2e-worker-w3-cf0a86-openshift-default-595bfdc58c-jg25b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.113:15021/healthz/ready\": dial tcp 10.132.0.113:15021: connect: connection refused" start-of-body=
Oct 31 17:41:49.903776 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:49.903725    5003 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-cf0a86-openshift-default-595bfdc58c-jg25b" podUID="61193be6-6ada-48ff-9e96-700c73f018dd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.113:15021/healthz/ready\": dial tcp 10.132.0.113:15021: connect: connection refused"
Oct 31 17:41:49.928670 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:49.906615    5003 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w4-1c0bfd-openshift-default-f7f657c57-hp2wj" podStartSLOduration=3.906595862 podStartE2EDuration="3.906595862s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 17:41:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 17:41:48.697057455 +0000 UTC m=+876.951911996" watchObservedRunningTime="2026-10-31 17:41:49.906595862 +0000 UTC m=+878.161450404"
Oct 31 17:41:50.141752 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:50.127473    5003 prober.go:122] "Probe failed" probeType="Readiness" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-82w89" podUID="ef5a065b-f98e-4d14-810f-2d0c42c58ce6" containerName="main" probeResult="failure" output="Get \"https://10.132.0.54:8000/ready\": context deadline exceeded"
Oct 31 17:41:50.144507 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:50.143241    5003 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-b78c31/distinct-w5-b78c31-kserve-77ccb69d98-p2zct" podUID="fcf01e9c-57fb-42db-848d-d314c615bd67" containerName="main" probeResult="failure" output="Get \"https://10.132.0.93:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 31 17:41:50.237675 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:50.232213    5003 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-ee816e/simulator-w0-ee816e-kserve-5bd4657dc-9rlm4" podUID="620f499f-36d7-4900-abbe-98ee5cf5d96c" containerName="main" probeResult="failure" output="Get \"https://10.132.0.72:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 31 17:41:50.332749 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:50.303517    5003 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-1c0bfd/premium-w4-1c0bfd-kserve-d78fbb98-psx55" podUID="34bdffed-87b8-4e7a-b182-f069d081bd62" containerName="main" probeResult="failure" output="Get \"https://10.132.0.74:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 31 17:41:50.461450 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:50.444726    5003 patch_prober.go:29] interesting pod/e2e-worker-w4-1c0bfd-openshift-default-f7f657c57-hp2wj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.114:15021/healthz/ready\": dial tcp 10.132.0.114:15021: connect: connection refused" start-of-body=
Oct 31 17:41:50.461450 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:50.444846    5003 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-1c0bfd-openshift-default-f7f657c57-hp2wj" podUID="679da5c1-9c28-4f80-a210-185350147f11" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.114:15021/healthz/ready\": dial tcp 10.132.0.114:15021: connect: connection refused"
Oct 31 17:41:50.532086 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:50.530106    5003 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-f827198e-mcgds"]
Oct 31 17:41:50.610670 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:50.607316    5003 patch_prober.go:29] interesting pod/e2e-worker-w0-ee816e-openshift-default-c4db85b5c-dz8kv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.115:15021/healthz/ready\": dial tcp 10.132.0.115:15021: connect: connection refused" start-of-body=
Oct 31 17:41:50.610670 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:50.607375    5003 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-ee816e-openshift-default-c4db85b5c-dz8kv" podUID="6dbed28d-b3b9-4af1-82b7-40151ba418c1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.115:15021/healthz/ready\": dial tcp 10.132.0.115:15021: connect: connection refused"
Oct 31 17:41:50.682121 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:50.682091    5003 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-f827198e-mcgds"
Oct 31 17:41:50.698618 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:50.677296    5003 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-f827198e-mcgds"]
Oct 31 17:41:50.728080 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:50.727966    5003 patch_prober.go:29] interesting pod/e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-9rlpc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.116:15021/healthz/ready\": dial tcp 10.132.0.116:15021: connect: connection refused" start-of-body=
Oct 31 17:41:50.728345 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:50.728300    5003 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-9rlpc" podUID="a115d540-ac87-497f-97f8-bd2e52d066f7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.116:15021/healthz/ready\": dial tcp 10.132.0.116:15021: connect: connection refused"
Oct 31 17:41:50.797669 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:50.797604    5003 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-b78c31/simulator-w5-b78c31-kserve-95df74778-fpvpr" podUID="665d75c7-8ba5-49e1-87a7-51a18ae6f369" containerName="main" probeResult="failure" output="Get \"https://10.132.0.73:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 31 17:41:50.801683 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:50.797776    5003 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-5c446c/premium-w2-5c446c-kserve-66f7486c85-f7lk2" podUID="9c2ddfab-2348-4bb0-8844-1fca62460390" containerName="main" probeResult="failure" output="Get \"https://10.132.0.75:8000/ready\": context deadline exceeded"
Oct 31 17:41:50.893192 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:50.885302    5003 patch_prober.go:29] interesting pod/e2e-worker-w3-cf0a86-openshift-default-595bfdc58c-jg25b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.113:15021/healthz/ready\": dial tcp 10.132.0.113:15021: connect: connection refused" start-of-body=
Oct 31 17:41:50.893192 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:50.885367    5003 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-cf0a86-openshift-default-595bfdc58c-jg25b" podUID="61193be6-6ada-48ff-9e96-700c73f018dd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.113:15021/healthz/ready\": dial tcp 10.132.0.113:15021: connect: connection refused"
Oct 31 17:41:50.951672 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:50.939504    5003 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-mr9x2\""
Oct 31 17:41:50.974476 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:50.962595    5003 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\""
Oct 31 17:41:50.988450 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:50.987839    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/bcb7173c-3e08-4d4e-84ef-d88a41aae7dc-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-f827198e-mcgds\" (UID: \"bcb7173c-3e08-4d4e-84ef-d88a41aae7dc\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-f827198e-mcgds"
Oct 31 17:41:50.988450 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:50.987950    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/bcb7173c-3e08-4d4e-84ef-d88a41aae7dc-maas-api-xks-ca\") pod \"maas-api-revoke-sub-f827198e-mcgds\" (UID: \"bcb7173c-3e08-4d4e-84ef-d88a41aae7dc\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-f827198e-mcgds"
Oct 31 17:41:50.988450 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:50.988103    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9f8b6\" (UniqueName: \"kubernetes.io/projected/bcb7173c-3e08-4d4e-84ef-d88a41aae7dc-kube-api-access-9f8b6\") pod \"maas-api-revoke-sub-f827198e-mcgds\" (UID: \"bcb7173c-3e08-4d4e-84ef-d88a41aae7dc\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-f827198e-mcgds"
Oct 31 17:41:51.303074 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:51.089119    5003 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-ee816e/distinct-w0-ee816e-kserve-564f897f89-kglpl" podUID="82b982f8-de44-449d-b4a6-dc8f5824bf35" containerName="main" probeResult="failure" output="Get \"https://10.132.0.91:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 31 17:41:51.389672 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:51.155310    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/bcb7173c-3e08-4d4e-84ef-d88a41aae7dc-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-f827198e-mcgds\" (UID: \"bcb7173c-3e08-4d4e-84ef-d88a41aae7dc\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-f827198e-mcgds"
Oct 31 17:41:51.389672 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:51.387061    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/bcb7173c-3e08-4d4e-84ef-d88a41aae7dc-maas-api-xks-ca\") pod \"maas-api-revoke-sub-f827198e-mcgds\" (UID: \"bcb7173c-3e08-4d4e-84ef-d88a41aae7dc\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-f827198e-mcgds"
Oct 31 17:41:51.389672 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:51.387250    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9f8b6\" (UniqueName: \"kubernetes.io/projected/bcb7173c-3e08-4d4e-84ef-d88a41aae7dc-kube-api-access-9f8b6\") pod \"maas-api-revoke-sub-f827198e-mcgds\" (UID: \"bcb7173c-3e08-4d4e-84ef-d88a41aae7dc\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-f827198e-mcgds"
Oct 31 17:41:51.389672 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:51.165970    5003 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-0e59ca/simulator-w1-0e59ca-kserve-999765679-zs7kh" podUID="018d423e-6866-4b61-a4a2-d2e786d82bf0" containerName="main" probeResult="failure" output="Get \"https://10.132.0.71:8000/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 31 17:41:51.389672 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:51.165813    5003 prober.go:122] "Probe failed" probeType="Readiness" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-82w89" podUID="ef5a065b-f98e-4d14-810f-2d0c42c58ce6" containerName="main" probeResult="failure" output="Get \"https://10.132.0.54:8000/ready\": context deadline exceeded"
Oct 31 17:41:51.408989 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:51.165878    5003 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-1c0bfd/distinct-w4-1c0bfd-kserve-867858548f-46gwg" podUID="93f16294-fc40-477d-90b3-d02640037d5b" containerName="main" probeResult="failure" output="Get \"https://10.132.0.94:8000/ready\": context deadline exceeded"
Oct 31 17:41:51.411526 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:51.166938    5003 patch_prober.go:29] interesting pod/e2e-worker-w4-1c0bfd-openshift-default-f7f657c57-hp2wj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.114:15021/healthz/ready\": dial tcp 10.132.0.114:15021: connect: connection refused" start-of-body=
Oct 31 17:41:51.411748 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:51.411719    5003 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-1c0bfd-openshift-default-f7f657c57-hp2wj" podUID="679da5c1-9c28-4f80-a210-185350147f11" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.114:15021/healthz/ready\": dial tcp 10.132.0.114:15021: connect: connection refused"
Oct 31 17:41:51.411845 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:51.243820    5003 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-ee816e/simulator-w0-ee816e-kserve-5bd4657dc-9rlm4" podUID="620f499f-36d7-4900-abbe-98ee5cf5d96c" containerName="main" probeResult="failure" output="Get \"https://10.132.0.72:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 31 17:41:51.413498 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:51.413475    5003 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-82w89"
Oct 31 17:41:51.413699 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:51.413683    5003 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w0-ee816e/simulator-w0-ee816e-kserve-5bd4657dc-9rlm4"
Oct 31 17:41:51.438771 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:51.208757    5003 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-b78c31/distinct-w5-b78c31-kserve-77ccb69d98-p2zct" podUID="fcf01e9c-57fb-42db-848d-d314c615bd67" containerName="main" probeResult="failure" output="Get \"https://10.132.0.93:8000/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 31 17:41:51.439869 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:51.439276    5003 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w5-b78c31/distinct-w5-b78c31-kserve-77ccb69d98-p2zct"
Oct 31 17:41:51.440272 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:51.194467    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/bcb7173c-3e08-4d4e-84ef-d88a41aae7dc-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-f827198e-mcgds\" (UID: \"bcb7173c-3e08-4d4e-84ef-d88a41aae7dc\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-f827198e-mcgds"
Oct 31 17:41:51.442926 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:51.442367    5003 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-1c0bfd/premium-w4-1c0bfd-kserve-d78fbb98-psx55" podUID="34bdffed-87b8-4e7a-b182-f069d081bd62" containerName="main" probeResult="failure" output="Get \"https://10.132.0.74:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 31 17:41:51.443133 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:51.443112    5003 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w4-1c0bfd/premium-w4-1c0bfd-kserve-d78fbb98-psx55"
Oct 31 17:41:51.479668 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:51.478318    5003 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w1-0e59ca/simulator-w1-0e59ca-kserve-999765679-zs7kh" podUID="018d423e-6866-4b61-a4a2-d2e786d82bf0" containerName="main" probeResult="failure" output="Get \"https://10.132.0.71:8000/health\": context deadline exceeded"
Oct 31 17:41:51.492692 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:51.492100    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/bcb7173c-3e08-4d4e-84ef-d88a41aae7dc-maas-api-xks-ca\") pod \"maas-api-revoke-sub-f827198e-mcgds\" (UID: \"bcb7173c-3e08-4d4e-84ef-d88a41aae7dc\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-f827198e-mcgds"
Oct 31 17:41:51.634679 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:51.603734    5003 patch_prober.go:29] interesting pod/e2e-worker-w0-ee816e-openshift-default-c4db85b5c-dz8kv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.115:15021/healthz/ready\": dial tcp 10.132.0.115:15021: connect: connection refused" start-of-body=
Oct 31 17:41:51.634679 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:51.603791    5003 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-ee816e-openshift-default-c4db85b5c-dz8kv" podUID="6dbed28d-b3b9-4af1-82b7-40151ba418c1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.115:15021/healthz/ready\": dial tcp 10.132.0.115:15021: connect: connection refused"
Oct 31 17:41:51.793712 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:51.780755    5003 patch_prober.go:29] interesting pod/e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-9rlpc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.116:15021/healthz/ready\": dial tcp 10.132.0.116:15021: connect: connection refused" start-of-body=
Oct 31 17:41:51.793712 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:51.780818    5003 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-9rlpc" podUID="a115d540-ac87-497f-97f8-bd2e52d066f7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.116:15021/healthz/ready\": dial tcp 10.132.0.116:15021: connect: connection refused"
Oct 31 17:41:51.797941 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:51.797878    5003 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-b78c31/distinct-2-w5-b78c31-kserve-5f4f9d4bb5-ss7g2" podUID="9cc6d7e8-30de-4173-9974-1f1a4fd08e1c" containerName="main" probeResult="failure" output="Get \"https://10.132.0.99:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 31 17:41:51.825793 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:51.825749    5003 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-b78c31/simulator-w5-b78c31-kserve-95df74778-fpvpr" podUID="665d75c7-8ba5-49e1-87a7-51a18ae6f369" containerName="main" probeResult="failure" output="Get \"https://10.132.0.73:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 31 17:41:51.876132 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:51.876077    5003 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w5-b78c31/simulator-w5-b78c31-kserve-95df74778-fpvpr"
Oct 31 17:41:52.178083 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:52.178039    5003 patch_prober.go:29] interesting pod/e2e-worker-w3-cf0a86-openshift-default-595bfdc58c-jg25b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.113:15021/healthz/ready\": dial tcp 10.132.0.113:15021: connect: connection refused" start-of-body=
Oct 31 17:41:52.178367 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:52.178106    5003 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-cf0a86-openshift-default-595bfdc58c-jg25b" podUID="61193be6-6ada-48ff-9e96-700c73f018dd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.113:15021/healthz/ready\": dial tcp 10.132.0.113:15021: connect: connection refused"
Oct 31 17:41:52.397839 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:52.397798    5003 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-0e59ca/simulator-w1-0e59ca-kserve-999765679-zs7kh" podUID="018d423e-6866-4b61-a4a2-d2e786d82bf0" containerName="main" probeResult="failure" output="Get \"https://10.132.0.71:8000/ready\": context deadline exceeded"
Oct 31 17:41:52.808412 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:52.468334    5003 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-ee816e/distinct-w0-ee816e-kserve-564f897f89-kglpl" podUID="82b982f8-de44-449d-b4a6-dc8f5824bf35" containerName="main" probeResult="failure" output="Get \"https://10.132.0.91:8000/ready\": context deadline exceeded"
Oct 31 17:41:52.809542 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:52.608793    5003 patch_prober.go:29] interesting pod/e2e-worker-w4-1c0bfd-openshift-default-f7f657c57-hp2wj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.114:15021/healthz/ready\": dial tcp 10.132.0.114:15021: connect: connection refused" start-of-body=
Oct 31 17:41:52.832786 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:52.832749    5003 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-1c0bfd-openshift-default-f7f657c57-hp2wj" podUID="679da5c1-9c28-4f80-a210-185350147f11" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.114:15021/healthz/ready\": dial tcp 10.132.0.114:15021: connect: connection refused"
Oct 31 17:41:52.833302 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:52.662397    5003 prober.go:122] "Probe failed" probeType="Readiness" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-82w89" podUID="ef5a065b-f98e-4d14-810f-2d0c42c58ce6" containerName="main" probeResult="failure" output="Get \"https://10.132.0.54:8000/ready\": context deadline exceeded"
Oct 31 17:41:52.833488 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:52.649929    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9f8b6\" (UniqueName: \"kubernetes.io/projected/bcb7173c-3e08-4d4e-84ef-d88a41aae7dc-kube-api-access-9f8b6\") pod \"maas-api-revoke-sub-f827198e-mcgds\" (UID: \"bcb7173c-3e08-4d4e-84ef-d88a41aae7dc\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-f827198e-mcgds"
Oct 31 17:41:52.833591 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:52.830186    5003 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-b78c31/distinct-2-w5-b78c31-kserve-5f4f9d4bb5-ss7g2" podUID="9cc6d7e8-30de-4173-9974-1f1a4fd08e1c" containerName="main" probeResult="failure" output="Get \"https://10.132.0.99:8000/ready\": context deadline exceeded"
Oct 31 17:41:52.833765 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:52.683993    5003 patch_prober.go:29] interesting pod/e2e-worker-w0-ee816e-openshift-default-c4db85b5c-dz8kv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.115:15021/healthz/ready\": dial tcp 10.132.0.115:15021: connect: connection refused" start-of-body=
Oct 31 17:41:52.833862 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:52.833844    5003 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-ee816e-openshift-default-c4db85b5c-dz8kv" podUID="6dbed28d-b3b9-4af1-82b7-40151ba418c1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.115:15021/healthz/ready\": dial tcp 10.132.0.115:15021: connect: connection refused"
Oct 31 17:41:52.834395 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:52.662531    5003 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-b78c31/distinct-w5-b78c31-kserve-77ccb69d98-p2zct" podUID="fcf01e9c-57fb-42db-848d-d314c615bd67" containerName="main" probeResult="failure" output="Get \"https://10.132.0.93:8000/ready\": context deadline exceeded"
Oct 31 17:41:52.850365 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:52.827610    5003 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-b78c31/simulator-w5-b78c31-kserve-95df74778-fpvpr" podUID="665d75c7-8ba5-49e1-87a7-51a18ae6f369" containerName="main" probeResult="failure" output="Get \"https://10.132.0.73:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 31 17:41:52.882969 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:52.882924    5003 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-1c0bfd/distinct-w4-1c0bfd-kserve-867858548f-46gwg" podUID="93f16294-fc40-477d-90b3-d02640037d5b" containerName="main" probeResult="failure" output="Get \"https://10.132.0.94:8000/ready\": context deadline exceeded"
Oct 31 17:41:53.029770 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:53.029719    5003 patch_prober.go:29] interesting pod/e2e-worker-w3-cf0a86-openshift-default-595bfdc58c-jg25b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.113:15021/healthz/ready\": dial tcp 10.132.0.113:15021: connect: connection refused" start-of-body=
Oct 31 17:41:53.030059 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:53.030033    5003 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-cf0a86-openshift-default-595bfdc58c-jg25b" podUID="61193be6-6ada-48ff-9e96-700c73f018dd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.113:15021/healthz/ready\": dial tcp 10.132.0.113:15021: connect: connection refused"
Oct 31 17:41:53.031388 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:53.031360    5003 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-f827198e-mcgds"
Oct 31 17:41:53.194780 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:53.193535    5003 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-5c446c/premium-w2-5c446c-kserve-66f7486c85-f7lk2" podUID="9c2ddfab-2348-4bb0-8844-1fca62460390" containerName="main" probeResult="failure" output="Get \"https://10.132.0.75:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 31 17:41:53.320705 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:53.297973    5003 prober.go:122] "Probe failed" probeType="Liveness" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-82w89" podUID="ef5a065b-f98e-4d14-810f-2d0c42c58ce6" containerName="main" probeResult="failure" output="Get \"https://10.132.0.54:8000/health\": context deadline exceeded"
Oct 31 17:41:53.320705 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:53.311011    5003 patch_prober.go:29] interesting pod/e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-9rlpc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.116:15021/healthz/ready\": dial tcp 10.132.0.116:15021: connect: connection refused" start-of-body=
Oct 31 17:41:53.320705 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:53.311070    5003 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-9rlpc" podUID="a115d540-ac87-497f-97f8-bd2e52d066f7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.116:15021/healthz/ready\": dial tcp 10.132.0.116:15021: connect: connection refused"
Oct 31 17:41:53.358421 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:53.358388    5003 patch_prober.go:29] interesting pod/e2e-worker-w4-1c0bfd-openshift-default-f7f657c57-hp2wj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.114:15021/healthz/ready\": dial tcp 10.132.0.114:15021: connect: connection refused" start-of-body=
Oct 31 17:41:53.358701 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:53.358670    5003 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-1c0bfd-openshift-default-f7f657c57-hp2wj" podUID="679da5c1-9c28-4f80-a210-185350147f11" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.114:15021/healthz/ready\": dial tcp 10.132.0.114:15021: connect: connection refused"
Oct 31 17:41:53.451855 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:53.451759    5003 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w0-ee816e/distinct-w0-ee816e-kserve-564f897f89-kglpl" podUID="82b982f8-de44-449d-b4a6-dc8f5824bf35" containerName="main" probeResult="failure" output="Get \"https://10.132.0.91:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 31 17:41:53.533790 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:53.533744    5003 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-1c0bfd/premium-w4-1c0bfd-kserve-d78fbb98-psx55" podUID="34bdffed-87b8-4e7a-b182-f069d081bd62" containerName="main" probeResult="failure" output="Get \"https://10.132.0.74:8000/ready\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)"
Oct 31 17:41:53.589670 ip-10-0-138-17 kubenswrapper[5003]: E1031 17:41:53.586737    5003 kubelet.go:2711] "Housekeeping took longer than expected" err="housekeeping took too long" expected="1s" actual="1.652s"
Oct 31 17:41:53.615670 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:53.597730    5003 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w4-1c0bfd/premium-w4-1c0bfd-kserve-d78fbb98-psx55"
Oct 31 17:41:53.615670 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:53.597809    5003 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w0-ee816e/simulator-w0-ee816e-kserve-5bd4657dc-9rlm4"
Oct 31 17:41:53.615670 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:53.597856    5003 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w1-0e59ca/simulator-w1-0e59ca-kserve-999765679-zs7kh"
Oct 31 17:41:53.615670 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:53.597891    5003 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w0-ee816e/distinct-w0-ee816e-kserve-564f897f89-kglpl"
Oct 31 17:41:53.615670 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:53.597934    5003 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w5-b78c31/distinct-2-w5-b78c31-kserve-5f4f9d4bb5-ss7g2"
Oct 31 17:41:53.615670 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:53.597988    5003 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w4-1c0bfd/distinct-w4-1c0bfd-kserve-867858548f-46gwg"
Oct 31 17:41:53.736945 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:53.679246    5003 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-ee816e/simulator-w0-ee816e-kserve-5bd4657dc-9rlm4" podUID="620f499f-36d7-4900-abbe-98ee5cf5d96c" containerName="main" probeResult="failure" output="Get \"https://10.132.0.72:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 31 17:41:53.749823 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:53.749785    5003 patch_prober.go:29] interesting pod/e2e-worker-w0-ee816e-openshift-default-c4db85b5c-dz8kv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.115:15021/healthz/ready\": dial tcp 10.132.0.115:15021: connect: connection refused" start-of-body=
Oct 31 17:41:53.752842 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:53.752816    5003 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-ee816e-openshift-default-c4db85b5c-dz8kv" podUID="6dbed28d-b3b9-4af1-82b7-40151ba418c1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.115:15021/healthz/ready\": dial tcp 10.132.0.115:15021: connect: connection refused"
Oct 31 17:41:53.753028 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:53.752757    5003 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-0e59ca/simulator-w1-0e59ca-kserve-999765679-zs7kh" podUID="018d423e-6866-4b61-a4a2-d2e786d82bf0" containerName="main" probeResult="failure" output="Get \"https://10.132.0.71:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 31 17:41:53.778031 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:53.751036    5003 patch_prober.go:29] interesting pod/e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-9rlpc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.116:15021/healthz/ready\": dial tcp 10.132.0.116:15021: connect: connection refused" start-of-body=
Oct 31 17:41:53.778230 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:53.778041    5003 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-9rlpc" podUID="a115d540-ac87-497f-97f8-bd2e52d066f7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.116:15021/healthz/ready\": dial tcp 10.132.0.116:15021: connect: connection refused"
Oct 31 17:41:53.813401 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:53.813340    5003 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-ee816e/distinct-w0-ee816e-kserve-564f897f89-kglpl" podUID="82b982f8-de44-449d-b4a6-dc8f5824bf35" containerName="main" probeResult="failure" output="Get \"https://10.132.0.91:8000/ready\": context deadline exceeded"
Oct 31 17:41:53.852331 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:53.852288    5003 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-bdlh9"]
Oct 31 17:41:53.883533 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:53.883402    5003 prober.go:122] "Probe failed" probeType="Readiness" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-82w89" podUID="ef5a065b-f98e-4d14-810f-2d0c42c58ce6" containerName="main" probeResult="failure" output="Get \"https://10.132.0.54:8000/ready\": context deadline exceeded"
Oct 31 17:41:53.904922 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:53.883829    5003 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-b78c31/distinct-2-w5-b78c31-kserve-5f4f9d4bb5-ss7g2" podUID="9cc6d7e8-30de-4173-9974-1f1a4fd08e1c" containerName="main" probeResult="failure" output="Get \"https://10.132.0.99:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 31 17:41:53.905576 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:53.885744    5003 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-b78c31/distinct-w5-b78c31-kserve-77ccb69d98-p2zct" podUID="fcf01e9c-57fb-42db-848d-d314c615bd67" containerName="main" probeResult="failure" output="Get \"https://10.132.0.93:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 31 17:41:53.951674 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:53.906144    5003 patch_prober.go:29] interesting pod/e2e-worker-w3-cf0a86-openshift-default-595bfdc58c-jg25b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.113:15021/healthz/ready\": dial tcp 10.132.0.113:15021: connect: connection refused" start-of-body=
Oct 31 17:41:53.952967 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:53.952931    5003 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-cf0a86-openshift-default-595bfdc58c-jg25b" podUID="61193be6-6ada-48ff-9e96-700c73f018dd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.113:15021/healthz/ready\": dial tcp 10.132.0.113:15021: connect: connection refused"
Oct 31 17:41:53.965821 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:53.909985    5003 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-b78c31/simulator-w5-b78c31-kserve-95df74778-fpvpr" podUID="665d75c7-8ba5-49e1-87a7-51a18ae6f369" containerName="main" probeResult="failure" output="Get \"https://10.132.0.73:8000/ready\": context deadline exceeded"
Oct 31 17:41:54.224725 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:54.224671    5003 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w4-1c0bfd/premium-w4-1c0bfd-kserve-d78fbb98-psx55" podUID="34bdffed-87b8-4e7a-b182-f069d081bd62" containerName="main" probeResult="failure" output="Get \"https://10.132.0.74:8000/health\": context deadline exceeded"
Oct 31 17:41:54.225076 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:54.225044    5003 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-5c446c/premium-w2-5c446c-kserve-66f7486c85-f7lk2" podUID="9c2ddfab-2348-4bb0-8844-1fca62460390" containerName="main" probeResult="failure" output="Get \"https://10.132.0.75:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 31 17:41:54.227307 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:54.227278    5003 patch_prober.go:29] interesting pod/e2e-worker-w4-1c0bfd-openshift-default-f7f657c57-hp2wj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.114:15021/healthz/ready\": dial tcp 10.132.0.114:15021: connect: connection refused" start-of-body=
Oct 31 17:41:54.227456 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:54.227435    5003 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-1c0bfd-openshift-default-f7f657c57-hp2wj" podUID="679da5c1-9c28-4f80-a210-185350147f11" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.114:15021/healthz/ready\": dial tcp 10.132.0.114:15021: connect: connection refused"
Oct 31 17:41:54.336671 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:54.309886    5003 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-bdlh9"]
Oct 31 17:41:54.404697 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:54.337087    5003 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-bdlh9"
Oct 31 17:41:54.511655 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:54.511548    5003 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-fm5qc\""
Oct 31 17:41:54.598311 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:54.597452    5003 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Oct 31 17:41:54.598311 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:54.597520    5003 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Oct 31 17:41:54.598311 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:54.597563    5003 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Oct 31 17:41:54.655427 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:54.600632    5003 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-1c0bfd/premium-w4-1c0bfd-kserve-d78fbb98-psx55" podUID="34bdffed-87b8-4e7a-b182-f069d081bd62" containerName="main" probeResult="failure" output="Get \"https://10.132.0.74:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 31 17:41:54.708953 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:54.695819    5003 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-ee816e/simulator-w0-ee816e-kserve-5bd4657dc-9rlm4" podUID="620f499f-36d7-4900-abbe-98ee5cf5d96c" containerName="main" probeResult="failure" output="Get \"https://10.132.0.72:8000/ready\": context deadline exceeded"
Oct 31 17:41:54.747752 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:54.745193    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/42e93792-9b87-4637-89df-62b5836971f9-istio-token\") pod \"istiod-openshift-gateway-7ddd9cfdc8-bdlh9\" (UID: \"42e93792-9b87-4637-89df-62b5836971f9\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-bdlh9"
Oct 31 17:41:54.747752 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:54.745305    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/42e93792-9b87-4637-89df-62b5836971f9-local-certs\") pod \"istiod-openshift-gateway-7ddd9cfdc8-bdlh9\" (UID: \"42e93792-9b87-4637-89df-62b5836971f9\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-bdlh9"
Oct 31 17:41:54.747752 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:54.745352    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/42e93792-9b87-4637-89df-62b5836971f9-cacerts\") pod \"istiod-openshift-gateway-7ddd9cfdc8-bdlh9\" (UID: \"42e93792-9b87-4637-89df-62b5836971f9\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-bdlh9"
Oct 31 17:41:54.747752 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:54.745515    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/42e93792-9b87-4637-89df-62b5836971f9-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7ddd9cfdc8-bdlh9\" (UID: \"42e93792-9b87-4637-89df-62b5836971f9\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-bdlh9"
Oct 31 17:41:54.747752 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:54.745573    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/42e93792-9b87-4637-89df-62b5836971f9-istio-kubeconfig\") pod \"istiod-openshift-gateway-7ddd9cfdc8-bdlh9\" (UID: \"42e93792-9b87-4637-89df-62b5836971f9\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-bdlh9"
Oct 31 17:41:54.747752 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:54.745718    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/42e93792-9b87-4637-89df-62b5836971f9-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7ddd9cfdc8-bdlh9\" (UID: \"42e93792-9b87-4637-89df-62b5836971f9\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-bdlh9"
Oct 31 17:41:54.747752 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:54.745834    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zdtlb\" (UniqueName: \"kubernetes.io/projected/42e93792-9b87-4637-89df-62b5836971f9-kube-api-access-zdtlb\") pod \"istiod-openshift-gateway-7ddd9cfdc8-bdlh9\" (UID: \"42e93792-9b87-4637-89df-62b5836971f9\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-bdlh9"
Oct 31 17:41:54.811688 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:54.796405    5003 patch_prober.go:29] interesting pod/e2e-worker-w0-ee816e-openshift-default-c4db85b5c-dz8kv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.115:15021/healthz/ready\": dial tcp 10.132.0.115:15021: connect: connection refused" start-of-body=
Oct 31 17:41:54.811688 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:54.796472    5003 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-ee816e-openshift-default-c4db85b5c-dz8kv" podUID="6dbed28d-b3b9-4af1-82b7-40151ba418c1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.115:15021/healthz/ready\": dial tcp 10.132.0.115:15021: connect: connection refused"
Oct 31 17:41:54.811688 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:54.797102    5003 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-0e59ca/simulator-w1-0e59ca-kserve-999765679-zs7kh" podUID="018d423e-6866-4b61-a4a2-d2e786d82bf0" containerName="main" probeResult="failure" output="Get \"https://10.132.0.71:8000/ready\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)"
Oct 31 17:41:54.880450 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:54.861241    5003 patch_prober.go:29] interesting pod/e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-9rlpc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.116:15021/healthz/ready\": dial tcp 10.132.0.116:15021: connect: connection refused" start-of-body=
Oct 31 17:41:54.880450 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:54.861298    5003 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-9rlpc" podUID="a115d540-ac87-497f-97f8-bd2e52d066f7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.116:15021/healthz/ready\": dial tcp 10.132.0.116:15021: connect: connection refused"
Oct 31 17:41:54.893897 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:54.893840    5003 prober.go:122] "Probe failed" probeType="Readiness" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-82w89" podUID="ef5a065b-f98e-4d14-810f-2d0c42c58ce6" containerName="main" probeResult="failure" output="Get \"https://10.132.0.54:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 31 17:41:54.930534 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:54.930484    5003 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-b78c31/distinct-2-w5-b78c31-kserve-5f4f9d4bb5-ss7g2" podUID="9cc6d7e8-30de-4173-9974-1f1a4fd08e1c" containerName="main" probeResult="failure" output="Get \"https://10.132.0.99:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 31 17:41:54.998701 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:54.983450    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/42e93792-9b87-4637-89df-62b5836971f9-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7ddd9cfdc8-bdlh9\" (UID: \"42e93792-9b87-4637-89df-62b5836971f9\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-bdlh9"
Oct 31 17:41:54.998701 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:54.983561    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zdtlb\" (UniqueName: \"kubernetes.io/projected/42e93792-9b87-4637-89df-62b5836971f9-kube-api-access-zdtlb\") pod \"istiod-openshift-gateway-7ddd9cfdc8-bdlh9\" (UID: \"42e93792-9b87-4637-89df-62b5836971f9\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-bdlh9"
Oct 31 17:41:54.998701 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:54.983680    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/42e93792-9b87-4637-89df-62b5836971f9-istio-token\") pod \"istiod-openshift-gateway-7ddd9cfdc8-bdlh9\" (UID: \"42e93792-9b87-4637-89df-62b5836971f9\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-bdlh9"
Oct 31 17:41:54.998701 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:54.983753    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/42e93792-9b87-4637-89df-62b5836971f9-local-certs\") pod \"istiod-openshift-gateway-7ddd9cfdc8-bdlh9\" (UID: \"42e93792-9b87-4637-89df-62b5836971f9\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-bdlh9"
Oct 31 17:41:54.998701 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:54.983797    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/42e93792-9b87-4637-89df-62b5836971f9-cacerts\") pod \"istiod-openshift-gateway-7ddd9cfdc8-bdlh9\" (UID: \"42e93792-9b87-4637-89df-62b5836971f9\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-bdlh9"
Oct 31 17:41:54.998701 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:54.983945    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/42e93792-9b87-4637-89df-62b5836971f9-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7ddd9cfdc8-bdlh9\" (UID: \"42e93792-9b87-4637-89df-62b5836971f9\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-bdlh9"
Oct 31 17:41:54.998701 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:54.984006    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/42e93792-9b87-4637-89df-62b5836971f9-istio-kubeconfig\") pod \"istiod-openshift-gateway-7ddd9cfdc8-bdlh9\" (UID: \"42e93792-9b87-4637-89df-62b5836971f9\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-bdlh9"
Oct 31 17:41:55.044805 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:55.044712    5003 patch_prober.go:29] interesting pod/e2e-worker-w3-cf0a86-openshift-default-595bfdc58c-jg25b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.113:15021/healthz/ready\": dial tcp 10.132.0.113:15021: connect: connection refused" start-of-body=
Oct 31 17:41:55.045072 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:55.045044    5003 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-cf0a86-openshift-default-595bfdc58c-jg25b" podUID="61193be6-6ada-48ff-9e96-700c73f018dd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.113:15021/healthz/ready\": dial tcp 10.132.0.113:15021: connect: connection refused"
Oct 31 17:41:55.113769 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:55.105262    5003 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-b78c31/simulator-w5-b78c31-kserve-95df74778-fpvpr" podUID="665d75c7-8ba5-49e1-87a7-51a18ae6f369" containerName="main" probeResult="failure" output="Get \"https://10.132.0.73:8000/ready\": context deadline exceeded"
Oct 31 17:41:55.423920 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:55.408370    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/42e93792-9b87-4637-89df-62b5836971f9-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7ddd9cfdc8-bdlh9\" (UID: \"42e93792-9b87-4637-89df-62b5836971f9\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-bdlh9"
Oct 31 17:41:55.429545 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:55.429158    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/42e93792-9b87-4637-89df-62b5836971f9-cacerts\") pod \"istiod-openshift-gateway-7ddd9cfdc8-bdlh9\" (UID: \"42e93792-9b87-4637-89df-62b5836971f9\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-bdlh9"
Oct 31 17:41:55.436780 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:55.435882    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/42e93792-9b87-4637-89df-62b5836971f9-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7ddd9cfdc8-bdlh9\" (UID: \"42e93792-9b87-4637-89df-62b5836971f9\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-bdlh9"
Oct 31 17:41:55.449619 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:55.449584    5003 patch_prober.go:29] interesting pod/e2e-worker-w4-1c0bfd-openshift-default-f7f657c57-hp2wj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.114:15021/healthz/ready\": dial tcp 10.132.0.114:15021: connect: connection refused" start-of-body=
Oct 31 17:41:55.449889 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:55.449827    5003 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-1c0bfd-openshift-default-f7f657c57-hp2wj" podUID="679da5c1-9c28-4f80-a210-185350147f11" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.114:15021/healthz/ready\": dial tcp 10.132.0.114:15021: connect: connection refused"
Oct 31 17:41:55.504861 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:55.504824    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/42e93792-9b87-4637-89df-62b5836971f9-local-certs\") pod \"istiod-openshift-gateway-7ddd9cfdc8-bdlh9\" (UID: \"42e93792-9b87-4637-89df-62b5836971f9\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-bdlh9"
Oct 31 17:41:55.517055 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:55.516401    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zdtlb\" (UniqueName: \"kubernetes.io/projected/42e93792-9b87-4637-89df-62b5836971f9-kube-api-access-zdtlb\") pod \"istiod-openshift-gateway-7ddd9cfdc8-bdlh9\" (UID: \"42e93792-9b87-4637-89df-62b5836971f9\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-bdlh9"
Oct 31 17:41:55.556670 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:55.551812    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/42e93792-9b87-4637-89df-62b5836971f9-istio-token\") pod \"istiod-openshift-gateway-7ddd9cfdc8-bdlh9\" (UID: \"42e93792-9b87-4637-89df-62b5836971f9\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-bdlh9"
Oct 31 17:41:55.609673 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:55.582078    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/42e93792-9b87-4637-89df-62b5836971f9-istio-kubeconfig\") pod \"istiod-openshift-gateway-7ddd9cfdc8-bdlh9\" (UID: \"42e93792-9b87-4637-89df-62b5836971f9\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-bdlh9"
Oct 31 17:41:55.645631 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:55.645594    5003 patch_prober.go:29] interesting pod/e2e-worker-w0-ee816e-openshift-default-c4db85b5c-dz8kv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.115:15021/healthz/ready\": dial tcp 10.132.0.115:15021: connect: connection refused" start-of-body=
Oct 31 17:41:55.645855 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:55.645694    5003 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-ee816e-openshift-default-c4db85b5c-dz8kv" podUID="6dbed28d-b3b9-4af1-82b7-40151ba418c1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.115:15021/healthz/ready\": dial tcp 10.132.0.115:15021: connect: connection refused"
Oct 31 17:41:55.649718 ip-10-0-138-17 kubenswrapper[5003]: E1031 17:41:55.649688    5003 kubelet.go:2711] "Housekeeping took longer than expected" err="housekeeping took too long" expected="1s" actual="1.281s"
Oct 31 17:41:55.649894 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:55.649780    5003 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w4-1c0bfd/distinct-w4-1c0bfd-kserve-867858548f-46gwg"
Oct 31 17:41:55.649985 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:55.649906    5003 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w2-5c446c/premium-w2-5c446c-kserve-66f7486c85-f7lk2"
Oct 31 17:41:55.651583 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:55.651283    5003 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w4-1c0bfd/premium-w4-1c0bfd-kserve-d78fbb98-psx55"
Oct 31 17:41:55.651583 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:55.651458    5003 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w0-ee816e/simulator-w0-ee816e-kserve-5bd4657dc-9rlm4"
Oct 31 17:41:55.651814 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:55.651787    5003 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w0-ee816e/distinct-w0-ee816e-kserve-564f897f89-kglpl"
Oct 31 17:41:55.652284 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:55.652174    5003 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w5-b78c31/distinct-w5-b78c31-kserve-77ccb69d98-p2zct"
Oct 31 17:41:55.652521 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:55.652430    5003 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w2-5c446c/premium-w2-5c446c-kserve-66f7486c85-f7lk2"
Oct 31 17:41:55.686874 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:55.686782    5003 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-82w89"
Oct 31 17:41:55.695677 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:55.687131    5003 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w1-0e59ca/simulator-w1-0e59ca-kserve-999765679-zs7kh"
Oct 31 17:41:55.702875 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:55.699102    5003 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w5-b78c31/simulator-w5-b78c31-kserve-95df74778-fpvpr"
Oct 31 17:41:55.704522 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:55.704487    5003 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w0-ee816e/simulator-w0-ee816e-kserve-5bd4657dc-9rlm4"
Oct 31 17:41:55.705742 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:55.705448    5003 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w5-b78c31/distinct-2-w5-b78c31-kserve-5f4f9d4bb5-ss7g2"
Oct 31 17:41:55.705742 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:55.705484    5003 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w4-1c0bfd/premium-w4-1c0bfd-kserve-d78fbb98-psx55"
Oct 31 17:41:55.718440 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:55.718241    5003 patch_prober.go:29] interesting pod/e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-9rlpc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.116:15021/healthz/ready\": dial tcp 10.132.0.116:15021: connect: connection refused" start-of-body=
Oct 31 17:41:55.718691 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:55.718466    5003 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-9rlpc" podUID="a115d540-ac87-497f-97f8-bd2e52d066f7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.116:15021/healthz/ready\": dial tcp 10.132.0.116:15021: connect: connection refused"
Oct 31 17:41:55.747084 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:55.747052    5003 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-f827198e-mcgds"]
Oct 31 17:41:55.749510 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:55.749488    5003 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-bdlh9"
Oct 31 17:41:55.815669 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:55.782155    5003 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w2-5c446c/premium-w2-5c446c-kserve-66f7486c85-f7lk2"]
Oct 31 17:41:56.166681 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:56.163921    5003 patch_prober.go:29] interesting pod/e2e-worker-w4-1c0bfd-openshift-default-f7f657c57-hp2wj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.114:15021/healthz/ready\": dial tcp 10.132.0.114:15021: connect: connection refused" start-of-body=
Oct 31 17:41:56.166681 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:56.163989    5003 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-1c0bfd-openshift-default-f7f657c57-hp2wj" podUID="679da5c1-9c28-4f80-a210-185350147f11" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.114:15021/healthz/ready\": dial tcp 10.132.0.114:15021: connect: connection refused"
Oct 31 17:41:56.549438 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:56.547042    5003 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w3-cf0a86-openshift-default-595bfdc58c-jg25b"
Oct 31 17:41:56.549438 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:56.548761    5003 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w3-cf0a86-openshift-default-595bfdc58c-jg25b"
Oct 31 17:41:56.552669 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:56.551904    5003 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w3-cf0a86-openshift-default-595bfdc58c-jg25b"
Oct 31 17:41:56.608669 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:56.602921    5003 patch_prober.go:29] interesting pod/e2e-worker-w0-ee816e-openshift-default-c4db85b5c-dz8kv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.115:15021/healthz/ready\": dial tcp 10.132.0.115:15021: connect: connection refused" start-of-body=
Oct 31 17:41:56.608669 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:56.602982    5003 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-ee816e-openshift-default-c4db85b5c-dz8kv" podUID="6dbed28d-b3b9-4af1-82b7-40151ba418c1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.115:15021/healthz/ready\": dial tcp 10.132.0.115:15021: connect: connection refused"
Oct 31 17:41:56.615809 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:56.611959    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-f827198e-mcgds" event={"ID":"bcb7173c-3e08-4d4e-84ef-d88a41aae7dc","Type":"ContainerStarted","Data":"d2b6c20ec2a3c48a706d4126edc8e4691d224114763930f8edf8c7739abde364"}
Oct 31 17:41:56.737786 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:56.737022    5003 patch_prober.go:29] interesting pod/e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-9rlpc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.116:15021/healthz/ready\": dial tcp 10.132.0.116:15021: connect: connection refused" start-of-body=
Oct 31 17:41:56.737786 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:56.737080    5003 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-9rlpc" podUID="a115d540-ac87-497f-97f8-bd2e52d066f7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.116:15021/healthz/ready\": dial tcp 10.132.0.116:15021: connect: connection refused"
Oct 31 17:41:57.044283 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:57.023817    5003 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-bdlh9"]
Oct 31 17:41:57.044283 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:57.041189    5003 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Oct 31 17:41:57.182691 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:57.177745    5003 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w4-1c0bfd-openshift-default-f7f657c57-hp2wj"
Oct 31 17:41:57.182691 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:57.180359    5003 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w4-1c0bfd-openshift-default-f7f657c57-hp2wj"
Oct 31 17:41:57.183470 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:57.183444    5003 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w4-1c0bfd-openshift-default-f7f657c57-hp2wj"
Oct 31 17:41:57.399085 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:57.399046    5003 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-6ef9a326-tqcgp"]
Oct 31 17:41:57.405763 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:57.405726    5003 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-6ef9a326-tqcgp"
Oct 31 17:41:57.425236 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:57.425201    5003 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-6ef9a326-tqcgp"]
Oct 31 17:41:57.439868 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:57.439831    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/b8119054-38c4-4e15-b85c-5b46c13fa1cd-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-6ef9a326-tqcgp\" (UID: \"b8119054-38c4-4e15-b85c-5b46c13fa1cd\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-6ef9a326-tqcgp"
Oct 31 17:41:57.440182 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:57.440150    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/b8119054-38c4-4e15-b85c-5b46c13fa1cd-maas-api-xks-ca\") pod \"maas-api-revoke-sub-6ef9a326-tqcgp\" (UID: \"b8119054-38c4-4e15-b85c-5b46c13fa1cd\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-6ef9a326-tqcgp"
Oct 31 17:41:57.440408 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:57.440388    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r4zcs\" (UniqueName: \"kubernetes.io/projected/b8119054-38c4-4e15-b85c-5b46c13fa1cd-kube-api-access-r4zcs\") pod \"maas-api-revoke-sub-6ef9a326-tqcgp\" (UID: \"b8119054-38c4-4e15-b85c-5b46c13fa1cd\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-6ef9a326-tqcgp"
Oct 31 17:41:57.574811 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:57.572026    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/b8119054-38c4-4e15-b85c-5b46c13fa1cd-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-6ef9a326-tqcgp\" (UID: \"b8119054-38c4-4e15-b85c-5b46c13fa1cd\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-6ef9a326-tqcgp"
Oct 31 17:41:57.574811 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:57.572112    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/b8119054-38c4-4e15-b85c-5b46c13fa1cd-maas-api-xks-ca\") pod \"maas-api-revoke-sub-6ef9a326-tqcgp\" (UID: \"b8119054-38c4-4e15-b85c-5b46c13fa1cd\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-6ef9a326-tqcgp"
Oct 31 17:41:57.574811 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:57.572214    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r4zcs\" (UniqueName: \"kubernetes.io/projected/b8119054-38c4-4e15-b85c-5b46c13fa1cd-kube-api-access-r4zcs\") pod \"maas-api-revoke-sub-6ef9a326-tqcgp\" (UID: \"b8119054-38c4-4e15-b85c-5b46c13fa1cd\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-6ef9a326-tqcgp"
Oct 31 17:41:57.574811 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:57.573764    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/b8119054-38c4-4e15-b85c-5b46c13fa1cd-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-6ef9a326-tqcgp\" (UID: \"b8119054-38c4-4e15-b85c-5b46c13fa1cd\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-6ef9a326-tqcgp"
Oct 31 17:41:57.577305 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:57.577062    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/b8119054-38c4-4e15-b85c-5b46c13fa1cd-maas-api-xks-ca\") pod \"maas-api-revoke-sub-6ef9a326-tqcgp\" (UID: \"b8119054-38c4-4e15-b85c-5b46c13fa1cd\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-6ef9a326-tqcgp"
Oct 31 17:41:57.607976 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:57.593655    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r4zcs\" (UniqueName: \"kubernetes.io/projected/b8119054-38c4-4e15-b85c-5b46c13fa1cd-kube-api-access-r4zcs\") pod \"maas-api-revoke-sub-6ef9a326-tqcgp\" (UID: \"b8119054-38c4-4e15-b85c-5b46c13fa1cd\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-6ef9a326-tqcgp"
Oct 31 17:41:57.627456 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:57.625713    5003 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w0-ee816e-openshift-default-c4db85b5c-dz8kv"
Oct 31 17:41:57.627456 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:57.627194    5003 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w0-ee816e-openshift-default-c4db85b5c-dz8kv"
Oct 31 17:41:57.628308 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:57.628286    5003 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w0-ee816e-openshift-default-c4db85b5c-dz8kv"
Oct 31 17:41:57.649696 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:57.647615    5003 generic.go:356] "Generic (PLEG): container finished" podID="bcb7173c-3e08-4d4e-84ef-d88a41aae7dc" containerID="a562ccd0a5e85f2280613c779fd25c18353ca0ee0c28ac8aeaa2254c45045f34" exitCode=0
Oct 31 17:41:57.649696 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:57.648019    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-f827198e-mcgds" event={"ID":"bcb7173c-3e08-4d4e-84ef-d88a41aae7dc","Type":"ContainerDied","Data":"a562ccd0a5e85f2280613c779fd25c18353ca0ee0c28ac8aeaa2254c45045f34"}
Oct 31 17:41:57.657811 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:57.657765    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-bdlh9" event={"ID":"42e93792-9b87-4637-89df-62b5836971f9","Type":"ContainerStarted","Data":"9edff2e9e872130fe5c98d9491fd4867e24d0f5fab75aecdf1ae748883881dac"}
Oct 31 17:41:57.784338 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:57.784304    5003 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-6ef9a326-tqcgp"
Oct 31 17:41:57.960394 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:57.959981    5003 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-9rlpc"
Oct 31 17:41:57.961776 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:57.961752    5003 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-9rlpc"
Oct 31 17:41:57.962243 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:57.962221    5003 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-9rlpc"
Oct 31 17:41:58.117549 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:58.117517    5003 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-6ef9a326-tqcgp"]
Oct 31 17:41:58.119088 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:41:58.119061    5003 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb8119054_38c4_4e15_b85c_5b46c13fa1cd.slice/crio-3a069825c7c6177f833bd795ebeb29fd669162f3870046e8409b16c7c0f36f56 WatchSource:0}: Error finding container 3a069825c7c6177f833bd795ebeb29fd669162f3870046e8409b16c7c0f36f56: Status 404 returned error can't find the container with id 3a069825c7c6177f833bd795ebeb29fd669162f3870046e8409b16c7c0f36f56
Oct 31 17:41:58.668943 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:58.668903    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-6ef9a326-tqcgp" event={"ID":"b8119054-38c4-4e15-b85c-5b46c13fa1cd","Type":"ContainerStarted","Data":"82070aae68b55710ff8da94a50fd640b3903e7ff67b5b1efd2a6a95ac1ead337"}
Oct 31 17:41:58.669379 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:58.668974    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-6ef9a326-tqcgp" event={"ID":"b8119054-38c4-4e15-b85c-5b46c13fa1cd","Type":"ContainerStarted","Data":"3a069825c7c6177f833bd795ebeb29fd669162f3870046e8409b16c7c0f36f56"}
Oct 31 17:41:58.712039 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:58.711983    5003 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-sub-6ef9a326-tqcgp" podStartSLOduration=1.711968287 podStartE2EDuration="1.711968287s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 17:41:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 17:41:58.705799637 +0000 UTC m=+886.960654182" watchObservedRunningTime="2026-10-31 17:41:58.711968287 +0000 UTC m=+886.966822828"
Oct 31 17:41:58.864849 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:58.864802    5003 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-f827198e-mcgds"
Oct 31 17:41:58.895714 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:58.895680    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/bcb7173c-3e08-4d4e-84ef-d88a41aae7dc-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/bcb7173c-3e08-4d4e-84ef-d88a41aae7dc-maas-api-openshift-ca\") pod \"bcb7173c-3e08-4d4e-84ef-d88a41aae7dc\" (UID: \"bcb7173c-3e08-4d4e-84ef-d88a41aae7dc\") "
Oct 31 17:41:58.895894 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:58.895856    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/bcb7173c-3e08-4d4e-84ef-d88a41aae7dc-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/bcb7173c-3e08-4d4e-84ef-d88a41aae7dc-maas-api-xks-ca\") pod \"bcb7173c-3e08-4d4e-84ef-d88a41aae7dc\" (UID: \"bcb7173c-3e08-4d4e-84ef-d88a41aae7dc\") "
Oct 31 17:41:58.895960 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:58.895910    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/bcb7173c-3e08-4d4e-84ef-d88a41aae7dc-kube-api-access-9f8b6\" (UniqueName: \"kubernetes.io/projected/bcb7173c-3e08-4d4e-84ef-d88a41aae7dc-kube-api-access-9f8b6\") pod \"bcb7173c-3e08-4d4e-84ef-d88a41aae7dc\" (UID: \"bcb7173c-3e08-4d4e-84ef-d88a41aae7dc\") "
Oct 31 17:41:58.896110 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:58.896084    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bcb7173c-3e08-4d4e-84ef-d88a41aae7dc-maas-api-openshift-ca" pod "bcb7173c-3e08-4d4e-84ef-d88a41aae7dc" (UID: "bcb7173c-3e08-4d4e-84ef-d88a41aae7dc"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 17:41:58.896636 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:58.896611    5003 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/bcb7173c-3e08-4d4e-84ef-d88a41aae7dc-maas-api-openshift-ca\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:41:58.898514 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:58.898490    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bcb7173c-3e08-4d4e-84ef-d88a41aae7dc-maas-api-xks-ca" pod "bcb7173c-3e08-4d4e-84ef-d88a41aae7dc" (UID: "bcb7173c-3e08-4d4e-84ef-d88a41aae7dc"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 17:41:58.898634 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:58.898587    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bcb7173c-3e08-4d4e-84ef-d88a41aae7dc-kube-api-access-9f8b6" pod "bcb7173c-3e08-4d4e-84ef-d88a41aae7dc" (UID: "bcb7173c-3e08-4d4e-84ef-d88a41aae7dc"). InnerVolumeSpecName "kube-api-access-9f8b6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 17:41:58.998703 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:58.998665    5003 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/bcb7173c-3e08-4d4e-84ef-d88a41aae7dc-maas-api-xks-ca\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:41:58.998703 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:58.998704    5003 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9f8b6\" (UniqueName: \"kubernetes.io/projected/bcb7173c-3e08-4d4e-84ef-d88a41aae7dc-kube-api-access-9f8b6\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:41:59.681060 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:59.680988    5003 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-f827198e-mcgds"
Oct 31 17:41:59.681596 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:59.681571    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-f827198e-mcgds" event={"ID":"bcb7173c-3e08-4d4e-84ef-d88a41aae7dc","Type":"ContainerDied","Data":"d2b6c20ec2a3c48a706d4126edc8e4691d224114763930f8edf8c7739abde364"}
Oct 31 17:41:59.681702 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:59.681624    5003 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d2b6c20ec2a3c48a706d4126edc8e4691d224114763930f8edf8c7739abde364"
Oct 31 17:41:59.684762 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:59.684735    5003 generic.go:356] "Generic (PLEG): container finished" podID="b8119054-38c4-4e15-b85c-5b46c13fa1cd" containerID="82070aae68b55710ff8da94a50fd640b3903e7ff67b5b1efd2a6a95ac1ead337" exitCode=0
Oct 31 17:41:59.686039 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:41:59.686015    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-6ef9a326-tqcgp" event={"ID":"b8119054-38c4-4e15-b85c-5b46c13fa1cd","Type":"ContainerDied","Data":"82070aae68b55710ff8da94a50fd640b3903e7ff67b5b1efd2a6a95ac1ead337"}
Oct 31 17:42:00.261082 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:00.261044    5003 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Oct 31 17:42:00.261181 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:00.261112    5003 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Oct 31 17:42:00.701087 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:00.700956    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-bdlh9" event={"ID":"42e93792-9b87-4637-89df-62b5836971f9","Type":"ContainerStarted","Data":"a954ba512428edcfff058e8097d5e67da58d3fb23f633bfc22102781df1ed7f7"}
Oct 31 17:42:00.701087 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:00.701043    5003 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-bdlh9"
Oct 31 17:42:00.754908 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:00.749920    5003 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-bdlh9" podStartSLOduration=4.531809569 podStartE2EDuration="7.74989445s" totalImagesPullingTime="3.218084881s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 17:41:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 17:42:00.747135278 +0000 UTC m=+889.001989822" watchObservedRunningTime="2026-10-31 17:42:00.74989445 +0000 UTC m=+889.004748993"
Oct 31 17:42:00.954729 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:00.953505    5003 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-6ef9a326-tqcgp"
Oct 31 17:42:01.041074 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:01.040223    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/b8119054-38c4-4e15-b85c-5b46c13fa1cd-kube-api-access-r4zcs\" (UniqueName: \"kubernetes.io/projected/b8119054-38c4-4e15-b85c-5b46c13fa1cd-kube-api-access-r4zcs\") pod \"b8119054-38c4-4e15-b85c-5b46c13fa1cd\" (UID: \"b8119054-38c4-4e15-b85c-5b46c13fa1cd\") "
Oct 31 17:42:01.041074 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:01.040526    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/b8119054-38c4-4e15-b85c-5b46c13fa1cd-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/b8119054-38c4-4e15-b85c-5b46c13fa1cd-maas-api-xks-ca\") pod \"b8119054-38c4-4e15-b85c-5b46c13fa1cd\" (UID: \"b8119054-38c4-4e15-b85c-5b46c13fa1cd\") "
Oct 31 17:42:01.041074 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:01.040615    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/b8119054-38c4-4e15-b85c-5b46c13fa1cd-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/b8119054-38c4-4e15-b85c-5b46c13fa1cd-maas-api-openshift-ca\") pod \"b8119054-38c4-4e15-b85c-5b46c13fa1cd\" (UID: \"b8119054-38c4-4e15-b85c-5b46c13fa1cd\") "
Oct 31 17:42:01.044837 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:01.044147    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b8119054-38c4-4e15-b85c-5b46c13fa1cd-maas-api-openshift-ca" pod "b8119054-38c4-4e15-b85c-5b46c13fa1cd" (UID: "b8119054-38c4-4e15-b85c-5b46c13fa1cd"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 17:42:01.050132 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:01.045180    5003 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/b8119054-38c4-4e15-b85c-5b46c13fa1cd-maas-api-openshift-ca\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:42:01.118863 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:01.118790    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b8119054-38c4-4e15-b85c-5b46c13fa1cd-maas-api-xks-ca" pod "b8119054-38c4-4e15-b85c-5b46c13fa1cd" (UID: "b8119054-38c4-4e15-b85c-5b46c13fa1cd"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 17:42:01.121802 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:01.121735    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b8119054-38c4-4e15-b85c-5b46c13fa1cd-kube-api-access-r4zcs" pod "b8119054-38c4-4e15-b85c-5b46c13fa1cd" (UID: "b8119054-38c4-4e15-b85c-5b46c13fa1cd"). InnerVolumeSpecName "kube-api-access-r4zcs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 17:42:01.149572 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:01.147433    5003 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r4zcs\" (UniqueName: \"kubernetes.io/projected/b8119054-38c4-4e15-b85c-5b46c13fa1cd-kube-api-access-r4zcs\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:42:01.149572 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:01.147476    5003 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/b8119054-38c4-4e15-b85c-5b46c13fa1cd-maas-api-xks-ca\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:42:02.160707 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:02.140609    5003 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-6ef9a326-tqcgp"
Oct 31 17:42:02.160707 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:02.157919    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-6ef9a326-tqcgp" event={"ID":"b8119054-38c4-4e15-b85c-5b46c13fa1cd","Type":"ContainerDied","Data":"3a069825c7c6177f833bd795ebeb29fd669162f3870046e8409b16c7c0f36f56"}
Oct 31 17:42:02.160707 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:02.157982    5003 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3a069825c7c6177f833bd795ebeb29fd669162f3870046e8409b16c7c0f36f56"
Oct 31 17:42:02.171669 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:02.166412    5003 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-bdlh9"
Oct 31 17:42:02.794687 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:02.771749    5003 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-ee816e/distinct-w0-ee816e-kserve-564f897f89-kglpl" podUID="82b982f8-de44-449d-b4a6-dc8f5824bf35" containerName="main" probeResult="failure" output="Get \"https://10.132.0.91:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 31 17:42:02.911792 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:02.911738    5003 prober.go:122] "Probe failed" probeType="Readiness" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-82w89" podUID="ef5a065b-f98e-4d14-810f-2d0c42c58ce6" containerName="main" probeResult="failure" output="Get \"https://10.132.0.54:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 31 17:42:03.149667 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:03.146115    5003 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-1c0bfd/distinct-w4-1c0bfd-kserve-867858548f-46gwg" podUID="93f16294-fc40-477d-90b3-d02640037d5b" containerName="main" probeResult="failure" output="Get \"https://10.132.0.94:8000/ready\": context deadline exceeded"
Oct 31 17:42:03.149667 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:03.147073    5003 prober.go:122] "Probe failed" probeType="Liveness" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-82w89" podUID="ef5a065b-f98e-4d14-810f-2d0c42c58ce6" containerName="main" probeResult="failure" output="Get \"https://10.132.0.54:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 31 17:42:03.149667 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:03.147306    5003 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-b78c31/distinct-w5-b78c31-kserve-77ccb69d98-p2zct" podUID="fcf01e9c-57fb-42db-848d-d314c615bd67" containerName="main" probeResult="failure" output="Get \"https://10.132.0.93:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 31 17:42:03.149667 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:03.147468    5003 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-b78c31/distinct-2-w5-b78c31-kserve-5f4f9d4bb5-ss7g2" podUID="9cc6d7e8-30de-4173-9974-1f1a4fd08e1c" containerName="main" probeResult="failure" output="Get \"https://10.132.0.99:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 31 17:42:03.491731 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:03.491384    5003 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w0-ee816e/distinct-w0-ee816e-kserve-564f897f89-kglpl" podUID="82b982f8-de44-449d-b4a6-dc8f5824bf35" containerName="main" probeResult="failure" output="Get \"https://10.132.0.91:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 31 17:42:03.556507 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:03.556465    5003 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-1c0bfd/premium-w4-1c0bfd-kserve-d78fbb98-psx55" podUID="34bdffed-87b8-4e7a-b182-f069d081bd62" containerName="main" probeResult="failure" output="Get \"https://10.132.0.74:8000/ready\": context deadline exceeded"
Oct 31 17:42:03.714014 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:03.709243    5003 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-ee816e/simulator-w0-ee816e-kserve-5bd4657dc-9rlm4" podUID="620f499f-36d7-4900-abbe-98ee5cf5d96c" containerName="main" probeResult="failure" output="Get \"https://10.132.0.72:8000/ready\": context deadline exceeded"
Oct 31 17:42:03.772259 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:03.772157    5003 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-ee816e/distinct-w0-ee816e-kserve-564f897f89-kglpl" podUID="82b982f8-de44-449d-b4a6-dc8f5824bf35" containerName="main" probeResult="failure" output="Get \"https://10.132.0.91:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 31 17:42:03.773143 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:03.773116    5003 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w0-ee816e/distinct-w0-ee816e-kserve-564f897f89-kglpl"
Oct 31 17:42:03.782999 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:03.782921    5003 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-0e59ca/simulator-w1-0e59ca-kserve-999765679-zs7kh" podUID="018d423e-6866-4b61-a4a2-d2e786d82bf0" containerName="main" probeResult="failure" output="Get \"https://10.132.0.71:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 31 17:42:03.871726 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:03.862756    5003 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-b78c31/simulator-w5-b78c31-kserve-95df74778-fpvpr" podUID="665d75c7-8ba5-49e1-87a7-51a18ae6f369" containerName="main" probeResult="failure" output="Get \"https://10.132.0.73:8000/ready\": context deadline exceeded"
Oct 31 17:42:03.871726 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:03.863156    5003 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-5c446c/premium-w2-5c446c-kserve-66f7486c85-f7lk2" podUID="9c2ddfab-2348-4bb0-8844-1fca62460390" containerName="main" probeResult="failure" output="Get \"https://10.132.0.75:8000/ready\": context deadline exceeded"
Oct 31 17:42:03.929671 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:03.922503    5003 prober.go:122] "Probe failed" probeType="Readiness" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-82w89" podUID="ef5a065b-f98e-4d14-810f-2d0c42c58ce6" containerName="main" probeResult="failure" output="Get \"https://10.132.0.54:8000/ready\": context deadline exceeded"
Oct 31 17:42:04.168688 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:04.166870    5003 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-b78c31/distinct-2-w5-b78c31-kserve-5f4f9d4bb5-ss7g2" podUID="9cc6d7e8-30de-4173-9974-1f1a4fd08e1c" containerName="main" probeResult="failure" output="Get \"https://10.132.0.99:8000/ready\": context deadline exceeded"
Oct 31 17:42:04.168688 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:04.166834    5003 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-1c0bfd/distinct-w4-1c0bfd-kserve-867858548f-46gwg" podUID="93f16294-fc40-477d-90b3-d02640037d5b" containerName="main" probeResult="failure" output="Get \"https://10.132.0.94:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 31 17:42:04.205960 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:04.178842    5003 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-b78c31/distinct-w5-b78c31-kserve-77ccb69d98-p2zct" podUID="fcf01e9c-57fb-42db-848d-d314c615bd67" containerName="main" probeResult="failure" output="Get \"https://10.132.0.93:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 31 17:42:04.208871 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:04.208249    5003 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w4-1c0bfd/premium-w4-1c0bfd-kserve-d78fbb98-psx55" podUID="34bdffed-87b8-4e7a-b182-f069d081bd62" containerName="main" probeResult="failure" output="Get \"https://10.132.0.74:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 31 17:42:04.278707 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:04.266293    5003 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-82w89"
Oct 31 17:42:04.550941 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:04.550844    5003 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w2-5c446c-7c8d75cf57-px9mc"]
Oct 31 17:42:04.551577 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:04.551553    5003 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w4-1c0bfd/distinct-w4-1c0bfd-kserve-867858548f-46gwg"
Oct 31 17:42:04.551759 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:04.551733    5003 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w5-b78c31/distinct-2-w5-b78c31-kserve-5f4f9d4bb5-ss7g2"
Oct 31 17:42:04.590904 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:04.590870    5003 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w5-b78c31/distinct-w5-b78c31-kserve-77ccb69d98-p2zct"
Oct 31 17:42:04.660672 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:04.620229    5003 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w2-5c446c-748954c4f5-9xwrq"]
Oct 31 17:42:04.660672 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:04.558793    5003 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-1c0bfd/premium-w4-1c0bfd-kserve-d78fbb98-psx55" podUID="34bdffed-87b8-4e7a-b182-f069d081bd62" containerName="main" probeResult="failure" output="Get \"https://10.132.0.74:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 31 17:42:04.660672 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:04.645862    5003 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w4-1c0bfd/premium-w4-1c0bfd-kserve-d78fbb98-psx55"
Oct 31 17:42:04.779799 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:04.779744    5003 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-ee816e/distinct-w0-ee816e-kserve-564f897f89-kglpl" podUID="82b982f8-de44-449d-b4a6-dc8f5824bf35" containerName="main" probeResult="failure" output="Get \"https://10.132.0.91:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 31 17:42:04.952675 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:04.779741    5003 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-ee816e/simulator-w0-ee816e-kserve-5bd4657dc-9rlm4" podUID="620f499f-36d7-4900-abbe-98ee5cf5d96c" containerName="main" probeResult="failure" output="Get \"https://10.132.0.72:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 31 17:42:05.483705 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:04.873268    5003 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-5c446c/premium-w2-5c446c-kserve-66f7486c85-f7lk2" podUID="9c2ddfab-2348-4bb0-8844-1fca62460390" containerName="main" probeResult="failure" output="Get \"https://10.132.0.75:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 31 17:42:05.539731 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:04.873313    5003 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-b78c31/simulator-w5-b78c31-kserve-95df74778-fpvpr" podUID="665d75c7-8ba5-49e1-87a7-51a18ae6f369" containerName="main" probeResult="failure" output="Get \"https://10.132.0.73:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 31 17:42:05.559257 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:05.180179    5003 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-1c0bfd/distinct-w4-1c0bfd-kserve-867858548f-46gwg" podUID="93f16294-fc40-477d-90b3-d02640037d5b" containerName="main" probeResult="failure" output="Get \"https://10.132.0.94:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 31 17:42:05.559257 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:05.208841    5003 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-b78c31/distinct-2-w5-b78c31-kserve-5f4f9d4bb5-ss7g2" podUID="9cc6d7e8-30de-4173-9974-1f1a4fd08e1c" containerName="main" probeResult="failure" output="Get \"https://10.132.0.99:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 31 17:42:05.559257 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:05.282432    5003 prober.go:122] "Probe failed" probeType="Readiness" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-82w89" podUID="ef5a065b-f98e-4d14-810f-2d0c42c58ce6" containerName="main" probeResult="failure" output="Get \"https://10.132.0.54:8000/ready\": context deadline exceeded"
Oct 31 17:42:05.559904 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:05.311558    5003 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-b78c31/distinct-w5-b78c31-kserve-77ccb69d98-p2zct" podUID="fcf01e9c-57fb-42db-848d-d314c615bd67" containerName="main" probeResult="failure" output="Get \"https://10.132.0.93:8000/ready\": context deadline exceeded"
Oct 31 17:42:05.559904 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:05.504990    5003 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w0-ee816e/simulator-w0-ee816e-kserve-5bd4657dc-9rlm4"
Oct 31 17:42:05.559904 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:05.559833    5003 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w2-5c446c/premium-w2-5c446c-kserve-66f7486c85-f7lk2"
Oct 31 17:42:05.560076 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:05.559913    5003 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w5-b78c31/simulator-w5-b78c31-kserve-95df74778-fpvpr"
Oct 31 17:42:05.573760 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:05.526731    5003 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-0e59ca/simulator-w1-0e59ca-kserve-999765679-zs7kh" podUID="018d423e-6866-4b61-a4a2-d2e786d82bf0" containerName="main" probeResult="failure" output="Get \"https://10.132.0.71:8000/ready\": context deadline exceeded"
Oct 31 17:42:05.588804 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:05.588768    5003 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w1-0e59ca/simulator-w1-0e59ca-kserve-999765679-zs7kh"
Oct 31 17:42:05.674025 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:05.628446    5003 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-1c0bfd/premium-w4-1c0bfd-kserve-d78fbb98-psx55" podUID="34bdffed-87b8-4e7a-b182-f069d081bd62" containerName="main" probeResult="failure" output="Get \"https://10.132.0.74:8000/ready\": context deadline exceeded"
Oct 31 17:42:05.879358 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:05.879312    5003 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-ee816e/distinct-w0-ee816e-kserve-564f897f89-kglpl" podUID="82b982f8-de44-449d-b4a6-dc8f5824bf35" containerName="main" probeResult="failure" output="Get \"https://10.132.0.91:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 31 17:42:05.881180 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:05.881148    5003 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w5-b78c31/distinct-2-w5-b78c31-kserve-5f4f9d4bb5-ss7g2" podUID="9cc6d7e8-30de-4173-9974-1f1a4fd08e1c" containerName="main" probeResult="failure" output="Get \"https://10.132.0.99:8000/health\": context deadline exceeded"
Oct 31 17:42:06.462727 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:06.459218    5003 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-ee816e/simulator-w0-ee816e-kserve-5bd4657dc-9rlm4" podUID="620f499f-36d7-4900-abbe-98ee5cf5d96c" containerName="main" probeResult="failure" output="Get \"https://10.132.0.72:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 31 17:42:06.589335 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:06.589279    5003 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-b78c31/distinct-w5-b78c31-kserve-77ccb69d98-p2zct" podUID="fcf01e9c-57fb-42db-848d-d314c615bd67" containerName="main" probeResult="failure" output="Get \"https://10.132.0.93:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 31 17:42:06.625379 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:06.588816    5003 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-0e59ca/simulator-w1-0e59ca-kserve-999765679-zs7kh" podUID="018d423e-6866-4b61-a4a2-d2e786d82bf0" containerName="main" probeResult="failure" output="Get \"https://10.132.0.71:8000/ready\": context deadline exceeded"
Oct 31 17:42:06.645856 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:06.640105    5003 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-1c0bfd/premium-w4-1c0bfd-kserve-d78fbb98-psx55" podUID="34bdffed-87b8-4e7a-b182-f069d081bd62" containerName="main" probeResult="failure" output="Get \"https://10.132.0.74:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 31 17:42:06.780998 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:06.645886    5003 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-1c0bfd/distinct-w4-1c0bfd-kserve-867858548f-46gwg" podUID="93f16294-fc40-477d-90b3-d02640037d5b" containerName="main" probeResult="failure" output="Get \"https://10.132.0.94:8000/ready\": context deadline exceeded"
Oct 31 17:42:06.781717 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:06.645928    5003 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w5-b78c31/distinct-w5-b78c31-kserve-77ccb69d98-p2zct" podUID="fcf01e9c-57fb-42db-848d-d314c615bd67" containerName="main" probeResult="failure" output="Get \"https://10.132.0.93:8000/health\": context deadline exceeded"
Oct 31 17:42:06.781901 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:06.645976    5003 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-5c446c/premium-w2-5c446c-kserve-66f7486c85-f7lk2" podUID="9c2ddfab-2348-4bb0-8844-1fca62460390" containerName="main" probeResult="failure" output="Get \"https://10.132.0.75:8000/ready\": context deadline exceeded"
Oct 31 17:42:06.791755 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:06.646005    5003 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-b78c31/simulator-w5-b78c31-kserve-95df74778-fpvpr" podUID="665d75c7-8ba5-49e1-87a7-51a18ae6f369" containerName="main" probeResult="failure" output="Get \"https://10.132.0.73:8000/ready\": context deadline exceeded"
Oct 31 17:42:06.813863 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:06.646041    5003 prober.go:122] "Probe failed" probeType="Readiness" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-82w89" podUID="ef5a065b-f98e-4d14-810f-2d0c42c58ce6" containerName="main" probeResult="failure" output="Get \"https://10.132.0.54:8000/ready\": context deadline exceeded"
Oct 31 17:42:06.814232 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:06.646070    5003 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-b78c31/distinct-2-w5-b78c31-kserve-5f4f9d4bb5-ss7g2" podUID="9cc6d7e8-30de-4173-9974-1f1a4fd08e1c" containerName="main" probeResult="failure" output="Get \"https://10.132.0.99:8000/ready\": context deadline exceeded"
Oct 31 17:42:06.933616 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:06.933584    5003 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w0-ee816e/distinct-w0-ee816e-kserve-564f897f89-kglpl"
Oct 31 17:42:06.940856 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:06.940815    5003 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w5-b78c31/distinct-w5-b78c31-kserve-77ccb69d98-p2zct"
Oct 31 17:42:06.997016 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:06.996969    5003 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w1-0e59ca/simulator-w1-0e59ca-kserve-999765679-zs7kh"
Oct 31 17:42:07.013722 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:07.012266    5003 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w0-ee816e/simulator-w0-ee816e-kserve-5bd4657dc-9rlm4"
Oct 31 17:42:07.051188 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:07.042399    5003 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w4-1c0bfd/premium-w4-1c0bfd-kserve-d78fbb98-psx55"
Oct 31 17:42:07.051188 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:07.050906    5003 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-82w89"
Oct 31 17:42:07.051741 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:07.051717    5003 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w5-b78c31/distinct-2-w5-b78c31-kserve-5f4f9d4bb5-ss7g2"
Oct 31 17:42:07.053779 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:07.053757    5003 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w4-1c0bfd/distinct-w4-1c0bfd-kserve-867858548f-46gwg"
Oct 31 17:42:07.067500 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:07.067466    5003 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w5-b78c31/simulator-w5-b78c31-kserve-95df74778-fpvpr"
Oct 31 17:42:07.093383 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:07.093352    5003 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w2-5c446c/premium-w2-5c446c-kserve-66f7486c85-f7lk2"
Oct 31 17:42:08.877010 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:08.876971    5003 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-e15c3d5b-79884"]
Oct 31 17:42:08.879581 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:08.877875    5003 cpu_manager.go:414] "containerMap: removing container" podUID="b8119054-38c4-4e15-b85c-5b46c13fa1cd" containerName="revoke-keys"
Oct 31 17:42:08.879581 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:08.877893    5003 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="b8119054-38c4-4e15-b85c-5b46c13fa1cd" containerName="revoke-keys"
Oct 31 17:42:08.879581 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:08.877932    5003 cpu_manager.go:414] "containerMap: removing container" podUID="bcb7173c-3e08-4d4e-84ef-d88a41aae7dc" containerName="revoke-keys"
Oct 31 17:42:08.879581 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:08.877937    5003 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="bcb7173c-3e08-4d4e-84ef-d88a41aae7dc" containerName="revoke-keys"
Oct 31 17:42:08.879581 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:08.878048    5003 memory_manager.go:365] "RemoveStaleState removing state" podUID="b8119054-38c4-4e15-b85c-5b46c13fa1cd" containerName="revoke-keys"
Oct 31 17:42:08.879581 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:08.878060    5003 memory_manager.go:365] "RemoveStaleState removing state" podUID="bcb7173c-3e08-4d4e-84ef-d88a41aae7dc" containerName="revoke-keys"
Oct 31 17:42:08.881988 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:08.881966    5003 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-e15c3d5b-79884"
Oct 31 17:42:08.894424 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:08.894397    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/bcf651cc-ecd4-443c-b968-72575fc1174d-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-e15c3d5b-79884\" (UID: \"bcf651cc-ecd4-443c-b968-72575fc1174d\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-e15c3d5b-79884"
Oct 31 17:42:08.895290 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:08.894680    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7jnhm\" (UniqueName: \"kubernetes.io/projected/bcf651cc-ecd4-443c-b968-72575fc1174d-kube-api-access-7jnhm\") pod \"maas-api-revoke-sub-e15c3d5b-79884\" (UID: \"bcf651cc-ecd4-443c-b968-72575fc1174d\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-e15c3d5b-79884"
Oct 31 17:42:08.895290 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:08.894840    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/bcf651cc-ecd4-443c-b968-72575fc1174d-maas-api-xks-ca\") pod \"maas-api-revoke-sub-e15c3d5b-79884\" (UID: \"bcf651cc-ecd4-443c-b968-72575fc1174d\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-e15c3d5b-79884"
Oct 31 17:42:08.899476 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:08.899451    5003 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-e15c3d5b-79884"]
Oct 31 17:42:08.904740 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:08.904715    5003 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\""
Oct 31 17:42:08.904848 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:08.904737    5003 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-mr9x2\""
Oct 31 17:42:08.996861 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:08.996828    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7jnhm\" (UniqueName: \"kubernetes.io/projected/bcf651cc-ecd4-443c-b968-72575fc1174d-kube-api-access-7jnhm\") pod \"maas-api-revoke-sub-e15c3d5b-79884\" (UID: \"bcf651cc-ecd4-443c-b968-72575fc1174d\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-e15c3d5b-79884"
Oct 31 17:42:08.997064 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:08.996944    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/bcf651cc-ecd4-443c-b968-72575fc1174d-maas-api-xks-ca\") pod \"maas-api-revoke-sub-e15c3d5b-79884\" (UID: \"bcf651cc-ecd4-443c-b968-72575fc1174d\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-e15c3d5b-79884"
Oct 31 17:42:08.997064 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:08.997054    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/bcf651cc-ecd4-443c-b968-72575fc1174d-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-e15c3d5b-79884\" (UID: \"bcf651cc-ecd4-443c-b968-72575fc1174d\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-e15c3d5b-79884"
Oct 31 17:42:08.997733 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:08.997708    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/bcf651cc-ecd4-443c-b968-72575fc1174d-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-e15c3d5b-79884\" (UID: \"bcf651cc-ecd4-443c-b968-72575fc1174d\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-e15c3d5b-79884"
Oct 31 17:42:08.999352 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:08.999329    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/bcf651cc-ecd4-443c-b968-72575fc1174d-maas-api-xks-ca\") pod \"maas-api-revoke-sub-e15c3d5b-79884\" (UID: \"bcf651cc-ecd4-443c-b968-72575fc1174d\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-e15c3d5b-79884"
Oct 31 17:42:09.020769 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:09.020732    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7jnhm\" (UniqueName: \"kubernetes.io/projected/bcf651cc-ecd4-443c-b968-72575fc1174d-kube-api-access-7jnhm\") pod \"maas-api-revoke-sub-e15c3d5b-79884\" (UID: \"bcf651cc-ecd4-443c-b968-72575fc1174d\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-e15c3d5b-79884"
Oct 31 17:42:09.198817 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:09.198730    5003 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-e15c3d5b-79884"
Oct 31 17:42:09.249259 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:09.249218    5003 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w3-cf0a86-c788d8d8f-r22w9"]
Oct 31 17:42:09.507128 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:09.507096    5003 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-e15c3d5b-79884"]
Oct 31 17:42:09.508524 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:42:09.508161    5003 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbcf651cc_ecd4_443c_b968_72575fc1174d.slice/crio-777d98d0ee2b8991b9759b87d62317872c4e2a13fddea905c249ea3531bb0559 WatchSource:0}: Error finding container 777d98d0ee2b8991b9759b87d62317872c4e2a13fddea905c249ea3531bb0559: Status 404 returned error can't find the container with id 777d98d0ee2b8991b9759b87d62317872c4e2a13fddea905c249ea3531bb0559
Oct 31 17:42:09.576325 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:09.576288    5003 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-worker-w2-5c446c-7c8d75cf57-px9mc" podUID="69ade7b0-0eb9-4426-901e-9bb7acdf1c1f" containerName="payload-processing" containerID="cri-o://93ace7d75c2830aac310fe02738439a7e46bd294becee20ab2181bc7e974212b" gracePeriod=25
Oct 31 17:42:09.621394 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:09.621352    5003 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-5c446c-748954c4f5-9xwrq" podUID="801db2fa-c695-4267-a534-5a024d355c57" containerName="payload-pre-processing" containerID="cri-o://91976378d344d8840a524b21851cd5bd81c7f885d67070a8d85236e87f75f161" gracePeriod=25
Oct 31 17:42:10.118727 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:10.115092    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-e15c3d5b-79884" event={"ID":"bcf651cc-ecd4-443c-b968-72575fc1174d","Type":"ContainerStarted","Data":"458cd5a65f3b3a97cebc555559782b4f80b0d7d6f8c4c50242f12bd61432f7cb"}
Oct 31 17:42:10.118727 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:10.115143    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-e15c3d5b-79884" event={"ID":"bcf651cc-ecd4-443c-b968-72575fc1174d","Type":"ContainerStarted","Data":"777d98d0ee2b8991b9759b87d62317872c4e2a13fddea905c249ea3531bb0559"}
Oct 31 17:42:10.154620 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:10.154562    5003 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-sub-e15c3d5b-79884" podStartSLOduration=2.154547637 podStartE2EDuration="2.154547637s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 17:42:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 17:42:10.151463874 +0000 UTC m=+898.406318415" watchObservedRunningTime="2026-10-31 17:42:10.154547637 +0000 UTC m=+898.409402179"
Oct 31 17:42:10.335397 ip-10-0-138-17 kubenswrapper[5003]: E1031 17:42:10.335351    5003 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-tdzz5" containerName="extractor"
Oct 31 17:42:10.752550 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:10.752468    5003 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-49c5059e-qq2br"]
Oct 31 17:42:10.757996 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:10.757969    5003 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-49c5059e-qq2br"
Oct 31 17:42:10.809980 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:10.780462    5003 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-49c5059e-qq2br"]
Oct 31 17:42:10.907947 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:10.907911    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/b51d3573-af2d-4813-ad48-73668757ede7-maas-api-xks-ca\") pod \"maas-api-revoke-sub-49c5059e-qq2br\" (UID: \"b51d3573-af2d-4813-ad48-73668757ede7\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-49c5059e-qq2br"
Oct 31 17:42:10.908135 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:10.907993    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9n92q\" (UniqueName: \"kubernetes.io/projected/b51d3573-af2d-4813-ad48-73668757ede7-kube-api-access-9n92q\") pod \"maas-api-revoke-sub-49c5059e-qq2br\" (UID: \"b51d3573-af2d-4813-ad48-73668757ede7\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-49c5059e-qq2br"
Oct 31 17:42:10.908256 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:10.908225    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/b51d3573-af2d-4813-ad48-73668757ede7-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-49c5059e-qq2br\" (UID: \"b51d3573-af2d-4813-ad48-73668757ede7\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-49c5059e-qq2br"
Oct 31 17:42:11.010244 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:11.010146    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/b51d3573-af2d-4813-ad48-73668757ede7-maas-api-xks-ca\") pod \"maas-api-revoke-sub-49c5059e-qq2br\" (UID: \"b51d3573-af2d-4813-ad48-73668757ede7\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-49c5059e-qq2br"
Oct 31 17:42:11.010244 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:11.010213    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9n92q\" (UniqueName: \"kubernetes.io/projected/b51d3573-af2d-4813-ad48-73668757ede7-kube-api-access-9n92q\") pod \"maas-api-revoke-sub-49c5059e-qq2br\" (UID: \"b51d3573-af2d-4813-ad48-73668757ede7\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-49c5059e-qq2br"
Oct 31 17:42:11.010481 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:11.010352    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/b51d3573-af2d-4813-ad48-73668757ede7-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-49c5059e-qq2br\" (UID: \"b51d3573-af2d-4813-ad48-73668757ede7\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-49c5059e-qq2br"
Oct 31 17:42:11.011282 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:11.011242    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/b51d3573-af2d-4813-ad48-73668757ede7-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-49c5059e-qq2br\" (UID: \"b51d3573-af2d-4813-ad48-73668757ede7\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-49c5059e-qq2br"
Oct 31 17:42:11.012983 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:11.012959    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/b51d3573-af2d-4813-ad48-73668757ede7-maas-api-xks-ca\") pod \"maas-api-revoke-sub-49c5059e-qq2br\" (UID: \"b51d3573-af2d-4813-ad48-73668757ede7\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-49c5059e-qq2br"
Oct 31 17:42:11.028509 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:11.028481    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9n92q\" (UniqueName: \"kubernetes.io/projected/b51d3573-af2d-4813-ad48-73668757ede7-kube-api-access-9n92q\") pod \"maas-api-revoke-sub-49c5059e-qq2br\" (UID: \"b51d3573-af2d-4813-ad48-73668757ede7\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-49c5059e-qq2br"
Oct 31 17:42:11.106503 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:11.106188    5003 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-49c5059e-qq2br"
Oct 31 17:42:11.135963 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:11.135930    5003 generic.go:356] "Generic (PLEG): container finished" podID="bcf651cc-ecd4-443c-b968-72575fc1174d" containerID="458cd5a65f3b3a97cebc555559782b4f80b0d7d6f8c4c50242f12bd61432f7cb" exitCode=0
Oct 31 17:42:11.136364 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:11.136136    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-e15c3d5b-79884" event={"ID":"bcf651cc-ecd4-443c-b968-72575fc1174d","Type":"ContainerDied","Data":"458cd5a65f3b3a97cebc555559782b4f80b0d7d6f8c4c50242f12bd61432f7cb"}
Oct 31 17:42:11.461215 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:11.459392    5003 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-49c5059e-qq2br"]
Oct 31 17:42:11.844357 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:11.844321    5003 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-5d29a9aa-6lrkh"]
Oct 31 17:42:11.850509 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:11.850479    5003 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-5d29a9aa-6lrkh"
Oct 31 17:42:11.867875 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:11.867847    5003 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-5d29a9aa-6lrkh"]
Oct 31 17:42:11.940978 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:11.940938    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9vhtl\" (UniqueName: \"kubernetes.io/projected/4bf9b794-ebb8-47f4-b084-e5f6ba0e6453-kube-api-access-9vhtl\") pod \"maas-api-revoke-sub-5d29a9aa-6lrkh\" (UID: \"4bf9b794-ebb8-47f4-b084-e5f6ba0e6453\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-5d29a9aa-6lrkh"
Oct 31 17:42:11.941460 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:11.941431    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/4bf9b794-ebb8-47f4-b084-e5f6ba0e6453-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-5d29a9aa-6lrkh\" (UID: \"4bf9b794-ebb8-47f4-b084-e5f6ba0e6453\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-5d29a9aa-6lrkh"
Oct 31 17:42:11.941703 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:11.941678    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/4bf9b794-ebb8-47f4-b084-e5f6ba0e6453-maas-api-xks-ca\") pod \"maas-api-revoke-sub-5d29a9aa-6lrkh\" (UID: \"4bf9b794-ebb8-47f4-b084-e5f6ba0e6453\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-5d29a9aa-6lrkh"
Oct 31 17:42:12.044984 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:12.044943    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9vhtl\" (UniqueName: \"kubernetes.io/projected/4bf9b794-ebb8-47f4-b084-e5f6ba0e6453-kube-api-access-9vhtl\") pod \"maas-api-revoke-sub-5d29a9aa-6lrkh\" (UID: \"4bf9b794-ebb8-47f4-b084-e5f6ba0e6453\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-5d29a9aa-6lrkh"
Oct 31 17:42:12.045180 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:12.045161    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/4bf9b794-ebb8-47f4-b084-e5f6ba0e6453-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-5d29a9aa-6lrkh\" (UID: \"4bf9b794-ebb8-47f4-b084-e5f6ba0e6453\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-5d29a9aa-6lrkh"
Oct 31 17:42:12.045262 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:12.045209    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/4bf9b794-ebb8-47f4-b084-e5f6ba0e6453-maas-api-xks-ca\") pod \"maas-api-revoke-sub-5d29a9aa-6lrkh\" (UID: \"4bf9b794-ebb8-47f4-b084-e5f6ba0e6453\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-5d29a9aa-6lrkh"
Oct 31 17:42:12.048762 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:12.048736    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/4bf9b794-ebb8-47f4-b084-e5f6ba0e6453-maas-api-xks-ca\") pod \"maas-api-revoke-sub-5d29a9aa-6lrkh\" (UID: \"4bf9b794-ebb8-47f4-b084-e5f6ba0e6453\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-5d29a9aa-6lrkh"
Oct 31 17:42:12.049170 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:12.049150    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/4bf9b794-ebb8-47f4-b084-e5f6ba0e6453-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-5d29a9aa-6lrkh\" (UID: \"4bf9b794-ebb8-47f4-b084-e5f6ba0e6453\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-5d29a9aa-6lrkh"
Oct 31 17:42:12.064331 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:12.064302    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9vhtl\" (UniqueName: \"kubernetes.io/projected/4bf9b794-ebb8-47f4-b084-e5f6ba0e6453-kube-api-access-9vhtl\") pod \"maas-api-revoke-sub-5d29a9aa-6lrkh\" (UID: \"4bf9b794-ebb8-47f4-b084-e5f6ba0e6453\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-5d29a9aa-6lrkh"
Oct 31 17:42:12.123738 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:12.123637    5003 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-b2xxw_f03611db-3bd9-401a-a137-1d4f691b51ea/console-operator/2.log"
Oct 31 17:42:12.124727 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:12.124702    5003 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-b2xxw_f03611db-3bd9-401a-a137-1d4f691b51ea/console-operator/2.log"
Oct 31 17:42:12.164114 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:12.164073    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-49c5059e-qq2br" event={"ID":"b51d3573-af2d-4813-ad48-73668757ede7","Type":"ContainerStarted","Data":"9032f86dbc1bf133f7166d4ae278c4f19d5040f47c913cbe1ef9646fcec5173c"}
Oct 31 17:42:12.164584 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:12.164163    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-49c5059e-qq2br" event={"ID":"b51d3573-af2d-4813-ad48-73668757ede7","Type":"ContainerStarted","Data":"1d6f46693165513f5af060ac0f0b4318c8b95615bd7d395613cf15b09434548c"}
Oct 31 17:42:12.168668 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:12.168630    5003 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-5d29a9aa-6lrkh"
Oct 31 17:42:12.209213 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:12.209128    5003 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-sub-49c5059e-qq2br" podStartSLOduration=2.209106135 podStartE2EDuration="2.209106135s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 17:42:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 17:42:12.201733432 +0000 UTC m=+900.456587989" watchObservedRunningTime="2026-10-31 17:42:12.209106135 +0000 UTC m=+900.463960679"
Oct 31 17:42:12.364328 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:12.364292    5003 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-e15c3d5b-79884"
Oct 31 17:42:12.462221 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:12.462193    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/bcf651cc-ecd4-443c-b968-72575fc1174d-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/bcf651cc-ecd4-443c-b968-72575fc1174d-maas-api-openshift-ca\") pod \"bcf651cc-ecd4-443c-b968-72575fc1174d\" (UID: \"bcf651cc-ecd4-443c-b968-72575fc1174d\") "
Oct 31 17:42:12.462584 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:12.462392    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/bcf651cc-ecd4-443c-b968-72575fc1174d-kube-api-access-7jnhm\" (UniqueName: \"kubernetes.io/projected/bcf651cc-ecd4-443c-b968-72575fc1174d-kube-api-access-7jnhm\") pod \"bcf651cc-ecd4-443c-b968-72575fc1174d\" (UID: \"bcf651cc-ecd4-443c-b968-72575fc1174d\") "
Oct 31 17:42:12.462584 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:12.462505    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/bcf651cc-ecd4-443c-b968-72575fc1174d-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/bcf651cc-ecd4-443c-b968-72575fc1174d-maas-api-xks-ca\") pod \"bcf651cc-ecd4-443c-b968-72575fc1174d\" (UID: \"bcf651cc-ecd4-443c-b968-72575fc1174d\") "
Oct 31 17:42:12.462584 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:12.462562    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bcf651cc-ecd4-443c-b968-72575fc1174d-maas-api-openshift-ca" pod "bcf651cc-ecd4-443c-b968-72575fc1174d" (UID: "bcf651cc-ecd4-443c-b968-72575fc1174d"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 17:42:12.463481 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:12.463454    5003 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/bcf651cc-ecd4-443c-b968-72575fc1174d-maas-api-openshift-ca\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:42:12.466424 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:12.466390    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bcf651cc-ecd4-443c-b968-72575fc1174d-kube-api-access-7jnhm" pod "bcf651cc-ecd4-443c-b968-72575fc1174d" (UID: "bcf651cc-ecd4-443c-b968-72575fc1174d"). InnerVolumeSpecName "kube-api-access-7jnhm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 17:42:12.466511 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:12.466417    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bcf651cc-ecd4-443c-b968-72575fc1174d-maas-api-xks-ca" pod "bcf651cc-ecd4-443c-b968-72575fc1174d" (UID: "bcf651cc-ecd4-443c-b968-72575fc1174d"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 17:42:12.488536 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:12.488495    5003 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-5d29a9aa-6lrkh"]
Oct 31 17:42:12.508714 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:42:12.508682    5003 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4bf9b794_ebb8_47f4_b084_e5f6ba0e6453.slice/crio-8d77437f220f5e51177c010333dae0539318db9aaf4783878dc8497ab2371b4c WatchSource:0}: Error finding container 8d77437f220f5e51177c010333dae0539318db9aaf4783878dc8497ab2371b4c: Status 404 returned error can't find the container with id 8d77437f220f5e51177c010333dae0539318db9aaf4783878dc8497ab2371b4c
Oct 31 17:42:12.565228 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:12.565202    5003 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7jnhm\" (UniqueName: \"kubernetes.io/projected/bcf651cc-ecd4-443c-b968-72575fc1174d-kube-api-access-7jnhm\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:42:12.565228 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:12.565229    5003 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/bcf651cc-ecd4-443c-b968-72575fc1174d-maas-api-xks-ca\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:42:12.701253 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:12.701219    5003 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w2-5c446c/premium-w2-5c446c-kserve-66f7486c85-f7lk2" podUID="9c2ddfab-2348-4bb0-8844-1fca62460390" containerName="main" containerID="cri-o://37d78a6b655ea6e4b8252c8c9a5560e084763d2c2a442284252794fa79dc9f66" gracePeriod=45
Oct 31 17:42:12.791063 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:12.791021    5003 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-5c446c/premium-w2-5c446c-kserve-66f7486c85-f7lk2" podUID="9c2ddfab-2348-4bb0-8844-1fca62460390" containerName="main" probeResult="failure" output="Get \"https://10.132.0.75:8000/ready\": dial tcp 10.132.0.75:8000: connect: connection refused"
Oct 31 17:42:12.916772 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:12.916729    5003 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w1-0e59ca/simulator-w1-0e59ca-kserve-999765679-zs7kh"]
Oct 31 17:42:12.974428 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:12.974404    5003 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w2-5c446c/premium-w2-5c446c-kserve-66f7486c85-f7lk2"
Oct 31 17:42:13.072684 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:13.072630    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9c2ddfab-2348-4bb0-8844-1fca62460390-home\" (UniqueName: \"kubernetes.io/empty-dir/9c2ddfab-2348-4bb0-8844-1fca62460390-home\") pod \"9c2ddfab-2348-4bb0-8844-1fca62460390\" (UID: \"9c2ddfab-2348-4bb0-8844-1fca62460390\") "
Oct 31 17:42:13.072875 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:13.072716    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9c2ddfab-2348-4bb0-8844-1fca62460390-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9c2ddfab-2348-4bb0-8844-1fca62460390-tmp-dir\") pod \"9c2ddfab-2348-4bb0-8844-1fca62460390\" (UID: \"9c2ddfab-2348-4bb0-8844-1fca62460390\") "
Oct 31 17:42:13.072875 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:13.072798    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9c2ddfab-2348-4bb0-8844-1fca62460390-dshm\" (UniqueName: \"kubernetes.io/empty-dir/9c2ddfab-2348-4bb0-8844-1fca62460390-dshm\") pod \"9c2ddfab-2348-4bb0-8844-1fca62460390\" (UID: \"9c2ddfab-2348-4bb0-8844-1fca62460390\") "
Oct 31 17:42:13.073019 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:13.072924    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9c2ddfab-2348-4bb0-8844-1fca62460390-home" pod "9c2ddfab-2348-4bb0-8844-1fca62460390" (UID: "9c2ddfab-2348-4bb0-8844-1fca62460390"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 17:42:13.073019 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:13.072958    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/9c2ddfab-2348-4bb0-8844-1fca62460390-kube-api-access-gzmxc\" (UniqueName: \"kubernetes.io/projected/9c2ddfab-2348-4bb0-8844-1fca62460390-kube-api-access-gzmxc\") pod \"9c2ddfab-2348-4bb0-8844-1fca62460390\" (UID: \"9c2ddfab-2348-4bb0-8844-1fca62460390\") "
Oct 31 17:42:13.073019 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:13.073003    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9c2ddfab-2348-4bb0-8844-1fca62460390-tmp-dir" pod "9c2ddfab-2348-4bb0-8844-1fca62460390" (UID: "9c2ddfab-2348-4bb0-8844-1fca62460390"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 17:42:13.073182 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:13.073014    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9c2ddfab-2348-4bb0-8844-1fca62460390-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9c2ddfab-2348-4bb0-8844-1fca62460390-model-cache\") pod \"9c2ddfab-2348-4bb0-8844-1fca62460390\" (UID: \"9c2ddfab-2348-4bb0-8844-1fca62460390\") "
Oct 31 17:42:13.073182 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:13.073111    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/9c2ddfab-2348-4bb0-8844-1fca62460390-tls-certs\" (UniqueName: \"kubernetes.io/secret/9c2ddfab-2348-4bb0-8844-1fca62460390-tls-certs\") pod \"9c2ddfab-2348-4bb0-8844-1fca62460390\" (UID: \"9c2ddfab-2348-4bb0-8844-1fca62460390\") "
Oct 31 17:42:13.073292 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:13.073231    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9c2ddfab-2348-4bb0-8844-1fca62460390-model-cache" pod "9c2ddfab-2348-4bb0-8844-1fca62460390" (UID: "9c2ddfab-2348-4bb0-8844-1fca62460390"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 17:42:13.074011 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:13.073987    5003 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9c2ddfab-2348-4bb0-8844-1fca62460390-model-cache\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:42:13.074011 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:13.074013    5003 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9c2ddfab-2348-4bb0-8844-1fca62460390-home\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:42:13.074200 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:13.074028    5003 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9c2ddfab-2348-4bb0-8844-1fca62460390-tmp-dir\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:42:13.076079 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:13.076051    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9c2ddfab-2348-4bb0-8844-1fca62460390-dshm" pod "9c2ddfab-2348-4bb0-8844-1fca62460390" (UID: "9c2ddfab-2348-4bb0-8844-1fca62460390"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 17:42:13.076293 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:13.076264    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9c2ddfab-2348-4bb0-8844-1fca62460390-tls-certs" pod "9c2ddfab-2348-4bb0-8844-1fca62460390" (UID: "9c2ddfab-2348-4bb0-8844-1fca62460390"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 17:42:13.076429 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:13.076408    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9c2ddfab-2348-4bb0-8844-1fca62460390-kube-api-access-gzmxc" pod "9c2ddfab-2348-4bb0-8844-1fca62460390" (UID: "9c2ddfab-2348-4bb0-8844-1fca62460390"). InnerVolumeSpecName "kube-api-access-gzmxc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 17:42:13.175191 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:13.175159    5003 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-e15c3d5b-79884"
Oct 31 17:42:13.175191 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:13.175182    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-e15c3d5b-79884" event={"ID":"bcf651cc-ecd4-443c-b968-72575fc1174d","Type":"ContainerDied","Data":"777d98d0ee2b8991b9759b87d62317872c4e2a13fddea905c249ea3531bb0559"}
Oct 31 17:42:13.175697 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:13.175233    5003 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9c2ddfab-2348-4bb0-8844-1fca62460390-dshm\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:42:13.175697 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:13.175240    5003 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="777d98d0ee2b8991b9759b87d62317872c4e2a13fddea905c249ea3531bb0559"
Oct 31 17:42:13.175697 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:13.175250    5003 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gzmxc\" (UniqueName: \"kubernetes.io/projected/9c2ddfab-2348-4bb0-8844-1fca62460390-kube-api-access-gzmxc\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:42:13.175697 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:13.175262    5003 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9c2ddfab-2348-4bb0-8844-1fca62460390-tls-certs\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:42:13.176887 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:13.176864    5003 generic.go:356] "Generic (PLEG): container finished" podID="9c2ddfab-2348-4bb0-8844-1fca62460390" containerID="37d78a6b655ea6e4b8252c8c9a5560e084763d2c2a442284252794fa79dc9f66" exitCode=0
Oct 31 17:42:13.176982 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:13.176899    5003 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w2-5c446c/premium-w2-5c446c-kserve-66f7486c85-f7lk2"
Oct 31 17:42:13.176982 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:13.176918    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w2-5c446c/premium-w2-5c446c-kserve-66f7486c85-f7lk2" event={"ID":"9c2ddfab-2348-4bb0-8844-1fca62460390","Type":"ContainerDied","Data":"37d78a6b655ea6e4b8252c8c9a5560e084763d2c2a442284252794fa79dc9f66"}
Oct 31 17:42:13.176982 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:13.176968    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w2-5c446c/premium-w2-5c446c-kserve-66f7486c85-f7lk2" event={"ID":"9c2ddfab-2348-4bb0-8844-1fca62460390","Type":"ContainerDied","Data":"79d809d0a371ad14025c0512f06192d8e8b4c38470b0a905c60c7a97ef951a5a"}
Oct 31 17:42:13.177131 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:13.176991    5003 scope.go:122] "RemoveContainer" containerID="37d78a6b655ea6e4b8252c8c9a5560e084763d2c2a442284252794fa79dc9f66"
Oct 31 17:42:13.179282 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:13.179255    5003 generic.go:356] "Generic (PLEG): container finished" podID="b51d3573-af2d-4813-ad48-73668757ede7" containerID="9032f86dbc1bf133f7166d4ae278c4f19d5040f47c913cbe1ef9646fcec5173c" exitCode=0
Oct 31 17:42:13.179401 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:13.179315    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-49c5059e-qq2br" event={"ID":"b51d3573-af2d-4813-ad48-73668757ede7","Type":"ContainerDied","Data":"9032f86dbc1bf133f7166d4ae278c4f19d5040f47c913cbe1ef9646fcec5173c"}
Oct 31 17:42:13.181208 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:13.181185    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-5d29a9aa-6lrkh" event={"ID":"4bf9b794-ebb8-47f4-b084-e5f6ba0e6453","Type":"ContainerStarted","Data":"b7506511188232a55fa210f4e14080cc026e8bbd859d9f1f307284b68ae6a191"}
Oct 31 17:42:13.181345 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:13.181231    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-5d29a9aa-6lrkh" event={"ID":"4bf9b794-ebb8-47f4-b084-e5f6ba0e6453","Type":"ContainerStarted","Data":"8d77437f220f5e51177c010333dae0539318db9aaf4783878dc8497ab2371b4c"}
Oct 31 17:42:13.193412 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:13.193396    5003 scope.go:122] "RemoveContainer" containerID="37d78a6b655ea6e4b8252c8c9a5560e084763d2c2a442284252794fa79dc9f66"
Oct 31 17:42:13.193755 ip-10-0-138-17 kubenswrapper[5003]: E1031 17:42:13.193730    5003 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"37d78a6b655ea6e4b8252c8c9a5560e084763d2c2a442284252794fa79dc9f66\": container with ID starting with 37d78a6b655ea6e4b8252c8c9a5560e084763d2c2a442284252794fa79dc9f66 not found: ID does not exist" containerID="37d78a6b655ea6e4b8252c8c9a5560e084763d2c2a442284252794fa79dc9f66"
Oct 31 17:42:13.193873 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:13.193763    5003 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"37d78a6b655ea6e4b8252c8c9a5560e084763d2c2a442284252794fa79dc9f66"} err="failed to get container status \"37d78a6b655ea6e4b8252c8c9a5560e084763d2c2a442284252794fa79dc9f66\": rpc error: code = NotFound desc = could not find container \"37d78a6b655ea6e4b8252c8c9a5560e084763d2c2a442284252794fa79dc9f66\": container with ID starting with 37d78a6b655ea6e4b8252c8c9a5560e084763d2c2a442284252794fa79dc9f66 not found: ID does not exist"
Oct 31 17:42:13.265227 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:13.264422    5003 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-sub-5d29a9aa-6lrkh" podStartSLOduration=2.2644018470000002 podStartE2EDuration="2.264401847s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 17:42:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 17:42:13.263141358 +0000 UTC m=+901.517995899" watchObservedRunningTime="2026-10-31 17:42:13.264401847 +0000 UTC m=+901.519256431"
Oct 31 17:42:13.304084 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:13.304052    5003 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w2-5c446c/premium-w2-5c446c-kserve-66f7486c85-f7lk2"]
Oct 31 17:42:13.309312 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:13.309286    5003 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w2-5c446c/premium-w2-5c446c-kserve-66f7486c85-f7lk2"]
Oct 31 17:42:13.896001 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:13.895967    5003 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="9c2ddfab-2348-4bb0-8844-1fca62460390" path="/var/lib/kubelet/pods/9c2ddfab-2348-4bb0-8844-1fca62460390/volumes"
Oct 31 17:42:14.200285 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:14.200192    5003 generic.go:356] "Generic (PLEG): container finished" podID="4bf9b794-ebb8-47f4-b084-e5f6ba0e6453" containerID="b7506511188232a55fa210f4e14080cc026e8bbd859d9f1f307284b68ae6a191" exitCode=0
Oct 31 17:42:14.200946 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:14.200284    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-5d29a9aa-6lrkh" event={"ID":"4bf9b794-ebb8-47f4-b084-e5f6ba0e6453","Type":"ContainerDied","Data":"b7506511188232a55fa210f4e14080cc026e8bbd859d9f1f307284b68ae6a191"}
Oct 31 17:42:14.250044 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:14.249962    5003 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-worker-w3-cf0a86-c788d8d8f-r22w9" podUID="7804a34f-1c95-4057-8131-39e8bec72e57" containerName="payload-processing" containerID="cri-o://e62cc85dcfe147870753f54ee06f3070b37a30ab64836a6e78ed1b0c56e41593" gracePeriod=25
Oct 31 17:42:14.384473 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:14.384446    5003 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-49c5059e-qq2br"
Oct 31 17:42:14.497681 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:14.497562    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/b51d3573-af2d-4813-ad48-73668757ede7-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/b51d3573-af2d-4813-ad48-73668757ede7-maas-api-xks-ca\") pod \"b51d3573-af2d-4813-ad48-73668757ede7\" (UID: \"b51d3573-af2d-4813-ad48-73668757ede7\") "
Oct 31 17:42:14.497834 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:14.497792    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/b51d3573-af2d-4813-ad48-73668757ede7-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/b51d3573-af2d-4813-ad48-73668757ede7-maas-api-openshift-ca\") pod \"b51d3573-af2d-4813-ad48-73668757ede7\" (UID: \"b51d3573-af2d-4813-ad48-73668757ede7\") "
Oct 31 17:42:14.497937 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:14.497922    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/b51d3573-af2d-4813-ad48-73668757ede7-kube-api-access-9n92q\" (UniqueName: \"kubernetes.io/projected/b51d3573-af2d-4813-ad48-73668757ede7-kube-api-access-9n92q\") pod \"b51d3573-af2d-4813-ad48-73668757ede7\" (UID: \"b51d3573-af2d-4813-ad48-73668757ede7\") "
Oct 31 17:42:14.498261 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:14.498229    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b51d3573-af2d-4813-ad48-73668757ede7-maas-api-openshift-ca" pod "b51d3573-af2d-4813-ad48-73668757ede7" (UID: "b51d3573-af2d-4813-ad48-73668757ede7"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 17:42:14.498594 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:14.498574    5003 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/b51d3573-af2d-4813-ad48-73668757ede7-maas-api-openshift-ca\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:42:14.500060 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:14.499929    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b51d3573-af2d-4813-ad48-73668757ede7-maas-api-xks-ca" pod "b51d3573-af2d-4813-ad48-73668757ede7" (UID: "b51d3573-af2d-4813-ad48-73668757ede7"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 17:42:14.500360 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:14.500337    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b51d3573-af2d-4813-ad48-73668757ede7-kube-api-access-9n92q" pod "b51d3573-af2d-4813-ad48-73668757ede7" (UID: "b51d3573-af2d-4813-ad48-73668757ede7"). InnerVolumeSpecName "kube-api-access-9n92q". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 17:42:14.599752 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:14.599718    5003 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/b51d3573-af2d-4813-ad48-73668757ede7-maas-api-xks-ca\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:42:14.599752 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:14.599750    5003 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9n92q\" (UniqueName: \"kubernetes.io/projected/b51d3573-af2d-4813-ad48-73668757ede7-kube-api-access-9n92q\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:42:14.679092 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:14.679057    5003 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-271db076-dn2gx"]
Oct 31 17:42:14.680043 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:14.680019    5003 cpu_manager.go:414] "containerMap: removing container" podUID="b51d3573-af2d-4813-ad48-73668757ede7" containerName="revoke-keys"
Oct 31 17:42:14.680043 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:14.680041    5003 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="b51d3573-af2d-4813-ad48-73668757ede7" containerName="revoke-keys"
Oct 31 17:42:14.680190 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:14.680060    5003 cpu_manager.go:414] "containerMap: removing container" podUID="bcf651cc-ecd4-443c-b968-72575fc1174d" containerName="revoke-keys"
Oct 31 17:42:14.680190 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:14.680066    5003 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="bcf651cc-ecd4-443c-b968-72575fc1174d" containerName="revoke-keys"
Oct 31 17:42:14.680190 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:14.680086    5003 cpu_manager.go:414] "containerMap: removing container" podUID="9c2ddfab-2348-4bb0-8844-1fca62460390" containerName="main"
Oct 31 17:42:14.680190 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:14.680091    5003 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="9c2ddfab-2348-4bb0-8844-1fca62460390" containerName="main"
Oct 31 17:42:14.680190 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:14.680191    5003 memory_manager.go:365] "RemoveStaleState removing state" podUID="b51d3573-af2d-4813-ad48-73668757ede7" containerName="revoke-keys"
Oct 31 17:42:14.680346 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:14.680201    5003 memory_manager.go:365] "RemoveStaleState removing state" podUID="bcf651cc-ecd4-443c-b968-72575fc1174d" containerName="revoke-keys"
Oct 31 17:42:14.680346 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:14.680210    5003 memory_manager.go:365] "RemoveStaleState removing state" podUID="9c2ddfab-2348-4bb0-8844-1fca62460390" containerName="main"
Oct 31 17:42:14.684761 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:14.684735    5003 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-271db076-dn2gx"
Oct 31 17:42:14.708097 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:14.708061    5003 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-271db076-dn2gx"]
Oct 31 17:42:14.805207 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:14.805115    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/7984ecfd-fc9a-4343-aae8-8c35b9bae263-maas-api-xks-ca\") pod \"maas-api-revoke-sub-271db076-dn2gx\" (UID: \"7984ecfd-fc9a-4343-aae8-8c35b9bae263\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-271db076-dn2gx"
Oct 31 17:42:14.805371 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:14.805349    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n8rz6\" (UniqueName: \"kubernetes.io/projected/7984ecfd-fc9a-4343-aae8-8c35b9bae263-kube-api-access-n8rz6\") pod \"maas-api-revoke-sub-271db076-dn2gx\" (UID: \"7984ecfd-fc9a-4343-aae8-8c35b9bae263\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-271db076-dn2gx"
Oct 31 17:42:14.805413 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:14.805399    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/7984ecfd-fc9a-4343-aae8-8c35b9bae263-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-271db076-dn2gx\" (UID: \"7984ecfd-fc9a-4343-aae8-8c35b9bae263\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-271db076-dn2gx"
Oct 31 17:42:14.907266 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:14.907227    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n8rz6\" (UniqueName: \"kubernetes.io/projected/7984ecfd-fc9a-4343-aae8-8c35b9bae263-kube-api-access-n8rz6\") pod \"maas-api-revoke-sub-271db076-dn2gx\" (UID: \"7984ecfd-fc9a-4343-aae8-8c35b9bae263\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-271db076-dn2gx"
Oct 31 17:42:14.907459 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:14.907300    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/7984ecfd-fc9a-4343-aae8-8c35b9bae263-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-271db076-dn2gx\" (UID: \"7984ecfd-fc9a-4343-aae8-8c35b9bae263\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-271db076-dn2gx"
Oct 31 17:42:14.907531 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:14.907500    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/7984ecfd-fc9a-4343-aae8-8c35b9bae263-maas-api-xks-ca\") pod \"maas-api-revoke-sub-271db076-dn2gx\" (UID: \"7984ecfd-fc9a-4343-aae8-8c35b9bae263\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-271db076-dn2gx"
Oct 31 17:42:14.908456 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:14.908425    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/7984ecfd-fc9a-4343-aae8-8c35b9bae263-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-271db076-dn2gx\" (UID: \"7984ecfd-fc9a-4343-aae8-8c35b9bae263\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-271db076-dn2gx"
Oct 31 17:42:14.910536 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:14.910508    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/7984ecfd-fc9a-4343-aae8-8c35b9bae263-maas-api-xks-ca\") pod \"maas-api-revoke-sub-271db076-dn2gx\" (UID: \"7984ecfd-fc9a-4343-aae8-8c35b9bae263\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-271db076-dn2gx"
Oct 31 17:42:14.925469 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:14.925435    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n8rz6\" (UniqueName: \"kubernetes.io/projected/7984ecfd-fc9a-4343-aae8-8c35b9bae263-kube-api-access-n8rz6\") pod \"maas-api-revoke-sub-271db076-dn2gx\" (UID: \"7984ecfd-fc9a-4343-aae8-8c35b9bae263\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-271db076-dn2gx"
Oct 31 17:42:15.012248 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:15.012213    5003 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-271db076-dn2gx"
Oct 31 17:42:15.221785 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:15.221734    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-49c5059e-qq2br" event={"ID":"b51d3573-af2d-4813-ad48-73668757ede7","Type":"ContainerDied","Data":"1d6f46693165513f5af060ac0f0b4318c8b95615bd7d395613cf15b09434548c"}
Oct 31 17:42:15.221785 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:15.221786    5003 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-49c5059e-qq2br"
Oct 31 17:42:15.222379 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:15.221829    5003 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1d6f46693165513f5af060ac0f0b4318c8b95615bd7d395613cf15b09434548c"
Oct 31 17:42:15.347052 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:15.346961    5003 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-271db076-dn2gx"]
Oct 31 17:42:15.452813 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:15.452785    5003 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-5d29a9aa-6lrkh"
Oct 31 17:42:15.523661 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:15.523613    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/4bf9b794-ebb8-47f4-b084-e5f6ba0e6453-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/4bf9b794-ebb8-47f4-b084-e5f6ba0e6453-maas-api-xks-ca\") pod \"4bf9b794-ebb8-47f4-b084-e5f6ba0e6453\" (UID: \"4bf9b794-ebb8-47f4-b084-e5f6ba0e6453\") "
Oct 31 17:42:15.523861 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:15.523736    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/4bf9b794-ebb8-47f4-b084-e5f6ba0e6453-kube-api-access-9vhtl\" (UniqueName: \"kubernetes.io/projected/4bf9b794-ebb8-47f4-b084-e5f6ba0e6453-kube-api-access-9vhtl\") pod \"4bf9b794-ebb8-47f4-b084-e5f6ba0e6453\" (UID: \"4bf9b794-ebb8-47f4-b084-e5f6ba0e6453\") "
Oct 31 17:42:15.523935 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:15.523901    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/4bf9b794-ebb8-47f4-b084-e5f6ba0e6453-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/4bf9b794-ebb8-47f4-b084-e5f6ba0e6453-maas-api-openshift-ca\") pod \"4bf9b794-ebb8-47f4-b084-e5f6ba0e6453\" (UID: \"4bf9b794-ebb8-47f4-b084-e5f6ba0e6453\") "
Oct 31 17:42:15.524307 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:15.524274    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4bf9b794-ebb8-47f4-b084-e5f6ba0e6453-maas-api-openshift-ca" pod "4bf9b794-ebb8-47f4-b084-e5f6ba0e6453" (UID: "4bf9b794-ebb8-47f4-b084-e5f6ba0e6453"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 17:42:15.524823 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:15.524793    5003 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/4bf9b794-ebb8-47f4-b084-e5f6ba0e6453-maas-api-openshift-ca\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:42:15.525979 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:15.525948    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4bf9b794-ebb8-47f4-b084-e5f6ba0e6453-maas-api-xks-ca" pod "4bf9b794-ebb8-47f4-b084-e5f6ba0e6453" (UID: "4bf9b794-ebb8-47f4-b084-e5f6ba0e6453"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 17:42:15.526164 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:15.526141    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4bf9b794-ebb8-47f4-b084-e5f6ba0e6453-kube-api-access-9vhtl" pod "4bf9b794-ebb8-47f4-b084-e5f6ba0e6453" (UID: "4bf9b794-ebb8-47f4-b084-e5f6ba0e6453"). InnerVolumeSpecName "kube-api-access-9vhtl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 17:42:15.626468 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:15.626391    5003 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/4bf9b794-ebb8-47f4-b084-e5f6ba0e6453-maas-api-xks-ca\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:42:15.626605 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:15.626466    5003 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9vhtl\" (UniqueName: \"kubernetes.io/projected/4bf9b794-ebb8-47f4-b084-e5f6ba0e6453-kube-api-access-9vhtl\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:42:16.232071 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:16.231974    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-271db076-dn2gx" event={"ID":"7984ecfd-fc9a-4343-aae8-8c35b9bae263","Type":"ContainerStarted","Data":"9917a5d62a4f015c359df9b23c7fc35377c62c61a9b250bd8c8f88fbf2315341"}
Oct 31 17:42:16.232514 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:16.232077    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-271db076-dn2gx" event={"ID":"7984ecfd-fc9a-4343-aae8-8c35b9bae263","Type":"ContainerStarted","Data":"e369e7528a85d2067cc38c743f8febcf3b089a37930e0cf0fb294a81dbfd08fa"}
Oct 31 17:42:16.233397 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:16.233374    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-5d29a9aa-6lrkh" event={"ID":"4bf9b794-ebb8-47f4-b084-e5f6ba0e6453","Type":"ContainerDied","Data":"8d77437f220f5e51177c010333dae0539318db9aaf4783878dc8497ab2371b4c"}
Oct 31 17:42:16.233475 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:16.233404    5003 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-5d29a9aa-6lrkh"
Oct 31 17:42:16.233475 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:16.233413    5003 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8d77437f220f5e51177c010333dae0539318db9aaf4783878dc8497ab2371b4c"
Oct 31 17:42:16.269301 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:16.269244    5003 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-sub-271db076-dn2gx" podStartSLOduration=2.2692254 podStartE2EDuration="2.2692254s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 17:42:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 17:42:16.267830494 +0000 UTC m=+904.522685051" watchObservedRunningTime="2026-10-31 17:42:16.2692254 +0000 UTC m=+904.524079945"
Oct 31 17:42:17.243430 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:17.243395    5003 generic.go:356] "Generic (PLEG): container finished" podID="7984ecfd-fc9a-4343-aae8-8c35b9bae263" containerID="9917a5d62a4f015c359df9b23c7fc35377c62c61a9b250bd8c8f88fbf2315341" exitCode=0
Oct 31 17:42:17.243892 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:17.243484    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-271db076-dn2gx" event={"ID":"7984ecfd-fc9a-4343-aae8-8c35b9bae263","Type":"ContainerDied","Data":"9917a5d62a4f015c359df9b23c7fc35377c62c61a9b250bd8c8f88fbf2315341"}
Oct 31 17:42:17.334454 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:17.334414    5003 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-processing-e2e-worker-w2-5c446c-7c8d75cf57-px9mc" podUID="69ade7b0-0eb9-4426-901e-9bb7acdf1c1f" containerName="payload-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 31 17:42:18.339557 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:18.339521    5003 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-5c446c-748954c4f5-9xwrq" podUID="801db2fa-c695-4267-a534-5a024d355c57" containerName="payload-pre-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 31 17:42:18.485506 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:18.485477    5003 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-271db076-dn2gx"
Oct 31 17:42:18.572070 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:18.572038    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/7984ecfd-fc9a-4343-aae8-8c35b9bae263-kube-api-access-n8rz6\" (UniqueName: \"kubernetes.io/projected/7984ecfd-fc9a-4343-aae8-8c35b9bae263-kube-api-access-n8rz6\") pod \"7984ecfd-fc9a-4343-aae8-8c35b9bae263\" (UID: \"7984ecfd-fc9a-4343-aae8-8c35b9bae263\") "
Oct 31 17:42:18.572274 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:18.572148    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/7984ecfd-fc9a-4343-aae8-8c35b9bae263-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/7984ecfd-fc9a-4343-aae8-8c35b9bae263-maas-api-xks-ca\") pod \"7984ecfd-fc9a-4343-aae8-8c35b9bae263\" (UID: \"7984ecfd-fc9a-4343-aae8-8c35b9bae263\") "
Oct 31 17:42:18.572274 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:18.572183    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/7984ecfd-fc9a-4343-aae8-8c35b9bae263-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/7984ecfd-fc9a-4343-aae8-8c35b9bae263-maas-api-openshift-ca\") pod \"7984ecfd-fc9a-4343-aae8-8c35b9bae263\" (UID: \"7984ecfd-fc9a-4343-aae8-8c35b9bae263\") "
Oct 31 17:42:18.572886 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:18.572855    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7984ecfd-fc9a-4343-aae8-8c35b9bae263-maas-api-openshift-ca" pod "7984ecfd-fc9a-4343-aae8-8c35b9bae263" (UID: "7984ecfd-fc9a-4343-aae8-8c35b9bae263"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 17:42:18.574589 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:18.574558    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7984ecfd-fc9a-4343-aae8-8c35b9bae263-maas-api-xks-ca" pod "7984ecfd-fc9a-4343-aae8-8c35b9bae263" (UID: "7984ecfd-fc9a-4343-aae8-8c35b9bae263"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 17:42:18.575114 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:18.575088    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7984ecfd-fc9a-4343-aae8-8c35b9bae263-kube-api-access-n8rz6" pod "7984ecfd-fc9a-4343-aae8-8c35b9bae263" (UID: "7984ecfd-fc9a-4343-aae8-8c35b9bae263"). InnerVolumeSpecName "kube-api-access-n8rz6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 17:42:18.674433 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:18.674390    5003 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n8rz6\" (UniqueName: \"kubernetes.io/projected/7984ecfd-fc9a-4343-aae8-8c35b9bae263-kube-api-access-n8rz6\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:42:18.674433 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:18.674429    5003 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/7984ecfd-fc9a-4343-aae8-8c35b9bae263-maas-api-xks-ca\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:42:18.674433 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:18.674439    5003 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/7984ecfd-fc9a-4343-aae8-8c35b9bae263-maas-api-openshift-ca\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:42:18.721002 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:18.720961    5003 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w1-0e59ca-6c6556b595-dq7d4"]
Oct 31 17:42:19.264097 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:19.264068    5003 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-271db076-dn2gx"
Oct 31 17:42:19.264279 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:19.264108    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-271db076-dn2gx" event={"ID":"7984ecfd-fc9a-4343-aae8-8c35b9bae263","Type":"ContainerDied","Data":"e369e7528a85d2067cc38c743f8febcf3b089a37930e0cf0fb294a81dbfd08fa"}
Oct 31 17:42:19.264279 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:19.264163    5003 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e369e7528a85d2067cc38c743f8febcf3b089a37930e0cf0fb294a81dbfd08fa"
Oct 31 17:42:19.721683 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:19.721610    5003 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w5-b78c31-8tlpl"]
Oct 31 17:42:19.722413 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:19.722391    5003 cpu_manager.go:414] "containerMap: removing container" podUID="4bf9b794-ebb8-47f4-b084-e5f6ba0e6453" containerName="revoke-keys"
Oct 31 17:42:19.722413 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:19.722409    5003 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="4bf9b794-ebb8-47f4-b084-e5f6ba0e6453" containerName="revoke-keys"
Oct 31 17:42:19.722610 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:19.722444    5003 cpu_manager.go:414] "containerMap: removing container" podUID="7984ecfd-fc9a-4343-aae8-8c35b9bae263" containerName="revoke-keys"
Oct 31 17:42:19.722610 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:19.722449    5003 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="7984ecfd-fc9a-4343-aae8-8c35b9bae263" containerName="revoke-keys"
Oct 31 17:42:19.722610 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:19.722550    5003 memory_manager.go:365] "RemoveStaleState removing state" podUID="4bf9b794-ebb8-47f4-b084-e5f6ba0e6453" containerName="revoke-keys"
Oct 31 17:42:19.722610 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:19.722564    5003 memory_manager.go:365] "RemoveStaleState removing state" podUID="7984ecfd-fc9a-4343-aae8-8c35b9bae263" containerName="revoke-keys"
Oct 31 17:42:19.726823 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:19.726804    5003 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w5-b78c31-8tlpl"
Oct 31 17:42:19.743389 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:19.743354    5003 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w5-b78c31-8tlpl"]
Oct 31 17:42:19.748380 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:19.748353    5003 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\""
Oct 31 17:42:19.748586 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:19.748436    5003 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-mr9x2\""
Oct 31 17:42:19.800604 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:19.800565    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/8c4070da-49cf-4158-b6fe-4b6ea0cc5ea2-maas-api-xks-ca\") pod \"maas-api-revoke-keys-e2e-worker-w5-b78c31-8tlpl\" (UID: \"8c4070da-49cf-4158-b6fe-4b6ea0cc5ea2\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w5-b78c31-8tlpl"
Oct 31 17:42:19.800853 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:19.800832    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/8c4070da-49cf-4158-b6fe-4b6ea0cc5ea2-maas-api-openshift-ca\") pod \"maas-api-revoke-keys-e2e-worker-w5-b78c31-8tlpl\" (UID: \"8c4070da-49cf-4158-b6fe-4b6ea0cc5ea2\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w5-b78c31-8tlpl"
Oct 31 17:42:19.801048 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:19.801029    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gn6rs\" (UniqueName: \"kubernetes.io/projected/8c4070da-49cf-4158-b6fe-4b6ea0cc5ea2-kube-api-access-gn6rs\") pod \"maas-api-revoke-keys-e2e-worker-w5-b78c31-8tlpl\" (UID: \"8c4070da-49cf-4158-b6fe-4b6ea0cc5ea2\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w5-b78c31-8tlpl"
Oct 31 17:42:19.902918 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:19.902879    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gn6rs\" (UniqueName: \"kubernetes.io/projected/8c4070da-49cf-4158-b6fe-4b6ea0cc5ea2-kube-api-access-gn6rs\") pod \"maas-api-revoke-keys-e2e-worker-w5-b78c31-8tlpl\" (UID: \"8c4070da-49cf-4158-b6fe-4b6ea0cc5ea2\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w5-b78c31-8tlpl"
Oct 31 17:42:19.903118 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:19.903004    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/8c4070da-49cf-4158-b6fe-4b6ea0cc5ea2-maas-api-xks-ca\") pod \"maas-api-revoke-keys-e2e-worker-w5-b78c31-8tlpl\" (UID: \"8c4070da-49cf-4158-b6fe-4b6ea0cc5ea2\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w5-b78c31-8tlpl"
Oct 31 17:42:19.903195 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:19.903166    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/8c4070da-49cf-4158-b6fe-4b6ea0cc5ea2-maas-api-openshift-ca\") pod \"maas-api-revoke-keys-e2e-worker-w5-b78c31-8tlpl\" (UID: \"8c4070da-49cf-4158-b6fe-4b6ea0cc5ea2\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w5-b78c31-8tlpl"
Oct 31 17:42:19.904703 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:19.904663    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/8c4070da-49cf-4158-b6fe-4b6ea0cc5ea2-maas-api-openshift-ca\") pod \"maas-api-revoke-keys-e2e-worker-w5-b78c31-8tlpl\" (UID: \"8c4070da-49cf-4158-b6fe-4b6ea0cc5ea2\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w5-b78c31-8tlpl"
Oct 31 17:42:19.907343 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:19.907315    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/8c4070da-49cf-4158-b6fe-4b6ea0cc5ea2-maas-api-xks-ca\") pod \"maas-api-revoke-keys-e2e-worker-w5-b78c31-8tlpl\" (UID: \"8c4070da-49cf-4158-b6fe-4b6ea0cc5ea2\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w5-b78c31-8tlpl"
Oct 31 17:42:19.923543 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:19.923511    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gn6rs\" (UniqueName: \"kubernetes.io/projected/8c4070da-49cf-4158-b6fe-4b6ea0cc5ea2-kube-api-access-gn6rs\") pod \"maas-api-revoke-keys-e2e-worker-w5-b78c31-8tlpl\" (UID: \"8c4070da-49cf-4158-b6fe-4b6ea0cc5ea2\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w5-b78c31-8tlpl"
Oct 31 17:42:20.045037 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:20.044942    5003 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w5-b78c31-8tlpl"
Oct 31 17:42:20.195520 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:20.195431    5003 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-processing-e2e-worker-w3-cf0a86-c788d8d8f-r22w9" podUID="7804a34f-1c95-4057-8131-39e8bec72e57" containerName="payload-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 31 17:42:20.350407 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:42:20.350376    5003 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8c4070da_49cf_4158_b6fe_4b6ea0cc5ea2.slice/crio-74c41f04019527fb41c26e1a00de4593929c6a0fa9431b8ef05c308f7d4a26ca WatchSource:0}: Error finding container 74c41f04019527fb41c26e1a00de4593929c6a0fa9431b8ef05c308f7d4a26ca: Status 404 returned error can't find the container with id 74c41f04019527fb41c26e1a00de4593929c6a0fa9431b8ef05c308f7d4a26ca
Oct 31 17:42:20.351024 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:20.350999    5003 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w5-b78c31-8tlpl"]
Oct 31 17:42:21.284162 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:21.284126    5003 generic.go:356] "Generic (PLEG): container finished" podID="8c4070da-49cf-4158-b6fe-4b6ea0cc5ea2" containerID="aa939f17a02186e71bb6f043f067d65acc80f52275db45a186401f24885eaa45" exitCode=0
Oct 31 17:42:21.284505 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:21.284208    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w5-b78c31-8tlpl" event={"ID":"8c4070da-49cf-4158-b6fe-4b6ea0cc5ea2","Type":"ContainerDied","Data":"aa939f17a02186e71bb6f043f067d65acc80f52275db45a186401f24885eaa45"}
Oct 31 17:42:21.284505 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:21.284264    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w5-b78c31-8tlpl" event={"ID":"8c4070da-49cf-4158-b6fe-4b6ea0cc5ea2","Type":"ContainerStarted","Data":"74c41f04019527fb41c26e1a00de4593929c6a0fa9431b8ef05c308f7d4a26ca"}
Oct 31 17:42:22.489379 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:22.489346    5003 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w5-b78c31-8tlpl"
Oct 31 17:42:22.649040 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:22.649009    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/8c4070da-49cf-4158-b6fe-4b6ea0cc5ea2-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/8c4070da-49cf-4158-b6fe-4b6ea0cc5ea2-maas-api-xks-ca\") pod \"8c4070da-49cf-4158-b6fe-4b6ea0cc5ea2\" (UID: \"8c4070da-49cf-4158-b6fe-4b6ea0cc5ea2\") "
Oct 31 17:42:22.649237 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:22.649078    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/8c4070da-49cf-4158-b6fe-4b6ea0cc5ea2-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/8c4070da-49cf-4158-b6fe-4b6ea0cc5ea2-maas-api-openshift-ca\") pod \"8c4070da-49cf-4158-b6fe-4b6ea0cc5ea2\" (UID: \"8c4070da-49cf-4158-b6fe-4b6ea0cc5ea2\") "
Oct 31 17:42:22.649237 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:22.649108    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/8c4070da-49cf-4158-b6fe-4b6ea0cc5ea2-kube-api-access-gn6rs\" (UniqueName: \"kubernetes.io/projected/8c4070da-49cf-4158-b6fe-4b6ea0cc5ea2-kube-api-access-gn6rs\") pod \"8c4070da-49cf-4158-b6fe-4b6ea0cc5ea2\" (UID: \"8c4070da-49cf-4158-b6fe-4b6ea0cc5ea2\") "
Oct 31 17:42:22.649506 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:22.649481    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8c4070da-49cf-4158-b6fe-4b6ea0cc5ea2-maas-api-openshift-ca" pod "8c4070da-49cf-4158-b6fe-4b6ea0cc5ea2" (UID: "8c4070da-49cf-4158-b6fe-4b6ea0cc5ea2"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 17:42:22.649811 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:22.649790    5003 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/8c4070da-49cf-4158-b6fe-4b6ea0cc5ea2-maas-api-openshift-ca\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:42:22.651110 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:22.651081    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8c4070da-49cf-4158-b6fe-4b6ea0cc5ea2-maas-api-xks-ca" pod "8c4070da-49cf-4158-b6fe-4b6ea0cc5ea2" (UID: "8c4070da-49cf-4158-b6fe-4b6ea0cc5ea2"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 17:42:22.651291 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:22.651267    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8c4070da-49cf-4158-b6fe-4b6ea0cc5ea2-kube-api-access-gn6rs" pod "8c4070da-49cf-4158-b6fe-4b6ea0cc5ea2" (UID: "8c4070da-49cf-4158-b6fe-4b6ea0cc5ea2"). InnerVolumeSpecName "kube-api-access-gn6rs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 17:42:22.751555 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:22.751521    5003 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/8c4070da-49cf-4158-b6fe-4b6ea0cc5ea2-maas-api-xks-ca\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:42:22.751555 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:22.751551    5003 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gn6rs\" (UniqueName: \"kubernetes.io/projected/8c4070da-49cf-4158-b6fe-4b6ea0cc5ea2-kube-api-access-gn6rs\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:42:23.309321 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:23.309286    5003 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-ee816e-bgmxx"]
Oct 31 17:42:23.310011 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:23.309986    5003 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w5-b78c31-8tlpl"
Oct 31 17:42:23.310311 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:23.310291    5003 cpu_manager.go:414] "containerMap: removing container" podUID="8c4070da-49cf-4158-b6fe-4b6ea0cc5ea2" containerName="revoke-keys"
Oct 31 17:42:23.310356 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:23.310314    5003 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="8c4070da-49cf-4158-b6fe-4b6ea0cc5ea2" containerName="revoke-keys"
Oct 31 17:42:23.310494 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:23.310480    5003 memory_manager.go:365] "RemoveStaleState removing state" podUID="8c4070da-49cf-4158-b6fe-4b6ea0cc5ea2" containerName="revoke-keys"
Oct 31 17:42:23.315196 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:23.315171    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w5-b78c31-8tlpl" event={"ID":"8c4070da-49cf-4158-b6fe-4b6ea0cc5ea2","Type":"ContainerDied","Data":"74c41f04019527fb41c26e1a00de4593929c6a0fa9431b8ef05c308f7d4a26ca"}
Oct 31 17:42:23.315319 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:23.315207    5003 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="74c41f04019527fb41c26e1a00de4593929c6a0fa9431b8ef05c308f7d4a26ca"
Oct 31 17:42:23.315319 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:23.315297    5003 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-ee816e-bgmxx"
Oct 31 17:42:23.332534 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:23.332505    5003 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-ee816e-bgmxx"]
Oct 31 17:42:23.334964 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:23.334938    5003 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\""
Oct 31 17:42:23.334964 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:23.334945    5003 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-mr9x2\""
Oct 31 17:42:23.464615 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:23.464577    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/55b8d358-b7ac-4cf7-bea9-35621070d8cc-maas-api-openshift-ca\") pod \"maas-api-revoke-keys-e2e-worker-w0-ee816e-bgmxx\" (UID: \"55b8d358-b7ac-4cf7-bea9-35621070d8cc\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-ee816e-bgmxx"
Oct 31 17:42:23.464833 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:23.464680    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/55b8d358-b7ac-4cf7-bea9-35621070d8cc-maas-api-xks-ca\") pod \"maas-api-revoke-keys-e2e-worker-w0-ee816e-bgmxx\" (UID: \"55b8d358-b7ac-4cf7-bea9-35621070d8cc\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-ee816e-bgmxx"
Oct 31 17:42:23.464833 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:23.464800    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8dxqq\" (UniqueName: \"kubernetes.io/projected/55b8d358-b7ac-4cf7-bea9-35621070d8cc-kube-api-access-8dxqq\") pod \"maas-api-revoke-keys-e2e-worker-w0-ee816e-bgmxx\" (UID: \"55b8d358-b7ac-4cf7-bea9-35621070d8cc\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-ee816e-bgmxx"
Oct 31 17:42:23.566526 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:23.566441    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/55b8d358-b7ac-4cf7-bea9-35621070d8cc-maas-api-openshift-ca\") pod \"maas-api-revoke-keys-e2e-worker-w0-ee816e-bgmxx\" (UID: \"55b8d358-b7ac-4cf7-bea9-35621070d8cc\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-ee816e-bgmxx"
Oct 31 17:42:23.566526 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:23.566502    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/55b8d358-b7ac-4cf7-bea9-35621070d8cc-maas-api-xks-ca\") pod \"maas-api-revoke-keys-e2e-worker-w0-ee816e-bgmxx\" (UID: \"55b8d358-b7ac-4cf7-bea9-35621070d8cc\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-ee816e-bgmxx"
Oct 31 17:42:23.566958 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:23.566539    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8dxqq\" (UniqueName: \"kubernetes.io/projected/55b8d358-b7ac-4cf7-bea9-35621070d8cc-kube-api-access-8dxqq\") pod \"maas-api-revoke-keys-e2e-worker-w0-ee816e-bgmxx\" (UID: \"55b8d358-b7ac-4cf7-bea9-35621070d8cc\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-ee816e-bgmxx"
Oct 31 17:42:23.567303 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:23.567270    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/55b8d358-b7ac-4cf7-bea9-35621070d8cc-maas-api-openshift-ca\") pod \"maas-api-revoke-keys-e2e-worker-w0-ee816e-bgmxx\" (UID: \"55b8d358-b7ac-4cf7-bea9-35621070d8cc\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-ee816e-bgmxx"
Oct 31 17:42:23.568992 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:23.568969    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/55b8d358-b7ac-4cf7-bea9-35621070d8cc-maas-api-xks-ca\") pod \"maas-api-revoke-keys-e2e-worker-w0-ee816e-bgmxx\" (UID: \"55b8d358-b7ac-4cf7-bea9-35621070d8cc\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-ee816e-bgmxx"
Oct 31 17:42:23.584981 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:23.584951    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8dxqq\" (UniqueName: \"kubernetes.io/projected/55b8d358-b7ac-4cf7-bea9-35621070d8cc-kube-api-access-8dxqq\") pod \"maas-api-revoke-keys-e2e-worker-w0-ee816e-bgmxx\" (UID: \"55b8d358-b7ac-4cf7-bea9-35621070d8cc\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-ee816e-bgmxx"
Oct 31 17:42:23.637975 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:23.637931    5003 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-ee816e-bgmxx"
Oct 31 17:42:23.722154 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:23.722080    5003 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-worker-w1-0e59ca-6c6556b595-dq7d4" podUID="5a745358-9cc6-464a-a00d-a25d6b205bab" containerName="payload-pre-processing" containerID="cri-o://bdff0449b0550197d2053d2a03a871c08be721dfda375c12db8c0c9bf37ba338" gracePeriod=25
Oct 31 17:42:23.945043 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:23.945012    5003 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-ee816e-bgmxx"]
Oct 31 17:42:23.945745 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:42:23.945721    5003 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod55b8d358_b7ac_4cf7_bea9_35621070d8cc.slice/crio-29477a8764a03cac14a9b3c2b771a4e347ee2061b217acbc33fa33f95efee54d WatchSource:0}: Error finding container 29477a8764a03cac14a9b3c2b771a4e347ee2061b217acbc33fa33f95efee54d: Status 404 returned error can't find the container with id 29477a8764a03cac14a9b3c2b771a4e347ee2061b217acbc33fa33f95efee54d
Oct 31 17:42:24.320096 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:24.320062    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-ee816e-bgmxx" event={"ID":"55b8d358-b7ac-4cf7-bea9-35621070d8cc","Type":"ContainerStarted","Data":"29477a8764a03cac14a9b3c2b771a4e347ee2061b217acbc33fa33f95efee54d"}
Oct 31 17:42:24.400902 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:24.400870    5003 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w5-b78c31/distinct-2-w5-b78c31-kserve-5f4f9d4bb5-ss7g2"]
Oct 31 17:42:24.415000 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:24.412875    5003 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w5-b78c31/distinct-w5-b78c31-kserve-77ccb69d98-p2zct"]
Oct 31 17:42:24.421936 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:24.421903    5003 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w5-b78c31/simulator-w5-b78c31-kserve-95df74778-fpvpr"]
Oct 31 17:42:25.329878 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:25.329839    5003 generic.go:356] "Generic (PLEG): container finished" podID="55b8d358-b7ac-4cf7-bea9-35621070d8cc" containerID="d27030d1edd69da8647c4e88327b4a152341a27cce6e9d0bd97690efd06675cb" exitCode=0
Oct 31 17:42:25.330310 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:25.329922    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-ee816e-bgmxx" event={"ID":"55b8d358-b7ac-4cf7-bea9-35621070d8cc","Type":"ContainerDied","Data":"d27030d1edd69da8647c4e88327b4a152341a27cce6e9d0bd97690efd06675cb"}
Oct 31 17:42:26.220898 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:26.220863    5003 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-1c0bfd/distinct-w4-1c0bfd-kserve-867858548f-46gwg"]
Oct 31 17:42:26.233271 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:26.233219    5003 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-1c0bfd/premium-w4-1c0bfd-kserve-d78fbb98-psx55"]
Oct 31 17:42:26.519662 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:26.519625    5003 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-ee816e-bgmxx"
Oct 31 17:42:26.620517 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:26.620477    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/55b8d358-b7ac-4cf7-bea9-35621070d8cc-kube-api-access-8dxqq\" (UniqueName: \"kubernetes.io/projected/55b8d358-b7ac-4cf7-bea9-35621070d8cc-kube-api-access-8dxqq\") pod \"55b8d358-b7ac-4cf7-bea9-35621070d8cc\" (UID: \"55b8d358-b7ac-4cf7-bea9-35621070d8cc\") "
Oct 31 17:42:26.620723 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:26.620614    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/55b8d358-b7ac-4cf7-bea9-35621070d8cc-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/55b8d358-b7ac-4cf7-bea9-35621070d8cc-maas-api-openshift-ca\") pod \"55b8d358-b7ac-4cf7-bea9-35621070d8cc\" (UID: \"55b8d358-b7ac-4cf7-bea9-35621070d8cc\") "
Oct 31 17:42:26.620820 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:26.620798    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/55b8d358-b7ac-4cf7-bea9-35621070d8cc-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/55b8d358-b7ac-4cf7-bea9-35621070d8cc-maas-api-xks-ca\") pod \"55b8d358-b7ac-4cf7-bea9-35621070d8cc\" (UID: \"55b8d358-b7ac-4cf7-bea9-35621070d8cc\") "
Oct 31 17:42:26.621096 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:26.621068    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/55b8d358-b7ac-4cf7-bea9-35621070d8cc-maas-api-openshift-ca" pod "55b8d358-b7ac-4cf7-bea9-35621070d8cc" (UID: "55b8d358-b7ac-4cf7-bea9-35621070d8cc"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 17:42:26.621699 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:26.621672    5003 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/55b8d358-b7ac-4cf7-bea9-35621070d8cc-maas-api-openshift-ca\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:42:26.622921 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:26.622889    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/55b8d358-b7ac-4cf7-bea9-35621070d8cc-kube-api-access-8dxqq" pod "55b8d358-b7ac-4cf7-bea9-35621070d8cc" (UID: "55b8d358-b7ac-4cf7-bea9-35621070d8cc"). InnerVolumeSpecName "kube-api-access-8dxqq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 17:42:26.623104 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:26.623074    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/55b8d358-b7ac-4cf7-bea9-35621070d8cc-maas-api-xks-ca" pod "55b8d358-b7ac-4cf7-bea9-35621070d8cc" (UID: "55b8d358-b7ac-4cf7-bea9-35621070d8cc"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 17:42:26.723558 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:26.723514    5003 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8dxqq\" (UniqueName: \"kubernetes.io/projected/55b8d358-b7ac-4cf7-bea9-35621070d8cc-kube-api-access-8dxqq\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:42:26.723558 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:26.723558    5003 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/55b8d358-b7ac-4cf7-bea9-35621070d8cc-maas-api-xks-ca\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:42:27.333664 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:27.333617    5003 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-worker-w1-0e59ca-6c6556b595-dq7d4" podUID="5a745358-9cc6-464a-a00d-a25d6b205bab" containerName="payload-pre-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 31 17:42:27.333848 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:27.333623    5003 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-processing-e2e-worker-w2-5c446c-7c8d75cf57-px9mc" podUID="69ade7b0-0eb9-4426-901e-9bb7acdf1c1f" containerName="payload-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 31 17:42:27.356407 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:27.356382    5003 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-ee816e-bgmxx"
Oct 31 17:42:27.356538 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:27.356409    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-ee816e-bgmxx" event={"ID":"55b8d358-b7ac-4cf7-bea9-35621070d8cc","Type":"ContainerDied","Data":"29477a8764a03cac14a9b3c2b771a4e347ee2061b217acbc33fa33f95efee54d"}
Oct 31 17:42:27.356538 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:27.356456    5003 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="29477a8764a03cac14a9b3c2b771a4e347ee2061b217acbc33fa33f95efee54d"
Oct 31 17:42:27.947685 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:27.947627    5003 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w1-0e59ca/simulator-w1-0e59ca-kserve-999765679-zs7kh" podUID="018d423e-6866-4b61-a4a2-d2e786d82bf0" containerName="main" containerID="cri-o://0db39d22eaf34ae4fd5851858abf89cc8562ec7f0ccc3e2557a58800be6db318" gracePeriod=45
Oct 31 17:42:27.996400 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:27.996362    5003 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-0e59ca/simulator-w1-0e59ca-kserve-999765679-zs7kh" podUID="018d423e-6866-4b61-a4a2-d2e786d82bf0" containerName="main" probeResult="failure" output="Get \"https://10.132.0.71:8000/ready\": dial tcp 10.132.0.71:8000: connect: connection refused"
Oct 31 17:42:28.069928 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:28.069891    5003 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-ee816e/distinct-w0-ee816e-kserve-564f897f89-kglpl"]
Oct 31 17:42:28.085617 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:28.085581    5003 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-ee816e/simulator-w0-ee816e-kserve-5bd4657dc-9rlm4"]
Oct 31 17:42:28.253951 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:28.253920    5003 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w1-0e59ca/simulator-w1-0e59ca-kserve-999765679-zs7kh"
Oct 31 17:42:28.339074 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:28.339031    5003 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-5c446c-748954c4f5-9xwrq" podUID="801db2fa-c695-4267-a534-5a024d355c57" containerName="payload-pre-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 31 17:42:28.347579 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:28.347543    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/018d423e-6866-4b61-a4a2-d2e786d82bf0-home\" (UniqueName: \"kubernetes.io/empty-dir/018d423e-6866-4b61-a4a2-d2e786d82bf0-home\") pod \"018d423e-6866-4b61-a4a2-d2e786d82bf0\" (UID: \"018d423e-6866-4b61-a4a2-d2e786d82bf0\") "
Oct 31 17:42:28.347806 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:28.347773    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/018d423e-6866-4b61-a4a2-d2e786d82bf0-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/018d423e-6866-4b61-a4a2-d2e786d82bf0-tmp-dir\") pod \"018d423e-6866-4b61-a4a2-d2e786d82bf0\" (UID: \"018d423e-6866-4b61-a4a2-d2e786d82bf0\") "
Oct 31 17:42:28.347886 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:28.347819    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/018d423e-6866-4b61-a4a2-d2e786d82bf0-kube-api-access-f5ltq\" (UniqueName: \"kubernetes.io/projected/018d423e-6866-4b61-a4a2-d2e786d82bf0-kube-api-access-f5ltq\") pod \"018d423e-6866-4b61-a4a2-d2e786d82bf0\" (UID: \"018d423e-6866-4b61-a4a2-d2e786d82bf0\") "
Oct 31 17:42:28.348171 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:28.348113    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/018d423e-6866-4b61-a4a2-d2e786d82bf0-tls-certs\" (UniqueName: \"kubernetes.io/secret/018d423e-6866-4b61-a4a2-d2e786d82bf0-tls-certs\") pod \"018d423e-6866-4b61-a4a2-d2e786d82bf0\" (UID: \"018d423e-6866-4b61-a4a2-d2e786d82bf0\") "
Oct 31 17:42:28.348171 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:28.348153    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/018d423e-6866-4b61-a4a2-d2e786d82bf0-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/018d423e-6866-4b61-a4a2-d2e786d82bf0-model-cache\") pod \"018d423e-6866-4b61-a4a2-d2e786d82bf0\" (UID: \"018d423e-6866-4b61-a4a2-d2e786d82bf0\") "
Oct 31 17:42:28.348335 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:28.348180    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/018d423e-6866-4b61-a4a2-d2e786d82bf0-dshm\" (UniqueName: \"kubernetes.io/empty-dir/018d423e-6866-4b61-a4a2-d2e786d82bf0-dshm\") pod \"018d423e-6866-4b61-a4a2-d2e786d82bf0\" (UID: \"018d423e-6866-4b61-a4a2-d2e786d82bf0\") "
Oct 31 17:42:28.348468 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:28.348442    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/018d423e-6866-4b61-a4a2-d2e786d82bf0-home" pod "018d423e-6866-4b61-a4a2-d2e786d82bf0" (UID: "018d423e-6866-4b61-a4a2-d2e786d82bf0"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 17:42:28.348790 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:28.348769    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/018d423e-6866-4b61-a4a2-d2e786d82bf0-tmp-dir" pod "018d423e-6866-4b61-a4a2-d2e786d82bf0" (UID: "018d423e-6866-4b61-a4a2-d2e786d82bf0"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 17:42:28.348933 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:28.348910    5003 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/018d423e-6866-4b61-a4a2-d2e786d82bf0-home\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:42:28.349277 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:28.349218    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/018d423e-6866-4b61-a4a2-d2e786d82bf0-model-cache" pod "018d423e-6866-4b61-a4a2-d2e786d82bf0" (UID: "018d423e-6866-4b61-a4a2-d2e786d82bf0"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 17:42:28.351739 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:28.351711    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/018d423e-6866-4b61-a4a2-d2e786d82bf0-dshm" pod "018d423e-6866-4b61-a4a2-d2e786d82bf0" (UID: "018d423e-6866-4b61-a4a2-d2e786d82bf0"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 17:42:28.351950 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:28.351931    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/018d423e-6866-4b61-a4a2-d2e786d82bf0-tls-certs" pod "018d423e-6866-4b61-a4a2-d2e786d82bf0" (UID: "018d423e-6866-4b61-a4a2-d2e786d82bf0"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 17:42:28.353821 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:28.353791    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/018d423e-6866-4b61-a4a2-d2e786d82bf0-kube-api-access-f5ltq" pod "018d423e-6866-4b61-a4a2-d2e786d82bf0" (UID: "018d423e-6866-4b61-a4a2-d2e786d82bf0"). InnerVolumeSpecName "kube-api-access-f5ltq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 17:42:28.371540 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:28.371507    5003 generic.go:356] "Generic (PLEG): container finished" podID="018d423e-6866-4b61-a4a2-d2e786d82bf0" containerID="0db39d22eaf34ae4fd5851858abf89cc8562ec7f0ccc3e2557a58800be6db318" exitCode=0
Oct 31 17:42:28.371854 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:28.371831    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w1-0e59ca/simulator-w1-0e59ca-kserve-999765679-zs7kh" event={"ID":"018d423e-6866-4b61-a4a2-d2e786d82bf0","Type":"ContainerDied","Data":"0db39d22eaf34ae4fd5851858abf89cc8562ec7f0ccc3e2557a58800be6db318"}
Oct 31 17:42:28.371930 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:28.371877    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w1-0e59ca/simulator-w1-0e59ca-kserve-999765679-zs7kh" event={"ID":"018d423e-6866-4b61-a4a2-d2e786d82bf0","Type":"ContainerDied","Data":"da4391c3290a04ca000b8f7df40995d6dc2f8d17ba558ed89eefdbc828923c6a"}
Oct 31 17:42:28.371930 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:28.371900    5003 scope.go:122] "RemoveContainer" containerID="0db39d22eaf34ae4fd5851858abf89cc8562ec7f0ccc3e2557a58800be6db318"
Oct 31 17:42:28.372005 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:28.371980    5003 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w1-0e59ca/simulator-w1-0e59ca-kserve-999765679-zs7kh"
Oct 31 17:42:28.395786 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:28.395756    5003 scope.go:122] "RemoveContainer" containerID="0db39d22eaf34ae4fd5851858abf89cc8562ec7f0ccc3e2557a58800be6db318"
Oct 31 17:42:28.396133 ip-10-0-138-17 kubenswrapper[5003]: E1031 17:42:28.396109    5003 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0db39d22eaf34ae4fd5851858abf89cc8562ec7f0ccc3e2557a58800be6db318\": container with ID starting with 0db39d22eaf34ae4fd5851858abf89cc8562ec7f0ccc3e2557a58800be6db318 not found: ID does not exist" containerID="0db39d22eaf34ae4fd5851858abf89cc8562ec7f0ccc3e2557a58800be6db318"
Oct 31 17:42:28.396231 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:28.396142    5003 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0db39d22eaf34ae4fd5851858abf89cc8562ec7f0ccc3e2557a58800be6db318"} err="failed to get container status \"0db39d22eaf34ae4fd5851858abf89cc8562ec7f0ccc3e2557a58800be6db318\": rpc error: code = NotFound desc = could not find container \"0db39d22eaf34ae4fd5851858abf89cc8562ec7f0ccc3e2557a58800be6db318\": container with ID starting with 0db39d22eaf34ae4fd5851858abf89cc8562ec7f0ccc3e2557a58800be6db318 not found: ID does not exist"
Oct 31 17:42:28.435733 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:28.435698    5003 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w1-0e59ca/simulator-w1-0e59ca-kserve-999765679-zs7kh"]
Oct 31 17:42:28.444329 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:28.444294    5003 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w1-0e59ca/simulator-w1-0e59ca-kserve-999765679-zs7kh"]
Oct 31 17:42:28.450075 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:28.450047    5003 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/018d423e-6866-4b61-a4a2-d2e786d82bf0-tls-certs\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:42:28.450075 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:28.450073    5003 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/018d423e-6866-4b61-a4a2-d2e786d82bf0-model-cache\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:42:28.450075 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:28.450081    5003 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/018d423e-6866-4b61-a4a2-d2e786d82bf0-dshm\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:42:28.450333 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:28.450108    5003 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/018d423e-6866-4b61-a4a2-d2e786d82bf0-tmp-dir\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:42:28.450333 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:28.450117    5003 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f5ltq\" (UniqueName: \"kubernetes.io/projected/018d423e-6866-4b61-a4a2-d2e786d82bf0-kube-api-access-f5ltq\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:42:29.082566 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:29.082527    5003 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-49dabe6f-xrmqh"]
Oct 31 17:42:29.083330 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:29.083313    5003 cpu_manager.go:414] "containerMap: removing container" podUID="018d423e-6866-4b61-a4a2-d2e786d82bf0" containerName="main"
Oct 31 17:42:29.083386 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:29.083331    5003 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="018d423e-6866-4b61-a4a2-d2e786d82bf0" containerName="main"
Oct 31 17:42:29.083386 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:29.083352    5003 cpu_manager.go:414] "containerMap: removing container" podUID="55b8d358-b7ac-4cf7-bea9-35621070d8cc" containerName="revoke-keys"
Oct 31 17:42:29.083386 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:29.083358    5003 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="55b8d358-b7ac-4cf7-bea9-35621070d8cc" containerName="revoke-keys"
Oct 31 17:42:29.083489 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:29.083466    5003 memory_manager.go:365] "RemoveStaleState removing state" podUID="018d423e-6866-4b61-a4a2-d2e786d82bf0" containerName="main"
Oct 31 17:42:29.083489 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:29.083478    5003 memory_manager.go:365] "RemoveStaleState removing state" podUID="55b8d358-b7ac-4cf7-bea9-35621070d8cc" containerName="revoke-keys"
Oct 31 17:42:29.088441 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:29.088422    5003 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-49dabe6f-xrmqh"
Oct 31 17:42:29.109742 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:29.109712    5003 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-49dabe6f-xrmqh"]
Oct 31 17:42:29.160332 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:29.160299    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8wt6z\" (UniqueName: \"kubernetes.io/projected/66d82d62-6b08-42ed-8b29-a47110c86879-kube-api-access-8wt6z\") pod \"maas-api-revoke-sub-49dabe6f-xrmqh\" (UID: \"66d82d62-6b08-42ed-8b29-a47110c86879\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-49dabe6f-xrmqh"
Oct 31 17:42:29.160526 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:29.160342    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/66d82d62-6b08-42ed-8b29-a47110c86879-maas-api-xks-ca\") pod \"maas-api-revoke-sub-49dabe6f-xrmqh\" (UID: \"66d82d62-6b08-42ed-8b29-a47110c86879\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-49dabe6f-xrmqh"
Oct 31 17:42:29.160597 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:29.160548    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/66d82d62-6b08-42ed-8b29-a47110c86879-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-49dabe6f-xrmqh\" (UID: \"66d82d62-6b08-42ed-8b29-a47110c86879\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-49dabe6f-xrmqh"
Oct 31 17:42:29.192579 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:29.192538    5003 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\""
Oct 31 17:42:29.192734 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:29.192577    5003 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-mr9x2\""
Oct 31 17:42:29.262881 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:29.262842    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8wt6z\" (UniqueName: \"kubernetes.io/projected/66d82d62-6b08-42ed-8b29-a47110c86879-kube-api-access-8wt6z\") pod \"maas-api-revoke-sub-49dabe6f-xrmqh\" (UID: \"66d82d62-6b08-42ed-8b29-a47110c86879\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-49dabe6f-xrmqh"
Oct 31 17:42:29.263185 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:29.263143    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/66d82d62-6b08-42ed-8b29-a47110c86879-maas-api-xks-ca\") pod \"maas-api-revoke-sub-49dabe6f-xrmqh\" (UID: \"66d82d62-6b08-42ed-8b29-a47110c86879\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-49dabe6f-xrmqh"
Oct 31 17:42:29.263341 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:29.263323    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/66d82d62-6b08-42ed-8b29-a47110c86879-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-49dabe6f-xrmqh\" (UID: \"66d82d62-6b08-42ed-8b29-a47110c86879\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-49dabe6f-xrmqh"
Oct 31 17:42:29.264380 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:29.264355    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/66d82d62-6b08-42ed-8b29-a47110c86879-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-49dabe6f-xrmqh\" (UID: \"66d82d62-6b08-42ed-8b29-a47110c86879\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-49dabe6f-xrmqh"
Oct 31 17:42:29.266266 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:29.266242    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/66d82d62-6b08-42ed-8b29-a47110c86879-maas-api-xks-ca\") pod \"maas-api-revoke-sub-49dabe6f-xrmqh\" (UID: \"66d82d62-6b08-42ed-8b29-a47110c86879\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-49dabe6f-xrmqh"
Oct 31 17:42:29.283240 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:29.283220    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8wt6z\" (UniqueName: \"kubernetes.io/projected/66d82d62-6b08-42ed-8b29-a47110c86879-kube-api-access-8wt6z\") pod \"maas-api-revoke-sub-49dabe6f-xrmqh\" (UID: \"66d82d62-6b08-42ed-8b29-a47110c86879\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-49dabe6f-xrmqh"
Oct 31 17:42:29.413792 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:29.413717    5003 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-49dabe6f-xrmqh"
Oct 31 17:42:29.856237 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:29.856195    5003 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-49dabe6f-xrmqh"]
Oct 31 17:42:29.928589 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:29.928507    5003 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="018d423e-6866-4b61-a4a2-d2e786d82bf0" path="/var/lib/kubelet/pods/018d423e-6866-4b61-a4a2-d2e786d82bf0/volumes"
Oct 31 17:42:30.254718 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:30.251206    5003 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-processing-e2e-worker-w3-cf0a86-c788d8d8f-r22w9" podUID="7804a34f-1c95-4057-8131-39e8bec72e57" containerName="payload-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 31 17:42:30.287719 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:30.283950    5003 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w2-5c446c-7c8d75cf57-px9mc"
Oct 31 17:42:30.344154 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:30.344126    5003 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-5c446c-748954c4f5-9xwrq"
Oct 31 17:42:30.423592 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:30.423284    5003 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-5c446c-748954c4f5-9xwrq"
Oct 31 17:42:30.423956 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:30.423288    5003 generic.go:356] "Generic (PLEG): container finished" podID="801db2fa-c695-4267-a534-5a024d355c57" containerID="91976378d344d8840a524b21851cd5bd81c7f885d67070a8d85236e87f75f161" exitCode=0
Oct 31 17:42:30.424070 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:30.423788    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-5c446c-748954c4f5-9xwrq" event={"ID":"801db2fa-c695-4267-a534-5a024d355c57","Type":"ContainerDied","Data":"91976378d344d8840a524b21851cd5bd81c7f885d67070a8d85236e87f75f161"}
Oct 31 17:42:30.424326 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:30.424114    5003 scope.go:122] "RemoveContainer" containerID="91976378d344d8840a524b21851cd5bd81c7f885d67070a8d85236e87f75f161"
Oct 31 17:42:30.427205 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:30.427175    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-5c446c-748954c4f5-9xwrq" event={"ID":"801db2fa-c695-4267-a534-5a024d355c57","Type":"ContainerDied","Data":"a244b3bdc3c5d42e624f5cca5620394ab727ff9fb9401e1dcdb76806b49411bc"}
Oct 31 17:42:30.430602 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:30.430574    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/801db2fa-c695-4267-a534-5a024d355c57-kube-api-access-j2ls4\" (UniqueName: \"kubernetes.io/projected/801db2fa-c695-4267-a534-5a024d355c57-kube-api-access-j2ls4\") pod \"801db2fa-c695-4267-a534-5a024d355c57\" (UID: \"801db2fa-c695-4267-a534-5a024d355c57\") "
Oct 31 17:42:30.430722 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:30.430625    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/801db2fa-c695-4267-a534-5a024d355c57-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/801db2fa-c695-4267-a534-5a024d355c57-plugins-config-volume\") pod \"801db2fa-c695-4267-a534-5a024d355c57\" (UID: \"801db2fa-c695-4267-a534-5a024d355c57\") "
Oct 31 17:42:30.430722 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:30.430690    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/69ade7b0-0eb9-4426-901e-9bb7acdf1c1f-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/69ade7b0-0eb9-4426-901e-9bb7acdf1c1f-plugins-config-volume\") pod \"69ade7b0-0eb9-4426-901e-9bb7acdf1c1f\" (UID: \"69ade7b0-0eb9-4426-901e-9bb7acdf1c1f\") "
Oct 31 17:42:30.430919 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:30.430837    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/69ade7b0-0eb9-4426-901e-9bb7acdf1c1f-kube-api-access-z8s7g\" (UniqueName: \"kubernetes.io/projected/69ade7b0-0eb9-4426-901e-9bb7acdf1c1f-kube-api-access-z8s7g\") pod \"69ade7b0-0eb9-4426-901e-9bb7acdf1c1f\" (UID: \"69ade7b0-0eb9-4426-901e-9bb7acdf1c1f\") "
Oct 31 17:42:30.432511 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:30.432205    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/801db2fa-c695-4267-a534-5a024d355c57-plugins-config-volume" pod "801db2fa-c695-4267-a534-5a024d355c57" (UID: "801db2fa-c695-4267-a534-5a024d355c57"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 17:42:30.432706 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:30.432681    5003 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w2-5c446c-7c8d75cf57-px9mc"
Oct 31 17:42:30.432824 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:30.432711    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/69ade7b0-0eb9-4426-901e-9bb7acdf1c1f-plugins-config-volume" pod "69ade7b0-0eb9-4426-901e-9bb7acdf1c1f" (UID: "69ade7b0-0eb9-4426-901e-9bb7acdf1c1f"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 17:42:30.432824 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:30.432713    5003 generic.go:356] "Generic (PLEG): container finished" podID="69ade7b0-0eb9-4426-901e-9bb7acdf1c1f" containerID="93ace7d75c2830aac310fe02738439a7e46bd294becee20ab2181bc7e974212b" exitCode=0
Oct 31 17:42:30.432824 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:30.432779    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w2-5c446c-7c8d75cf57-px9mc" event={"ID":"69ade7b0-0eb9-4426-901e-9bb7acdf1c1f","Type":"ContainerDied","Data":"93ace7d75c2830aac310fe02738439a7e46bd294becee20ab2181bc7e974212b"}
Oct 31 17:42:30.432989 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:30.432851    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w2-5c446c-7c8d75cf57-px9mc" event={"ID":"69ade7b0-0eb9-4426-901e-9bb7acdf1c1f","Type":"ContainerDied","Data":"bcfb46f24fabd11ce85f6a3562141fccf24b04cfe4a9992fc75ac68e0cd2ea99"}
Oct 31 17:42:30.446016 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:30.445981    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-49dabe6f-xrmqh" event={"ID":"66d82d62-6b08-42ed-8b29-a47110c86879","Type":"ContainerStarted","Data":"ed770df629637dc1d57b8295745dcf39e5d44dcc14ff24e900a59f478def6949"}
Oct 31 17:42:30.449116 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:30.449093    5003 scope.go:122] "RemoveContainer" containerID="91976378d344d8840a524b21851cd5bd81c7f885d67070a8d85236e87f75f161"
Oct 31 17:42:30.449408 ip-10-0-138-17 kubenswrapper[5003]: E1031 17:42:30.449386    5003 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"91976378d344d8840a524b21851cd5bd81c7f885d67070a8d85236e87f75f161\": container with ID starting with 91976378d344d8840a524b21851cd5bd81c7f885d67070a8d85236e87f75f161 not found: ID does not exist" containerID="91976378d344d8840a524b21851cd5bd81c7f885d67070a8d85236e87f75f161"
Oct 31 17:42:30.449474 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:30.449415    5003 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"91976378d344d8840a524b21851cd5bd81c7f885d67070a8d85236e87f75f161"} err="failed to get container status \"91976378d344d8840a524b21851cd5bd81c7f885d67070a8d85236e87f75f161\": rpc error: code = NotFound desc = could not find container \"91976378d344d8840a524b21851cd5bd81c7f885d67070a8d85236e87f75f161\": container with ID starting with 91976378d344d8840a524b21851cd5bd81c7f885d67070a8d85236e87f75f161 not found: ID does not exist"
Oct 31 17:42:30.449474 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:30.449439    5003 scope.go:122] "RemoveContainer" containerID="93ace7d75c2830aac310fe02738439a7e46bd294becee20ab2181bc7e974212b"
Oct 31 17:42:30.454993 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:30.454960    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/69ade7b0-0eb9-4426-901e-9bb7acdf1c1f-kube-api-access-z8s7g" pod "69ade7b0-0eb9-4426-901e-9bb7acdf1c1f" (UID: "69ade7b0-0eb9-4426-901e-9bb7acdf1c1f"). InnerVolumeSpecName "kube-api-access-z8s7g". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 17:42:30.455109 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:30.455018    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/801db2fa-c695-4267-a534-5a024d355c57-kube-api-access-j2ls4" pod "801db2fa-c695-4267-a534-5a024d355c57" (UID: "801db2fa-c695-4267-a534-5a024d355c57"). InnerVolumeSpecName "kube-api-access-j2ls4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 17:42:30.497603 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:30.497579    5003 scope.go:122] "RemoveContainer" containerID="93ace7d75c2830aac310fe02738439a7e46bd294becee20ab2181bc7e974212b"
Oct 31 17:42:30.497984 ip-10-0-138-17 kubenswrapper[5003]: E1031 17:42:30.497961    5003 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"93ace7d75c2830aac310fe02738439a7e46bd294becee20ab2181bc7e974212b\": container with ID starting with 93ace7d75c2830aac310fe02738439a7e46bd294becee20ab2181bc7e974212b not found: ID does not exist" containerID="93ace7d75c2830aac310fe02738439a7e46bd294becee20ab2181bc7e974212b"
Oct 31 17:42:30.498068 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:30.498000    5003 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"93ace7d75c2830aac310fe02738439a7e46bd294becee20ab2181bc7e974212b"} err="failed to get container status \"93ace7d75c2830aac310fe02738439a7e46bd294becee20ab2181bc7e974212b\": rpc error: code = NotFound desc = could not find container \"93ace7d75c2830aac310fe02738439a7e46bd294becee20ab2181bc7e974212b\": container with ID starting with 93ace7d75c2830aac310fe02738439a7e46bd294becee20ab2181bc7e974212b not found: ID does not exist"
Oct 31 17:42:30.534178 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:30.534053    5003 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j2ls4\" (UniqueName: \"kubernetes.io/projected/801db2fa-c695-4267-a534-5a024d355c57-kube-api-access-j2ls4\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:42:30.534178 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:30.534090    5003 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/801db2fa-c695-4267-a534-5a024d355c57-plugins-config-volume\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:42:30.534178 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:30.534107    5003 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/69ade7b0-0eb9-4426-901e-9bb7acdf1c1f-plugins-config-volume\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:42:30.534178 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:30.534121    5003 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z8s7g\" (UniqueName: \"kubernetes.io/projected/69ade7b0-0eb9-4426-901e-9bb7acdf1c1f-kube-api-access-z8s7g\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:42:30.780894 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:30.780857    5003 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w2-5c446c-748954c4f5-9xwrq"]
Oct 31 17:42:30.789248 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:30.789173    5003 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w2-5c446c-748954c4f5-9xwrq"]
Oct 31 17:42:30.823508 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:30.823474    5003 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w2-5c446c-7c8d75cf57-px9mc"]
Oct 31 17:42:30.833249 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:30.833210    5003 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w2-5c446c-7c8d75cf57-px9mc"]
Oct 31 17:42:31.457351 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:31.457316    5003 generic.go:356] "Generic (PLEG): container finished" podID="66d82d62-6b08-42ed-8b29-a47110c86879" containerID="446f3521b44c5c9f3dddf18e68e143b6854934f5ce6f448267bcf68ec93e4eb9" exitCode=0
Oct 31 17:42:31.457814 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:31.457401    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-49dabe6f-xrmqh" event={"ID":"66d82d62-6b08-42ed-8b29-a47110c86879","Type":"ContainerDied","Data":"446f3521b44c5c9f3dddf18e68e143b6854934f5ce6f448267bcf68ec93e4eb9"}
Oct 31 17:42:31.520689 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:31.520632    5003 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w5-b78c31-86cdfb657c-m4s5d"]
Oct 31 17:42:31.896624 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:31.896584    5003 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="69ade7b0-0eb9-4426-901e-9bb7acdf1c1f" path="/var/lib/kubelet/pods/69ade7b0-0eb9-4426-901e-9bb7acdf1c1f/volumes"
Oct 31 17:42:31.897383 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:31.897356    5003 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="801db2fa-c695-4267-a534-5a024d355c57" path="/var/lib/kubelet/pods/801db2fa-c695-4267-a534-5a024d355c57/volumes"
Oct 31 17:42:32.410668 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:32.410106    5003 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w4-1c0bfd-754b9cb7cf-gpdmq"]
Oct 31 17:42:32.434763 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:32.416358    5003 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-1c0bfd-84cbc7675-n2bbv"]
Oct 31 17:42:33.078631 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:33.078592    5003 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-49dabe6f-xrmqh"
Oct 31 17:42:33.181667 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:33.178429    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/66d82d62-6b08-42ed-8b29-a47110c86879-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/66d82d62-6b08-42ed-8b29-a47110c86879-maas-api-openshift-ca\") pod \"66d82d62-6b08-42ed-8b29-a47110c86879\" (UID: \"66d82d62-6b08-42ed-8b29-a47110c86879\") "
Oct 31 17:42:33.181667 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:33.178705    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/66d82d62-6b08-42ed-8b29-a47110c86879-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/66d82d62-6b08-42ed-8b29-a47110c86879-maas-api-xks-ca\") pod \"66d82d62-6b08-42ed-8b29-a47110c86879\" (UID: \"66d82d62-6b08-42ed-8b29-a47110c86879\") "
Oct 31 17:42:33.181667 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:33.178951    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/66d82d62-6b08-42ed-8b29-a47110c86879-kube-api-access-8wt6z\" (UniqueName: \"kubernetes.io/projected/66d82d62-6b08-42ed-8b29-a47110c86879-kube-api-access-8wt6z\") pod \"66d82d62-6b08-42ed-8b29-a47110c86879\" (UID: \"66d82d62-6b08-42ed-8b29-a47110c86879\") "
Oct 31 17:42:33.181667 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:33.180745    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/66d82d62-6b08-42ed-8b29-a47110c86879-maas-api-openshift-ca" pod "66d82d62-6b08-42ed-8b29-a47110c86879" (UID: "66d82d62-6b08-42ed-8b29-a47110c86879"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 17:42:33.207672 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:33.196433    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/66d82d62-6b08-42ed-8b29-a47110c86879-maas-api-xks-ca" pod "66d82d62-6b08-42ed-8b29-a47110c86879" (UID: "66d82d62-6b08-42ed-8b29-a47110c86879"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 17:42:33.207672 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:33.199333    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/66d82d62-6b08-42ed-8b29-a47110c86879-kube-api-access-8wt6z" pod "66d82d62-6b08-42ed-8b29-a47110c86879" (UID: "66d82d62-6b08-42ed-8b29-a47110c86879"). InnerVolumeSpecName "kube-api-access-8wt6z". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 17:42:33.291770 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:33.291105    5003 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/66d82d62-6b08-42ed-8b29-a47110c86879-maas-api-openshift-ca\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:42:33.291770 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:33.291145    5003 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/66d82d62-6b08-42ed-8b29-a47110c86879-maas-api-xks-ca\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:42:33.291770 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:33.291160    5003 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8wt6z\" (UniqueName: \"kubernetes.io/projected/66d82d62-6b08-42ed-8b29-a47110c86879-kube-api-access-8wt6z\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:42:33.627680 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:33.624927    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-49dabe6f-xrmqh" event={"ID":"66d82d62-6b08-42ed-8b29-a47110c86879","Type":"ContainerDied","Data":"ed770df629637dc1d57b8295745dcf39e5d44dcc14ff24e900a59f478def6949"}
Oct 31 17:42:33.627680 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:33.625412    5003 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ed770df629637dc1d57b8295745dcf39e5d44dcc14ff24e900a59f478def6949"
Oct 31 17:42:33.627680 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:33.625350    5003 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-49dabe6f-xrmqh"
Oct 31 17:42:34.297046 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:34.284872    5003 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w0-ee816e-7d6bc48879-mmfcd"]
Oct 31 17:42:34.524747 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:34.466700    5003 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w0-ee816e-7cd5d5699-t92fc"]
Oct 31 17:42:34.881713 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:34.881210    5003 prober.go:122] "Probe failed" probeType="Readiness" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-82w89" podUID="ef5a065b-f98e-4d14-810f-2d0c42c58ce6" containerName="main" probeResult="failure" output="Get \"https://10.132.0.54:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 31 17:42:34.970672 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:34.964389    5003 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-ee816e/distinct-w0-ee816e-kserve-564f897f89-kglpl" podUID="82b982f8-de44-449d-b4a6-dc8f5824bf35" containerName="main" probeResult="failure" output="Get \"https://10.132.0.91:8000/ready\": context deadline exceeded"
Oct 31 17:42:34.991493 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:34.974840    5003 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-b78c31/distinct-w5-b78c31-kserve-77ccb69d98-p2zct" podUID="fcf01e9c-57fb-42db-848d-d314c615bd67" containerName="main" probeResult="failure" output="Get \"https://10.132.0.93:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 31 17:42:35.030685 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:35.026883    5003 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-ee816e/simulator-w0-ee816e-kserve-5bd4657dc-9rlm4" podUID="620f499f-36d7-4900-abbe-98ee5cf5d96c" containerName="main" probeResult="failure" output="Get \"https://10.132.0.72:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 31 17:42:35.125955 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:35.125899    5003 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-b78c31/simulator-w5-b78c31-kserve-95df74778-fpvpr" podUID="665d75c7-8ba5-49e1-87a7-51a18ae6f369" containerName="main" probeResult="failure" output="Get \"https://10.132.0.73:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 31 17:42:35.603339 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:35.603294    5003 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-1c0bfd/distinct-w4-1c0bfd-kserve-867858548f-46gwg" podUID="93f16294-fc40-477d-90b3-d02640037d5b" containerName="main" probeResult="failure" output="Get \"https://10.132.0.94:8000/ready\": context deadline exceeded"
Oct 31 17:42:35.615849 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:35.604432    5003 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-b78c31/distinct-2-w5-b78c31-kserve-5f4f9d4bb5-ss7g2" podUID="9cc6d7e8-30de-4173-9974-1f1a4fd08e1c" containerName="main" probeResult="failure" output="Get \"https://10.132.0.99:8000/ready\": context deadline exceeded"
Oct 31 17:42:35.801670 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:35.799691    5003 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-1c0bfd/premium-w4-1c0bfd-kserve-d78fbb98-psx55" podUID="34bdffed-87b8-4e7a-b182-f069d081bd62" containerName="main" probeResult="failure" output="Get \"https://10.132.0.74:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 31 17:42:35.935727 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:35.926985    5003 prober.go:122] "Probe failed" probeType="Readiness" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-82w89" podUID="ef5a065b-f98e-4d14-810f-2d0c42c58ce6" containerName="main" probeResult="failure" output="Get \"https://10.132.0.54:8000/ready\": context deadline exceeded"
Oct 31 17:42:35.969669 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:35.965939    5003 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-ee816e/distinct-w0-ee816e-kserve-564f897f89-kglpl" podUID="82b982f8-de44-449d-b4a6-dc8f5824bf35" containerName="main" probeResult="failure" output="Get \"https://10.132.0.91:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 31 17:42:36.002682 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:35.990880    5003 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-b78c31/distinct-w5-b78c31-kserve-77ccb69d98-p2zct" podUID="fcf01e9c-57fb-42db-848d-d314c615bd67" containerName="main" probeResult="failure" output="Get \"https://10.132.0.93:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 31 17:42:36.040907 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:36.040125    5003 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-ee816e/simulator-w0-ee816e-kserve-5bd4657dc-9rlm4" podUID="620f499f-36d7-4900-abbe-98ee5cf5d96c" containerName="main" probeResult="failure" output="Get \"https://10.132.0.72:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 31 17:42:36.108173 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:36.106982    5003 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-82w89"
Oct 31 17:42:36.108173 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:36.107047    5003 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w0-ee816e/distinct-w0-ee816e-kserve-564f897f89-kglpl"
Oct 31 17:42:36.108173 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:36.107133    5003 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w5-b78c31/distinct-w5-b78c31-kserve-77ccb69d98-p2zct"
Oct 31 17:42:36.108173 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:36.107172    5003 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w0-ee816e/simulator-w0-ee816e-kserve-5bd4657dc-9rlm4"
Oct 31 17:42:36.131505 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:36.128824    5003 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-b78c31/simulator-w5-b78c31-kserve-95df74778-fpvpr" podUID="665d75c7-8ba5-49e1-87a7-51a18ae6f369" containerName="main" probeResult="failure" output="Get \"https://10.132.0.73:8000/ready\": context deadline exceeded"
Oct 31 17:42:36.131505 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:36.129246    5003 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w5-b78c31/simulator-w5-b78c31-kserve-95df74778-fpvpr"
Oct 31 17:42:36.382463 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:36.382422    5003 generic.go:356] "Generic (PLEG): container finished" podID="7804a34f-1c95-4057-8131-39e8bec72e57" containerID="e62cc85dcfe147870753f54ee06f3070b37a30ab64836a6e78ed1b0c56e41593" exitCode=0
Oct 31 17:42:36.382981 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:36.382934    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w3-cf0a86-c788d8d8f-r22w9" event={"ID":"7804a34f-1c95-4057-8131-39e8bec72e57","Type":"ContainerDied","Data":"e62cc85dcfe147870753f54ee06f3070b37a30ab64836a6e78ed1b0c56e41593"}
Oct 31 17:42:36.565671 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:36.558845    5003 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-worker-w5-b78c31-86cdfb657c-m4s5d" podUID="06aa3682-3041-49d8-b240-761092b11dc9" containerName="payload-processing" containerID="cri-o://695bb9d51a97ef5793c4817e95a5b6a014f7271b66789311a45ca17c2b1256dc" gracePeriod=25
Oct 31 17:42:36.609012 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:36.608875    5003 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-1c0bfd/distinct-w4-1c0bfd-kserve-867858548f-46gwg" podUID="93f16294-fc40-477d-90b3-d02640037d5b" containerName="main" probeResult="failure" output="Get \"https://10.132.0.94:8000/ready\": context deadline exceeded"
Oct 31 17:42:36.645452 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:36.609894    5003 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-b78c31/distinct-2-w5-b78c31-kserve-5f4f9d4bb5-ss7g2" podUID="9cc6d7e8-30de-4173-9974-1f1a4fd08e1c" containerName="main" probeResult="failure" output="Get \"https://10.132.0.99:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 31 17:42:36.646175 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:36.646150    5003 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w4-1c0bfd/distinct-w4-1c0bfd-kserve-867858548f-46gwg"
Oct 31 17:42:36.646412 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:36.646382    5003 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w5-b78c31/distinct-2-w5-b78c31-kserve-5f4f9d4bb5-ss7g2"
Oct 31 17:42:36.805880 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:36.805831    5003 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-1c0bfd/premium-w4-1c0bfd-kserve-d78fbb98-psx55" podUID="34bdffed-87b8-4e7a-b182-f069d081bd62" containerName="main" probeResult="failure" output="Get \"https://10.132.0.74:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 31 17:42:36.807556 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:36.807530    5003 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w4-1c0bfd/premium-w4-1c0bfd-kserve-d78fbb98-psx55"
Oct 31 17:42:37.032357 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:37.030587    5003 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-b78c31/distinct-w5-b78c31-kserve-77ccb69d98-p2zct" podUID="fcf01e9c-57fb-42db-848d-d314c615bd67" containerName="main" probeResult="failure" output="Get \"https://10.132.0.93:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 31 17:42:37.068334 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:37.057727    5003 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-ee816e/distinct-w0-ee816e-kserve-564f897f89-kglpl" podUID="82b982f8-de44-449d-b4a6-dc8f5824bf35" containerName="main" probeResult="failure" output="Get \"https://10.132.0.91:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 31 17:42:37.068334 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:37.058326    5003 prober.go:122] "Probe failed" probeType="Readiness" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-82w89" podUID="ef5a065b-f98e-4d14-810f-2d0c42c58ce6" containerName="main" probeResult="failure" output="Get \"https://10.132.0.54:8000/ready\": context deadline exceeded"
Oct 31 17:42:37.068334 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:37.067775    5003 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-ee816e/simulator-w0-ee816e-kserve-5bd4657dc-9rlm4" podUID="620f499f-36d7-4900-abbe-98ee5cf5d96c" containerName="main" probeResult="failure" output="Get \"https://10.132.0.72:8000/ready\": context deadline exceeded"
Oct 31 17:42:37.150954 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:37.132400    5003 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-b78c31/simulator-w5-b78c31-kserve-95df74778-fpvpr" podUID="665d75c7-8ba5-49e1-87a7-51a18ae6f369" containerName="main" probeResult="failure" output="Get \"https://10.132.0.73:8000/ready\": context deadline exceeded"
Oct 31 17:42:37.432910 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:37.422521    5003 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-1c0bfd-84cbc7675-n2bbv" podUID="2335abae-520f-4557-8ffd-ab60cbb68812" containerName="payload-pre-processing" containerID="cri-o://69d0a3b5870d84a0100266dd65465f8556a48de1b8d7402ccc4c954407dcd5d3" gracePeriod=25
Oct 31 17:42:37.433598 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:37.421755    5003 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-worker-w4-1c0bfd-754b9cb7cf-gpdmq" podUID="6eff589e-d19b-4ea9-898e-85009de000eb" containerName="payload-processing" containerID="cri-o://77c1d72a93c4020e18c5448d9f83ef56527d53248911d93608aa0f6cea15b656" gracePeriod=25
Oct 31 17:42:37.553960 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:37.487946    5003 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-worker-w1-0e59ca-6c6556b595-dq7d4" podUID="5a745358-9cc6-464a-a00d-a25d6b205bab" containerName="payload-pre-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 31 17:42:37.652848 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:37.652790    5003 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-1c0bfd/distinct-w4-1c0bfd-kserve-867858548f-46gwg" podUID="93f16294-fc40-477d-90b3-d02640037d5b" containerName="main" probeResult="failure" output="Get \"https://10.132.0.94:8000/ready\": context deadline exceeded"
Oct 31 17:42:37.686500 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:37.686381    5003 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-b78c31/distinct-2-w5-b78c31-kserve-5f4f9d4bb5-ss7g2" podUID="9cc6d7e8-30de-4173-9974-1f1a4fd08e1c" containerName="main" probeResult="failure" output="Get \"https://10.132.0.99:8000/ready\": context deadline exceeded"
Oct 31 17:42:37.812671 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:37.806762    5003 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-1c0bfd/premium-w4-1c0bfd-kserve-d78fbb98-psx55" podUID="34bdffed-87b8-4e7a-b182-f069d081bd62" containerName="main" probeResult="failure" output="Get \"https://10.132.0.74:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 31 17:42:38.073343 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:38.073302    5003 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-ee816e/simulator-w0-ee816e-kserve-5bd4657dc-9rlm4" podUID="620f499f-36d7-4900-abbe-98ee5cf5d96c" containerName="main" probeResult="failure" output="Get \"https://10.132.0.72:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 31 17:42:38.080176 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:38.080119    5003 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-b78c31/distinct-w5-b78c31-kserve-77ccb69d98-p2zct" podUID="fcf01e9c-57fb-42db-848d-d314c615bd67" containerName="main" probeResult="failure" output="Get \"https://10.132.0.93:8000/ready\": context deadline exceeded"
Oct 31 17:42:38.080556 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:38.080515    5003 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-ee816e/distinct-w0-ee816e-kserve-564f897f89-kglpl" podUID="82b982f8-de44-449d-b4a6-dc8f5824bf35" containerName="main" probeResult="failure" output="Get \"https://10.132.0.91:8000/ready\": context deadline exceeded"
Oct 31 17:42:38.084980 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:38.084933    5003 prober.go:122] "Probe failed" probeType="Readiness" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-82w89" podUID="ef5a065b-f98e-4d14-810f-2d0c42c58ce6" containerName="main" probeResult="failure" output="Get \"https://10.132.0.54:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 31 17:42:38.180684 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:38.179665    5003 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-b78c31/simulator-w5-b78c31-kserve-95df74778-fpvpr" podUID="665d75c7-8ba5-49e1-87a7-51a18ae6f369" containerName="main" probeResult="failure" output="Get \"https://10.132.0.73:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 31 17:42:38.704826 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:38.704778    5003 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-b78c31/distinct-2-w5-b78c31-kserve-5f4f9d4bb5-ss7g2" podUID="9cc6d7e8-30de-4173-9974-1f1a4fd08e1c" containerName="main" probeResult="failure" output="Get \"https://10.132.0.99:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 31 17:42:38.729671 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:38.717923    5003 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-1c0bfd/distinct-w4-1c0bfd-kserve-867858548f-46gwg" podUID="93f16294-fc40-477d-90b3-d02640037d5b" containerName="main" probeResult="failure" output="Get \"https://10.132.0.94:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 31 17:42:38.817813 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:38.815110    5003 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-1c0bfd/premium-w4-1c0bfd-kserve-d78fbb98-psx55" podUID="34bdffed-87b8-4e7a-b182-f069d081bd62" containerName="main" probeResult="failure" output="Get \"https://10.132.0.74:8000/ready\": context deadline exceeded"
Oct 31 17:42:39.121865 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:39.121810    5003 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-b78c31/distinct-w5-b78c31-kserve-77ccb69d98-p2zct" podUID="fcf01e9c-57fb-42db-848d-d314c615bd67" containerName="main" probeResult="failure" output="Get \"https://10.132.0.93:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 31 17:42:39.145672 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:39.131173    5003 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-ee816e/simulator-w0-ee816e-kserve-5bd4657dc-9rlm4" podUID="620f499f-36d7-4900-abbe-98ee5cf5d96c" containerName="main" probeResult="failure" output="Get \"https://10.132.0.72:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 31 17:42:39.145672 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:39.131586    5003 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-ee816e/distinct-w0-ee816e-kserve-564f897f89-kglpl" podUID="82b982f8-de44-449d-b4a6-dc8f5824bf35" containerName="main" probeResult="failure" output="Get \"https://10.132.0.91:8000/ready\": context deadline exceeded"
Oct 31 17:42:39.145672 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:39.131906    5003 prober.go:122] "Probe failed" probeType="Readiness" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-82w89" podUID="ef5a065b-f98e-4d14-810f-2d0c42c58ce6" containerName="main" probeResult="failure" output="Get \"https://10.132.0.54:8000/ready\": context deadline exceeded"
Oct 31 17:42:39.245078 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:39.245025    5003 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-b78c31/simulator-w5-b78c31-kserve-95df74778-fpvpr" podUID="665d75c7-8ba5-49e1-87a7-51a18ae6f369" containerName="main" probeResult="failure" output="Get \"https://10.132.0.73:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 31 17:42:39.308010 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:39.307957    5003 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-worker-w0-ee816e-7d6bc48879-mmfcd" podUID="7a49c490-67e7-4f7e-8ce9-11def81392e4" containerName="payload-processing" containerID="cri-o://fa00b801b3196dd63e6b0384954eca3509bdbaf78ed687304fb321ea3ed57e64" gracePeriod=25
Oct 31 17:42:39.521733 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:39.489576    5003 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w5-b78c31/distinct-w5-b78c31-kserve-77ccb69d98-p2zct" podUID="fcf01e9c-57fb-42db-848d-d314c615bd67" containerName="main" containerID="cri-o://8ec4032c3e41e43dd8aab3fb1c9200d548ed26e84398fd0b61c2784d7e286aac" gracePeriod=45
Oct 31 17:42:39.538357 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:39.538309    5003 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w5-b78c31/distinct-2-w5-b78c31-kserve-5f4f9d4bb5-ss7g2" podUID="9cc6d7e8-30de-4173-9974-1f1a4fd08e1c" containerName="main" containerID="cri-o://d5784dbef515bf6d57b395bed5f0579e48dc680622a22131fbee541d3795ea23" gracePeriod=45
Oct 31 17:42:39.592848 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:39.582162    5003 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-ee816e-7cd5d5699-t92fc" podUID="d0144654-e609-4e0f-9c06-7522cefcf9f0" containerName="payload-pre-processing" containerID="cri-o://e48f4c71eedc524f09c49d937c9b74783151265e70eb1cec84560e88c7ee0e4c" gracePeriod=25
Oct 31 17:42:39.855018 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:39.786828    5003 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-b78c31/distinct-2-w5-b78c31-kserve-5f4f9d4bb5-ss7g2" podUID="9cc6d7e8-30de-4173-9974-1f1a4fd08e1c" containerName="main" probeResult="failure" output="Get \"https://10.132.0.99:8000/ready\": context deadline exceeded"
Oct 31 17:42:39.855018 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:39.802850    5003 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-1c0bfd/distinct-w4-1c0bfd-kserve-867858548f-46gwg" podUID="93f16294-fc40-477d-90b3-d02640037d5b" containerName="main" probeResult="failure" output="Get \"https://10.132.0.94:8000/ready\": context deadline exceeded"
Oct 31 17:42:39.908144 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:39.904829    5003 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-1c0bfd/premium-w4-1c0bfd-kserve-d78fbb98-psx55" podUID="34bdffed-87b8-4e7a-b182-f069d081bd62" containerName="main" probeResult="failure" output="Get \"https://10.132.0.74:8000/ready\": context deadline exceeded"
Oct 31 17:42:40.154672 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:40.134141    5003 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-b78c31/distinct-w5-b78c31-kserve-77ccb69d98-p2zct" podUID="fcf01e9c-57fb-42db-848d-d314c615bd67" containerName="main" probeResult="failure" output="Get \"https://10.132.0.93:8000/ready\": context deadline exceeded"
Oct 31 17:42:40.154672 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:40.148162    5003 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-ee816e/simulator-w0-ee816e-kserve-5bd4657dc-9rlm4" podUID="620f499f-36d7-4900-abbe-98ee5cf5d96c" containerName="main" probeResult="failure" output="Get \"https://10.132.0.72:8000/ready\": context deadline exceeded"
Oct 31 17:42:40.155096 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:40.155041    5003 prober.go:122] "Probe failed" probeType="Readiness" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-82w89" podUID="ef5a065b-f98e-4d14-810f-2d0c42c58ce6" containerName="main" probeResult="failure" output="Get \"https://10.132.0.54:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 31 17:42:40.169015 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:40.155251    5003 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-ee816e/distinct-w0-ee816e-kserve-564f897f89-kglpl" podUID="82b982f8-de44-449d-b4a6-dc8f5824bf35" containerName="main" probeResult="failure" output="Get \"https://10.132.0.91:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 31 17:42:40.236446 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:40.226760    5003 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w5-b78c31/simulator-w5-b78c31-kserve-95df74778-fpvpr" podUID="665d75c7-8ba5-49e1-87a7-51a18ae6f369" containerName="main" containerID="cri-o://077723067de6d165c413d9d4fe52d1a8cc9a99ebb335b1c23df06dd67df67c6b" gracePeriod=45
Oct 31 17:42:40.254833 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:40.254784    5003 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-b78c31/simulator-w5-b78c31-kserve-95df74778-fpvpr" podUID="665d75c7-8ba5-49e1-87a7-51a18ae6f369" containerName="main" probeResult="failure" output="Get \"https://10.132.0.73:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 31 17:42:40.316910 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:40.316868    5003 patch_prober.go:29] interesting pod/e2e-worker-w2-5c446c-openshift-default-797c6dc855-nd8tv container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.77:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 31 17:42:40.377672 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:40.352834    5003 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w2-5c446c-openshift-default-797c6dc855-nd8tv" podUID="6de961b6-2fb6-404d-9db2-594a7ef76ccb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.77:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 31 17:42:40.429667 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:40.428835    5003 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w3-cf0a86-c788d8d8f-r22w9"
Oct 31 17:42:40.580138 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:40.580098    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7804a34f-1c95-4057-8131-39e8bec72e57-plugins-config-volume" pod "7804a34f-1c95-4057-8131-39e8bec72e57" (UID: "7804a34f-1c95-4057-8131-39e8bec72e57"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 17:42:40.679694 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:40.667577    5003 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-b78c31/distinct-2-w5-b78c31-kserve-5f4f9d4bb5-ss7g2" podUID="9cc6d7e8-30de-4173-9974-1f1a4fd08e1c" containerName="main" probeResult="failure" output="Get \"https://10.132.0.99:8000/ready\": read tcp 10.132.0.2:35846->10.132.0.99:8000: read: connection reset by peer"
Oct 31 17:42:40.743681 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:40.737217    5003 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-b78c31/distinct-2-w5-b78c31-kserve-5f4f9d4bb5-ss7g2" podUID="9cc6d7e8-30de-4173-9974-1f1a4fd08e1c" containerName="main" probeResult="failure" output="Get \"https://10.132.0.99:8000/ready\": dial tcp 10.132.0.99:8000: connect: connection refused"
Oct 31 17:42:40.801265 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:40.783686    5003 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w3-cf0a86-c788d8d8f-r22w9"
Oct 31 17:42:40.848730 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:40.824010    5003 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-1c0bfd/distinct-w4-1c0bfd-kserve-867858548f-46gwg" podUID="93f16294-fc40-477d-90b3-d02640037d5b" containerName="main" probeResult="failure" output="Get \"https://10.132.0.94:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 31 17:42:40.947541 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:40.947194    5003 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-1c0bfd/premium-w4-1c0bfd-kserve-d78fbb98-psx55" podUID="34bdffed-87b8-4e7a-b182-f069d081bd62" containerName="main" probeResult="failure" output="Get \"https://10.132.0.74:8000/ready\": context deadline exceeded"
Oct 31 17:42:41.060669 ip-10-0-138-17 kubenswrapper[5003]: E1031 17:42:41.056412    5003 kubelet.go:2711] "Housekeeping took longer than expected" err="housekeeping took too long" expected="1s" actual="1.022s"
Oct 31 17:42:41.060669 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:41.056456    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w3-cf0a86-c788d8d8f-r22w9" event={"ID":"7804a34f-1c95-4057-8131-39e8bec72e57","Type":"ContainerDied","Data":"f07f174fd80344435a04a565c79614b6f084386b3ab9bb99f72c8c2d1eb72a95"}
Oct 31 17:42:41.060669 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:41.056530    5003 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-f64ceb2b-xh2mb"]
Oct 31 17:42:41.074095 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:40.574636    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/7804a34f-1c95-4057-8131-39e8bec72e57-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7804a34f-1c95-4057-8131-39e8bec72e57-plugins-config-volume\") pod \"7804a34f-1c95-4057-8131-39e8bec72e57\" (UID: \"7804a34f-1c95-4057-8131-39e8bec72e57\") "
Oct 31 17:42:41.074720 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:41.074687    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/7804a34f-1c95-4057-8131-39e8bec72e57-kube-api-access-lqj7l\" (UniqueName: \"kubernetes.io/projected/7804a34f-1c95-4057-8131-39e8bec72e57-kube-api-access-lqj7l\") pod \"7804a34f-1c95-4057-8131-39e8bec72e57\" (UID: \"7804a34f-1c95-4057-8131-39e8bec72e57\") "
Oct 31 17:42:41.115899 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:41.086675    5003 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7804a34f-1c95-4057-8131-39e8bec72e57-plugins-config-volume\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:42:41.117029 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:41.083515    5003 cpu_manager.go:414] "containerMap: removing container" podUID="7804a34f-1c95-4057-8131-39e8bec72e57" containerName="payload-processing"
Oct 31 17:42:41.117196 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:41.117177    5003 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="7804a34f-1c95-4057-8131-39e8bec72e57" containerName="payload-processing"
Oct 31 17:42:41.117305 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:41.117292    5003 cpu_manager.go:414] "containerMap: removing container" podUID="66d82d62-6b08-42ed-8b29-a47110c86879" containerName="revoke-keys"
Oct 31 17:42:41.117404 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:41.117391    5003 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="66d82d62-6b08-42ed-8b29-a47110c86879" containerName="revoke-keys"
Oct 31 17:42:41.117521 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:41.117508    5003 cpu_manager.go:414] "containerMap: removing container" podUID="801db2fa-c695-4267-a534-5a024d355c57" containerName="payload-pre-processing"
Oct 31 17:42:41.117605 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:41.117593    5003 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="801db2fa-c695-4267-a534-5a024d355c57" containerName="payload-pre-processing"
Oct 31 17:42:41.117716 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:41.117704    5003 cpu_manager.go:414] "containerMap: removing container" podUID="69ade7b0-0eb9-4426-901e-9bb7acdf1c1f" containerName="payload-processing"
Oct 31 17:42:41.117797 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:41.117786    5003 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="69ade7b0-0eb9-4426-901e-9bb7acdf1c1f" containerName="payload-processing"
Oct 31 17:42:41.118158 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:41.118136    5003 memory_manager.go:365] "RemoveStaleState removing state" podUID="7804a34f-1c95-4057-8131-39e8bec72e57" containerName="payload-processing"
Oct 31 17:42:41.118312 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:41.118298    5003 memory_manager.go:365] "RemoveStaleState removing state" podUID="66d82d62-6b08-42ed-8b29-a47110c86879" containerName="revoke-keys"
Oct 31 17:42:41.118428 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:41.118415    5003 memory_manager.go:365] "RemoveStaleState removing state" podUID="801db2fa-c695-4267-a534-5a024d355c57" containerName="payload-pre-processing"
Oct 31 17:42:41.118517 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:41.118506    5003 memory_manager.go:365] "RemoveStaleState removing state" podUID="69ade7b0-0eb9-4426-901e-9bb7acdf1c1f" containerName="payload-processing"
Oct 31 17:42:41.120700 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:41.074313    5003 scope.go:122] "RemoveContainer" containerID="e62cc85dcfe147870753f54ee06f3070b37a30ab64836a6e78ed1b0c56e41593"
Oct 31 17:42:41.121398 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:41.113414    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7804a34f-1c95-4057-8131-39e8bec72e57-kube-api-access-lqj7l" pod "7804a34f-1c95-4057-8131-39e8bec72e57" (UID: "7804a34f-1c95-4057-8131-39e8bec72e57"). InnerVolumeSpecName "kube-api-access-lqj7l". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 17:42:41.148268 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:41.148180    5003 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-b78c31/distinct-w5-b78c31-kserve-77ccb69d98-p2zct" podUID="fcf01e9c-57fb-42db-848d-d314c615bd67" containerName="main" probeResult="failure" output="Get \"https://10.132.0.93:8000/ready\": context deadline exceeded"
Oct 31 17:42:41.187337 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:41.167524    5003 prober.go:122] "Probe failed" probeType="Readiness" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-82w89" podUID="ef5a065b-f98e-4d14-810f-2d0c42c58ce6" containerName="main" probeResult="failure" output="Get \"https://10.132.0.54:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 31 17:42:41.188912 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:41.167572    5003 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-ee816e/simulator-w0-ee816e-kserve-5bd4657dc-9rlm4" podUID="620f499f-36d7-4900-abbe-98ee5cf5d96c" containerName="main" probeResult="failure" output="Get \"https://10.132.0.72:8000/ready\": context deadline exceeded"
Oct 31 17:42:41.210240 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:41.210206    5003 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-f64ceb2b-xh2mb"]
Oct 31 17:42:41.210489 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:41.210473    5003 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w3-cf0a86-openshift-default-595bfdc58c-jwvk2"]
Oct 31 17:42:41.226814 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:41.226780    5003 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lqj7l\" (UniqueName: \"kubernetes.io/projected/7804a34f-1c95-4057-8131-39e8bec72e57-kube-api-access-lqj7l\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:42:41.685229 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:41.169817    5003 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-ee816e/distinct-w0-ee816e-kserve-564f897f89-kglpl" podUID="82b982f8-de44-449d-b4a6-dc8f5824bf35" containerName="main" probeResult="failure" output="Get \"https://10.132.0.91:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 31 17:42:41.702353 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:41.228992    5003 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-f64ceb2b-xh2mb"
Oct 31 17:42:41.745682 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:41.229152    5003 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w3-cf0a86-openshift-default-595bfdc58c-jwvk2" podUID="3dac59b3-ae83-496f-87cb-16c7fd249497" containerName="istio-proxy" containerID="cri-o://13e041a079399f46c303c38488c6ecb78bf58d112509e980ab7c81f5263337e7" gracePeriod=30
Oct 31 17:42:41.772923 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:41.229549    5003 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-processing-e2e-worker-w3-cf0a86-c788d8d8f-r22w9" podUID="7804a34f-1c95-4057-8131-39e8bec72e57" containerName="payload-processing" probeResult="failure" output="timeout: failed to connect service \"10.132.0.60:50052\" within 1s: context deadline exceeded"
Oct 31 17:42:41.778818 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:41.778785    5003 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-worker-w3-cf0a86-c788d8d8f-r22w9"
Oct 31 17:42:41.786919 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:41.356080    5003 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-processing-e2e-worker-w0-ee816e-7d6bc48879-mmfcd" podUID="7a49c490-67e7-4f7e-8ce9-11def81392e4" containerName="payload-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 31 17:42:42.064672 ip-10-0-138-17 kubenswrapper[5003]: E1031 17:42:41.398394    5003 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-tdzz5" containerName="extractor"
Oct 31 17:42:42.588812 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:41.398459    5003 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w4-1c0bfd/premium-w4-1c0bfd-kserve-d78fbb98-psx55" podUID="34bdffed-87b8-4e7a-b182-f069d081bd62" containerName="main" containerID="cri-o://e780db873a69f8c9a7b3c27619a1a620aafd4c76c61a95df8723ee2d402db409" gracePeriod=45
Oct 31 17:42:42.752066 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:42.752006    5003 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-ee816e/distinct-w0-ee816e-kserve-564f897f89-kglpl" podUID="82b982f8-de44-449d-b4a6-dc8f5824bf35" containerName="main" probeResult="failure" output="Get \"https://10.132.0.91:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 31 17:42:42.763667 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:41.427154    5003 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-b78c31/distinct-w5-b78c31-kserve-77ccb69d98-p2zct" podUID="fcf01e9c-57fb-42db-848d-d314c615bd67" containerName="main" probeResult="failure" output="Get \"https://10.132.0.93:8000/ready\": read tcp 10.132.0.2:42720->10.132.0.93:8000: read: connection reset by peer"
Oct 31 17:42:42.775729 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:41.509501    5003 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-b78c31/simulator-w5-b78c31-kserve-95df74778-fpvpr" podUID="665d75c7-8ba5-49e1-87a7-51a18ae6f369" containerName="main" probeResult="failure" output="Get \"https://10.132.0.73:8000/ready\": context deadline exceeded"
Oct 31 17:42:42.804690 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:41.400319    5003 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-ee816e-7cd5d5699-t92fc" podUID="d0144654-e609-4e0f-9c06-7522cefcf9f0" containerName="payload-pre-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 31 17:42:42.804690 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:42:41.229659    5003 logging.go:55] [core] [Channel #1064 SubChannel #1065]grpc: addrConn.createTransport failed to connect to {Addr: "10.132.0.60:50052", ServerName: "10.132.0.60:50052", BalancerAttributes: {"<%!p(pickfirstleaf.managedByPickfirstKeyType={})>": "<%!p(bool=true)>" }}. Err: connection error: desc = "transport: Error while dialing: dial tcp 10.132.0.60:50052: operation was canceled"
Oct 31 17:42:42.804690 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:41.244378    5003 patch_prober.go:29] interesting pod/e2e-worker-w6-d80080-openshift-default-956cddf57-rdglw container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.101:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 31 17:42:42.804690 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:42.799998    5003 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w6-d80080-openshift-default-956cddf57-rdglw" podUID="eeb8afc2-1a66-4c38-9fb3-04ccd09083a2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.101:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 31 17:42:42.804690 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:41.837487    5003 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w3-cf0a86-openshift-default-595bfdc58c-knt8p"]
Oct 31 17:42:42.849720 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:41.398167    5003 patch_prober.go:29] interesting pod/e2e-worker-w6-d80080-openshift-default-956cddf57-5f59v container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.89:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 31 17:42:42.870671 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:42.851038    5003 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w6-d80080-openshift-default-956cddf57-5f59v" podUID="503ff30a-8065-430d-a685-89ff4ec49f7c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.89:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 31 17:42:42.982458 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:41.988738    5003 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-1c0bfd/premium-w4-1c0bfd-kserve-d78fbb98-psx55" podUID="34bdffed-87b8-4e7a-b182-f069d081bd62" containerName="main" probeResult="failure" output="Get \"https://10.132.0.74:8000/ready\": context deadline exceeded"
Oct 31 17:42:43.075761 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:42.213590    5003 prober.go:122] "Probe failed" probeType="Readiness" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-82w89" podUID="ef5a065b-f98e-4d14-810f-2d0c42c58ce6" containerName="main" probeResult="failure" output="Get \"https://10.132.0.54:8000/ready\": context deadline exceeded"
Oct 31 17:42:43.109728 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:42.213627    5003 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-ee816e/simulator-w0-ee816e-kserve-5bd4657dc-9rlm4" podUID="620f499f-36d7-4900-abbe-98ee5cf5d96c" containerName="main" probeResult="failure" output="Get \"https://10.132.0.72:8000/ready\": context deadline exceeded"
Oct 31 17:42:43.109728 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:42.798915    5003 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-b78c31/distinct-w5-b78c31-kserve-77ccb69d98-p2zct" podUID="fcf01e9c-57fb-42db-848d-d314c615bd67" containerName="main" probeResult="failure" output="Get \"https://10.132.0.93:8000/ready\": dial tcp 10.132.0.93:8000: connect: connection refused"
Oct 31 17:42:43.109728 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:41.836541    5003 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\""
Oct 31 17:42:43.109728 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:41.634831    5003 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-b78c31/distinct-2-w5-b78c31-kserve-5f4f9d4bb5-ss7g2" podUID="9cc6d7e8-30de-4173-9974-1f1a4fd08e1c" containerName="main" probeResult="failure" output="Get \"https://10.132.0.99:8000/ready\": dial tcp 10.132.0.99:8000: connect: connection refused"
Oct 31 17:42:43.109728 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:41.836693    5003 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-mr9x2\""
Oct 31 17:42:43.109728 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:42.868750    5003 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-b78c31/simulator-w5-b78c31-kserve-95df74778-fpvpr" podUID="665d75c7-8ba5-49e1-87a7-51a18ae6f369" containerName="main" probeResult="failure" output="Get \"https://10.132.0.73:8000/ready\": read tcp 10.132.0.2:56180->10.132.0.73:8000: read: connection reset by peer"
Oct 31 17:42:43.109728 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:41.868319    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vmtph\" (UniqueName: \"kubernetes.io/projected/bfa2dbca-7f50-4a7a-97a7-e780fa561f47-kube-api-access-vmtph\") pod \"maas-api-revoke-sub-f64ceb2b-xh2mb\" (UID: \"bfa2dbca-7f50-4a7a-97a7-e780fa561f47\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-f64ceb2b-xh2mb"
Oct 31 17:42:43.109728 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:43.105338    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/bfa2dbca-7f50-4a7a-97a7-e780fa561f47-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-f64ceb2b-xh2mb\" (UID: \"bfa2dbca-7f50-4a7a-97a7-e780fa561f47\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-f64ceb2b-xh2mb"
Oct 31 17:42:43.109728 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:43.105561    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/bfa2dbca-7f50-4a7a-97a7-e780fa561f47-maas-api-xks-ca\") pod \"maas-api-revoke-sub-f64ceb2b-xh2mb\" (UID: \"bfa2dbca-7f50-4a7a-97a7-e780fa561f47\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-f64ceb2b-xh2mb"
Oct 31 17:42:43.162669 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:43.147583    5003 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-b78c31/simulator-w5-b78c31-kserve-95df74778-fpvpr" podUID="665d75c7-8ba5-49e1-87a7-51a18ae6f369" containerName="main" probeResult="failure" output="Get \"https://10.132.0.73:8000/ready\": dial tcp 10.132.0.73:8000: connect: connection refused"
Oct 31 17:42:43.162669 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:43.147699    5003 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-b78c31/distinct-2-w5-b78c31-kserve-5f4f9d4bb5-ss7g2" podUID="9cc6d7e8-30de-4173-9974-1f1a4fd08e1c" containerName="main" probeResult="failure" output="Get \"https://10.132.0.99:8000/ready\": dial tcp 10.132.0.99:8000: connect: connection refused"
Oct 31 17:42:43.162669 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:43.147762    5003 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-b78c31/distinct-w5-b78c31-kserve-77ccb69d98-p2zct" podUID="fcf01e9c-57fb-42db-848d-d314c615bd67" containerName="main" probeResult="failure" output="Get \"https://10.132.0.93:8000/ready\": dial tcp 10.132.0.93:8000: connect: connection refused"
Oct 31 17:42:43.173045 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:42.951170    5003 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w3-cf0a86-openshift-default-595bfdc58c-knt8p" podUID="ebe4bd91-be4d-4d45-89f7-5aa595b9e2aa" containerName="istio-proxy" containerID="cri-o://669bf380ab9a48852a83ab1bc90c18f6989affedc423c648fb7ed3c031cc4ff6" gracePeriod=30
Oct 31 17:42:43.173045 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:41.900876    5003 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-1c0bfd/distinct-w4-1c0bfd-kserve-867858548f-46gwg" podUID="93f16294-fc40-477d-90b3-d02640037d5b" containerName="main" probeResult="failure" output="Get \"https://10.132.0.94:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 31 17:42:43.173045 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:41.463780    5003 patch_prober.go:29] interesting pod/e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-64dkg container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.92:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 31 17:42:43.173045 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:43.164466    5003 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-64dkg" podUID="73f3a3b3-a5dd-4054-be25-5e23a820c5fe" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.92:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 31 17:42:43.173045 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:41.769851    5003 patch_prober.go:29] interesting pod/e2e-worker-w0-ee816e-openshift-default-c4db85b5c-7pwpp container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 31 17:42:43.173045 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:43.164560    5003 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w0-ee816e-openshift-default-c4db85b5c-7pwpp" podUID="a79988d8-d286-43ae-914b-bd1f6db3eb11" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 31 17:42:43.173045 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:42.032041    5003 patch_prober.go:29] interesting pod/e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-bpm5b container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.84:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 31 17:42:43.173045 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:43.164609    5003 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-bpm5b" podUID="9bf16293-fd1c-421b-9f91-3c7178ed7cd3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.84:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 31 17:42:43.173045 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:42.469205    5003 patch_prober.go:29] interesting pod/e2e-worker-w0-ee816e-openshift-default-c4db85b5c-qm655 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.97:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 31 17:42:43.173045 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:43.164666    5003 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w0-ee816e-openshift-default-c4db85b5c-qm655" podUID="d2652cf4-9d2a-480e-ad8a-946d0d4b90f3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.97:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 31 17:42:43.217227 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:43.217188    5003 prober.go:122] "Probe failed" probeType="Liveness" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-82w89" podUID="ef5a065b-f98e-4d14-810f-2d0c42c58ce6" containerName="main" probeResult="failure" output="Get \"https://10.132.0.54:8000/health\": context deadline exceeded"
Oct 31 17:42:43.313670 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:43.291658    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/bfa2dbca-7f50-4a7a-97a7-e780fa561f47-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-f64ceb2b-xh2mb\" (UID: \"bfa2dbca-7f50-4a7a-97a7-e780fa561f47\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-f64ceb2b-xh2mb"
Oct 31 17:42:43.356918 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:43.356769    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/bfa2dbca-7f50-4a7a-97a7-e780fa561f47-maas-api-xks-ca\") pod \"maas-api-revoke-sub-f64ceb2b-xh2mb\" (UID: \"bfa2dbca-7f50-4a7a-97a7-e780fa561f47\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-f64ceb2b-xh2mb"
Oct 31 17:42:43.357257 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:43.357232    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vmtph\" (UniqueName: \"kubernetes.io/projected/bfa2dbca-7f50-4a7a-97a7-e780fa561f47-kube-api-access-vmtph\") pod \"maas-api-revoke-sub-f64ceb2b-xh2mb\" (UID: \"bfa2dbca-7f50-4a7a-97a7-e780fa561f47\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-f64ceb2b-xh2mb"
Oct 31 17:42:43.357930 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:43.316375    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/bfa2dbca-7f50-4a7a-97a7-e780fa561f47-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-f64ceb2b-xh2mb\" (UID: \"bfa2dbca-7f50-4a7a-97a7-e780fa561f47\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-f64ceb2b-xh2mb"
Oct 31 17:42:43.384829 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:43.377222    5003 patch_prober.go:29] interesting pod/e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-mst4q container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.103:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 31 17:42:43.385125 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:43.385083    5003 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-mst4q" podUID="fa5b3d0d-4ae9-4f60-8af5-571df26ba157" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.103:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 31 17:42:43.449805 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:43.442421    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vmtph\" (UniqueName: \"kubernetes.io/projected/bfa2dbca-7f50-4a7a-97a7-e780fa561f47-kube-api-access-vmtph\") pod \"maas-api-revoke-sub-f64ceb2b-xh2mb\" (UID: \"bfa2dbca-7f50-4a7a-97a7-e780fa561f47\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-f64ceb2b-xh2mb"
Oct 31 17:42:43.560796 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:43.560755    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/bfa2dbca-7f50-4a7a-97a7-e780fa561f47-maas-api-xks-ca\") pod \"maas-api-revoke-sub-f64ceb2b-xh2mb\" (UID: \"bfa2dbca-7f50-4a7a-97a7-e780fa561f47\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-f64ceb2b-xh2mb"
Oct 31 17:42:43.563108 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:43.563061    5003 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w0-ee816e/distinct-w0-ee816e-kserve-564f897f89-kglpl" podUID="82b982f8-de44-449d-b4a6-dc8f5824bf35" containerName="main" containerID="cri-o://5ba6b2db40dd0fae9c50b42561f442c785684a1b1b1c9e5508407fdc625ed92a" gracePeriod=45
Oct 31 17:42:43.565086 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:43.565053    5003 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-processing-e2e-worker-w5-b78c31-86cdfb657c-m4s5d" podUID="06aa3682-3041-49d8-b240-761092b11dc9" containerName="payload-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 31 17:42:43.588669 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:43.573141    5003 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-b78c31/distinct-2-w5-b78c31-kserve-5f4f9d4bb5-ss7g2" podUID="9cc6d7e8-30de-4173-9974-1f1a4fd08e1c" containerName="main" probeResult="failure" output="Get \"https://10.132.0.99:8000/ready\": dial tcp 10.132.0.99:8000: connect: connection refused"
Oct 31 17:42:43.588669 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:43.578151    5003 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-f64ceb2b-xh2mb"
Oct 31 17:42:43.705170 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:43.705128    5003 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-82w89"
Oct 31 17:42:43.705424 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:43.705403    5003 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w3-cf0a86-openshift-default-595bfdc58c-jg25b"]
Oct 31 17:42:43.705583 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:43.705568    5003 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w2-5c446c-openshift-default-797c6dc855-v5k9r"]
Oct 31 17:42:43.705876 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:43.705858    5003 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w2-5c446c-openshift-default-797c6dc855-w477z"]
Oct 31 17:42:43.706145 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:43.706128    5003 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w2-5c446c-openshift-default-797c6dc855-nd8tv"]
Oct 31 17:42:43.706302 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:43.706289    5003 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w2-5c446c-openshift-default-797c6dc855-rtzkv"]
Oct 31 17:42:43.706732 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:43.706702    5003 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w2-5c446c-openshift-default-797c6dc855-rtzkv" podUID="80900980-7b5e-4d15-a9db-279185d25b57" containerName="istio-proxy" containerID="cri-o://1f3b2bf06f9049ce80d34c68d2cf5be1c701f068ac3e2d6d9ee9d5463b12eb29" gracePeriod=30
Oct 31 17:42:43.710110 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:43.710080    5003 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w3-cf0a86-openshift-default-595bfdc58c-jg25b" podUID="61193be6-6ada-48ff-9e96-700c73f018dd" containerName="istio-proxy" containerID="cri-o://15223b5a03fae4c192405ab90afbea6bc329c562bbc20103f6a231f371f1d23e" gracePeriod=30
Oct 31 17:42:43.710600 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:43.710573    5003 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w2-5c446c-openshift-default-797c6dc855-v5k9r" podUID="ef941538-5385-4d44-98cd-ffddd91e9dc5" containerName="istio-proxy" containerID="cri-o://30c12535f0c7c5fa7b42e42386e0219a6c8fb87af5a09c9aac4edac282a087b1" gracePeriod=30
Oct 31 17:42:43.723425 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:43.723391    5003 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w2-5c446c-openshift-default-797c6dc855-w477z" podUID="a92e2f56-5eb4-4b64-9947-25e1f0d51c30" containerName="istio-proxy" containerID="cri-o://88f32c22ff949f40ab5613152bad312210dc8e101df7d91e55a418b417b6426d" gracePeriod=30
Oct 31 17:42:43.754036 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:43.734998    5003 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w2-5c446c-openshift-default-797c6dc855-nd8tv" podUID="6de961b6-2fb6-404d-9db2-594a7ef76ccb" containerName="istio-proxy" containerID="cri-o://52c5c37ad0287ee27616dbe9180e24eb2b511582d0419ad96d3978d8fba03075" gracePeriod=30
Oct 31 17:42:43.754332 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:43.745822    5003 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w0-ee816e/distinct-w0-ee816e-kserve-564f897f89-kglpl"
Oct 31 17:42:43.780840 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:43.780248    5003 generic.go:356] "Generic (PLEG): container finished" podID="fcf01e9c-57fb-42db-848d-d314c615bd67" containerID="8ec4032c3e41e43dd8aab3fb1c9200d548ed26e84398fd0b61c2784d7e286aac" exitCode=0
Oct 31 17:42:43.780840 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:43.780572    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w5-b78c31/distinct-w5-b78c31-kserve-77ccb69d98-p2zct" event={"ID":"fcf01e9c-57fb-42db-848d-d314c615bd67","Type":"ContainerDied","Data":"8ec4032c3e41e43dd8aab3fb1c9200d548ed26e84398fd0b61c2784d7e286aac"}
Oct 31 17:42:43.829075 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:43.829036    5003 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w6-d80080-7f8f6c66c-btxwt"]
Oct 31 17:42:43.878825 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:43.872510    5003 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w3-cf0a86-c788d8d8f-r22w9"]
Oct 31 17:42:43.882000 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:43.881971    5003 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w3-cf0a86-c788d8d8f-r22w9"]
Oct 31 17:42:43.977728 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:43.956496    5003 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w4-1c0bfd/distinct-w4-1c0bfd-kserve-867858548f-46gwg" podUID="93f16294-fc40-477d-90b3-d02640037d5b" containerName="main" containerID="cri-o://3c88eb21e2c9f22f24802e047713e8ac735028ced9afeb22f315dc365eacd1dc" gracePeriod=43
Oct 31 17:42:44.168688 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:44.158409    5003 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-ee816e/distinct-w0-ee816e-kserve-564f897f89-kglpl" podUID="82b982f8-de44-449d-b4a6-dc8f5824bf35" containerName="main" probeResult="failure" output="Get \"https://10.132.0.91:8000/ready\": EOF"
Oct 31 17:42:44.168688 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:44.162565    5003 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-ee816e/distinct-w0-ee816e-kserve-564f897f89-kglpl" podUID="82b982f8-de44-449d-b4a6-dc8f5824bf35" containerName="main" probeResult="failure" output="Get \"https://10.132.0.91:8000/ready\": dial tcp 10.132.0.91:8000: connect: connection refused"
Oct 31 17:42:44.222370 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:44.219611    5003 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-1c0bfd/premium-w4-1c0bfd-kserve-d78fbb98-psx55" podUID="34bdffed-87b8-4e7a-b182-f069d081bd62" containerName="main" probeResult="failure" output="Get \"https://10.132.0.74:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 31 17:42:44.222370 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:44.219963    5003 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w0-ee816e/simulator-w0-ee816e-kserve-5bd4657dc-9rlm4" podUID="620f499f-36d7-4900-abbe-98ee5cf5d96c" containerName="main" containerID="cri-o://1a17a8851924632e8cf69c5a657cbcf25016d6fa290fd85247d9e29cca4170fa" gracePeriod=44
Oct 31 17:42:44.222370 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:44.221270    5003 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-ee816e/simulator-w0-ee816e-kserve-5bd4657dc-9rlm4" podUID="620f499f-36d7-4900-abbe-98ee5cf5d96c" containerName="main" probeResult="failure" output="Get \"https://10.132.0.72:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 31 17:42:44.305426 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:44.238417    5003 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-b78c31/distinct-w5-b78c31-kserve-77ccb69d98-p2zct" podUID="fcf01e9c-57fb-42db-848d-d314c615bd67" containerName="main" probeResult="failure" output="Get \"https://10.132.0.93:8000/ready\": dial tcp 10.132.0.93:8000: connect: connection refused"
Oct 31 17:42:44.322382 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:44.310512    5003 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-ee816e/simulator-w0-ee816e-kserve-5bd4657dc-9rlm4" podUID="620f499f-36d7-4900-abbe-98ee5cf5d96c" containerName="main" probeResult="failure" output="Get \"https://10.132.0.72:8000/ready\": dial tcp 10.132.0.72:8000: connect: connection refused"
Oct 31 17:42:44.322382 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:44.310684    5003 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-1c0bfd/premium-w4-1c0bfd-kserve-d78fbb98-psx55" podUID="34bdffed-87b8-4e7a-b182-f069d081bd62" containerName="main" probeResult="failure" output="Get \"https://10.132.0.74:8000/ready\": dial tcp 10.132.0.74:8000: connect: connection refused"
Oct 31 17:42:44.322382 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:44.321030    5003 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-b78c31/simulator-w5-b78c31-kserve-95df74778-fpvpr" podUID="665d75c7-8ba5-49e1-87a7-51a18ae6f369" containerName="main" probeResult="failure" output="Get \"https://10.132.0.73:8000/ready\": dial tcp 10.132.0.73:8000: connect: connection refused"
Oct 31 17:42:44.410033 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:44.409246    5003 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-1c0bfd/distinct-w4-1c0bfd-kserve-867858548f-46gwg" podUID="93f16294-fc40-477d-90b3-d02640037d5b" containerName="main" probeResult="failure" output="Get \"https://10.132.0.94:8000/ready\": EOF"
Oct 31 17:42:44.420825 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:44.413555    5003 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="7804a34f-1c95-4057-8131-39e8bec72e57" path="/var/lib/kubelet/pods/7804a34f-1c95-4057-8131-39e8bec72e57/volumes"
Oct 31 17:42:44.420825 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:44.414327    5003 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w4-1c0bfd/distinct-w4-1c0bfd-kserve-867858548f-46gwg"
Oct 31 17:42:44.420825 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:44.414404    5003 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w0-ee816e/distinct-w0-ee816e-kserve-564f897f89-kglpl"
Oct 31 17:42:44.565695 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:44.565605    5003 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-1c0bfd/distinct-w4-1c0bfd-kserve-867858548f-46gwg" podUID="93f16294-fc40-477d-90b3-d02640037d5b" containerName="main" probeResult="failure" output="Get \"https://10.132.0.94:8000/ready\": dial tcp 10.132.0.94:8000: connect: connection refused"
Oct 31 17:42:44.566029 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:44.565987    5003 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w4-1c0bfd/distinct-w4-1c0bfd-kserve-867858548f-46gwg"
Oct 31 17:42:44.566421 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:44.566381    5003 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-b78c31/distinct-2-w5-b78c31-kserve-5f4f9d4bb5-ss7g2" podUID="9cc6d7e8-30de-4173-9974-1f1a4fd08e1c" containerName="main" probeResult="failure" output="Get \"https://10.132.0.99:8000/ready\": dial tcp 10.132.0.99:8000: connect: connection refused"
Oct 31 17:42:44.600694 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:44.600626    5003 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w5-b78c31/distinct-w5-b78c31-kserve-77ccb69d98-p2zct"
Oct 31 17:42:44.618489 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:44.616544    5003 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-fdac4c5b-4jxs4"]
Oct 31 17:42:44.618489 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:44.617604    5003 cpu_manager.go:414] "containerMap: removing container" podUID="fcf01e9c-57fb-42db-848d-d314c615bd67" containerName="main"
Oct 31 17:42:44.618489 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:44.617626    5003 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="fcf01e9c-57fb-42db-848d-d314c615bd67" containerName="main"
Oct 31 17:42:44.618489 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:44.617939    5003 memory_manager.go:365] "RemoveStaleState removing state" podUID="fcf01e9c-57fb-42db-848d-d314c615bd67" containerName="main"
Oct 31 17:42:44.621401 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:44.619924    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/fcf01e9c-57fb-42db-848d-d314c615bd67-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fcf01e9c-57fb-42db-848d-d314c615bd67-tmp-dir\") pod \"fcf01e9c-57fb-42db-848d-d314c615bd67\" (UID: \"fcf01e9c-57fb-42db-848d-d314c615bd67\") "
Oct 31 17:42:44.621401 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:44.620001    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/fcf01e9c-57fb-42db-848d-d314c615bd67-tls-certs\" (UniqueName: \"kubernetes.io/secret/fcf01e9c-57fb-42db-848d-d314c615bd67-tls-certs\") pod \"fcf01e9c-57fb-42db-848d-d314c615bd67\" (UID: \"fcf01e9c-57fb-42db-848d-d314c615bd67\") "
Oct 31 17:42:44.621401 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:44.620052    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/fcf01e9c-57fb-42db-848d-d314c615bd67-kube-api-access-4p9pl\" (UniqueName: \"kubernetes.io/projected/fcf01e9c-57fb-42db-848d-d314c615bd67-kube-api-access-4p9pl\") pod \"fcf01e9c-57fb-42db-848d-d314c615bd67\" (UID: \"fcf01e9c-57fb-42db-848d-d314c615bd67\") "
Oct 31 17:42:44.621401 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:44.620261    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/fcf01e9c-57fb-42db-848d-d314c615bd67-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fcf01e9c-57fb-42db-848d-d314c615bd67-model-cache\") pod \"fcf01e9c-57fb-42db-848d-d314c615bd67\" (UID: \"fcf01e9c-57fb-42db-848d-d314c615bd67\") "
Oct 31 17:42:44.621401 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:44.620350    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/fcf01e9c-57fb-42db-848d-d314c615bd67-home\" (UniqueName: \"kubernetes.io/empty-dir/fcf01e9c-57fb-42db-848d-d314c615bd67-home\") pod \"fcf01e9c-57fb-42db-848d-d314c615bd67\" (UID: \"fcf01e9c-57fb-42db-848d-d314c615bd67\") "
Oct 31 17:42:44.621401 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:44.620378    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/fcf01e9c-57fb-42db-848d-d314c615bd67-dshm\" (UniqueName: \"kubernetes.io/empty-dir/fcf01e9c-57fb-42db-848d-d314c615bd67-dshm\") pod \"fcf01e9c-57fb-42db-848d-d314c615bd67\" (UID: \"fcf01e9c-57fb-42db-848d-d314c615bd67\") "
Oct 31 17:42:44.622947 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:44.622723    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fcf01e9c-57fb-42db-848d-d314c615bd67-home" pod "fcf01e9c-57fb-42db-848d-d314c615bd67" (UID: "fcf01e9c-57fb-42db-848d-d314c615bd67"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 17:42:44.622947 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:44.622800    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fcf01e9c-57fb-42db-848d-d314c615bd67-tmp-dir" pod "fcf01e9c-57fb-42db-848d-d314c615bd67" (UID: "fcf01e9c-57fb-42db-848d-d314c615bd67"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 17:42:44.622947 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:44.622864    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fcf01e9c-57fb-42db-848d-d314c615bd67-model-cache" pod "fcf01e9c-57fb-42db-848d-d314c615bd67" (UID: "fcf01e9c-57fb-42db-848d-d314c615bd67"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 17:42:44.624440 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:44.624401    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fcf01e9c-57fb-42db-848d-d314c615bd67-dshm" pod "fcf01e9c-57fb-42db-848d-d314c615bd67" (UID: "fcf01e9c-57fb-42db-848d-d314c615bd67"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 17:42:44.628183 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:44.627639    5003 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-fdac4c5b-4jxs4"
Oct 31 17:42:44.644175 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:44.644125    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fcf01e9c-57fb-42db-848d-d314c615bd67-kube-api-access-4p9pl" pod "fcf01e9c-57fb-42db-848d-d314c615bd67" (UID: "fcf01e9c-57fb-42db-848d-d314c615bd67"). InnerVolumeSpecName "kube-api-access-4p9pl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 17:42:44.653067 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:44.652871    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fcf01e9c-57fb-42db-848d-d314c615bd67-tls-certs" pod "fcf01e9c-57fb-42db-848d-d314c615bd67" (UID: "fcf01e9c-57fb-42db-848d-d314c615bd67"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 17:42:44.680111 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:44.679785    5003 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-fdac4c5b-4jxs4"]
Oct 31 17:42:44.734012 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:44.733190    5003 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fcf01e9c-57fb-42db-848d-d314c615bd67-tmp-dir\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:42:44.734012 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:44.733223    5003 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fcf01e9c-57fb-42db-848d-d314c615bd67-tls-certs\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:42:44.734012 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:44.733237    5003 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4p9pl\" (UniqueName: \"kubernetes.io/projected/fcf01e9c-57fb-42db-848d-d314c615bd67-kube-api-access-4p9pl\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:42:44.734012 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:44.733254    5003 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fcf01e9c-57fb-42db-848d-d314c615bd67-model-cache\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:42:44.734012 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:44.733267    5003 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fcf01e9c-57fb-42db-848d-d314c615bd67-home\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:42:44.734012 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:44.733279    5003 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fcf01e9c-57fb-42db-848d-d314c615bd67-dshm\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:42:44.758420 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:44.757454    5003 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w1-0e59ca-6c6556b595-dq7d4"
Oct 31 17:42:44.774369 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:44.774339    5003 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-ee816e/distinct-w0-ee816e-kserve-564f897f89-kglpl"
Oct 31 17:42:44.784491 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:44.784451    5003 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-1c0bfd/premium-w4-1c0bfd-kserve-d78fbb98-psx55" podUID="34bdffed-87b8-4e7a-b182-f069d081bd62" containerName="main" probeResult="failure" output="Get \"https://10.132.0.74:8000/ready\": dial tcp 10.132.0.74:8000: connect: connection refused"
Oct 31 17:42:44.817099 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:44.817035    5003 generic.go:356] "Generic (PLEG): container finished" podID="34bdffed-87b8-4e7a-b182-f069d081bd62" containerID="e780db873a69f8c9a7b3c27619a1a620aafd4c76c61a95df8723ee2d402db409" exitCode=0
Oct 31 17:42:44.817216 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:44.817105    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-1c0bfd/premium-w4-1c0bfd-kserve-d78fbb98-psx55" event={"ID":"34bdffed-87b8-4e7a-b182-f069d081bd62","Type":"ContainerDied","Data":"e780db873a69f8c9a7b3c27619a1a620aafd4c76c61a95df8723ee2d402db409"}
Oct 31 17:42:44.836939 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:44.836801    5003 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-f64ceb2b-xh2mb"]
Oct 31 17:42:44.837818 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:44.837789    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/82b982f8-de44-449d-b4a6-dc8f5824bf35-kube-api-access-flgwf\" (UniqueName: \"kubernetes.io/projected/82b982f8-de44-449d-b4a6-dc8f5824bf35-kube-api-access-flgwf\") pod \"82b982f8-de44-449d-b4a6-dc8f5824bf35\" (UID: \"82b982f8-de44-449d-b4a6-dc8f5824bf35\") "
Oct 31 17:42:44.837992 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:44.837880    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/5a745358-9cc6-464a-a00d-a25d6b205bab-kube-api-access-c9wxx\" (UniqueName: \"kubernetes.io/projected/5a745358-9cc6-464a-a00d-a25d6b205bab-kube-api-access-c9wxx\") pod \"5a745358-9cc6-464a-a00d-a25d6b205bab\" (UID: \"5a745358-9cc6-464a-a00d-a25d6b205bab\") "
Oct 31 17:42:44.837992 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:44.837974    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/82b982f8-de44-449d-b4a6-dc8f5824bf35-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/82b982f8-de44-449d-b4a6-dc8f5824bf35-model-cache\") pod \"82b982f8-de44-449d-b4a6-dc8f5824bf35\" (UID: \"82b982f8-de44-449d-b4a6-dc8f5824bf35\") "
Oct 31 17:42:44.838111 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:44.838015    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/5a745358-9cc6-464a-a00d-a25d6b205bab-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5a745358-9cc6-464a-a00d-a25d6b205bab-plugins-config-volume\") pod \"5a745358-9cc6-464a-a00d-a25d6b205bab\" (UID: \"5a745358-9cc6-464a-a00d-a25d6b205bab\") "
Oct 31 17:42:44.838111 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:44.838046    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/82b982f8-de44-449d-b4a6-dc8f5824bf35-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/82b982f8-de44-449d-b4a6-dc8f5824bf35-tmp-dir\") pod \"82b982f8-de44-449d-b4a6-dc8f5824bf35\" (UID: \"82b982f8-de44-449d-b4a6-dc8f5824bf35\") "
Oct 31 17:42:44.838111 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:44.838103    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/82b982f8-de44-449d-b4a6-dc8f5824bf35-dshm\" (UniqueName: \"kubernetes.io/empty-dir/82b982f8-de44-449d-b4a6-dc8f5824bf35-dshm\") pod \"82b982f8-de44-449d-b4a6-dc8f5824bf35\" (UID: \"82b982f8-de44-449d-b4a6-dc8f5824bf35\") "
Oct 31 17:42:44.838847 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:44.838214    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/82b982f8-de44-449d-b4a6-dc8f5824bf35-tls-certs\" (UniqueName: \"kubernetes.io/secret/82b982f8-de44-449d-b4a6-dc8f5824bf35-tls-certs\") pod \"82b982f8-de44-449d-b4a6-dc8f5824bf35\" (UID: \"82b982f8-de44-449d-b4a6-dc8f5824bf35\") "
Oct 31 17:42:44.838847 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:44.838251    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/82b982f8-de44-449d-b4a6-dc8f5824bf35-home\" (UniqueName: \"kubernetes.io/empty-dir/82b982f8-de44-449d-b4a6-dc8f5824bf35-home\") pod \"82b982f8-de44-449d-b4a6-dc8f5824bf35\" (UID: \"82b982f8-de44-449d-b4a6-dc8f5824bf35\") "
Oct 31 17:42:44.838847 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:44.838513    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/c04e8e25-b143-4ff0-85d4-a5f8e569887f-maas-api-xks-ca\") pod \"maas-api-revoke-sub-fdac4c5b-4jxs4\" (UID: \"c04e8e25-b143-4ff0-85d4-a5f8e569887f\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-fdac4c5b-4jxs4"
Oct 31 17:42:44.838847 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:44.838704    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q9dmw\" (UniqueName: \"kubernetes.io/projected/c04e8e25-b143-4ff0-85d4-a5f8e569887f-kube-api-access-q9dmw\") pod \"maas-api-revoke-sub-fdac4c5b-4jxs4\" (UID: \"c04e8e25-b143-4ff0-85d4-a5f8e569887f\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-fdac4c5b-4jxs4"
Oct 31 17:42:44.838847 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:44.838797    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/c04e8e25-b143-4ff0-85d4-a5f8e569887f-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-fdac4c5b-4jxs4\" (UID: \"c04e8e25-b143-4ff0-85d4-a5f8e569887f\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-fdac4c5b-4jxs4"
Oct 31 17:42:44.844314 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:44.844026    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/82b982f8-de44-449d-b4a6-dc8f5824bf35-home" pod "82b982f8-de44-449d-b4a6-dc8f5824bf35" (UID: "82b982f8-de44-449d-b4a6-dc8f5824bf35"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 17:42:44.847525 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:44.847003    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5a745358-9cc6-464a-a00d-a25d6b205bab-plugins-config-volume" pod "5a745358-9cc6-464a-a00d-a25d6b205bab" (UID: "5a745358-9cc6-464a-a00d-a25d6b205bab"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 17:42:44.859266 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:44.858223    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/82b982f8-de44-449d-b4a6-dc8f5824bf35-model-cache" pod "82b982f8-de44-449d-b4a6-dc8f5824bf35" (UID: "82b982f8-de44-449d-b4a6-dc8f5824bf35"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 17:42:44.859536 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:44.859484    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/82b982f8-de44-449d-b4a6-dc8f5824bf35-tmp-dir" pod "82b982f8-de44-449d-b4a6-dc8f5824bf35" (UID: "82b982f8-de44-449d-b4a6-dc8f5824bf35"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 17:42:44.861071 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:44.860909    5003 generic.go:356] "Generic (PLEG): container finished" podID="665d75c7-8ba5-49e1-87a7-51a18ae6f369" containerID="077723067de6d165c413d9d4fe52d1a8cc9a99ebb335b1c23df06dd67df67c6b" exitCode=0
Oct 31 17:42:44.861071 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:44.861018    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w5-b78c31/simulator-w5-b78c31-kserve-95df74778-fpvpr" event={"ID":"665d75c7-8ba5-49e1-87a7-51a18ae6f369","Type":"ContainerDied","Data":"077723067de6d165c413d9d4fe52d1a8cc9a99ebb335b1c23df06dd67df67c6b"}
Oct 31 17:42:44.887698 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:44.882976    5003 generic.go:356] "Generic (PLEG): container finished" podID="93f16294-fc40-477d-90b3-d02640037d5b" containerID="3c88eb21e2c9f22f24802e047713e8ac735028ced9afeb22f315dc365eacd1dc" exitCode=0
Oct 31 17:42:44.887698 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:44.883086    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-1c0bfd/distinct-w4-1c0bfd-kserve-867858548f-46gwg" event={"ID":"93f16294-fc40-477d-90b3-d02640037d5b","Type":"ContainerDied","Data":"3c88eb21e2c9f22f24802e047713e8ac735028ced9afeb22f315dc365eacd1dc"}
Oct 31 17:42:44.887698 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:44.887202    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w5-b78c31/distinct-w5-b78c31-kserve-77ccb69d98-p2zct" event={"ID":"fcf01e9c-57fb-42db-848d-d314c615bd67","Type":"ContainerDied","Data":"05a191c43af6dd6029573980603d59e61de2fa21455d9264e966f7993a788ed3"}
Oct 31 17:42:44.887698 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:44.887251    5003 scope.go:122] "RemoveContainer" containerID="8ec4032c3e41e43dd8aab3fb1c9200d548ed26e84398fd0b61c2784d7e286aac"
Oct 31 17:42:44.891979 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:44.888111    5003 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w5-b78c31/distinct-w5-b78c31-kserve-77ccb69d98-p2zct"
Oct 31 17:42:44.916182 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:44.914926    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5a745358-9cc6-464a-a00d-a25d6b205bab-kube-api-access-c9wxx" pod "5a745358-9cc6-464a-a00d-a25d6b205bab" (UID: "5a745358-9cc6-464a-a00d-a25d6b205bab"). InnerVolumeSpecName "kube-api-access-c9wxx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 17:42:44.921737 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:44.920891    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/82b982f8-de44-449d-b4a6-dc8f5824bf35-kube-api-access-flgwf" pod "82b982f8-de44-449d-b4a6-dc8f5824bf35" (UID: "82b982f8-de44-449d-b4a6-dc8f5824bf35"). InnerVolumeSpecName "kube-api-access-flgwf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 17:42:44.922759 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:44.922035    5003 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-1c0bfd/distinct-w4-1c0bfd-kserve-867858548f-46gwg"
Oct 31 17:42:44.926081 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:44.926024    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/82b982f8-de44-449d-b4a6-dc8f5824bf35-tls-certs" pod "82b982f8-de44-449d-b4a6-dc8f5824bf35" (UID: "82b982f8-de44-449d-b4a6-dc8f5824bf35"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 17:42:44.927007 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:44.926849    5003 generic.go:356] "Generic (PLEG): container finished" podID="9cc6d7e8-30de-4173-9974-1f1a4fd08e1c" containerID="d5784dbef515bf6d57b395bed5f0579e48dc680622a22131fbee541d3795ea23" exitCode=0
Oct 31 17:42:44.927007 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:44.926949    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w5-b78c31/distinct-2-w5-b78c31-kserve-5f4f9d4bb5-ss7g2" event={"ID":"9cc6d7e8-30de-4173-9974-1f1a4fd08e1c","Type":"ContainerDied","Data":"d5784dbef515bf6d57b395bed5f0579e48dc680622a22131fbee541d3795ea23"}
Oct 31 17:42:44.928625 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:44.928602    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/82b982f8-de44-449d-b4a6-dc8f5824bf35-dshm" pod "82b982f8-de44-449d-b4a6-dc8f5824bf35" (UID: "82b982f8-de44-449d-b4a6-dc8f5824bf35"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 17:42:44.939799 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:44.939368    5003 generic.go:356] "Generic (PLEG): container finished" podID="620f499f-36d7-4900-abbe-98ee5cf5d96c" containerID="1a17a8851924632e8cf69c5a657cbcf25016d6fa290fd85247d9e29cca4170fa" exitCode=0
Oct 31 17:42:44.939799 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:44.939491    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-ee816e/simulator-w0-ee816e-kserve-5bd4657dc-9rlm4" event={"ID":"620f499f-36d7-4900-abbe-98ee5cf5d96c","Type":"ContainerDied","Data":"1a17a8851924632e8cf69c5a657cbcf25016d6fa290fd85247d9e29cca4170fa"}
Oct 31 17:42:44.939799 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:44.939776    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/93f16294-fc40-477d-90b3-d02640037d5b-home\" (UniqueName: \"kubernetes.io/empty-dir/93f16294-fc40-477d-90b3-d02640037d5b-home\") pod \"93f16294-fc40-477d-90b3-d02640037d5b\" (UID: \"93f16294-fc40-477d-90b3-d02640037d5b\") "
Oct 31 17:42:44.940023 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:44.939822    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/93f16294-fc40-477d-90b3-d02640037d5b-kube-api-access-k652l\" (UniqueName: \"kubernetes.io/projected/93f16294-fc40-477d-90b3-d02640037d5b-kube-api-access-k652l\") pod \"93f16294-fc40-477d-90b3-d02640037d5b\" (UID: \"93f16294-fc40-477d-90b3-d02640037d5b\") "
Oct 31 17:42:44.940023 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:44.939876    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/93f16294-fc40-477d-90b3-d02640037d5b-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/93f16294-fc40-477d-90b3-d02640037d5b-model-cache\") pod \"93f16294-fc40-477d-90b3-d02640037d5b\" (UID: \"93f16294-fc40-477d-90b3-d02640037d5b\") "
Oct 31 17:42:44.940023 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:44.939938    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/93f16294-fc40-477d-90b3-d02640037d5b-tls-certs\" (UniqueName: \"kubernetes.io/secret/93f16294-fc40-477d-90b3-d02640037d5b-tls-certs\") pod \"93f16294-fc40-477d-90b3-d02640037d5b\" (UID: \"93f16294-fc40-477d-90b3-d02640037d5b\") "
Oct 31 17:42:44.940023 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:44.939994    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/93f16294-fc40-477d-90b3-d02640037d5b-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/93f16294-fc40-477d-90b3-d02640037d5b-tmp-dir\") pod \"93f16294-fc40-477d-90b3-d02640037d5b\" (UID: \"93f16294-fc40-477d-90b3-d02640037d5b\") "
Oct 31 17:42:44.940225 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:44.940122    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/93f16294-fc40-477d-90b3-d02640037d5b-home" pod "93f16294-fc40-477d-90b3-d02640037d5b" (UID: "93f16294-fc40-477d-90b3-d02640037d5b"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 17:42:44.940345 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:44.940324    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/93f16294-fc40-477d-90b3-d02640037d5b-dshm\" (UniqueName: \"kubernetes.io/empty-dir/93f16294-fc40-477d-90b3-d02640037d5b-dshm\") pod \"93f16294-fc40-477d-90b3-d02640037d5b\" (UID: \"93f16294-fc40-477d-90b3-d02640037d5b\") "
Oct 31 17:42:44.940398 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:44.940339    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/93f16294-fc40-477d-90b3-d02640037d5b-model-cache" pod "93f16294-fc40-477d-90b3-d02640037d5b" (UID: "93f16294-fc40-477d-90b3-d02640037d5b"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 17:42:44.940731 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:44.940697    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q9dmw\" (UniqueName: \"kubernetes.io/projected/c04e8e25-b143-4ff0-85d4-a5f8e569887f-kube-api-access-q9dmw\") pod \"maas-api-revoke-sub-fdac4c5b-4jxs4\" (UID: \"c04e8e25-b143-4ff0-85d4-a5f8e569887f\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-fdac4c5b-4jxs4"
Oct 31 17:42:44.940812 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:44.940797    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/c04e8e25-b143-4ff0-85d4-a5f8e569887f-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-fdac4c5b-4jxs4\" (UID: \"c04e8e25-b143-4ff0-85d4-a5f8e569887f\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-fdac4c5b-4jxs4"
Oct 31 17:42:44.940984 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:44.940966    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/c04e8e25-b143-4ff0-85d4-a5f8e569887f-maas-api-xks-ca\") pod \"maas-api-revoke-sub-fdac4c5b-4jxs4\" (UID: \"c04e8e25-b143-4ff0-85d4-a5f8e569887f\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-fdac4c5b-4jxs4"
Oct 31 17:42:44.941122 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:44.941109    5003 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-flgwf\" (UniqueName: \"kubernetes.io/projected/82b982f8-de44-449d-b4a6-dc8f5824bf35-kube-api-access-flgwf\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:42:44.941190 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:44.941126    5003 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/93f16294-fc40-477d-90b3-d02640037d5b-home\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:42:44.941190 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:44.941139    5003 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c9wxx\" (UniqueName: \"kubernetes.io/projected/5a745358-9cc6-464a-a00d-a25d6b205bab-kube-api-access-c9wxx\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:42:44.941190 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:44.941152    5003 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/93f16294-fc40-477d-90b3-d02640037d5b-model-cache\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:42:44.941190 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:44.941160    5003 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/82b982f8-de44-449d-b4a6-dc8f5824bf35-model-cache\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:42:44.941190 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:44.941168    5003 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5a745358-9cc6-464a-a00d-a25d6b205bab-plugins-config-volume\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:42:44.941190 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:44.941177    5003 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/82b982f8-de44-449d-b4a6-dc8f5824bf35-tmp-dir\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:42:44.941478 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:44.941203    5003 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/82b982f8-de44-449d-b4a6-dc8f5824bf35-dshm\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:42:44.941478 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:44.941213    5003 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/82b982f8-de44-449d-b4a6-dc8f5824bf35-tls-certs\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:42:44.941478 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:44.941222    5003 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/82b982f8-de44-449d-b4a6-dc8f5824bf35-home\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:42:44.943214 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:44.943168    5003 generic.go:356] "Generic (PLEG): container finished" podID="5a745358-9cc6-464a-a00d-a25d6b205bab" containerID="bdff0449b0550197d2053d2a03a871c08be721dfda375c12db8c0c9bf37ba338" exitCode=0
Oct 31 17:42:44.943311 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:44.943253    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w1-0e59ca-6c6556b595-dq7d4" event={"ID":"5a745358-9cc6-464a-a00d-a25d6b205bab","Type":"ContainerDied","Data":"bdff0449b0550197d2053d2a03a871c08be721dfda375c12db8c0c9bf37ba338"}
Oct 31 17:42:44.943311 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:44.943300    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w1-0e59ca-6c6556b595-dq7d4" event={"ID":"5a745358-9cc6-464a-a00d-a25d6b205bab","Type":"ContainerDied","Data":"b720c89f6bb573f03883a5ab1ab567aaf837b2b58f76537dc5ea6791e9c2376a"}
Oct 31 17:42:44.943427 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:44.943380    5003 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w1-0e59ca-6c6556b595-dq7d4"
Oct 31 17:42:44.944171 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:44.943965    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/c04e8e25-b143-4ff0-85d4-a5f8e569887f-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-fdac4c5b-4jxs4\" (UID: \"c04e8e25-b143-4ff0-85d4-a5f8e569887f\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-fdac4c5b-4jxs4"
Oct 31 17:42:44.944305 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:44.944226    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/93f16294-fc40-477d-90b3-d02640037d5b-tmp-dir" pod "93f16294-fc40-477d-90b3-d02640037d5b" (UID: "93f16294-fc40-477d-90b3-d02640037d5b"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 17:42:44.944757 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:44.944737    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/93f16294-fc40-477d-90b3-d02640037d5b-kube-api-access-k652l" pod "93f16294-fc40-477d-90b3-d02640037d5b" (UID: "93f16294-fc40-477d-90b3-d02640037d5b"). InnerVolumeSpecName "kube-api-access-k652l". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 17:42:44.946090 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:44.946066    5003 generic.go:356] "Generic (PLEG): container finished" podID="82b982f8-de44-449d-b4a6-dc8f5824bf35" containerID="5ba6b2db40dd0fae9c50b42561f442c785684a1b1b1c9e5508407fdc625ed92a" exitCode=0
Oct 31 17:42:44.946180 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:44.946145    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-ee816e/distinct-w0-ee816e-kserve-564f897f89-kglpl" event={"ID":"82b982f8-de44-449d-b4a6-dc8f5824bf35","Type":"ContainerDied","Data":"5ba6b2db40dd0fae9c50b42561f442c785684a1b1b1c9e5508407fdc625ed92a"}
Oct 31 17:42:44.946180 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:44.946168    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-ee816e/distinct-w0-ee816e-kserve-564f897f89-kglpl" event={"ID":"82b982f8-de44-449d-b4a6-dc8f5824bf35","Type":"ContainerDied","Data":"33374cfd8b1b9adf6e7351e1cff6bb02413a8420934e2be8ab5c4b516c27d92c"}
Oct 31 17:42:44.946286 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:44.946216    5003 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-ee816e/distinct-w0-ee816e-kserve-564f897f89-kglpl"
Oct 31 17:42:44.947708 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:44.947688    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/c04e8e25-b143-4ff0-85d4-a5f8e569887f-maas-api-xks-ca\") pod \"maas-api-revoke-sub-fdac4c5b-4jxs4\" (UID: \"c04e8e25-b143-4ff0-85d4-a5f8e569887f\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-fdac4c5b-4jxs4"
Oct 31 17:42:44.948006 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:44.947977    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/93f16294-fc40-477d-90b3-d02640037d5b-dshm" pod "93f16294-fc40-477d-90b3-d02640037d5b" (UID: "93f16294-fc40-477d-90b3-d02640037d5b"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 17:42:44.951732 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:44.951683    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/93f16294-fc40-477d-90b3-d02640037d5b-tls-certs" pod "93f16294-fc40-477d-90b3-d02640037d5b" (UID: "93f16294-fc40-477d-90b3-d02640037d5b"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 17:42:44.975792 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:44.974473    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q9dmw\" (UniqueName: \"kubernetes.io/projected/c04e8e25-b143-4ff0-85d4-a5f8e569887f-kube-api-access-q9dmw\") pod \"maas-api-revoke-sub-fdac4c5b-4jxs4\" (UID: \"c04e8e25-b143-4ff0-85d4-a5f8e569887f\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-fdac4c5b-4jxs4"
Oct 31 17:42:44.986149 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:44.986119    5003 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-fdac4c5b-4jxs4"
Oct 31 17:42:45.004709 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:45.004627    5003 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w5-b78c31/distinct-w5-b78c31-kserve-77ccb69d98-p2zct"]
Oct 31 17:42:45.010579 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:45.010553    5003 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w5-b78c31/distinct-w5-b78c31-kserve-77ccb69d98-p2zct"]
Oct 31 17:42:45.043903 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:45.043868    5003 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k652l\" (UniqueName: \"kubernetes.io/projected/93f16294-fc40-477d-90b3-d02640037d5b-kube-api-access-k652l\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:42:45.044074 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:45.043914    5003 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/93f16294-fc40-477d-90b3-d02640037d5b-tls-certs\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:42:45.044074 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:45.043936    5003 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/93f16294-fc40-477d-90b3-d02640037d5b-tmp-dir\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:42:45.044074 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:45.043949    5003 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/93f16294-fc40-477d-90b3-d02640037d5b-dshm\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:42:45.084968 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:45.071850    5003 scope.go:122] "RemoveContainer" containerID="bdff0449b0550197d2053d2a03a871c08be721dfda375c12db8c0c9bf37ba338"
Oct 31 17:42:45.315730 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:45.312870    5003 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-processing-e2e-worker-w4-1c0bfd-754b9cb7cf-gpdmq" podUID="6eff589e-d19b-4ea9-898e-85009de000eb" containerName="payload-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 31 17:42:45.374764 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:45.368616    5003 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-d8e5e35c-xlfxz"]
Oct 31 17:42:45.391750 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:45.389457    5003 cpu_manager.go:414] "containerMap: removing container" podUID="5a745358-9cc6-464a-a00d-a25d6b205bab" containerName="payload-pre-processing"
Oct 31 17:42:45.391750 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:45.389482    5003 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="5a745358-9cc6-464a-a00d-a25d6b205bab" containerName="payload-pre-processing"
Oct 31 17:42:45.391750 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:45.389503    5003 cpu_manager.go:414] "containerMap: removing container" podUID="93f16294-fc40-477d-90b3-d02640037d5b" containerName="main"
Oct 31 17:42:45.391750 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:45.389509    5003 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="93f16294-fc40-477d-90b3-d02640037d5b" containerName="main"
Oct 31 17:42:45.391750 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:45.389524    5003 cpu_manager.go:414] "containerMap: removing container" podUID="82b982f8-de44-449d-b4a6-dc8f5824bf35" containerName="main"
Oct 31 17:42:45.391750 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:45.389529    5003 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="82b982f8-de44-449d-b4a6-dc8f5824bf35" containerName="main"
Oct 31 17:42:45.391750 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:45.389747    5003 memory_manager.go:365] "RemoveStaleState removing state" podUID="5a745358-9cc6-464a-a00d-a25d6b205bab" containerName="payload-pre-processing"
Oct 31 17:42:45.391750 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:45.389764    5003 memory_manager.go:365] "RemoveStaleState removing state" podUID="93f16294-fc40-477d-90b3-d02640037d5b" containerName="main"
Oct 31 17:42:45.391750 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:45.389779    5003 memory_manager.go:365] "RemoveStaleState removing state" podUID="82b982f8-de44-449d-b4a6-dc8f5824bf35" containerName="main"
Oct 31 17:42:45.437025 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:45.436996    5003 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-d8e5e35c-xlfxz"]
Oct 31 17:42:45.437268 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:45.437103    5003 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-d8e5e35c-xlfxz"
Oct 31 17:42:45.439521 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:45.437832    5003 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w1-0e59ca-6c6556b595-dq7d4"]
Oct 31 17:42:45.440257 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:45.440230    5003 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-1c0bfd/premium-w4-1c0bfd-kserve-d78fbb98-psx55"
Oct 31 17:42:45.442970 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:45.441504    5003 scope.go:122] "RemoveContainer" containerID="bdff0449b0550197d2053d2a03a871c08be721dfda375c12db8c0c9bf37ba338"
Oct 31 17:42:45.442970 ip-10-0-138-17 kubenswrapper[5003]: E1031 17:42:45.441825    5003 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bdff0449b0550197d2053d2a03a871c08be721dfda375c12db8c0c9bf37ba338\": container with ID starting with bdff0449b0550197d2053d2a03a871c08be721dfda375c12db8c0c9bf37ba338 not found: ID does not exist" containerID="bdff0449b0550197d2053d2a03a871c08be721dfda375c12db8c0c9bf37ba338"
Oct 31 17:42:45.442970 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:45.441856    5003 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bdff0449b0550197d2053d2a03a871c08be721dfda375c12db8c0c9bf37ba338"} err="failed to get container status \"bdff0449b0550197d2053d2a03a871c08be721dfda375c12db8c0c9bf37ba338\": rpc error: code = NotFound desc = could not find container \"bdff0449b0550197d2053d2a03a871c08be721dfda375c12db8c0c9bf37ba338\": container with ID starting with bdff0449b0550197d2053d2a03a871c08be721dfda375c12db8c0c9bf37ba338 not found: ID does not exist"
Oct 31 17:42:45.442970 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:45.441881    5003 scope.go:122] "RemoveContainer" containerID="5ba6b2db40dd0fae9c50b42561f442c785684a1b1b1c9e5508407fdc625ed92a"
Oct 31 17:42:45.444382 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:45.443565    5003 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-ee816e/simulator-w0-ee816e-kserve-5bd4657dc-9rlm4"
Oct 31 17:42:45.448470 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:45.446930    5003 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w5-b78c31/simulator-w5-b78c31-kserve-95df74778-fpvpr"
Oct 31 17:42:45.448470 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:45.448368    5003 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w1-0e59ca-6c6556b595-dq7d4"]
Oct 31 17:42:45.453960 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:45.449706    5003 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w5-b78c31/distinct-2-w5-b78c31-kserve-5f4f9d4bb5-ss7g2"
Oct 31 17:42:45.466824 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:45.466801    5003 scope.go:122] "RemoveContainer" containerID="5ba6b2db40dd0fae9c50b42561f442c785684a1b1b1c9e5508407fdc625ed92a"
Oct 31 17:42:45.467215 ip-10-0-138-17 kubenswrapper[5003]: E1031 17:42:45.467191    5003 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5ba6b2db40dd0fae9c50b42561f442c785684a1b1b1c9e5508407fdc625ed92a\": container with ID starting with 5ba6b2db40dd0fae9c50b42561f442c785684a1b1b1c9e5508407fdc625ed92a not found: ID does not exist" containerID="5ba6b2db40dd0fae9c50b42561f442c785684a1b1b1c9e5508407fdc625ed92a"
Oct 31 17:42:45.467266 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:45.467228    5003 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5ba6b2db40dd0fae9c50b42561f442c785684a1b1b1c9e5508407fdc625ed92a"} err="failed to get container status \"5ba6b2db40dd0fae9c50b42561f442c785684a1b1b1c9e5508407fdc625ed92a\": rpc error: code = NotFound desc = could not find container \"5ba6b2db40dd0fae9c50b42561f442c785684a1b1b1c9e5508407fdc625ed92a\": container with ID starting with 5ba6b2db40dd0fae9c50b42561f442c785684a1b1b1c9e5508407fdc625ed92a not found: ID does not exist"
Oct 31 17:42:45.479241 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:45.479215    5003 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-ee816e/distinct-w0-ee816e-kserve-564f897f89-kglpl"]
Oct 31 17:42:45.485192 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:45.485165    5003 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w0-ee816e/distinct-w0-ee816e-kserve-564f897f89-kglpl"]
Oct 31 17:42:45.582756 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:42:45.582716    5003 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc04e8e25_b143_4ff0_85d4_a5f8e569887f.slice/crio-a676607c559b0363c647b6b6bc9f50b4dbd451263b4287d4c0d0a759a24a4ffd WatchSource:0}: Error finding container a676607c559b0363c647b6b6bc9f50b4dbd451263b4287d4c0d0a759a24a4ffd: Status 404 returned error can't find the container with id a676607c559b0363c647b6b6bc9f50b4dbd451263b4287d4c0d0a759a24a4ffd
Oct 31 17:42:45.584230 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:45.584208    5003 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-fdac4c5b-4jxs4"]
Oct 31 17:42:45.588189 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:45.588160    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/665d75c7-8ba5-49e1-87a7-51a18ae6f369-tls-certs\" (UniqueName: \"kubernetes.io/secret/665d75c7-8ba5-49e1-87a7-51a18ae6f369-tls-certs\") pod \"665d75c7-8ba5-49e1-87a7-51a18ae6f369\" (UID: \"665d75c7-8ba5-49e1-87a7-51a18ae6f369\") "
Oct 31 17:42:45.588302 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:45.588246    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/620f499f-36d7-4900-abbe-98ee5cf5d96c-tls-certs\" (UniqueName: \"kubernetes.io/secret/620f499f-36d7-4900-abbe-98ee5cf5d96c-tls-certs\") pod \"620f499f-36d7-4900-abbe-98ee5cf5d96c\" (UID: \"620f499f-36d7-4900-abbe-98ee5cf5d96c\") "
Oct 31 17:42:45.588302 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:45.588290    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/9cc6d7e8-30de-4173-9974-1f1a4fd08e1c-kube-api-access-wmjk8\" (UniqueName: \"kubernetes.io/projected/9cc6d7e8-30de-4173-9974-1f1a4fd08e1c-kube-api-access-wmjk8\") pod \"9cc6d7e8-30de-4173-9974-1f1a4fd08e1c\" (UID: \"9cc6d7e8-30de-4173-9974-1f1a4fd08e1c\") "
Oct 31 17:42:45.588423 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:45.588326    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/665d75c7-8ba5-49e1-87a7-51a18ae6f369-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/665d75c7-8ba5-49e1-87a7-51a18ae6f369-tmp-dir\") pod \"665d75c7-8ba5-49e1-87a7-51a18ae6f369\" (UID: \"665d75c7-8ba5-49e1-87a7-51a18ae6f369\") "
Oct 31 17:42:45.588423 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:45.588365    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/620f499f-36d7-4900-abbe-98ee5cf5d96c-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/620f499f-36d7-4900-abbe-98ee5cf5d96c-model-cache\") pod \"620f499f-36d7-4900-abbe-98ee5cf5d96c\" (UID: \"620f499f-36d7-4900-abbe-98ee5cf5d96c\") "
Oct 31 17:42:45.588423 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:45.588398    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/665d75c7-8ba5-49e1-87a7-51a18ae6f369-dshm\" (UniqueName: \"kubernetes.io/empty-dir/665d75c7-8ba5-49e1-87a7-51a18ae6f369-dshm\") pod \"665d75c7-8ba5-49e1-87a7-51a18ae6f369\" (UID: \"665d75c7-8ba5-49e1-87a7-51a18ae6f369\") "
Oct 31 17:42:45.588573 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:45.588448    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/620f499f-36d7-4900-abbe-98ee5cf5d96c-dshm\" (UniqueName: \"kubernetes.io/empty-dir/620f499f-36d7-4900-abbe-98ee5cf5d96c-dshm\") pod \"620f499f-36d7-4900-abbe-98ee5cf5d96c\" (UID: \"620f499f-36d7-4900-abbe-98ee5cf5d96c\") "
Oct 31 17:42:45.588573 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:45.588474    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/665d75c7-8ba5-49e1-87a7-51a18ae6f369-home\" (UniqueName: \"kubernetes.io/empty-dir/665d75c7-8ba5-49e1-87a7-51a18ae6f369-home\") pod \"665d75c7-8ba5-49e1-87a7-51a18ae6f369\" (UID: \"665d75c7-8ba5-49e1-87a7-51a18ae6f369\") "
Oct 31 17:42:45.588573 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:45.588507    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/620f499f-36d7-4900-abbe-98ee5cf5d96c-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/620f499f-36d7-4900-abbe-98ee5cf5d96c-tmp-dir\") pod \"620f499f-36d7-4900-abbe-98ee5cf5d96c\" (UID: \"620f499f-36d7-4900-abbe-98ee5cf5d96c\") "
Oct 31 17:42:45.589178 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:45.589149    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/620f499f-36d7-4900-abbe-98ee5cf5d96c-model-cache" pod "620f499f-36d7-4900-abbe-98ee5cf5d96c" (UID: "620f499f-36d7-4900-abbe-98ee5cf5d96c"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 17:42:45.589405 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:45.589366    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/34bdffed-87b8-4e7a-b182-f069d081bd62-tls-certs\" (UniqueName: \"kubernetes.io/secret/34bdffed-87b8-4e7a-b182-f069d081bd62-tls-certs\") pod \"34bdffed-87b8-4e7a-b182-f069d081bd62\" (UID: \"34bdffed-87b8-4e7a-b182-f069d081bd62\") "
Oct 31 17:42:45.589472 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:45.589456    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9cc6d7e8-30de-4173-9974-1f1a4fd08e1c-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9cc6d7e8-30de-4173-9974-1f1a4fd08e1c-tmp-dir\") pod \"9cc6d7e8-30de-4173-9974-1f1a4fd08e1c\" (UID: \"9cc6d7e8-30de-4173-9974-1f1a4fd08e1c\") "
Oct 31 17:42:45.589620 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:45.589601    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/620f499f-36d7-4900-abbe-98ee5cf5d96c-home\" (UniqueName: \"kubernetes.io/empty-dir/620f499f-36d7-4900-abbe-98ee5cf5d96c-home\") pod \"620f499f-36d7-4900-abbe-98ee5cf5d96c\" (UID: \"620f499f-36d7-4900-abbe-98ee5cf5d96c\") "
Oct 31 17:42:45.589756 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:45.589685    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/665d75c7-8ba5-49e1-87a7-51a18ae6f369-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/665d75c7-8ba5-49e1-87a7-51a18ae6f369-model-cache\") pod \"665d75c7-8ba5-49e1-87a7-51a18ae6f369\" (UID: \"665d75c7-8ba5-49e1-87a7-51a18ae6f369\") "
Oct 31 17:42:45.589756 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:45.589730    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/34bdffed-87b8-4e7a-b182-f069d081bd62-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/34bdffed-87b8-4e7a-b182-f069d081bd62-model-cache\") pod \"34bdffed-87b8-4e7a-b182-f069d081bd62\" (UID: \"34bdffed-87b8-4e7a-b182-f069d081bd62\") "
Oct 31 17:42:45.589916 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:45.589765    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9cc6d7e8-30de-4173-9974-1f1a4fd08e1c-home\" (UniqueName: \"kubernetes.io/empty-dir/9cc6d7e8-30de-4173-9974-1f1a4fd08e1c-home\") pod \"9cc6d7e8-30de-4173-9974-1f1a4fd08e1c\" (UID: \"9cc6d7e8-30de-4173-9974-1f1a4fd08e1c\") "
Oct 31 17:42:45.589916 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:45.589816    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9cc6d7e8-30de-4173-9974-1f1a4fd08e1c-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9cc6d7e8-30de-4173-9974-1f1a4fd08e1c-model-cache\") pod \"9cc6d7e8-30de-4173-9974-1f1a4fd08e1c\" (UID: \"9cc6d7e8-30de-4173-9974-1f1a4fd08e1c\") "
Oct 31 17:42:45.589916 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:45.589867    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/34bdffed-87b8-4e7a-b182-f069d081bd62-home\" (UniqueName: \"kubernetes.io/empty-dir/34bdffed-87b8-4e7a-b182-f069d081bd62-home\") pod \"34bdffed-87b8-4e7a-b182-f069d081bd62\" (UID: \"34bdffed-87b8-4e7a-b182-f069d081bd62\") "
Oct 31 17:42:45.589916 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:45.589907    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/9cc6d7e8-30de-4173-9974-1f1a4fd08e1c-tls-certs\" (UniqueName: \"kubernetes.io/secret/9cc6d7e8-30de-4173-9974-1f1a4fd08e1c-tls-certs\") pod \"9cc6d7e8-30de-4173-9974-1f1a4fd08e1c\" (UID: \"9cc6d7e8-30de-4173-9974-1f1a4fd08e1c\") "
Oct 31 17:42:45.590321 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:45.590299    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/665d75c7-8ba5-49e1-87a7-51a18ae6f369-kube-api-access-nff5q\" (UniqueName: \"kubernetes.io/projected/665d75c7-8ba5-49e1-87a7-51a18ae6f369-kube-api-access-nff5q\") pod \"665d75c7-8ba5-49e1-87a7-51a18ae6f369\" (UID: \"665d75c7-8ba5-49e1-87a7-51a18ae6f369\") "
Oct 31 17:42:45.590469 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:45.590395    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9cc6d7e8-30de-4173-9974-1f1a4fd08e1c-dshm\" (UniqueName: \"kubernetes.io/empty-dir/9cc6d7e8-30de-4173-9974-1f1a4fd08e1c-dshm\") pod \"9cc6d7e8-30de-4173-9974-1f1a4fd08e1c\" (UID: \"9cc6d7e8-30de-4173-9974-1f1a4fd08e1c\") "
Oct 31 17:42:45.590547 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:45.590511    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/620f499f-36d7-4900-abbe-98ee5cf5d96c-kube-api-access-7bt8x\" (UniqueName: \"kubernetes.io/projected/620f499f-36d7-4900-abbe-98ee5cf5d96c-kube-api-access-7bt8x\") pod \"620f499f-36d7-4900-abbe-98ee5cf5d96c\" (UID: \"620f499f-36d7-4900-abbe-98ee5cf5d96c\") "
Oct 31 17:42:45.590624 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:45.590562    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/34bdffed-87b8-4e7a-b182-f069d081bd62-dshm\" (UniqueName: \"kubernetes.io/empty-dir/34bdffed-87b8-4e7a-b182-f069d081bd62-dshm\") pod \"34bdffed-87b8-4e7a-b182-f069d081bd62\" (UID: \"34bdffed-87b8-4e7a-b182-f069d081bd62\") "
Oct 31 17:42:45.590624 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:45.590618    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/34bdffed-87b8-4e7a-b182-f069d081bd62-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/34bdffed-87b8-4e7a-b182-f069d081bd62-tmp-dir\") pod \"34bdffed-87b8-4e7a-b182-f069d081bd62\" (UID: \"34bdffed-87b8-4e7a-b182-f069d081bd62\") "
Oct 31 17:42:45.590919 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:45.590899    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/34bdffed-87b8-4e7a-b182-f069d081bd62-kube-api-access-4mgwl\" (UniqueName: \"kubernetes.io/projected/34bdffed-87b8-4e7a-b182-f069d081bd62-kube-api-access-4mgwl\") pod \"34bdffed-87b8-4e7a-b182-f069d081bd62\" (UID: \"34bdffed-87b8-4e7a-b182-f069d081bd62\") "
Oct 31 17:42:45.592431 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:45.591987    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/665d75c7-8ba5-49e1-87a7-51a18ae6f369-home" pod "665d75c7-8ba5-49e1-87a7-51a18ae6f369" (UID: "665d75c7-8ba5-49e1-87a7-51a18ae6f369"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 17:42:45.592431 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:45.592177    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/620f499f-36d7-4900-abbe-98ee5cf5d96c-tmp-dir" pod "620f499f-36d7-4900-abbe-98ee5cf5d96c" (UID: "620f499f-36d7-4900-abbe-98ee5cf5d96c"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 17:42:45.594041 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:45.593223    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/620f499f-36d7-4900-abbe-98ee5cf5d96c-home" pod "620f499f-36d7-4900-abbe-98ee5cf5d96c" (UID: "620f499f-36d7-4900-abbe-98ee5cf5d96c"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 17:42:45.594041 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:45.593411    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9cc6d7e8-30de-4173-9974-1f1a4fd08e1c-tmp-dir" pod "9cc6d7e8-30de-4173-9974-1f1a4fd08e1c" (UID: "9cc6d7e8-30de-4173-9974-1f1a4fd08e1c"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 17:42:45.594041 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:45.593550    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/665d75c7-8ba5-49e1-87a7-51a18ae6f369-tmp-dir" pod "665d75c7-8ba5-49e1-87a7-51a18ae6f369" (UID: "665d75c7-8ba5-49e1-87a7-51a18ae6f369"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 17:42:45.594041 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:45.593686    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9cc6d7e8-30de-4173-9974-1f1a4fd08e1c-home" pod "9cc6d7e8-30de-4173-9974-1f1a4fd08e1c" (UID: "9cc6d7e8-30de-4173-9974-1f1a4fd08e1c"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 17:42:45.594041 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:45.593833    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/665d75c7-8ba5-49e1-87a7-51a18ae6f369-model-cache" pod "665d75c7-8ba5-49e1-87a7-51a18ae6f369" (UID: "665d75c7-8ba5-49e1-87a7-51a18ae6f369"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 17:42:45.594349 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:45.594220    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/34bdffed-87b8-4e7a-b182-f069d081bd62-model-cache" pod "34bdffed-87b8-4e7a-b182-f069d081bd62" (UID: "34bdffed-87b8-4e7a-b182-f069d081bd62"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 17:42:45.596263 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:45.596237    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2fb94\" (UniqueName: \"kubernetes.io/projected/24b256e4-f9ad-4df2-ae67-bd7ddee0118e-kube-api-access-2fb94\") pod \"maas-api-revoke-sub-d8e5e35c-xlfxz\" (UID: \"24b256e4-f9ad-4df2-ae67-bd7ddee0118e\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-d8e5e35c-xlfxz"
Oct 31 17:42:45.596577 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:45.596557    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/24b256e4-f9ad-4df2-ae67-bd7ddee0118e-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-d8e5e35c-xlfxz\" (UID: \"24b256e4-f9ad-4df2-ae67-bd7ddee0118e\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-d8e5e35c-xlfxz"
Oct 31 17:42:45.597171 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:45.597144    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/24b256e4-f9ad-4df2-ae67-bd7ddee0118e-maas-api-xks-ca\") pod \"maas-api-revoke-sub-d8e5e35c-xlfxz\" (UID: \"24b256e4-f9ad-4df2-ae67-bd7ddee0118e\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-d8e5e35c-xlfxz"
Oct 31 17:42:45.597614 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:45.597569    5003 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9cc6d7e8-30de-4173-9974-1f1a4fd08e1c-tmp-dir\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:42:45.597761 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:45.597747    5003 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/620f499f-36d7-4900-abbe-98ee5cf5d96c-home\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:42:45.601048 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:45.601024    5003 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/665d75c7-8ba5-49e1-87a7-51a18ae6f369-model-cache\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:42:45.601192 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:45.601177    5003 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/34bdffed-87b8-4e7a-b182-f069d081bd62-model-cache\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:42:45.601287 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:45.601277    5003 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9cc6d7e8-30de-4173-9974-1f1a4fd08e1c-home\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:42:45.601374 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:45.601363    5003 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/665d75c7-8ba5-49e1-87a7-51a18ae6f369-tmp-dir\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:42:45.601458 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:45.601447    5003 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/620f499f-36d7-4900-abbe-98ee5cf5d96c-model-cache\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:42:45.613788 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:45.612734    5003 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/665d75c7-8ba5-49e1-87a7-51a18ae6f369-home\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:42:45.613788 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:45.599051    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/34bdffed-87b8-4e7a-b182-f069d081bd62-tmp-dir" pod "34bdffed-87b8-4e7a-b182-f069d081bd62" (UID: "34bdffed-87b8-4e7a-b182-f069d081bd62"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 17:42:45.613788 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:45.602962    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/34bdffed-87b8-4e7a-b182-f069d081bd62-home" pod "34bdffed-87b8-4e7a-b182-f069d081bd62" (UID: "34bdffed-87b8-4e7a-b182-f069d081bd62"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 17:42:45.613788 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:45.603142    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9cc6d7e8-30de-4173-9974-1f1a4fd08e1c-model-cache" pod "9cc6d7e8-30de-4173-9974-1f1a4fd08e1c" (UID: "9cc6d7e8-30de-4173-9974-1f1a4fd08e1c"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 17:42:45.613788 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:45.607268    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9cc6d7e8-30de-4173-9974-1f1a4fd08e1c-tls-certs" pod "9cc6d7e8-30de-4173-9974-1f1a4fd08e1c" (UID: "9cc6d7e8-30de-4173-9974-1f1a4fd08e1c"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 17:42:45.613788 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:45.608386    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/34bdffed-87b8-4e7a-b182-f069d081bd62-dshm" pod "34bdffed-87b8-4e7a-b182-f069d081bd62" (UID: "34bdffed-87b8-4e7a-b182-f069d081bd62"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 17:42:45.613788 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:45.608436    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/620f499f-36d7-4900-abbe-98ee5cf5d96c-kube-api-access-7bt8x" pod "620f499f-36d7-4900-abbe-98ee5cf5d96c" (UID: "620f499f-36d7-4900-abbe-98ee5cf5d96c"). InnerVolumeSpecName "kube-api-access-7bt8x". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 17:42:45.613788 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:45.609248    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/665d75c7-8ba5-49e1-87a7-51a18ae6f369-dshm" pod "665d75c7-8ba5-49e1-87a7-51a18ae6f369" (UID: "665d75c7-8ba5-49e1-87a7-51a18ae6f369"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 17:42:45.613788 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:45.610077    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/34bdffed-87b8-4e7a-b182-f069d081bd62-kube-api-access-4mgwl" pod "34bdffed-87b8-4e7a-b182-f069d081bd62" (UID: "34bdffed-87b8-4e7a-b182-f069d081bd62"). InnerVolumeSpecName "kube-api-access-4mgwl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 17:42:45.613788 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:45.611457    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/665d75c7-8ba5-49e1-87a7-51a18ae6f369-kube-api-access-nff5q" pod "665d75c7-8ba5-49e1-87a7-51a18ae6f369" (UID: "665d75c7-8ba5-49e1-87a7-51a18ae6f369"). InnerVolumeSpecName "kube-api-access-nff5q". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 17:42:45.613788 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:45.611457    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/620f499f-36d7-4900-abbe-98ee5cf5d96c-dshm" pod "620f499f-36d7-4900-abbe-98ee5cf5d96c" (UID: "620f499f-36d7-4900-abbe-98ee5cf5d96c"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 17:42:45.613788 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:45.611477    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/665d75c7-8ba5-49e1-87a7-51a18ae6f369-tls-certs" pod "665d75c7-8ba5-49e1-87a7-51a18ae6f369" (UID: "665d75c7-8ba5-49e1-87a7-51a18ae6f369"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 17:42:45.613788 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:45.611520    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/620f499f-36d7-4900-abbe-98ee5cf5d96c-tls-certs" pod "620f499f-36d7-4900-abbe-98ee5cf5d96c" (UID: "620f499f-36d7-4900-abbe-98ee5cf5d96c"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 17:42:45.613788 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:45.612131    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9cc6d7e8-30de-4173-9974-1f1a4fd08e1c-dshm" pod "9cc6d7e8-30de-4173-9974-1f1a4fd08e1c" (UID: "9cc6d7e8-30de-4173-9974-1f1a4fd08e1c"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 17:42:45.613788 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:45.612756    5003 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/620f499f-36d7-4900-abbe-98ee5cf5d96c-tmp-dir\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:42:45.614862 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:45.614836    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/34bdffed-87b8-4e7a-b182-f069d081bd62-tls-certs" pod "34bdffed-87b8-4e7a-b182-f069d081bd62" (UID: "34bdffed-87b8-4e7a-b182-f069d081bd62"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 17:42:45.617147 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:45.617117    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9cc6d7e8-30de-4173-9974-1f1a4fd08e1c-kube-api-access-wmjk8" pod "9cc6d7e8-30de-4173-9974-1f1a4fd08e1c" (UID: "9cc6d7e8-30de-4173-9974-1f1a4fd08e1c"). InnerVolumeSpecName "kube-api-access-wmjk8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 17:42:45.713981 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:45.713933    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/24b256e4-f9ad-4df2-ae67-bd7ddee0118e-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-d8e5e35c-xlfxz\" (UID: \"24b256e4-f9ad-4df2-ae67-bd7ddee0118e\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-d8e5e35c-xlfxz"
Oct 31 17:42:45.714134 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:45.714081    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/24b256e4-f9ad-4df2-ae67-bd7ddee0118e-maas-api-xks-ca\") pod \"maas-api-revoke-sub-d8e5e35c-xlfxz\" (UID: \"24b256e4-f9ad-4df2-ae67-bd7ddee0118e\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-d8e5e35c-xlfxz"
Oct 31 17:42:45.714378 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:45.714355    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2fb94\" (UniqueName: \"kubernetes.io/projected/24b256e4-f9ad-4df2-ae67-bd7ddee0118e-kube-api-access-2fb94\") pod \"maas-api-revoke-sub-d8e5e35c-xlfxz\" (UID: \"24b256e4-f9ad-4df2-ae67-bd7ddee0118e\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-d8e5e35c-xlfxz"
Oct 31 17:42:45.714698 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:45.714679    5003 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9cc6d7e8-30de-4173-9974-1f1a4fd08e1c-model-cache\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:42:45.714828 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:45.714815    5003 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/34bdffed-87b8-4e7a-b182-f069d081bd62-home\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:42:45.714926 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:45.714914    5003 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9cc6d7e8-30de-4173-9974-1f1a4fd08e1c-tls-certs\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:42:45.715023 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:45.715010    5003 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nff5q\" (UniqueName: \"kubernetes.io/projected/665d75c7-8ba5-49e1-87a7-51a18ae6f369-kube-api-access-nff5q\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:42:45.715240 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:45.715218    5003 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9cc6d7e8-30de-4173-9974-1f1a4fd08e1c-dshm\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:42:45.715320 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:45.715245    5003 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7bt8x\" (UniqueName: \"kubernetes.io/projected/620f499f-36d7-4900-abbe-98ee5cf5d96c-kube-api-access-7bt8x\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:42:45.715320 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:45.715260    5003 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/34bdffed-87b8-4e7a-b182-f069d081bd62-dshm\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:42:45.715320 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:45.715273    5003 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/34bdffed-87b8-4e7a-b182-f069d081bd62-tmp-dir\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:42:45.715320 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:45.715286    5003 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4mgwl\" (UniqueName: \"kubernetes.io/projected/34bdffed-87b8-4e7a-b182-f069d081bd62-kube-api-access-4mgwl\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:42:45.715320 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:45.715299    5003 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/665d75c7-8ba5-49e1-87a7-51a18ae6f369-tls-certs\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:42:45.715320 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:45.715312    5003 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/620f499f-36d7-4900-abbe-98ee5cf5d96c-tls-certs\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:42:45.715538 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:45.715325    5003 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wmjk8\" (UniqueName: \"kubernetes.io/projected/9cc6d7e8-30de-4173-9974-1f1a4fd08e1c-kube-api-access-wmjk8\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:42:45.715538 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:45.715338    5003 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/665d75c7-8ba5-49e1-87a7-51a18ae6f369-dshm\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:42:45.715538 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:45.715353    5003 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/620f499f-36d7-4900-abbe-98ee5cf5d96c-dshm\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:42:45.715538 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:45.715178    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/24b256e4-f9ad-4df2-ae67-bd7ddee0118e-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-d8e5e35c-xlfxz\" (UID: \"24b256e4-f9ad-4df2-ae67-bd7ddee0118e\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-d8e5e35c-xlfxz"
Oct 31 17:42:45.715538 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:45.715365    5003 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/34bdffed-87b8-4e7a-b182-f069d081bd62-tls-certs\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:42:45.717047 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:45.717023    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/24b256e4-f9ad-4df2-ae67-bd7ddee0118e-maas-api-xks-ca\") pod \"maas-api-revoke-sub-d8e5e35c-xlfxz\" (UID: \"24b256e4-f9ad-4df2-ae67-bd7ddee0118e\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-d8e5e35c-xlfxz"
Oct 31 17:42:45.740068 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:45.740038    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2fb94\" (UniqueName: \"kubernetes.io/projected/24b256e4-f9ad-4df2-ae67-bd7ddee0118e-kube-api-access-2fb94\") pod \"maas-api-revoke-sub-d8e5e35c-xlfxz\" (UID: \"24b256e4-f9ad-4df2-ae67-bd7ddee0118e\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-d8e5e35c-xlfxz"
Oct 31 17:42:45.765272 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:45.765239    5003 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-d8e5e35c-xlfxz"
Oct 31 17:42:45.908269 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:45.908233    5003 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="5a745358-9cc6-464a-a00d-a25d6b205bab" path="/var/lib/kubelet/pods/5a745358-9cc6-464a-a00d-a25d6b205bab/volumes"
Oct 31 17:42:45.908926 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:45.908909    5003 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="82b982f8-de44-449d-b4a6-dc8f5824bf35" path="/var/lib/kubelet/pods/82b982f8-de44-449d-b4a6-dc8f5824bf35/volumes"
Oct 31 17:42:45.910202 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:45.909467    5003 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="fcf01e9c-57fb-42db-848d-d314c615bd67" path="/var/lib/kubelet/pods/fcf01e9c-57fb-42db-848d-d314c615bd67/volumes"
Oct 31 17:42:45.962553 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:45.962524    5003 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w5-b78c31/distinct-2-w5-b78c31-kserve-5f4f9d4bb5-ss7g2"
Oct 31 17:42:45.962553 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:45.962537    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w5-b78c31/distinct-2-w5-b78c31-kserve-5f4f9d4bb5-ss7g2" event={"ID":"9cc6d7e8-30de-4173-9974-1f1a4fd08e1c","Type":"ContainerDied","Data":"6686b395eb38b9065e585574a85284f819784a6eb0db69fe31c839be238e88bd"}
Oct 31 17:42:45.962799 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:45.962591    5003 scope.go:122] "RemoveContainer" containerID="d5784dbef515bf6d57b395bed5f0579e48dc680622a22131fbee541d3795ea23"
Oct 31 17:42:45.964137 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:45.964109    5003 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-ee816e/simulator-w0-ee816e-kserve-5bd4657dc-9rlm4"
Oct 31 17:42:45.964270 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:45.964109    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-ee816e/simulator-w0-ee816e-kserve-5bd4657dc-9rlm4" event={"ID":"620f499f-36d7-4900-abbe-98ee5cf5d96c","Type":"ContainerDied","Data":"eff87f0e3c3f2ab730c626467ac911679272e8aa7e46374cd1a608cbe1e44120"}
Oct 31 17:42:45.965820 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:45.965799    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-fdac4c5b-4jxs4" event={"ID":"c04e8e25-b143-4ff0-85d4-a5f8e569887f","Type":"ContainerStarted","Data":"a676607c559b0363c647b6b6bc9f50b4dbd451263b4287d4c0d0a759a24a4ffd"}
Oct 31 17:42:45.970186 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:45.970163    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-f64ceb2b-xh2mb" event={"ID":"bfa2dbca-7f50-4a7a-97a7-e780fa561f47","Type":"ContainerStarted","Data":"fd0cc54ed56e09a38bcadff7bec3840142c282ace89dbb47c0ee99a11075c0cd"}
Oct 31 17:42:45.970358 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:45.970341    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-f64ceb2b-xh2mb" event={"ID":"bfa2dbca-7f50-4a7a-97a7-e780fa561f47","Type":"ContainerStarted","Data":"03e5c3cee4abd9fb558d8662a27198eab4875ace0fb4c1bd4e22e2d6c8678de4"}
Oct 31 17:42:45.972947 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:45.972928    5003 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-1c0bfd/premium-w4-1c0bfd-kserve-d78fbb98-psx55"
Oct 31 17:42:45.974006 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:45.972941    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-1c0bfd/premium-w4-1c0bfd-kserve-d78fbb98-psx55" event={"ID":"34bdffed-87b8-4e7a-b182-f069d081bd62","Type":"ContainerDied","Data":"f4acfc644675ebac64edd716324f69e3c3bded63410550e53e39b51a696f4b5c"}
Oct 31 17:42:45.975691 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:45.974390    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w5-b78c31/simulator-w5-b78c31-kserve-95df74778-fpvpr" event={"ID":"665d75c7-8ba5-49e1-87a7-51a18ae6f369","Type":"ContainerDied","Data":"cba574051ea3b9c794f5c88c87eedd3fa1a3a2f26b82b8066d723a57cc13c1e7"}
Oct 31 17:42:45.975691 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:45.974457    5003 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w5-b78c31/simulator-w5-b78c31-kserve-95df74778-fpvpr"
Oct 31 17:42:45.977691 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:45.976942    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-1c0bfd/distinct-w4-1c0bfd-kserve-867858548f-46gwg" event={"ID":"93f16294-fc40-477d-90b3-d02640037d5b","Type":"ContainerDied","Data":"463c8db5622eeeafa8d291da7a8aa755ab807762d9f0820185e85d39195a8a35"}
Oct 31 17:42:45.977691 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:45.977198    5003 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-1c0bfd/distinct-w4-1c0bfd-kserve-867858548f-46gwg"
Oct 31 17:42:46.000379 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:46.000354    5003 scope.go:122] "RemoveContainer" containerID="1a17a8851924632e8cf69c5a657cbcf25016d6fa290fd85247d9e29cca4170fa"
Oct 31 17:42:46.013520 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:46.013487    5003 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-ee816e/simulator-w0-ee816e-kserve-5bd4657dc-9rlm4" podUID="620f499f-36d7-4900-abbe-98ee5cf5d96c" containerName="main" probeResult="failure" output="Get \"https://10.132.0.72:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 31 17:42:46.014765 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:46.014744    5003 scope.go:122] "RemoveContainer" containerID="e780db873a69f8c9a7b3c27619a1a620aafd4c76c61a95df8723ee2d402db409"
Oct 31 17:42:46.029211 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:46.029192    5003 scope.go:122] "RemoveContainer" containerID="077723067de6d165c413d9d4fe52d1a8cc9a99ebb335b1c23df06dd67df67c6b"
Oct 31 17:42:46.040990 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:46.040961    5003 scope.go:122] "RemoveContainer" containerID="3c88eb21e2c9f22f24802e047713e8ac735028ced9afeb22f315dc365eacd1dc"
Oct 31 17:42:46.074297 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:46.070781    5003 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-sub-f64ceb2b-xh2mb" podStartSLOduration=9.070761416 podStartE2EDuration="9.070761416s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 17:42:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 17:42:46.061089678 +0000 UTC m=+934.315944244" watchObservedRunningTime="2026-10-31 17:42:46.070761416 +0000 UTC m=+934.325615959"
Oct 31 17:42:46.101338 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:46.101305    5003 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-ee816e/simulator-w0-ee816e-kserve-5bd4657dc-9rlm4"]
Oct 31 17:42:46.106711 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:46.106683    5003 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w0-ee816e/simulator-w0-ee816e-kserve-5bd4657dc-9rlm4"]
Oct 31 17:42:46.125285 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:46.125243    5003 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-b78c31/simulator-w5-b78c31-kserve-95df74778-fpvpr" podUID="665d75c7-8ba5-49e1-87a7-51a18ae6f369" containerName="main" probeResult="failure" output="Get \"https://10.132.0.73:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 31 17:42:46.144422 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:46.144312    5003 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w5-b78c31/simulator-w5-b78c31-kserve-95df74778-fpvpr"]
Oct 31 17:42:46.157612 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:46.157576    5003 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w5-b78c31/simulator-w5-b78c31-kserve-95df74778-fpvpr"]
Oct 31 17:42:46.173361 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:42:46.173317    5003 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod24b256e4_f9ad_4df2_ae67_bd7ddee0118e.slice/crio-5f22c7e977f37d800bdf1758dfba9a9551f9b8b95bfbaf912c4ba085eb7d22f8 WatchSource:0}: Error finding container 5f22c7e977f37d800bdf1758dfba9a9551f9b8b95bfbaf912c4ba085eb7d22f8: Status 404 returned error can't find the container with id 5f22c7e977f37d800bdf1758dfba9a9551f9b8b95bfbaf912c4ba085eb7d22f8
Oct 31 17:42:46.175696 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:46.175662    5003 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-d8e5e35c-xlfxz"]
Oct 31 17:42:46.183310 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:46.183287    5003 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-1c0bfd/distinct-w4-1c0bfd-kserve-867858548f-46gwg"]
Oct 31 17:42:46.191902 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:46.191875    5003 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w4-1c0bfd/distinct-w4-1c0bfd-kserve-867858548f-46gwg"]
Oct 31 17:42:46.209951 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:46.209921    5003 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w5-b78c31/distinct-2-w5-b78c31-kserve-5f4f9d4bb5-ss7g2"]
Oct 31 17:42:46.215734 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:46.215709    5003 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w5-b78c31/distinct-2-w5-b78c31-kserve-5f4f9d4bb5-ss7g2"]
Oct 31 17:42:46.248766 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:46.248735    5003 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-1c0bfd/premium-w4-1c0bfd-kserve-d78fbb98-psx55"]
Oct 31 17:42:46.254468 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:46.254441    5003 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w4-1c0bfd/premium-w4-1c0bfd-kserve-d78fbb98-psx55"]
Oct 31 17:42:46.331820 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:46.331776    5003 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-1c0bfd-84cbc7675-n2bbv" podUID="2335abae-520f-4557-8ffd-ab60cbb68812" containerName="payload-pre-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 31 17:42:46.964879 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:46.964840    5003 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w5-b78c31-openshift-default-774cb4f6c9-nhqll"]
Oct 31 17:42:46.966035 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:46.966007    5003 cpu_manager.go:414] "containerMap: removing container" podUID="34bdffed-87b8-4e7a-b182-f069d081bd62" containerName="main"
Oct 31 17:42:46.966209 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:46.966187    5003 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="34bdffed-87b8-4e7a-b182-f069d081bd62" containerName="main"
Oct 31 17:42:46.966328 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:46.966220    5003 cpu_manager.go:414] "containerMap: removing container" podUID="9cc6d7e8-30de-4173-9974-1f1a4fd08e1c" containerName="main"
Oct 31 17:42:46.966328 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:46.966226    5003 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="9cc6d7e8-30de-4173-9974-1f1a4fd08e1c" containerName="main"
Oct 31 17:42:46.966328 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:46.966245    5003 cpu_manager.go:414] "containerMap: removing container" podUID="620f499f-36d7-4900-abbe-98ee5cf5d96c" containerName="main"
Oct 31 17:42:46.966328 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:46.966251    5003 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="620f499f-36d7-4900-abbe-98ee5cf5d96c" containerName="main"
Oct 31 17:42:46.966328 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:46.966272    5003 cpu_manager.go:414] "containerMap: removing container" podUID="665d75c7-8ba5-49e1-87a7-51a18ae6f369" containerName="main"
Oct 31 17:42:46.966328 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:46.966279    5003 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="665d75c7-8ba5-49e1-87a7-51a18ae6f369" containerName="main"
Oct 31 17:42:46.966637 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:46.966614    5003 memory_manager.go:365] "RemoveStaleState removing state" podUID="34bdffed-87b8-4e7a-b182-f069d081bd62" containerName="main"
Oct 31 17:42:46.966719 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:46.966637    5003 memory_manager.go:365] "RemoveStaleState removing state" podUID="9cc6d7e8-30de-4173-9974-1f1a4fd08e1c" containerName="main"
Oct 31 17:42:46.966719 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:46.966664    5003 memory_manager.go:365] "RemoveStaleState removing state" podUID="620f499f-36d7-4900-abbe-98ee5cf5d96c" containerName="main"
Oct 31 17:42:46.966719 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:46.966676    5003 memory_manager.go:365] "RemoveStaleState removing state" podUID="665d75c7-8ba5-49e1-87a7-51a18ae6f369" containerName="main"
Oct 31 17:42:46.971066 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:46.971045    5003 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-b78c31-openshift-default-774cb4f6c9-nhqll"
Oct 31 17:42:47.016086 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:47.016046    5003 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w5-b78c31-openshift-default-774cb4f6c9-nhqll"]
Oct 31 17:42:47.019806 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:47.019767    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-d8e5e35c-xlfxz" event={"ID":"24b256e4-f9ad-4df2-ae67-bd7ddee0118e","Type":"ContainerStarted","Data":"def3548ece19314dd11affaf05d0b4337027725aa560fd5cd6514adbc56a6298"}
Oct 31 17:42:47.019957 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:47.019830    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-d8e5e35c-xlfxz" event={"ID":"24b256e4-f9ad-4df2-ae67-bd7ddee0118e","Type":"ContainerStarted","Data":"5f22c7e977f37d800bdf1758dfba9a9551f9b8b95bfbaf912c4ba085eb7d22f8"}
Oct 31 17:42:47.028291 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:47.028257    5003 generic.go:356] "Generic (PLEG): container finished" podID="c04e8e25-b143-4ff0-85d4-a5f8e569887f" containerID="a3094af8252436d79261615de9a2316b6b74a6fd674e0b0cd261f533fc71f0eb" exitCode=0
Oct 31 17:42:47.028592 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:47.028290    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-fdac4c5b-4jxs4" event={"ID":"c04e8e25-b143-4ff0-85d4-a5f8e569887f","Type":"ContainerDied","Data":"a3094af8252436d79261615de9a2316b6b74a6fd674e0b0cd261f533fc71f0eb"}
Oct 31 17:42:47.030454 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:47.030425    5003 generic.go:356] "Generic (PLEG): container finished" podID="bfa2dbca-7f50-4a7a-97a7-e780fa561f47" containerID="fd0cc54ed56e09a38bcadff7bec3840142c282ace89dbb47c0ee99a11075c0cd" exitCode=0
Oct 31 17:42:47.030555 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:47.030537    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-f64ceb2b-xh2mb" event={"ID":"bfa2dbca-7f50-4a7a-97a7-e780fa561f47","Type":"ContainerDied","Data":"fd0cc54ed56e09a38bcadff7bec3840142c282ace89dbb47c0ee99a11075c0cd"}
Oct 31 17:42:47.038130 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:47.038105    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b0a16d54-5d2c-4c23-bf11-9cfe1844b568-workload-socket\") pod \"e2e-worker-w5-b78c31-openshift-default-774cb4f6c9-nhqll\" (UID: \"b0a16d54-5d2c-4c23-bf11-9cfe1844b568\") " pod="openshift-ingress/e2e-worker-w5-b78c31-openshift-default-774cb4f6c9-nhqll"
Oct 31 17:42:47.038271 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:47.038250    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b0a16d54-5d2c-4c23-bf11-9cfe1844b568-credential-socket\") pod \"e2e-worker-w5-b78c31-openshift-default-774cb4f6c9-nhqll\" (UID: \"b0a16d54-5d2c-4c23-bf11-9cfe1844b568\") " pod="openshift-ingress/e2e-worker-w5-b78c31-openshift-default-774cb4f6c9-nhqll"
Oct 31 17:42:47.038381 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:47.038366    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b0a16d54-5d2c-4c23-bf11-9cfe1844b568-istiod-ca-cert\") pod \"e2e-worker-w5-b78c31-openshift-default-774cb4f6c9-nhqll\" (UID: \"b0a16d54-5d2c-4c23-bf11-9cfe1844b568\") " pod="openshift-ingress/e2e-worker-w5-b78c31-openshift-default-774cb4f6c9-nhqll"
Oct 31 17:42:47.038439 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:47.038413    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b0a16d54-5d2c-4c23-bf11-9cfe1844b568-istio-data\") pod \"e2e-worker-w5-b78c31-openshift-default-774cb4f6c9-nhqll\" (UID: \"b0a16d54-5d2c-4c23-bf11-9cfe1844b568\") " pod="openshift-ingress/e2e-worker-w5-b78c31-openshift-default-774cb4f6c9-nhqll"
Oct 31 17:42:47.038525 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:47.038512    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b0a16d54-5d2c-4c23-bf11-9cfe1844b568-workload-certs\") pod \"e2e-worker-w5-b78c31-openshift-default-774cb4f6c9-nhqll\" (UID: \"b0a16d54-5d2c-4c23-bf11-9cfe1844b568\") " pod="openshift-ingress/e2e-worker-w5-b78c31-openshift-default-774cb4f6c9-nhqll"
Oct 31 17:42:47.038586 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:47.038554    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b0a16d54-5d2c-4c23-bf11-9cfe1844b568-istio-token\") pod \"e2e-worker-w5-b78c31-openshift-default-774cb4f6c9-nhqll\" (UID: \"b0a16d54-5d2c-4c23-bf11-9cfe1844b568\") " pod="openshift-ingress/e2e-worker-w5-b78c31-openshift-default-774cb4f6c9-nhqll"
Oct 31 17:42:47.038824 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:47.038796    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b0a16d54-5d2c-4c23-bf11-9cfe1844b568-istio-podinfo\") pod \"e2e-worker-w5-b78c31-openshift-default-774cb4f6c9-nhqll\" (UID: \"b0a16d54-5d2c-4c23-bf11-9cfe1844b568\") " pod="openshift-ingress/e2e-worker-w5-b78c31-openshift-default-774cb4f6c9-nhqll"
Oct 31 17:42:47.038878 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:47.038847    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b0a16d54-5d2c-4c23-bf11-9cfe1844b568-istio-envoy\") pod \"e2e-worker-w5-b78c31-openshift-default-774cb4f6c9-nhqll\" (UID: \"b0a16d54-5d2c-4c23-bf11-9cfe1844b568\") " pod="openshift-ingress/e2e-worker-w5-b78c31-openshift-default-774cb4f6c9-nhqll"
Oct 31 17:42:47.038970 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:47.038953    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jrz65\" (UniqueName: \"kubernetes.io/projected/b0a16d54-5d2c-4c23-bf11-9cfe1844b568-kube-api-access-jrz65\") pod \"e2e-worker-w5-b78c31-openshift-default-774cb4f6c9-nhqll\" (UID: \"b0a16d54-5d2c-4c23-bf11-9cfe1844b568\") " pod="openshift-ingress/e2e-worker-w5-b78c31-openshift-default-774cb4f6c9-nhqll"
Oct 31 17:42:47.070537 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:47.070478    5003 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-sub-d8e5e35c-xlfxz" podStartSLOduration=2.070458689 podStartE2EDuration="2.070458689s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 17:42:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 17:42:47.06888277 +0000 UTC m=+935.323737313" watchObservedRunningTime="2026-10-31 17:42:47.070458689 +0000 UTC m=+935.325313232"
Oct 31 17:42:47.140316 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:47.140273    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b0a16d54-5d2c-4c23-bf11-9cfe1844b568-workload-certs\") pod \"e2e-worker-w5-b78c31-openshift-default-774cb4f6c9-nhqll\" (UID: \"b0a16d54-5d2c-4c23-bf11-9cfe1844b568\") " pod="openshift-ingress/e2e-worker-w5-b78c31-openshift-default-774cb4f6c9-nhqll"
Oct 31 17:42:47.140497 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:47.140326    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b0a16d54-5d2c-4c23-bf11-9cfe1844b568-istio-token\") pod \"e2e-worker-w5-b78c31-openshift-default-774cb4f6c9-nhqll\" (UID: \"b0a16d54-5d2c-4c23-bf11-9cfe1844b568\") " pod="openshift-ingress/e2e-worker-w5-b78c31-openshift-default-774cb4f6c9-nhqll"
Oct 31 17:42:47.140497 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:47.140384    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b0a16d54-5d2c-4c23-bf11-9cfe1844b568-istio-podinfo\") pod \"e2e-worker-w5-b78c31-openshift-default-774cb4f6c9-nhqll\" (UID: \"b0a16d54-5d2c-4c23-bf11-9cfe1844b568\") " pod="openshift-ingress/e2e-worker-w5-b78c31-openshift-default-774cb4f6c9-nhqll"
Oct 31 17:42:47.140497 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:47.140413    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b0a16d54-5d2c-4c23-bf11-9cfe1844b568-istio-envoy\") pod \"e2e-worker-w5-b78c31-openshift-default-774cb4f6c9-nhqll\" (UID: \"b0a16d54-5d2c-4c23-bf11-9cfe1844b568\") " pod="openshift-ingress/e2e-worker-w5-b78c31-openshift-default-774cb4f6c9-nhqll"
Oct 31 17:42:47.140782 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:47.140506    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jrz65\" (UniqueName: \"kubernetes.io/projected/b0a16d54-5d2c-4c23-bf11-9cfe1844b568-kube-api-access-jrz65\") pod \"e2e-worker-w5-b78c31-openshift-default-774cb4f6c9-nhqll\" (UID: \"b0a16d54-5d2c-4c23-bf11-9cfe1844b568\") " pod="openshift-ingress/e2e-worker-w5-b78c31-openshift-default-774cb4f6c9-nhqll"
Oct 31 17:42:47.140782 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:47.140601    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b0a16d54-5d2c-4c23-bf11-9cfe1844b568-workload-socket\") pod \"e2e-worker-w5-b78c31-openshift-default-774cb4f6c9-nhqll\" (UID: \"b0a16d54-5d2c-4c23-bf11-9cfe1844b568\") " pod="openshift-ingress/e2e-worker-w5-b78c31-openshift-default-774cb4f6c9-nhqll"
Oct 31 17:42:47.140782 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:47.140671    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b0a16d54-5d2c-4c23-bf11-9cfe1844b568-credential-socket\") pod \"e2e-worker-w5-b78c31-openshift-default-774cb4f6c9-nhqll\" (UID: \"b0a16d54-5d2c-4c23-bf11-9cfe1844b568\") " pod="openshift-ingress/e2e-worker-w5-b78c31-openshift-default-774cb4f6c9-nhqll"
Oct 31 17:42:47.140782 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:47.140741    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b0a16d54-5d2c-4c23-bf11-9cfe1844b568-workload-certs\") pod \"e2e-worker-w5-b78c31-openshift-default-774cb4f6c9-nhqll\" (UID: \"b0a16d54-5d2c-4c23-bf11-9cfe1844b568\") " pod="openshift-ingress/e2e-worker-w5-b78c31-openshift-default-774cb4f6c9-nhqll"
Oct 31 17:42:47.141075 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:47.141003    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b0a16d54-5d2c-4c23-bf11-9cfe1844b568-workload-socket\") pod \"e2e-worker-w5-b78c31-openshift-default-774cb4f6c9-nhqll\" (UID: \"b0a16d54-5d2c-4c23-bf11-9cfe1844b568\") " pod="openshift-ingress/e2e-worker-w5-b78c31-openshift-default-774cb4f6c9-nhqll"
Oct 31 17:42:47.141354 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:47.141307    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b0a16d54-5d2c-4c23-bf11-9cfe1844b568-istiod-ca-cert\") pod \"e2e-worker-w5-b78c31-openshift-default-774cb4f6c9-nhqll\" (UID: \"b0a16d54-5d2c-4c23-bf11-9cfe1844b568\") " pod="openshift-ingress/e2e-worker-w5-b78c31-openshift-default-774cb4f6c9-nhqll"
Oct 31 17:42:47.141682 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:47.141638    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b0a16d54-5d2c-4c23-bf11-9cfe1844b568-credential-socket\") pod \"e2e-worker-w5-b78c31-openshift-default-774cb4f6c9-nhqll\" (UID: \"b0a16d54-5d2c-4c23-bf11-9cfe1844b568\") " pod="openshift-ingress/e2e-worker-w5-b78c31-openshift-default-774cb4f6c9-nhqll"
Oct 31 17:42:47.141784 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:47.141700    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b0a16d54-5d2c-4c23-bf11-9cfe1844b568-istio-data\") pod \"e2e-worker-w5-b78c31-openshift-default-774cb4f6c9-nhqll\" (UID: \"b0a16d54-5d2c-4c23-bf11-9cfe1844b568\") " pod="openshift-ingress/e2e-worker-w5-b78c31-openshift-default-774cb4f6c9-nhqll"
Oct 31 17:42:47.142132 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:47.142102    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b0a16d54-5d2c-4c23-bf11-9cfe1844b568-istiod-ca-cert\") pod \"e2e-worker-w5-b78c31-openshift-default-774cb4f6c9-nhqll\" (UID: \"b0a16d54-5d2c-4c23-bf11-9cfe1844b568\") " pod="openshift-ingress/e2e-worker-w5-b78c31-openshift-default-774cb4f6c9-nhqll"
Oct 31 17:42:47.142259 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:47.142145    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b0a16d54-5d2c-4c23-bf11-9cfe1844b568-istio-data\") pod \"e2e-worker-w5-b78c31-openshift-default-774cb4f6c9-nhqll\" (UID: \"b0a16d54-5d2c-4c23-bf11-9cfe1844b568\") " pod="openshift-ingress/e2e-worker-w5-b78c31-openshift-default-774cb4f6c9-nhqll"
Oct 31 17:42:47.143260 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:47.143240    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b0a16d54-5d2c-4c23-bf11-9cfe1844b568-istio-envoy\") pod \"e2e-worker-w5-b78c31-openshift-default-774cb4f6c9-nhqll\" (UID: \"b0a16d54-5d2c-4c23-bf11-9cfe1844b568\") " pod="openshift-ingress/e2e-worker-w5-b78c31-openshift-default-774cb4f6c9-nhqll"
Oct 31 17:42:47.143495 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:47.143469    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b0a16d54-5d2c-4c23-bf11-9cfe1844b568-istio-podinfo\") pod \"e2e-worker-w5-b78c31-openshift-default-774cb4f6c9-nhqll\" (UID: \"b0a16d54-5d2c-4c23-bf11-9cfe1844b568\") " pod="openshift-ingress/e2e-worker-w5-b78c31-openshift-default-774cb4f6c9-nhqll"
Oct 31 17:42:47.173156 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:47.173112    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jrz65\" (UniqueName: \"kubernetes.io/projected/b0a16d54-5d2c-4c23-bf11-9cfe1844b568-kube-api-access-jrz65\") pod \"e2e-worker-w5-b78c31-openshift-default-774cb4f6c9-nhqll\" (UID: \"b0a16d54-5d2c-4c23-bf11-9cfe1844b568\") " pod="openshift-ingress/e2e-worker-w5-b78c31-openshift-default-774cb4f6c9-nhqll"
Oct 31 17:42:47.178051 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:47.178024    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b0a16d54-5d2c-4c23-bf11-9cfe1844b568-istio-token\") pod \"e2e-worker-w5-b78c31-openshift-default-774cb4f6c9-nhqll\" (UID: \"b0a16d54-5d2c-4c23-bf11-9cfe1844b568\") " pod="openshift-ingress/e2e-worker-w5-b78c31-openshift-default-774cb4f6c9-nhqll"
Oct 31 17:42:47.317142 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:47.317107    5003 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-b78c31-openshift-default-774cb4f6c9-nhqll"
Oct 31 17:42:47.646064 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:42:47.646021    5003 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb0a16d54_5d2c_4c23_bf11_9cfe1844b568.slice/crio-e78fa2b166c2345efd1398fc1ad9a08cedf87b62c3a104c76182786373dd4de3 WatchSource:0}: Error finding container e78fa2b166c2345efd1398fc1ad9a08cedf87b62c3a104c76182786373dd4de3: Status 404 returned error can't find the container with id e78fa2b166c2345efd1398fc1ad9a08cedf87b62c3a104c76182786373dd4de3
Oct 31 17:42:47.646441 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:47.646415    5003 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w5-b78c31-openshift-default-774cb4f6c9-nhqll"]
Oct 31 17:42:47.648896 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:47.648827    5003 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Oct 31 17:42:47.648963 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:47.648950    5003 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Oct 31 17:42:47.649018 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:47.648999    5003 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Oct 31 17:42:47.908765 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:47.908468    5003 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="34bdffed-87b8-4e7a-b182-f069d081bd62" path="/var/lib/kubelet/pods/34bdffed-87b8-4e7a-b182-f069d081bd62/volumes"
Oct 31 17:42:47.909220 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:47.909199    5003 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="620f499f-36d7-4900-abbe-98ee5cf5d96c" path="/var/lib/kubelet/pods/620f499f-36d7-4900-abbe-98ee5cf5d96c/volumes"
Oct 31 17:42:47.909848 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:47.909825    5003 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="665d75c7-8ba5-49e1-87a7-51a18ae6f369" path="/var/lib/kubelet/pods/665d75c7-8ba5-49e1-87a7-51a18ae6f369/volumes"
Oct 31 17:42:47.910915 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:47.910878    5003 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="93f16294-fc40-477d-90b3-d02640037d5b" path="/var/lib/kubelet/pods/93f16294-fc40-477d-90b3-d02640037d5b/volumes"
Oct 31 17:42:47.911785 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:47.911620    5003 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="9cc6d7e8-30de-4173-9974-1f1a4fd08e1c" path="/var/lib/kubelet/pods/9cc6d7e8-30de-4173-9974-1f1a4fd08e1c/volumes"
Oct 31 17:42:47.955854 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:47.955819    5003 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-cf0a86-openshift-default-595bfdc58c-jwvk2"
Oct 31 17:42:48.045236 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:48.045201    5003 generic.go:356] "Generic (PLEG): container finished" podID="24b256e4-f9ad-4df2-ae67-bd7ddee0118e" containerID="def3548ece19314dd11affaf05d0b4337027725aa560fd5cd6514adbc56a6298" exitCode=0
Oct 31 17:42:48.045407 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:48.045377    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-d8e5e35c-xlfxz" event={"ID":"24b256e4-f9ad-4df2-ae67-bd7ddee0118e","Type":"ContainerDied","Data":"def3548ece19314dd11affaf05d0b4337027725aa560fd5cd6514adbc56a6298"}
Oct 31 17:42:48.047212 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:48.047187    5003 generic.go:356] "Generic (PLEG): container finished" podID="3dac59b3-ae83-496f-87cb-16c7fd249497" containerID="13e041a079399f46c303c38488c6ecb78bf58d112509e980ab7c81f5263337e7" exitCode=0
Oct 31 17:42:48.047378 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:48.047250    5003 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-cf0a86-openshift-default-595bfdc58c-jwvk2"
Oct 31 17:42:48.047461 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:48.047414    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-cf0a86-openshift-default-595bfdc58c-jwvk2" event={"ID":"3dac59b3-ae83-496f-87cb-16c7fd249497","Type":"ContainerDied","Data":"13e041a079399f46c303c38488c6ecb78bf58d112509e980ab7c81f5263337e7"}
Oct 31 17:42:48.047569 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:48.047548    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-cf0a86-openshift-default-595bfdc58c-jwvk2" event={"ID":"3dac59b3-ae83-496f-87cb-16c7fd249497","Type":"ContainerDied","Data":"6a3553278b5b512e49ae592c9f04990dc4ab6baccf84265b65e9d16b0b278bf4"}
Oct 31 17:42:48.047688 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:48.047595    5003 scope.go:122] "RemoveContainer" containerID="13e041a079399f46c303c38488c6ecb78bf58d112509e980ab7c81f5263337e7"
Oct 31 17:42:48.051639 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:48.051524    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-b78c31-openshift-default-774cb4f6c9-nhqll" event={"ID":"b0a16d54-5d2c-4c23-bf11-9cfe1844b568","Type":"ContainerStarted","Data":"0b6a122534975c4cb372789f76d3740b168b2c8ff368438578c2a105fb75f154"}
Oct 31 17:42:48.051639 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:48.051576    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-b78c31-openshift-default-774cb4f6c9-nhqll" event={"ID":"b0a16d54-5d2c-4c23-bf11-9cfe1844b568","Type":"ContainerStarted","Data":"e78fa2b166c2345efd1398fc1ad9a08cedf87b62c3a104c76182786373dd4de3"}
Oct 31 17:42:48.055310 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:48.055285    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/3dac59b3-ae83-496f-87cb-16c7fd249497-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3dac59b3-ae83-496f-87cb-16c7fd249497-workload-socket\") pod \"3dac59b3-ae83-496f-87cb-16c7fd249497\" (UID: \"3dac59b3-ae83-496f-87cb-16c7fd249497\") "
Oct 31 17:42:48.055535 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:48.055514    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/3dac59b3-ae83-496f-87cb-16c7fd249497-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3dac59b3-ae83-496f-87cb-16c7fd249497-workload-certs\") pod \"3dac59b3-ae83-496f-87cb-16c7fd249497\" (UID: \"3dac59b3-ae83-496f-87cb-16c7fd249497\") "
Oct 31 17:42:48.055708 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:48.055691    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/3dac59b3-ae83-496f-87cb-16c7fd249497-istio-token\" (UniqueName: \"kubernetes.io/projected/3dac59b3-ae83-496f-87cb-16c7fd249497-istio-token\") pod \"3dac59b3-ae83-496f-87cb-16c7fd249497\" (UID: \"3dac59b3-ae83-496f-87cb-16c7fd249497\") "
Oct 31 17:42:48.055857 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:48.055828    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/3dac59b3-ae83-496f-87cb-16c7fd249497-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3dac59b3-ae83-496f-87cb-16c7fd249497-istio-podinfo\") pod \"3dac59b3-ae83-496f-87cb-16c7fd249497\" (UID: \"3dac59b3-ae83-496f-87cb-16c7fd249497\") "
Oct 31 17:42:48.056042 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:48.056024    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/3dac59b3-ae83-496f-87cb-16c7fd249497-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3dac59b3-ae83-496f-87cb-16c7fd249497-istio-data\") pod \"3dac59b3-ae83-496f-87cb-16c7fd249497\" (UID: \"3dac59b3-ae83-496f-87cb-16c7fd249497\") "
Oct 31 17:42:48.057089 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:48.057068    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/3dac59b3-ae83-496f-87cb-16c7fd249497-kube-api-access-5lht5\" (UniqueName: \"kubernetes.io/projected/3dac59b3-ae83-496f-87cb-16c7fd249497-kube-api-access-5lht5\") pod \"3dac59b3-ae83-496f-87cb-16c7fd249497\" (UID: \"3dac59b3-ae83-496f-87cb-16c7fd249497\") "
Oct 31 17:42:48.057243 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:48.057228    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/3dac59b3-ae83-496f-87cb-16c7fd249497-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3dac59b3-ae83-496f-87cb-16c7fd249497-istio-envoy\") pod \"3dac59b3-ae83-496f-87cb-16c7fd249497\" (UID: \"3dac59b3-ae83-496f-87cb-16c7fd249497\") "
Oct 31 17:42:48.057369 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:48.057354    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/3dac59b3-ae83-496f-87cb-16c7fd249497-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3dac59b3-ae83-496f-87cb-16c7fd249497-credential-socket\") pod \"3dac59b3-ae83-496f-87cb-16c7fd249497\" (UID: \"3dac59b3-ae83-496f-87cb-16c7fd249497\") "
Oct 31 17:42:48.057593 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:48.057579    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/3dac59b3-ae83-496f-87cb-16c7fd249497-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3dac59b3-ae83-496f-87cb-16c7fd249497-istiod-ca-cert\") pod \"3dac59b3-ae83-496f-87cb-16c7fd249497\" (UID: \"3dac59b3-ae83-496f-87cb-16c7fd249497\") "
Oct 31 17:42:48.058429 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:48.056353    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3dac59b3-ae83-496f-87cb-16c7fd249497-workload-socket" pod "3dac59b3-ae83-496f-87cb-16c7fd249497" (UID: "3dac59b3-ae83-496f-87cb-16c7fd249497"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 17:42:48.058429 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:48.056819    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3dac59b3-ae83-496f-87cb-16c7fd249497-istio-data" pod "3dac59b3-ae83-496f-87cb-16c7fd249497" (UID: "3dac59b3-ae83-496f-87cb-16c7fd249497"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 17:42:48.058429 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:48.056982    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3dac59b3-ae83-496f-87cb-16c7fd249497-workload-certs" pod "3dac59b3-ae83-496f-87cb-16c7fd249497" (UID: "3dac59b3-ae83-496f-87cb-16c7fd249497"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 17:42:48.058726 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:48.058598    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3dac59b3-ae83-496f-87cb-16c7fd249497-credential-socket" pod "3dac59b3-ae83-496f-87cb-16c7fd249497" (UID: "3dac59b3-ae83-496f-87cb-16c7fd249497"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 17:42:48.059043 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:48.059010    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3dac59b3-ae83-496f-87cb-16c7fd249497-istiod-ca-cert" pod "3dac59b3-ae83-496f-87cb-16c7fd249497" (UID: "3dac59b3-ae83-496f-87cb-16c7fd249497"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 17:42:48.059383 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:48.059364    5003 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3dac59b3-ae83-496f-87cb-16c7fd249497-istio-data\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:42:48.059477 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:48.059465    5003 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3dac59b3-ae83-496f-87cb-16c7fd249497-credential-socket\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:42:48.059559 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:48.059547    5003 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3dac59b3-ae83-496f-87cb-16c7fd249497-istiod-ca-cert\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:42:48.059671 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:48.059660    5003 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3dac59b3-ae83-496f-87cb-16c7fd249497-workload-socket\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:42:48.059753 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:48.059742    5003 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3dac59b3-ae83-496f-87cb-16c7fd249497-workload-certs\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:42:48.061788 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:48.061743    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/3dac59b3-ae83-496f-87cb-16c7fd249497-istio-podinfo" pod "3dac59b3-ae83-496f-87cb-16c7fd249497" (UID: "3dac59b3-ae83-496f-87cb-16c7fd249497"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 31 17:42:48.064420 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:48.064393    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3dac59b3-ae83-496f-87cb-16c7fd249497-istio-token" pod "3dac59b3-ae83-496f-87cb-16c7fd249497" (UID: "3dac59b3-ae83-496f-87cb-16c7fd249497"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 17:42:48.065860 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:48.065834    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3dac59b3-ae83-496f-87cb-16c7fd249497-kube-api-access-5lht5" pod "3dac59b3-ae83-496f-87cb-16c7fd249497" (UID: "3dac59b3-ae83-496f-87cb-16c7fd249497"). InnerVolumeSpecName "kube-api-access-5lht5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 17:42:48.067989 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:48.067961    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3dac59b3-ae83-496f-87cb-16c7fd249497-istio-envoy" pod "3dac59b3-ae83-496f-87cb-16c7fd249497" (UID: "3dac59b3-ae83-496f-87cb-16c7fd249497"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 17:42:48.068467 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:48.068356    5003 scope.go:122] "RemoveContainer" containerID="13e041a079399f46c303c38488c6ecb78bf58d112509e980ab7c81f5263337e7"
Oct 31 17:42:48.068810 ip-10-0-138-17 kubenswrapper[5003]: E1031 17:42:48.068750    5003 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"13e041a079399f46c303c38488c6ecb78bf58d112509e980ab7c81f5263337e7\": container with ID starting with 13e041a079399f46c303c38488c6ecb78bf58d112509e980ab7c81f5263337e7 not found: ID does not exist" containerID="13e041a079399f46c303c38488c6ecb78bf58d112509e980ab7c81f5263337e7"
Oct 31 17:42:48.068810 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:48.068792    5003 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"13e041a079399f46c303c38488c6ecb78bf58d112509e980ab7c81f5263337e7"} err="failed to get container status \"13e041a079399f46c303c38488c6ecb78bf58d112509e980ab7c81f5263337e7\": rpc error: code = NotFound desc = could not find container \"13e041a079399f46c303c38488c6ecb78bf58d112509e980ab7c81f5263337e7\": container with ID starting with 13e041a079399f46c303c38488c6ecb78bf58d112509e980ab7c81f5263337e7 not found: ID does not exist"
Oct 31 17:42:48.140973 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:48.140912    5003 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w5-b78c31-openshift-default-774cb4f6c9-nhqll" podStartSLOduration=2.140891833 podStartE2EDuration="2.140891833s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 17:42:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 17:42:48.140581455 +0000 UTC m=+936.395435998" watchObservedRunningTime="2026-10-31 17:42:48.140891833 +0000 UTC m=+936.395746377"
Oct 31 17:42:48.162175 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:48.162099    5003 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3dac59b3-ae83-496f-87cb-16c7fd249497-istio-token\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:42:48.162175 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:48.162135    5003 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3dac59b3-ae83-496f-87cb-16c7fd249497-istio-podinfo\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:42:48.162175 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:48.162150    5003 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5lht5\" (UniqueName: \"kubernetes.io/projected/3dac59b3-ae83-496f-87cb-16c7fd249497-kube-api-access-5lht5\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:42:48.162175 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:48.162164    5003 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3dac59b3-ae83-496f-87cb-16c7fd249497-istio-envoy\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:42:48.318053 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:48.318024    5003 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w5-b78c31-openshift-default-774cb4f6c9-nhqll"
Oct 31 17:42:48.320319 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:48.320014    5003 patch_prober.go:29] interesting pod/e2e-worker-w5-b78c31-openshift-default-774cb4f6c9-nhqll container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.130:15021/healthz/ready\": dial tcp 10.132.0.130:15021: connect: connection refused" start-of-body=
Oct 31 17:42:48.320319 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:48.320076    5003 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-b78c31-openshift-default-774cb4f6c9-nhqll" podUID="b0a16d54-5d2c-4c23-bf11-9cfe1844b568" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.130:15021/healthz/ready\": dial tcp 10.132.0.130:15021: connect: connection refused"
Oct 31 17:42:48.377015 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:48.376984    5003 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-f64ceb2b-xh2mb"
Oct 31 17:42:48.382861 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:48.382834    5003 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-fdac4c5b-4jxs4"
Oct 31 17:42:48.426327 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:48.425835    5003 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w3-cf0a86-openshift-default-595bfdc58c-jwvk2"]
Oct 31 17:42:48.430586 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:48.430551    5003 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w3-cf0a86-openshift-default-595bfdc58c-jwvk2"]
Oct 31 17:42:48.481280 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:48.480173    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/bfa2dbca-7f50-4a7a-97a7-e780fa561f47-kube-api-access-vmtph\" (UniqueName: \"kubernetes.io/projected/bfa2dbca-7f50-4a7a-97a7-e780fa561f47-kube-api-access-vmtph\") pod \"bfa2dbca-7f50-4a7a-97a7-e780fa561f47\" (UID: \"bfa2dbca-7f50-4a7a-97a7-e780fa561f47\") "
Oct 31 17:42:48.482260 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:48.482220    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/c04e8e25-b143-4ff0-85d4-a5f8e569887f-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/c04e8e25-b143-4ff0-85d4-a5f8e569887f-maas-api-xks-ca\") pod \"c04e8e25-b143-4ff0-85d4-a5f8e569887f\" (UID: \"c04e8e25-b143-4ff0-85d4-a5f8e569887f\") "
Oct 31 17:42:48.491223 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:48.491175    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/bfa2dbca-7f50-4a7a-97a7-e780fa561f47-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/bfa2dbca-7f50-4a7a-97a7-e780fa561f47-maas-api-openshift-ca\") pod \"bfa2dbca-7f50-4a7a-97a7-e780fa561f47\" (UID: \"bfa2dbca-7f50-4a7a-97a7-e780fa561f47\") "
Oct 31 17:42:48.491613 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:48.491588    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bfa2dbca-7f50-4a7a-97a7-e780fa561f47-maas-api-openshift-ca" pod "bfa2dbca-7f50-4a7a-97a7-e780fa561f47" (UID: "bfa2dbca-7f50-4a7a-97a7-e780fa561f47"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 17:42:48.491771 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:48.491606    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/bfa2dbca-7f50-4a7a-97a7-e780fa561f47-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/bfa2dbca-7f50-4a7a-97a7-e780fa561f47-maas-api-xks-ca\") pod \"bfa2dbca-7f50-4a7a-97a7-e780fa561f47\" (UID: \"bfa2dbca-7f50-4a7a-97a7-e780fa561f47\") "
Oct 31 17:42:48.491957 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:48.491938    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/c04e8e25-b143-4ff0-85d4-a5f8e569887f-kube-api-access-q9dmw\" (UniqueName: \"kubernetes.io/projected/c04e8e25-b143-4ff0-85d4-a5f8e569887f-kube-api-access-q9dmw\") pod \"c04e8e25-b143-4ff0-85d4-a5f8e569887f\" (UID: \"c04e8e25-b143-4ff0-85d4-a5f8e569887f\") "
Oct 31 17:42:48.492163 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:48.492146    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/c04e8e25-b143-4ff0-85d4-a5f8e569887f-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/c04e8e25-b143-4ff0-85d4-a5f8e569887f-maas-api-openshift-ca\") pod \"c04e8e25-b143-4ff0-85d4-a5f8e569887f\" (UID: \"c04e8e25-b143-4ff0-85d4-a5f8e569887f\") "
Oct 31 17:42:48.493105 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:48.493081    5003 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/bfa2dbca-7f50-4a7a-97a7-e780fa561f47-maas-api-openshift-ca\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:42:48.493404 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:48.493384    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c04e8e25-b143-4ff0-85d4-a5f8e569887f-maas-api-openshift-ca" pod "c04e8e25-b143-4ff0-85d4-a5f8e569887f" (UID: "c04e8e25-b143-4ff0-85d4-a5f8e569887f"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 17:42:48.494438 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:48.494402    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c04e8e25-b143-4ff0-85d4-a5f8e569887f-kube-api-access-q9dmw" pod "c04e8e25-b143-4ff0-85d4-a5f8e569887f" (UID: "c04e8e25-b143-4ff0-85d4-a5f8e569887f"). InnerVolumeSpecName "kube-api-access-q9dmw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 17:42:48.494539 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:48.494487    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bfa2dbca-7f50-4a7a-97a7-e780fa561f47-maas-api-xks-ca" pod "bfa2dbca-7f50-4a7a-97a7-e780fa561f47" (UID: "bfa2dbca-7f50-4a7a-97a7-e780fa561f47"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 17:42:48.494703 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:48.494635    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bfa2dbca-7f50-4a7a-97a7-e780fa561f47-kube-api-access-vmtph" pod "bfa2dbca-7f50-4a7a-97a7-e780fa561f47" (UID: "bfa2dbca-7f50-4a7a-97a7-e780fa561f47"). InnerVolumeSpecName "kube-api-access-vmtph". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 17:42:48.495589 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:48.495569    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c04e8e25-b143-4ff0-85d4-a5f8e569887f-maas-api-xks-ca" pod "c04e8e25-b143-4ff0-85d4-a5f8e569887f" (UID: "c04e8e25-b143-4ff0-85d4-a5f8e569887f"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 17:42:48.516088 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:48.515590    5003 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-cf0a86-openshift-default-595bfdc58c-knt8p"
Oct 31 17:42:48.594308 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:48.594275    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ebe4bd91-be4d-4d45-89f7-5aa595b9e2aa-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ebe4bd91-be4d-4d45-89f7-5aa595b9e2aa-credential-socket\") pod \"ebe4bd91-be4d-4d45-89f7-5aa595b9e2aa\" (UID: \"ebe4bd91-be4d-4d45-89f7-5aa595b9e2aa\") "
Oct 31 17:42:48.594452 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:48.594324    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/ebe4bd91-be4d-4d45-89f7-5aa595b9e2aa-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ebe4bd91-be4d-4d45-89f7-5aa595b9e2aa-istio-podinfo\") pod \"ebe4bd91-be4d-4d45-89f7-5aa595b9e2aa\" (UID: \"ebe4bd91-be4d-4d45-89f7-5aa595b9e2aa\") "
Oct 31 17:42:48.594452 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:48.594356    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ebe4bd91-be4d-4d45-89f7-5aa595b9e2aa-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ebe4bd91-be4d-4d45-89f7-5aa595b9e2aa-workload-socket\") pod \"ebe4bd91-be4d-4d45-89f7-5aa595b9e2aa\" (UID: \"ebe4bd91-be4d-4d45-89f7-5aa595b9e2aa\") "
Oct 31 17:42:48.594549 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:48.594456    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/ebe4bd91-be4d-4d45-89f7-5aa595b9e2aa-istio-token\" (UniqueName: \"kubernetes.io/projected/ebe4bd91-be4d-4d45-89f7-5aa595b9e2aa-istio-token\") pod \"ebe4bd91-be4d-4d45-89f7-5aa595b9e2aa\" (UID: \"ebe4bd91-be4d-4d45-89f7-5aa595b9e2aa\") "
Oct 31 17:42:48.594549 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:48.594478    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ebe4bd91-be4d-4d45-89f7-5aa595b9e2aa-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ebe4bd91-be4d-4d45-89f7-5aa595b9e2aa-istio-data\") pod \"ebe4bd91-be4d-4d45-89f7-5aa595b9e2aa\" (UID: \"ebe4bd91-be4d-4d45-89f7-5aa595b9e2aa\") "
Oct 31 17:42:48.594549 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:48.594505    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/ebe4bd91-be4d-4d45-89f7-5aa595b9e2aa-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ebe4bd91-be4d-4d45-89f7-5aa595b9e2aa-istiod-ca-cert\") pod \"ebe4bd91-be4d-4d45-89f7-5aa595b9e2aa\" (UID: \"ebe4bd91-be4d-4d45-89f7-5aa595b9e2aa\") "
Oct 31 17:42:48.594636 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:48.594557    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ebe4bd91-be4d-4d45-89f7-5aa595b9e2aa-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ebe4bd91-be4d-4d45-89f7-5aa595b9e2aa-workload-certs\") pod \"ebe4bd91-be4d-4d45-89f7-5aa595b9e2aa\" (UID: \"ebe4bd91-be4d-4d45-89f7-5aa595b9e2aa\") "
Oct 31 17:42:48.594636 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:48.594611    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ebe4bd91-be4d-4d45-89f7-5aa595b9e2aa-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ebe4bd91-be4d-4d45-89f7-5aa595b9e2aa-istio-envoy\") pod \"ebe4bd91-be4d-4d45-89f7-5aa595b9e2aa\" (UID: \"ebe4bd91-be4d-4d45-89f7-5aa595b9e2aa\") "
Oct 31 17:42:48.594731 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:48.594634    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/ebe4bd91-be4d-4d45-89f7-5aa595b9e2aa-kube-api-access-dkf5d\" (UniqueName: \"kubernetes.io/projected/ebe4bd91-be4d-4d45-89f7-5aa595b9e2aa-kube-api-access-dkf5d\") pod \"ebe4bd91-be4d-4d45-89f7-5aa595b9e2aa\" (UID: \"ebe4bd91-be4d-4d45-89f7-5aa595b9e2aa\") "
Oct 31 17:42:48.595143 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:48.595121    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ebe4bd91-be4d-4d45-89f7-5aa595b9e2aa-credential-socket" pod "ebe4bd91-be4d-4d45-89f7-5aa595b9e2aa" (UID: "ebe4bd91-be4d-4d45-89f7-5aa595b9e2aa"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 17:42:48.595824 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:48.595795    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ebe4bd91-be4d-4d45-89f7-5aa595b9e2aa-workload-certs" pod "ebe4bd91-be4d-4d45-89f7-5aa595b9e2aa" (UID: "ebe4bd91-be4d-4d45-89f7-5aa595b9e2aa"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 17:42:48.596304 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:48.596083    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ebe4bd91-be4d-4d45-89f7-5aa595b9e2aa-workload-socket" pod "ebe4bd91-be4d-4d45-89f7-5aa595b9e2aa" (UID: "ebe4bd91-be4d-4d45-89f7-5aa595b9e2aa"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 17:42:48.596304 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:48.596093    5003 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/bfa2dbca-7f50-4a7a-97a7-e780fa561f47-maas-api-xks-ca\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:42:48.596304 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:48.596117    5003 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q9dmw\" (UniqueName: \"kubernetes.io/projected/c04e8e25-b143-4ff0-85d4-a5f8e569887f-kube-api-access-q9dmw\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:42:48.596304 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:48.596133    5003 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/c04e8e25-b143-4ff0-85d4-a5f8e569887f-maas-api-openshift-ca\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:42:48.596304 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:48.596148    5003 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ebe4bd91-be4d-4d45-89f7-5aa595b9e2aa-workload-certs\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:42:48.596304 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:48.596161    5003 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vmtph\" (UniqueName: \"kubernetes.io/projected/bfa2dbca-7f50-4a7a-97a7-e780fa561f47-kube-api-access-vmtph\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:42:48.596304 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:48.596175    5003 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/c04e8e25-b143-4ff0-85d4-a5f8e569887f-maas-api-xks-ca\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:42:48.596304 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:48.596189    5003 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ebe4bd91-be4d-4d45-89f7-5aa595b9e2aa-credential-socket\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:42:48.596756 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:48.596486    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ebe4bd91-be4d-4d45-89f7-5aa595b9e2aa-istio-data" pod "ebe4bd91-be4d-4d45-89f7-5aa595b9e2aa" (UID: "ebe4bd91-be4d-4d45-89f7-5aa595b9e2aa"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 17:42:48.596796 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:48.596759    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ebe4bd91-be4d-4d45-89f7-5aa595b9e2aa-istiod-ca-cert" pod "ebe4bd91-be4d-4d45-89f7-5aa595b9e2aa" (UID: "ebe4bd91-be4d-4d45-89f7-5aa595b9e2aa"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 17:42:48.597754 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:48.597733    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/ebe4bd91-be4d-4d45-89f7-5aa595b9e2aa-istio-podinfo" pod "ebe4bd91-be4d-4d45-89f7-5aa595b9e2aa" (UID: "ebe4bd91-be4d-4d45-89f7-5aa595b9e2aa"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 31 17:42:48.597834 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:48.597770    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ebe4bd91-be4d-4d45-89f7-5aa595b9e2aa-kube-api-access-dkf5d" pod "ebe4bd91-be4d-4d45-89f7-5aa595b9e2aa" (UID: "ebe4bd91-be4d-4d45-89f7-5aa595b9e2aa"). InnerVolumeSpecName "kube-api-access-dkf5d". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 17:42:48.598966 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:48.598936    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ebe4bd91-be4d-4d45-89f7-5aa595b9e2aa-istio-token" pod "ebe4bd91-be4d-4d45-89f7-5aa595b9e2aa" (UID: "ebe4bd91-be4d-4d45-89f7-5aa595b9e2aa"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 17:42:48.599038 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:48.599015    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ebe4bd91-be4d-4d45-89f7-5aa595b9e2aa-istio-envoy" pod "ebe4bd91-be4d-4d45-89f7-5aa595b9e2aa" (UID: "ebe4bd91-be4d-4d45-89f7-5aa595b9e2aa"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 17:42:48.697958 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:48.697873    5003 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ebe4bd91-be4d-4d45-89f7-5aa595b9e2aa-istio-token\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:42:48.697958 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:48.697903    5003 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ebe4bd91-be4d-4d45-89f7-5aa595b9e2aa-istio-data\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:42:48.697958 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:48.697921    5003 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ebe4bd91-be4d-4d45-89f7-5aa595b9e2aa-istiod-ca-cert\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:42:48.697958 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:48.697934    5003 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ebe4bd91-be4d-4d45-89f7-5aa595b9e2aa-istio-envoy\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:42:48.697958 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:48.697946    5003 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dkf5d\" (UniqueName: \"kubernetes.io/projected/ebe4bd91-be4d-4d45-89f7-5aa595b9e2aa-kube-api-access-dkf5d\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:42:48.697958 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:48.697958    5003 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ebe4bd91-be4d-4d45-89f7-5aa595b9e2aa-istio-podinfo\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:42:48.698473 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:48.697972    5003 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ebe4bd91-be4d-4d45-89f7-5aa595b9e2aa-workload-socket\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:42:48.830113 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:48.830071    5003 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-worker-w6-d80080-7f8f6c66c-btxwt" podUID="d6d7f818-43c5-4470-9799-6b6e6cebb928" containerName="payload-processing" containerID="cri-o://6237f9f1f5859ea0ed18d12272273009f471c652f72b1c34a42abecd7c42359f" gracePeriod=25
Oct 31 17:42:49.095031 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:49.094991    5003 generic.go:356] "Generic (PLEG): container finished" podID="ef941538-5385-4d44-98cd-ffddd91e9dc5" containerID="30c12535f0c7c5fa7b42e42386e0219a6c8fb87af5a09c9aac4edac282a087b1" exitCode=0
Oct 31 17:42:49.095194 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:49.095080    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-5c446c-openshift-default-797c6dc855-v5k9r" event={"ID":"ef941538-5385-4d44-98cd-ffddd91e9dc5","Type":"ContainerDied","Data":"30c12535f0c7c5fa7b42e42386e0219a6c8fb87af5a09c9aac4edac282a087b1"}
Oct 31 17:42:49.098346 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:49.098316    5003 generic.go:356] "Generic (PLEG): container finished" podID="a92e2f56-5eb4-4b64-9947-25e1f0d51c30" containerID="88f32c22ff949f40ab5613152bad312210dc8e101df7d91e55a418b417b6426d" exitCode=0
Oct 31 17:42:49.098435 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:49.098391    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-5c446c-openshift-default-797c6dc855-w477z" event={"ID":"a92e2f56-5eb4-4b64-9947-25e1f0d51c30","Type":"ContainerDied","Data":"88f32c22ff949f40ab5613152bad312210dc8e101df7d91e55a418b417b6426d"}
Oct 31 17:42:49.100093 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:49.100069    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-fdac4c5b-4jxs4" event={"ID":"c04e8e25-b143-4ff0-85d4-a5f8e569887f","Type":"ContainerDied","Data":"a676607c559b0363c647b6b6bc9f50b4dbd451263b4287d4c0d0a759a24a4ffd"}
Oct 31 17:42:49.100261 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:49.100247    5003 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a676607c559b0363c647b6b6bc9f50b4dbd451263b4287d4c0d0a759a24a4ffd"
Oct 31 17:42:49.100411 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:49.100402    5003 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-fdac4c5b-4jxs4"
Oct 31 17:42:49.111412 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:49.111232    5003 generic.go:356] "Generic (PLEG): container finished" podID="6de961b6-2fb6-404d-9db2-594a7ef76ccb" containerID="52c5c37ad0287ee27616dbe9180e24eb2b511582d0419ad96d3978d8fba03075" exitCode=0
Oct 31 17:42:49.111412 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:49.111360    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-5c446c-openshift-default-797c6dc855-nd8tv" event={"ID":"6de961b6-2fb6-404d-9db2-594a7ef76ccb","Type":"ContainerDied","Data":"52c5c37ad0287ee27616dbe9180e24eb2b511582d0419ad96d3978d8fba03075"}
Oct 31 17:42:49.115977 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:49.113522    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-f64ceb2b-xh2mb" event={"ID":"bfa2dbca-7f50-4a7a-97a7-e780fa561f47","Type":"ContainerDied","Data":"03e5c3cee4abd9fb558d8662a27198eab4875ace0fb4c1bd4e22e2d6c8678de4"}
Oct 31 17:42:49.115977 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:49.113562    5003 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="03e5c3cee4abd9fb558d8662a27198eab4875ace0fb4c1bd4e22e2d6c8678de4"
Oct 31 17:42:49.115977 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:49.113638    5003 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-f64ceb2b-xh2mb"
Oct 31 17:42:49.116717 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:49.116698    5003 generic.go:356] "Generic (PLEG): container finished" podID="ebe4bd91-be4d-4d45-89f7-5aa595b9e2aa" containerID="669bf380ab9a48852a83ab1bc90c18f6989affedc423c648fb7ed3c031cc4ff6" exitCode=0
Oct 31 17:42:49.116845 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:49.116832    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-cf0a86-openshift-default-595bfdc58c-knt8p" event={"ID":"ebe4bd91-be4d-4d45-89f7-5aa595b9e2aa","Type":"ContainerDied","Data":"669bf380ab9a48852a83ab1bc90c18f6989affedc423c648fb7ed3c031cc4ff6"}
Oct 31 17:42:49.116938 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:49.116928    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-cf0a86-openshift-default-595bfdc58c-knt8p" event={"ID":"ebe4bd91-be4d-4d45-89f7-5aa595b9e2aa","Type":"ContainerDied","Data":"75a180af3825653ec563c8c1eae578b6a809bbe8531a628c41fb65c47b91a23a"}
Oct 31 17:42:49.117004 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:49.116996    5003 scope.go:122] "RemoveContainer" containerID="669bf380ab9a48852a83ab1bc90c18f6989affedc423c648fb7ed3c031cc4ff6"
Oct 31 17:42:49.117154 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:49.117145    5003 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-cf0a86-openshift-default-595bfdc58c-knt8p"
Oct 31 17:42:49.123015 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:49.122989    5003 generic.go:356] "Generic (PLEG): container finished" podID="61193be6-6ada-48ff-9e96-700c73f018dd" containerID="15223b5a03fae4c192405ab90afbea6bc329c562bbc20103f6a231f371f1d23e" exitCode=0
Oct 31 17:42:49.123247 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:49.123229    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-cf0a86-openshift-default-595bfdc58c-jg25b" event={"ID":"61193be6-6ada-48ff-9e96-700c73f018dd","Type":"ContainerDied","Data":"15223b5a03fae4c192405ab90afbea6bc329c562bbc20103f6a231f371f1d23e"}
Oct 31 17:42:49.126828 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:49.126805    5003 generic.go:356] "Generic (PLEG): container finished" podID="80900980-7b5e-4d15-a9db-279185d25b57" containerID="1f3b2bf06f9049ce80d34c68d2cf5be1c701f068ac3e2d6d9ee9d5463b12eb29" exitCode=0
Oct 31 17:42:49.127201 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:49.127177    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-5c446c-openshift-default-797c6dc855-rtzkv" event={"ID":"80900980-7b5e-4d15-a9db-279185d25b57","Type":"ContainerDied","Data":"1f3b2bf06f9049ce80d34c68d2cf5be1c701f068ac3e2d6d9ee9d5463b12eb29"}
Oct 31 17:42:49.141094 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:49.141074    5003 scope.go:122] "RemoveContainer" containerID="669bf380ab9a48852a83ab1bc90c18f6989affedc423c648fb7ed3c031cc4ff6"
Oct 31 17:42:49.141881 ip-10-0-138-17 kubenswrapper[5003]: E1031 17:42:49.141860    5003 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"669bf380ab9a48852a83ab1bc90c18f6989affedc423c648fb7ed3c031cc4ff6\": container with ID starting with 669bf380ab9a48852a83ab1bc90c18f6989affedc423c648fb7ed3c031cc4ff6 not found: ID does not exist" containerID="669bf380ab9a48852a83ab1bc90c18f6989affedc423c648fb7ed3c031cc4ff6"
Oct 31 17:42:49.141961 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:49.141891    5003 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"669bf380ab9a48852a83ab1bc90c18f6989affedc423c648fb7ed3c031cc4ff6"} err="failed to get container status \"669bf380ab9a48852a83ab1bc90c18f6989affedc423c648fb7ed3c031cc4ff6\": rpc error: code = NotFound desc = could not find container \"669bf380ab9a48852a83ab1bc90c18f6989affedc423c648fb7ed3c031cc4ff6\": container with ID starting with 669bf380ab9a48852a83ab1bc90c18f6989affedc423c648fb7ed3c031cc4ff6 not found: ID does not exist"
Oct 31 17:42:49.228479 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:49.228428    5003 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w3-cf0a86-openshift-default-595bfdc58c-knt8p"]
Oct 31 17:42:49.234220 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:49.234152    5003 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-5c446c-openshift-default-797c6dc855-rtzkv"
Oct 31 17:42:49.235706 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:49.235678    5003 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w3-cf0a86-openshift-default-595bfdc58c-knt8p"]
Oct 31 17:42:49.313467 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:49.313433    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/80900980-7b5e-4d15-a9db-279185d25b57-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/80900980-7b5e-4d15-a9db-279185d25b57-credential-socket\") pod \"80900980-7b5e-4d15-a9db-279185d25b57\" (UID: \"80900980-7b5e-4d15-a9db-279185d25b57\") "
Oct 31 17:42:49.314068 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:49.314044    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/80900980-7b5e-4d15-a9db-279185d25b57-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/80900980-7b5e-4d15-a9db-279185d25b57-istiod-ca-cert\") pod \"80900980-7b5e-4d15-a9db-279185d25b57\" (UID: \"80900980-7b5e-4d15-a9db-279185d25b57\") "
Oct 31 17:42:49.314252 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:49.314237    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/80900980-7b5e-4d15-a9db-279185d25b57-kube-api-access-vtmwx\" (UniqueName: \"kubernetes.io/projected/80900980-7b5e-4d15-a9db-279185d25b57-kube-api-access-vtmwx\") pod \"80900980-7b5e-4d15-a9db-279185d25b57\" (UID: \"80900980-7b5e-4d15-a9db-279185d25b57\") "
Oct 31 17:42:49.314360 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:49.314348    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/80900980-7b5e-4d15-a9db-279185d25b57-istio-token\" (UniqueName: \"kubernetes.io/projected/80900980-7b5e-4d15-a9db-279185d25b57-istio-token\") pod \"80900980-7b5e-4d15-a9db-279185d25b57\" (UID: \"80900980-7b5e-4d15-a9db-279185d25b57\") "
Oct 31 17:42:49.314550 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:49.314537    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/80900980-7b5e-4d15-a9db-279185d25b57-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/80900980-7b5e-4d15-a9db-279185d25b57-workload-certs\") pod \"80900980-7b5e-4d15-a9db-279185d25b57\" (UID: \"80900980-7b5e-4d15-a9db-279185d25b57\") "
Oct 31 17:42:49.314677 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:49.314658    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/80900980-7b5e-4d15-a9db-279185d25b57-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/80900980-7b5e-4d15-a9db-279185d25b57-istio-data\") pod \"80900980-7b5e-4d15-a9db-279185d25b57\" (UID: \"80900980-7b5e-4d15-a9db-279185d25b57\") "
Oct 31 17:42:49.314864 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:49.314850    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/80900980-7b5e-4d15-a9db-279185d25b57-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/80900980-7b5e-4d15-a9db-279185d25b57-istio-envoy\") pod \"80900980-7b5e-4d15-a9db-279185d25b57\" (UID: \"80900980-7b5e-4d15-a9db-279185d25b57\") "
Oct 31 17:42:49.315047 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:49.315034    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/80900980-7b5e-4d15-a9db-279185d25b57-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/80900980-7b5e-4d15-a9db-279185d25b57-istio-podinfo\") pod \"80900980-7b5e-4d15-a9db-279185d25b57\" (UID: \"80900980-7b5e-4d15-a9db-279185d25b57\") "
Oct 31 17:42:49.315158 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:49.315146    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/80900980-7b5e-4d15-a9db-279185d25b57-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/80900980-7b5e-4d15-a9db-279185d25b57-workload-socket\") pod \"80900980-7b5e-4d15-a9db-279185d25b57\" (UID: \"80900980-7b5e-4d15-a9db-279185d25b57\") "
Oct 31 17:42:49.316611 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:49.316582    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/80900980-7b5e-4d15-a9db-279185d25b57-workload-socket" pod "80900980-7b5e-4d15-a9db-279185d25b57" (UID: "80900980-7b5e-4d15-a9db-279185d25b57"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 17:42:49.317677 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:49.317635    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/80900980-7b5e-4d15-a9db-279185d25b57-workload-certs" pod "80900980-7b5e-4d15-a9db-279185d25b57" (UID: "80900980-7b5e-4d15-a9db-279185d25b57"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 17:42:49.318324 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:49.318171    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/80900980-7b5e-4d15-a9db-279185d25b57-istio-data" pod "80900980-7b5e-4d15-a9db-279185d25b57" (UID: "80900980-7b5e-4d15-a9db-279185d25b57"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 17:42:49.318875 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:49.318687    5003 patch_prober.go:29] interesting pod/e2e-worker-w5-b78c31-openshift-default-774cb4f6c9-nhqll container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.130:15021/healthz/ready\": dial tcp 10.132.0.130:15021: connect: connection refused" start-of-body=
Oct 31 17:42:49.318875 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:49.318759    5003 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-b78c31-openshift-default-774cb4f6c9-nhqll" podUID="b0a16d54-5d2c-4c23-bf11-9cfe1844b568" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.130:15021/healthz/ready\": dial tcp 10.132.0.130:15021: connect: connection refused"
Oct 31 17:42:49.318875 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:49.318805    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/80900980-7b5e-4d15-a9db-279185d25b57-istiod-ca-cert" pod "80900980-7b5e-4d15-a9db-279185d25b57" (UID: "80900980-7b5e-4d15-a9db-279185d25b57"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 17:42:49.320828 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:49.320242    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/80900980-7b5e-4d15-a9db-279185d25b57-credential-socket" pod "80900980-7b5e-4d15-a9db-279185d25b57" (UID: "80900980-7b5e-4d15-a9db-279185d25b57"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 17:42:49.322964 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:49.322600    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/80900980-7b5e-4d15-a9db-279185d25b57-istio-token" pod "80900980-7b5e-4d15-a9db-279185d25b57" (UID: "80900980-7b5e-4d15-a9db-279185d25b57"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 17:42:49.323161 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:49.323084    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/80900980-7b5e-4d15-a9db-279185d25b57-kube-api-access-vtmwx" pod "80900980-7b5e-4d15-a9db-279185d25b57" (UID: "80900980-7b5e-4d15-a9db-279185d25b57"). InnerVolumeSpecName "kube-api-access-vtmwx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 17:42:49.324164 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:49.324084    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/80900980-7b5e-4d15-a9db-279185d25b57-istio-envoy" pod "80900980-7b5e-4d15-a9db-279185d25b57" (UID: "80900980-7b5e-4d15-a9db-279185d25b57"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 17:42:49.324339 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:49.324318    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/80900980-7b5e-4d15-a9db-279185d25b57-istio-podinfo" pod "80900980-7b5e-4d15-a9db-279185d25b57" (UID: "80900980-7b5e-4d15-a9db-279185d25b57"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 31 17:42:49.411532 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:49.411105    5003 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-cf0a86-openshift-default-595bfdc58c-jg25b"
Oct 31 17:42:49.418683 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:49.418633    5003 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/80900980-7b5e-4d15-a9db-279185d25b57-istiod-ca-cert\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:42:49.418804 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:49.418689    5003 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vtmwx\" (UniqueName: \"kubernetes.io/projected/80900980-7b5e-4d15-a9db-279185d25b57-kube-api-access-vtmwx\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:42:49.418804 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:49.418705    5003 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/80900980-7b5e-4d15-a9db-279185d25b57-istio-token\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:42:49.418804 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:49.418719    5003 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/80900980-7b5e-4d15-a9db-279185d25b57-workload-certs\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:42:49.418804 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:49.418731    5003 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/80900980-7b5e-4d15-a9db-279185d25b57-istio-data\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:42:49.418804 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:49.418743    5003 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/80900980-7b5e-4d15-a9db-279185d25b57-istio-envoy\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:42:49.418804 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:49.418755    5003 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/80900980-7b5e-4d15-a9db-279185d25b57-istio-podinfo\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:42:49.418804 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:49.418767    5003 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/80900980-7b5e-4d15-a9db-279185d25b57-workload-socket\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:42:49.418804 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:49.418778    5003 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/80900980-7b5e-4d15-a9db-279185d25b57-credential-socket\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:42:49.434250 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:49.434164    5003 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-5c446c-openshift-default-797c6dc855-w477z"
Oct 31 17:42:49.439103 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:49.439078    5003 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-5c446c-openshift-default-797c6dc855-nd8tv"
Oct 31 17:42:49.442464 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:49.442446    5003 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-d8e5e35c-xlfxz"
Oct 31 17:42:49.519720 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:49.519538    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/61193be6-6ada-48ff-9e96-700c73f018dd-istio-token\" (UniqueName: \"kubernetes.io/projected/61193be6-6ada-48ff-9e96-700c73f018dd-istio-token\") pod \"61193be6-6ada-48ff-9e96-700c73f018dd\" (UID: \"61193be6-6ada-48ff-9e96-700c73f018dd\") "
Oct 31 17:42:49.519720 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:49.519617    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/6de961b6-2fb6-404d-9db2-594a7ef76ccb-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6de961b6-2fb6-404d-9db2-594a7ef76ccb-workload-certs\") pod \"6de961b6-2fb6-404d-9db2-594a7ef76ccb\" (UID: \"6de961b6-2fb6-404d-9db2-594a7ef76ccb\") "
Oct 31 17:42:49.520353 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:49.519978    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/6de961b6-2fb6-404d-9db2-594a7ef76ccb-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6de961b6-2fb6-404d-9db2-594a7ef76ccb-istio-podinfo\") pod \"6de961b6-2fb6-404d-9db2-594a7ef76ccb\" (UID: \"6de961b6-2fb6-404d-9db2-594a7ef76ccb\") "
Oct 31 17:42:49.520353 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:49.520040    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a92e2f56-5eb4-4b64-9947-25e1f0d51c30-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a92e2f56-5eb4-4b64-9947-25e1f0d51c30-istio-envoy\") pod \"a92e2f56-5eb4-4b64-9947-25e1f0d51c30\" (UID: \"a92e2f56-5eb4-4b64-9947-25e1f0d51c30\") "
Oct 31 17:42:49.520353 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:49.520106    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/24b256e4-f9ad-4df2-ae67-bd7ddee0118e-kube-api-access-2fb94\" (UniqueName: \"kubernetes.io/projected/24b256e4-f9ad-4df2-ae67-bd7ddee0118e-kube-api-access-2fb94\") pod \"24b256e4-f9ad-4df2-ae67-bd7ddee0118e\" (UID: \"24b256e4-f9ad-4df2-ae67-bd7ddee0118e\") "
Oct 31 17:42:49.520353 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:49.520251    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/61193be6-6ada-48ff-9e96-700c73f018dd-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/61193be6-6ada-48ff-9e96-700c73f018dd-istio-envoy\") pod \"61193be6-6ada-48ff-9e96-700c73f018dd\" (UID: \"61193be6-6ada-48ff-9e96-700c73f018dd\") "
Oct 31 17:42:49.523098 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:49.523068    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6de961b6-2fb6-404d-9db2-594a7ef76ccb-workload-certs" pod "6de961b6-2fb6-404d-9db2-594a7ef76ccb" (UID: "6de961b6-2fb6-404d-9db2-594a7ef76ccb"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 17:42:49.525671 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:49.524859    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6de961b6-2fb6-404d-9db2-594a7ef76ccb-workload-socket" pod "6de961b6-2fb6-404d-9db2-594a7ef76ccb" (UID: "6de961b6-2fb6-404d-9db2-594a7ef76ccb"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 17:42:49.531738 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:49.531710    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/6de961b6-2fb6-404d-9db2-594a7ef76ccb-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6de961b6-2fb6-404d-9db2-594a7ef76ccb-workload-socket\") pod \"6de961b6-2fb6-404d-9db2-594a7ef76ccb\" (UID: \"6de961b6-2fb6-404d-9db2-594a7ef76ccb\") "
Oct 31 17:42:49.531845 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:49.531778    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/a92e2f56-5eb4-4b64-9947-25e1f0d51c30-istio-token\" (UniqueName: \"kubernetes.io/projected/a92e2f56-5eb4-4b64-9947-25e1f0d51c30-istio-token\") pod \"a92e2f56-5eb4-4b64-9947-25e1f0d51c30\" (UID: \"a92e2f56-5eb4-4b64-9947-25e1f0d51c30\") "
Oct 31 17:42:49.531845 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:49.531824    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/a92e2f56-5eb4-4b64-9947-25e1f0d51c30-kube-api-access-dvwrv\" (UniqueName: \"kubernetes.io/projected/a92e2f56-5eb4-4b64-9947-25e1f0d51c30-kube-api-access-dvwrv\") pod \"a92e2f56-5eb4-4b64-9947-25e1f0d51c30\" (UID: \"a92e2f56-5eb4-4b64-9947-25e1f0d51c30\") "
Oct 31 17:42:49.531963 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:49.531853    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a92e2f56-5eb4-4b64-9947-25e1f0d51c30-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a92e2f56-5eb4-4b64-9947-25e1f0d51c30-istio-data\") pod \"a92e2f56-5eb4-4b64-9947-25e1f0d51c30\" (UID: \"a92e2f56-5eb4-4b64-9947-25e1f0d51c30\") "
Oct 31 17:42:49.531963 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:49.531887    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/61193be6-6ada-48ff-9e96-700c73f018dd-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/61193be6-6ada-48ff-9e96-700c73f018dd-credential-socket\") pod \"61193be6-6ada-48ff-9e96-700c73f018dd\" (UID: \"61193be6-6ada-48ff-9e96-700c73f018dd\") "
Oct 31 17:42:49.532066 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:49.531960    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/6de961b6-2fb6-404d-9db2-594a7ef76ccb-istio-token\" (UniqueName: \"kubernetes.io/projected/6de961b6-2fb6-404d-9db2-594a7ef76ccb-istio-token\") pod \"6de961b6-2fb6-404d-9db2-594a7ef76ccb\" (UID: \"6de961b6-2fb6-404d-9db2-594a7ef76ccb\") "
Oct 31 17:42:49.532066 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:49.532007    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/6de961b6-2fb6-404d-9db2-594a7ef76ccb-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6de961b6-2fb6-404d-9db2-594a7ef76ccb-istio-envoy\") pod \"6de961b6-2fb6-404d-9db2-594a7ef76ccb\" (UID: \"6de961b6-2fb6-404d-9db2-594a7ef76ccb\") "
Oct 31 17:42:49.532066 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:49.532045    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/6de961b6-2fb6-404d-9db2-594a7ef76ccb-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6de961b6-2fb6-404d-9db2-594a7ef76ccb-istio-data\") pod \"6de961b6-2fb6-404d-9db2-594a7ef76ccb\" (UID: \"6de961b6-2fb6-404d-9db2-594a7ef76ccb\") "
Oct 31 17:42:49.532220 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:49.532103    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/a92e2f56-5eb4-4b64-9947-25e1f0d51c30-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a92e2f56-5eb4-4b64-9947-25e1f0d51c30-istiod-ca-cert\") pod \"a92e2f56-5eb4-4b64-9947-25e1f0d51c30\" (UID: \"a92e2f56-5eb4-4b64-9947-25e1f0d51c30\") "
Oct 31 17:42:49.532220 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:49.532155    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/61193be6-6ada-48ff-9e96-700c73f018dd-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/61193be6-6ada-48ff-9e96-700c73f018dd-workload-certs\") pod \"61193be6-6ada-48ff-9e96-700c73f018dd\" (UID: \"61193be6-6ada-48ff-9e96-700c73f018dd\") "
Oct 31 17:42:49.532318 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:49.532233    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/61193be6-6ada-48ff-9e96-700c73f018dd-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/61193be6-6ada-48ff-9e96-700c73f018dd-istiod-ca-cert\") pod \"61193be6-6ada-48ff-9e96-700c73f018dd\" (UID: \"61193be6-6ada-48ff-9e96-700c73f018dd\") "
Oct 31 17:42:49.532318 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:49.532268    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/24b256e4-f9ad-4df2-ae67-bd7ddee0118e-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/24b256e4-f9ad-4df2-ae67-bd7ddee0118e-maas-api-xks-ca\") pod \"24b256e4-f9ad-4df2-ae67-bd7ddee0118e\" (UID: \"24b256e4-f9ad-4df2-ae67-bd7ddee0118e\") "
Oct 31 17:42:49.532408 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:49.532323    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/a92e2f56-5eb4-4b64-9947-25e1f0d51c30-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a92e2f56-5eb4-4b64-9947-25e1f0d51c30-istio-podinfo\") pod \"a92e2f56-5eb4-4b64-9947-25e1f0d51c30\" (UID: \"a92e2f56-5eb4-4b64-9947-25e1f0d51c30\") "
Oct 31 17:42:49.532408 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:49.532387    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/61193be6-6ada-48ff-9e96-700c73f018dd-kube-api-access-frxtv\" (UniqueName: \"kubernetes.io/projected/61193be6-6ada-48ff-9e96-700c73f018dd-kube-api-access-frxtv\") pod \"61193be6-6ada-48ff-9e96-700c73f018dd\" (UID: \"61193be6-6ada-48ff-9e96-700c73f018dd\") "
Oct 31 17:42:49.532508 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:49.532429    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/61193be6-6ada-48ff-9e96-700c73f018dd-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/61193be6-6ada-48ff-9e96-700c73f018dd-istio-podinfo\") pod \"61193be6-6ada-48ff-9e96-700c73f018dd\" (UID: \"61193be6-6ada-48ff-9e96-700c73f018dd\") "
Oct 31 17:42:49.532508 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:49.532487    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/6de961b6-2fb6-404d-9db2-594a7ef76ccb-kube-api-access-2wd8m\" (UniqueName: \"kubernetes.io/projected/6de961b6-2fb6-404d-9db2-594a7ef76ccb-kube-api-access-2wd8m\") pod \"6de961b6-2fb6-404d-9db2-594a7ef76ccb\" (UID: \"6de961b6-2fb6-404d-9db2-594a7ef76ccb\") "
Oct 31 17:42:49.532609 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:49.532520    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a92e2f56-5eb4-4b64-9947-25e1f0d51c30-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a92e2f56-5eb4-4b64-9947-25e1f0d51c30-workload-certs\") pod \"a92e2f56-5eb4-4b64-9947-25e1f0d51c30\" (UID: \"a92e2f56-5eb4-4b64-9947-25e1f0d51c30\") "
Oct 31 17:42:49.532679 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:49.532608    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/61193be6-6ada-48ff-9e96-700c73f018dd-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/61193be6-6ada-48ff-9e96-700c73f018dd-istio-data\") pod \"61193be6-6ada-48ff-9e96-700c73f018dd\" (UID: \"61193be6-6ada-48ff-9e96-700c73f018dd\") "
Oct 31 17:42:49.532679 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:49.532639    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/61193be6-6ada-48ff-9e96-700c73f018dd-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/61193be6-6ada-48ff-9e96-700c73f018dd-workload-socket\") pod \"61193be6-6ada-48ff-9e96-700c73f018dd\" (UID: \"61193be6-6ada-48ff-9e96-700c73f018dd\") "
Oct 31 17:42:49.532785 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:49.532693    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/6de961b6-2fb6-404d-9db2-594a7ef76ccb-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6de961b6-2fb6-404d-9db2-594a7ef76ccb-istiod-ca-cert\") pod \"6de961b6-2fb6-404d-9db2-594a7ef76ccb\" (UID: \"6de961b6-2fb6-404d-9db2-594a7ef76ccb\") "
Oct 31 17:42:49.532785 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:49.532748    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/24b256e4-f9ad-4df2-ae67-bd7ddee0118e-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/24b256e4-f9ad-4df2-ae67-bd7ddee0118e-maas-api-openshift-ca\") pod \"24b256e4-f9ad-4df2-ae67-bd7ddee0118e\" (UID: \"24b256e4-f9ad-4df2-ae67-bd7ddee0118e\") "
Oct 31 17:42:49.532879 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:49.532786    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a92e2f56-5eb4-4b64-9947-25e1f0d51c30-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a92e2f56-5eb4-4b64-9947-25e1f0d51c30-workload-socket\") pod \"a92e2f56-5eb4-4b64-9947-25e1f0d51c30\" (UID: \"a92e2f56-5eb4-4b64-9947-25e1f0d51c30\") "
Oct 31 17:42:49.532879 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:49.532832    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/6de961b6-2fb6-404d-9db2-594a7ef76ccb-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6de961b6-2fb6-404d-9db2-594a7ef76ccb-credential-socket\") pod \"6de961b6-2fb6-404d-9db2-594a7ef76ccb\" (UID: \"6de961b6-2fb6-404d-9db2-594a7ef76ccb\") "
Oct 31 17:42:49.532982 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:49.532875    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a92e2f56-5eb4-4b64-9947-25e1f0d51c30-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a92e2f56-5eb4-4b64-9947-25e1f0d51c30-credential-socket\") pod \"a92e2f56-5eb4-4b64-9947-25e1f0d51c30\" (UID: \"a92e2f56-5eb4-4b64-9947-25e1f0d51c30\") "
Oct 31 17:42:49.534343 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:49.534320    5003 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6de961b6-2fb6-404d-9db2-594a7ef76ccb-workload-certs\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:42:49.534454 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:49.534350    5003 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6de961b6-2fb6-404d-9db2-594a7ef76ccb-workload-socket\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:42:49.538680 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:49.537971    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a92e2f56-5eb4-4b64-9947-25e1f0d51c30-istiod-ca-cert" pod "a92e2f56-5eb4-4b64-9947-25e1f0d51c30" (UID: "a92e2f56-5eb4-4b64-9947-25e1f0d51c30"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 17:42:49.538680 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:49.538235    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a92e2f56-5eb4-4b64-9947-25e1f0d51c30-istio-data" pod "a92e2f56-5eb4-4b64-9947-25e1f0d51c30" (UID: "a92e2f56-5eb4-4b64-9947-25e1f0d51c30"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 17:42:49.538680 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:49.538390    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/61193be6-6ada-48ff-9e96-700c73f018dd-credential-socket" pod "61193be6-6ada-48ff-9e96-700c73f018dd" (UID: "61193be6-6ada-48ff-9e96-700c73f018dd"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 17:42:49.538680 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:49.538524    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/61193be6-6ada-48ff-9e96-700c73f018dd-workload-certs" pod "61193be6-6ada-48ff-9e96-700c73f018dd" (UID: "61193be6-6ada-48ff-9e96-700c73f018dd"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 17:42:49.538928 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:49.538706    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6de961b6-2fb6-404d-9db2-594a7ef76ccb-istio-data" pod "6de961b6-2fb6-404d-9db2-594a7ef76ccb" (UID: "6de961b6-2fb6-404d-9db2-594a7ef76ccb"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 17:42:49.538928 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:49.538747    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/6de961b6-2fb6-404d-9db2-594a7ef76ccb-istio-podinfo" pod "6de961b6-2fb6-404d-9db2-594a7ef76ccb" (UID: "6de961b6-2fb6-404d-9db2-594a7ef76ccb"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 31 17:42:49.538928 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:49.538903    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/61193be6-6ada-48ff-9e96-700c73f018dd-istio-data" pod "61193be6-6ada-48ff-9e96-700c73f018dd" (UID: "61193be6-6ada-48ff-9e96-700c73f018dd"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 17:42:49.539689 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:49.539498    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a92e2f56-5eb4-4b64-9947-25e1f0d51c30-workload-certs" pod "a92e2f56-5eb4-4b64-9947-25e1f0d51c30" (UID: "a92e2f56-5eb4-4b64-9947-25e1f0d51c30"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 17:42:49.540670 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:49.539948    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a92e2f56-5eb4-4b64-9947-25e1f0d51c30-workload-socket" pod "a92e2f56-5eb4-4b64-9947-25e1f0d51c30" (UID: "a92e2f56-5eb4-4b64-9947-25e1f0d51c30"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 17:42:49.540670 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:49.540139    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6de961b6-2fb6-404d-9db2-594a7ef76ccb-credential-socket" pod "6de961b6-2fb6-404d-9db2-594a7ef76ccb" (UID: "6de961b6-2fb6-404d-9db2-594a7ef76ccb"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 17:42:49.540670 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:49.540251    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a92e2f56-5eb4-4b64-9947-25e1f0d51c30-kube-api-access-dvwrv" pod "a92e2f56-5eb4-4b64-9947-25e1f0d51c30" (UID: "a92e2f56-5eb4-4b64-9947-25e1f0d51c30"). InnerVolumeSpecName "kube-api-access-dvwrv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 17:42:49.540670 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:49.539877    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/24b256e4-f9ad-4df2-ae67-bd7ddee0118e-maas-api-openshift-ca" pod "24b256e4-f9ad-4df2-ae67-bd7ddee0118e" (UID: "24b256e4-f9ad-4df2-ae67-bd7ddee0118e"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 17:42:49.540670 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:49.540438    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/61193be6-6ada-48ff-9e96-700c73f018dd-workload-socket" pod "61193be6-6ada-48ff-9e96-700c73f018dd" (UID: "61193be6-6ada-48ff-9e96-700c73f018dd"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 17:42:49.540670 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:49.540620    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6de961b6-2fb6-404d-9db2-594a7ef76ccb-istiod-ca-cert" pod "6de961b6-2fb6-404d-9db2-594a7ef76ccb" (UID: "6de961b6-2fb6-404d-9db2-594a7ef76ccb"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 17:42:49.541054 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:49.540733    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/61193be6-6ada-48ff-9e96-700c73f018dd-istiod-ca-cert" pod "61193be6-6ada-48ff-9e96-700c73f018dd" (UID: "61193be6-6ada-48ff-9e96-700c73f018dd"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 17:42:49.543668 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:49.542696    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/61193be6-6ada-48ff-9e96-700c73f018dd-istio-podinfo" pod "61193be6-6ada-48ff-9e96-700c73f018dd" (UID: "61193be6-6ada-48ff-9e96-700c73f018dd"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 31 17:42:49.543668 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:49.542765    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6de961b6-2fb6-404d-9db2-594a7ef76ccb-istio-envoy" pod "6de961b6-2fb6-404d-9db2-594a7ef76ccb" (UID: "6de961b6-2fb6-404d-9db2-594a7ef76ccb"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 17:42:49.545202 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:49.543973    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a92e2f56-5eb4-4b64-9947-25e1f0d51c30-credential-socket" pod "a92e2f56-5eb4-4b64-9947-25e1f0d51c30" (UID: "a92e2f56-5eb4-4b64-9947-25e1f0d51c30"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 17:42:49.545202 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:49.544195    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/61193be6-6ada-48ff-9e96-700c73f018dd-kube-api-access-frxtv" pod "61193be6-6ada-48ff-9e96-700c73f018dd" (UID: "61193be6-6ada-48ff-9e96-700c73f018dd"). InnerVolumeSpecName "kube-api-access-frxtv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 17:42:49.545202 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:49.544588    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a92e2f56-5eb4-4b64-9947-25e1f0d51c30-istio-token" pod "a92e2f56-5eb4-4b64-9947-25e1f0d51c30" (UID: "a92e2f56-5eb4-4b64-9947-25e1f0d51c30"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 17:42:49.545202 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:49.544914    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a92e2f56-5eb4-4b64-9947-25e1f0d51c30-istio-envoy" pod "a92e2f56-5eb4-4b64-9947-25e1f0d51c30" (UID: "a92e2f56-5eb4-4b64-9947-25e1f0d51c30"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 17:42:49.545202 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:49.544934    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/a92e2f56-5eb4-4b64-9947-25e1f0d51c30-istio-podinfo" pod "a92e2f56-5eb4-4b64-9947-25e1f0d51c30" (UID: "a92e2f56-5eb4-4b64-9947-25e1f0d51c30"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 31 17:42:49.545202 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:49.544987    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/61193be6-6ada-48ff-9e96-700c73f018dd-istio-token" pod "61193be6-6ada-48ff-9e96-700c73f018dd" (UID: "61193be6-6ada-48ff-9e96-700c73f018dd"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 17:42:49.545202 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:49.545036    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/61193be6-6ada-48ff-9e96-700c73f018dd-istio-envoy" pod "61193be6-6ada-48ff-9e96-700c73f018dd" (UID: "61193be6-6ada-48ff-9e96-700c73f018dd"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 17:42:49.545202 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:49.545138    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6de961b6-2fb6-404d-9db2-594a7ef76ccb-kube-api-access-2wd8m" pod "6de961b6-2fb6-404d-9db2-594a7ef76ccb" (UID: "6de961b6-2fb6-404d-9db2-594a7ef76ccb"). InnerVolumeSpecName "kube-api-access-2wd8m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 17:42:49.545789 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:49.545752    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/24b256e4-f9ad-4df2-ae67-bd7ddee0118e-maas-api-xks-ca" pod "24b256e4-f9ad-4df2-ae67-bd7ddee0118e" (UID: "24b256e4-f9ad-4df2-ae67-bd7ddee0118e"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 17:42:49.545789 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:49.545752    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/24b256e4-f9ad-4df2-ae67-bd7ddee0118e-kube-api-access-2fb94" pod "24b256e4-f9ad-4df2-ae67-bd7ddee0118e" (UID: "24b256e4-f9ad-4df2-ae67-bd7ddee0118e"). InnerVolumeSpecName "kube-api-access-2fb94". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 17:42:49.552696 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:49.546233    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6de961b6-2fb6-404d-9db2-594a7ef76ccb-istio-token" pod "6de961b6-2fb6-404d-9db2-594a7ef76ccb" (UID: "6de961b6-2fb6-404d-9db2-594a7ef76ccb"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 17:42:49.604398 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:49.604297    5003 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-5c446c-openshift-default-797c6dc855-v5k9r"
Oct 31 17:42:49.636452 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:49.636414    5003 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2fb94\" (UniqueName: \"kubernetes.io/projected/24b256e4-f9ad-4df2-ae67-bd7ddee0118e-kube-api-access-2fb94\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:42:49.636452 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:49.636454    5003 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/61193be6-6ada-48ff-9e96-700c73f018dd-istio-envoy\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:42:49.636665 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:49.636468    5003 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a92e2f56-5eb4-4b64-9947-25e1f0d51c30-istio-token\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:42:49.636665 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:49.636505    5003 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dvwrv\" (UniqueName: \"kubernetes.io/projected/a92e2f56-5eb4-4b64-9947-25e1f0d51c30-kube-api-access-dvwrv\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:42:49.636665 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:49.636518    5003 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a92e2f56-5eb4-4b64-9947-25e1f0d51c30-istio-data\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:42:49.636665 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:49.636529    5003 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/61193be6-6ada-48ff-9e96-700c73f018dd-credential-socket\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:42:49.636665 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:49.636542    5003 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6de961b6-2fb6-404d-9db2-594a7ef76ccb-istio-token\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:42:49.636665 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:49.636554    5003 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6de961b6-2fb6-404d-9db2-594a7ef76ccb-istio-envoy\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:42:49.636665 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:49.636564    5003 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6de961b6-2fb6-404d-9db2-594a7ef76ccb-istio-data\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:42:49.636665 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:49.636575    5003 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a92e2f56-5eb4-4b64-9947-25e1f0d51c30-istiod-ca-cert\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:42:49.636665 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:49.636586    5003 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/61193be6-6ada-48ff-9e96-700c73f018dd-workload-certs\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:42:49.636665 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:49.636597    5003 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/61193be6-6ada-48ff-9e96-700c73f018dd-istiod-ca-cert\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:42:49.636665 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:49.636610    5003 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/24b256e4-f9ad-4df2-ae67-bd7ddee0118e-maas-api-xks-ca\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:42:49.636665 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:49.636621    5003 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a92e2f56-5eb4-4b64-9947-25e1f0d51c30-istio-podinfo\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:42:49.636665 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:49.636632    5003 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-frxtv\" (UniqueName: \"kubernetes.io/projected/61193be6-6ada-48ff-9e96-700c73f018dd-kube-api-access-frxtv\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:42:49.636665 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:49.636662    5003 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/61193be6-6ada-48ff-9e96-700c73f018dd-istio-podinfo\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:42:49.637045 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:49.636675    5003 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2wd8m\" (UniqueName: \"kubernetes.io/projected/6de961b6-2fb6-404d-9db2-594a7ef76ccb-kube-api-access-2wd8m\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:42:49.637045 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:49.636687    5003 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a92e2f56-5eb4-4b64-9947-25e1f0d51c30-workload-certs\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:42:49.637045 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:49.636698    5003 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/61193be6-6ada-48ff-9e96-700c73f018dd-istio-data\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:42:49.637045 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:49.636710    5003 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/61193be6-6ada-48ff-9e96-700c73f018dd-workload-socket\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:42:49.637045 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:49.636721    5003 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6de961b6-2fb6-404d-9db2-594a7ef76ccb-istiod-ca-cert\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:42:49.637045 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:49.636735    5003 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/24b256e4-f9ad-4df2-ae67-bd7ddee0118e-maas-api-openshift-ca\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:42:49.637045 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:49.636747    5003 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a92e2f56-5eb4-4b64-9947-25e1f0d51c30-workload-socket\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:42:49.637045 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:49.636760    5003 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6de961b6-2fb6-404d-9db2-594a7ef76ccb-credential-socket\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:42:49.637045 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:49.636773    5003 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a92e2f56-5eb4-4b64-9947-25e1f0d51c30-credential-socket\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:42:49.637045 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:49.636786    5003 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/61193be6-6ada-48ff-9e96-700c73f018dd-istio-token\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:42:49.637045 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:49.636799    5003 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6de961b6-2fb6-404d-9db2-594a7ef76ccb-istio-podinfo\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:42:49.637045 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:49.636810    5003 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a92e2f56-5eb4-4b64-9947-25e1f0d51c30-istio-envoy\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:42:49.737440 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:49.737406    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/ef941538-5385-4d44-98cd-ffddd91e9dc5-istio-token\" (UniqueName: \"kubernetes.io/projected/ef941538-5385-4d44-98cd-ffddd91e9dc5-istio-token\") pod \"ef941538-5385-4d44-98cd-ffddd91e9dc5\" (UID: \"ef941538-5385-4d44-98cd-ffddd91e9dc5\") "
Oct 31 17:42:49.737958 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:49.737470    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/ef941538-5385-4d44-98cd-ffddd91e9dc5-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ef941538-5385-4d44-98cd-ffddd91e9dc5-istiod-ca-cert\") pod \"ef941538-5385-4d44-98cd-ffddd91e9dc5\" (UID: \"ef941538-5385-4d44-98cd-ffddd91e9dc5\") "
Oct 31 17:42:49.737958 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:49.737505    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ef941538-5385-4d44-98cd-ffddd91e9dc5-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ef941538-5385-4d44-98cd-ffddd91e9dc5-istio-envoy\") pod \"ef941538-5385-4d44-98cd-ffddd91e9dc5\" (UID: \"ef941538-5385-4d44-98cd-ffddd91e9dc5\") "
Oct 31 17:42:49.737958 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:49.737530    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ef941538-5385-4d44-98cd-ffddd91e9dc5-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ef941538-5385-4d44-98cd-ffddd91e9dc5-workload-certs\") pod \"ef941538-5385-4d44-98cd-ffddd91e9dc5\" (UID: \"ef941538-5385-4d44-98cd-ffddd91e9dc5\") "
Oct 31 17:42:49.737958 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:49.737546    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ef941538-5385-4d44-98cd-ffddd91e9dc5-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ef941538-5385-4d44-98cd-ffddd91e9dc5-credential-socket\") pod \"ef941538-5385-4d44-98cd-ffddd91e9dc5\" (UID: \"ef941538-5385-4d44-98cd-ffddd91e9dc5\") "
Oct 31 17:42:49.737958 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:49.737587    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/ef941538-5385-4d44-98cd-ffddd91e9dc5-kube-api-access-w55mk\" (UniqueName: \"kubernetes.io/projected/ef941538-5385-4d44-98cd-ffddd91e9dc5-kube-api-access-w55mk\") pod \"ef941538-5385-4d44-98cd-ffddd91e9dc5\" (UID: \"ef941538-5385-4d44-98cd-ffddd91e9dc5\") "
Oct 31 17:42:49.737958 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:49.737745    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/ef941538-5385-4d44-98cd-ffddd91e9dc5-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ef941538-5385-4d44-98cd-ffddd91e9dc5-istio-podinfo\") pod \"ef941538-5385-4d44-98cd-ffddd91e9dc5\" (UID: \"ef941538-5385-4d44-98cd-ffddd91e9dc5\") "
Oct 31 17:42:49.737958 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:49.737871    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ef941538-5385-4d44-98cd-ffddd91e9dc5-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ef941538-5385-4d44-98cd-ffddd91e9dc5-istio-data\") pod \"ef941538-5385-4d44-98cd-ffddd91e9dc5\" (UID: \"ef941538-5385-4d44-98cd-ffddd91e9dc5\") "
Oct 31 17:42:49.737958 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:49.737874    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ef941538-5385-4d44-98cd-ffddd91e9dc5-workload-certs" pod "ef941538-5385-4d44-98cd-ffddd91e9dc5" (UID: "ef941538-5385-4d44-98cd-ffddd91e9dc5"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 17:42:49.737958 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:49.737936    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ef941538-5385-4d44-98cd-ffddd91e9dc5-credential-socket" pod "ef941538-5385-4d44-98cd-ffddd91e9dc5" (UID: "ef941538-5385-4d44-98cd-ffddd91e9dc5"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 17:42:49.739348 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:49.737981    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ef941538-5385-4d44-98cd-ffddd91e9dc5-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ef941538-5385-4d44-98cd-ffddd91e9dc5-workload-socket\") pod \"ef941538-5385-4d44-98cd-ffddd91e9dc5\" (UID: \"ef941538-5385-4d44-98cd-ffddd91e9dc5\") "
Oct 31 17:42:49.739348 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:49.738105    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ef941538-5385-4d44-98cd-ffddd91e9dc5-istio-data" pod "ef941538-5385-4d44-98cd-ffddd91e9dc5" (UID: "ef941538-5385-4d44-98cd-ffddd91e9dc5"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 17:42:49.739348 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:49.738136    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ef941538-5385-4d44-98cd-ffddd91e9dc5-istiod-ca-cert" pod "ef941538-5385-4d44-98cd-ffddd91e9dc5" (UID: "ef941538-5385-4d44-98cd-ffddd91e9dc5"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 17:42:49.739348 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:49.738373    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ef941538-5385-4d44-98cd-ffddd91e9dc5-workload-socket" pod "ef941538-5385-4d44-98cd-ffddd91e9dc5" (UID: "ef941538-5385-4d44-98cd-ffddd91e9dc5"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 17:42:49.739348 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:49.738769    5003 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ef941538-5385-4d44-98cd-ffddd91e9dc5-istiod-ca-cert\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:42:49.739348 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:49.738788    5003 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ef941538-5385-4d44-98cd-ffddd91e9dc5-workload-certs\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:42:49.739348 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:49.738801    5003 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ef941538-5385-4d44-98cd-ffddd91e9dc5-credential-socket\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:42:49.739348 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:49.738817    5003 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ef941538-5385-4d44-98cd-ffddd91e9dc5-istio-data\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:42:49.739348 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:49.738831    5003 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ef941538-5385-4d44-98cd-ffddd91e9dc5-workload-socket\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:42:49.740212 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:49.739851    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ef941538-5385-4d44-98cd-ffddd91e9dc5-istio-token" pod "ef941538-5385-4d44-98cd-ffddd91e9dc5" (UID: "ef941538-5385-4d44-98cd-ffddd91e9dc5"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 17:42:49.740212 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:49.740054    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ef941538-5385-4d44-98cd-ffddd91e9dc5-kube-api-access-w55mk" pod "ef941538-5385-4d44-98cd-ffddd91e9dc5" (UID: "ef941538-5385-4d44-98cd-ffddd91e9dc5"). InnerVolumeSpecName "kube-api-access-w55mk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 17:42:49.740532 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:49.740510    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/ef941538-5385-4d44-98cd-ffddd91e9dc5-istio-podinfo" pod "ef941538-5385-4d44-98cd-ffddd91e9dc5" (UID: "ef941538-5385-4d44-98cd-ffddd91e9dc5"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 31 17:42:49.740695 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:49.740679    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ef941538-5385-4d44-98cd-ffddd91e9dc5-istio-envoy" pod "ef941538-5385-4d44-98cd-ffddd91e9dc5" (UID: "ef941538-5385-4d44-98cd-ffddd91e9dc5"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 17:42:49.839903 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:49.839867    5003 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ef941538-5385-4d44-98cd-ffddd91e9dc5-istio-token\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:42:49.839903 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:49.839897    5003 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ef941538-5385-4d44-98cd-ffddd91e9dc5-istio-envoy\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:42:49.839903 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:49.839907    5003 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w55mk\" (UniqueName: \"kubernetes.io/projected/ef941538-5385-4d44-98cd-ffddd91e9dc5-kube-api-access-w55mk\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:42:49.840133 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:49.839918    5003 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ef941538-5385-4d44-98cd-ffddd91e9dc5-istio-podinfo\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:42:49.891469 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:49.891437    5003 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="3dac59b3-ae83-496f-87cb-16c7fd249497" path="/var/lib/kubelet/pods/3dac59b3-ae83-496f-87cb-16c7fd249497/volumes"
Oct 31 17:42:49.891968 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:49.891953    5003 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="ebe4bd91-be4d-4d45-89f7-5aa595b9e2aa" path="/var/lib/kubelet/pods/ebe4bd91-be4d-4d45-89f7-5aa595b9e2aa/volumes"
Oct 31 17:42:50.144178 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:50.144095    5003 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-5c446c-openshift-default-797c6dc855-rtzkv"
Oct 31 17:42:50.144329 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:50.144097    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-5c446c-openshift-default-797c6dc855-rtzkv" event={"ID":"80900980-7b5e-4d15-a9db-279185d25b57","Type":"ContainerDied","Data":"b44bddaaa36e4a55159d5ad187508002f81f9a5714031313869850d8a1769513"}
Oct 31 17:42:50.144329 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:50.144294    5003 scope.go:122] "RemoveContainer" containerID="1f3b2bf06f9049ce80d34c68d2cf5be1c701f068ac3e2d6d9ee9d5463b12eb29"
Oct 31 17:42:50.146331 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:50.146306    5003 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-5c446c-openshift-default-797c6dc855-v5k9r"
Oct 31 17:42:50.146475 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:50.146311    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-5c446c-openshift-default-797c6dc855-v5k9r" event={"ID":"ef941538-5385-4d44-98cd-ffddd91e9dc5","Type":"ContainerDied","Data":"78acb7f55486d10f16593f4acef02e7f7bfa6c2434b34b6004f18794475959e1"}
Oct 31 17:42:50.148392 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:50.148372    5003 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-5c446c-openshift-default-797c6dc855-w477z"
Oct 31 17:42:50.148591 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:50.148384    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-5c446c-openshift-default-797c6dc855-w477z" event={"ID":"a92e2f56-5eb4-4b64-9947-25e1f0d51c30","Type":"ContainerDied","Data":"ef750e3e0012bb27a6414dfb9dbad9a4a855f31e127f5674e64d2e450a3f6c8a"}
Oct 31 17:42:50.150033 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:50.150015    5003 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-5c446c-openshift-default-797c6dc855-nd8tv"
Oct 31 17:42:50.150119 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:50.150044    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-5c446c-openshift-default-797c6dc855-nd8tv" event={"ID":"6de961b6-2fb6-404d-9db2-594a7ef76ccb","Type":"ContainerDied","Data":"c5e9b80470d33df71dc35a3c8b8c784a19d0c30dd1f089c0a42551c7c24fc22f"}
Oct 31 17:42:50.152497 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:50.152468    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-cf0a86-openshift-default-595bfdc58c-jg25b" event={"ID":"61193be6-6ada-48ff-9e96-700c73f018dd","Type":"ContainerDied","Data":"01fc905e40cc6a5789df8d17f25033cb71a9b2553f7847ef43b288a0c1b8bdc3"}
Oct 31 17:42:50.152588 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:50.152476    5003 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-cf0a86-openshift-default-595bfdc58c-jg25b"
Oct 31 17:42:50.174667 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:50.154594    5003 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-d8e5e35c-xlfxz"
Oct 31 17:42:50.174667 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:50.155917    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-d8e5e35c-xlfxz" event={"ID":"24b256e4-f9ad-4df2-ae67-bd7ddee0118e","Type":"ContainerDied","Data":"5f22c7e977f37d800bdf1758dfba9a9551f9b8b95bfbaf912c4ba085eb7d22f8"}
Oct 31 17:42:50.174667 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:50.155961    5003 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5f22c7e977f37d800bdf1758dfba9a9551f9b8b95bfbaf912c4ba085eb7d22f8"
Oct 31 17:42:50.198992 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:50.198960    5003 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-processing-e2e-worker-w6-d80080-7f8f6c66c-btxwt" podUID="d6d7f818-43c5-4470-9799-6b6e6cebb928" containerName="payload-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 31 17:42:50.204361 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:50.204341    5003 scope.go:122] "RemoveContainer" containerID="30c12535f0c7c5fa7b42e42386e0219a6c8fb87af5a09c9aac4edac282a087b1"
Oct 31 17:42:50.215024 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:50.215005    5003 scope.go:122] "RemoveContainer" containerID="88f32c22ff949f40ab5613152bad312210dc8e101df7d91e55a418b417b6426d"
Oct 31 17:42:50.224968 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:50.224947    5003 scope.go:122] "RemoveContainer" containerID="52c5c37ad0287ee27616dbe9180e24eb2b511582d0419ad96d3978d8fba03075"
Oct 31 17:42:50.235795 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:50.235775    5003 scope.go:122] "RemoveContainer" containerID="15223b5a03fae4c192405ab90afbea6bc329c562bbc20103f6a231f371f1d23e"
Oct 31 17:42:50.286132 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:50.286086    5003 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w2-5c446c-openshift-default-797c6dc855-rtzkv"]
Oct 31 17:42:50.291249 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:50.291220    5003 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w2-5c446c-openshift-default-797c6dc855-rtzkv"]
Oct 31 17:42:50.308123 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:50.308091    5003 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w2-5c446c-openshift-default-797c6dc855-v5k9r"]
Oct 31 17:42:50.313916 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:50.313885    5003 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w2-5c446c-openshift-default-797c6dc855-v5k9r"]
Oct 31 17:42:50.317875 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:50.317851    5003 patch_prober.go:29] interesting pod/e2e-worker-w5-b78c31-openshift-default-774cb4f6c9-nhqll container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.130:15021/healthz/ready\": dial tcp 10.132.0.130:15021: connect: connection refused" start-of-body=
Oct 31 17:42:50.318020 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:50.317894    5003 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-b78c31-openshift-default-774cb4f6c9-nhqll" podUID="b0a16d54-5d2c-4c23-bf11-9cfe1844b568" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.130:15021/healthz/ready\": dial tcp 10.132.0.130:15021: connect: connection refused"
Oct 31 17:42:50.405727 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:50.400126    5003 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w2-5c446c-openshift-default-797c6dc855-w477z"]
Oct 31 17:42:50.438689 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:50.433725    5003 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w2-5c446c-openshift-default-797c6dc855-w477z"]
Oct 31 17:42:50.450837 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:50.450799    5003 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w2-5c446c-openshift-default-797c6dc855-nd8tv"]
Oct 31 17:42:50.479041 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:50.479007    5003 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w2-5c446c-openshift-default-797c6dc855-nd8tv"]
Oct 31 17:42:50.489207 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:50.489173    5003 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w3-cf0a86-openshift-default-595bfdc58c-jg25b"]
Oct 31 17:42:50.494269 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:50.494241    5003 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w3-cf0a86-openshift-default-595bfdc58c-jg25b"]
Oct 31 17:42:51.212540 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:51.212506    5003 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-ee816e-7cd5d5699-t92fc" podUID="d0144654-e609-4e0f-9c06-7522cefcf9f0" containerName="payload-pre-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 31 17:42:51.212969 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:51.212678    5003 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-processing-e2e-worker-w0-ee816e-7d6bc48879-mmfcd" podUID="7a49c490-67e7-4f7e-8ce9-11def81392e4" containerName="payload-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 31 17:42:51.318454 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:51.318424    5003 patch_prober.go:29] interesting pod/e2e-worker-w5-b78c31-openshift-default-774cb4f6c9-nhqll container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.130:15021/healthz/ready\": dial tcp 10.132.0.130:15021: connect: connection refused" start-of-body=
Oct 31 17:42:51.318602 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:51.318475    5003 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-b78c31-openshift-default-774cb4f6c9-nhqll" podUID="b0a16d54-5d2c-4c23-bf11-9cfe1844b568" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.130:15021/healthz/ready\": dial tcp 10.132.0.130:15021: connect: connection refused"
Oct 31 17:42:51.891983 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:51.891950    5003 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="61193be6-6ada-48ff-9e96-700c73f018dd" path="/var/lib/kubelet/pods/61193be6-6ada-48ff-9e96-700c73f018dd/volumes"
Oct 31 17:42:51.892432 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:51.892418    5003 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="6de961b6-2fb6-404d-9db2-594a7ef76ccb" path="/var/lib/kubelet/pods/6de961b6-2fb6-404d-9db2-594a7ef76ccb/volumes"
Oct 31 17:42:51.892883 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:51.892870    5003 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="80900980-7b5e-4d15-a9db-279185d25b57" path="/var/lib/kubelet/pods/80900980-7b5e-4d15-a9db-279185d25b57/volumes"
Oct 31 17:42:51.893632 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:51.893617    5003 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="a92e2f56-5eb4-4b64-9947-25e1f0d51c30" path="/var/lib/kubelet/pods/a92e2f56-5eb4-4b64-9947-25e1f0d51c30/volumes"
Oct 31 17:42:51.894067 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:51.894053    5003 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="ef941538-5385-4d44-98cd-ffddd91e9dc5" path="/var/lib/kubelet/pods/ef941538-5385-4d44-98cd-ffddd91e9dc5/volumes"
Oct 31 17:42:52.318802 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:52.318765    5003 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-mst4q"]
Oct 31 17:42:52.319337 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:52.319095    5003 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-mst4q" podUID="fa5b3d0d-4ae9-4f60-8af5-571df26ba157" containerName="istio-proxy" containerID="cri-o://a005f0f8ec631a78f1a1a23eed30e31fb1003883e3697da4d31aa9419acfaa03" gracePeriod=30
Oct 31 17:42:52.320250 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:52.320216    5003 patch_prober.go:29] interesting pod/e2e-worker-w5-b78c31-openshift-default-774cb4f6c9-nhqll container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.130:15021/healthz/ready\": dial tcp 10.132.0.130:15021: connect: connection refused" start-of-body=
Oct 31 17:42:52.320425 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:52.320289    5003 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-b78c31-openshift-default-774cb4f6c9-nhqll" podUID="b0a16d54-5d2c-4c23-bf11-9cfe1844b568" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.130:15021/healthz/ready\": dial tcp 10.132.0.130:15021: connect: connection refused"
Oct 31 17:42:52.325665 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:52.325615    5003 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-9rlpc"]
Oct 31 17:42:52.325896 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:52.325851    5003 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-9rlpc" podUID="a115d540-ac87-497f-97f8-bd2e52d066f7" containerName="istio-proxy" containerID="cri-o://ddb2cb22d217daf6a7ea2d32877c8ae9d586aa3974ac305c3a99a4fc6c9d460f" gracePeriod=30
Oct 31 17:42:52.330395 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:52.330368    5003 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-64dkg"]
Oct 31 17:42:52.330558 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:52.330540    5003 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-64dkg" podUID="73f3a3b3-a5dd-4054-be25-5e23a820c5fe" containerName="istio-proxy" containerID="cri-o://6980e2f4859dd66f13efe444e15d8017e4212565c288f08348e4220c18fa54fa" gracePeriod=30
Oct 31 17:42:52.334925 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:52.334893    5003 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-bpm5b"]
Oct 31 17:42:52.335136 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:52.335114    5003 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-bpm5b" podUID="9bf16293-fd1c-421b-9f91-3c7178ed7cd3" containerName="istio-proxy" containerID="cri-o://78ca469a468ffb32a72aae916b4608a505f9d720a4103418099ff4684025deeb" gracePeriod=30
Oct 31 17:42:53.220326 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:53.220286    5003 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-processing-e2e-worker-w5-b78c31-86cdfb657c-m4s5d" podUID="06aa3682-3041-49d8-b240-761092b11dc9" containerName="payload-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 31 17:42:53.317919 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:53.317873    5003 patch_prober.go:29] interesting pod/e2e-worker-w5-b78c31-openshift-default-774cb4f6c9-nhqll container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.130:15021/healthz/ready\": dial tcp 10.132.0.130:15021: connect: connection refused" start-of-body=
Oct 31 17:42:53.318064 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:53.317952    5003 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-b78c31-openshift-default-774cb4f6c9-nhqll" podUID="b0a16d54-5d2c-4c23-bf11-9cfe1844b568" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.130:15021/healthz/ready\": dial tcp 10.132.0.130:15021: connect: connection refused"
Oct 31 17:42:54.318260 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:54.318219    5003 patch_prober.go:29] interesting pod/e2e-worker-w5-b78c31-openshift-default-774cb4f6c9-nhqll container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.130:15021/healthz/ready\": dial tcp 10.132.0.130:15021: connect: connection refused" start-of-body=
Oct 31 17:42:54.318749 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:54.318284    5003 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-b78c31-openshift-default-774cb4f6c9-nhqll" podUID="b0a16d54-5d2c-4c23-bf11-9cfe1844b568" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.130:15021/healthz/ready\": dial tcp 10.132.0.130:15021: connect: connection refused"
Oct 31 17:42:55.243745 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:55.243702    5003 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-processing-e2e-worker-w4-1c0bfd-754b9cb7cf-gpdmq" podUID="6eff589e-d19b-4ea9-898e-85009de000eb" containerName="payload-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 31 17:42:55.321805 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:55.321773    5003 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w5-b78c31-openshift-default-774cb4f6c9-nhqll"
Oct 31 17:42:55.322265 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:55.322253    5003 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w5-b78c31-openshift-default-774cb4f6c9-nhqll"
Oct 31 17:42:55.322889 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:55.322868    5003 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w5-b78c31-openshift-default-774cb4f6c9-nhqll"
Oct 31 17:42:55.355769 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:55.355737    5003 patch_prober.go:29] interesting pod/e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-64dkg container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Oct 31 17:42:55.355898 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:55.355788    5003 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-64dkg" podUID="73f3a3b3-a5dd-4054-be25-5e23a820c5fe" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 31 17:42:55.855832 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:55.855794    5003 patch_prober.go:29] interesting pod/e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-bpm5b container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Oct 31 17:42:55.856013 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:55.855875    5003 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-bpm5b" podUID="9bf16293-fd1c-421b-9f91-3c7178ed7cd3" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 31 17:42:56.330285 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:56.330250    5003 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-1c0bfd-84cbc7675-n2bbv" podUID="2335abae-520f-4557-8ffd-ab60cbb68812" containerName="payload-pre-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 31 17:42:56.834070 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:56.834048    5003 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w5-b78c31-86cdfb657c-m4s5d"
Oct 31 17:42:56.927562 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:56.927473    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/06aa3682-3041-49d8-b240-761092b11dc9-kube-api-access-wndws\" (UniqueName: \"kubernetes.io/projected/06aa3682-3041-49d8-b240-761092b11dc9-kube-api-access-wndws\") pod \"06aa3682-3041-49d8-b240-761092b11dc9\" (UID: \"06aa3682-3041-49d8-b240-761092b11dc9\") "
Oct 31 17:42:56.927562 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:56.927551    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/06aa3682-3041-49d8-b240-761092b11dc9-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/06aa3682-3041-49d8-b240-761092b11dc9-plugins-config-volume\") pod \"06aa3682-3041-49d8-b240-761092b11dc9\" (UID: \"06aa3682-3041-49d8-b240-761092b11dc9\") "
Oct 31 17:42:56.927972 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:56.927949    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/06aa3682-3041-49d8-b240-761092b11dc9-plugins-config-volume" pod "06aa3682-3041-49d8-b240-761092b11dc9" (UID: "06aa3682-3041-49d8-b240-761092b11dc9"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 17:42:56.928181 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:56.928163    5003 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/06aa3682-3041-49d8-b240-761092b11dc9-plugins-config-volume\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:42:56.929751 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:56.929728    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/06aa3682-3041-49d8-b240-761092b11dc9-kube-api-access-wndws" pod "06aa3682-3041-49d8-b240-761092b11dc9" (UID: "06aa3682-3041-49d8-b240-761092b11dc9"). InnerVolumeSpecName "kube-api-access-wndws". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 17:42:57.029156 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:57.029123    5003 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wndws\" (UniqueName: \"kubernetes.io/projected/06aa3682-3041-49d8-b240-761092b11dc9-kube-api-access-wndws\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:42:57.166354 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:57.166311    5003 patch_prober.go:29] interesting pod/e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-mst4q container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=upstream connect error or disconnect/reset before headers. reset reason: remote connection failure, transport failure reason: delayed connect error: Connection refused
Oct 31 17:42:57.166499 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:57.166369    5003 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-mst4q" podUID="fa5b3d0d-4ae9-4f60-8af5-571df26ba157" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 31 17:42:57.244253 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:57.244172    5003 generic.go:356] "Generic (PLEG): container finished" podID="06aa3682-3041-49d8-b240-761092b11dc9" containerID="695bb9d51a97ef5793c4817e95a5b6a014f7271b66789311a45ca17c2b1256dc" exitCode=0
Oct 31 17:42:57.244386 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:57.244272    5003 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w5-b78c31-86cdfb657c-m4s5d"
Oct 31 17:42:57.244386 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:57.244310    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w5-b78c31-86cdfb657c-m4s5d" event={"ID":"06aa3682-3041-49d8-b240-761092b11dc9","Type":"ContainerDied","Data":"695bb9d51a97ef5793c4817e95a5b6a014f7271b66789311a45ca17c2b1256dc"}
Oct 31 17:42:57.244386 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:57.244364    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w5-b78c31-86cdfb657c-m4s5d" event={"ID":"06aa3682-3041-49d8-b240-761092b11dc9","Type":"ContainerDied","Data":"5aedf0f6ba78923dcf815947f39f28be2fb643241155f0571ae51732fca25554"}
Oct 31 17:42:57.244498 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:57.244393    5003 scope.go:122] "RemoveContainer" containerID="695bb9d51a97ef5793c4817e95a5b6a014f7271b66789311a45ca17c2b1256dc"
Oct 31 17:42:57.255601 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:57.255584    5003 scope.go:122] "RemoveContainer" containerID="695bb9d51a97ef5793c4817e95a5b6a014f7271b66789311a45ca17c2b1256dc"
Oct 31 17:42:57.255892 ip-10-0-138-17 kubenswrapper[5003]: E1031 17:42:57.255870    5003 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"695bb9d51a97ef5793c4817e95a5b6a014f7271b66789311a45ca17c2b1256dc\": container with ID starting with 695bb9d51a97ef5793c4817e95a5b6a014f7271b66789311a45ca17c2b1256dc not found: ID does not exist" containerID="695bb9d51a97ef5793c4817e95a5b6a014f7271b66789311a45ca17c2b1256dc"
Oct 31 17:42:57.255960 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:57.255904    5003 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"695bb9d51a97ef5793c4817e95a5b6a014f7271b66789311a45ca17c2b1256dc"} err="failed to get container status \"695bb9d51a97ef5793c4817e95a5b6a014f7271b66789311a45ca17c2b1256dc\": rpc error: code = NotFound desc = could not find container \"695bb9d51a97ef5793c4817e95a5b6a014f7271b66789311a45ca17c2b1256dc\": container with ID starting with 695bb9d51a97ef5793c4817e95a5b6a014f7271b66789311a45ca17c2b1256dc not found: ID does not exist"
Oct 31 17:42:57.297093 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:57.297068    5003 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w5-b78c31-86cdfb657c-m4s5d"]
Oct 31 17:42:57.309328 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:57.309302    5003 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w5-b78c31-86cdfb657c-m4s5d"]
Oct 31 17:42:57.503708 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:57.499216    5003 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w5-b78c31-5f598f895d-wgvlq"]
Oct 31 17:42:57.503708 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:57.499837    5003 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-b78c31-5f598f895d-wgvlq" podUID="faeea853-aa53-4bb6-9a85-4e55772556b2" containerName="maas-api" containerID="cri-o://56e0be58563c6e08a8e4f124cd66b2748cb14aa9316f7d29bb3e29a98b74c66d" gracePeriod=30
Oct 31 17:42:57.842734 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:57.841090    5003 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-mst4q"
Oct 31 17:42:58.019672 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:58.006095    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/fa5b3d0d-4ae9-4f60-8af5-571df26ba157-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fa5b3d0d-4ae9-4f60-8af5-571df26ba157-istio-envoy\") pod \"fa5b3d0d-4ae9-4f60-8af5-571df26ba157\" (UID: \"fa5b3d0d-4ae9-4f60-8af5-571df26ba157\") "
Oct 31 17:42:58.019672 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:58.006215    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/fa5b3d0d-4ae9-4f60-8af5-571df26ba157-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fa5b3d0d-4ae9-4f60-8af5-571df26ba157-workload-certs\") pod \"fa5b3d0d-4ae9-4f60-8af5-571df26ba157\" (UID: \"fa5b3d0d-4ae9-4f60-8af5-571df26ba157\") "
Oct 31 17:42:58.019672 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:58.006268    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/fa5b3d0d-4ae9-4f60-8af5-571df26ba157-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fa5b3d0d-4ae9-4f60-8af5-571df26ba157-credential-socket\") pod \"fa5b3d0d-4ae9-4f60-8af5-571df26ba157\" (UID: \"fa5b3d0d-4ae9-4f60-8af5-571df26ba157\") "
Oct 31 17:42:58.019672 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:58.006329    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/fa5b3d0d-4ae9-4f60-8af5-571df26ba157-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fa5b3d0d-4ae9-4f60-8af5-571df26ba157-workload-socket\") pod \"fa5b3d0d-4ae9-4f60-8af5-571df26ba157\" (UID: \"fa5b3d0d-4ae9-4f60-8af5-571df26ba157\") "
Oct 31 17:42:58.019672 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:58.006452    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/fa5b3d0d-4ae9-4f60-8af5-571df26ba157-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fa5b3d0d-4ae9-4f60-8af5-571df26ba157-istio-podinfo\") pod \"fa5b3d0d-4ae9-4f60-8af5-571df26ba157\" (UID: \"fa5b3d0d-4ae9-4f60-8af5-571df26ba157\") "
Oct 31 17:42:58.019672 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:58.006492    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/fa5b3d0d-4ae9-4f60-8af5-571df26ba157-kube-api-access-pf5kr\" (UniqueName: \"kubernetes.io/projected/fa5b3d0d-4ae9-4f60-8af5-571df26ba157-kube-api-access-pf5kr\") pod \"fa5b3d0d-4ae9-4f60-8af5-571df26ba157\" (UID: \"fa5b3d0d-4ae9-4f60-8af5-571df26ba157\") "
Oct 31 17:42:58.019672 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:58.006534    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/fa5b3d0d-4ae9-4f60-8af5-571df26ba157-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fa5b3d0d-4ae9-4f60-8af5-571df26ba157-istiod-ca-cert\") pod \"fa5b3d0d-4ae9-4f60-8af5-571df26ba157\" (UID: \"fa5b3d0d-4ae9-4f60-8af5-571df26ba157\") "
Oct 31 17:42:58.019672 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:58.006591    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/fa5b3d0d-4ae9-4f60-8af5-571df26ba157-istio-token\" (UniqueName: \"kubernetes.io/projected/fa5b3d0d-4ae9-4f60-8af5-571df26ba157-istio-token\") pod \"fa5b3d0d-4ae9-4f60-8af5-571df26ba157\" (UID: \"fa5b3d0d-4ae9-4f60-8af5-571df26ba157\") "
Oct 31 17:42:58.019672 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:58.006669    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/fa5b3d0d-4ae9-4f60-8af5-571df26ba157-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fa5b3d0d-4ae9-4f60-8af5-571df26ba157-istio-data\") pod \"fa5b3d0d-4ae9-4f60-8af5-571df26ba157\" (UID: \"fa5b3d0d-4ae9-4f60-8af5-571df26ba157\") "
Oct 31 17:42:58.019672 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:58.013056    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fa5b3d0d-4ae9-4f60-8af5-571df26ba157-workload-socket" pod "fa5b3d0d-4ae9-4f60-8af5-571df26ba157" (UID: "fa5b3d0d-4ae9-4f60-8af5-571df26ba157"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 17:42:58.019672 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:58.013325    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fa5b3d0d-4ae9-4f60-8af5-571df26ba157-credential-socket" pod "fa5b3d0d-4ae9-4f60-8af5-571df26ba157" (UID: "fa5b3d0d-4ae9-4f60-8af5-571df26ba157"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 17:42:58.019672 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:58.013752    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fa5b3d0d-4ae9-4f60-8af5-571df26ba157-workload-certs" pod "fa5b3d0d-4ae9-4f60-8af5-571df26ba157" (UID: "fa5b3d0d-4ae9-4f60-8af5-571df26ba157"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 17:42:58.024669 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:58.023897    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fa5b3d0d-4ae9-4f60-8af5-571df26ba157-istiod-ca-cert" pod "fa5b3d0d-4ae9-4f60-8af5-571df26ba157" (UID: "fa5b3d0d-4ae9-4f60-8af5-571df26ba157"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 17:42:58.068796 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:58.044152    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fa5b3d0d-4ae9-4f60-8af5-571df26ba157-istio-data" pod "fa5b3d0d-4ae9-4f60-8af5-571df26ba157" (UID: "fa5b3d0d-4ae9-4f60-8af5-571df26ba157"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 17:42:58.068796 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:58.065885    5003 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-64dkg"
Oct 31 17:42:58.115780 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:58.097400    5003 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="06aa3682-3041-49d8-b240-761092b11dc9" path="/var/lib/kubelet/pods/06aa3682-3041-49d8-b240-761092b11dc9/volumes"
Oct 31 17:42:58.115780 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:58.102925    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/fa5b3d0d-4ae9-4f60-8af5-571df26ba157-istio-podinfo" pod "fa5b3d0d-4ae9-4f60-8af5-571df26ba157" (UID: "fa5b3d0d-4ae9-4f60-8af5-571df26ba157"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 31 17:42:58.115780 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:58.115449    5003 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fa5b3d0d-4ae9-4f60-8af5-571df26ba157-credential-socket\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:42:58.115780 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:58.115480    5003 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fa5b3d0d-4ae9-4f60-8af5-571df26ba157-workload-socket\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:42:58.115780 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:58.115494    5003 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fa5b3d0d-4ae9-4f60-8af5-571df26ba157-istio-podinfo\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:42:58.115780 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:58.115508    5003 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fa5b3d0d-4ae9-4f60-8af5-571df26ba157-istiod-ca-cert\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:42:58.115780 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:58.115521    5003 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fa5b3d0d-4ae9-4f60-8af5-571df26ba157-istio-data\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:42:58.115780 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:58.115535    5003 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fa5b3d0d-4ae9-4f60-8af5-571df26ba157-workload-certs\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:42:58.129720 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:58.127611    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fa5b3d0d-4ae9-4f60-8af5-571df26ba157-kube-api-access-pf5kr" pod "fa5b3d0d-4ae9-4f60-8af5-571df26ba157" (UID: "fa5b3d0d-4ae9-4f60-8af5-571df26ba157"). InnerVolumeSpecName "kube-api-access-pf5kr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 17:42:58.204673 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:58.194269    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fa5b3d0d-4ae9-4f60-8af5-571df26ba157-istio-envoy" pod "fa5b3d0d-4ae9-4f60-8af5-571df26ba157" (UID: "fa5b3d0d-4ae9-4f60-8af5-571df26ba157"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 17:42:58.204673 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:58.194421    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fa5b3d0d-4ae9-4f60-8af5-571df26ba157-istio-token" pod "fa5b3d0d-4ae9-4f60-8af5-571df26ba157" (UID: "fa5b3d0d-4ae9-4f60-8af5-571df26ba157"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 17:42:58.207356 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:58.206919    5003 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-9rlpc"
Oct 31 17:42:58.216339 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:58.215947    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/73f3a3b3-a5dd-4054-be25-5e23a820c5fe-kube-api-access-4rgfh\" (UniqueName: \"kubernetes.io/projected/73f3a3b3-a5dd-4054-be25-5e23a820c5fe-kube-api-access-4rgfh\") pod \"73f3a3b3-a5dd-4054-be25-5e23a820c5fe\" (UID: \"73f3a3b3-a5dd-4054-be25-5e23a820c5fe\") "
Oct 31 17:42:58.216339 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:58.215997    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/73f3a3b3-a5dd-4054-be25-5e23a820c5fe-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/73f3a3b3-a5dd-4054-be25-5e23a820c5fe-istio-podinfo\") pod \"73f3a3b3-a5dd-4054-be25-5e23a820c5fe\" (UID: \"73f3a3b3-a5dd-4054-be25-5e23a820c5fe\") "
Oct 31 17:42:58.216499 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:58.216350    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/73f3a3b3-a5dd-4054-be25-5e23a820c5fe-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/73f3a3b3-a5dd-4054-be25-5e23a820c5fe-workload-socket\") pod \"73f3a3b3-a5dd-4054-be25-5e23a820c5fe\" (UID: \"73f3a3b3-a5dd-4054-be25-5e23a820c5fe\") "
Oct 31 17:42:58.216499 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:58.216431    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/73f3a3b3-a5dd-4054-be25-5e23a820c5fe-istio-token\" (UniqueName: \"kubernetes.io/projected/73f3a3b3-a5dd-4054-be25-5e23a820c5fe-istio-token\") pod \"73f3a3b3-a5dd-4054-be25-5e23a820c5fe\" (UID: \"73f3a3b3-a5dd-4054-be25-5e23a820c5fe\") "
Oct 31 17:42:58.216499 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:58.216466    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/73f3a3b3-a5dd-4054-be25-5e23a820c5fe-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/73f3a3b3-a5dd-4054-be25-5e23a820c5fe-istio-envoy\") pod \"73f3a3b3-a5dd-4054-be25-5e23a820c5fe\" (UID: \"73f3a3b3-a5dd-4054-be25-5e23a820c5fe\") "
Oct 31 17:42:58.216499 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:58.216497    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/73f3a3b3-a5dd-4054-be25-5e23a820c5fe-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/73f3a3b3-a5dd-4054-be25-5e23a820c5fe-credential-socket\") pod \"73f3a3b3-a5dd-4054-be25-5e23a820c5fe\" (UID: \"73f3a3b3-a5dd-4054-be25-5e23a820c5fe\") "
Oct 31 17:42:58.216754 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:58.216585    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/73f3a3b3-a5dd-4054-be25-5e23a820c5fe-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/73f3a3b3-a5dd-4054-be25-5e23a820c5fe-workload-certs\") pod \"73f3a3b3-a5dd-4054-be25-5e23a820c5fe\" (UID: \"73f3a3b3-a5dd-4054-be25-5e23a820c5fe\") "
Oct 31 17:42:58.216754 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:58.216632    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/73f3a3b3-a5dd-4054-be25-5e23a820c5fe-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/73f3a3b3-a5dd-4054-be25-5e23a820c5fe-istio-data\") pod \"73f3a3b3-a5dd-4054-be25-5e23a820c5fe\" (UID: \"73f3a3b3-a5dd-4054-be25-5e23a820c5fe\") "
Oct 31 17:42:58.216754 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:58.216686    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/73f3a3b3-a5dd-4054-be25-5e23a820c5fe-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/73f3a3b3-a5dd-4054-be25-5e23a820c5fe-istiod-ca-cert\") pod \"73f3a3b3-a5dd-4054-be25-5e23a820c5fe\" (UID: \"73f3a3b3-a5dd-4054-be25-5e23a820c5fe\") "
Oct 31 17:42:58.217277 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:58.217255    5003 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pf5kr\" (UniqueName: \"kubernetes.io/projected/fa5b3d0d-4ae9-4f60-8af5-571df26ba157-kube-api-access-pf5kr\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:42:58.217337 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:58.217324    5003 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fa5b3d0d-4ae9-4f60-8af5-571df26ba157-istio-token\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:42:58.217391 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:58.217343    5003 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fa5b3d0d-4ae9-4f60-8af5-571df26ba157-istio-envoy\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:42:58.217736 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:58.217714    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/73f3a3b3-a5dd-4054-be25-5e23a820c5fe-istiod-ca-cert" pod "73f3a3b3-a5dd-4054-be25-5e23a820c5fe" (UID: "73f3a3b3-a5dd-4054-be25-5e23a820c5fe"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 17:42:58.218002 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:58.217980    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/73f3a3b3-a5dd-4054-be25-5e23a820c5fe-workload-socket" pod "73f3a3b3-a5dd-4054-be25-5e23a820c5fe" (UID: "73f3a3b3-a5dd-4054-be25-5e23a820c5fe"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 17:42:58.218167 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:58.218145    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/73f3a3b3-a5dd-4054-be25-5e23a820c5fe-workload-certs" pod "73f3a3b3-a5dd-4054-be25-5e23a820c5fe" (UID: "73f3a3b3-a5dd-4054-be25-5e23a820c5fe"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 17:42:58.218361 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:58.218286    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/73f3a3b3-a5dd-4054-be25-5e23a820c5fe-istio-data" pod "73f3a3b3-a5dd-4054-be25-5e23a820c5fe" (UID: "73f3a3b3-a5dd-4054-be25-5e23a820c5fe"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 17:42:58.219109 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:58.219076    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/73f3a3b3-a5dd-4054-be25-5e23a820c5fe-credential-socket" pod "73f3a3b3-a5dd-4054-be25-5e23a820c5fe" (UID: "73f3a3b3-a5dd-4054-be25-5e23a820c5fe"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 17:42:58.220786 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:58.220371    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/73f3a3b3-a5dd-4054-be25-5e23a820c5fe-istio-podinfo" pod "73f3a3b3-a5dd-4054-be25-5e23a820c5fe" (UID: "73f3a3b3-a5dd-4054-be25-5e23a820c5fe"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 31 17:42:58.222880 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:58.222163    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/73f3a3b3-a5dd-4054-be25-5e23a820c5fe-kube-api-access-4rgfh" pod "73f3a3b3-a5dd-4054-be25-5e23a820c5fe" (UID: "73f3a3b3-a5dd-4054-be25-5e23a820c5fe"). InnerVolumeSpecName "kube-api-access-4rgfh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 17:42:58.222880 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:58.222853    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/73f3a3b3-a5dd-4054-be25-5e23a820c5fe-istio-envoy" pod "73f3a3b3-a5dd-4054-be25-5e23a820c5fe" (UID: "73f3a3b3-a5dd-4054-be25-5e23a820c5fe"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 17:42:58.223482 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:58.223462    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/73f3a3b3-a5dd-4054-be25-5e23a820c5fe-istio-token" pod "73f3a3b3-a5dd-4054-be25-5e23a820c5fe" (UID: "73f3a3b3-a5dd-4054-be25-5e23a820c5fe"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 17:42:58.226968 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:58.226492    5003 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-bpm5b"
Oct 31 17:42:58.235151 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:58.232823    5003 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-1c0bfd-84cbc7675-n2bbv"
Oct 31 17:42:58.250054 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:58.250027    5003 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w5-b78c31-8tlpl"]
Oct 31 17:42:58.258183 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:58.258160    5003 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w5-b78c31-8tlpl"]
Oct 31 17:42:58.260714 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:58.260689    5003 generic.go:356] "Generic (PLEG): container finished" podID="fa5b3d0d-4ae9-4f60-8af5-571df26ba157" containerID="a005f0f8ec631a78f1a1a23eed30e31fb1003883e3697da4d31aa9419acfaa03" exitCode=0
Oct 31 17:42:58.260808 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:58.260756    5003 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-mst4q"
Oct 31 17:42:58.260885 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:58.260819    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-mst4q" event={"ID":"fa5b3d0d-4ae9-4f60-8af5-571df26ba157","Type":"ContainerDied","Data":"a005f0f8ec631a78f1a1a23eed30e31fb1003883e3697da4d31aa9419acfaa03"}
Oct 31 17:42:58.260885 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:58.260867    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-mst4q" event={"ID":"fa5b3d0d-4ae9-4f60-8af5-571df26ba157","Type":"ContainerDied","Data":"078e59ba83319e8fd016b44343af2f0f913a61b9a98a579dbd774c1bab29fff1"}
Oct 31 17:42:58.260994 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:58.260899    5003 scope.go:122] "RemoveContainer" containerID="a005f0f8ec631a78f1a1a23eed30e31fb1003883e3697da4d31aa9419acfaa03"
Oct 31 17:42:58.264040 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:58.264013    5003 generic.go:356] "Generic (PLEG): container finished" podID="73f3a3b3-a5dd-4054-be25-5e23a820c5fe" containerID="6980e2f4859dd66f13efe444e15d8017e4212565c288f08348e4220c18fa54fa" exitCode=0
Oct 31 17:42:58.264138 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:58.264073    5003 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-64dkg"
Oct 31 17:42:58.264138 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:58.264095    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-64dkg" event={"ID":"73f3a3b3-a5dd-4054-be25-5e23a820c5fe","Type":"ContainerDied","Data":"6980e2f4859dd66f13efe444e15d8017e4212565c288f08348e4220c18fa54fa"}
Oct 31 17:42:58.264262 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:58.264154    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-64dkg" event={"ID":"73f3a3b3-a5dd-4054-be25-5e23a820c5fe","Type":"ContainerDied","Data":"c1f0656bd77d7ec34910d3eac35ec4c49ca8b384400104b632d0c04932719be0"}
Oct 31 17:42:58.265513 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:58.265492    5003 generic.go:356] "Generic (PLEG): container finished" podID="9bf16293-fd1c-421b-9f91-3c7178ed7cd3" containerID="78ca469a468ffb32a72aae916b4608a505f9d720a4103418099ff4684025deeb" exitCode=0
Oct 31 17:42:58.265774 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:58.265747    5003 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-bpm5b"
Oct 31 17:42:58.265884 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:58.265749    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-bpm5b" event={"ID":"9bf16293-fd1c-421b-9f91-3c7178ed7cd3","Type":"ContainerDied","Data":"78ca469a468ffb32a72aae916b4608a505f9d720a4103418099ff4684025deeb"}
Oct 31 17:42:58.265884 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:58.265866    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-bpm5b" event={"ID":"9bf16293-fd1c-421b-9f91-3c7178ed7cd3","Type":"ContainerDied","Data":"944d8228854620fccd160cc90e04cf1a9af9465170053f1b2c906edc12ba903c"}
Oct 31 17:42:58.278504 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:58.278280    5003 generic.go:356] "Generic (PLEG): container finished" podID="2335abae-520f-4557-8ffd-ab60cbb68812" containerID="69d0a3b5870d84a0100266dd65465f8556a48de1b8d7402ccc4c954407dcd5d3" exitCode=0
Oct 31 17:42:58.278504 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:58.278394    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-1c0bfd-84cbc7675-n2bbv" event={"ID":"2335abae-520f-4557-8ffd-ab60cbb68812","Type":"ContainerDied","Data":"69d0a3b5870d84a0100266dd65465f8556a48de1b8d7402ccc4c954407dcd5d3"}
Oct 31 17:42:58.278504 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:58.278440    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-1c0bfd-84cbc7675-n2bbv" event={"ID":"2335abae-520f-4557-8ffd-ab60cbb68812","Type":"ContainerDied","Data":"59abf8bfa16eff662da4f900e79f6bb1fc08c6e79ef54e4296db806d1e4e9fc5"}
Oct 31 17:42:58.278771 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:58.278521    5003 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-1c0bfd-84cbc7675-n2bbv"
Oct 31 17:42:58.304119 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:58.304086    5003 generic.go:356] "Generic (PLEG): container finished" podID="6eff589e-d19b-4ea9-898e-85009de000eb" containerID="77c1d72a93c4020e18c5448d9f83ef56527d53248911d93608aa0f6cea15b656" exitCode=0
Oct 31 17:42:58.304497 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:58.304471    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w4-1c0bfd-754b9cb7cf-gpdmq" event={"ID":"6eff589e-d19b-4ea9-898e-85009de000eb","Type":"ContainerDied","Data":"77c1d72a93c4020e18c5448d9f83ef56527d53248911d93608aa0f6cea15b656"}
Oct 31 17:42:58.311109 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:58.311080    5003 generic.go:356] "Generic (PLEG): container finished" podID="a115d540-ac87-497f-97f8-bd2e52d066f7" containerID="ddb2cb22d217daf6a7ea2d32877c8ae9d586aa3974ac305c3a99a4fc6c9d460f" exitCode=0
Oct 31 17:42:58.311236 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:58.311128    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-9rlpc" event={"ID":"a115d540-ac87-497f-97f8-bd2e52d066f7","Type":"ContainerDied","Data":"ddb2cb22d217daf6a7ea2d32877c8ae9d586aa3974ac305c3a99a4fc6c9d460f"}
Oct 31 17:42:58.311236 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:58.311169    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-9rlpc" event={"ID":"a115d540-ac87-497f-97f8-bd2e52d066f7","Type":"ContainerDied","Data":"b1e81a80593e94af836e5421898bd8b5a422aa7551c35dbc231bf19d34a51bf1"}
Oct 31 17:42:58.311324 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:58.311253    5003 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-9rlpc"
Oct 31 17:42:58.313998 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:58.313976    5003 scope.go:122] "RemoveContainer" containerID="a005f0f8ec631a78f1a1a23eed30e31fb1003883e3697da4d31aa9419acfaa03"
Oct 31 17:42:58.314783 ip-10-0-138-17 kubenswrapper[5003]: E1031 17:42:58.314752    5003 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a005f0f8ec631a78f1a1a23eed30e31fb1003883e3697da4d31aa9419acfaa03\": container with ID starting with a005f0f8ec631a78f1a1a23eed30e31fb1003883e3697da4d31aa9419acfaa03 not found: ID does not exist" containerID="a005f0f8ec631a78f1a1a23eed30e31fb1003883e3697da4d31aa9419acfaa03"
Oct 31 17:42:58.314867 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:58.314794    5003 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a005f0f8ec631a78f1a1a23eed30e31fb1003883e3697da4d31aa9419acfaa03"} err="failed to get container status \"a005f0f8ec631a78f1a1a23eed30e31fb1003883e3697da4d31aa9419acfaa03\": rpc error: code = NotFound desc = could not find container \"a005f0f8ec631a78f1a1a23eed30e31fb1003883e3697da4d31aa9419acfaa03\": container with ID starting with a005f0f8ec631a78f1a1a23eed30e31fb1003883e3697da4d31aa9419acfaa03 not found: ID does not exist"
Oct 31 17:42:58.314867 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:58.314814    5003 scope.go:122] "RemoveContainer" containerID="6980e2f4859dd66f13efe444e15d8017e4212565c288f08348e4220c18fa54fa"
Oct 31 17:42:58.318726 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:58.318701    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a115d540-ac87-497f-97f8-bd2e52d066f7-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a115d540-ac87-497f-97f8-bd2e52d066f7-istio-data\") pod \"a115d540-ac87-497f-97f8-bd2e52d066f7\" (UID: \"a115d540-ac87-497f-97f8-bd2e52d066f7\") "
Oct 31 17:42:58.318829 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:58.318761    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/2335abae-520f-4557-8ffd-ab60cbb68812-kube-api-access-k2mx8\" (UniqueName: \"kubernetes.io/projected/2335abae-520f-4557-8ffd-ab60cbb68812-kube-api-access-k2mx8\") pod \"2335abae-520f-4557-8ffd-ab60cbb68812\" (UID: \"2335abae-520f-4557-8ffd-ab60cbb68812\") "
Oct 31 17:42:58.318898 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:58.318837    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/9bf16293-fd1c-421b-9f91-3c7178ed7cd3-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9bf16293-fd1c-421b-9f91-3c7178ed7cd3-istio-podinfo\") pod \"9bf16293-fd1c-421b-9f91-3c7178ed7cd3\" (UID: \"9bf16293-fd1c-421b-9f91-3c7178ed7cd3\") "
Oct 31 17:42:58.318955 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:58.318907    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/9bf16293-fd1c-421b-9f91-3c7178ed7cd3-istio-token\" (UniqueName: \"kubernetes.io/projected/9bf16293-fd1c-421b-9f91-3c7178ed7cd3-istio-token\") pod \"9bf16293-fd1c-421b-9f91-3c7178ed7cd3\" (UID: \"9bf16293-fd1c-421b-9f91-3c7178ed7cd3\") "
Oct 31 17:42:58.319016 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:58.318960    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/a115d540-ac87-497f-97f8-bd2e52d066f7-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a115d540-ac87-497f-97f8-bd2e52d066f7-istio-podinfo\") pod \"a115d540-ac87-497f-97f8-bd2e52d066f7\" (UID: \"a115d540-ac87-497f-97f8-bd2e52d066f7\") "
Oct 31 17:42:58.319016 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:58.319006    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/a115d540-ac87-497f-97f8-bd2e52d066f7-kube-api-access-97vf9\" (UniqueName: \"kubernetes.io/projected/a115d540-ac87-497f-97f8-bd2e52d066f7-kube-api-access-97vf9\") pod \"a115d540-ac87-497f-97f8-bd2e52d066f7\" (UID: \"a115d540-ac87-497f-97f8-bd2e52d066f7\") "
Oct 31 17:42:58.319119 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:58.319034    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/a115d540-ac87-497f-97f8-bd2e52d066f7-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a115d540-ac87-497f-97f8-bd2e52d066f7-istiod-ca-cert\") pod \"a115d540-ac87-497f-97f8-bd2e52d066f7\" (UID: \"a115d540-ac87-497f-97f8-bd2e52d066f7\") "
Oct 31 17:42:58.319119 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:58.319088    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/9bf16293-fd1c-421b-9f91-3c7178ed7cd3-kube-api-access-tp8dz\" (UniqueName: \"kubernetes.io/projected/9bf16293-fd1c-421b-9f91-3c7178ed7cd3-kube-api-access-tp8dz\") pod \"9bf16293-fd1c-421b-9f91-3c7178ed7cd3\" (UID: \"9bf16293-fd1c-421b-9f91-3c7178ed7cd3\") "
Oct 31 17:42:58.319221 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:58.319127    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a115d540-ac87-497f-97f8-bd2e52d066f7-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a115d540-ac87-497f-97f8-bd2e52d066f7-workload-certs\") pod \"a115d540-ac87-497f-97f8-bd2e52d066f7\" (UID: \"a115d540-ac87-497f-97f8-bd2e52d066f7\") "
Oct 31 17:42:58.319221 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:58.319165    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9bf16293-fd1c-421b-9f91-3c7178ed7cd3-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9bf16293-fd1c-421b-9f91-3c7178ed7cd3-istio-data\") pod \"9bf16293-fd1c-421b-9f91-3c7178ed7cd3\" (UID: \"9bf16293-fd1c-421b-9f91-3c7178ed7cd3\") "
Oct 31 17:42:58.319333 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:58.319219    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9bf16293-fd1c-421b-9f91-3c7178ed7cd3-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9bf16293-fd1c-421b-9f91-3c7178ed7cd3-workload-socket\") pod \"9bf16293-fd1c-421b-9f91-3c7178ed7cd3\" (UID: \"9bf16293-fd1c-421b-9f91-3c7178ed7cd3\") "
Oct 31 17:42:58.319333 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:58.319259    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a115d540-ac87-497f-97f8-bd2e52d066f7-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a115d540-ac87-497f-97f8-bd2e52d066f7-credential-socket\") pod \"a115d540-ac87-497f-97f8-bd2e52d066f7\" (UID: \"a115d540-ac87-497f-97f8-bd2e52d066f7\") "
Oct 31 17:42:58.319333 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:58.319308    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a115d540-ac87-497f-97f8-bd2e52d066f7-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a115d540-ac87-497f-97f8-bd2e52d066f7-workload-socket\") pod \"a115d540-ac87-497f-97f8-bd2e52d066f7\" (UID: \"a115d540-ac87-497f-97f8-bd2e52d066f7\") "
Oct 31 17:42:58.319482 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:58.319365    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9bf16293-fd1c-421b-9f91-3c7178ed7cd3-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9bf16293-fd1c-421b-9f91-3c7178ed7cd3-credential-socket\") pod \"9bf16293-fd1c-421b-9f91-3c7178ed7cd3\" (UID: \"9bf16293-fd1c-421b-9f91-3c7178ed7cd3\") "
Oct 31 17:42:58.319482 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:58.319407    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a115d540-ac87-497f-97f8-bd2e52d066f7-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a115d540-ac87-497f-97f8-bd2e52d066f7-istio-envoy\") pod \"a115d540-ac87-497f-97f8-bd2e52d066f7\" (UID: \"a115d540-ac87-497f-97f8-bd2e52d066f7\") "
Oct 31 17:42:58.319482 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:58.319463    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/2335abae-520f-4557-8ffd-ab60cbb68812-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2335abae-520f-4557-8ffd-ab60cbb68812-plugins-config-volume\") pod \"2335abae-520f-4557-8ffd-ab60cbb68812\" (UID: \"2335abae-520f-4557-8ffd-ab60cbb68812\") "
Oct 31 17:42:58.319587 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:58.319497    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9bf16293-fd1c-421b-9f91-3c7178ed7cd3-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9bf16293-fd1c-421b-9f91-3c7178ed7cd3-workload-certs\") pod \"9bf16293-fd1c-421b-9f91-3c7178ed7cd3\" (UID: \"9bf16293-fd1c-421b-9f91-3c7178ed7cd3\") "
Oct 31 17:42:58.319587 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:58.319533    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9bf16293-fd1c-421b-9f91-3c7178ed7cd3-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9bf16293-fd1c-421b-9f91-3c7178ed7cd3-istio-envoy\") pod \"9bf16293-fd1c-421b-9f91-3c7178ed7cd3\" (UID: \"9bf16293-fd1c-421b-9f91-3c7178ed7cd3\") "
Oct 31 17:42:58.319587 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:58.319560    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/9bf16293-fd1c-421b-9f91-3c7178ed7cd3-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9bf16293-fd1c-421b-9f91-3c7178ed7cd3-istiod-ca-cert\") pod \"9bf16293-fd1c-421b-9f91-3c7178ed7cd3\" (UID: \"9bf16293-fd1c-421b-9f91-3c7178ed7cd3\") "
Oct 31 17:42:58.319697 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:58.319630    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/a115d540-ac87-497f-97f8-bd2e52d066f7-istio-token\" (UniqueName: \"kubernetes.io/projected/a115d540-ac87-497f-97f8-bd2e52d066f7-istio-token\") pod \"a115d540-ac87-497f-97f8-bd2e52d066f7\" (UID: \"a115d540-ac87-497f-97f8-bd2e52d066f7\") "
Oct 31 17:42:58.320298 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:58.320279    5003 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/73f3a3b3-a5dd-4054-be25-5e23a820c5fe-istio-token\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:42:58.320373 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:58.320302    5003 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/73f3a3b3-a5dd-4054-be25-5e23a820c5fe-istio-envoy\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:42:58.320373 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:58.320316    5003 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/73f3a3b3-a5dd-4054-be25-5e23a820c5fe-credential-socket\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:42:58.320373 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:58.320328    5003 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/73f3a3b3-a5dd-4054-be25-5e23a820c5fe-workload-certs\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:42:58.320373 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:58.320342    5003 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/73f3a3b3-a5dd-4054-be25-5e23a820c5fe-istio-data\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:42:58.320373 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:58.320356    5003 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/73f3a3b3-a5dd-4054-be25-5e23a820c5fe-istiod-ca-cert\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:42:58.320373 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:58.320370    5003 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4rgfh\" (UniqueName: \"kubernetes.io/projected/73f3a3b3-a5dd-4054-be25-5e23a820c5fe-kube-api-access-4rgfh\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:42:58.320610 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:58.320383    5003 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/73f3a3b3-a5dd-4054-be25-5e23a820c5fe-istio-podinfo\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:42:58.320610 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:58.320396    5003 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/73f3a3b3-a5dd-4054-be25-5e23a820c5fe-workload-socket\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:42:58.324436 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:58.324341    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/a115d540-ac87-497f-97f8-bd2e52d066f7-istio-podinfo" pod "a115d540-ac87-497f-97f8-bd2e52d066f7" (UID: "a115d540-ac87-497f-97f8-bd2e52d066f7"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 31 17:42:58.324583 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:58.324560    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a115d540-ac87-497f-97f8-bd2e52d066f7-istio-data" pod "a115d540-ac87-497f-97f8-bd2e52d066f7" (UID: "a115d540-ac87-497f-97f8-bd2e52d066f7"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 17:42:58.326700 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:58.326677    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a115d540-ac87-497f-97f8-bd2e52d066f7-istio-envoy" pod "a115d540-ac87-497f-97f8-bd2e52d066f7" (UID: "a115d540-ac87-497f-97f8-bd2e52d066f7"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 17:42:58.327025 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:58.327002    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2335abae-520f-4557-8ffd-ab60cbb68812-plugins-config-volume" pod "2335abae-520f-4557-8ffd-ab60cbb68812" (UID: "2335abae-520f-4557-8ffd-ab60cbb68812"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 17:42:58.327122 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:58.327011    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9bf16293-fd1c-421b-9f91-3c7178ed7cd3-workload-socket" pod "9bf16293-fd1c-421b-9f91-3c7178ed7cd3" (UID: "9bf16293-fd1c-421b-9f91-3c7178ed7cd3"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 17:42:58.327356 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:58.327306    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9bf16293-fd1c-421b-9f91-3c7178ed7cd3-workload-certs" pod "9bf16293-fd1c-421b-9f91-3c7178ed7cd3" (UID: "9bf16293-fd1c-421b-9f91-3c7178ed7cd3"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 17:42:58.327501 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:58.327482    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a115d540-ac87-497f-97f8-bd2e52d066f7-credential-socket" pod "a115d540-ac87-497f-97f8-bd2e52d066f7" (UID: "a115d540-ac87-497f-97f8-bd2e52d066f7"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 17:42:58.327796 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:58.327765    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a115d540-ac87-497f-97f8-bd2e52d066f7-workload-socket" pod "a115d540-ac87-497f-97f8-bd2e52d066f7" (UID: "a115d540-ac87-497f-97f8-bd2e52d066f7"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 17:42:58.328060 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:58.328037    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9bf16293-fd1c-421b-9f91-3c7178ed7cd3-credential-socket" pod "9bf16293-fd1c-421b-9f91-3c7178ed7cd3" (UID: "9bf16293-fd1c-421b-9f91-3c7178ed7cd3"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 17:42:58.328141 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:58.328062    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2335abae-520f-4557-8ffd-ab60cbb68812-kube-api-access-k2mx8" pod "2335abae-520f-4557-8ffd-ab60cbb68812" (UID: "2335abae-520f-4557-8ffd-ab60cbb68812"). InnerVolumeSpecName "kube-api-access-k2mx8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 17:42:58.328628 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:58.328604    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a115d540-ac87-497f-97f8-bd2e52d066f7-istio-token" pod "a115d540-ac87-497f-97f8-bd2e52d066f7" (UID: "a115d540-ac87-497f-97f8-bd2e52d066f7"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 17:42:58.329089 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:58.329067    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9bf16293-fd1c-421b-9f91-3c7178ed7cd3-istiod-ca-cert" pod "9bf16293-fd1c-421b-9f91-3c7178ed7cd3" (UID: "9bf16293-fd1c-421b-9f91-3c7178ed7cd3"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 17:42:58.333352 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:58.333012    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9bf16293-fd1c-421b-9f91-3c7178ed7cd3-istio-token" pod "9bf16293-fd1c-421b-9f91-3c7178ed7cd3" (UID: "9bf16293-fd1c-421b-9f91-3c7178ed7cd3"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 17:42:58.334238 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:58.333981    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a115d540-ac87-497f-97f8-bd2e52d066f7-istiod-ca-cert" pod "a115d540-ac87-497f-97f8-bd2e52d066f7" (UID: "a115d540-ac87-497f-97f8-bd2e52d066f7"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 17:42:58.335067 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:58.334953    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/9bf16293-fd1c-421b-9f91-3c7178ed7cd3-istio-podinfo" pod "9bf16293-fd1c-421b-9f91-3c7178ed7cd3" (UID: "9bf16293-fd1c-421b-9f91-3c7178ed7cd3"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 31 17:42:58.335848 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:58.335814    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a115d540-ac87-497f-97f8-bd2e52d066f7-workload-certs" pod "a115d540-ac87-497f-97f8-bd2e52d066f7" (UID: "a115d540-ac87-497f-97f8-bd2e52d066f7"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 17:42:58.336794 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:58.336764    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9bf16293-fd1c-421b-9f91-3c7178ed7cd3-istio-envoy" pod "9bf16293-fd1c-421b-9f91-3c7178ed7cd3" (UID: "9bf16293-fd1c-421b-9f91-3c7178ed7cd3"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 17:42:58.339005 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:58.338784    5003 scope.go:122] "RemoveContainer" containerID="6980e2f4859dd66f13efe444e15d8017e4212565c288f08348e4220c18fa54fa"
Oct 31 17:42:58.339398 ip-10-0-138-17 kubenswrapper[5003]: E1031 17:42:58.339199    5003 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6980e2f4859dd66f13efe444e15d8017e4212565c288f08348e4220c18fa54fa\": container with ID starting with 6980e2f4859dd66f13efe444e15d8017e4212565c288f08348e4220c18fa54fa not found: ID does not exist" containerID="6980e2f4859dd66f13efe444e15d8017e4212565c288f08348e4220c18fa54fa"
Oct 31 17:42:58.339398 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:58.339240    5003 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6980e2f4859dd66f13efe444e15d8017e4212565c288f08348e4220c18fa54fa"} err="failed to get container status \"6980e2f4859dd66f13efe444e15d8017e4212565c288f08348e4220c18fa54fa\": rpc error: code = NotFound desc = could not find container \"6980e2f4859dd66f13efe444e15d8017e4212565c288f08348e4220c18fa54fa\": container with ID starting with 6980e2f4859dd66f13efe444e15d8017e4212565c288f08348e4220c18fa54fa not found: ID does not exist"
Oct 31 17:42:58.339398 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:58.339290    5003 scope.go:122] "RemoveContainer" containerID="78ca469a468ffb32a72aae916b4608a505f9d720a4103418099ff4684025deeb"
Oct 31 17:42:58.339611 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:58.339548    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9bf16293-fd1c-421b-9f91-3c7178ed7cd3-istio-data" pod "9bf16293-fd1c-421b-9f91-3c7178ed7cd3" (UID: "9bf16293-fd1c-421b-9f91-3c7178ed7cd3"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 17:42:58.340405 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:58.340102    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a115d540-ac87-497f-97f8-bd2e52d066f7-kube-api-access-97vf9" pod "a115d540-ac87-497f-97f8-bd2e52d066f7" (UID: "a115d540-ac87-497f-97f8-bd2e52d066f7"). InnerVolumeSpecName "kube-api-access-97vf9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 17:42:58.341238 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:58.341217    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9bf16293-fd1c-421b-9f91-3c7178ed7cd3-kube-api-access-tp8dz" pod "9bf16293-fd1c-421b-9f91-3c7178ed7cd3" (UID: "9bf16293-fd1c-421b-9f91-3c7178ed7cd3"). InnerVolumeSpecName "kube-api-access-tp8dz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 17:42:58.544954 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:58.544915    5003 scope.go:122] "RemoveContainer" containerID="78ca469a468ffb32a72aae916b4608a505f9d720a4103418099ff4684025deeb"
Oct 31 17:42:58.562932 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:58.550309    5003 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9bf16293-fd1c-421b-9f91-3c7178ed7cd3-istio-token\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:42:58.583755 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:58.583719    5003 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a115d540-ac87-497f-97f8-bd2e52d066f7-istio-podinfo\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:42:58.583991 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:58.583973    5003 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-97vf9\" (UniqueName: \"kubernetes.io/projected/a115d540-ac87-497f-97f8-bd2e52d066f7-kube-api-access-97vf9\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:42:58.584096 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:58.584082    5003 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a115d540-ac87-497f-97f8-bd2e52d066f7-istiod-ca-cert\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:42:58.584208 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:58.584195    5003 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tp8dz\" (UniqueName: \"kubernetes.io/projected/9bf16293-fd1c-421b-9f91-3c7178ed7cd3-kube-api-access-tp8dz\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:42:58.584322 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:58.584304    5003 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a115d540-ac87-497f-97f8-bd2e52d066f7-workload-certs\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:42:58.584412 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:58.584401    5003 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9bf16293-fd1c-421b-9f91-3c7178ed7cd3-istio-data\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:42:58.584522 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:58.584507    5003 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9bf16293-fd1c-421b-9f91-3c7178ed7cd3-workload-socket\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:42:58.584637 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:58.584621    5003 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a115d540-ac87-497f-97f8-bd2e52d066f7-credential-socket\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:42:58.584781 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:58.584762    5003 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a115d540-ac87-497f-97f8-bd2e52d066f7-workload-socket\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:42:58.584877 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:58.584863    5003 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9bf16293-fd1c-421b-9f91-3c7178ed7cd3-credential-socket\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:42:58.584980 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:58.584967    5003 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a115d540-ac87-497f-97f8-bd2e52d066f7-istio-envoy\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:42:58.585079 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:58.585066    5003 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2335abae-520f-4557-8ffd-ab60cbb68812-plugins-config-volume\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:42:58.585174 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:58.585159    5003 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9bf16293-fd1c-421b-9f91-3c7178ed7cd3-workload-certs\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:42:58.585288 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:58.585268    5003 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9bf16293-fd1c-421b-9f91-3c7178ed7cd3-istio-envoy\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:42:58.585471 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:58.585458    5003 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9bf16293-fd1c-421b-9f91-3c7178ed7cd3-istiod-ca-cert\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:42:58.585564 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:58.585553    5003 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a115d540-ac87-497f-97f8-bd2e52d066f7-istio-token\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:42:58.585657 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:58.585632    5003 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a115d540-ac87-497f-97f8-bd2e52d066f7-istio-data\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:42:58.585744 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:58.585733    5003 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k2mx8\" (UniqueName: \"kubernetes.io/projected/2335abae-520f-4557-8ffd-ab60cbb68812-kube-api-access-k2mx8\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:42:58.585821 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:58.585809    5003 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9bf16293-fd1c-421b-9f91-3c7178ed7cd3-istio-podinfo\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:42:58.585907 ip-10-0-138-17 kubenswrapper[5003]: E1031 17:42:58.554038    5003 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"78ca469a468ffb32a72aae916b4608a505f9d720a4103418099ff4684025deeb\": container with ID starting with 78ca469a468ffb32a72aae916b4608a505f9d720a4103418099ff4684025deeb not found: ID does not exist" containerID="78ca469a468ffb32a72aae916b4608a505f9d720a4103418099ff4684025deeb"
Oct 31 17:42:58.586048 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:58.586015    5003 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"78ca469a468ffb32a72aae916b4608a505f9d720a4103418099ff4684025deeb"} err="failed to get container status \"78ca469a468ffb32a72aae916b4608a505f9d720a4103418099ff4684025deeb\": rpc error: code = NotFound desc = could not find container \"78ca469a468ffb32a72aae916b4608a505f9d720a4103418099ff4684025deeb\": container with ID starting with 78ca469a468ffb32a72aae916b4608a505f9d720a4103418099ff4684025deeb not found: ID does not exist"
Oct 31 17:42:58.586143 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:58.586132    5003 scope.go:122] "RemoveContainer" containerID="69d0a3b5870d84a0100266dd65465f8556a48de1b8d7402ccc4c954407dcd5d3"
Oct 31 17:42:58.701746 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:58.700801    5003 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-mst4q"]
Oct 31 17:42:58.707340 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:58.707271    5003 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-mst4q"]
Oct 31 17:42:58.717573 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:58.716194    5003 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-64dkg"]
Oct 31 17:42:58.732240 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:58.723976    5003 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-64dkg"]
Oct 31 17:42:58.770733 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:58.763093    5003 scope.go:122] "RemoveContainer" containerID="69d0a3b5870d84a0100266dd65465f8556a48de1b8d7402ccc4c954407dcd5d3"
Oct 31 17:42:58.785685 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:58.776858    5003 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w4-1c0bfd-754b9cb7cf-gpdmq"
Oct 31 17:42:58.785685 ip-10-0-138-17 kubenswrapper[5003]: E1031 17:42:58.781119    5003 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"69d0a3b5870d84a0100266dd65465f8556a48de1b8d7402ccc4c954407dcd5d3\": container with ID starting with 69d0a3b5870d84a0100266dd65465f8556a48de1b8d7402ccc4c954407dcd5d3 not found: ID does not exist" containerID="69d0a3b5870d84a0100266dd65465f8556a48de1b8d7402ccc4c954407dcd5d3"
Oct 31 17:42:58.785685 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:58.781171    5003 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"69d0a3b5870d84a0100266dd65465f8556a48de1b8d7402ccc4c954407dcd5d3"} err="failed to get container status \"69d0a3b5870d84a0100266dd65465f8556a48de1b8d7402ccc4c954407dcd5d3\": rpc error: code = NotFound desc = could not find container \"69d0a3b5870d84a0100266dd65465f8556a48de1b8d7402ccc4c954407dcd5d3\": container with ID starting with 69d0a3b5870d84a0100266dd65465f8556a48de1b8d7402ccc4c954407dcd5d3 not found: ID does not exist"
Oct 31 17:42:58.785685 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:58.781200    5003 scope.go:122] "RemoveContainer" containerID="ddb2cb22d217daf6a7ea2d32877c8ae9d586aa3974ac305c3a99a4fc6c9d460f"
Oct 31 17:42:58.841047 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:58.835773    5003 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-9rlpc"]
Oct 31 17:42:58.942248 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:58.941104    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/6eff589e-d19b-4ea9-898e-85009de000eb-kube-api-access-6n6bg\" (UniqueName: \"kubernetes.io/projected/6eff589e-d19b-4ea9-898e-85009de000eb-kube-api-access-6n6bg\") pod \"6eff589e-d19b-4ea9-898e-85009de000eb\" (UID: \"6eff589e-d19b-4ea9-898e-85009de000eb\") "
Oct 31 17:42:58.942248 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:58.941167    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/6eff589e-d19b-4ea9-898e-85009de000eb-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6eff589e-d19b-4ea9-898e-85009de000eb-plugins-config-volume\") pod \"6eff589e-d19b-4ea9-898e-85009de000eb\" (UID: \"6eff589e-d19b-4ea9-898e-85009de000eb\") "
Oct 31 17:42:58.947365 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:58.946982    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6eff589e-d19b-4ea9-898e-85009de000eb-plugins-config-volume" pod "6eff589e-d19b-4ea9-898e-85009de000eb" (UID: "6eff589e-d19b-4ea9-898e-85009de000eb"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 17:42:58.967489 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:58.967266    5003 scope.go:122] "RemoveContainer" containerID="ddb2cb22d217daf6a7ea2d32877c8ae9d586aa3974ac305c3a99a4fc6c9d460f"
Oct 31 17:42:58.968658 ip-10-0-138-17 kubenswrapper[5003]: E1031 17:42:58.968561    5003 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ddb2cb22d217daf6a7ea2d32877c8ae9d586aa3974ac305c3a99a4fc6c9d460f\": container with ID starting with ddb2cb22d217daf6a7ea2d32877c8ae9d586aa3974ac305c3a99a4fc6c9d460f not found: ID does not exist" containerID="ddb2cb22d217daf6a7ea2d32877c8ae9d586aa3974ac305c3a99a4fc6c9d460f"
Oct 31 17:42:58.968658 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:58.968602    5003 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ddb2cb22d217daf6a7ea2d32877c8ae9d586aa3974ac305c3a99a4fc6c9d460f"} err="failed to get container status \"ddb2cb22d217daf6a7ea2d32877c8ae9d586aa3974ac305c3a99a4fc6c9d460f\": rpc error: code = NotFound desc = could not find container \"ddb2cb22d217daf6a7ea2d32877c8ae9d586aa3974ac305c3a99a4fc6c9d460f\": container with ID starting with ddb2cb22d217daf6a7ea2d32877c8ae9d586aa3974ac305c3a99a4fc6c9d460f not found: ID does not exist"
Oct 31 17:42:59.026932 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:59.019845    5003 patch_prober.go:29] interesting pod/e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-9rlpc container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.116:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 31 17:42:59.026932 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:59.019921    5003 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-9rlpc" podUID="a115d540-ac87-497f-97f8-bd2e52d066f7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.116:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 31 17:42:59.063694 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:59.049113    5003 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6eff589e-d19b-4ea9-898e-85009de000eb-plugins-config-volume\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:42:59.072712 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:59.071437    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6eff589e-d19b-4ea9-898e-85009de000eb-kube-api-access-6n6bg" pod "6eff589e-d19b-4ea9-898e-85009de000eb" (UID: "6eff589e-d19b-4ea9-898e-85009de000eb"). InnerVolumeSpecName "kube-api-access-6n6bg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 17:42:59.123768 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:59.123722    5003 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-9rlpc"]
Oct 31 17:42:59.158143 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:59.158113    5003 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6n6bg\" (UniqueName: \"kubernetes.io/projected/6eff589e-d19b-4ea9-898e-85009de000eb-kube-api-access-6n6bg\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:42:59.262144 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:59.262016    5003 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-1c0bfd-84cbc7675-n2bbv"]
Oct 31 17:42:59.298687 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:59.298637    5003 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-1c0bfd-84cbc7675-n2bbv"]
Oct 31 17:42:59.322969 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:59.322931    5003 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-bpm5b"]
Oct 31 17:42:59.443752 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:59.350794    5003 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w1-0e59ca-openshift-default-7cd8df4957-bpm5b"]
Oct 31 17:42:59.594021 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:59.593957    5003 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-ee816e-bgmxx"]
Oct 31 17:42:59.598583 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:59.598514    5003 generic.go:356] "Generic (PLEG): container finished" podID="faeea853-aa53-4bb6-9a85-4e55772556b2" containerID="56e0be58563c6e08a8e4f124cd66b2748cb14aa9316f7d29bb3e29a98b74c66d" exitCode=0
Oct 31 17:42:59.599531 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:59.599459    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-b78c31-5f598f895d-wgvlq" event={"ID":"faeea853-aa53-4bb6-9a85-4e55772556b2","Type":"ContainerDied","Data":"56e0be58563c6e08a8e4f124cd66b2748cb14aa9316f7d29bb3e29a98b74c66d"}
Oct 31 17:42:59.603826 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:59.603793    5003 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-ee816e-bgmxx"]
Oct 31 17:42:59.608680 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:59.604983    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w4-1c0bfd-754b9cb7cf-gpdmq" event={"ID":"6eff589e-d19b-4ea9-898e-85009de000eb","Type":"ContainerDied","Data":"32e7f9fba5b8e6ff7726488d1de22ea6d57a83f683d55ea5ea59e11885f22138"}
Oct 31 17:42:59.608680 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:59.605044    5003 scope.go:122] "RemoveContainer" containerID="77c1d72a93c4020e18c5448d9f83ef56527d53248911d93608aa0f6cea15b656"
Oct 31 17:42:59.608680 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:59.605168    5003 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w4-1c0bfd-754b9cb7cf-gpdmq"
Oct 31 17:42:59.616024 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:59.616003    5003 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-b78c31-5f598f895d-wgvlq"
Oct 31 17:42:59.787995 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:59.777449    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/faeea853-aa53-4bb6-9a85-4e55772556b2-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/faeea853-aa53-4bb6-9a85-4e55772556b2-maas-api-tls\") pod \"faeea853-aa53-4bb6-9a85-4e55772556b2\" (UID: \"faeea853-aa53-4bb6-9a85-4e55772556b2\") "
Oct 31 17:42:59.787995 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:59.777671    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/faeea853-aa53-4bb6-9a85-4e55772556b2-kube-api-access-wctt7\" (UniqueName: \"kubernetes.io/projected/faeea853-aa53-4bb6-9a85-4e55772556b2-kube-api-access-wctt7\") pod \"faeea853-aa53-4bb6-9a85-4e55772556b2\" (UID: \"faeea853-aa53-4bb6-9a85-4e55772556b2\") "
Oct 31 17:42:59.787995 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:59.777720    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/faeea853-aa53-4bb6-9a85-4e55772556b2-metrics-certs\" (UniqueName: \"kubernetes.io/secret/faeea853-aa53-4bb6-9a85-4e55772556b2-metrics-certs\") pod \"faeea853-aa53-4bb6-9a85-4e55772556b2\" (UID: \"faeea853-aa53-4bb6-9a85-4e55772556b2\") "
Oct 31 17:42:59.787995 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:59.777852    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/faeea853-aa53-4bb6-9a85-4e55772556b2-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/faeea853-aa53-4bb6-9a85-4e55772556b2-openshift-service-ca\") pod \"faeea853-aa53-4bb6-9a85-4e55772556b2\" (UID: \"faeea853-aa53-4bb6-9a85-4e55772556b2\") "
Oct 31 17:42:59.794906 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:59.794864    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/faeea853-aa53-4bb6-9a85-4e55772556b2-openshift-service-ca" pod "faeea853-aa53-4bb6-9a85-4e55772556b2" (UID: "faeea853-aa53-4bb6-9a85-4e55772556b2"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 17:42:59.803735 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:59.803677    5003 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w4-1c0bfd-754b9cb7cf-gpdmq"]
Oct 31 17:42:59.820443 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:59.819075    5003 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w4-1c0bfd-754b9cb7cf-gpdmq"]
Oct 31 17:42:59.841554 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:59.841481    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/faeea853-aa53-4bb6-9a85-4e55772556b2-kube-api-access-wctt7" pod "faeea853-aa53-4bb6-9a85-4e55772556b2" (UID: "faeea853-aa53-4bb6-9a85-4e55772556b2"). InnerVolumeSpecName "kube-api-access-wctt7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 17:42:59.877669 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:59.877464    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/faeea853-aa53-4bb6-9a85-4e55772556b2-metrics-certs" pod "faeea853-aa53-4bb6-9a85-4e55772556b2" (UID: "faeea853-aa53-4bb6-9a85-4e55772556b2"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 17:42:59.877669 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:59.877606    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/faeea853-aa53-4bb6-9a85-4e55772556b2-maas-api-tls" pod "faeea853-aa53-4bb6-9a85-4e55772556b2" (UID: "faeea853-aa53-4bb6-9a85-4e55772556b2"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 17:42:59.880170 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:59.880144    5003 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/faeea853-aa53-4bb6-9a85-4e55772556b2-metrics-certs\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:42:59.880247 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:59.880177    5003 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/faeea853-aa53-4bb6-9a85-4e55772556b2-openshift-service-ca\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:42:59.880247 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:59.880196    5003 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/faeea853-aa53-4bb6-9a85-4e55772556b2-maas-api-tls\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:42:59.880247 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:59.880210    5003 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wctt7\" (UniqueName: \"kubernetes.io/projected/faeea853-aa53-4bb6-9a85-4e55772556b2-kube-api-access-wctt7\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:42:59.918665 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:59.915095    5003 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="2335abae-520f-4557-8ffd-ab60cbb68812" path="/var/lib/kubelet/pods/2335abae-520f-4557-8ffd-ab60cbb68812/volumes"
Oct 31 17:42:59.918665 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:59.915832    5003 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="55b8d358-b7ac-4cf7-bea9-35621070d8cc" path="/var/lib/kubelet/pods/55b8d358-b7ac-4cf7-bea9-35621070d8cc/volumes"
Oct 31 17:42:59.918665 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:59.916415    5003 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="6eff589e-d19b-4ea9-898e-85009de000eb" path="/var/lib/kubelet/pods/6eff589e-d19b-4ea9-898e-85009de000eb/volumes"
Oct 31 17:42:59.918665 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:59.918165    5003 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="73f3a3b3-a5dd-4054-be25-5e23a820c5fe" path="/var/lib/kubelet/pods/73f3a3b3-a5dd-4054-be25-5e23a820c5fe/volumes"
Oct 31 17:42:59.919743 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:59.918995    5003 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="8c4070da-49cf-4158-b6fe-4b6ea0cc5ea2" path="/var/lib/kubelet/pods/8c4070da-49cf-4158-b6fe-4b6ea0cc5ea2/volumes"
Oct 31 17:42:59.919805 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:59.919783    5003 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="9bf16293-fd1c-421b-9f91-3c7178ed7cd3" path="/var/lib/kubelet/pods/9bf16293-fd1c-421b-9f91-3c7178ed7cd3/volumes"
Oct 31 17:42:59.921279 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:59.921201    5003 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="a115d540-ac87-497f-97f8-bd2e52d066f7" path="/var/lib/kubelet/pods/a115d540-ac87-497f-97f8-bd2e52d066f7/volumes"
Oct 31 17:42:59.922035 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:42:59.922012    5003 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="fa5b3d0d-4ae9-4f60-8af5-571df26ba157" path="/var/lib/kubelet/pods/fa5b3d0d-4ae9-4f60-8af5-571df26ba157/volumes"
Oct 31 17:43:00.060537 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:00.060510    5003 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-ee816e-7cd5d5699-t92fc"
Oct 31 17:43:00.185726 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:00.185682    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/d0144654-e609-4e0f-9c06-7522cefcf9f0-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d0144654-e609-4e0f-9c06-7522cefcf9f0-plugins-config-volume\") pod \"d0144654-e609-4e0f-9c06-7522cefcf9f0\" (UID: \"d0144654-e609-4e0f-9c06-7522cefcf9f0\") "
Oct 31 17:43:00.185894 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:00.185754    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/d0144654-e609-4e0f-9c06-7522cefcf9f0-kube-api-access-6zbfl\" (UniqueName: \"kubernetes.io/projected/d0144654-e609-4e0f-9c06-7522cefcf9f0-kube-api-access-6zbfl\") pod \"d0144654-e609-4e0f-9c06-7522cefcf9f0\" (UID: \"d0144654-e609-4e0f-9c06-7522cefcf9f0\") "
Oct 31 17:43:00.187168 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:00.187118    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d0144654-e609-4e0f-9c06-7522cefcf9f0-plugins-config-volume" pod "d0144654-e609-4e0f-9c06-7522cefcf9f0" (UID: "d0144654-e609-4e0f-9c06-7522cefcf9f0"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 17:43:00.190573 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:00.190541    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d0144654-e609-4e0f-9c06-7522cefcf9f0-kube-api-access-6zbfl" pod "d0144654-e609-4e0f-9c06-7522cefcf9f0" (UID: "d0144654-e609-4e0f-9c06-7522cefcf9f0"). InnerVolumeSpecName "kube-api-access-6zbfl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 17:43:00.197947 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:00.197915    5003 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-processing-e2e-worker-w6-d80080-7f8f6c66c-btxwt" podUID="d6d7f818-43c5-4470-9799-6b6e6cebb928" containerName="payload-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 31 17:43:00.287883 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:00.287844    5003 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d0144654-e609-4e0f-9c06-7522cefcf9f0-plugins-config-volume\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:43:00.289237 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:00.289200    5003 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6zbfl\" (UniqueName: \"kubernetes.io/projected/d0144654-e609-4e0f-9c06-7522cefcf9f0-kube-api-access-6zbfl\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:43:00.358705 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:00.356780    5003 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w0-ee816e-7d6bc48879-mmfcd"
Oct 31 17:43:00.490765 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:00.490732    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/7a49c490-67e7-4f7e-8ce9-11def81392e4-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7a49c490-67e7-4f7e-8ce9-11def81392e4-plugins-config-volume\") pod \"7a49c490-67e7-4f7e-8ce9-11def81392e4\" (UID: \"7a49c490-67e7-4f7e-8ce9-11def81392e4\") "
Oct 31 17:43:00.490939 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:00.490898    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/7a49c490-67e7-4f7e-8ce9-11def81392e4-kube-api-access-v5j4p\" (UniqueName: \"kubernetes.io/projected/7a49c490-67e7-4f7e-8ce9-11def81392e4-kube-api-access-v5j4p\") pod \"7a49c490-67e7-4f7e-8ce9-11def81392e4\" (UID: \"7a49c490-67e7-4f7e-8ce9-11def81392e4\") "
Oct 31 17:43:00.491154 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:00.491131    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7a49c490-67e7-4f7e-8ce9-11def81392e4-plugins-config-volume" pod "7a49c490-67e7-4f7e-8ce9-11def81392e4" (UID: "7a49c490-67e7-4f7e-8ce9-11def81392e4"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 17:43:00.491321 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:00.491307    5003 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7a49c490-67e7-4f7e-8ce9-11def81392e4-plugins-config-volume\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:43:00.492947 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:00.492925    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7a49c490-67e7-4f7e-8ce9-11def81392e4-kube-api-access-v5j4p" pod "7a49c490-67e7-4f7e-8ce9-11def81392e4" (UID: "7a49c490-67e7-4f7e-8ce9-11def81392e4"). InnerVolumeSpecName "kube-api-access-v5j4p". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 17:43:00.593028 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:00.592996    5003 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v5j4p\" (UniqueName: \"kubernetes.io/projected/7a49c490-67e7-4f7e-8ce9-11def81392e4-kube-api-access-v5j4p\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:43:00.614559 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:00.614528    5003 generic.go:356] "Generic (PLEG): container finished" podID="7a49c490-67e7-4f7e-8ce9-11def81392e4" containerID="fa00b801b3196dd63e6b0384954eca3509bdbaf78ed687304fb321ea3ed57e64" exitCode=0
Oct 31 17:43:00.615162 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:00.614571    5003 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w0-ee816e-7d6bc48879-mmfcd"
Oct 31 17:43:00.615162 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:00.614606    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w0-ee816e-7d6bc48879-mmfcd" event={"ID":"7a49c490-67e7-4f7e-8ce9-11def81392e4","Type":"ContainerDied","Data":"fa00b801b3196dd63e6b0384954eca3509bdbaf78ed687304fb321ea3ed57e64"}
Oct 31 17:43:00.615162 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:00.614684    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w0-ee816e-7d6bc48879-mmfcd" event={"ID":"7a49c490-67e7-4f7e-8ce9-11def81392e4","Type":"ContainerDied","Data":"4d0ee13e846b53e2a87bfb16f34522f628ee21585ae5bc871417b020a60e1119"}
Oct 31 17:43:00.615162 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:00.614717    5003 scope.go:122] "RemoveContainer" containerID="fa00b801b3196dd63e6b0384954eca3509bdbaf78ed687304fb321ea3ed57e64"
Oct 31 17:43:00.616685 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:00.616661    5003 generic.go:356] "Generic (PLEG): container finished" podID="d0144654-e609-4e0f-9c06-7522cefcf9f0" containerID="e48f4c71eedc524f09c49d937c9b74783151265e70eb1cec84560e88c7ee0e4c" exitCode=0
Oct 31 17:43:00.616789 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:00.616718    5003 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-ee816e-7cd5d5699-t92fc"
Oct 31 17:43:00.616789 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:00.616739    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-ee816e-7cd5d5699-t92fc" event={"ID":"d0144654-e609-4e0f-9c06-7522cefcf9f0","Type":"ContainerDied","Data":"e48f4c71eedc524f09c49d937c9b74783151265e70eb1cec84560e88c7ee0e4c"}
Oct 31 17:43:00.616789 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:00.616784    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-ee816e-7cd5d5699-t92fc" event={"ID":"d0144654-e609-4e0f-9c06-7522cefcf9f0","Type":"ContainerDied","Data":"ab97baf78c5708af0cbbf56aac2d69e92aa75f78e87717e143e3ad3532b04767"}
Oct 31 17:43:00.618406 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:00.618384    5003 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-b78c31-5f598f895d-wgvlq"
Oct 31 17:43:00.618511 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:00.618420    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-b78c31-5f598f895d-wgvlq" event={"ID":"faeea853-aa53-4bb6-9a85-4e55772556b2","Type":"ContainerDied","Data":"37ad7fd42645750b4ea848a7a82ad60fad9a6b8927c9a348061949c58c53ed13"}
Oct 31 17:43:00.628917 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:00.628895    5003 scope.go:122] "RemoveContainer" containerID="fa00b801b3196dd63e6b0384954eca3509bdbaf78ed687304fb321ea3ed57e64"
Oct 31 17:43:00.629202 ip-10-0-138-17 kubenswrapper[5003]: E1031 17:43:00.629179    5003 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fa00b801b3196dd63e6b0384954eca3509bdbaf78ed687304fb321ea3ed57e64\": container with ID starting with fa00b801b3196dd63e6b0384954eca3509bdbaf78ed687304fb321ea3ed57e64 not found: ID does not exist" containerID="fa00b801b3196dd63e6b0384954eca3509bdbaf78ed687304fb321ea3ed57e64"
Oct 31 17:43:00.629252 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:00.629210    5003 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fa00b801b3196dd63e6b0384954eca3509bdbaf78ed687304fb321ea3ed57e64"} err="failed to get container status \"fa00b801b3196dd63e6b0384954eca3509bdbaf78ed687304fb321ea3ed57e64\": rpc error: code = NotFound desc = could not find container \"fa00b801b3196dd63e6b0384954eca3509bdbaf78ed687304fb321ea3ed57e64\": container with ID starting with fa00b801b3196dd63e6b0384954eca3509bdbaf78ed687304fb321ea3ed57e64 not found: ID does not exist"
Oct 31 17:43:00.629252 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:00.629230    5003 scope.go:122] "RemoveContainer" containerID="e48f4c71eedc524f09c49d937c9b74783151265e70eb1cec84560e88c7ee0e4c"
Oct 31 17:43:00.640253 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:00.640231    5003 scope.go:122] "RemoveContainer" containerID="e48f4c71eedc524f09c49d937c9b74783151265e70eb1cec84560e88c7ee0e4c"
Oct 31 17:43:00.640539 ip-10-0-138-17 kubenswrapper[5003]: E1031 17:43:00.640514    5003 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e48f4c71eedc524f09c49d937c9b74783151265e70eb1cec84560e88c7ee0e4c\": container with ID starting with e48f4c71eedc524f09c49d937c9b74783151265e70eb1cec84560e88c7ee0e4c not found: ID does not exist" containerID="e48f4c71eedc524f09c49d937c9b74783151265e70eb1cec84560e88c7ee0e4c"
Oct 31 17:43:00.640586 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:00.640550    5003 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e48f4c71eedc524f09c49d937c9b74783151265e70eb1cec84560e88c7ee0e4c"} err="failed to get container status \"e48f4c71eedc524f09c49d937c9b74783151265e70eb1cec84560e88c7ee0e4c\": rpc error: code = NotFound desc = could not find container \"e48f4c71eedc524f09c49d937c9b74783151265e70eb1cec84560e88c7ee0e4c\": container with ID starting with e48f4c71eedc524f09c49d937c9b74783151265e70eb1cec84560e88c7ee0e4c not found: ID does not exist"
Oct 31 17:43:00.640586 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:00.640568    5003 scope.go:122] "RemoveContainer" containerID="56e0be58563c6e08a8e4f124cd66b2748cb14aa9316f7d29bb3e29a98b74c66d"
Oct 31 17:43:00.677773 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:00.677747    5003 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w0-ee816e-7cd5d5699-t92fc"]
Oct 31 17:43:00.695010 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:00.694976    5003 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w0-ee816e-7cd5d5699-t92fc"]
Oct 31 17:43:00.735024 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:00.734992    5003 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w0-ee816e-7d6bc48879-mmfcd"]
Oct 31 17:43:00.753444 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:00.753409    5003 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w0-ee816e-7d6bc48879-mmfcd"]
Oct 31 17:43:00.806789 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:00.806758    5003 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w5-b78c31-5f598f895d-wgvlq"]
Oct 31 17:43:00.811038 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:00.811004    5003 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w5-b78c31-5f598f895d-wgvlq"]
Oct 31 17:43:01.948669 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:01.948365    5003 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="7a49c490-67e7-4f7e-8ce9-11def81392e4" path="/var/lib/kubelet/pods/7a49c490-67e7-4f7e-8ce9-11def81392e4/volumes"
Oct 31 17:43:01.949185 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:01.949031    5003 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="d0144654-e609-4e0f-9c06-7522cefcf9f0" path="/var/lib/kubelet/pods/d0144654-e609-4e0f-9c06-7522cefcf9f0/volumes"
Oct 31 17:43:01.952684 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:01.949699    5003 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="faeea853-aa53-4bb6-9a85-4e55772556b2" path="/var/lib/kubelet/pods/faeea853-aa53-4bb6-9a85-4e55772556b2/volumes"
Oct 31 17:43:02.524760 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:02.524714    5003 prober.go:122] "Probe failed" probeType="Readiness" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-b78c31-5f598f895d-wgvlq" podUID="faeea853-aa53-4bb6-9a85-4e55772556b2" containerName="maas-api" probeResult="failure" output="Get \"https://10.132.0.70:8443/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 31 17:43:06.333543 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:06.333497    5003 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w5-b78c31-openshift-default-774cb4f6c9-p7lp5"]
Oct 31 17:43:06.333947 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:06.333767    5003 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w5-b78c31-openshift-default-774cb4f6c9-p7lp5" podUID="4482b94f-d7f9-4575-b22e-765dfd4ad693" containerName="istio-proxy" containerID="cri-o://20685a362fdc25a06eac9a749dd142b9951c288dd4f246a73b3820116c4602c2" gracePeriod=30
Oct 31 17:43:06.344765 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:06.344734    5003 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w5-b78c31-openshift-default-774cb4f6c9-nhqll"]
Oct 31 17:43:06.345014 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:06.344971    5003 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w5-b78c31-openshift-default-774cb4f6c9-nhqll" podUID="b0a16d54-5d2c-4c23-bf11-9cfe1844b568" containerName="istio-proxy" containerID="cri-o://0b6a122534975c4cb372789f76d3740b168b2c8ff368438578c2a105fb75f154" gracePeriod=30
Oct 31 17:43:06.357381 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:06.357350    5003 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w5-b78c31-openshift-default-774cb4f6c9-dr2b8"]
Oct 31 17:43:06.357680 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:06.357598    5003 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w5-b78c31-openshift-default-774cb4f6c9-dr2b8" podUID="0711a80f-6f89-4949-aef2-a3281e637712" containerName="istio-proxy" containerID="cri-o://f94f4c34ce94c5da7fc3c8c1940338451d54e1dc9d60bd40a6596f5371384269" gracePeriod=30
Oct 31 17:43:08.378969 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:08.378058    5003 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-1c0bfd-openshift-default-f7f657c57-hp2wj"]
Oct 31 17:43:08.378969 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:08.378323    5003 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w4-1c0bfd-openshift-default-f7f657c57-hp2wj" podUID="679da5c1-9c28-4f80-a210-185350147f11" containerName="istio-proxy" containerID="cri-o://ed209a24e1203b5578ab5fddc515a3543dedaa851d14aa9fed738fe591800a6f" gracePeriod=30
Oct 31 17:43:08.391204 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:08.391133    5003 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-1c0bfd-openshift-default-f7f657c57-wxm7h"]
Oct 31 17:43:08.392080 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:08.392010    5003 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w4-1c0bfd-openshift-default-f7f657c57-wxm7h" podUID="92a031e7-6d59-4493-b15d-7dc213289f55" containerName="istio-proxy" containerID="cri-o://93e4421d727b7815d166afafabc67fa9fb7bb501d3b58c093af850d439339a81" gracePeriod=30
Oct 31 17:43:08.417145 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:08.414511    5003 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-1c0bfd-openshift-default-f7f657c57-prvbp"]
Oct 31 17:43:08.417145 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:08.414809    5003 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w4-1c0bfd-openshift-default-f7f657c57-prvbp" podUID="8a6f3fb4-846a-43aa-9309-48c6ca558850" containerName="istio-proxy" containerID="cri-o://09984cd9197e55863d415a0834b373a76536d8140f35ed93946cc3db69846837" gracePeriod=30
Oct 31 17:43:09.100302 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:09.100224    5003 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w6-d80080-7f8f6c66c-btxwt"
Oct 31 17:43:09.120745 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:09.120716    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/d6d7f818-43c5-4470-9799-6b6e6cebb928-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d6d7f818-43c5-4470-9799-6b6e6cebb928-plugins-config-volume\") pod \"d6d7f818-43c5-4470-9799-6b6e6cebb928\" (UID: \"d6d7f818-43c5-4470-9799-6b6e6cebb928\") "
Oct 31 17:43:09.120963 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:09.120947    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/d6d7f818-43c5-4470-9799-6b6e6cebb928-kube-api-access-jlvmr\" (UniqueName: \"kubernetes.io/projected/d6d7f818-43c5-4470-9799-6b6e6cebb928-kube-api-access-jlvmr\") pod \"d6d7f818-43c5-4470-9799-6b6e6cebb928\" (UID: \"d6d7f818-43c5-4470-9799-6b6e6cebb928\") "
Oct 31 17:43:09.121109 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:09.121083    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d6d7f818-43c5-4470-9799-6b6e6cebb928-plugins-config-volume" pod "d6d7f818-43c5-4470-9799-6b6e6cebb928" (UID: "d6d7f818-43c5-4470-9799-6b6e6cebb928"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 17:43:09.121470 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:09.121446    5003 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d6d7f818-43c5-4470-9799-6b6e6cebb928-plugins-config-volume\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:43:09.123795 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:09.123768    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d6d7f818-43c5-4470-9799-6b6e6cebb928-kube-api-access-jlvmr" pod "d6d7f818-43c5-4470-9799-6b6e6cebb928" (UID: "d6d7f818-43c5-4470-9799-6b6e6cebb928"). InnerVolumeSpecName "kube-api-access-jlvmr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 17:43:09.164595 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:09.164558    5003 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-ee816e-openshift-default-c4db85b5c-7pwpp"]
Oct 31 17:43:09.164904 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:09.164870    5003 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w0-ee816e-openshift-default-c4db85b5c-7pwpp" podUID="a79988d8-d286-43ae-914b-bd1f6db3eb11" containerName="istio-proxy" containerID="cri-o://b70f11a8fea21a6df296adcd388ee127839103162a8061281174277142cd35b8" gracePeriod=30
Oct 31 17:43:09.169924 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:09.169886    5003 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-ee816e-openshift-default-c4db85b5c-dz8kv"]
Oct 31 17:43:09.170162 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:09.170133    5003 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w0-ee816e-openshift-default-c4db85b5c-dz8kv" podUID="6dbed28d-b3b9-4af1-82b7-40151ba418c1" containerName="istio-proxy" containerID="cri-o://8c1bb55797c58b272d9659652198809f486df56cb182f4b46d80d863ecddd72b" gracePeriod=30
Oct 31 17:43:09.175261 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:09.175234    5003 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-ee816e-openshift-default-c4db85b5c-j7pfz"]
Oct 31 17:43:09.175471 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:09.175450    5003 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w0-ee816e-openshift-default-c4db85b5c-j7pfz" podUID="6c7cacb3-7045-4e9d-a2d6-9fabaa50af3d" containerName="istio-proxy" containerID="cri-o://60ce9522dc18b66c7ac96aca043fb8b211a05ce8556e834bff095cc29f4c834f" gracePeriod=30
Oct 31 17:43:09.211811 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:09.211777    5003 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-ee816e-openshift-default-c4db85b5c-qm655"]
Oct 31 17:43:09.211981 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:09.211961    5003 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w0-ee816e-openshift-default-c4db85b5c-qm655" podUID="d2652cf4-9d2a-480e-ad8a-946d0d4b90f3" containerName="istio-proxy" containerID="cri-o://c4ff4c810940412d9a1ff9122542f6410610dbb972e3da5152726e556a9c8a14" gracePeriod=30
Oct 31 17:43:09.223242 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:09.223213    5003 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jlvmr\" (UniqueName: \"kubernetes.io/projected/d6d7f818-43c5-4470-9799-6b6e6cebb928-kube-api-access-jlvmr\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:43:09.575284 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:09.575249    5003 patch_prober.go:29] interesting pod/e2e-worker-w4-1c0bfd-openshift-default-f7f657c57-prvbp container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Oct 31 17:43:09.575635 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:09.575309    5003 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w4-1c0bfd-openshift-default-f7f657c57-prvbp" podUID="8a6f3fb4-846a-43aa-9309-48c6ca558850" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 31 17:43:09.784460 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:09.784424    5003 generic.go:356] "Generic (PLEG): container finished" podID="d6d7f818-43c5-4470-9799-6b6e6cebb928" containerID="6237f9f1f5859ea0ed18d12272273009f471c652f72b1c34a42abecd7c42359f" exitCode=0
Oct 31 17:43:09.784603 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:09.784480    5003 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w6-d80080-7f8f6c66c-btxwt"
Oct 31 17:43:09.784603 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:09.784511    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w6-d80080-7f8f6c66c-btxwt" event={"ID":"d6d7f818-43c5-4470-9799-6b6e6cebb928","Type":"ContainerDied","Data":"6237f9f1f5859ea0ed18d12272273009f471c652f72b1c34a42abecd7c42359f"}
Oct 31 17:43:09.784603 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:09.784569    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w6-d80080-7f8f6c66c-btxwt" event={"ID":"d6d7f818-43c5-4470-9799-6b6e6cebb928","Type":"ContainerDied","Data":"87333d592c8781019769aeb3b522caddb0486a2f110ef0777fe720607e10d1e9"}
Oct 31 17:43:09.784603 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:09.784598    5003 scope.go:122] "RemoveContainer" containerID="6237f9f1f5859ea0ed18d12272273009f471c652f72b1c34a42abecd7c42359f"
Oct 31 17:43:09.795418 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:09.795387    5003 scope.go:122] "RemoveContainer" containerID="6237f9f1f5859ea0ed18d12272273009f471c652f72b1c34a42abecd7c42359f"
Oct 31 17:43:09.795708 ip-10-0-138-17 kubenswrapper[5003]: E1031 17:43:09.795687    5003 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6237f9f1f5859ea0ed18d12272273009f471c652f72b1c34a42abecd7c42359f\": container with ID starting with 6237f9f1f5859ea0ed18d12272273009f471c652f72b1c34a42abecd7c42359f not found: ID does not exist" containerID="6237f9f1f5859ea0ed18d12272273009f471c652f72b1c34a42abecd7c42359f"
Oct 31 17:43:09.795769 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:09.795718    5003 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6237f9f1f5859ea0ed18d12272273009f471c652f72b1c34a42abecd7c42359f"} err="failed to get container status \"6237f9f1f5859ea0ed18d12272273009f471c652f72b1c34a42abecd7c42359f\": rpc error: code = NotFound desc = could not find container \"6237f9f1f5859ea0ed18d12272273009f471c652f72b1c34a42abecd7c42359f\": container with ID starting with 6237f9f1f5859ea0ed18d12272273009f471c652f72b1c34a42abecd7c42359f not found: ID does not exist"
Oct 31 17:43:09.835707 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:09.835634    5003 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w6-d80080-7f8f6c66c-btxwt"]
Oct 31 17:43:09.842248 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:09.842220    5003 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w6-d80080-7f8f6c66c-btxwt"]
Oct 31 17:43:09.890807 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:09.890781    5003 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="d6d7f818-43c5-4470-9799-6b6e6cebb928" path="/var/lib/kubelet/pods/d6d7f818-43c5-4470-9799-6b6e6cebb928/volumes"
Oct 31 17:43:09.967389 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:09.967356    5003 patch_prober.go:29] interesting pod/e2e-worker-w4-1c0bfd-openshift-default-f7f657c57-wxm7h container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Oct 31 17:43:09.967523 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:09.967418    5003 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w4-1c0bfd-openshift-default-f7f657c57-wxm7h" podUID="92a031e7-6d59-4493-b15d-7dc213289f55" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 31 17:43:10.035634 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:10.035598    5003 patch_prober.go:29] interesting pod/e2e-worker-w5-b78c31-openshift-default-774cb4f6c9-dr2b8 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Oct 31 17:43:10.035828 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:10.035670    5003 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w5-b78c31-openshift-default-774cb4f6c9-dr2b8" podUID="0711a80f-6f89-4949-aef2-a3281e637712" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 31 17:43:10.324489 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:10.324456    5003 patch_prober.go:29] interesting pod/e2e-worker-w5-b78c31-openshift-default-774cb4f6c9-nhqll container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Oct 31 17:43:10.324701 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:10.324517    5003 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w5-b78c31-openshift-default-774cb4f6c9-nhqll" podUID="b0a16d54-5d2c-4c23-bf11-9cfe1844b568" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 31 17:43:10.339573 ip-10-0-138-17 kubenswrapper[5003]: E1031 17:43:10.339538    5003 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-tdzz5" containerName="extractor"
Oct 31 17:43:10.580759 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:10.580677    5003 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w6-d80080-openshift-default-956cddf57-x6xxp"]
Oct 31 17:43:10.581125 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:10.580911    5003 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w6-d80080-openshift-default-956cddf57-x6xxp" podUID="5f2c9613-4b8a-4452-b70a-2ed258063318" containerName="istio-proxy" containerID="cri-o://af682b13055f9fa3bfcb813dc3c7f84bd182a1fb9c5d47876115724ffe721500" gracePeriod=30
Oct 31 17:43:10.596455 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:10.596426    5003 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w6-d80080-openshift-default-956cddf57-5f59v"]
Oct 31 17:43:10.596618 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:10.596603    5003 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w6-d80080-openshift-default-956cddf57-5f59v" podUID="503ff30a-8065-430d-a685-89ff4ec49f7c" containerName="istio-proxy" containerID="cri-o://930ee319f56552eab82e08d8295978dd5d31efa037697ee5b6f837684ca1b6d6" gracePeriod=30
Oct 31 17:43:10.608748 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:10.608719    5003 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w6-d80080-openshift-default-956cddf57-rdglw"]
Oct 31 17:43:10.608915 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:10.608897    5003 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w6-d80080-openshift-default-956cddf57-rdglw" podUID="eeb8afc2-1a66-4c38-9fb3-04ccd09083a2" containerName="istio-proxy" containerID="cri-o://be1050371aa22276cd09f5b713b4e73dc04fb13672cd698f040abcd330a127b8" gracePeriod=30
Oct 31 17:43:10.701730 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:10.698341    5003 patch_prober.go:29] interesting pod/e2e-worker-w0-ee816e-openshift-default-c4db85b5c-7pwpp container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=upstream connect error or disconnect/reset before headers. reset reason: remote connection failure, transport failure reason: delayed connect error: Connection refused
Oct 31 17:43:10.702044 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:10.702008    5003 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w0-ee816e-openshift-default-c4db85b5c-7pwpp" podUID="a79988d8-d286-43ae-914b-bd1f6db3eb11" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 31 17:43:11.302565 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:11.302528    5003 patch_prober.go:29] interesting pod/e2e-worker-w0-ee816e-openshift-default-c4db85b5c-qm655 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Oct 31 17:43:11.302808 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:11.302593    5003 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w0-ee816e-openshift-default-c4db85b5c-qm655" podUID="d2652cf4-9d2a-480e-ad8a-946d0d4b90f3" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 31 17:43:11.653436 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:11.649773    5003 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-b78c31-openshift-default-774cb4f6c9-nhqll"
Oct 31 17:43:11.682386 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:11.682361    5003 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-b78c31-openshift-default-774cb4f6c9-p7lp5"
Oct 31 17:43:11.696071 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:11.696050    5003 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-b78c31-openshift-default-774cb4f6c9-dr2b8"
Oct 31 17:43:11.757353 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:11.757320    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/b0a16d54-5d2c-4c23-bf11-9cfe1844b568-kube-api-access-jrz65\" (UniqueName: \"kubernetes.io/projected/b0a16d54-5d2c-4c23-bf11-9cfe1844b568-kube-api-access-jrz65\") pod \"b0a16d54-5d2c-4c23-bf11-9cfe1844b568\" (UID: \"b0a16d54-5d2c-4c23-bf11-9cfe1844b568\") "
Oct 31 17:43:11.757522 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:11.757377    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/4482b94f-d7f9-4575-b22e-765dfd4ad693-istio-token\" (UniqueName: \"kubernetes.io/projected/4482b94f-d7f9-4575-b22e-765dfd4ad693-istio-token\") pod \"4482b94f-d7f9-4575-b22e-765dfd4ad693\" (UID: \"4482b94f-d7f9-4575-b22e-765dfd4ad693\") "
Oct 31 17:43:11.757522 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:11.757415    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/4482b94f-d7f9-4575-b22e-765dfd4ad693-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4482b94f-d7f9-4575-b22e-765dfd4ad693-istiod-ca-cert\") pod \"4482b94f-d7f9-4575-b22e-765dfd4ad693\" (UID: \"4482b94f-d7f9-4575-b22e-765dfd4ad693\") "
Oct 31 17:43:11.757522 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:11.757440    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/b0a16d54-5d2c-4c23-bf11-9cfe1844b568-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b0a16d54-5d2c-4c23-bf11-9cfe1844b568-istio-podinfo\") pod \"b0a16d54-5d2c-4c23-bf11-9cfe1844b568\" (UID: \"b0a16d54-5d2c-4c23-bf11-9cfe1844b568\") "
Oct 31 17:43:11.757522 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:11.757469    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/b0a16d54-5d2c-4c23-bf11-9cfe1844b568-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b0a16d54-5d2c-4c23-bf11-9cfe1844b568-istiod-ca-cert\") pod \"b0a16d54-5d2c-4c23-bf11-9cfe1844b568\" (UID: \"b0a16d54-5d2c-4c23-bf11-9cfe1844b568\") "
Oct 31 17:43:11.758261 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:11.757875    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/4482b94f-d7f9-4575-b22e-765dfd4ad693-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4482b94f-d7f9-4575-b22e-765dfd4ad693-istio-data\") pod \"4482b94f-d7f9-4575-b22e-765dfd4ad693\" (UID: \"4482b94f-d7f9-4575-b22e-765dfd4ad693\") "
Oct 31 17:43:11.758261 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:11.757951    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b0a16d54-5d2c-4c23-bf11-9cfe1844b568-istiod-ca-cert" pod "b0a16d54-5d2c-4c23-bf11-9cfe1844b568" (UID: "b0a16d54-5d2c-4c23-bf11-9cfe1844b568"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 17:43:11.758261 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:11.757979    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/4482b94f-d7f9-4575-b22e-765dfd4ad693-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4482b94f-d7f9-4575-b22e-765dfd4ad693-credential-socket\") pod \"4482b94f-d7f9-4575-b22e-765dfd4ad693\" (UID: \"4482b94f-d7f9-4575-b22e-765dfd4ad693\") "
Oct 31 17:43:11.758261 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:11.757996    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4482b94f-d7f9-4575-b22e-765dfd4ad693-istiod-ca-cert" pod "4482b94f-d7f9-4575-b22e-765dfd4ad693" (UID: "4482b94f-d7f9-4575-b22e-765dfd4ad693"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 17:43:11.758261 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:11.758045    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/0711a80f-6f89-4949-aef2-a3281e637712-kube-api-access-rjcgn\" (UniqueName: \"kubernetes.io/projected/0711a80f-6f89-4949-aef2-a3281e637712-kube-api-access-rjcgn\") pod \"0711a80f-6f89-4949-aef2-a3281e637712\" (UID: \"0711a80f-6f89-4949-aef2-a3281e637712\") "
Oct 31 17:43:11.758261 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:11.758089    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/4482b94f-d7f9-4575-b22e-765dfd4ad693-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4482b94f-d7f9-4575-b22e-765dfd4ad693-workload-socket\") pod \"4482b94f-d7f9-4575-b22e-765dfd4ad693\" (UID: \"4482b94f-d7f9-4575-b22e-765dfd4ad693\") "
Oct 31 17:43:11.758261 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:11.758142    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/0711a80f-6f89-4949-aef2-a3281e637712-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0711a80f-6f89-4949-aef2-a3281e637712-istio-podinfo\") pod \"0711a80f-6f89-4949-aef2-a3281e637712\" (UID: \"0711a80f-6f89-4949-aef2-a3281e637712\") "
Oct 31 17:43:11.758261 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:11.758214    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4482b94f-d7f9-4575-b22e-765dfd4ad693-istio-data" pod "4482b94f-d7f9-4575-b22e-765dfd4ad693" (UID: "4482b94f-d7f9-4575-b22e-765dfd4ad693"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 17:43:11.758799 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:11.758431    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4482b94f-d7f9-4575-b22e-765dfd4ad693-credential-socket" pod "4482b94f-d7f9-4575-b22e-765dfd4ad693" (UID: "4482b94f-d7f9-4575-b22e-765dfd4ad693"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 17:43:11.758799 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:11.758613    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4482b94f-d7f9-4575-b22e-765dfd4ad693-workload-socket" pod "4482b94f-d7f9-4575-b22e-765dfd4ad693" (UID: "4482b94f-d7f9-4575-b22e-765dfd4ad693"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 17:43:11.760306 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:11.758197    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b0a16d54-5d2c-4c23-bf11-9cfe1844b568-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b0a16d54-5d2c-4c23-bf11-9cfe1844b568-istio-envoy\") pod \"b0a16d54-5d2c-4c23-bf11-9cfe1844b568\" (UID: \"b0a16d54-5d2c-4c23-bf11-9cfe1844b568\") "
Oct 31 17:43:11.760306 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:11.758977    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/b0a16d54-5d2c-4c23-bf11-9cfe1844b568-istio-token\" (UniqueName: \"kubernetes.io/projected/b0a16d54-5d2c-4c23-bf11-9cfe1844b568-istio-token\") pod \"b0a16d54-5d2c-4c23-bf11-9cfe1844b568\" (UID: \"b0a16d54-5d2c-4c23-bf11-9cfe1844b568\") "
Oct 31 17:43:11.760306 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:11.759021    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/0711a80f-6f89-4949-aef2-a3281e637712-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0711a80f-6f89-4949-aef2-a3281e637712-workload-socket\") pod \"0711a80f-6f89-4949-aef2-a3281e637712\" (UID: \"0711a80f-6f89-4949-aef2-a3281e637712\") "
Oct 31 17:43:11.760306 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:11.759049    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/4482b94f-d7f9-4575-b22e-765dfd4ad693-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4482b94f-d7f9-4575-b22e-765dfd4ad693-workload-certs\") pod \"4482b94f-d7f9-4575-b22e-765dfd4ad693\" (UID: \"4482b94f-d7f9-4575-b22e-765dfd4ad693\") "
Oct 31 17:43:11.760306 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:11.759087    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/0711a80f-6f89-4949-aef2-a3281e637712-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0711a80f-6f89-4949-aef2-a3281e637712-credential-socket\") pod \"0711a80f-6f89-4949-aef2-a3281e637712\" (UID: \"0711a80f-6f89-4949-aef2-a3281e637712\") "
Oct 31 17:43:11.760306 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:11.759115    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/0711a80f-6f89-4949-aef2-a3281e637712-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0711a80f-6f89-4949-aef2-a3281e637712-workload-certs\") pod \"0711a80f-6f89-4949-aef2-a3281e637712\" (UID: \"0711a80f-6f89-4949-aef2-a3281e637712\") "
Oct 31 17:43:11.760306 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:11.759144    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/0711a80f-6f89-4949-aef2-a3281e637712-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0711a80f-6f89-4949-aef2-a3281e637712-istio-data\") pod \"0711a80f-6f89-4949-aef2-a3281e637712\" (UID: \"0711a80f-6f89-4949-aef2-a3281e637712\") "
Oct 31 17:43:11.760306 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:11.759176    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b0a16d54-5d2c-4c23-bf11-9cfe1844b568-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b0a16d54-5d2c-4c23-bf11-9cfe1844b568-workload-socket\") pod \"b0a16d54-5d2c-4c23-bf11-9cfe1844b568\" (UID: \"b0a16d54-5d2c-4c23-bf11-9cfe1844b568\") "
Oct 31 17:43:11.760306 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:11.759242    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/0711a80f-6f89-4949-aef2-a3281e637712-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0711a80f-6f89-4949-aef2-a3281e637712-istio-envoy\") pod \"0711a80f-6f89-4949-aef2-a3281e637712\" (UID: \"0711a80f-6f89-4949-aef2-a3281e637712\") "
Oct 31 17:43:11.760306 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:11.759285    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b0a16d54-5d2c-4c23-bf11-9cfe1844b568-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b0a16d54-5d2c-4c23-bf11-9cfe1844b568-workload-certs\") pod \"b0a16d54-5d2c-4c23-bf11-9cfe1844b568\" (UID: \"b0a16d54-5d2c-4c23-bf11-9cfe1844b568\") "
Oct 31 17:43:11.760306 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:11.759328    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/0711a80f-6f89-4949-aef2-a3281e637712-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0711a80f-6f89-4949-aef2-a3281e637712-istiod-ca-cert\") pod \"0711a80f-6f89-4949-aef2-a3281e637712\" (UID: \"0711a80f-6f89-4949-aef2-a3281e637712\") "
Oct 31 17:43:11.760306 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:11.759366    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/4482b94f-d7f9-4575-b22e-765dfd4ad693-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4482b94f-d7f9-4575-b22e-765dfd4ad693-istio-podinfo\") pod \"4482b94f-d7f9-4575-b22e-765dfd4ad693\" (UID: \"4482b94f-d7f9-4575-b22e-765dfd4ad693\") "
Oct 31 17:43:11.760306 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:11.759414    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/0711a80f-6f89-4949-aef2-a3281e637712-istio-token\" (UniqueName: \"kubernetes.io/projected/0711a80f-6f89-4949-aef2-a3281e637712-istio-token\") pod \"0711a80f-6f89-4949-aef2-a3281e637712\" (UID: \"0711a80f-6f89-4949-aef2-a3281e637712\") "
Oct 31 17:43:11.760306 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:11.759465    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/4482b94f-d7f9-4575-b22e-765dfd4ad693-kube-api-access-jrj2f\" (UniqueName: \"kubernetes.io/projected/4482b94f-d7f9-4575-b22e-765dfd4ad693-kube-api-access-jrj2f\") pod \"4482b94f-d7f9-4575-b22e-765dfd4ad693\" (UID: \"4482b94f-d7f9-4575-b22e-765dfd4ad693\") "
Oct 31 17:43:11.760306 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:11.759495    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b0a16d54-5d2c-4c23-bf11-9cfe1844b568-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b0a16d54-5d2c-4c23-bf11-9cfe1844b568-credential-socket\") pod \"b0a16d54-5d2c-4c23-bf11-9cfe1844b568\" (UID: \"b0a16d54-5d2c-4c23-bf11-9cfe1844b568\") "
Oct 31 17:43:11.760306 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:11.759537    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/4482b94f-d7f9-4575-b22e-765dfd4ad693-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4482b94f-d7f9-4575-b22e-765dfd4ad693-istio-envoy\") pod \"4482b94f-d7f9-4575-b22e-765dfd4ad693\" (UID: \"4482b94f-d7f9-4575-b22e-765dfd4ad693\") "
Oct 31 17:43:11.760306 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:11.759589    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b0a16d54-5d2c-4c23-bf11-9cfe1844b568-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b0a16d54-5d2c-4c23-bf11-9cfe1844b568-istio-data\") pod \"b0a16d54-5d2c-4c23-bf11-9cfe1844b568\" (UID: \"b0a16d54-5d2c-4c23-bf11-9cfe1844b568\") "
Oct 31 17:43:11.760306 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:11.760113    5003 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4482b94f-d7f9-4575-b22e-765dfd4ad693-istiod-ca-cert\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:43:11.760306 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:11.760131    5003 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b0a16d54-5d2c-4c23-bf11-9cfe1844b568-istiod-ca-cert\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:43:11.760306 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:11.760140    5003 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4482b94f-d7f9-4575-b22e-765dfd4ad693-istio-data\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:43:11.760306 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:11.760147    5003 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4482b94f-d7f9-4575-b22e-765dfd4ad693-credential-socket\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:43:11.760306 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:11.760155    5003 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4482b94f-d7f9-4575-b22e-765dfd4ad693-workload-socket\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:43:11.761371 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:11.760799    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b0a16d54-5d2c-4c23-bf11-9cfe1844b568-kube-api-access-jrz65" pod "b0a16d54-5d2c-4c23-bf11-9cfe1844b568" (UID: "b0a16d54-5d2c-4c23-bf11-9cfe1844b568"). InnerVolumeSpecName "kube-api-access-jrz65". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 17:43:11.761604 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:11.761507    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b0a16d54-5d2c-4c23-bf11-9cfe1844b568-istio-data" pod "b0a16d54-5d2c-4c23-bf11-9cfe1844b568" (UID: "b0a16d54-5d2c-4c23-bf11-9cfe1844b568"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 17:43:11.761754 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:11.761728    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0711a80f-6f89-4949-aef2-a3281e637712-credential-socket" pod "0711a80f-6f89-4949-aef2-a3281e637712" (UID: "0711a80f-6f89-4949-aef2-a3281e637712"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 17:43:11.761883 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:11.761808    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b0a16d54-5d2c-4c23-bf11-9cfe1844b568-workload-certs" pod "b0a16d54-5d2c-4c23-bf11-9cfe1844b568" (UID: "b0a16d54-5d2c-4c23-bf11-9cfe1844b568"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 17:43:11.762141 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:11.762110    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0711a80f-6f89-4949-aef2-a3281e637712-istiod-ca-cert" pod "0711a80f-6f89-4949-aef2-a3281e637712" (UID: "0711a80f-6f89-4949-aef2-a3281e637712"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 17:43:11.762446 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:11.762418    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b0a16d54-5d2c-4c23-bf11-9cfe1844b568-istio-envoy" pod "b0a16d54-5d2c-4c23-bf11-9cfe1844b568" (UID: "b0a16d54-5d2c-4c23-bf11-9cfe1844b568"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 17:43:11.763101 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:11.762903    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0711a80f-6f89-4949-aef2-a3281e637712-istio-envoy" pod "0711a80f-6f89-4949-aef2-a3281e637712" (UID: "0711a80f-6f89-4949-aef2-a3281e637712"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 17:43:11.763267 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:11.763216    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0711a80f-6f89-4949-aef2-a3281e637712-workload-socket" pod "0711a80f-6f89-4949-aef2-a3281e637712" (UID: "0711a80f-6f89-4949-aef2-a3281e637712"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 17:43:11.763567 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:11.763395    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0711a80f-6f89-4949-aef2-a3281e637712-workload-certs" pod "0711a80f-6f89-4949-aef2-a3281e637712" (UID: "0711a80f-6f89-4949-aef2-a3281e637712"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 17:43:11.763567 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:11.763413    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b0a16d54-5d2c-4c23-bf11-9cfe1844b568-credential-socket" pod "b0a16d54-5d2c-4c23-bf11-9cfe1844b568" (UID: "b0a16d54-5d2c-4c23-bf11-9cfe1844b568"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 17:43:11.763850 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:11.763805    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0711a80f-6f89-4949-aef2-a3281e637712-istio-data" pod "0711a80f-6f89-4949-aef2-a3281e637712" (UID: "0711a80f-6f89-4949-aef2-a3281e637712"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 17:43:11.764112 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:11.763999    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b0a16d54-5d2c-4c23-bf11-9cfe1844b568-istio-token" pod "b0a16d54-5d2c-4c23-bf11-9cfe1844b568" (UID: "b0a16d54-5d2c-4c23-bf11-9cfe1844b568"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 17:43:11.764380 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:11.764331    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b0a16d54-5d2c-4c23-bf11-9cfe1844b568-workload-socket" pod "b0a16d54-5d2c-4c23-bf11-9cfe1844b568" (UID: "b0a16d54-5d2c-4c23-bf11-9cfe1844b568"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 17:43:11.764380 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:11.764347    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4482b94f-d7f9-4575-b22e-765dfd4ad693-workload-certs" pod "4482b94f-d7f9-4575-b22e-765dfd4ad693" (UID: "4482b94f-d7f9-4575-b22e-765dfd4ad693"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 17:43:11.765821 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:11.765785    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4482b94f-d7f9-4575-b22e-765dfd4ad693-istio-envoy" pod "4482b94f-d7f9-4575-b22e-765dfd4ad693" (UID: "4482b94f-d7f9-4575-b22e-765dfd4ad693"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 17:43:11.765921 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:11.765779    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/b0a16d54-5d2c-4c23-bf11-9cfe1844b568-istio-podinfo" pod "b0a16d54-5d2c-4c23-bf11-9cfe1844b568" (UID: "b0a16d54-5d2c-4c23-bf11-9cfe1844b568"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 31 17:43:11.767146 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:11.767124    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0711a80f-6f89-4949-aef2-a3281e637712-kube-api-access-rjcgn" pod "0711a80f-6f89-4949-aef2-a3281e637712" (UID: "0711a80f-6f89-4949-aef2-a3281e637712"). InnerVolumeSpecName "kube-api-access-rjcgn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 17:43:11.767146 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:11.767136    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/0711a80f-6f89-4949-aef2-a3281e637712-istio-podinfo" pod "0711a80f-6f89-4949-aef2-a3281e637712" (UID: "0711a80f-6f89-4949-aef2-a3281e637712"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 31 17:43:11.767306 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:11.767127    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/4482b94f-d7f9-4575-b22e-765dfd4ad693-istio-podinfo" pod "4482b94f-d7f9-4575-b22e-765dfd4ad693" (UID: "4482b94f-d7f9-4575-b22e-765dfd4ad693"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 31 17:43:11.767306 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:11.767159    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4482b94f-d7f9-4575-b22e-765dfd4ad693-istio-token" pod "4482b94f-d7f9-4575-b22e-765dfd4ad693" (UID: "4482b94f-d7f9-4575-b22e-765dfd4ad693"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 17:43:11.767306 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:11.767168    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4482b94f-d7f9-4575-b22e-765dfd4ad693-kube-api-access-jrj2f" pod "4482b94f-d7f9-4575-b22e-765dfd4ad693" (UID: "4482b94f-d7f9-4575-b22e-765dfd4ad693"). InnerVolumeSpecName "kube-api-access-jrj2f". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 17:43:11.769047 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:11.769023    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0711a80f-6f89-4949-aef2-a3281e637712-istio-token" pod "0711a80f-6f89-4949-aef2-a3281e637712" (UID: "0711a80f-6f89-4949-aef2-a3281e637712"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 17:43:11.806756 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:11.806711    5003 generic.go:356] "Generic (PLEG): container finished" podID="0711a80f-6f89-4949-aef2-a3281e637712" containerID="f94f4c34ce94c5da7fc3c8c1940338451d54e1dc9d60bd40a6596f5371384269" exitCode=0
Oct 31 17:43:11.806902 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:11.806778    5003 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-b78c31-openshift-default-774cb4f6c9-dr2b8"
Oct 31 17:43:11.806902 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:11.806846    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-b78c31-openshift-default-774cb4f6c9-dr2b8" event={"ID":"0711a80f-6f89-4949-aef2-a3281e637712","Type":"ContainerDied","Data":"f94f4c34ce94c5da7fc3c8c1940338451d54e1dc9d60bd40a6596f5371384269"}
Oct 31 17:43:11.807013 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:11.806922    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-b78c31-openshift-default-774cb4f6c9-dr2b8" event={"ID":"0711a80f-6f89-4949-aef2-a3281e637712","Type":"ContainerDied","Data":"04eee82aed612b61f02c7b9c3be688377866d91e80bf168a6139f019c5f2ba8a"}
Oct 31 17:43:11.807013 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:11.806953    5003 scope.go:122] "RemoveContainer" containerID="f94f4c34ce94c5da7fc3c8c1940338451d54e1dc9d60bd40a6596f5371384269"
Oct 31 17:43:11.809480 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:11.809459    5003 generic.go:356] "Generic (PLEG): container finished" podID="b0a16d54-5d2c-4c23-bf11-9cfe1844b568" containerID="0b6a122534975c4cb372789f76d3740b168b2c8ff368438578c2a105fb75f154" exitCode=0
Oct 31 17:43:11.809576 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:11.809547    5003 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-b78c31-openshift-default-774cb4f6c9-nhqll"
Oct 31 17:43:11.809738 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:11.809638    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-b78c31-openshift-default-774cb4f6c9-nhqll" event={"ID":"b0a16d54-5d2c-4c23-bf11-9cfe1844b568","Type":"ContainerDied","Data":"0b6a122534975c4cb372789f76d3740b168b2c8ff368438578c2a105fb75f154"}
Oct 31 17:43:11.809826 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:11.809807    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-b78c31-openshift-default-774cb4f6c9-nhqll" event={"ID":"b0a16d54-5d2c-4c23-bf11-9cfe1844b568","Type":"ContainerDied","Data":"e78fa2b166c2345efd1398fc1ad9a08cedf87b62c3a104c76182786373dd4de3"}
Oct 31 17:43:11.815012 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:11.814987    5003 generic.go:356] "Generic (PLEG): container finished" podID="4482b94f-d7f9-4575-b22e-765dfd4ad693" containerID="20685a362fdc25a06eac9a749dd142b9951c288dd4f246a73b3820116c4602c2" exitCode=0
Oct 31 17:43:11.815119 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:11.815046    5003 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-b78c31-openshift-default-774cb4f6c9-p7lp5"
Oct 31 17:43:11.815119 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:11.815070    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-b78c31-openshift-default-774cb4f6c9-p7lp5" event={"ID":"4482b94f-d7f9-4575-b22e-765dfd4ad693","Type":"ContainerDied","Data":"20685a362fdc25a06eac9a749dd142b9951c288dd4f246a73b3820116c4602c2"}
Oct 31 17:43:11.815206 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:11.815127    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-b78c31-openshift-default-774cb4f6c9-p7lp5" event={"ID":"4482b94f-d7f9-4575-b22e-765dfd4ad693","Type":"ContainerDied","Data":"7fcb7baa1346d49aff7bc49e9223ea7fec9b19d8cf70c83c964a2b4b5fcbe07e"}
Oct 31 17:43:11.822474 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:11.822451    5003 scope.go:122] "RemoveContainer" containerID="f94f4c34ce94c5da7fc3c8c1940338451d54e1dc9d60bd40a6596f5371384269"
Oct 31 17:43:11.822985 ip-10-0-138-17 kubenswrapper[5003]: E1031 17:43:11.822958    5003 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f94f4c34ce94c5da7fc3c8c1940338451d54e1dc9d60bd40a6596f5371384269\": container with ID starting with f94f4c34ce94c5da7fc3c8c1940338451d54e1dc9d60bd40a6596f5371384269 not found: ID does not exist" containerID="f94f4c34ce94c5da7fc3c8c1940338451d54e1dc9d60bd40a6596f5371384269"
Oct 31 17:43:11.823079 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:11.822997    5003 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f94f4c34ce94c5da7fc3c8c1940338451d54e1dc9d60bd40a6596f5371384269"} err="failed to get container status \"f94f4c34ce94c5da7fc3c8c1940338451d54e1dc9d60bd40a6596f5371384269\": rpc error: code = NotFound desc = could not find container \"f94f4c34ce94c5da7fc3c8c1940338451d54e1dc9d60bd40a6596f5371384269\": container with ID starting with f94f4c34ce94c5da7fc3c8c1940338451d54e1dc9d60bd40a6596f5371384269 not found: ID does not exist"
Oct 31 17:43:11.823079 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:11.823022    5003 scope.go:122] "RemoveContainer" containerID="0b6a122534975c4cb372789f76d3740b168b2c8ff368438578c2a105fb75f154"
Oct 31 17:43:11.836465 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:11.836443    5003 scope.go:122] "RemoveContainer" containerID="0b6a122534975c4cb372789f76d3740b168b2c8ff368438578c2a105fb75f154"
Oct 31 17:43:11.836777 ip-10-0-138-17 kubenswrapper[5003]: E1031 17:43:11.836754    5003 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0b6a122534975c4cb372789f76d3740b168b2c8ff368438578c2a105fb75f154\": container with ID starting with 0b6a122534975c4cb372789f76d3740b168b2c8ff368438578c2a105fb75f154 not found: ID does not exist" containerID="0b6a122534975c4cb372789f76d3740b168b2c8ff368438578c2a105fb75f154"
Oct 31 17:43:11.836886 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:11.836785    5003 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0b6a122534975c4cb372789f76d3740b168b2c8ff368438578c2a105fb75f154"} err="failed to get container status \"0b6a122534975c4cb372789f76d3740b168b2c8ff368438578c2a105fb75f154\": rpc error: code = NotFound desc = could not find container \"0b6a122534975c4cb372789f76d3740b168b2c8ff368438578c2a105fb75f154\": container with ID starting with 0b6a122534975c4cb372789f76d3740b168b2c8ff368438578c2a105fb75f154 not found: ID does not exist"
Oct 31 17:43:11.836886 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:11.836803    5003 scope.go:122] "RemoveContainer" containerID="20685a362fdc25a06eac9a749dd142b9951c288dd4f246a73b3820116c4602c2"
Oct 31 17:43:11.847411 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:11.847393    5003 scope.go:122] "RemoveContainer" containerID="aceeb7197d496482a276549fd86c94a288836d57009bb94a2513cd606ffd8419"
Oct 31 17:43:11.860470 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:11.860440    5003 scope.go:122] "RemoveContainer" containerID="20685a362fdc25a06eac9a749dd142b9951c288dd4f246a73b3820116c4602c2"
Oct 31 17:43:11.860855 ip-10-0-138-17 kubenswrapper[5003]: E1031 17:43:11.860830    5003 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"20685a362fdc25a06eac9a749dd142b9951c288dd4f246a73b3820116c4602c2\": container with ID starting with 20685a362fdc25a06eac9a749dd142b9951c288dd4f246a73b3820116c4602c2 not found: ID does not exist" containerID="20685a362fdc25a06eac9a749dd142b9951c288dd4f246a73b3820116c4602c2"
Oct 31 17:43:11.860936 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:11.860866    5003 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"20685a362fdc25a06eac9a749dd142b9951c288dd4f246a73b3820116c4602c2"} err="failed to get container status \"20685a362fdc25a06eac9a749dd142b9951c288dd4f246a73b3820116c4602c2\": rpc error: code = NotFound desc = could not find container \"20685a362fdc25a06eac9a749dd142b9951c288dd4f246a73b3820116c4602c2\": container with ID starting with 20685a362fdc25a06eac9a749dd142b9951c288dd4f246a73b3820116c4602c2 not found: ID does not exist"
Oct 31 17:43:11.860936 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:11.860892    5003 scope.go:122] "RemoveContainer" containerID="aceeb7197d496482a276549fd86c94a288836d57009bb94a2513cd606ffd8419"
Oct 31 17:43:11.861063 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:11.860978    5003 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b0a16d54-5d2c-4c23-bf11-9cfe1844b568-workload-certs\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:43:11.861063 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:11.860995    5003 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0711a80f-6f89-4949-aef2-a3281e637712-istiod-ca-cert\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:43:11.861063 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:11.861006    5003 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4482b94f-d7f9-4575-b22e-765dfd4ad693-istio-podinfo\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:43:11.861063 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:11.861015    5003 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0711a80f-6f89-4949-aef2-a3281e637712-istio-token\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:43:11.861063 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:11.861023    5003 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jrj2f\" (UniqueName: \"kubernetes.io/projected/4482b94f-d7f9-4575-b22e-765dfd4ad693-kube-api-access-jrj2f\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:43:11.861063 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:11.861038    5003 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b0a16d54-5d2c-4c23-bf11-9cfe1844b568-credential-socket\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:43:11.861063 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:11.861052    5003 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4482b94f-d7f9-4575-b22e-765dfd4ad693-istio-envoy\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:43:11.861063 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:11.861065    5003 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b0a16d54-5d2c-4c23-bf11-9cfe1844b568-istio-data\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:43:11.861341 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:11.861078    5003 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jrz65\" (UniqueName: \"kubernetes.io/projected/b0a16d54-5d2c-4c23-bf11-9cfe1844b568-kube-api-access-jrz65\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:43:11.861341 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:11.861093    5003 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4482b94f-d7f9-4575-b22e-765dfd4ad693-istio-token\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:43:11.861341 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:11.861105    5003 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b0a16d54-5d2c-4c23-bf11-9cfe1844b568-istio-podinfo\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:43:11.861341 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:11.861113    5003 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rjcgn\" (UniqueName: \"kubernetes.io/projected/0711a80f-6f89-4949-aef2-a3281e637712-kube-api-access-rjcgn\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:43:11.861341 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:11.861121    5003 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0711a80f-6f89-4949-aef2-a3281e637712-istio-podinfo\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:43:11.861341 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:11.861131    5003 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b0a16d54-5d2c-4c23-bf11-9cfe1844b568-istio-envoy\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:43:11.861341 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:11.861143    5003 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b0a16d54-5d2c-4c23-bf11-9cfe1844b568-istio-token\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:43:11.861341 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:11.861155    5003 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0711a80f-6f89-4949-aef2-a3281e637712-workload-socket\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:43:11.861341 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:11.861167    5003 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4482b94f-d7f9-4575-b22e-765dfd4ad693-workload-certs\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:43:11.861341 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:11.861181    5003 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0711a80f-6f89-4949-aef2-a3281e637712-credential-socket\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:43:11.861341 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:11.861194    5003 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0711a80f-6f89-4949-aef2-a3281e637712-workload-certs\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:43:11.861341 ip-10-0-138-17 kubenswrapper[5003]: E1031 17:43:11.861199    5003 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"aceeb7197d496482a276549fd86c94a288836d57009bb94a2513cd606ffd8419\": container with ID starting with aceeb7197d496482a276549fd86c94a288836d57009bb94a2513cd606ffd8419 not found: ID does not exist" containerID="aceeb7197d496482a276549fd86c94a288836d57009bb94a2513cd606ffd8419"
Oct 31 17:43:11.861341 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:11.861224    5003 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aceeb7197d496482a276549fd86c94a288836d57009bb94a2513cd606ffd8419"} err="failed to get container status \"aceeb7197d496482a276549fd86c94a288836d57009bb94a2513cd606ffd8419\": rpc error: code = NotFound desc = could not find container \"aceeb7197d496482a276549fd86c94a288836d57009bb94a2513cd606ffd8419\": container with ID starting with aceeb7197d496482a276549fd86c94a288836d57009bb94a2513cd606ffd8419 not found: ID does not exist"
Oct 31 17:43:11.861341 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:11.861207    5003 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0711a80f-6f89-4949-aef2-a3281e637712-istio-data\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:43:11.861341 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:11.861250    5003 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b0a16d54-5d2c-4c23-bf11-9cfe1844b568-workload-socket\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:43:11.861341 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:11.861259    5003 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0711a80f-6f89-4949-aef2-a3281e637712-istio-envoy\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:43:11.903204 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:11.903174    5003 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w5-b78c31-openshift-default-774cb4f6c9-dr2b8"]
Oct 31 17:43:11.909121 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:11.909093    5003 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w5-b78c31-openshift-default-774cb4f6c9-dr2b8"]
Oct 31 17:43:11.944847 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:11.944816    5003 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w5-b78c31-openshift-default-774cb4f6c9-nhqll"]
Oct 31 17:43:11.951147 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:11.951120    5003 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w5-b78c31-openshift-default-774cb4f6c9-nhqll"]
Oct 31 17:43:11.980013 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:11.979979    5003 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w5-b78c31-openshift-default-774cb4f6c9-p7lp5"]
Oct 31 17:43:11.985150 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:11.985122    5003 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w5-b78c31-openshift-default-774cb4f6c9-p7lp5"]
Oct 31 17:43:12.182018 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:12.181986    5003 patch_prober.go:29] interesting pod/e2e-worker-w4-1c0bfd-openshift-default-f7f657c57-hp2wj container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Oct 31 17:43:12.182133 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:12.182066    5003 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w4-1c0bfd-openshift-default-f7f657c57-hp2wj" podUID="679da5c1-9c28-4f80-a210-185350147f11" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 31 17:43:12.528487 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:12.528446    5003 patch_prober.go:29] interesting pod/e2e-worker-w0-ee816e-openshift-default-c4db85b5c-j7pfz container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Oct 31 17:43:12.528717 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:12.528511    5003 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w0-ee816e-openshift-default-c4db85b5c-j7pfz" podUID="6c7cacb3-7045-4e9d-a2d6-9fabaa50af3d" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 31 17:43:12.644948 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:12.643767    5003 patch_prober.go:29] interesting pod/e2e-worker-w0-ee816e-openshift-default-c4db85b5c-dz8kv container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Oct 31 17:43:12.644948 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:12.643853    5003 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w0-ee816e-openshift-default-c4db85b5c-dz8kv" podUID="6dbed28d-b3b9-4af1-82b7-40151ba418c1" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 31 17:43:13.410727 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:13.410683    5003 patch_prober.go:29] interesting pod/e2e-worker-w6-d80080-openshift-default-956cddf57-x6xxp container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Oct 31 17:43:13.411092 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:13.410752    5003 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w6-d80080-openshift-default-956cddf57-x6xxp" podUID="5f2c9613-4b8a-4452-b70a-2ed258063318" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 31 17:43:13.634124 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:13.634082    5003 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-1c0bfd-openshift-default-f7f657c57-wxm7h"
Oct 31 17:43:13.684429 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:13.684398    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/92a031e7-6d59-4493-b15d-7dc213289f55-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/92a031e7-6d59-4493-b15d-7dc213289f55-istio-data\") pod \"92a031e7-6d59-4493-b15d-7dc213289f55\" (UID: \"92a031e7-6d59-4493-b15d-7dc213289f55\") "
Oct 31 17:43:13.684787 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:13.684453    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/92a031e7-6d59-4493-b15d-7dc213289f55-kube-api-access-lzs42\" (UniqueName: \"kubernetes.io/projected/92a031e7-6d59-4493-b15d-7dc213289f55-kube-api-access-lzs42\") pod \"92a031e7-6d59-4493-b15d-7dc213289f55\" (UID: \"92a031e7-6d59-4493-b15d-7dc213289f55\") "
Oct 31 17:43:13.684787 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:13.684502    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/92a031e7-6d59-4493-b15d-7dc213289f55-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/92a031e7-6d59-4493-b15d-7dc213289f55-istio-podinfo\") pod \"92a031e7-6d59-4493-b15d-7dc213289f55\" (UID: \"92a031e7-6d59-4493-b15d-7dc213289f55\") "
Oct 31 17:43:13.684787 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:13.684571    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/92a031e7-6d59-4493-b15d-7dc213289f55-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/92a031e7-6d59-4493-b15d-7dc213289f55-credential-socket\") pod \"92a031e7-6d59-4493-b15d-7dc213289f55\" (UID: \"92a031e7-6d59-4493-b15d-7dc213289f55\") "
Oct 31 17:43:13.684787 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:13.684678    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/92a031e7-6d59-4493-b15d-7dc213289f55-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/92a031e7-6d59-4493-b15d-7dc213289f55-workload-certs\") pod \"92a031e7-6d59-4493-b15d-7dc213289f55\" (UID: \"92a031e7-6d59-4493-b15d-7dc213289f55\") "
Oct 31 17:43:13.684787 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:13.684723    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/92a031e7-6d59-4493-b15d-7dc213289f55-istio-token\" (UniqueName: \"kubernetes.io/projected/92a031e7-6d59-4493-b15d-7dc213289f55-istio-token\") pod \"92a031e7-6d59-4493-b15d-7dc213289f55\" (UID: \"92a031e7-6d59-4493-b15d-7dc213289f55\") "
Oct 31 17:43:13.684787 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:13.684749    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/92a031e7-6d59-4493-b15d-7dc213289f55-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/92a031e7-6d59-4493-b15d-7dc213289f55-istio-envoy\") pod \"92a031e7-6d59-4493-b15d-7dc213289f55\" (UID: \"92a031e7-6d59-4493-b15d-7dc213289f55\") "
Oct 31 17:43:13.684787 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:13.684765    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/92a031e7-6d59-4493-b15d-7dc213289f55-istio-data" pod "92a031e7-6d59-4493-b15d-7dc213289f55" (UID: "92a031e7-6d59-4493-b15d-7dc213289f55"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 17:43:13.684787 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:13.684788    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/92a031e7-6d59-4493-b15d-7dc213289f55-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/92a031e7-6d59-4493-b15d-7dc213289f55-istiod-ca-cert\") pod \"92a031e7-6d59-4493-b15d-7dc213289f55\" (UID: \"92a031e7-6d59-4493-b15d-7dc213289f55\") "
Oct 31 17:43:13.685681 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:13.684836    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/92a031e7-6d59-4493-b15d-7dc213289f55-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/92a031e7-6d59-4493-b15d-7dc213289f55-workload-socket\") pod \"92a031e7-6d59-4493-b15d-7dc213289f55\" (UID: \"92a031e7-6d59-4493-b15d-7dc213289f55\") "
Oct 31 17:43:13.685681 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:13.684978    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/92a031e7-6d59-4493-b15d-7dc213289f55-credential-socket" pod "92a031e7-6d59-4493-b15d-7dc213289f55" (UID: "92a031e7-6d59-4493-b15d-7dc213289f55"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 17:43:13.685681 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:13.685259    5003 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/92a031e7-6d59-4493-b15d-7dc213289f55-istio-data\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:43:13.685681 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:13.685280    5003 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/92a031e7-6d59-4493-b15d-7dc213289f55-credential-socket\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:43:13.686152 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:13.686003    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/92a031e7-6d59-4493-b15d-7dc213289f55-workload-socket" pod "92a031e7-6d59-4493-b15d-7dc213289f55" (UID: "92a031e7-6d59-4493-b15d-7dc213289f55"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 17:43:13.686152 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:13.686009    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/92a031e7-6d59-4493-b15d-7dc213289f55-istiod-ca-cert" pod "92a031e7-6d59-4493-b15d-7dc213289f55" (UID: "92a031e7-6d59-4493-b15d-7dc213289f55"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 17:43:13.686152 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:13.686071    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/92a031e7-6d59-4493-b15d-7dc213289f55-workload-certs" pod "92a031e7-6d59-4493-b15d-7dc213289f55" (UID: "92a031e7-6d59-4493-b15d-7dc213289f55"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 17:43:13.687965 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:13.687926    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/92a031e7-6d59-4493-b15d-7dc213289f55-kube-api-access-lzs42" pod "92a031e7-6d59-4493-b15d-7dc213289f55" (UID: "92a031e7-6d59-4493-b15d-7dc213289f55"). InnerVolumeSpecName "kube-api-access-lzs42". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 17:43:13.688599 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:13.688460    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/92a031e7-6d59-4493-b15d-7dc213289f55-istio-token" pod "92a031e7-6d59-4493-b15d-7dc213289f55" (UID: "92a031e7-6d59-4493-b15d-7dc213289f55"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 17:43:13.688831 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:13.688808    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/92a031e7-6d59-4493-b15d-7dc213289f55-istio-envoy" pod "92a031e7-6d59-4493-b15d-7dc213289f55" (UID: "92a031e7-6d59-4493-b15d-7dc213289f55"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 17:43:13.689850 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:13.689826    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/92a031e7-6d59-4493-b15d-7dc213289f55-istio-podinfo" pod "92a031e7-6d59-4493-b15d-7dc213289f55" (UID: "92a031e7-6d59-4493-b15d-7dc213289f55"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 31 17:43:13.691136 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:13.691119    5003 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-1c0bfd-openshift-default-f7f657c57-prvbp"
Oct 31 17:43:13.786736 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:13.786692    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8a6f3fb4-846a-43aa-9309-48c6ca558850-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8a6f3fb4-846a-43aa-9309-48c6ca558850-credential-socket\") pod \"8a6f3fb4-846a-43aa-9309-48c6ca558850\" (UID: \"8a6f3fb4-846a-43aa-9309-48c6ca558850\") "
Oct 31 17:43:13.786926 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:13.786766    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/8a6f3fb4-846a-43aa-9309-48c6ca558850-istio-token\" (UniqueName: \"kubernetes.io/projected/8a6f3fb4-846a-43aa-9309-48c6ca558850-istio-token\") pod \"8a6f3fb4-846a-43aa-9309-48c6ca558850\" (UID: \"8a6f3fb4-846a-43aa-9309-48c6ca558850\") "
Oct 31 17:43:13.786926 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:13.786809    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8a6f3fb4-846a-43aa-9309-48c6ca558850-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8a6f3fb4-846a-43aa-9309-48c6ca558850-workload-socket\") pod \"8a6f3fb4-846a-43aa-9309-48c6ca558850\" (UID: \"8a6f3fb4-846a-43aa-9309-48c6ca558850\") "
Oct 31 17:43:13.787037 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:13.786945    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8a6f3fb4-846a-43aa-9309-48c6ca558850-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8a6f3fb4-846a-43aa-9309-48c6ca558850-workload-certs\") pod \"8a6f3fb4-846a-43aa-9309-48c6ca558850\" (UID: \"8a6f3fb4-846a-43aa-9309-48c6ca558850\") "
Oct 31 17:43:13.787037 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:13.786989    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8a6f3fb4-846a-43aa-9309-48c6ca558850-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8a6f3fb4-846a-43aa-9309-48c6ca558850-istio-envoy\") pod \"8a6f3fb4-846a-43aa-9309-48c6ca558850\" (UID: \"8a6f3fb4-846a-43aa-9309-48c6ca558850\") "
Oct 31 17:43:13.787037 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:13.786993    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8a6f3fb4-846a-43aa-9309-48c6ca558850-credential-socket" pod "8a6f3fb4-846a-43aa-9309-48c6ca558850" (UID: "8a6f3fb4-846a-43aa-9309-48c6ca558850"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 17:43:13.787037 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:13.787021    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8a6f3fb4-846a-43aa-9309-48c6ca558850-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8a6f3fb4-846a-43aa-9309-48c6ca558850-istio-data\") pod \"8a6f3fb4-846a-43aa-9309-48c6ca558850\" (UID: \"8a6f3fb4-846a-43aa-9309-48c6ca558850\") "
Oct 31 17:43:13.787239 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:13.787110    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/8a6f3fb4-846a-43aa-9309-48c6ca558850-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8a6f3fb4-846a-43aa-9309-48c6ca558850-istio-podinfo\") pod \"8a6f3fb4-846a-43aa-9309-48c6ca558850\" (UID: \"8a6f3fb4-846a-43aa-9309-48c6ca558850\") "
Oct 31 17:43:13.787239 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:13.787149    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/8a6f3fb4-846a-43aa-9309-48c6ca558850-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8a6f3fb4-846a-43aa-9309-48c6ca558850-istiod-ca-cert\") pod \"8a6f3fb4-846a-43aa-9309-48c6ca558850\" (UID: \"8a6f3fb4-846a-43aa-9309-48c6ca558850\") "
Oct 31 17:43:13.787239 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:13.787185    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8a6f3fb4-846a-43aa-9309-48c6ca558850-workload-socket" pod "8a6f3fb4-846a-43aa-9309-48c6ca558850" (UID: "8a6f3fb4-846a-43aa-9309-48c6ca558850"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 17:43:13.787239 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:13.787201    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/8a6f3fb4-846a-43aa-9309-48c6ca558850-kube-api-access-h2zm2\" (UniqueName: \"kubernetes.io/projected/8a6f3fb4-846a-43aa-9309-48c6ca558850-kube-api-access-h2zm2\") pod \"8a6f3fb4-846a-43aa-9309-48c6ca558850\" (UID: \"8a6f3fb4-846a-43aa-9309-48c6ca558850\") "
Oct 31 17:43:13.787419 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:13.787217    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8a6f3fb4-846a-43aa-9309-48c6ca558850-workload-certs" pod "8a6f3fb4-846a-43aa-9309-48c6ca558850" (UID: "8a6f3fb4-846a-43aa-9309-48c6ca558850"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 17:43:13.787419 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:13.787265    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8a6f3fb4-846a-43aa-9309-48c6ca558850-istio-data" pod "8a6f3fb4-846a-43aa-9309-48c6ca558850" (UID: "8a6f3fb4-846a-43aa-9309-48c6ca558850"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 17:43:13.787586 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:13.787561    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8a6f3fb4-846a-43aa-9309-48c6ca558850-istiod-ca-cert" pod "8a6f3fb4-846a-43aa-9309-48c6ca558850" (UID: "8a6f3fb4-846a-43aa-9309-48c6ca558850"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 17:43:13.787738 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:13.787722    5003 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/92a031e7-6d59-4493-b15d-7dc213289f55-workload-certs\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:43:13.787802 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:13.787739    5003 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/92a031e7-6d59-4493-b15d-7dc213289f55-istio-token\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:43:13.787802 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:13.787748    5003 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/92a031e7-6d59-4493-b15d-7dc213289f55-istio-envoy\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:43:13.787802 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:13.787759    5003 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/92a031e7-6d59-4493-b15d-7dc213289f55-istiod-ca-cert\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:43:13.787802 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:13.787771    5003 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8a6f3fb4-846a-43aa-9309-48c6ca558850-workload-certs\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:43:13.787802 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:13.787783    5003 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/92a031e7-6d59-4493-b15d-7dc213289f55-workload-socket\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:43:13.787802 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:13.787793    5003 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8a6f3fb4-846a-43aa-9309-48c6ca558850-istio-data\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:43:13.787802 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:13.787801    5003 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8a6f3fb4-846a-43aa-9309-48c6ca558850-istiod-ca-cert\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:43:13.788028 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:13.787809    5003 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lzs42\" (UniqueName: \"kubernetes.io/projected/92a031e7-6d59-4493-b15d-7dc213289f55-kube-api-access-lzs42\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:43:13.788028 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:13.787818    5003 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/92a031e7-6d59-4493-b15d-7dc213289f55-istio-podinfo\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:43:13.788028 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:13.787828    5003 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8a6f3fb4-846a-43aa-9309-48c6ca558850-credential-socket\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:43:13.788028 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:13.787840    5003 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8a6f3fb4-846a-43aa-9309-48c6ca558850-workload-socket\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:43:13.789625 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:13.789596    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8a6f3fb4-846a-43aa-9309-48c6ca558850-istio-token" pod "8a6f3fb4-846a-43aa-9309-48c6ca558850" (UID: "8a6f3fb4-846a-43aa-9309-48c6ca558850"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 17:43:13.789625 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:13.789611    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8a6f3fb4-846a-43aa-9309-48c6ca558850-istio-envoy" pod "8a6f3fb4-846a-43aa-9309-48c6ca558850" (UID: "8a6f3fb4-846a-43aa-9309-48c6ca558850"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 17:43:13.789625 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:13.789606    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8a6f3fb4-846a-43aa-9309-48c6ca558850-kube-api-access-h2zm2" pod "8a6f3fb4-846a-43aa-9309-48c6ca558850" (UID: "8a6f3fb4-846a-43aa-9309-48c6ca558850"). InnerVolumeSpecName "kube-api-access-h2zm2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 17:43:13.789799 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:13.789682    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/8a6f3fb4-846a-43aa-9309-48c6ca558850-istio-podinfo" pod "8a6f3fb4-846a-43aa-9309-48c6ca558850" (UID: "8a6f3fb4-846a-43aa-9309-48c6ca558850"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 31 17:43:13.852456 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:13.852413    5003 generic.go:356] "Generic (PLEG): container finished" podID="8a6f3fb4-846a-43aa-9309-48c6ca558850" containerID="09984cd9197e55863d415a0834b373a76536d8140f35ed93946cc3db69846837" exitCode=0
Oct 31 17:43:13.852628 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:13.852486    5003 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-1c0bfd-openshift-default-f7f657c57-prvbp"
Oct 31 17:43:13.852628 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:13.852575    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-1c0bfd-openshift-default-f7f657c57-prvbp" event={"ID":"8a6f3fb4-846a-43aa-9309-48c6ca558850","Type":"ContainerDied","Data":"09984cd9197e55863d415a0834b373a76536d8140f35ed93946cc3db69846837"}
Oct 31 17:43:13.852777 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:13.852662    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-1c0bfd-openshift-default-f7f657c57-prvbp" event={"ID":"8a6f3fb4-846a-43aa-9309-48c6ca558850","Type":"ContainerDied","Data":"c69f84c4e9bb442b5259f1fd32ce5cc388ef48e199e46b353b01070caf9a6fce"}
Oct 31 17:43:13.852777 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:13.852691    5003 scope.go:122] "RemoveContainer" containerID="09984cd9197e55863d415a0834b373a76536d8140f35ed93946cc3db69846837"
Oct 31 17:43:13.855570 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:13.855536    5003 generic.go:356] "Generic (PLEG): container finished" podID="679da5c1-9c28-4f80-a210-185350147f11" containerID="ed209a24e1203b5578ab5fddc515a3543dedaa851d14aa9fed738fe591800a6f" exitCode=0
Oct 31 17:43:13.855715 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:13.855690    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-1c0bfd-openshift-default-f7f657c57-hp2wj" event={"ID":"679da5c1-9c28-4f80-a210-185350147f11","Type":"ContainerDied","Data":"ed209a24e1203b5578ab5fddc515a3543dedaa851d14aa9fed738fe591800a6f"}
Oct 31 17:43:13.857370 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:13.857340    5003 generic.go:356] "Generic (PLEG): container finished" podID="92a031e7-6d59-4493-b15d-7dc213289f55" containerID="93e4421d727b7815d166afafabc67fa9fb7bb501d3b58c093af850d439339a81" exitCode=0
Oct 31 17:43:13.857507 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:13.857490    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-1c0bfd-openshift-default-f7f657c57-wxm7h" event={"ID":"92a031e7-6d59-4493-b15d-7dc213289f55","Type":"ContainerDied","Data":"93e4421d727b7815d166afafabc67fa9fb7bb501d3b58c093af850d439339a81"}
Oct 31 17:43:13.857573 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:13.857536    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-1c0bfd-openshift-default-f7f657c57-wxm7h" event={"ID":"92a031e7-6d59-4493-b15d-7dc213289f55","Type":"ContainerDied","Data":"0d8ed850f673b9785193c572a462913331d9f0244aaaf9d265a828037f0265cd"}
Oct 31 17:43:13.857683 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:13.857626    5003 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-1c0bfd-openshift-default-f7f657c57-wxm7h"
Oct 31 17:43:13.874422 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:13.874275    5003 scope.go:122] "RemoveContainer" containerID="09984cd9197e55863d415a0834b373a76536d8140f35ed93946cc3db69846837"
Oct 31 17:43:13.874791 ip-10-0-138-17 kubenswrapper[5003]: E1031 17:43:13.874764    5003 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"09984cd9197e55863d415a0834b373a76536d8140f35ed93946cc3db69846837\": container with ID starting with 09984cd9197e55863d415a0834b373a76536d8140f35ed93946cc3db69846837 not found: ID does not exist" containerID="09984cd9197e55863d415a0834b373a76536d8140f35ed93946cc3db69846837"
Oct 31 17:43:13.874894 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:13.874798    5003 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"09984cd9197e55863d415a0834b373a76536d8140f35ed93946cc3db69846837"} err="failed to get container status \"09984cd9197e55863d415a0834b373a76536d8140f35ed93946cc3db69846837\": rpc error: code = NotFound desc = could not find container \"09984cd9197e55863d415a0834b373a76536d8140f35ed93946cc3db69846837\": container with ID starting with 09984cd9197e55863d415a0834b373a76536d8140f35ed93946cc3db69846837 not found: ID does not exist"
Oct 31 17:43:13.874894 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:13.874823    5003 scope.go:122] "RemoveContainer" containerID="93e4421d727b7815d166afafabc67fa9fb7bb501d3b58c093af850d439339a81"
Oct 31 17:43:13.891461 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:13.891435    5003 scope.go:122] "RemoveContainer" containerID="93e4421d727b7815d166afafabc67fa9fb7bb501d3b58c093af850d439339a81"
Oct 31 17:43:13.892339 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:13.892318    5003 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8a6f3fb4-846a-43aa-9309-48c6ca558850-istio-envoy\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:43:13.892445 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:13.892346    5003 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8a6f3fb4-846a-43aa-9309-48c6ca558850-istio-podinfo\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:43:13.892445 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:13.892361    5003 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h2zm2\" (UniqueName: \"kubernetes.io/projected/8a6f3fb4-846a-43aa-9309-48c6ca558850-kube-api-access-h2zm2\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:43:13.892445 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:13.892376    5003 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8a6f3fb4-846a-43aa-9309-48c6ca558850-istio-token\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:43:13.893869 ip-10-0-138-17 kubenswrapper[5003]: E1031 17:43:13.893824    5003 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"93e4421d727b7815d166afafabc67fa9fb7bb501d3b58c093af850d439339a81\": container with ID starting with 93e4421d727b7815d166afafabc67fa9fb7bb501d3b58c093af850d439339a81 not found: ID does not exist" containerID="93e4421d727b7815d166afafabc67fa9fb7bb501d3b58c093af850d439339a81"
Oct 31 17:43:13.893976 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:13.893872    5003 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"93e4421d727b7815d166afafabc67fa9fb7bb501d3b58c093af850d439339a81"} err="failed to get container status \"93e4421d727b7815d166afafabc67fa9fb7bb501d3b58c093af850d439339a81\": rpc error: code = NotFound desc = could not find container \"93e4421d727b7815d166afafabc67fa9fb7bb501d3b58c093af850d439339a81\": container with ID starting with 93e4421d727b7815d166afafabc67fa9fb7bb501d3b58c093af850d439339a81 not found: ID does not exist"
Oct 31 17:43:13.896277 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:13.896250    5003 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="0711a80f-6f89-4949-aef2-a3281e637712" path="/var/lib/kubelet/pods/0711a80f-6f89-4949-aef2-a3281e637712/volumes"
Oct 31 17:43:13.896841 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:13.896822    5003 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="4482b94f-d7f9-4575-b22e-765dfd4ad693" path="/var/lib/kubelet/pods/4482b94f-d7f9-4575-b22e-765dfd4ad693/volumes"
Oct 31 17:43:13.897373 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:13.897356    5003 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="b0a16d54-5d2c-4c23-bf11-9cfe1844b568" path="/var/lib/kubelet/pods/b0a16d54-5d2c-4c23-bf11-9cfe1844b568/volumes"
Oct 31 17:43:13.910667 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:13.910630    5003 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-1c0bfd-openshift-default-f7f657c57-prvbp"]
Oct 31 17:43:13.918637 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:13.918581    5003 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w4-1c0bfd-openshift-default-f7f657c57-prvbp"]
Oct 31 17:43:13.965530 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:13.965498    5003 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-1c0bfd-openshift-default-f7f657c57-wxm7h"]
Oct 31 17:43:13.972572 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:13.972542    5003 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w4-1c0bfd-openshift-default-f7f657c57-wxm7h"]
Oct 31 17:43:14.067926 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:14.067898    5003 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-1c0bfd-openshift-default-f7f657c57-hp2wj"
Oct 31 17:43:14.194840 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:14.194805    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/679da5c1-9c28-4f80-a210-185350147f11-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/679da5c1-9c28-4f80-a210-185350147f11-workload-certs\") pod \"679da5c1-9c28-4f80-a210-185350147f11\" (UID: \"679da5c1-9c28-4f80-a210-185350147f11\") "
Oct 31 17:43:14.195028 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:14.194868    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/679da5c1-9c28-4f80-a210-185350147f11-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/679da5c1-9c28-4f80-a210-185350147f11-istiod-ca-cert\") pod \"679da5c1-9c28-4f80-a210-185350147f11\" (UID: \"679da5c1-9c28-4f80-a210-185350147f11\") "
Oct 31 17:43:14.195105 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:14.195025    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/679da5c1-9c28-4f80-a210-185350147f11-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/679da5c1-9c28-4f80-a210-185350147f11-istio-data\") pod \"679da5c1-9c28-4f80-a210-185350147f11\" (UID: \"679da5c1-9c28-4f80-a210-185350147f11\") "
Oct 31 17:43:14.195105 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:14.195082    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/679da5c1-9c28-4f80-a210-185350147f11-kube-api-access-s4pgj\" (UniqueName: \"kubernetes.io/projected/679da5c1-9c28-4f80-a210-185350147f11-kube-api-access-s4pgj\") pod \"679da5c1-9c28-4f80-a210-185350147f11\" (UID: \"679da5c1-9c28-4f80-a210-185350147f11\") "
Oct 31 17:43:14.195213 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:14.195103    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/679da5c1-9c28-4f80-a210-185350147f11-workload-certs" pod "679da5c1-9c28-4f80-a210-185350147f11" (UID: "679da5c1-9c28-4f80-a210-185350147f11"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 17:43:14.195213 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:14.195149    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/679da5c1-9c28-4f80-a210-185350147f11-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/679da5c1-9c28-4f80-a210-185350147f11-istio-podinfo\") pod \"679da5c1-9c28-4f80-a210-185350147f11\" (UID: \"679da5c1-9c28-4f80-a210-185350147f11\") "
Oct 31 17:43:14.195213 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:14.195202    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/679da5c1-9c28-4f80-a210-185350147f11-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/679da5c1-9c28-4f80-a210-185350147f11-credential-socket\") pod \"679da5c1-9c28-4f80-a210-185350147f11\" (UID: \"679da5c1-9c28-4f80-a210-185350147f11\") "
Oct 31 17:43:14.195457 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:14.195238    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/679da5c1-9c28-4f80-a210-185350147f11-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/679da5c1-9c28-4f80-a210-185350147f11-workload-socket\") pod \"679da5c1-9c28-4f80-a210-185350147f11\" (UID: \"679da5c1-9c28-4f80-a210-185350147f11\") "
Oct 31 17:43:14.195457 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:14.195295    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/679da5c1-9c28-4f80-a210-185350147f11-istio-token\" (UniqueName: \"kubernetes.io/projected/679da5c1-9c28-4f80-a210-185350147f11-istio-token\") pod \"679da5c1-9c28-4f80-a210-185350147f11\" (UID: \"679da5c1-9c28-4f80-a210-185350147f11\") "
Oct 31 17:43:14.195457 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:14.195297    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/679da5c1-9c28-4f80-a210-185350147f11-istio-data" pod "679da5c1-9c28-4f80-a210-185350147f11" (UID: "679da5c1-9c28-4f80-a210-185350147f11"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 17:43:14.195457 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:14.195328    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/679da5c1-9c28-4f80-a210-185350147f11-istiod-ca-cert" pod "679da5c1-9c28-4f80-a210-185350147f11" (UID: "679da5c1-9c28-4f80-a210-185350147f11"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 17:43:14.195457 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:14.195341    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/679da5c1-9c28-4f80-a210-185350147f11-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/679da5c1-9c28-4f80-a210-185350147f11-istio-envoy\") pod \"679da5c1-9c28-4f80-a210-185350147f11\" (UID: \"679da5c1-9c28-4f80-a210-185350147f11\") "
Oct 31 17:43:14.195933 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:14.195491    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/679da5c1-9c28-4f80-a210-185350147f11-credential-socket" pod "679da5c1-9c28-4f80-a210-185350147f11" (UID: "679da5c1-9c28-4f80-a210-185350147f11"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 17:43:14.196083 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:14.195961    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/679da5c1-9c28-4f80-a210-185350147f11-workload-socket" pod "679da5c1-9c28-4f80-a210-185350147f11" (UID: "679da5c1-9c28-4f80-a210-185350147f11"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 17:43:14.196270 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:14.196248    5003 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/679da5c1-9c28-4f80-a210-185350147f11-workload-certs\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:43:14.196381 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:14.196273    5003 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/679da5c1-9c28-4f80-a210-185350147f11-istiod-ca-cert\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:43:14.196381 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:14.196285    5003 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/679da5c1-9c28-4f80-a210-185350147f11-istio-data\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:43:14.196381 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:14.196294    5003 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/679da5c1-9c28-4f80-a210-185350147f11-credential-socket\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:43:14.197808 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:14.197782    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/679da5c1-9c28-4f80-a210-185350147f11-istio-envoy" pod "679da5c1-9c28-4f80-a210-185350147f11" (UID: "679da5c1-9c28-4f80-a210-185350147f11"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 17:43:14.198019 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:14.197996    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/679da5c1-9c28-4f80-a210-185350147f11-istio-podinfo" pod "679da5c1-9c28-4f80-a210-185350147f11" (UID: "679da5c1-9c28-4f80-a210-185350147f11"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 31 17:43:14.198108 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:14.198039    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/679da5c1-9c28-4f80-a210-185350147f11-kube-api-access-s4pgj" pod "679da5c1-9c28-4f80-a210-185350147f11" (UID: "679da5c1-9c28-4f80-a210-185350147f11"). InnerVolumeSpecName "kube-api-access-s4pgj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 17:43:14.198150 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:14.198120    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/679da5c1-9c28-4f80-a210-185350147f11-istio-token" pod "679da5c1-9c28-4f80-a210-185350147f11" (UID: "679da5c1-9c28-4f80-a210-185350147f11"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 17:43:14.297974 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:14.297929    5003 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s4pgj\" (UniqueName: \"kubernetes.io/projected/679da5c1-9c28-4f80-a210-185350147f11-kube-api-access-s4pgj\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:43:14.297974 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:14.297970    5003 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/679da5c1-9c28-4f80-a210-185350147f11-istio-podinfo\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:43:14.298163 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:14.297985    5003 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/679da5c1-9c28-4f80-a210-185350147f11-workload-socket\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:43:14.298163 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:14.297997    5003 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/679da5c1-9c28-4f80-a210-185350147f11-istio-token\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:43:14.298163 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:14.298011    5003 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/679da5c1-9c28-4f80-a210-185350147f11-istio-envoy\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:43:14.492412 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:14.492382    5003 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-ee816e-openshift-default-c4db85b5c-dz8kv"
Oct 31 17:43:14.601965 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:14.601934    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/6dbed28d-b3b9-4af1-82b7-40151ba418c1-istio-token\" (UniqueName: \"kubernetes.io/projected/6dbed28d-b3b9-4af1-82b7-40151ba418c1-istio-token\") pod \"6dbed28d-b3b9-4af1-82b7-40151ba418c1\" (UID: \"6dbed28d-b3b9-4af1-82b7-40151ba418c1\") "
Oct 31 17:43:14.602101 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:14.602032    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/6dbed28d-b3b9-4af1-82b7-40151ba418c1-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6dbed28d-b3b9-4af1-82b7-40151ba418c1-credential-socket\") pod \"6dbed28d-b3b9-4af1-82b7-40151ba418c1\" (UID: \"6dbed28d-b3b9-4af1-82b7-40151ba418c1\") "
Oct 31 17:43:14.602101 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:14.602080    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/6dbed28d-b3b9-4af1-82b7-40151ba418c1-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6dbed28d-b3b9-4af1-82b7-40151ba418c1-istiod-ca-cert\") pod \"6dbed28d-b3b9-4af1-82b7-40151ba418c1\" (UID: \"6dbed28d-b3b9-4af1-82b7-40151ba418c1\") "
Oct 31 17:43:14.602213 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:14.602123    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/6dbed28d-b3b9-4af1-82b7-40151ba418c1-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6dbed28d-b3b9-4af1-82b7-40151ba418c1-istio-data\") pod \"6dbed28d-b3b9-4af1-82b7-40151ba418c1\" (UID: \"6dbed28d-b3b9-4af1-82b7-40151ba418c1\") "
Oct 31 17:43:14.602213 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:14.602201    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/6dbed28d-b3b9-4af1-82b7-40151ba418c1-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6dbed28d-b3b9-4af1-82b7-40151ba418c1-workload-socket\") pod \"6dbed28d-b3b9-4af1-82b7-40151ba418c1\" (UID: \"6dbed28d-b3b9-4af1-82b7-40151ba418c1\") "
Oct 31 17:43:14.602319 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:14.602242    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/6dbed28d-b3b9-4af1-82b7-40151ba418c1-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6dbed28d-b3b9-4af1-82b7-40151ba418c1-istio-podinfo\") pod \"6dbed28d-b3b9-4af1-82b7-40151ba418c1\" (UID: \"6dbed28d-b3b9-4af1-82b7-40151ba418c1\") "
Oct 31 17:43:14.602319 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:14.602289    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/6dbed28d-b3b9-4af1-82b7-40151ba418c1-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6dbed28d-b3b9-4af1-82b7-40151ba418c1-workload-certs\") pod \"6dbed28d-b3b9-4af1-82b7-40151ba418c1\" (UID: \"6dbed28d-b3b9-4af1-82b7-40151ba418c1\") "
Oct 31 17:43:14.602426 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:14.602356    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/6dbed28d-b3b9-4af1-82b7-40151ba418c1-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6dbed28d-b3b9-4af1-82b7-40151ba418c1-istio-envoy\") pod \"6dbed28d-b3b9-4af1-82b7-40151ba418c1\" (UID: \"6dbed28d-b3b9-4af1-82b7-40151ba418c1\") "
Oct 31 17:43:14.602426 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:14.602404    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/6dbed28d-b3b9-4af1-82b7-40151ba418c1-kube-api-access-29wtw\" (UniqueName: \"kubernetes.io/projected/6dbed28d-b3b9-4af1-82b7-40151ba418c1-kube-api-access-29wtw\") pod \"6dbed28d-b3b9-4af1-82b7-40151ba418c1\" (UID: \"6dbed28d-b3b9-4af1-82b7-40151ba418c1\") "
Oct 31 17:43:14.602426 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:14.602382    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6dbed28d-b3b9-4af1-82b7-40151ba418c1-credential-socket" pod "6dbed28d-b3b9-4af1-82b7-40151ba418c1" (UID: "6dbed28d-b3b9-4af1-82b7-40151ba418c1"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 17:43:14.602589 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:14.602470    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6dbed28d-b3b9-4af1-82b7-40151ba418c1-workload-socket" pod "6dbed28d-b3b9-4af1-82b7-40151ba418c1" (UID: "6dbed28d-b3b9-4af1-82b7-40151ba418c1"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 17:43:14.602589 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:14.602535    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6dbed28d-b3b9-4af1-82b7-40151ba418c1-istiod-ca-cert" pod "6dbed28d-b3b9-4af1-82b7-40151ba418c1" (UID: "6dbed28d-b3b9-4af1-82b7-40151ba418c1"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 17:43:14.602720 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:14.602630    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6dbed28d-b3b9-4af1-82b7-40151ba418c1-workload-certs" pod "6dbed28d-b3b9-4af1-82b7-40151ba418c1" (UID: "6dbed28d-b3b9-4af1-82b7-40151ba418c1"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 17:43:14.602778 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:14.602748    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6dbed28d-b3b9-4af1-82b7-40151ba418c1-istio-data" pod "6dbed28d-b3b9-4af1-82b7-40151ba418c1" (UID: "6dbed28d-b3b9-4af1-82b7-40151ba418c1"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 17:43:14.602923 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:14.602900    5003 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6dbed28d-b3b9-4af1-82b7-40151ba418c1-credential-socket\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:43:14.602999 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:14.602929    5003 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6dbed28d-b3b9-4af1-82b7-40151ba418c1-istiod-ca-cert\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:43:14.602999 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:14.602943    5003 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6dbed28d-b3b9-4af1-82b7-40151ba418c1-istio-data\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:43:14.602999 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:14.602959    5003 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6dbed28d-b3b9-4af1-82b7-40151ba418c1-workload-socket\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:43:14.602999 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:14.602972    5003 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6dbed28d-b3b9-4af1-82b7-40151ba418c1-workload-certs\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:43:14.604315 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:14.604292    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6dbed28d-b3b9-4af1-82b7-40151ba418c1-istio-token" pod "6dbed28d-b3b9-4af1-82b7-40151ba418c1" (UID: "6dbed28d-b3b9-4af1-82b7-40151ba418c1"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 17:43:14.604597 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:14.604580    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/6dbed28d-b3b9-4af1-82b7-40151ba418c1-istio-podinfo" pod "6dbed28d-b3b9-4af1-82b7-40151ba418c1" (UID: "6dbed28d-b3b9-4af1-82b7-40151ba418c1"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 31 17:43:14.604929 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:14.604912    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6dbed28d-b3b9-4af1-82b7-40151ba418c1-kube-api-access-29wtw" pod "6dbed28d-b3b9-4af1-82b7-40151ba418c1" (UID: "6dbed28d-b3b9-4af1-82b7-40151ba418c1"). InnerVolumeSpecName "kube-api-access-29wtw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 17:43:14.604989 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:14.604923    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6dbed28d-b3b9-4af1-82b7-40151ba418c1-istio-envoy" pod "6dbed28d-b3b9-4af1-82b7-40151ba418c1" (UID: "6dbed28d-b3b9-4af1-82b7-40151ba418c1"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 17:43:14.611756 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:14.611728    5003 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-ee816e-openshift-default-c4db85b5c-7pwpp"
Oct 31 17:43:14.613990 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:14.613959    5003 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-ee816e-openshift-default-c4db85b5c-qm655"
Oct 31 17:43:14.619270 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:14.619234    5003 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-ee816e-openshift-default-c4db85b5c-j7pfz"
Oct 31 17:43:14.703702 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:14.703665    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a79988d8-d286-43ae-914b-bd1f6db3eb11-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a79988d8-d286-43ae-914b-bd1f6db3eb11-istio-envoy\") pod \"a79988d8-d286-43ae-914b-bd1f6db3eb11\" (UID: \"a79988d8-d286-43ae-914b-bd1f6db3eb11\") "
Oct 31 17:43:14.703702 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:14.703709    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d2652cf4-9d2a-480e-ad8a-946d0d4b90f3-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d2652cf4-9d2a-480e-ad8a-946d0d4b90f3-istio-envoy\") pod \"d2652cf4-9d2a-480e-ad8a-946d0d4b90f3\" (UID: \"d2652cf4-9d2a-480e-ad8a-946d0d4b90f3\") "
Oct 31 17:43:14.710171 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:14.703731    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/a79988d8-d286-43ae-914b-bd1f6db3eb11-istio-token\" (UniqueName: \"kubernetes.io/projected/a79988d8-d286-43ae-914b-bd1f6db3eb11-istio-token\") pod \"a79988d8-d286-43ae-914b-bd1f6db3eb11\" (UID: \"a79988d8-d286-43ae-914b-bd1f6db3eb11\") "
Oct 31 17:43:14.710171 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:14.703752    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/6c7cacb3-7045-4e9d-a2d6-9fabaa50af3d-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6c7cacb3-7045-4e9d-a2d6-9fabaa50af3d-credential-socket\") pod \"6c7cacb3-7045-4e9d-a2d6-9fabaa50af3d\" (UID: \"6c7cacb3-7045-4e9d-a2d6-9fabaa50af3d\") "
Oct 31 17:43:14.710171 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:14.703781    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/d2652cf4-9d2a-480e-ad8a-946d0d4b90f3-istio-token\" (UniqueName: \"kubernetes.io/projected/d2652cf4-9d2a-480e-ad8a-946d0d4b90f3-istio-token\") pod \"d2652cf4-9d2a-480e-ad8a-946d0d4b90f3\" (UID: \"d2652cf4-9d2a-480e-ad8a-946d0d4b90f3\") "
Oct 31 17:43:14.710171 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:14.703943    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/6c7cacb3-7045-4e9d-a2d6-9fabaa50af3d-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6c7cacb3-7045-4e9d-a2d6-9fabaa50af3d-workload-socket\") pod \"6c7cacb3-7045-4e9d-a2d6-9fabaa50af3d\" (UID: \"6c7cacb3-7045-4e9d-a2d6-9fabaa50af3d\") "
Oct 31 17:43:14.710171 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:14.704015    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/a79988d8-d286-43ae-914b-bd1f6db3eb11-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a79988d8-d286-43ae-914b-bd1f6db3eb11-istiod-ca-cert\") pod \"a79988d8-d286-43ae-914b-bd1f6db3eb11\" (UID: \"a79988d8-d286-43ae-914b-bd1f6db3eb11\") "
Oct 31 17:43:14.710171 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:14.704043    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a79988d8-d286-43ae-914b-bd1f6db3eb11-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a79988d8-d286-43ae-914b-bd1f6db3eb11-workload-certs\") pod \"a79988d8-d286-43ae-914b-bd1f6db3eb11\" (UID: \"a79988d8-d286-43ae-914b-bd1f6db3eb11\") "
Oct 31 17:43:14.710171 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:14.704081    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6c7cacb3-7045-4e9d-a2d6-9fabaa50af3d-credential-socket" pod "6c7cacb3-7045-4e9d-a2d6-9fabaa50af3d" (UID: "6c7cacb3-7045-4e9d-a2d6-9fabaa50af3d"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 17:43:14.710171 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:14.704089    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a79988d8-d286-43ae-914b-bd1f6db3eb11-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a79988d8-d286-43ae-914b-bd1f6db3eb11-workload-socket\") pod \"a79988d8-d286-43ae-914b-bd1f6db3eb11\" (UID: \"a79988d8-d286-43ae-914b-bd1f6db3eb11\") "
Oct 31 17:43:14.710171 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:14.704131    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/a79988d8-d286-43ae-914b-bd1f6db3eb11-kube-api-access-kb5cs\" (UniqueName: \"kubernetes.io/projected/a79988d8-d286-43ae-914b-bd1f6db3eb11-kube-api-access-kb5cs\") pod \"a79988d8-d286-43ae-914b-bd1f6db3eb11\" (UID: \"a79988d8-d286-43ae-914b-bd1f6db3eb11\") "
Oct 31 17:43:14.710171 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:14.704169    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/6c7cacb3-7045-4e9d-a2d6-9fabaa50af3d-kube-api-access-9d2bq\" (UniqueName: \"kubernetes.io/projected/6c7cacb3-7045-4e9d-a2d6-9fabaa50af3d-kube-api-access-9d2bq\") pod \"6c7cacb3-7045-4e9d-a2d6-9fabaa50af3d\" (UID: \"6c7cacb3-7045-4e9d-a2d6-9fabaa50af3d\") "
Oct 31 17:43:14.710171 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:14.704206    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/6c7cacb3-7045-4e9d-a2d6-9fabaa50af3d-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6c7cacb3-7045-4e9d-a2d6-9fabaa50af3d-workload-certs\") pod \"6c7cacb3-7045-4e9d-a2d6-9fabaa50af3d\" (UID: \"6c7cacb3-7045-4e9d-a2d6-9fabaa50af3d\") "
Oct 31 17:43:14.710171 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:14.704281    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a79988d8-d286-43ae-914b-bd1f6db3eb11-workload-socket" pod "a79988d8-d286-43ae-914b-bd1f6db3eb11" (UID: "a79988d8-d286-43ae-914b-bd1f6db3eb11"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 17:43:14.710171 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:14.704285    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d2652cf4-9d2a-480e-ad8a-946d0d4b90f3-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d2652cf4-9d2a-480e-ad8a-946d0d4b90f3-workload-certs\") pod \"d2652cf4-9d2a-480e-ad8a-946d0d4b90f3\" (UID: \"d2652cf4-9d2a-480e-ad8a-946d0d4b90f3\") "
Oct 31 17:43:14.710171 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:14.704383    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d2652cf4-9d2a-480e-ad8a-946d0d4b90f3-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d2652cf4-9d2a-480e-ad8a-946d0d4b90f3-credential-socket\") pod \"d2652cf4-9d2a-480e-ad8a-946d0d4b90f3\" (UID: \"d2652cf4-9d2a-480e-ad8a-946d0d4b90f3\") "
Oct 31 17:43:14.710171 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:14.704430    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/d2652cf4-9d2a-480e-ad8a-946d0d4b90f3-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d2652cf4-9d2a-480e-ad8a-946d0d4b90f3-istiod-ca-cert\") pod \"d2652cf4-9d2a-480e-ad8a-946d0d4b90f3\" (UID: \"d2652cf4-9d2a-480e-ad8a-946d0d4b90f3\") "
Oct 31 17:43:14.710171 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:14.704468    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/6c7cacb3-7045-4e9d-a2d6-9fabaa50af3d-istio-token\" (UniqueName: \"kubernetes.io/projected/6c7cacb3-7045-4e9d-a2d6-9fabaa50af3d-istio-token\") pod \"6c7cacb3-7045-4e9d-a2d6-9fabaa50af3d\" (UID: \"6c7cacb3-7045-4e9d-a2d6-9fabaa50af3d\") "
Oct 31 17:43:14.710171 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:14.704467    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a79988d8-d286-43ae-914b-bd1f6db3eb11-istiod-ca-cert" pod "a79988d8-d286-43ae-914b-bd1f6db3eb11" (UID: "a79988d8-d286-43ae-914b-bd1f6db3eb11"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 17:43:14.710171 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:14.704488    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d2652cf4-9d2a-480e-ad8a-946d0d4b90f3-workload-certs" pod "d2652cf4-9d2a-480e-ad8a-946d0d4b90f3" (UID: "d2652cf4-9d2a-480e-ad8a-946d0d4b90f3"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 17:43:14.710171 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:14.704502    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a79988d8-d286-43ae-914b-bd1f6db3eb11-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a79988d8-d286-43ae-914b-bd1f6db3eb11-credential-socket\") pod \"a79988d8-d286-43ae-914b-bd1f6db3eb11\" (UID: \"a79988d8-d286-43ae-914b-bd1f6db3eb11\") "
Oct 31 17:43:14.710171 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:14.704549    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/6c7cacb3-7045-4e9d-a2d6-9fabaa50af3d-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6c7cacb3-7045-4e9d-a2d6-9fabaa50af3d-istio-podinfo\") pod \"6c7cacb3-7045-4e9d-a2d6-9fabaa50af3d\" (UID: \"6c7cacb3-7045-4e9d-a2d6-9fabaa50af3d\") "
Oct 31 17:43:14.710171 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:14.704579    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/d2652cf4-9d2a-480e-ad8a-946d0d4b90f3-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d2652cf4-9d2a-480e-ad8a-946d0d4b90f3-istio-podinfo\") pod \"d2652cf4-9d2a-480e-ad8a-946d0d4b90f3\" (UID: \"d2652cf4-9d2a-480e-ad8a-946d0d4b90f3\") "
Oct 31 17:43:14.710171 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:14.704620    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a79988d8-d286-43ae-914b-bd1f6db3eb11-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a79988d8-d286-43ae-914b-bd1f6db3eb11-istio-data\") pod \"a79988d8-d286-43ae-914b-bd1f6db3eb11\" (UID: \"a79988d8-d286-43ae-914b-bd1f6db3eb11\") "
Oct 31 17:43:14.710171 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:14.704673    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/6c7cacb3-7045-4e9d-a2d6-9fabaa50af3d-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6c7cacb3-7045-4e9d-a2d6-9fabaa50af3d-istiod-ca-cert\") pod \"6c7cacb3-7045-4e9d-a2d6-9fabaa50af3d\" (UID: \"6c7cacb3-7045-4e9d-a2d6-9fabaa50af3d\") "
Oct 31 17:43:14.710171 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:14.704727    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d2652cf4-9d2a-480e-ad8a-946d0d4b90f3-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d2652cf4-9d2a-480e-ad8a-946d0d4b90f3-workload-socket\") pod \"d2652cf4-9d2a-480e-ad8a-946d0d4b90f3\" (UID: \"d2652cf4-9d2a-480e-ad8a-946d0d4b90f3\") "
Oct 31 17:43:14.710171 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:14.704757    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6c7cacb3-7045-4e9d-a2d6-9fabaa50af3d-workload-socket" pod "6c7cacb3-7045-4e9d-a2d6-9fabaa50af3d" (UID: "6c7cacb3-7045-4e9d-a2d6-9fabaa50af3d"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 17:43:14.710171 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:14.704791    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/d2652cf4-9d2a-480e-ad8a-946d0d4b90f3-kube-api-access-7jpb7\" (UniqueName: \"kubernetes.io/projected/d2652cf4-9d2a-480e-ad8a-946d0d4b90f3-kube-api-access-7jpb7\") pod \"d2652cf4-9d2a-480e-ad8a-946d0d4b90f3\" (UID: \"d2652cf4-9d2a-480e-ad8a-946d0d4b90f3\") "
Oct 31 17:43:14.710171 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:14.704845    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/6c7cacb3-7045-4e9d-a2d6-9fabaa50af3d-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6c7cacb3-7045-4e9d-a2d6-9fabaa50af3d-istio-envoy\") pod \"6c7cacb3-7045-4e9d-a2d6-9fabaa50af3d\" (UID: \"6c7cacb3-7045-4e9d-a2d6-9fabaa50af3d\") "
Oct 31 17:43:14.710171 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:14.704885    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/a79988d8-d286-43ae-914b-bd1f6db3eb11-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a79988d8-d286-43ae-914b-bd1f6db3eb11-istio-podinfo\") pod \"a79988d8-d286-43ae-914b-bd1f6db3eb11\" (UID: \"a79988d8-d286-43ae-914b-bd1f6db3eb11\") "
Oct 31 17:43:14.710171 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:14.704944    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d2652cf4-9d2a-480e-ad8a-946d0d4b90f3-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d2652cf4-9d2a-480e-ad8a-946d0d4b90f3-istio-data\") pod \"d2652cf4-9d2a-480e-ad8a-946d0d4b90f3\" (UID: \"d2652cf4-9d2a-480e-ad8a-946d0d4b90f3\") "
Oct 31 17:43:14.710171 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:14.704972    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/6c7cacb3-7045-4e9d-a2d6-9fabaa50af3d-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6c7cacb3-7045-4e9d-a2d6-9fabaa50af3d-istio-data\") pod \"6c7cacb3-7045-4e9d-a2d6-9fabaa50af3d\" (UID: \"6c7cacb3-7045-4e9d-a2d6-9fabaa50af3d\") "
Oct 31 17:43:14.710171 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:14.705320    5003 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6dbed28d-b3b9-4af1-82b7-40151ba418c1-istio-envoy\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:43:14.710171 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:14.705343    5003 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-29wtw\" (UniqueName: \"kubernetes.io/projected/6dbed28d-b3b9-4af1-82b7-40151ba418c1-kube-api-access-29wtw\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:43:14.710171 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:14.705359    5003 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6dbed28d-b3b9-4af1-82b7-40151ba418c1-istio-token\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:43:14.710171 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:14.705374    5003 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6c7cacb3-7045-4e9d-a2d6-9fabaa50af3d-credential-socket\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:43:14.710171 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:14.705388    5003 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6c7cacb3-7045-4e9d-a2d6-9fabaa50af3d-workload-socket\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:43:14.710171 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:14.705403    5003 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a79988d8-d286-43ae-914b-bd1f6db3eb11-istiod-ca-cert\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:43:14.710171 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:14.705417    5003 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6dbed28d-b3b9-4af1-82b7-40151ba418c1-istio-podinfo\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:43:14.710171 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:14.705431    5003 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a79988d8-d286-43ae-914b-bd1f6db3eb11-workload-socket\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:43:14.710171 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:14.705444    5003 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d2652cf4-9d2a-480e-ad8a-946d0d4b90f3-workload-certs\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:43:14.710171 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:14.704944    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6c7cacb3-7045-4e9d-a2d6-9fabaa50af3d-workload-certs" pod "6c7cacb3-7045-4e9d-a2d6-9fabaa50af3d" (UID: "6c7cacb3-7045-4e9d-a2d6-9fabaa50af3d"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 17:43:14.710171 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:14.705680    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6c7cacb3-7045-4e9d-a2d6-9fabaa50af3d-istio-data" pod "6c7cacb3-7045-4e9d-a2d6-9fabaa50af3d" (UID: "6c7cacb3-7045-4e9d-a2d6-9fabaa50af3d"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 17:43:14.710171 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:14.709759    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d2652cf4-9d2a-480e-ad8a-946d0d4b90f3-kube-api-access-7jpb7" pod "d2652cf4-9d2a-480e-ad8a-946d0d4b90f3" (UID: "d2652cf4-9d2a-480e-ad8a-946d0d4b90f3"). InnerVolumeSpecName "kube-api-access-7jpb7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 17:43:14.710171 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:14.705853    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a79988d8-d286-43ae-914b-bd1f6db3eb11-istio-data" pod "a79988d8-d286-43ae-914b-bd1f6db3eb11" (UID: "a79988d8-d286-43ae-914b-bd1f6db3eb11"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 17:43:14.710171 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:14.706279    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6c7cacb3-7045-4e9d-a2d6-9fabaa50af3d-istiod-ca-cert" pod "6c7cacb3-7045-4e9d-a2d6-9fabaa50af3d" (UID: "6c7cacb3-7045-4e9d-a2d6-9fabaa50af3d"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 17:43:14.710171 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:14.706574    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d2652cf4-9d2a-480e-ad8a-946d0d4b90f3-workload-socket" pod "d2652cf4-9d2a-480e-ad8a-946d0d4b90f3" (UID: "d2652cf4-9d2a-480e-ad8a-946d0d4b90f3"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 17:43:14.710171 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:14.708097    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a79988d8-d286-43ae-914b-bd1f6db3eb11-workload-certs" pod "a79988d8-d286-43ae-914b-bd1f6db3eb11" (UID: "a79988d8-d286-43ae-914b-bd1f6db3eb11"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 17:43:14.710171 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:14.708152    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d2652cf4-9d2a-480e-ad8a-946d0d4b90f3-istiod-ca-cert" pod "d2652cf4-9d2a-480e-ad8a-946d0d4b90f3" (UID: "d2652cf4-9d2a-480e-ad8a-946d0d4b90f3"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 17:43:14.710171 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:14.708291    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d2652cf4-9d2a-480e-ad8a-946d0d4b90f3-credential-socket" pod "d2652cf4-9d2a-480e-ad8a-946d0d4b90f3" (UID: "d2652cf4-9d2a-480e-ad8a-946d0d4b90f3"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 17:43:14.710171 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:14.708472    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a79988d8-d286-43ae-914b-bd1f6db3eb11-credential-socket" pod "a79988d8-d286-43ae-914b-bd1f6db3eb11" (UID: "a79988d8-d286-43ae-914b-bd1f6db3eb11"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 17:43:14.710171 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:14.709881    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/d2652cf4-9d2a-480e-ad8a-946d0d4b90f3-istio-podinfo" pod "d2652cf4-9d2a-480e-ad8a-946d0d4b90f3" (UID: "d2652cf4-9d2a-480e-ad8a-946d0d4b90f3"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 31 17:43:14.712969 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:14.710322    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d2652cf4-9d2a-480e-ad8a-946d0d4b90f3-istio-data" pod "d2652cf4-9d2a-480e-ad8a-946d0d4b90f3" (UID: "d2652cf4-9d2a-480e-ad8a-946d0d4b90f3"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 17:43:14.713533 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:14.713487    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/a79988d8-d286-43ae-914b-bd1f6db3eb11-istio-podinfo" pod "a79988d8-d286-43ae-914b-bd1f6db3eb11" (UID: "a79988d8-d286-43ae-914b-bd1f6db3eb11"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 31 17:43:14.715123 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:14.715087    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6c7cacb3-7045-4e9d-a2d6-9fabaa50af3d-kube-api-access-9d2bq" pod "6c7cacb3-7045-4e9d-a2d6-9fabaa50af3d" (UID: "6c7cacb3-7045-4e9d-a2d6-9fabaa50af3d"). InnerVolumeSpecName "kube-api-access-9d2bq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 17:43:14.715379 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:14.715355    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/6c7cacb3-7045-4e9d-a2d6-9fabaa50af3d-istio-podinfo" pod "6c7cacb3-7045-4e9d-a2d6-9fabaa50af3d" (UID: "6c7cacb3-7045-4e9d-a2d6-9fabaa50af3d"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 31 17:43:14.715676 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:14.715625    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6c7cacb3-7045-4e9d-a2d6-9fabaa50af3d-istio-envoy" pod "6c7cacb3-7045-4e9d-a2d6-9fabaa50af3d" (UID: "6c7cacb3-7045-4e9d-a2d6-9fabaa50af3d"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 17:43:14.716573 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:14.716551    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6c7cacb3-7045-4e9d-a2d6-9fabaa50af3d-istio-token" pod "6c7cacb3-7045-4e9d-a2d6-9fabaa50af3d" (UID: "6c7cacb3-7045-4e9d-a2d6-9fabaa50af3d"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 17:43:14.717096 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:14.716939    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a79988d8-d286-43ae-914b-bd1f6db3eb11-istio-envoy" pod "a79988d8-d286-43ae-914b-bd1f6db3eb11" (UID: "a79988d8-d286-43ae-914b-bd1f6db3eb11"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 17:43:14.717096 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:14.716943    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a79988d8-d286-43ae-914b-bd1f6db3eb11-kube-api-access-kb5cs" pod "a79988d8-d286-43ae-914b-bd1f6db3eb11" (UID: "a79988d8-d286-43ae-914b-bd1f6db3eb11"). InnerVolumeSpecName "kube-api-access-kb5cs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 17:43:14.717096 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:14.716946    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d2652cf4-9d2a-480e-ad8a-946d0d4b90f3-istio-envoy" pod "d2652cf4-9d2a-480e-ad8a-946d0d4b90f3" (UID: "d2652cf4-9d2a-480e-ad8a-946d0d4b90f3"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 17:43:14.717096 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:14.717046    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a79988d8-d286-43ae-914b-bd1f6db3eb11-istio-token" pod "a79988d8-d286-43ae-914b-bd1f6db3eb11" (UID: "a79988d8-d286-43ae-914b-bd1f6db3eb11"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 17:43:14.718280 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:14.718257    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d2652cf4-9d2a-480e-ad8a-946d0d4b90f3-istio-token" pod "d2652cf4-9d2a-480e-ad8a-946d0d4b90f3" (UID: "d2652cf4-9d2a-480e-ad8a-946d0d4b90f3"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 17:43:14.806527 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:14.806498    5003 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d2652cf4-9d2a-480e-ad8a-946d0d4b90f3-istio-data\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:43:14.806527 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:14.806524    5003 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6c7cacb3-7045-4e9d-a2d6-9fabaa50af3d-istio-data\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:43:14.806527 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:14.806533    5003 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a79988d8-d286-43ae-914b-bd1f6db3eb11-istio-envoy\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:43:14.806793 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:14.806546    5003 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d2652cf4-9d2a-480e-ad8a-946d0d4b90f3-istio-envoy\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:43:14.806793 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:14.806558    5003 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a79988d8-d286-43ae-914b-bd1f6db3eb11-istio-token\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:43:14.806793 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:14.806567    5003 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d2652cf4-9d2a-480e-ad8a-946d0d4b90f3-istio-token\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:43:14.806793 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:14.806574    5003 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a79988d8-d286-43ae-914b-bd1f6db3eb11-workload-certs\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:43:14.806793 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:14.806583    5003 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kb5cs\" (UniqueName: \"kubernetes.io/projected/a79988d8-d286-43ae-914b-bd1f6db3eb11-kube-api-access-kb5cs\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:43:14.806793 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:14.806592    5003 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9d2bq\" (UniqueName: \"kubernetes.io/projected/6c7cacb3-7045-4e9d-a2d6-9fabaa50af3d-kube-api-access-9d2bq\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:43:14.806793 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:14.806601    5003 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6c7cacb3-7045-4e9d-a2d6-9fabaa50af3d-workload-certs\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:43:14.806793 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:14.806611    5003 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d2652cf4-9d2a-480e-ad8a-946d0d4b90f3-credential-socket\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:43:14.806793 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:14.806623    5003 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d2652cf4-9d2a-480e-ad8a-946d0d4b90f3-istiod-ca-cert\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:43:14.806793 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:14.806635    5003 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6c7cacb3-7045-4e9d-a2d6-9fabaa50af3d-istio-token\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:43:14.806793 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:14.806655    5003 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a79988d8-d286-43ae-914b-bd1f6db3eb11-credential-socket\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:43:14.806793 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:14.806663    5003 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6c7cacb3-7045-4e9d-a2d6-9fabaa50af3d-istio-podinfo\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:43:14.806793 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:14.806671    5003 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d2652cf4-9d2a-480e-ad8a-946d0d4b90f3-istio-podinfo\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:43:14.806793 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:14.806680    5003 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a79988d8-d286-43ae-914b-bd1f6db3eb11-istio-data\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:43:14.806793 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:14.806687    5003 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6c7cacb3-7045-4e9d-a2d6-9fabaa50af3d-istiod-ca-cert\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:43:14.806793 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:14.806698    5003 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d2652cf4-9d2a-480e-ad8a-946d0d4b90f3-workload-socket\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:43:14.806793 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:14.806709    5003 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7jpb7\" (UniqueName: \"kubernetes.io/projected/d2652cf4-9d2a-480e-ad8a-946d0d4b90f3-kube-api-access-7jpb7\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:43:14.806793 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:14.806718    5003 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6c7cacb3-7045-4e9d-a2d6-9fabaa50af3d-istio-envoy\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:43:14.806793 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:14.806726    5003 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a79988d8-d286-43ae-914b-bd1f6db3eb11-istio-podinfo\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:43:14.866351 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:14.866315    5003 generic.go:356] "Generic (PLEG): container finished" podID="a79988d8-d286-43ae-914b-bd1f6db3eb11" containerID="b70f11a8fea21a6df296adcd388ee127839103162a8061281174277142cd35b8" exitCode=0
Oct 31 17:43:14.866551 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:14.866373    5003 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-ee816e-openshift-default-c4db85b5c-7pwpp"
Oct 31 17:43:14.866551 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:14.866408    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-ee816e-openshift-default-c4db85b5c-7pwpp" event={"ID":"a79988d8-d286-43ae-914b-bd1f6db3eb11","Type":"ContainerDied","Data":"b70f11a8fea21a6df296adcd388ee127839103162a8061281174277142cd35b8"}
Oct 31 17:43:14.866551 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:14.866471    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-ee816e-openshift-default-c4db85b5c-7pwpp" event={"ID":"a79988d8-d286-43ae-914b-bd1f6db3eb11","Type":"ContainerDied","Data":"c1c17d0d66e485901851025cbfb785da8938f388137ab73586f0fcd8e9793ab2"}
Oct 31 17:43:14.866551 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:14.866504    5003 scope.go:122] "RemoveContainer" containerID="b70f11a8fea21a6df296adcd388ee127839103162a8061281174277142cd35b8"
Oct 31 17:43:14.869328 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:14.869295    5003 generic.go:356] "Generic (PLEG): container finished" podID="d2652cf4-9d2a-480e-ad8a-946d0d4b90f3" containerID="c4ff4c810940412d9a1ff9122542f6410610dbb972e3da5152726e556a9c8a14" exitCode=0
Oct 31 17:43:14.869453 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:14.869352    5003 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-ee816e-openshift-default-c4db85b5c-qm655"
Oct 31 17:43:14.869453 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:14.869377    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-ee816e-openshift-default-c4db85b5c-qm655" event={"ID":"d2652cf4-9d2a-480e-ad8a-946d0d4b90f3","Type":"ContainerDied","Data":"c4ff4c810940412d9a1ff9122542f6410610dbb972e3da5152726e556a9c8a14"}
Oct 31 17:43:14.869453 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:14.869432    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-ee816e-openshift-default-c4db85b5c-qm655" event={"ID":"d2652cf4-9d2a-480e-ad8a-946d0d4b90f3","Type":"ContainerDied","Data":"734daf0235946b34258e2ef05b0628f9dbc40700cb7d94ec3a8618136c7d8d34"}
Oct 31 17:43:14.871124 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:14.871052    5003 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-1c0bfd-openshift-default-f7f657c57-hp2wj"
Oct 31 17:43:14.871124 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:14.871070    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-1c0bfd-openshift-default-f7f657c57-hp2wj" event={"ID":"679da5c1-9c28-4f80-a210-185350147f11","Type":"ContainerDied","Data":"b501a46539a9ff1efdd382af2125d4040b7f66c7edf6ff3350d2efbdd01332be"}
Oct 31 17:43:14.874604 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:14.872858    5003 generic.go:356] "Generic (PLEG): container finished" podID="6c7cacb3-7045-4e9d-a2d6-9fabaa50af3d" containerID="60ce9522dc18b66c7ac96aca043fb8b211a05ce8556e834bff095cc29f4c834f" exitCode=0
Oct 31 17:43:14.874604 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:14.872905    5003 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-ee816e-openshift-default-c4db85b5c-j7pfz"
Oct 31 17:43:14.874604 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:14.872942    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-ee816e-openshift-default-c4db85b5c-j7pfz" event={"ID":"6c7cacb3-7045-4e9d-a2d6-9fabaa50af3d","Type":"ContainerDied","Data":"60ce9522dc18b66c7ac96aca043fb8b211a05ce8556e834bff095cc29f4c834f"}
Oct 31 17:43:14.874604 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:14.873003    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-ee816e-openshift-default-c4db85b5c-j7pfz" event={"ID":"6c7cacb3-7045-4e9d-a2d6-9fabaa50af3d","Type":"ContainerDied","Data":"56e7a69fab53f5efbdaa002da438f74f2d2c50b0edb1099fb9b9aaa122d74be2"}
Oct 31 17:43:14.875873 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:14.875848    5003 generic.go:356] "Generic (PLEG): container finished" podID="6dbed28d-b3b9-4af1-82b7-40151ba418c1" containerID="8c1bb55797c58b272d9659652198809f486df56cb182f4b46d80d863ecddd72b" exitCode=0
Oct 31 17:43:14.875982 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:14.875890    5003 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-ee816e-openshift-default-c4db85b5c-dz8kv"
Oct 31 17:43:14.875982 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:14.875903    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-ee816e-openshift-default-c4db85b5c-dz8kv" event={"ID":"6dbed28d-b3b9-4af1-82b7-40151ba418c1","Type":"ContainerDied","Data":"8c1bb55797c58b272d9659652198809f486df56cb182f4b46d80d863ecddd72b"}
Oct 31 17:43:14.875982 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:14.875938    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-ee816e-openshift-default-c4db85b5c-dz8kv" event={"ID":"6dbed28d-b3b9-4af1-82b7-40151ba418c1","Type":"ContainerDied","Data":"4ec8d8397936df066501c9f711fb4dac900da42b38f73a52ff18e8b7a36f003c"}
Oct 31 17:43:14.882084 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:14.881968    5003 scope.go:122] "RemoveContainer" containerID="d4a19531fd76d530d4e154e2e9cba4fa36562053b4577b64fafc78b4f6b5c744"
Oct 31 17:43:14.894482 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:14.894456    5003 scope.go:122] "RemoveContainer" containerID="b70f11a8fea21a6df296adcd388ee127839103162a8061281174277142cd35b8"
Oct 31 17:43:14.895377 ip-10-0-138-17 kubenswrapper[5003]: E1031 17:43:14.895354    5003 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b70f11a8fea21a6df296adcd388ee127839103162a8061281174277142cd35b8\": container with ID starting with b70f11a8fea21a6df296adcd388ee127839103162a8061281174277142cd35b8 not found: ID does not exist" containerID="b70f11a8fea21a6df296adcd388ee127839103162a8061281174277142cd35b8"
Oct 31 17:43:14.895472 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:14.895385    5003 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b70f11a8fea21a6df296adcd388ee127839103162a8061281174277142cd35b8"} err="failed to get container status \"b70f11a8fea21a6df296adcd388ee127839103162a8061281174277142cd35b8\": rpc error: code = NotFound desc = could not find container \"b70f11a8fea21a6df296adcd388ee127839103162a8061281174277142cd35b8\": container with ID starting with b70f11a8fea21a6df296adcd388ee127839103162a8061281174277142cd35b8 not found: ID does not exist"
Oct 31 17:43:14.895472 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:14.895406    5003 scope.go:122] "RemoveContainer" containerID="d4a19531fd76d530d4e154e2e9cba4fa36562053b4577b64fafc78b4f6b5c744"
Oct 31 17:43:14.895707 ip-10-0-138-17 kubenswrapper[5003]: E1031 17:43:14.895685    5003 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d4a19531fd76d530d4e154e2e9cba4fa36562053b4577b64fafc78b4f6b5c744\": container with ID starting with d4a19531fd76d530d4e154e2e9cba4fa36562053b4577b64fafc78b4f6b5c744 not found: ID does not exist" containerID="d4a19531fd76d530d4e154e2e9cba4fa36562053b4577b64fafc78b4f6b5c744"
Oct 31 17:43:14.895754 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:14.895716    5003 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d4a19531fd76d530d4e154e2e9cba4fa36562053b4577b64fafc78b4f6b5c744"} err="failed to get container status \"d4a19531fd76d530d4e154e2e9cba4fa36562053b4577b64fafc78b4f6b5c744\": rpc error: code = NotFound desc = could not find container \"d4a19531fd76d530d4e154e2e9cba4fa36562053b4577b64fafc78b4f6b5c744\": container with ID starting with d4a19531fd76d530d4e154e2e9cba4fa36562053b4577b64fafc78b4f6b5c744 not found: ID does not exist"
Oct 31 17:43:14.895754 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:14.895732    5003 scope.go:122] "RemoveContainer" containerID="c4ff4c810940412d9a1ff9122542f6410610dbb972e3da5152726e556a9c8a14"
Oct 31 17:43:14.905191 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:14.905174    5003 scope.go:122] "RemoveContainer" containerID="c4ff4c810940412d9a1ff9122542f6410610dbb972e3da5152726e556a9c8a14"
Oct 31 17:43:14.905487 ip-10-0-138-17 kubenswrapper[5003]: E1031 17:43:14.905469    5003 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c4ff4c810940412d9a1ff9122542f6410610dbb972e3da5152726e556a9c8a14\": container with ID starting with c4ff4c810940412d9a1ff9122542f6410610dbb972e3da5152726e556a9c8a14 not found: ID does not exist" containerID="c4ff4c810940412d9a1ff9122542f6410610dbb972e3da5152726e556a9c8a14"
Oct 31 17:43:14.905527 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:14.905496    5003 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c4ff4c810940412d9a1ff9122542f6410610dbb972e3da5152726e556a9c8a14"} err="failed to get container status \"c4ff4c810940412d9a1ff9122542f6410610dbb972e3da5152726e556a9c8a14\": rpc error: code = NotFound desc = could not find container \"c4ff4c810940412d9a1ff9122542f6410610dbb972e3da5152726e556a9c8a14\": container with ID starting with c4ff4c810940412d9a1ff9122542f6410610dbb972e3da5152726e556a9c8a14 not found: ID does not exist"
Oct 31 17:43:14.905527 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:14.905513    5003 scope.go:122] "RemoveContainer" containerID="ed209a24e1203b5578ab5fddc515a3543dedaa851d14aa9fed738fe591800a6f"
Oct 31 17:43:14.916227 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:14.916210    5003 scope.go:122] "RemoveContainer" containerID="60ce9522dc18b66c7ac96aca043fb8b211a05ce8556e834bff095cc29f4c834f"
Oct 31 17:43:14.929679 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:14.929632    5003 scope.go:122] "RemoveContainer" containerID="60ce9522dc18b66c7ac96aca043fb8b211a05ce8556e834bff095cc29f4c834f"
Oct 31 17:43:14.930000 ip-10-0-138-17 kubenswrapper[5003]: E1031 17:43:14.929976    5003 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"60ce9522dc18b66c7ac96aca043fb8b211a05ce8556e834bff095cc29f4c834f\": container with ID starting with 60ce9522dc18b66c7ac96aca043fb8b211a05ce8556e834bff095cc29f4c834f not found: ID does not exist" containerID="60ce9522dc18b66c7ac96aca043fb8b211a05ce8556e834bff095cc29f4c834f"
Oct 31 17:43:14.930103 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:14.930010    5003 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"60ce9522dc18b66c7ac96aca043fb8b211a05ce8556e834bff095cc29f4c834f"} err="failed to get container status \"60ce9522dc18b66c7ac96aca043fb8b211a05ce8556e834bff095cc29f4c834f\": rpc error: code = NotFound desc = could not find container \"60ce9522dc18b66c7ac96aca043fb8b211a05ce8556e834bff095cc29f4c834f\": container with ID starting with 60ce9522dc18b66c7ac96aca043fb8b211a05ce8556e834bff095cc29f4c834f not found: ID does not exist"
Oct 31 17:43:14.930103 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:14.930030    5003 scope.go:122] "RemoveContainer" containerID="8c1bb55797c58b272d9659652198809f486df56cb182f4b46d80d863ecddd72b"
Oct 31 17:43:14.939458 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:14.939436    5003 scope.go:122] "RemoveContainer" containerID="8c1bb55797c58b272d9659652198809f486df56cb182f4b46d80d863ecddd72b"
Oct 31 17:43:14.939830 ip-10-0-138-17 kubenswrapper[5003]: E1031 17:43:14.939807    5003 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8c1bb55797c58b272d9659652198809f486df56cb182f4b46d80d863ecddd72b\": container with ID starting with 8c1bb55797c58b272d9659652198809f486df56cb182f4b46d80d863ecddd72b not found: ID does not exist" containerID="8c1bb55797c58b272d9659652198809f486df56cb182f4b46d80d863ecddd72b"
Oct 31 17:43:14.939893 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:14.939836    5003 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8c1bb55797c58b272d9659652198809f486df56cb182f4b46d80d863ecddd72b"} err="failed to get container status \"8c1bb55797c58b272d9659652198809f486df56cb182f4b46d80d863ecddd72b\": rpc error: code = NotFound desc = could not find container \"8c1bb55797c58b272d9659652198809f486df56cb182f4b46d80d863ecddd72b\": container with ID starting with 8c1bb55797c58b272d9659652198809f486df56cb182f4b46d80d863ecddd72b not found: ID does not exist"
Oct 31 17:43:14.989918 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:14.989822    5003 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-ee816e-openshift-default-c4db85b5c-dz8kv"]
Oct 31 17:43:15.002593 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:15.002560    5003 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w0-ee816e-openshift-default-c4db85b5c-dz8kv"]
Oct 31 17:43:15.036630 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:15.036597    5003 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-ee816e-openshift-default-c4db85b5c-7pwpp"]
Oct 31 17:43:15.041507 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:15.041480    5003 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w0-ee816e-openshift-default-c4db85b5c-7pwpp"]
Oct 31 17:43:15.072050 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:15.072017    5003 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-ee816e-openshift-default-c4db85b5c-qm655"]
Oct 31 17:43:15.083148 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:15.083120    5003 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w0-ee816e-openshift-default-c4db85b5c-qm655"]
Oct 31 17:43:15.120414 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:15.120355    5003 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-ee816e-openshift-default-c4db85b5c-j7pfz"]
Oct 31 17:43:15.124706 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:15.124675    5003 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w0-ee816e-openshift-default-c4db85b5c-j7pfz"]
Oct 31 17:43:15.157932 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:15.157894    5003 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-1c0bfd-openshift-default-f7f657c57-hp2wj"]
Oct 31 17:43:15.161804 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:15.161773    5003 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w4-1c0bfd-openshift-default-f7f657c57-hp2wj"]
Oct 31 17:43:15.892408 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:15.892381    5003 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="679da5c1-9c28-4f80-a210-185350147f11" path="/var/lib/kubelet/pods/679da5c1-9c28-4f80-a210-185350147f11/volumes"
Oct 31 17:43:15.893057 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:15.893037    5003 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="6c7cacb3-7045-4e9d-a2d6-9fabaa50af3d" path="/var/lib/kubelet/pods/6c7cacb3-7045-4e9d-a2d6-9fabaa50af3d/volumes"
Oct 31 17:43:15.893193 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:15.893106    5003 generic.go:356] "Generic (PLEG): container finished" podID="503ff30a-8065-430d-a685-89ff4ec49f7c" containerID="930ee319f56552eab82e08d8295978dd5d31efa037697ee5b6f837684ca1b6d6" exitCode=0
Oct 31 17:43:15.893721 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:15.893589    5003 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="6dbed28d-b3b9-4af1-82b7-40151ba418c1" path="/var/lib/kubelet/pods/6dbed28d-b3b9-4af1-82b7-40151ba418c1/volumes"
Oct 31 17:43:15.894575 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:15.894554    5003 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="8a6f3fb4-846a-43aa-9309-48c6ca558850" path="/var/lib/kubelet/pods/8a6f3fb4-846a-43aa-9309-48c6ca558850/volumes"
Oct 31 17:43:15.895208 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:15.895186    5003 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="92a031e7-6d59-4493-b15d-7dc213289f55" path="/var/lib/kubelet/pods/92a031e7-6d59-4493-b15d-7dc213289f55/volumes"
Oct 31 17:43:15.895472 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:15.895454    5003 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-d80080-openshift-default-956cddf57-x6xxp"
Oct 31 17:43:15.895810 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:15.895791    5003 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="a79988d8-d286-43ae-914b-bd1f6db3eb11" path="/var/lib/kubelet/pods/a79988d8-d286-43ae-914b-bd1f6db3eb11/volumes"
Oct 31 17:43:15.896878 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:15.896855    5003 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="d2652cf4-9d2a-480e-ad8a-946d0d4b90f3" path="/var/lib/kubelet/pods/d2652cf4-9d2a-480e-ad8a-946d0d4b90f3/volumes"
Oct 31 17:43:15.897271 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:15.897247    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-d80080-openshift-default-956cddf57-5f59v" event={"ID":"503ff30a-8065-430d-a685-89ff4ec49f7c","Type":"ContainerDied","Data":"930ee319f56552eab82e08d8295978dd5d31efa037697ee5b6f837684ca1b6d6"}
Oct 31 17:43:15.898402 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:15.898375    5003 generic.go:356] "Generic (PLEG): container finished" podID="eeb8afc2-1a66-4c38-9fb3-04ccd09083a2" containerID="be1050371aa22276cd09f5b713b4e73dc04fb13672cd698f040abcd330a127b8" exitCode=0
Oct 31 17:43:15.898519 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:15.898438    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-d80080-openshift-default-956cddf57-rdglw" event={"ID":"eeb8afc2-1a66-4c38-9fb3-04ccd09083a2","Type":"ContainerDied","Data":"be1050371aa22276cd09f5b713b4e73dc04fb13672cd698f040abcd330a127b8"}
Oct 31 17:43:15.904684 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:15.901681    5003 generic.go:356] "Generic (PLEG): container finished" podID="5f2c9613-4b8a-4452-b70a-2ed258063318" containerID="af682b13055f9fa3bfcb813dc3c7f84bd182a1fb9c5d47876115724ffe721500" exitCode=0
Oct 31 17:43:15.904684 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:15.901742    5003 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-d80080-openshift-default-956cddf57-x6xxp"
Oct 31 17:43:15.904684 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:15.901761    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-d80080-openshift-default-956cddf57-x6xxp" event={"ID":"5f2c9613-4b8a-4452-b70a-2ed258063318","Type":"ContainerDied","Data":"af682b13055f9fa3bfcb813dc3c7f84bd182a1fb9c5d47876115724ffe721500"}
Oct 31 17:43:15.904684 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:15.901813    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-d80080-openshift-default-956cddf57-x6xxp" event={"ID":"5f2c9613-4b8a-4452-b70a-2ed258063318","Type":"ContainerDied","Data":"2ea88d2127f3bed88a0d2884dac73ebc7f2e112e1f9927525e024973af0c4ec1"}
Oct 31 17:43:15.904684 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:15.901845    5003 scope.go:122] "RemoveContainer" containerID="af682b13055f9fa3bfcb813dc3c7f84bd182a1fb9c5d47876115724ffe721500"
Oct 31 17:43:15.904684 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:15.903324    5003 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-d80080-openshift-default-956cddf57-5f59v"
Oct 31 17:43:15.913564 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:15.913539    5003 scope.go:122] "RemoveContainer" containerID="bb5ae6599bdfa06eaa315d59a12ddcdeb296955b61ca4d075418d7282d4d0aee"
Oct 31 17:43:15.926016 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:15.925981    5003 scope.go:122] "RemoveContainer" containerID="af682b13055f9fa3bfcb813dc3c7f84bd182a1fb9c5d47876115724ffe721500"
Oct 31 17:43:15.926412 ip-10-0-138-17 kubenswrapper[5003]: E1031 17:43:15.926373    5003 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"af682b13055f9fa3bfcb813dc3c7f84bd182a1fb9c5d47876115724ffe721500\": container with ID starting with af682b13055f9fa3bfcb813dc3c7f84bd182a1fb9c5d47876115724ffe721500 not found: ID does not exist" containerID="af682b13055f9fa3bfcb813dc3c7f84bd182a1fb9c5d47876115724ffe721500"
Oct 31 17:43:15.926526 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:15.926429    5003 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"af682b13055f9fa3bfcb813dc3c7f84bd182a1fb9c5d47876115724ffe721500"} err="failed to get container status \"af682b13055f9fa3bfcb813dc3c7f84bd182a1fb9c5d47876115724ffe721500\": rpc error: code = NotFound desc = could not find container \"af682b13055f9fa3bfcb813dc3c7f84bd182a1fb9c5d47876115724ffe721500\": container with ID starting with af682b13055f9fa3bfcb813dc3c7f84bd182a1fb9c5d47876115724ffe721500 not found: ID does not exist"
Oct 31 17:43:15.926526 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:15.926457    5003 scope.go:122] "RemoveContainer" containerID="bb5ae6599bdfa06eaa315d59a12ddcdeb296955b61ca4d075418d7282d4d0aee"
Oct 31 17:43:15.927305 ip-10-0-138-17 kubenswrapper[5003]: E1031 17:43:15.927279    5003 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bb5ae6599bdfa06eaa315d59a12ddcdeb296955b61ca4d075418d7282d4d0aee\": container with ID starting with bb5ae6599bdfa06eaa315d59a12ddcdeb296955b61ca4d075418d7282d4d0aee not found: ID does not exist" containerID="bb5ae6599bdfa06eaa315d59a12ddcdeb296955b61ca4d075418d7282d4d0aee"
Oct 31 17:43:15.927432 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:15.927334    5003 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bb5ae6599bdfa06eaa315d59a12ddcdeb296955b61ca4d075418d7282d4d0aee"} err="failed to get container status \"bb5ae6599bdfa06eaa315d59a12ddcdeb296955b61ca4d075418d7282d4d0aee\": rpc error: code = NotFound desc = could not find container \"bb5ae6599bdfa06eaa315d59a12ddcdeb296955b61ca4d075418d7282d4d0aee\": container with ID starting with bb5ae6599bdfa06eaa315d59a12ddcdeb296955b61ca4d075418d7282d4d0aee not found: ID does not exist"
Oct 31 17:43:15.950847 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:15.950756    5003 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-d80080-openshift-default-956cddf57-rdglw"
Oct 31 17:43:16.020267 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:16.020229    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/5f2c9613-4b8a-4452-b70a-2ed258063318-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5f2c9613-4b8a-4452-b70a-2ed258063318-workload-certs\") pod \"5f2c9613-4b8a-4452-b70a-2ed258063318\" (UID: \"5f2c9613-4b8a-4452-b70a-2ed258063318\") "
Oct 31 17:43:16.020448 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:16.020277    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/503ff30a-8065-430d-a685-89ff4ec49f7c-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/503ff30a-8065-430d-a685-89ff4ec49f7c-workload-socket\") pod \"503ff30a-8065-430d-a685-89ff4ec49f7c\" (UID: \"503ff30a-8065-430d-a685-89ff4ec49f7c\") "
Oct 31 17:43:16.020448 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:16.020298    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/5f2c9613-4b8a-4452-b70a-2ed258063318-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5f2c9613-4b8a-4452-b70a-2ed258063318-workload-socket\") pod \"5f2c9613-4b8a-4452-b70a-2ed258063318\" (UID: \"5f2c9613-4b8a-4452-b70a-2ed258063318\") "
Oct 31 17:43:16.020448 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:16.020322    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/503ff30a-8065-430d-a685-89ff4ec49f7c-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/503ff30a-8065-430d-a685-89ff4ec49f7c-credential-socket\") pod \"503ff30a-8065-430d-a685-89ff4ec49f7c\" (UID: \"503ff30a-8065-430d-a685-89ff4ec49f7c\") "
Oct 31 17:43:16.020448 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:16.020347    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/eeb8afc2-1a66-4c38-9fb3-04ccd09083a2-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/eeb8afc2-1a66-4c38-9fb3-04ccd09083a2-istio-data\") pod \"eeb8afc2-1a66-4c38-9fb3-04ccd09083a2\" (UID: \"eeb8afc2-1a66-4c38-9fb3-04ccd09083a2\") "
Oct 31 17:43:16.020448 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:16.020378    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/5f2c9613-4b8a-4452-b70a-2ed258063318-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5f2c9613-4b8a-4452-b70a-2ed258063318-istio-data\") pod \"5f2c9613-4b8a-4452-b70a-2ed258063318\" (UID: \"5f2c9613-4b8a-4452-b70a-2ed258063318\") "
Oct 31 17:43:16.020448 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:16.020425    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/eeb8afc2-1a66-4c38-9fb3-04ccd09083a2-kube-api-access-bbd9f\" (UniqueName: \"kubernetes.io/projected/eeb8afc2-1a66-4c38-9fb3-04ccd09083a2-kube-api-access-bbd9f\") pod \"eeb8afc2-1a66-4c38-9fb3-04ccd09083a2\" (UID: \"eeb8afc2-1a66-4c38-9fb3-04ccd09083a2\") "
Oct 31 17:43:16.020817 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:16.020457    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/eeb8afc2-1a66-4c38-9fb3-04ccd09083a2-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/eeb8afc2-1a66-4c38-9fb3-04ccd09083a2-istiod-ca-cert\") pod \"eeb8afc2-1a66-4c38-9fb3-04ccd09083a2\" (UID: \"eeb8afc2-1a66-4c38-9fb3-04ccd09083a2\") "
Oct 31 17:43:16.020817 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:16.020484    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/503ff30a-8065-430d-a685-89ff4ec49f7c-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/503ff30a-8065-430d-a685-89ff4ec49f7c-istiod-ca-cert\") pod \"503ff30a-8065-430d-a685-89ff4ec49f7c\" (UID: \"503ff30a-8065-430d-a685-89ff4ec49f7c\") "
Oct 31 17:43:16.020817 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:16.020505    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/5f2c9613-4b8a-4452-b70a-2ed258063318-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5f2c9613-4b8a-4452-b70a-2ed258063318-istio-podinfo\") pod \"5f2c9613-4b8a-4452-b70a-2ed258063318\" (UID: \"5f2c9613-4b8a-4452-b70a-2ed258063318\") "
Oct 31 17:43:16.020817 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:16.020581    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/503ff30a-8065-430d-a685-89ff4ec49f7c-workload-socket" pod "503ff30a-8065-430d-a685-89ff4ec49f7c" (UID: "503ff30a-8065-430d-a685-89ff4ec49f7c"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 17:43:16.020817 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:16.020623    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5f2c9613-4b8a-4452-b70a-2ed258063318-workload-certs" pod "5f2c9613-4b8a-4452-b70a-2ed258063318" (UID: "5f2c9613-4b8a-4452-b70a-2ed258063318"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 17:43:16.020817 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:16.020751    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/eeb8afc2-1a66-4c38-9fb3-04ccd09083a2-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/eeb8afc2-1a66-4c38-9fb3-04ccd09083a2-workload-socket\") pod \"eeb8afc2-1a66-4c38-9fb3-04ccd09083a2\" (UID: \"eeb8afc2-1a66-4c38-9fb3-04ccd09083a2\") "
Oct 31 17:43:16.020817 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:16.020809    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/5f2c9613-4b8a-4452-b70a-2ed258063318-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5f2c9613-4b8a-4452-b70a-2ed258063318-credential-socket\") pod \"5f2c9613-4b8a-4452-b70a-2ed258063318\" (UID: \"5f2c9613-4b8a-4452-b70a-2ed258063318\") "
Oct 31 17:43:16.021186 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:16.020818    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/503ff30a-8065-430d-a685-89ff4ec49f7c-credential-socket" pod "503ff30a-8065-430d-a685-89ff4ec49f7c" (UID: "503ff30a-8065-430d-a685-89ff4ec49f7c"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 17:43:16.021186 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:16.020830    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eeb8afc2-1a66-4c38-9fb3-04ccd09083a2-istio-data" pod "eeb8afc2-1a66-4c38-9fb3-04ccd09083a2" (UID: "eeb8afc2-1a66-4c38-9fb3-04ccd09083a2"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 17:43:16.021186 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:16.020851    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/eeb8afc2-1a66-4c38-9fb3-04ccd09083a2-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/eeb8afc2-1a66-4c38-9fb3-04ccd09083a2-istio-podinfo\") pod \"eeb8afc2-1a66-4c38-9fb3-04ccd09083a2\" (UID: \"eeb8afc2-1a66-4c38-9fb3-04ccd09083a2\") "
Oct 31 17:43:16.021186 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:16.020880    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/eeb8afc2-1a66-4c38-9fb3-04ccd09083a2-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/eeb8afc2-1a66-4c38-9fb3-04ccd09083a2-credential-socket\") pod \"eeb8afc2-1a66-4c38-9fb3-04ccd09083a2\" (UID: \"eeb8afc2-1a66-4c38-9fb3-04ccd09083a2\") "
Oct 31 17:43:16.021186 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:16.020925    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/503ff30a-8065-430d-a685-89ff4ec49f7c-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/503ff30a-8065-430d-a685-89ff4ec49f7c-istio-envoy\") pod \"503ff30a-8065-430d-a685-89ff4ec49f7c\" (UID: \"503ff30a-8065-430d-a685-89ff4ec49f7c\") "
Oct 31 17:43:16.021186 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:16.020961    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/eeb8afc2-1a66-4c38-9fb3-04ccd09083a2-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/eeb8afc2-1a66-4c38-9fb3-04ccd09083a2-istio-envoy\") pod \"eeb8afc2-1a66-4c38-9fb3-04ccd09083a2\" (UID: \"eeb8afc2-1a66-4c38-9fb3-04ccd09083a2\") "
Oct 31 17:43:16.021186 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:16.020994    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/5f2c9613-4b8a-4452-b70a-2ed258063318-kube-api-access-zlbc6\" (UniqueName: \"kubernetes.io/projected/5f2c9613-4b8a-4452-b70a-2ed258063318-kube-api-access-zlbc6\") pod \"5f2c9613-4b8a-4452-b70a-2ed258063318\" (UID: \"5f2c9613-4b8a-4452-b70a-2ed258063318\") "
Oct 31 17:43:16.021186 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:16.021070    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/503ff30a-8065-430d-a685-89ff4ec49f7c-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/503ff30a-8065-430d-a685-89ff4ec49f7c-workload-certs\") pod \"503ff30a-8065-430d-a685-89ff4ec49f7c\" (UID: \"503ff30a-8065-430d-a685-89ff4ec49f7c\") "
Oct 31 17:43:16.021186 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:16.021099    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/eeb8afc2-1a66-4c38-9fb3-04ccd09083a2-istio-token\" (UniqueName: \"kubernetes.io/projected/eeb8afc2-1a66-4c38-9fb3-04ccd09083a2-istio-token\") pod \"eeb8afc2-1a66-4c38-9fb3-04ccd09083a2\" (UID: \"eeb8afc2-1a66-4c38-9fb3-04ccd09083a2\") "
Oct 31 17:43:16.021186 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:16.021139    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/5f2c9613-4b8a-4452-b70a-2ed258063318-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5f2c9613-4b8a-4452-b70a-2ed258063318-istiod-ca-cert\") pod \"5f2c9613-4b8a-4452-b70a-2ed258063318\" (UID: \"5f2c9613-4b8a-4452-b70a-2ed258063318\") "
Oct 31 17:43:16.021186 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:16.021169    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/503ff30a-8065-430d-a685-89ff4ec49f7c-istio-token\" (UniqueName: \"kubernetes.io/projected/503ff30a-8065-430d-a685-89ff4ec49f7c-istio-token\") pod \"503ff30a-8065-430d-a685-89ff4ec49f7c\" (UID: \"503ff30a-8065-430d-a685-89ff4ec49f7c\") "
Oct 31 17:43:16.022588 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:16.021226    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/503ff30a-8065-430d-a685-89ff4ec49f7c-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/503ff30a-8065-430d-a685-89ff4ec49f7c-istio-podinfo\") pod \"503ff30a-8065-430d-a685-89ff4ec49f7c\" (UID: \"503ff30a-8065-430d-a685-89ff4ec49f7c\") "
Oct 31 17:43:16.022588 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:16.021447    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/503ff30a-8065-430d-a685-89ff4ec49f7c-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/503ff30a-8065-430d-a685-89ff4ec49f7c-istio-data\") pod \"503ff30a-8065-430d-a685-89ff4ec49f7c\" (UID: \"503ff30a-8065-430d-a685-89ff4ec49f7c\") "
Oct 31 17:43:16.022588 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:16.021524    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/5f2c9613-4b8a-4452-b70a-2ed258063318-istio-token\" (UniqueName: \"kubernetes.io/projected/5f2c9613-4b8a-4452-b70a-2ed258063318-istio-token\") pod \"5f2c9613-4b8a-4452-b70a-2ed258063318\" (UID: \"5f2c9613-4b8a-4452-b70a-2ed258063318\") "
Oct 31 17:43:16.022588 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:16.021555    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/5f2c9613-4b8a-4452-b70a-2ed258063318-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5f2c9613-4b8a-4452-b70a-2ed258063318-istio-envoy\") pod \"5f2c9613-4b8a-4452-b70a-2ed258063318\" (UID: \"5f2c9613-4b8a-4452-b70a-2ed258063318\") "
Oct 31 17:43:16.022588 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:16.021677    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/eeb8afc2-1a66-4c38-9fb3-04ccd09083a2-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/eeb8afc2-1a66-4c38-9fb3-04ccd09083a2-workload-certs\") pod \"eeb8afc2-1a66-4c38-9fb3-04ccd09083a2\" (UID: \"eeb8afc2-1a66-4c38-9fb3-04ccd09083a2\") "
Oct 31 17:43:16.022588 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:16.021712    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/503ff30a-8065-430d-a685-89ff4ec49f7c-kube-api-access-2v8gn\" (UniqueName: \"kubernetes.io/projected/503ff30a-8065-430d-a685-89ff4ec49f7c-kube-api-access-2v8gn\") pod \"503ff30a-8065-430d-a685-89ff4ec49f7c\" (UID: \"503ff30a-8065-430d-a685-89ff4ec49f7c\") "
Oct 31 17:43:16.022588 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:16.022316    5003 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5f2c9613-4b8a-4452-b70a-2ed258063318-workload-certs\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:43:16.022588 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:16.022340    5003 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/503ff30a-8065-430d-a685-89ff4ec49f7c-workload-socket\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:43:16.022588 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:16.022355    5003 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/503ff30a-8065-430d-a685-89ff4ec49f7c-credential-socket\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:43:16.022588 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:16.022372    5003 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/eeb8afc2-1a66-4c38-9fb3-04ccd09083a2-istio-data\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:43:16.023176 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:16.020927    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5f2c9613-4b8a-4452-b70a-2ed258063318-workload-socket" pod "5f2c9613-4b8a-4452-b70a-2ed258063318" (UID: "5f2c9613-4b8a-4452-b70a-2ed258063318"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 17:43:16.023176 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:16.021044    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/503ff30a-8065-430d-a685-89ff4ec49f7c-istiod-ca-cert" pod "503ff30a-8065-430d-a685-89ff4ec49f7c" (UID: "503ff30a-8065-430d-a685-89ff4ec49f7c"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 17:43:16.023176 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:16.022293    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5f2c9613-4b8a-4452-b70a-2ed258063318-istiod-ca-cert" pod "5f2c9613-4b8a-4452-b70a-2ed258063318" (UID: "5f2c9613-4b8a-4452-b70a-2ed258063318"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 17:43:16.023176 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:16.022749    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eeb8afc2-1a66-4c38-9fb3-04ccd09083a2-workload-socket" pod "eeb8afc2-1a66-4c38-9fb3-04ccd09083a2" (UID: "eeb8afc2-1a66-4c38-9fb3-04ccd09083a2"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 17:43:16.023176 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:16.022874    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/eeb8afc2-1a66-4c38-9fb3-04ccd09083a2-istiod-ca-cert" pod "eeb8afc2-1a66-4c38-9fb3-04ccd09083a2" (UID: "eeb8afc2-1a66-4c38-9fb3-04ccd09083a2"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 17:43:16.025135 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:16.024960    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eeb8afc2-1a66-4c38-9fb3-04ccd09083a2-kube-api-access-bbd9f" pod "eeb8afc2-1a66-4c38-9fb3-04ccd09083a2" (UID: "eeb8afc2-1a66-4c38-9fb3-04ccd09083a2"). InnerVolumeSpecName "kube-api-access-bbd9f". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 17:43:16.025135 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:16.025092    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5f2c9613-4b8a-4452-b70a-2ed258063318-credential-socket" pod "5f2c9613-4b8a-4452-b70a-2ed258063318" (UID: "5f2c9613-4b8a-4452-b70a-2ed258063318"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 17:43:16.026951 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:16.026073    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eeb8afc2-1a66-4c38-9fb3-04ccd09083a2-credential-socket" pod "eeb8afc2-1a66-4c38-9fb3-04ccd09083a2" (UID: "eeb8afc2-1a66-4c38-9fb3-04ccd09083a2"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 17:43:16.026951 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:16.026356    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/503ff30a-8065-430d-a685-89ff4ec49f7c-workload-certs" pod "503ff30a-8065-430d-a685-89ff4ec49f7c" (UID: "503ff30a-8065-430d-a685-89ff4ec49f7c"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 17:43:16.026951 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:16.026385    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/503ff30a-8065-430d-a685-89ff4ec49f7c-istio-envoy" pod "503ff30a-8065-430d-a685-89ff4ec49f7c" (UID: "503ff30a-8065-430d-a685-89ff4ec49f7c"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 17:43:16.026951 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:16.026675    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eeb8afc2-1a66-4c38-9fb3-04ccd09083a2-workload-certs" pod "eeb8afc2-1a66-4c38-9fb3-04ccd09083a2" (UID: "eeb8afc2-1a66-4c38-9fb3-04ccd09083a2"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 17:43:16.026951 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:16.026744    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5f2c9613-4b8a-4452-b70a-2ed258063318-kube-api-access-zlbc6" pod "5f2c9613-4b8a-4452-b70a-2ed258063318" (UID: "5f2c9613-4b8a-4452-b70a-2ed258063318"). InnerVolumeSpecName "kube-api-access-zlbc6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 17:43:16.027694 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:16.027334    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/503ff30a-8065-430d-a685-89ff4ec49f7c-istio-data" pod "503ff30a-8065-430d-a685-89ff4ec49f7c" (UID: "503ff30a-8065-430d-a685-89ff4ec49f7c"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 17:43:16.027694 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:16.027420    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/503ff30a-8065-430d-a685-89ff4ec49f7c-istio-token" pod "503ff30a-8065-430d-a685-89ff4ec49f7c" (UID: "503ff30a-8065-430d-a685-89ff4ec49f7c"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 17:43:16.028061 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:16.028021    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5f2c9613-4b8a-4452-b70a-2ed258063318-istio-data" pod "5f2c9613-4b8a-4452-b70a-2ed258063318" (UID: "5f2c9613-4b8a-4452-b70a-2ed258063318"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 17:43:16.028428 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:16.028398    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/eeb8afc2-1a66-4c38-9fb3-04ccd09083a2-istio-podinfo" pod "eeb8afc2-1a66-4c38-9fb3-04ccd09083a2" (UID: "eeb8afc2-1a66-4c38-9fb3-04ccd09083a2"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 31 17:43:16.029213 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:16.029183    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/5f2c9613-4b8a-4452-b70a-2ed258063318-istio-podinfo" pod "5f2c9613-4b8a-4452-b70a-2ed258063318" (UID: "5f2c9613-4b8a-4452-b70a-2ed258063318"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 31 17:43:16.029213 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:16.029205    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5f2c9613-4b8a-4452-b70a-2ed258063318-istio-token" pod "5f2c9613-4b8a-4452-b70a-2ed258063318" (UID: "5f2c9613-4b8a-4452-b70a-2ed258063318"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 17:43:16.029373 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:16.029258    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eeb8afc2-1a66-4c38-9fb3-04ccd09083a2-istio-token" pod "eeb8afc2-1a66-4c38-9fb3-04ccd09083a2" (UID: "eeb8afc2-1a66-4c38-9fb3-04ccd09083a2"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 17:43:16.029853 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:16.029819    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/503ff30a-8065-430d-a685-89ff4ec49f7c-kube-api-access-2v8gn" pod "503ff30a-8065-430d-a685-89ff4ec49f7c" (UID: "503ff30a-8065-430d-a685-89ff4ec49f7c"). InnerVolumeSpecName "kube-api-access-2v8gn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 17:43:16.030447 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:16.030417    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eeb8afc2-1a66-4c38-9fb3-04ccd09083a2-istio-envoy" pod "eeb8afc2-1a66-4c38-9fb3-04ccd09083a2" (UID: "eeb8afc2-1a66-4c38-9fb3-04ccd09083a2"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 17:43:16.030872 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:16.030849    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5f2c9613-4b8a-4452-b70a-2ed258063318-istio-envoy" pod "5f2c9613-4b8a-4452-b70a-2ed258063318" (UID: "5f2c9613-4b8a-4452-b70a-2ed258063318"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 17:43:16.030939 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:16.030854    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/503ff30a-8065-430d-a685-89ff4ec49f7c-istio-podinfo" pod "503ff30a-8065-430d-a685-89ff4ec49f7c" (UID: "503ff30a-8065-430d-a685-89ff4ec49f7c"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 31 17:43:16.124088 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:16.124048    5003 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/503ff30a-8065-430d-a685-89ff4ec49f7c-istio-data\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:43:16.124088 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:16.124082    5003 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5f2c9613-4b8a-4452-b70a-2ed258063318-istio-token\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:43:16.124088 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:16.124092    5003 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5f2c9613-4b8a-4452-b70a-2ed258063318-istio-envoy\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:43:16.124332 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:16.124101    5003 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/eeb8afc2-1a66-4c38-9fb3-04ccd09083a2-workload-certs\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:43:16.124332 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:16.124111    5003 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2v8gn\" (UniqueName: \"kubernetes.io/projected/503ff30a-8065-430d-a685-89ff4ec49f7c-kube-api-access-2v8gn\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:43:16.124332 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:16.124122    5003 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5f2c9613-4b8a-4452-b70a-2ed258063318-workload-socket\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:43:16.124332 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:16.124131    5003 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5f2c9613-4b8a-4452-b70a-2ed258063318-istio-data\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:43:16.124332 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:16.124140    5003 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bbd9f\" (UniqueName: \"kubernetes.io/projected/eeb8afc2-1a66-4c38-9fb3-04ccd09083a2-kube-api-access-bbd9f\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:43:16.124332 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:16.124148    5003 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/eeb8afc2-1a66-4c38-9fb3-04ccd09083a2-istiod-ca-cert\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:43:16.124332 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:16.124157    5003 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/503ff30a-8065-430d-a685-89ff4ec49f7c-istiod-ca-cert\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:43:16.124332 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:16.124165    5003 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5f2c9613-4b8a-4452-b70a-2ed258063318-istio-podinfo\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:43:16.124332 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:16.124172    5003 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/eeb8afc2-1a66-4c38-9fb3-04ccd09083a2-workload-socket\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:43:16.124332 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:16.124180    5003 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5f2c9613-4b8a-4452-b70a-2ed258063318-credential-socket\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:43:16.124332 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:16.124188    5003 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/eeb8afc2-1a66-4c38-9fb3-04ccd09083a2-istio-podinfo\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:43:16.124332 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:16.124196    5003 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/eeb8afc2-1a66-4c38-9fb3-04ccd09083a2-credential-socket\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:43:16.124332 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:16.124204    5003 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/503ff30a-8065-430d-a685-89ff4ec49f7c-istio-envoy\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:43:16.124332 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:16.124213    5003 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/eeb8afc2-1a66-4c38-9fb3-04ccd09083a2-istio-envoy\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:43:16.124332 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:16.124220    5003 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zlbc6\" (UniqueName: \"kubernetes.io/projected/5f2c9613-4b8a-4452-b70a-2ed258063318-kube-api-access-zlbc6\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:43:16.124332 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:16.124228    5003 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/503ff30a-8065-430d-a685-89ff4ec49f7c-workload-certs\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:43:16.124332 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:16.124236    5003 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/eeb8afc2-1a66-4c38-9fb3-04ccd09083a2-istio-token\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:43:16.124332 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:16.124246    5003 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5f2c9613-4b8a-4452-b70a-2ed258063318-istiod-ca-cert\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:43:16.124332 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:16.124254    5003 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/503ff30a-8065-430d-a685-89ff4ec49f7c-istio-token\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:43:16.124332 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:16.124263    5003 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/503ff30a-8065-430d-a685-89ff4ec49f7c-istio-podinfo\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:43:16.250263 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:16.250229    5003 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w6-d80080-openshift-default-956cddf57-x6xxp"]
Oct 31 17:43:16.256931 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:16.256897    5003 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w6-d80080-openshift-default-956cddf57-x6xxp"]
Oct 31 17:43:16.914399 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:16.914371    5003 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-d80080-openshift-default-956cddf57-rdglw"
Oct 31 17:43:16.914897 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:16.914403    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-d80080-openshift-default-956cddf57-rdglw" event={"ID":"eeb8afc2-1a66-4c38-9fb3-04ccd09083a2","Type":"ContainerDied","Data":"1d0f7f5002977c44ed2bbf16139ffb1511ce6e250d55283e5cd12ae16469c630"}
Oct 31 17:43:16.914897 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:16.914479    5003 scope.go:122] "RemoveContainer" containerID="be1050371aa22276cd09f5b713b4e73dc04fb13672cd698f040abcd330a127b8"
Oct 31 17:43:16.917082 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:16.917063    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-d80080-openshift-default-956cddf57-5f59v" event={"ID":"503ff30a-8065-430d-a685-89ff4ec49f7c","Type":"ContainerDied","Data":"fa352262ad4303017f0576c2e25f4449334a5700194562b3d8d27b7f3d673a24"}
Oct 31 17:43:16.917082 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:16.917076    5003 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-d80080-openshift-default-956cddf57-5f59v"
Oct 31 17:43:16.925231 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:16.925124    5003 scope.go:122] "RemoveContainer" containerID="930ee319f56552eab82e08d8295978dd5d31efa037697ee5b6f837684ca1b6d6"
Oct 31 17:43:16.982068 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:16.982036    5003 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w6-d80080-openshift-default-956cddf57-5f59v"]
Oct 31 17:43:16.994698 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:16.994672    5003 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w6-d80080-openshift-default-956cddf57-5f59v"]
Oct 31 17:43:17.026770 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:17.026737    5003 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w6-d80080-openshift-default-956cddf57-rdglw"]
Oct 31 17:43:17.032826 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:17.032799    5003 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w6-d80080-openshift-default-956cddf57-rdglw"]
Oct 31 17:43:17.895788 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:17.895755    5003 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="503ff30a-8065-430d-a685-89ff4ec49f7c" path="/var/lib/kubelet/pods/503ff30a-8065-430d-a685-89ff4ec49f7c/volumes"
Oct 31 17:43:17.896265 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:17.896248    5003 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="5f2c9613-4b8a-4452-b70a-2ed258063318" path="/var/lib/kubelet/pods/5f2c9613-4b8a-4452-b70a-2ed258063318/volumes"
Oct 31 17:43:17.896772 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:17.896750    5003 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="eeb8afc2-1a66-4c38-9fb3-04ccd09083a2" path="/var/lib/kubelet/pods/eeb8afc2-1a66-4c38-9fb3-04ccd09083a2/volumes"
Oct 31 17:43:36.217417 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:36.217372    5003 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-85237e45-xj79v"]
Oct 31 17:43:36.217989 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:36.217969    5003 cpu_manager.go:414] "containerMap: removing container" podUID="4482b94f-d7f9-4575-b22e-765dfd4ad693" containerName="istio-proxy"
Oct 31 17:43:36.217989 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:36.217990    5003 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="4482b94f-d7f9-4575-b22e-765dfd4ad693" containerName="istio-proxy"
Oct 31 17:43:36.218093 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:36.218001    5003 cpu_manager.go:414] "containerMap: removing container" podUID="a115d540-ac87-497f-97f8-bd2e52d066f7" containerName="istio-proxy"
Oct 31 17:43:36.218093 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:36.218008    5003 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="a115d540-ac87-497f-97f8-bd2e52d066f7" containerName="istio-proxy"
Oct 31 17:43:36.218093 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:36.218019    5003 cpu_manager.go:414] "containerMap: removing container" podUID="503ff30a-8065-430d-a685-89ff4ec49f7c" containerName="istio-proxy"
Oct 31 17:43:36.218093 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:36.218024    5003 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="503ff30a-8065-430d-a685-89ff4ec49f7c" containerName="istio-proxy"
Oct 31 17:43:36.218093 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:36.218031    5003 cpu_manager.go:414] "containerMap: removing container" podUID="7a49c490-67e7-4f7e-8ce9-11def81392e4" containerName="payload-processing"
Oct 31 17:43:36.218093 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:36.218036    5003 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="7a49c490-67e7-4f7e-8ce9-11def81392e4" containerName="payload-processing"
Oct 31 17:43:36.218093 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:36.218043    5003 cpu_manager.go:414] "containerMap: removing container" podUID="c04e8e25-b143-4ff0-85d4-a5f8e569887f" containerName="revoke-keys"
Oct 31 17:43:36.218093 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:36.218048    5003 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="c04e8e25-b143-4ff0-85d4-a5f8e569887f" containerName="revoke-keys"
Oct 31 17:43:36.218093 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:36.218055    5003 cpu_manager.go:414] "containerMap: removing container" podUID="eeb8afc2-1a66-4c38-9fb3-04ccd09083a2" containerName="istio-proxy"
Oct 31 17:43:36.218093 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:36.218059    5003 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="eeb8afc2-1a66-4c38-9fb3-04ccd09083a2" containerName="istio-proxy"
Oct 31 17:43:36.218093 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:36.218065    5003 cpu_manager.go:414] "containerMap: removing container" podUID="679da5c1-9c28-4f80-a210-185350147f11" containerName="istio-proxy"
Oct 31 17:43:36.218093 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:36.218069    5003 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="679da5c1-9c28-4f80-a210-185350147f11" containerName="istio-proxy"
Oct 31 17:43:36.218093 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:36.218077    5003 cpu_manager.go:414] "containerMap: removing container" podUID="92a031e7-6d59-4493-b15d-7dc213289f55" containerName="istio-proxy"
Oct 31 17:43:36.218093 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:36.218081    5003 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="92a031e7-6d59-4493-b15d-7dc213289f55" containerName="istio-proxy"
Oct 31 17:43:36.218093 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:36.218090    5003 cpu_manager.go:414] "containerMap: removing container" podUID="d0144654-e609-4e0f-9c06-7522cefcf9f0" containerName="payload-pre-processing"
Oct 31 17:43:36.218093 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:36.218095    5003 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="d0144654-e609-4e0f-9c06-7522cefcf9f0" containerName="payload-pre-processing"
Oct 31 17:43:36.218552 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:36.218106    5003 cpu_manager.go:414] "containerMap: removing container" podUID="faeea853-aa53-4bb6-9a85-4e55772556b2" containerName="maas-api"
Oct 31 17:43:36.218552 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:36.218111    5003 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="faeea853-aa53-4bb6-9a85-4e55772556b2" containerName="maas-api"
Oct 31 17:43:36.218552 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:36.218117    5003 cpu_manager.go:414] "containerMap: removing container" podUID="6eff589e-d19b-4ea9-898e-85009de000eb" containerName="payload-processing"
Oct 31 17:43:36.218552 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:36.218121    5003 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="6eff589e-d19b-4ea9-898e-85009de000eb" containerName="payload-processing"
Oct 31 17:43:36.218552 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:36.218126    5003 cpu_manager.go:414] "containerMap: removing container" podUID="4482b94f-d7f9-4575-b22e-765dfd4ad693" containerName="istio-proxy"
Oct 31 17:43:36.218552 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:36.218130    5003 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="4482b94f-d7f9-4575-b22e-765dfd4ad693" containerName="istio-proxy"
Oct 31 17:43:36.218552 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:36.218135    5003 cpu_manager.go:414] "containerMap: removing container" podUID="8a6f3fb4-846a-43aa-9309-48c6ca558850" containerName="istio-proxy"
Oct 31 17:43:36.218552 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:36.218140    5003 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="8a6f3fb4-846a-43aa-9309-48c6ca558850" containerName="istio-proxy"
Oct 31 17:43:36.218552 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:36.218146    5003 cpu_manager.go:414] "containerMap: removing container" podUID="ebe4bd91-be4d-4d45-89f7-5aa595b9e2aa" containerName="istio-proxy"
Oct 31 17:43:36.218552 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:36.218151    5003 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="ebe4bd91-be4d-4d45-89f7-5aa595b9e2aa" containerName="istio-proxy"
Oct 31 17:43:36.218552 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:36.218158    5003 cpu_manager.go:414] "containerMap: removing container" podUID="b0a16d54-5d2c-4c23-bf11-9cfe1844b568" containerName="istio-proxy"
Oct 31 17:43:36.218552 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:36.218162    5003 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="b0a16d54-5d2c-4c23-bf11-9cfe1844b568" containerName="istio-proxy"
Oct 31 17:43:36.218552 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:36.218169    5003 cpu_manager.go:414] "containerMap: removing container" podUID="0711a80f-6f89-4949-aef2-a3281e637712" containerName="istio-proxy"
Oct 31 17:43:36.218552 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:36.218173    5003 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="0711a80f-6f89-4949-aef2-a3281e637712" containerName="istio-proxy"
Oct 31 17:43:36.218552 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:36.218181    5003 cpu_manager.go:414] "containerMap: removing container" podUID="61193be6-6ada-48ff-9e96-700c73f018dd" containerName="istio-proxy"
Oct 31 17:43:36.218552 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:36.218185    5003 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="61193be6-6ada-48ff-9e96-700c73f018dd" containerName="istio-proxy"
Oct 31 17:43:36.218552 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:36.218192    5003 cpu_manager.go:414] "containerMap: removing container" podUID="73f3a3b3-a5dd-4054-be25-5e23a820c5fe" containerName="istio-proxy"
Oct 31 17:43:36.218552 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:36.218196    5003 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="73f3a3b3-a5dd-4054-be25-5e23a820c5fe" containerName="istio-proxy"
Oct 31 17:43:36.218552 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:36.218202    5003 cpu_manager.go:414] "containerMap: removing container" podUID="a79988d8-d286-43ae-914b-bd1f6db3eb11" containerName="istio-proxy"
Oct 31 17:43:36.218552 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:36.218207    5003 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="a79988d8-d286-43ae-914b-bd1f6db3eb11" containerName="istio-proxy"
Oct 31 17:43:36.218552 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:36.218214    5003 cpu_manager.go:414] "containerMap: removing container" podUID="80900980-7b5e-4d15-a9db-279185d25b57" containerName="istio-proxy"
Oct 31 17:43:36.218552 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:36.218218    5003 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="80900980-7b5e-4d15-a9db-279185d25b57" containerName="istio-proxy"
Oct 31 17:43:36.218552 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:36.218224    5003 cpu_manager.go:414] "containerMap: removing container" podUID="2335abae-520f-4557-8ffd-ab60cbb68812" containerName="payload-pre-processing"
Oct 31 17:43:36.218552 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:36.218229    5003 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="2335abae-520f-4557-8ffd-ab60cbb68812" containerName="payload-pre-processing"
Oct 31 17:43:36.218552 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:36.218238    5003 cpu_manager.go:414] "containerMap: removing container" podUID="5f2c9613-4b8a-4452-b70a-2ed258063318" containerName="istio-proxy"
Oct 31 17:43:36.218552 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:36.218242    5003 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="5f2c9613-4b8a-4452-b70a-2ed258063318" containerName="istio-proxy"
Oct 31 17:43:36.218552 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:36.218247    5003 cpu_manager.go:414] "containerMap: removing container" podUID="9bf16293-fd1c-421b-9f91-3c7178ed7cd3" containerName="istio-proxy"
Oct 31 17:43:36.218552 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:36.218251    5003 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="9bf16293-fd1c-421b-9f91-3c7178ed7cd3" containerName="istio-proxy"
Oct 31 17:43:36.218552 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:36.218258    5003 cpu_manager.go:414] "containerMap: removing container" podUID="24b256e4-f9ad-4df2-ae67-bd7ddee0118e" containerName="revoke-keys"
Oct 31 17:43:36.218552 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:36.218262    5003 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="24b256e4-f9ad-4df2-ae67-bd7ddee0118e" containerName="revoke-keys"
Oct 31 17:43:36.218552 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:36.218269    5003 cpu_manager.go:414] "containerMap: removing container" podUID="6de961b6-2fb6-404d-9db2-594a7ef76ccb" containerName="istio-proxy"
Oct 31 17:43:36.218552 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:36.218273    5003 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="6de961b6-2fb6-404d-9db2-594a7ef76ccb" containerName="istio-proxy"
Oct 31 17:43:36.218552 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:36.218280    5003 cpu_manager.go:414] "containerMap: removing container" podUID="ef941538-5385-4d44-98cd-ffddd91e9dc5" containerName="istio-proxy"
Oct 31 17:43:36.218552 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:36.218285    5003 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="ef941538-5385-4d44-98cd-ffddd91e9dc5" containerName="istio-proxy"
Oct 31 17:43:36.218552 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:36.218291    5003 cpu_manager.go:414] "containerMap: removing container" podUID="a92e2f56-5eb4-4b64-9947-25e1f0d51c30" containerName="istio-proxy"
Oct 31 17:43:36.218552 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:36.218296    5003 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="a92e2f56-5eb4-4b64-9947-25e1f0d51c30" containerName="istio-proxy"
Oct 31 17:43:36.218552 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:36.218302    5003 cpu_manager.go:414] "containerMap: removing container" podUID="d6d7f818-43c5-4470-9799-6b6e6cebb928" containerName="payload-processing"
Oct 31 17:43:36.218552 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:36.218307    5003 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="d6d7f818-43c5-4470-9799-6b6e6cebb928" containerName="payload-processing"
Oct 31 17:43:36.218552 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:36.218314    5003 cpu_manager.go:414] "containerMap: removing container" podUID="a79988d8-d286-43ae-914b-bd1f6db3eb11" containerName="istio-proxy"
Oct 31 17:43:36.218552 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:36.218319    5003 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="a79988d8-d286-43ae-914b-bd1f6db3eb11" containerName="istio-proxy"
Oct 31 17:43:36.218552 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:36.218326    5003 cpu_manager.go:414] "containerMap: removing container" podUID="6c7cacb3-7045-4e9d-a2d6-9fabaa50af3d" containerName="istio-proxy"
Oct 31 17:43:36.218552 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:36.218330    5003 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="6c7cacb3-7045-4e9d-a2d6-9fabaa50af3d" containerName="istio-proxy"
Oct 31 17:43:36.218552 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:36.218338    5003 cpu_manager.go:414] "containerMap: removing container" podUID="6dbed28d-b3b9-4af1-82b7-40151ba418c1" containerName="istio-proxy"
Oct 31 17:43:36.218552 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:36.218342    5003 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="6dbed28d-b3b9-4af1-82b7-40151ba418c1" containerName="istio-proxy"
Oct 31 17:43:36.218552 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:36.218350    5003 cpu_manager.go:414] "containerMap: removing container" podUID="bfa2dbca-7f50-4a7a-97a7-e780fa561f47" containerName="revoke-keys"
Oct 31 17:43:36.218552 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:36.218354    5003 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="bfa2dbca-7f50-4a7a-97a7-e780fa561f47" containerName="revoke-keys"
Oct 31 17:43:36.218552 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:36.218360    5003 cpu_manager.go:414] "containerMap: removing container" podUID="d2652cf4-9d2a-480e-ad8a-946d0d4b90f3" containerName="istio-proxy"
Oct 31 17:43:36.218552 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:36.218364    5003 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="d2652cf4-9d2a-480e-ad8a-946d0d4b90f3" containerName="istio-proxy"
Oct 31 17:43:36.218552 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:36.218371    5003 cpu_manager.go:414] "containerMap: removing container" podUID="fa5b3d0d-4ae9-4f60-8af5-571df26ba157" containerName="istio-proxy"
Oct 31 17:43:36.218552 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:36.218376    5003 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="fa5b3d0d-4ae9-4f60-8af5-571df26ba157" containerName="istio-proxy"
Oct 31 17:43:36.218552 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:36.218385    5003 cpu_manager.go:414] "containerMap: removing container" podUID="3dac59b3-ae83-496f-87cb-16c7fd249497" containerName="istio-proxy"
Oct 31 17:43:36.218552 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:36.218389    5003 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="3dac59b3-ae83-496f-87cb-16c7fd249497" containerName="istio-proxy"
Oct 31 17:43:36.218552 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:36.218396    5003 cpu_manager.go:414] "containerMap: removing container" podUID="5f2c9613-4b8a-4452-b70a-2ed258063318" containerName="istio-proxy"
Oct 31 17:43:36.218552 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:36.218400    5003 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="5f2c9613-4b8a-4452-b70a-2ed258063318" containerName="istio-proxy"
Oct 31 17:43:36.218552 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:36.218406    5003 cpu_manager.go:414] "containerMap: removing container" podUID="06aa3682-3041-49d8-b240-761092b11dc9" containerName="payload-processing"
Oct 31 17:43:36.218552 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:36.218411    5003 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="06aa3682-3041-49d8-b240-761092b11dc9" containerName="payload-processing"
Oct 31 17:43:36.218552 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:36.218476    5003 memory_manager.go:365] "RemoveStaleState removing state" podUID="61193be6-6ada-48ff-9e96-700c73f018dd" containerName="istio-proxy"
Oct 31 17:43:36.218552 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:36.218484    5003 memory_manager.go:365] "RemoveStaleState removing state" podUID="73f3a3b3-a5dd-4054-be25-5e23a820c5fe" containerName="istio-proxy"
Oct 31 17:43:36.218552 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:36.218494    5003 memory_manager.go:365] "RemoveStaleState removing state" podUID="a79988d8-d286-43ae-914b-bd1f6db3eb11" containerName="istio-proxy"
Oct 31 17:43:36.218552 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:36.218500    5003 memory_manager.go:365] "RemoveStaleState removing state" podUID="80900980-7b5e-4d15-a9db-279185d25b57" containerName="istio-proxy"
Oct 31 17:43:36.218552 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:36.218506    5003 memory_manager.go:365] "RemoveStaleState removing state" podUID="2335abae-520f-4557-8ffd-ab60cbb68812" containerName="payload-pre-processing"
Oct 31 17:43:36.218552 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:36.218511    5003 memory_manager.go:365] "RemoveStaleState removing state" podUID="5f2c9613-4b8a-4452-b70a-2ed258063318" containerName="istio-proxy"
Oct 31 17:43:36.218552 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:36.218516    5003 memory_manager.go:365] "RemoveStaleState removing state" podUID="9bf16293-fd1c-421b-9f91-3c7178ed7cd3" containerName="istio-proxy"
Oct 31 17:43:36.218552 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:36.218521    5003 memory_manager.go:365] "RemoveStaleState removing state" podUID="24b256e4-f9ad-4df2-ae67-bd7ddee0118e" containerName="revoke-keys"
Oct 31 17:43:36.218552 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:36.218526    5003 memory_manager.go:365] "RemoveStaleState removing state" podUID="6de961b6-2fb6-404d-9db2-594a7ef76ccb" containerName="istio-proxy"
Oct 31 17:43:36.218552 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:36.218532    5003 memory_manager.go:365] "RemoveStaleState removing state" podUID="ef941538-5385-4d44-98cd-ffddd91e9dc5" containerName="istio-proxy"
Oct 31 17:43:36.218552 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:36.218538    5003 memory_manager.go:365] "RemoveStaleState removing state" podUID="a92e2f56-5eb4-4b64-9947-25e1f0d51c30" containerName="istio-proxy"
Oct 31 17:43:36.218552 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:36.218542    5003 memory_manager.go:365] "RemoveStaleState removing state" podUID="d6d7f818-43c5-4470-9799-6b6e6cebb928" containerName="payload-processing"
Oct 31 17:43:36.218552 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:36.218548    5003 memory_manager.go:365] "RemoveStaleState removing state" podUID="a79988d8-d286-43ae-914b-bd1f6db3eb11" containerName="istio-proxy"
Oct 31 17:43:36.218552 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:36.218553    5003 memory_manager.go:365] "RemoveStaleState removing state" podUID="6c7cacb3-7045-4e9d-a2d6-9fabaa50af3d" containerName="istio-proxy"
Oct 31 17:43:36.218552 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:36.218558    5003 memory_manager.go:365] "RemoveStaleState removing state" podUID="6dbed28d-b3b9-4af1-82b7-40151ba418c1" containerName="istio-proxy"
Oct 31 17:43:36.218552 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:36.218563    5003 memory_manager.go:365] "RemoveStaleState removing state" podUID="bfa2dbca-7f50-4a7a-97a7-e780fa561f47" containerName="revoke-keys"
Oct 31 17:43:36.218552 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:36.218568    5003 memory_manager.go:365] "RemoveStaleState removing state" podUID="d2652cf4-9d2a-480e-ad8a-946d0d4b90f3" containerName="istio-proxy"
Oct 31 17:43:36.218552 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:36.218574    5003 memory_manager.go:365] "RemoveStaleState removing state" podUID="fa5b3d0d-4ae9-4f60-8af5-571df26ba157" containerName="istio-proxy"
Oct 31 17:43:36.218552 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:36.218579    5003 memory_manager.go:365] "RemoveStaleState removing state" podUID="3dac59b3-ae83-496f-87cb-16c7fd249497" containerName="istio-proxy"
Oct 31 17:43:36.218552 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:36.218583    5003 memory_manager.go:365] "RemoveStaleState removing state" podUID="5f2c9613-4b8a-4452-b70a-2ed258063318" containerName="istio-proxy"
Oct 31 17:43:36.218552 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:36.218588    5003 memory_manager.go:365] "RemoveStaleState removing state" podUID="06aa3682-3041-49d8-b240-761092b11dc9" containerName="payload-processing"
Oct 31 17:43:36.218552 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:36.218593    5003 memory_manager.go:365] "RemoveStaleState removing state" podUID="4482b94f-d7f9-4575-b22e-765dfd4ad693" containerName="istio-proxy"
Oct 31 17:43:36.220803 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:36.218598    5003 memory_manager.go:365] "RemoveStaleState removing state" podUID="a115d540-ac87-497f-97f8-bd2e52d066f7" containerName="istio-proxy"
Oct 31 17:43:36.220803 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:36.218603    5003 memory_manager.go:365] "RemoveStaleState removing state" podUID="503ff30a-8065-430d-a685-89ff4ec49f7c" containerName="istio-proxy"
Oct 31 17:43:36.220803 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:36.218608    5003 memory_manager.go:365] "RemoveStaleState removing state" podUID="7a49c490-67e7-4f7e-8ce9-11def81392e4" containerName="payload-processing"
Oct 31 17:43:36.220803 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:36.218614    5003 memory_manager.go:365] "RemoveStaleState removing state" podUID="c04e8e25-b143-4ff0-85d4-a5f8e569887f" containerName="revoke-keys"
Oct 31 17:43:36.220803 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:36.218619    5003 memory_manager.go:365] "RemoveStaleState removing state" podUID="eeb8afc2-1a66-4c38-9fb3-04ccd09083a2" containerName="istio-proxy"
Oct 31 17:43:36.220803 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:36.218624    5003 memory_manager.go:365] "RemoveStaleState removing state" podUID="679da5c1-9c28-4f80-a210-185350147f11" containerName="istio-proxy"
Oct 31 17:43:36.220803 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:36.218629    5003 memory_manager.go:365] "RemoveStaleState removing state" podUID="92a031e7-6d59-4493-b15d-7dc213289f55" containerName="istio-proxy"
Oct 31 17:43:36.220803 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:36.218634    5003 memory_manager.go:365] "RemoveStaleState removing state" podUID="d0144654-e609-4e0f-9c06-7522cefcf9f0" containerName="payload-pre-processing"
Oct 31 17:43:36.220803 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:36.218639    5003 memory_manager.go:365] "RemoveStaleState removing state" podUID="faeea853-aa53-4bb6-9a85-4e55772556b2" containerName="maas-api"
Oct 31 17:43:36.220803 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:36.218656    5003 memory_manager.go:365] "RemoveStaleState removing state" podUID="6eff589e-d19b-4ea9-898e-85009de000eb" containerName="payload-processing"
Oct 31 17:43:36.220803 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:36.218661    5003 memory_manager.go:365] "RemoveStaleState removing state" podUID="4482b94f-d7f9-4575-b22e-765dfd4ad693" containerName="istio-proxy"
Oct 31 17:43:36.220803 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:36.218666    5003 memory_manager.go:365] "RemoveStaleState removing state" podUID="8a6f3fb4-846a-43aa-9309-48c6ca558850" containerName="istio-proxy"
Oct 31 17:43:36.220803 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:36.218671    5003 memory_manager.go:365] "RemoveStaleState removing state" podUID="ebe4bd91-be4d-4d45-89f7-5aa595b9e2aa" containerName="istio-proxy"
Oct 31 17:43:36.220803 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:36.218676    5003 memory_manager.go:365] "RemoveStaleState removing state" podUID="b0a16d54-5d2c-4c23-bf11-9cfe1844b568" containerName="istio-proxy"
Oct 31 17:43:36.220803 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:36.218682    5003 memory_manager.go:365] "RemoveStaleState removing state" podUID="0711a80f-6f89-4949-aef2-a3281e637712" containerName="istio-proxy"
Oct 31 17:43:36.222002 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:36.221982    5003 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-85237e45-xj79v"
Oct 31 17:43:36.239691 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:36.239658    5003 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-85237e45-xj79v"]
Oct 31 17:43:36.247369 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:36.247334    5003 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\""
Oct 31 17:43:36.247369 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:36.247336    5003 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-mr9x2\""
Oct 31 17:43:36.284446 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:36.284394    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/574515e7-2f46-4caa-96c8-0df032da4d27-maas-api-xks-ca\") pod \"maas-api-revoke-sub-85237e45-xj79v\" (UID: \"574515e7-2f46-4caa-96c8-0df032da4d27\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-85237e45-xj79v"
Oct 31 17:43:36.284632 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:36.284518    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/574515e7-2f46-4caa-96c8-0df032da4d27-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-85237e45-xj79v\" (UID: \"574515e7-2f46-4caa-96c8-0df032da4d27\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-85237e45-xj79v"
Oct 31 17:43:36.284632 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:36.284574    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lq6zq\" (UniqueName: \"kubernetes.io/projected/574515e7-2f46-4caa-96c8-0df032da4d27-kube-api-access-lq6zq\") pod \"maas-api-revoke-sub-85237e45-xj79v\" (UID: \"574515e7-2f46-4caa-96c8-0df032da4d27\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-85237e45-xj79v"
Oct 31 17:43:36.385679 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:36.385591    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lq6zq\" (UniqueName: \"kubernetes.io/projected/574515e7-2f46-4caa-96c8-0df032da4d27-kube-api-access-lq6zq\") pod \"maas-api-revoke-sub-85237e45-xj79v\" (UID: \"574515e7-2f46-4caa-96c8-0df032da4d27\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-85237e45-xj79v"
Oct 31 17:43:36.385845 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:36.385744    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/574515e7-2f46-4caa-96c8-0df032da4d27-maas-api-xks-ca\") pod \"maas-api-revoke-sub-85237e45-xj79v\" (UID: \"574515e7-2f46-4caa-96c8-0df032da4d27\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-85237e45-xj79v"
Oct 31 17:43:36.385845 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:36.385805    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/574515e7-2f46-4caa-96c8-0df032da4d27-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-85237e45-xj79v\" (UID: \"574515e7-2f46-4caa-96c8-0df032da4d27\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-85237e45-xj79v"
Oct 31 17:43:36.386466 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:36.386444    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/574515e7-2f46-4caa-96c8-0df032da4d27-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-85237e45-xj79v\" (UID: \"574515e7-2f46-4caa-96c8-0df032da4d27\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-85237e45-xj79v"
Oct 31 17:43:36.388129 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:36.388106    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/574515e7-2f46-4caa-96c8-0df032da4d27-maas-api-xks-ca\") pod \"maas-api-revoke-sub-85237e45-xj79v\" (UID: \"574515e7-2f46-4caa-96c8-0df032da4d27\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-85237e45-xj79v"
Oct 31 17:43:36.404232 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:36.404200    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lq6zq\" (UniqueName: \"kubernetes.io/projected/574515e7-2f46-4caa-96c8-0df032da4d27-kube-api-access-lq6zq\") pod \"maas-api-revoke-sub-85237e45-xj79v\" (UID: \"574515e7-2f46-4caa-96c8-0df032da4d27\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-85237e45-xj79v"
Oct 31 17:43:36.536139 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:36.536049    5003 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-85237e45-xj79v"
Oct 31 17:43:36.839575 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:36.839540    5003 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-85237e45-xj79v"]
Oct 31 17:43:36.842001 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:43:36.841974    5003 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod574515e7_2f46_4caa_96c8_0df032da4d27.slice/crio-05a6251a629894f90c7057b037004859373e7f02231b75e784d1349a4d49df38 WatchSource:0}: Error finding container 05a6251a629894f90c7057b037004859373e7f02231b75e784d1349a4d49df38: Status 404 returned error can't find the container with id 05a6251a629894f90c7057b037004859373e7f02231b75e784d1349a4d49df38
Oct 31 17:43:37.084082 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:37.084048    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-85237e45-xj79v" event={"ID":"574515e7-2f46-4caa-96c8-0df032da4d27","Type":"ContainerStarted","Data":"05a6251a629894f90c7057b037004859373e7f02231b75e784d1349a4d49df38"}
Oct 31 17:43:38.092856 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:38.092816    5003 generic.go:356] "Generic (PLEG): container finished" podID="574515e7-2f46-4caa-96c8-0df032da4d27" containerID="1389de1c6382c631bfd366e867a9200f315fd8b76b6d3252b00bb4842df4e2be" exitCode=0
Oct 31 17:43:38.093287 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:38.092877    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-85237e45-xj79v" event={"ID":"574515e7-2f46-4caa-96c8-0df032da4d27","Type":"ContainerDied","Data":"1389de1c6382c631bfd366e867a9200f315fd8b76b6d3252b00bb4842df4e2be"}
Oct 31 17:43:39.256285 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:39.256256    5003 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-85237e45-xj79v"
Oct 31 17:43:39.311013 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:39.310958    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/574515e7-2f46-4caa-96c8-0df032da4d27-kube-api-access-lq6zq\" (UniqueName: \"kubernetes.io/projected/574515e7-2f46-4caa-96c8-0df032da4d27-kube-api-access-lq6zq\") pod \"574515e7-2f46-4caa-96c8-0df032da4d27\" (UID: \"574515e7-2f46-4caa-96c8-0df032da4d27\") "
Oct 31 17:43:39.311219 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:39.311093    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/574515e7-2f46-4caa-96c8-0df032da4d27-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/574515e7-2f46-4caa-96c8-0df032da4d27-maas-api-xks-ca\") pod \"574515e7-2f46-4caa-96c8-0df032da4d27\" (UID: \"574515e7-2f46-4caa-96c8-0df032da4d27\") "
Oct 31 17:43:39.311219 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:39.311166    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/574515e7-2f46-4caa-96c8-0df032da4d27-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/574515e7-2f46-4caa-96c8-0df032da4d27-maas-api-openshift-ca\") pod \"574515e7-2f46-4caa-96c8-0df032da4d27\" (UID: \"574515e7-2f46-4caa-96c8-0df032da4d27\") "
Oct 31 17:43:39.312408 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:39.312283    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/574515e7-2f46-4caa-96c8-0df032da4d27-maas-api-openshift-ca" pod "574515e7-2f46-4caa-96c8-0df032da4d27" (UID: "574515e7-2f46-4caa-96c8-0df032da4d27"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 17:43:39.314321 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:39.314280    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/574515e7-2f46-4caa-96c8-0df032da4d27-maas-api-xks-ca" pod "574515e7-2f46-4caa-96c8-0df032da4d27" (UID: "574515e7-2f46-4caa-96c8-0df032da4d27"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 17:43:39.314577 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:39.314549    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/574515e7-2f46-4caa-96c8-0df032da4d27-kube-api-access-lq6zq" pod "574515e7-2f46-4caa-96c8-0df032da4d27" (UID: "574515e7-2f46-4caa-96c8-0df032da4d27"). InnerVolumeSpecName "kube-api-access-lq6zq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 17:43:39.413415 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:39.413302    5003 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/574515e7-2f46-4caa-96c8-0df032da4d27-maas-api-openshift-ca\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:43:39.413415 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:39.413340    5003 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lq6zq\" (UniqueName: \"kubernetes.io/projected/574515e7-2f46-4caa-96c8-0df032da4d27-kube-api-access-lq6zq\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:43:39.413415 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:39.413349    5003 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/574515e7-2f46-4caa-96c8-0df032da4d27-maas-api-xks-ca\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:43:40.113730 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:40.113682    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-85237e45-xj79v" event={"ID":"574515e7-2f46-4caa-96c8-0df032da4d27","Type":"ContainerDied","Data":"05a6251a629894f90c7057b037004859373e7f02231b75e784d1349a4d49df38"}
Oct 31 17:43:40.114043 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:40.114016    5003 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="05a6251a629894f90c7057b037004859373e7f02231b75e784d1349a4d49df38"
Oct 31 17:43:40.114043 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:40.113737    5003 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-85237e45-xj79v"
Oct 31 17:43:40.284974 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:40.284863    5003 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-7d9897b54c-9t8k2 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.88:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 31 17:43:40.284974 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:40.284930    5003 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-9t8k2" podUID="c8d0a165-562c-4602-95fe-35a62229fa4f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.88:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 31 17:43:40.334197 ip-10-0-138-17 kubenswrapper[5003]: E1031 17:43:40.334159    5003 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-tdzz5" containerName="extractor"
Oct 31 17:43:42.026713 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:42.026672    5003 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-d0e7e8d8-gd524"]
Oct 31 17:43:42.038863 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:42.038827    5003 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-bc1ad3da-t9n2g"]
Oct 31 17:43:42.042630 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:42.042599    5003 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-d0e7e8d8-gd524"]
Oct 31 17:43:42.046279 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:42.046248    5003 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-bc1ad3da-t9n2g"]
Oct 31 17:43:43.888264 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:43.888225    5003 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="3155b804-e954-4f24-b64a-4a8e67739528" path="/var/lib/kubelet/pods/3155b804-e954-4f24-b64a-4a8e67739528/volumes"
Oct 31 17:43:43.888689 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:43.888675    5003 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="fc448460-87b4-41b3-b2c6-4e00d0b6e25c" path="/var/lib/kubelet/pods/fc448460-87b4-41b3-b2c6-4e00d0b6e25c/volumes"
Oct 31 17:43:54.029734 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:54.029696    5003 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-919cd635-fcsdj"]
Oct 31 17:43:54.041526 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:54.041489    5003 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-919cd635-fcsdj"]
Oct 31 17:43:55.888124 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:55.888084    5003 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="a37e40b6-68ba-4367-8cf2-b9b19746a86c" path="/var/lib/kubelet/pods/a37e40b6-68ba-4367-8cf2-b9b19746a86c/volumes"
Oct 31 17:43:56.026179 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:56.026128    5003 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-2889a968-f6cjs"]
Oct 31 17:43:56.038473 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:56.038435    5003 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-2889a968-f6cjs"]
Oct 31 17:43:57.888391 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:43:57.888352    5003 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="648faf0c-2e71-4e54-a4e6-272fe66e3ff5" path="/var/lib/kubelet/pods/648faf0c-2e71-4e54-a4e6-272fe66e3ff5/volumes"
Oct 31 17:44:01.022719 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:44:01.022681    5003 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-8ad4e6ed-xlf2v"]
Oct 31 17:44:01.034186 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:44:01.034157    5003 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-8ad4e6ed-xlf2v"]
Oct 31 17:44:01.888795 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:44:01.888761    5003 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="1d7b028c-1d18-4968-88ec-de1d9819ecb0" path="/var/lib/kubelet/pods/1d7b028c-1d18-4968-88ec-de1d9819ecb0/volumes"
Oct 31 17:44:10.027545 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:44:10.027508    5003 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-704f6c6f-ckzl2"]
Oct 31 17:44:10.039003 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:44:10.038979    5003 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-704f6c6f-ckzl2"]
Oct 31 17:44:10.332707 ip-10-0-138-17 kubenswrapper[5003]: E1031 17:44:10.332668    5003 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-tdzz5" containerName="extractor"
Oct 31 17:44:11.889167 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:44:11.889132    5003 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="2f3905d1-f623-4b53-ac3d-559fb3962829" path="/var/lib/kubelet/pods/2f3905d1-f623-4b53-ac3d-559fb3962829/volumes"
Oct 31 17:44:14.029726 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:44:14.029692    5003 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-bdc4aed9-92pw2"]
Oct 31 17:44:14.041700 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:44:14.041669    5003 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-bdc4aed9-92pw2"]
Oct 31 17:44:15.888910 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:44:15.888878    5003 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="cfc1b6b5-4f20-4900-9ad3-6cd1e7d8ce00" path="/var/lib/kubelet/pods/cfc1b6b5-4f20-4900-9ad3-6cd1e7d8ce00/volumes"
Oct 31 17:44:20.028601 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:44:20.028563    5003 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-6a23a398-h96sh"]
Oct 31 17:44:20.039968 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:44:20.039941    5003 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-6a23a398-h96sh"]
Oct 31 17:44:21.893433 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:44:21.893394    5003 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="88300b82-aa25-4290-8b52-9b6847c953d8" path="/var/lib/kubelet/pods/88300b82-aa25-4290-8b52-9b6847c953d8/volumes"
Oct 31 17:44:34.991311 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:44:34.991228    5003 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-c1e271a9-nv27v"]
Oct 31 17:44:34.991787 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:44:34.991674    5003 cpu_manager.go:414] "containerMap: removing container" podUID="574515e7-2f46-4caa-96c8-0df032da4d27" containerName="revoke-keys"
Oct 31 17:44:34.991787 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:44:34.991688    5003 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="574515e7-2f46-4caa-96c8-0df032da4d27" containerName="revoke-keys"
Oct 31 17:44:34.991872 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:44:34.991793    5003 memory_manager.go:365] "RemoveStaleState removing state" podUID="574515e7-2f46-4caa-96c8-0df032da4d27" containerName="revoke-keys"
Oct 31 17:44:34.995108 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:44:34.995092    5003 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-c1e271a9-nv27v"
Oct 31 17:44:35.009238 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:44:35.009209    5003 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\""
Oct 31 17:44:35.021119 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:44:35.021090    5003 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-mr9x2\""
Oct 31 17:44:35.024691 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:44:35.024665    5003 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-c1e271a9-nv27v"]
Oct 31 17:44:35.067466 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:44:35.067430    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/63cbff5b-ac34-4694-bd1c-6227c682d961-maas-api-xks-ca\") pod \"maas-api-revoke-sub-c1e271a9-nv27v\" (UID: \"63cbff5b-ac34-4694-bd1c-6227c682d961\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-c1e271a9-nv27v"
Oct 31 17:44:35.067609 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:44:35.067496    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2dk8m\" (UniqueName: \"kubernetes.io/projected/63cbff5b-ac34-4694-bd1c-6227c682d961-kube-api-access-2dk8m\") pod \"maas-api-revoke-sub-c1e271a9-nv27v\" (UID: \"63cbff5b-ac34-4694-bd1c-6227c682d961\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-c1e271a9-nv27v"
Oct 31 17:44:35.067708 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:44:35.067604    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/63cbff5b-ac34-4694-bd1c-6227c682d961-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-c1e271a9-nv27v\" (UID: \"63cbff5b-ac34-4694-bd1c-6227c682d961\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-c1e271a9-nv27v"
Oct 31 17:44:35.168377 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:44:35.168343    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2dk8m\" (UniqueName: \"kubernetes.io/projected/63cbff5b-ac34-4694-bd1c-6227c682d961-kube-api-access-2dk8m\") pod \"maas-api-revoke-sub-c1e271a9-nv27v\" (UID: \"63cbff5b-ac34-4694-bd1c-6227c682d961\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-c1e271a9-nv27v"
Oct 31 17:44:35.168544 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:44:35.168398    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/63cbff5b-ac34-4694-bd1c-6227c682d961-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-c1e271a9-nv27v\" (UID: \"63cbff5b-ac34-4694-bd1c-6227c682d961\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-c1e271a9-nv27v"
Oct 31 17:44:35.168544 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:44:35.168449    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/63cbff5b-ac34-4694-bd1c-6227c682d961-maas-api-xks-ca\") pod \"maas-api-revoke-sub-c1e271a9-nv27v\" (UID: \"63cbff5b-ac34-4694-bd1c-6227c682d961\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-c1e271a9-nv27v"
Oct 31 17:44:35.169081 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:44:35.169060    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/63cbff5b-ac34-4694-bd1c-6227c682d961-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-c1e271a9-nv27v\" (UID: \"63cbff5b-ac34-4694-bd1c-6227c682d961\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-c1e271a9-nv27v"
Oct 31 17:44:35.170772 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:44:35.170754    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/63cbff5b-ac34-4694-bd1c-6227c682d961-maas-api-xks-ca\") pod \"maas-api-revoke-sub-c1e271a9-nv27v\" (UID: \"63cbff5b-ac34-4694-bd1c-6227c682d961\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-c1e271a9-nv27v"
Oct 31 17:44:35.186778 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:44:35.186754    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2dk8m\" (UniqueName: \"kubernetes.io/projected/63cbff5b-ac34-4694-bd1c-6227c682d961-kube-api-access-2dk8m\") pod \"maas-api-revoke-sub-c1e271a9-nv27v\" (UID: \"63cbff5b-ac34-4694-bd1c-6227c682d961\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-c1e271a9-nv27v"
Oct 31 17:44:35.308583 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:44:35.308558    5003 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-c1e271a9-nv27v"
Oct 31 17:44:35.608674 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:44:35.608630    5003 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-c1e271a9-nv27v"]
Oct 31 17:44:35.611507 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:44:35.611477    5003 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod63cbff5b_ac34_4694_bd1c_6227c682d961.slice/crio-504a4016cd7754e4297d2fd99d55ad1ea4e2b3505b87d948b5c82df0083fb6b3 WatchSource:0}: Error finding container 504a4016cd7754e4297d2fd99d55ad1ea4e2b3505b87d948b5c82df0083fb6b3: Status 404 returned error can't find the container with id 504a4016cd7754e4297d2fd99d55ad1ea4e2b3505b87d948b5c82df0083fb6b3
Oct 31 17:44:36.571406 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:44:36.571366    5003 generic.go:356] "Generic (PLEG): container finished" podID="63cbff5b-ac34-4694-bd1c-6227c682d961" containerID="c3b91be85e558f1f21fc7a4f190329414c1820d47181373522066a61ff1ed666" exitCode=0
Oct 31 17:44:36.571801 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:44:36.571458    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-c1e271a9-nv27v" event={"ID":"63cbff5b-ac34-4694-bd1c-6227c682d961","Type":"ContainerDied","Data":"c3b91be85e558f1f21fc7a4f190329414c1820d47181373522066a61ff1ed666"}
Oct 31 17:44:36.571801 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:44:36.571518    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-c1e271a9-nv27v" event={"ID":"63cbff5b-ac34-4694-bd1c-6227c682d961","Type":"ContainerStarted","Data":"504a4016cd7754e4297d2fd99d55ad1ea4e2b3505b87d948b5c82df0083fb6b3"}
Oct 31 17:44:37.716827 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:44:37.716803    5003 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-c1e271a9-nv27v"
Oct 31 17:44:37.792996 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:44:37.792955    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/63cbff5b-ac34-4694-bd1c-6227c682d961-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/63cbff5b-ac34-4694-bd1c-6227c682d961-maas-api-xks-ca\") pod \"63cbff5b-ac34-4694-bd1c-6227c682d961\" (UID: \"63cbff5b-ac34-4694-bd1c-6227c682d961\") "
Oct 31 17:44:37.793193 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:44:37.793020    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/63cbff5b-ac34-4694-bd1c-6227c682d961-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/63cbff5b-ac34-4694-bd1c-6227c682d961-maas-api-openshift-ca\") pod \"63cbff5b-ac34-4694-bd1c-6227c682d961\" (UID: \"63cbff5b-ac34-4694-bd1c-6227c682d961\") "
Oct 31 17:44:37.793193 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:44:37.793108    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/63cbff5b-ac34-4694-bd1c-6227c682d961-kube-api-access-2dk8m\" (UniqueName: \"kubernetes.io/projected/63cbff5b-ac34-4694-bd1c-6227c682d961-kube-api-access-2dk8m\") pod \"63cbff5b-ac34-4694-bd1c-6227c682d961\" (UID: \"63cbff5b-ac34-4694-bd1c-6227c682d961\") "
Oct 31 17:44:37.793449 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:44:37.793425    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/63cbff5b-ac34-4694-bd1c-6227c682d961-maas-api-openshift-ca" pod "63cbff5b-ac34-4694-bd1c-6227c682d961" (UID: "63cbff5b-ac34-4694-bd1c-6227c682d961"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 17:44:37.795275 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:44:37.795249    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/63cbff5b-ac34-4694-bd1c-6227c682d961-maas-api-xks-ca" pod "63cbff5b-ac34-4694-bd1c-6227c682d961" (UID: "63cbff5b-ac34-4694-bd1c-6227c682d961"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 17:44:37.795275 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:44:37.795259    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/63cbff5b-ac34-4694-bd1c-6227c682d961-kube-api-access-2dk8m" pod "63cbff5b-ac34-4694-bd1c-6227c682d961" (UID: "63cbff5b-ac34-4694-bd1c-6227c682d961"). InnerVolumeSpecName "kube-api-access-2dk8m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 17:44:37.894575 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:44:37.894478    5003 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2dk8m\" (UniqueName: \"kubernetes.io/projected/63cbff5b-ac34-4694-bd1c-6227c682d961-kube-api-access-2dk8m\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:44:37.894575 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:44:37.894519    5003 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/63cbff5b-ac34-4694-bd1c-6227c682d961-maas-api-xks-ca\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:44:37.894575 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:44:37.894535    5003 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/63cbff5b-ac34-4694-bd1c-6227c682d961-maas-api-openshift-ca\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:44:38.585565 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:44:38.585529    5003 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-c1e271a9-nv27v"
Oct 31 17:44:38.585772 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:44:38.585566    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-c1e271a9-nv27v" event={"ID":"63cbff5b-ac34-4694-bd1c-6227c682d961","Type":"ContainerDied","Data":"504a4016cd7754e4297d2fd99d55ad1ea4e2b3505b87d948b5c82df0083fb6b3"}
Oct 31 17:44:38.585772 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:44:38.585660    5003 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="504a4016cd7754e4297d2fd99d55ad1ea4e2b3505b87d948b5c82df0083fb6b3"
Oct 31 17:44:40.331783 ip-10-0-138-17 kubenswrapper[5003]: E1031 17:44:40.331737    5003 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-tdzz5" containerName="extractor"
Oct 31 17:44:55.083843 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:44:55.083804    5003 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-2e1f5b5f-jh7r2"]
Oct 31 17:44:55.084418 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:44:55.084398    5003 cpu_manager.go:414] "containerMap: removing container" podUID="63cbff5b-ac34-4694-bd1c-6227c682d961" containerName="revoke-keys"
Oct 31 17:44:55.084489 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:44:55.084420    5003 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="63cbff5b-ac34-4694-bd1c-6227c682d961" containerName="revoke-keys"
Oct 31 17:44:55.084532 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:44:55.084492    5003 memory_manager.go:365] "RemoveStaleState removing state" podUID="63cbff5b-ac34-4694-bd1c-6227c682d961" containerName="revoke-keys"
Oct 31 17:44:55.088117 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:44:55.088096    5003 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-2e1f5b5f-jh7r2"
Oct 31 17:44:55.105366 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:44:55.105334    5003 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-2e1f5b5f-jh7r2"]
Oct 31 17:44:55.112803 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:44:55.112762    5003 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\""
Oct 31 17:44:55.112803 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:44:55.112802    5003 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-mr9x2\""
Oct 31 17:44:55.178754 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:44:55.178720    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/6803809f-6af1-4857-95c5-a1fbac1b9607-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-2e1f5b5f-jh7r2\" (UID: \"6803809f-6af1-4857-95c5-a1fbac1b9607\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-2e1f5b5f-jh7r2"
Oct 31 17:44:55.178754 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:44:55.178754    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8vqn2\" (UniqueName: \"kubernetes.io/projected/6803809f-6af1-4857-95c5-a1fbac1b9607-kube-api-access-8vqn2\") pod \"maas-api-revoke-sub-2e1f5b5f-jh7r2\" (UID: \"6803809f-6af1-4857-95c5-a1fbac1b9607\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-2e1f5b5f-jh7r2"
Oct 31 17:44:55.178971 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:44:55.178926    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/6803809f-6af1-4857-95c5-a1fbac1b9607-maas-api-xks-ca\") pod \"maas-api-revoke-sub-2e1f5b5f-jh7r2\" (UID: \"6803809f-6af1-4857-95c5-a1fbac1b9607\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-2e1f5b5f-jh7r2"
Oct 31 17:44:55.280110 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:44:55.280069    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/6803809f-6af1-4857-95c5-a1fbac1b9607-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-2e1f5b5f-jh7r2\" (UID: \"6803809f-6af1-4857-95c5-a1fbac1b9607\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-2e1f5b5f-jh7r2"
Oct 31 17:44:55.280110 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:44:55.280112    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8vqn2\" (UniqueName: \"kubernetes.io/projected/6803809f-6af1-4857-95c5-a1fbac1b9607-kube-api-access-8vqn2\") pod \"maas-api-revoke-sub-2e1f5b5f-jh7r2\" (UID: \"6803809f-6af1-4857-95c5-a1fbac1b9607\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-2e1f5b5f-jh7r2"
Oct 31 17:44:55.280392 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:44:55.280243    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/6803809f-6af1-4857-95c5-a1fbac1b9607-maas-api-xks-ca\") pod \"maas-api-revoke-sub-2e1f5b5f-jh7r2\" (UID: \"6803809f-6af1-4857-95c5-a1fbac1b9607\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-2e1f5b5f-jh7r2"
Oct 31 17:44:55.280959 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:44:55.280931    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/6803809f-6af1-4857-95c5-a1fbac1b9607-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-2e1f5b5f-jh7r2\" (UID: \"6803809f-6af1-4857-95c5-a1fbac1b9607\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-2e1f5b5f-jh7r2"
Oct 31 17:44:55.282692 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:44:55.282668    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/6803809f-6af1-4857-95c5-a1fbac1b9607-maas-api-xks-ca\") pod \"maas-api-revoke-sub-2e1f5b5f-jh7r2\" (UID: \"6803809f-6af1-4857-95c5-a1fbac1b9607\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-2e1f5b5f-jh7r2"
Oct 31 17:44:55.298555 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:44:55.298519    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8vqn2\" (UniqueName: \"kubernetes.io/projected/6803809f-6af1-4857-95c5-a1fbac1b9607-kube-api-access-8vqn2\") pod \"maas-api-revoke-sub-2e1f5b5f-jh7r2\" (UID: \"6803809f-6af1-4857-95c5-a1fbac1b9607\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-2e1f5b5f-jh7r2"
Oct 31 17:44:55.403434 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:44:55.403349    5003 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-2e1f5b5f-jh7r2"
Oct 31 17:44:55.700620 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:44:55.700535    5003 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-2e1f5b5f-jh7r2"]
Oct 31 17:44:55.704006 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:44:55.703972    5003 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6803809f_6af1_4857_95c5_a1fbac1b9607.slice/crio-2bcf7e55c4edaa6f1288f5995c854afaa5233d64dc3b28f9509045c90c2d1b30 WatchSource:0}: Error finding container 2bcf7e55c4edaa6f1288f5995c854afaa5233d64dc3b28f9509045c90c2d1b30: Status 404 returned error can't find the container with id 2bcf7e55c4edaa6f1288f5995c854afaa5233d64dc3b28f9509045c90c2d1b30
Oct 31 17:44:55.729146 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:44:55.729114    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-2e1f5b5f-jh7r2" event={"ID":"6803809f-6af1-4857-95c5-a1fbac1b9607","Type":"ContainerStarted","Data":"2bcf7e55c4edaa6f1288f5995c854afaa5233d64dc3b28f9509045c90c2d1b30"}
Oct 31 17:44:56.738288 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:44:56.738248    5003 generic.go:356] "Generic (PLEG): container finished" podID="6803809f-6af1-4857-95c5-a1fbac1b9607" containerID="d744a19cc837c720ecf1d7a4a575f600bec24d77f4b3f7ff948870a0ae438acf" exitCode=0
Oct 31 17:44:56.738720 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:44:56.738326    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-2e1f5b5f-jh7r2" event={"ID":"6803809f-6af1-4857-95c5-a1fbac1b9607","Type":"ContainerDied","Data":"d744a19cc837c720ecf1d7a4a575f600bec24d77f4b3f7ff948870a0ae438acf"}
Oct 31 17:44:57.885531 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:44:57.885505    5003 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-2e1f5b5f-jh7r2"
Oct 31 17:44:58.007708 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:44:58.007594    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/6803809f-6af1-4857-95c5-a1fbac1b9607-kube-api-access-8vqn2\" (UniqueName: \"kubernetes.io/projected/6803809f-6af1-4857-95c5-a1fbac1b9607-kube-api-access-8vqn2\") pod \"6803809f-6af1-4857-95c5-a1fbac1b9607\" (UID: \"6803809f-6af1-4857-95c5-a1fbac1b9607\") "
Oct 31 17:44:58.007708 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:44:58.007674    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/6803809f-6af1-4857-95c5-a1fbac1b9607-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/6803809f-6af1-4857-95c5-a1fbac1b9607-maas-api-openshift-ca\") pod \"6803809f-6af1-4857-95c5-a1fbac1b9607\" (UID: \"6803809f-6af1-4857-95c5-a1fbac1b9607\") "
Oct 31 17:44:58.007951 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:44:58.007792    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/6803809f-6af1-4857-95c5-a1fbac1b9607-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/6803809f-6af1-4857-95c5-a1fbac1b9607-maas-api-xks-ca\") pod \"6803809f-6af1-4857-95c5-a1fbac1b9607\" (UID: \"6803809f-6af1-4857-95c5-a1fbac1b9607\") "
Oct 31 17:44:58.008066 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:44:58.008041    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6803809f-6af1-4857-95c5-a1fbac1b9607-maas-api-openshift-ca" pod "6803809f-6af1-4857-95c5-a1fbac1b9607" (UID: "6803809f-6af1-4857-95c5-a1fbac1b9607"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 17:44:58.009779 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:44:58.009752    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6803809f-6af1-4857-95c5-a1fbac1b9607-maas-api-xks-ca" pod "6803809f-6af1-4857-95c5-a1fbac1b9607" (UID: "6803809f-6af1-4857-95c5-a1fbac1b9607"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 17:44:58.009901 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:44:58.009828    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6803809f-6af1-4857-95c5-a1fbac1b9607-kube-api-access-8vqn2" pod "6803809f-6af1-4857-95c5-a1fbac1b9607" (UID: "6803809f-6af1-4857-95c5-a1fbac1b9607"). InnerVolumeSpecName "kube-api-access-8vqn2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 17:44:58.109168 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:44:58.109132    5003 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/6803809f-6af1-4857-95c5-a1fbac1b9607-maas-api-xks-ca\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:44:58.109168 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:44:58.109162    5003 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8vqn2\" (UniqueName: \"kubernetes.io/projected/6803809f-6af1-4857-95c5-a1fbac1b9607-kube-api-access-8vqn2\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:44:58.109168 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:44:58.109173    5003 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/6803809f-6af1-4857-95c5-a1fbac1b9607-maas-api-openshift-ca\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:44:58.752177 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:44:58.752147    5003 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-2e1f5b5f-jh7r2"
Oct 31 17:44:58.752376 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:44:58.752177    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-2e1f5b5f-jh7r2" event={"ID":"6803809f-6af1-4857-95c5-a1fbac1b9607","Type":"ContainerDied","Data":"2bcf7e55c4edaa6f1288f5995c854afaa5233d64dc3b28f9509045c90c2d1b30"}
Oct 31 17:44:58.752376 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:44:58.752236    5003 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2bcf7e55c4edaa6f1288f5995c854afaa5233d64dc3b28f9509045c90c2d1b30"
Oct 31 17:45:00.136690 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:45:00.136620    5003 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29891145-x9nmw"]
Oct 31 17:45:00.137130 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:45:00.137115    5003 cpu_manager.go:414] "containerMap: removing container" podUID="6803809f-6af1-4857-95c5-a1fbac1b9607" containerName="revoke-keys"
Oct 31 17:45:00.137177 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:45:00.137131    5003 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="6803809f-6af1-4857-95c5-a1fbac1b9607" containerName="revoke-keys"
Oct 31 17:45:00.137217 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:45:00.137208    5003 memory_manager.go:365] "RemoveStaleState removing state" podUID="6803809f-6af1-4857-95c5-a1fbac1b9607" containerName="revoke-keys"
Oct 31 17:45:00.140723 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:45:00.140698    5003 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29891145-x9nmw"
Oct 31 17:45:00.158068 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:45:00.158042    5003 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29891145-x9nmw"]
Oct 31 17:45:00.165802 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:45:00.165770    5003 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-mr9x2\""
Oct 31 17:45:00.230172 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:45:00.230134    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7tvmx\" (UniqueName: \"kubernetes.io/projected/137fa0ca-af3e-4bfd-82c7-bf2bccb626d2-kube-api-access-7tvmx\") pod \"maas-api-key-cleanup-29891145-x9nmw\" (UID: \"137fa0ca-af3e-4bfd-82c7-bf2bccb626d2\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29891145-x9nmw"
Oct 31 17:45:00.230355 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:45:00.230182    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/137fa0ca-af3e-4bfd-82c7-bf2bccb626d2-maas-api-service-ca\") pod \"maas-api-key-cleanup-29891145-x9nmw\" (UID: \"137fa0ca-af3e-4bfd-82c7-bf2bccb626d2\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29891145-x9nmw"
Oct 31 17:45:00.330816 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:45:00.330774    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7tvmx\" (UniqueName: \"kubernetes.io/projected/137fa0ca-af3e-4bfd-82c7-bf2bccb626d2-kube-api-access-7tvmx\") pod \"maas-api-key-cleanup-29891145-x9nmw\" (UID: \"137fa0ca-af3e-4bfd-82c7-bf2bccb626d2\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29891145-x9nmw"
Oct 31 17:45:00.331029 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:45:00.330832    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/137fa0ca-af3e-4bfd-82c7-bf2bccb626d2-maas-api-service-ca\") pod \"maas-api-key-cleanup-29891145-x9nmw\" (UID: \"137fa0ca-af3e-4bfd-82c7-bf2bccb626d2\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29891145-x9nmw"
Oct 31 17:45:00.331488 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:45:00.331466    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/137fa0ca-af3e-4bfd-82c7-bf2bccb626d2-maas-api-service-ca\") pod \"maas-api-key-cleanup-29891145-x9nmw\" (UID: \"137fa0ca-af3e-4bfd-82c7-bf2bccb626d2\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29891145-x9nmw"
Oct 31 17:45:00.349392 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:45:00.349362    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7tvmx\" (UniqueName: \"kubernetes.io/projected/137fa0ca-af3e-4bfd-82c7-bf2bccb626d2-kube-api-access-7tvmx\") pod \"maas-api-key-cleanup-29891145-x9nmw\" (UID: \"137fa0ca-af3e-4bfd-82c7-bf2bccb626d2\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29891145-x9nmw"
Oct 31 17:45:00.459018 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:45:00.458933    5003 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29891145-x9nmw"
Oct 31 17:45:00.756746 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:45:00.756716    5003 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29891145-x9nmw"]
Oct 31 17:45:00.767100 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:45:00.767069    5003 generic.go:356] "Generic (PLEG): container finished" podID="368c56dd-6ea7-44cc-b666-7b4ed0b2d6c7" containerID="c2fd98be2465627aeb2f2deb6f3b713d11c847e7e03d97587f506a4d1b9217b4" exitCode=1
Oct 31 17:45:00.767240 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:45:00.767138    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-jobset-operator/jobset-controller-manager-7c59986b9-sv9jz" event={"ID":"368c56dd-6ea7-44cc-b666-7b4ed0b2d6c7","Type":"ContainerDied","Data":"c2fd98be2465627aeb2f2deb6f3b713d11c847e7e03d97587f506a4d1b9217b4"}
Oct 31 17:45:00.767552 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:45:00.767538    5003 scope.go:122] "RemoveContainer" containerID="c2fd98be2465627aeb2f2deb6f3b713d11c847e7e03d97587f506a4d1b9217b4"
Oct 31 17:45:00.798983 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:45:00.798952    5003 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod137fa0ca_af3e_4bfd_82c7_bf2bccb626d2.slice/crio-8c1ffa6d290363637fef69474c362fbaacd905627669c66e03a62ce5a7600838 WatchSource:0}: Error finding container 8c1ffa6d290363637fef69474c362fbaacd905627669c66e03a62ce5a7600838: Status 404 returned error can't find the container with id 8c1ffa6d290363637fef69474c362fbaacd905627669c66e03a62ce5a7600838
Oct 31 17:45:01.776171 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:45:01.776083    5003 generic.go:356] "Generic (PLEG): container finished" podID="137fa0ca-af3e-4bfd-82c7-bf2bccb626d2" containerID="e0376b62dc1da34c10e565bc17cea02a019314efc06c63fdb46000f457d9dcf0" exitCode=60
Oct 31 17:45:01.776614 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:45:01.776176    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29891145-x9nmw" event={"ID":"137fa0ca-af3e-4bfd-82c7-bf2bccb626d2","Type":"ContainerDied","Data":"e0376b62dc1da34c10e565bc17cea02a019314efc06c63fdb46000f457d9dcf0"}
Oct 31 17:45:01.776614 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:45:01.776226    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29891145-x9nmw" event={"ID":"137fa0ca-af3e-4bfd-82c7-bf2bccb626d2","Type":"ContainerStarted","Data":"8c1ffa6d290363637fef69474c362fbaacd905627669c66e03a62ce5a7600838"}
Oct 31 17:45:01.776614 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:45:01.776407    5003 scope.go:122] "RemoveContainer" containerID="e0376b62dc1da34c10e565bc17cea02a019314efc06c63fdb46000f457d9dcf0"
Oct 31 17:45:01.778136 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:45:01.778111    5003 generic.go:356] "Generic (PLEG): container finished" podID="59a4028e-1e9f-4bc1-8ebb-5db28ed51fdc" containerID="8021b948fba58bf0538141e5da6fffc450242a19b68c84be78d932226679a66c" exitCode=1
Oct 31 17:45:01.778241 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:45:01.778177    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-5778bb4449-d2s7v" event={"ID":"59a4028e-1e9f-4bc1-8ebb-5db28ed51fdc","Type":"ContainerDied","Data":"8021b948fba58bf0538141e5da6fffc450242a19b68c84be78d932226679a66c"}
Oct 31 17:45:01.778592 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:45:01.778576    5003 scope.go:122] "RemoveContainer" containerID="8021b948fba58bf0538141e5da6fffc450242a19b68c84be78d932226679a66c"
Oct 31 17:45:01.780259 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:45:01.780236    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-jobset-operator/jobset-controller-manager-7c59986b9-sv9jz" event={"ID":"368c56dd-6ea7-44cc-b666-7b4ed0b2d6c7","Type":"ContainerStarted","Data":"95180cceedccadb5ca08b70cb5e1086c5946dec9e85610059f0c71c5336b22ff"}
Oct 31 17:45:01.780496 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:45:01.780462    5003 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-jobset-operator/jobset-controller-manager-7c59986b9-sv9jz"
Oct 31 17:45:02.789372 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:45:02.789333    5003 generic.go:356] "Generic (PLEG): container finished" podID="137fa0ca-af3e-4bfd-82c7-bf2bccb626d2" containerID="3c5b03ccec49e9b5731528ef5b95596ae2807a91883292f92a4b417e73847749" exitCode=60
Oct 31 17:45:02.789905 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:45:02.789390    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29891145-x9nmw" event={"ID":"137fa0ca-af3e-4bfd-82c7-bf2bccb626d2","Type":"ContainerDied","Data":"3c5b03ccec49e9b5731528ef5b95596ae2807a91883292f92a4b417e73847749"}
Oct 31 17:45:02.789905 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:45:02.789475    5003 scope.go:122] "RemoveContainer" containerID="e0376b62dc1da34c10e565bc17cea02a019314efc06c63fdb46000f457d9dcf0"
Oct 31 17:45:02.789905 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:45:02.789798    5003 scope.go:122] "RemoveContainer" containerID="3c5b03ccec49e9b5731528ef5b95596ae2807a91883292f92a4b417e73847749"
Oct 31 17:45:02.790140 ip-10-0-138-17 kubenswrapper[5003]: E1031 17:45:02.790117    5003 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-29891145-x9nmw_odh-ai-gateway-infra(137fa0ca-af3e-4bfd-82c7-bf2bccb626d2)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29891145-x9nmw" podUID="137fa0ca-af3e-4bfd-82c7-bf2bccb626d2"
Oct 31 17:45:02.791729 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:45:02.791706    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-5778bb4449-d2s7v" event={"ID":"59a4028e-1e9f-4bc1-8ebb-5db28ed51fdc","Type":"ContainerStarted","Data":"69d0636daf5e96c6bc16050a3e535dc0b59dec0e689e91acfcaf95f23fa50e32"}
Oct 31 17:45:02.792070 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:45:02.792052    5003 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-5778bb4449-d2s7v"
Oct 31 17:45:03.801967 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:45:03.801938    5003 scope.go:122] "RemoveContainer" containerID="3c5b03ccec49e9b5731528ef5b95596ae2807a91883292f92a4b417e73847749"
Oct 31 17:45:03.802455 ip-10-0-138-17 kubenswrapper[5003]: E1031 17:45:03.802201    5003 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-29891145-x9nmw_odh-ai-gateway-infra(137fa0ca-af3e-4bfd-82c7-bf2bccb626d2)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29891145-x9nmw" podUID="137fa0ca-af3e-4bfd-82c7-bf2bccb626d2"
Oct 31 17:45:10.348325 ip-10-0-138-17 kubenswrapper[5003]: E1031 17:45:10.348282    5003 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-tdzz5" containerName="extractor"
Oct 31 17:45:12.367336 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:45:12.367296    5003 scope.go:122] "RemoveContainer" containerID="e737295d87d4ee1ef9ca5b078612daaf5f9412bc97606d8aa72583916acc159c"
Oct 31 17:45:12.376742 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:45:12.376723    5003 scope.go:122] "RemoveContainer" containerID="b7aa287e8f013f2518d0316752dc13ae5a08a2fb41745f70c4db7c995a24773e"
Oct 31 17:45:12.385672 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:45:12.385631    5003 scope.go:122] "RemoveContainer" containerID="15e886f00aa6a0ed7040cb0af5068ed0497d6f082c572753bebe5c0502d8a720"
Oct 31 17:45:12.393982 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:45:12.393962    5003 scope.go:122] "RemoveContainer" containerID="99e54b621c20b6501d3c6ed9e27bc9b5e12a81714abcb34c84752a9e69115e6c"
Oct 31 17:45:12.402517 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:45:12.402497    5003 scope.go:122] "RemoveContainer" containerID="793e072a4a88cf9226e1b2c71f264307d507ebd3c4a49af84f79e15ab7fa0cb8"
Oct 31 17:45:12.410732 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:45:12.410711    5003 scope.go:122] "RemoveContainer" containerID="764b8a3bbab58627f298e3275d2a9071b3f1631daee74e65c189e648e2815d0a"
Oct 31 17:45:12.418776 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:45:12.418758    5003 scope.go:122] "RemoveContainer" containerID="cbfe8e5316d5b8fb15ec28e7900ef30104ecc94d6a3a2ddd0fe1422fa5787a2d"
Oct 31 17:45:12.798709 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:45:12.798606    5003 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-jobset-operator/jobset-controller-manager-7c59986b9-sv9jz"
Oct 31 17:45:12.882300 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:45:12.882268    5003 scope.go:122] "RemoveContainer" containerID="3c5b03ccec49e9b5731528ef5b95596ae2807a91883292f92a4b417e73847749"
Oct 31 17:45:13.804022 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:45:13.803992    5003 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-5778bb4449-d2s7v"
Oct 31 17:45:13.923018 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:45:13.922936    5003 generic.go:356] "Generic (PLEG): container finished" podID="137fa0ca-af3e-4bfd-82c7-bf2bccb626d2" containerID="271e4fb388a119b64c70fb8945139216252b0211e7a4a265467647fd3063a5ab" exitCode=60
Oct 31 17:45:13.923156 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:45:13.923006    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29891145-x9nmw" event={"ID":"137fa0ca-af3e-4bfd-82c7-bf2bccb626d2","Type":"ContainerDied","Data":"271e4fb388a119b64c70fb8945139216252b0211e7a4a265467647fd3063a5ab"}
Oct 31 17:45:13.923156 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:45:13.923067    5003 scope.go:122] "RemoveContainer" containerID="3c5b03ccec49e9b5731528ef5b95596ae2807a91883292f92a4b417e73847749"
Oct 31 17:45:13.923414 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:45:13.923395    5003 scope.go:122] "RemoveContainer" containerID="271e4fb388a119b64c70fb8945139216252b0211e7a4a265467647fd3063a5ab"
Oct 31 17:45:13.923700 ip-10-0-138-17 kubenswrapper[5003]: E1031 17:45:13.923673    5003 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 20s restarting failed container=cleanup pod=maas-api-key-cleanup-29891145-x9nmw_odh-ai-gateway-infra(137fa0ca-af3e-4bfd-82c7-bf2bccb626d2)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29891145-x9nmw" podUID="137fa0ca-af3e-4bfd-82c7-bf2bccb626d2"
Oct 31 17:45:14.972402 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:45:14.972370    5003 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29891145-x9nmw"]
Oct 31 17:45:15.119285 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:45:15.119260    5003 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29891145-x9nmw"
Oct 31 17:45:15.184293 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:45:15.184258    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/137fa0ca-af3e-4bfd-82c7-bf2bccb626d2-kube-api-access-7tvmx\" (UniqueName: \"kubernetes.io/projected/137fa0ca-af3e-4bfd-82c7-bf2bccb626d2-kube-api-access-7tvmx\") pod \"137fa0ca-af3e-4bfd-82c7-bf2bccb626d2\" (UID: \"137fa0ca-af3e-4bfd-82c7-bf2bccb626d2\") "
Oct 31 17:45:15.184468 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:45:15.184351    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/137fa0ca-af3e-4bfd-82c7-bf2bccb626d2-maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/137fa0ca-af3e-4bfd-82c7-bf2bccb626d2-maas-api-service-ca\") pod \"137fa0ca-af3e-4bfd-82c7-bf2bccb626d2\" (UID: \"137fa0ca-af3e-4bfd-82c7-bf2bccb626d2\") "
Oct 31 17:45:15.184743 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:45:15.184716    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/137fa0ca-af3e-4bfd-82c7-bf2bccb626d2-maas-api-service-ca" pod "137fa0ca-af3e-4bfd-82c7-bf2bccb626d2" (UID: "137fa0ca-af3e-4bfd-82c7-bf2bccb626d2"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 17:45:15.186485 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:45:15.186460    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/137fa0ca-af3e-4bfd-82c7-bf2bccb626d2-kube-api-access-7tvmx" pod "137fa0ca-af3e-4bfd-82c7-bf2bccb626d2" (UID: "137fa0ca-af3e-4bfd-82c7-bf2bccb626d2"). InnerVolumeSpecName "kube-api-access-7tvmx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 17:45:15.285981 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:45:15.285902    5003 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/137fa0ca-af3e-4bfd-82c7-bf2bccb626d2-maas-api-service-ca\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:45:15.285981 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:45:15.285929    5003 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7tvmx\" (UniqueName: \"kubernetes.io/projected/137fa0ca-af3e-4bfd-82c7-bf2bccb626d2-kube-api-access-7tvmx\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:45:15.938322 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:45:15.938290    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29891145-x9nmw" event={"ID":"137fa0ca-af3e-4bfd-82c7-bf2bccb626d2","Type":"ContainerDied","Data":"8c1ffa6d290363637fef69474c362fbaacd905627669c66e03a62ce5a7600838"}
Oct 31 17:45:15.938469 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:45:15.938345    5003 scope.go:122] "RemoveContainer" containerID="271e4fb388a119b64c70fb8945139216252b0211e7a4a265467647fd3063a5ab"
Oct 31 17:45:15.938469 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:45:15.938306    5003 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29891145-x9nmw"
Oct 31 17:45:15.989748 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:45:15.989719    5003 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29891145-x9nmw"]
Oct 31 17:45:16.001427 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:45:16.001402    5003 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29891145-x9nmw"]
Oct 31 17:45:17.888700 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:45:17.888666    5003 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="137fa0ca-af3e-4bfd-82c7-bf2bccb626d2" path="/var/lib/kubelet/pods/137fa0ca-af3e-4bfd-82c7-bf2bccb626d2/volumes"
Oct 31 17:45:24.418670 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:45:24.414819    5003 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-7d9897b54c-z6b99 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 31 17:45:24.418670 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:45:24.414911    5003 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-z6b99" podUID="838478fc-1a24-432e-bb93-15d49ee7e1ed" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 31 17:45:37.279150 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:45:37.279110    5003 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-046e1343-mbfbj"]
Oct 31 17:45:37.279630 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:45:37.279531    5003 cpu_manager.go:414] "containerMap: removing container" podUID="137fa0ca-af3e-4bfd-82c7-bf2bccb626d2" containerName="cleanup"
Oct 31 17:45:37.279630 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:45:37.279542    5003 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="137fa0ca-af3e-4bfd-82c7-bf2bccb626d2" containerName="cleanup"
Oct 31 17:45:37.279630 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:45:37.279557    5003 cpu_manager.go:414] "containerMap: removing container" podUID="137fa0ca-af3e-4bfd-82c7-bf2bccb626d2" containerName="cleanup"
Oct 31 17:45:37.279630 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:45:37.279563    5003 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="137fa0ca-af3e-4bfd-82c7-bf2bccb626d2" containerName="cleanup"
Oct 31 17:45:37.279630 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:45:37.279580    5003 cpu_manager.go:414] "containerMap: removing container" podUID="137fa0ca-af3e-4bfd-82c7-bf2bccb626d2" containerName="cleanup"
Oct 31 17:45:37.279630 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:45:37.279586    5003 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="137fa0ca-af3e-4bfd-82c7-bf2bccb626d2" containerName="cleanup"
Oct 31 17:45:37.279898 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:45:37.279670    5003 memory_manager.go:365] "RemoveStaleState removing state" podUID="137fa0ca-af3e-4bfd-82c7-bf2bccb626d2" containerName="cleanup"
Oct 31 17:45:37.279898 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:45:37.279683    5003 memory_manager.go:365] "RemoveStaleState removing state" podUID="137fa0ca-af3e-4bfd-82c7-bf2bccb626d2" containerName="cleanup"
Oct 31 17:45:37.283032 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:45:37.283014    5003 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-046e1343-mbfbj"
Oct 31 17:45:37.300919 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:45:37.300888    5003 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-046e1343-mbfbj"]
Oct 31 17:45:37.308307 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:45:37.308279    5003 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\""
Oct 31 17:45:37.308444 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:45:37.308391    5003 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-mr9x2\""
Oct 31 17:45:37.351755 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:45:37.351718    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-flvf7\" (UniqueName: \"kubernetes.io/projected/ed5065fa-f0f3-4b7e-9194-0344bc8fc2e3-kube-api-access-flvf7\") pod \"maas-api-revoke-sub-046e1343-mbfbj\" (UID: \"ed5065fa-f0f3-4b7e-9194-0344bc8fc2e3\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-046e1343-mbfbj"
Oct 31 17:45:37.351912 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:45:37.351783    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/ed5065fa-f0f3-4b7e-9194-0344bc8fc2e3-maas-api-xks-ca\") pod \"maas-api-revoke-sub-046e1343-mbfbj\" (UID: \"ed5065fa-f0f3-4b7e-9194-0344bc8fc2e3\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-046e1343-mbfbj"
Oct 31 17:45:37.351959 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:45:37.351901    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/ed5065fa-f0f3-4b7e-9194-0344bc8fc2e3-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-046e1343-mbfbj\" (UID: \"ed5065fa-f0f3-4b7e-9194-0344bc8fc2e3\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-046e1343-mbfbj"
Oct 31 17:45:37.453284 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:45:37.453248    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/ed5065fa-f0f3-4b7e-9194-0344bc8fc2e3-maas-api-xks-ca\") pod \"maas-api-revoke-sub-046e1343-mbfbj\" (UID: \"ed5065fa-f0f3-4b7e-9194-0344bc8fc2e3\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-046e1343-mbfbj"
Oct 31 17:45:37.453451 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:45:37.453319    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/ed5065fa-f0f3-4b7e-9194-0344bc8fc2e3-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-046e1343-mbfbj\" (UID: \"ed5065fa-f0f3-4b7e-9194-0344bc8fc2e3\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-046e1343-mbfbj"
Oct 31 17:45:37.453451 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:45:37.453373    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-flvf7\" (UniqueName: \"kubernetes.io/projected/ed5065fa-f0f3-4b7e-9194-0344bc8fc2e3-kube-api-access-flvf7\") pod \"maas-api-revoke-sub-046e1343-mbfbj\" (UID: \"ed5065fa-f0f3-4b7e-9194-0344bc8fc2e3\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-046e1343-mbfbj"
Oct 31 17:45:37.454125 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:45:37.454103    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/ed5065fa-f0f3-4b7e-9194-0344bc8fc2e3-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-046e1343-mbfbj\" (UID: \"ed5065fa-f0f3-4b7e-9194-0344bc8fc2e3\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-046e1343-mbfbj"
Oct 31 17:45:37.455681 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:45:37.455662    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/ed5065fa-f0f3-4b7e-9194-0344bc8fc2e3-maas-api-xks-ca\") pod \"maas-api-revoke-sub-046e1343-mbfbj\" (UID: \"ed5065fa-f0f3-4b7e-9194-0344bc8fc2e3\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-046e1343-mbfbj"
Oct 31 17:45:37.472032 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:45:37.472006    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-flvf7\" (UniqueName: \"kubernetes.io/projected/ed5065fa-f0f3-4b7e-9194-0344bc8fc2e3-kube-api-access-flvf7\") pod \"maas-api-revoke-sub-046e1343-mbfbj\" (UID: \"ed5065fa-f0f3-4b7e-9194-0344bc8fc2e3\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-046e1343-mbfbj"
Oct 31 17:45:37.596832 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:45:37.596801    5003 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-046e1343-mbfbj"
Oct 31 17:45:37.892240 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:45:37.892107    5003 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-046e1343-mbfbj"]
Oct 31 17:45:37.895132 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:45:37.895102    5003 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poded5065fa_f0f3_4b7e_9194_0344bc8fc2e3.slice/crio-59a275f48244fe0c319215650735b671360b34ad270a9c7893416ff789f1b1c3 WatchSource:0}: Error finding container 59a275f48244fe0c319215650735b671360b34ad270a9c7893416ff789f1b1c3: Status 404 returned error can't find the container with id 59a275f48244fe0c319215650735b671360b34ad270a9c7893416ff789f1b1c3
Oct 31 17:45:38.116057 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:45:38.116016    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-046e1343-mbfbj" event={"ID":"ed5065fa-f0f3-4b7e-9194-0344bc8fc2e3","Type":"ContainerStarted","Data":"59a275f48244fe0c319215650735b671360b34ad270a9c7893416ff789f1b1c3"}
Oct 31 17:45:39.125186 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:45:39.125142    5003 generic.go:356] "Generic (PLEG): container finished" podID="ed5065fa-f0f3-4b7e-9194-0344bc8fc2e3" containerID="dc5415d20dc6c79d3925369b9ef280de7c1058bdc9fb5e73a21095cb7c4be4f9" exitCode=0
Oct 31 17:45:39.125571 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:45:39.125218    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-046e1343-mbfbj" event={"ID":"ed5065fa-f0f3-4b7e-9194-0344bc8fc2e3","Type":"ContainerDied","Data":"dc5415d20dc6c79d3925369b9ef280de7c1058bdc9fb5e73a21095cb7c4be4f9"}
Oct 31 17:45:40.262606 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:45:40.262579    5003 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-046e1343-mbfbj"
Oct 31 17:45:40.331478 ip-10-0-138-17 kubenswrapper[5003]: E1031 17:45:40.331432    5003 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-tdzz5" containerName="extractor"
Oct 31 17:45:40.380625 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:45:40.380594    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/ed5065fa-f0f3-4b7e-9194-0344bc8fc2e3-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/ed5065fa-f0f3-4b7e-9194-0344bc8fc2e3-maas-api-openshift-ca\") pod \"ed5065fa-f0f3-4b7e-9194-0344bc8fc2e3\" (UID: \"ed5065fa-f0f3-4b7e-9194-0344bc8fc2e3\") "
Oct 31 17:45:40.380842 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:45:40.380632    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/ed5065fa-f0f3-4b7e-9194-0344bc8fc2e3-kube-api-access-flvf7\" (UniqueName: \"kubernetes.io/projected/ed5065fa-f0f3-4b7e-9194-0344bc8fc2e3-kube-api-access-flvf7\") pod \"ed5065fa-f0f3-4b7e-9194-0344bc8fc2e3\" (UID: \"ed5065fa-f0f3-4b7e-9194-0344bc8fc2e3\") "
Oct 31 17:45:40.380842 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:45:40.380797    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/ed5065fa-f0f3-4b7e-9194-0344bc8fc2e3-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/ed5065fa-f0f3-4b7e-9194-0344bc8fc2e3-maas-api-xks-ca\") pod \"ed5065fa-f0f3-4b7e-9194-0344bc8fc2e3\" (UID: \"ed5065fa-f0f3-4b7e-9194-0344bc8fc2e3\") "
Oct 31 17:45:40.380987 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:45:40.380960    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ed5065fa-f0f3-4b7e-9194-0344bc8fc2e3-maas-api-openshift-ca" pod "ed5065fa-f0f3-4b7e-9194-0344bc8fc2e3" (UID: "ed5065fa-f0f3-4b7e-9194-0344bc8fc2e3"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 17:45:40.381144 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:45:40.381118    5003 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/ed5065fa-f0f3-4b7e-9194-0344bc8fc2e3-maas-api-openshift-ca\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:45:40.382793 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:45:40.382732    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ed5065fa-f0f3-4b7e-9194-0344bc8fc2e3-maas-api-xks-ca" pod "ed5065fa-f0f3-4b7e-9194-0344bc8fc2e3" (UID: "ed5065fa-f0f3-4b7e-9194-0344bc8fc2e3"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 17:45:40.382909 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:45:40.382886    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ed5065fa-f0f3-4b7e-9194-0344bc8fc2e3-kube-api-access-flvf7" pod "ed5065fa-f0f3-4b7e-9194-0344bc8fc2e3" (UID: "ed5065fa-f0f3-4b7e-9194-0344bc8fc2e3"). InnerVolumeSpecName "kube-api-access-flvf7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 17:45:40.482325 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:45:40.482292    5003 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/ed5065fa-f0f3-4b7e-9194-0344bc8fc2e3-maas-api-xks-ca\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:45:40.482325 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:45:40.482324    5003 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-flvf7\" (UniqueName: \"kubernetes.io/projected/ed5065fa-f0f3-4b7e-9194-0344bc8fc2e3-kube-api-access-flvf7\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:45:41.139360 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:45:41.139323    5003 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-046e1343-mbfbj"
Oct 31 17:45:41.139526 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:45:41.139354    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-046e1343-mbfbj" event={"ID":"ed5065fa-f0f3-4b7e-9194-0344bc8fc2e3","Type":"ContainerDied","Data":"59a275f48244fe0c319215650735b671360b34ad270a9c7893416ff789f1b1c3"}
Oct 31 17:45:41.139526 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:45:41.139414    5003 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="59a275f48244fe0c319215650735b671360b34ad270a9c7893416ff789f1b1c3"
Oct 31 17:45:47.055611 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:45:47.055569    5003 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-3e6bdf19-928d7"]
Oct 31 17:45:47.067302 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:45:47.067269    5003 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-3e6bdf19-928d7"]
Oct 31 17:45:47.626748 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:45:47.626712    5003 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-d3fba056-8cvgs"]
Oct 31 17:45:47.627196 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:45:47.627181    5003 cpu_manager.go:414] "containerMap: removing container" podUID="ed5065fa-f0f3-4b7e-9194-0344bc8fc2e3" containerName="revoke-keys"
Oct 31 17:45:47.627245 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:45:47.627197    5003 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="ed5065fa-f0f3-4b7e-9194-0344bc8fc2e3" containerName="revoke-keys"
Oct 31 17:45:47.627296 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:45:47.627288    5003 memory_manager.go:365] "RemoveStaleState removing state" podUID="137fa0ca-af3e-4bfd-82c7-bf2bccb626d2" containerName="cleanup"
Oct 31 17:45:47.627335 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:45:47.627303    5003 memory_manager.go:365] "RemoveStaleState removing state" podUID="ed5065fa-f0f3-4b7e-9194-0344bc8fc2e3" containerName="revoke-keys"
Oct 31 17:45:47.632009 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:45:47.631979    5003 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-d3fba056-8cvgs"
Oct 31 17:45:47.648761 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:45:47.648733    5003 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-d3fba056-8cvgs"]
Oct 31 17:45:47.656618 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:45:47.656591    5003 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\""
Oct 31 17:45:47.656757 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:45:47.656684    5003 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-mr9x2\""
Oct 31 17:45:47.748721 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:45:47.748687    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/19f75e5e-d17e-414e-acf7-81257df99bcf-maas-api-xks-ca\") pod \"maas-api-revoke-sub-d3fba056-8cvgs\" (UID: \"19f75e5e-d17e-414e-acf7-81257df99bcf\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-d3fba056-8cvgs"
Oct 31 17:45:47.748890 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:45:47.748743    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/19f75e5e-d17e-414e-acf7-81257df99bcf-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-d3fba056-8cvgs\" (UID: \"19f75e5e-d17e-414e-acf7-81257df99bcf\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-d3fba056-8cvgs"
Oct 31 17:45:47.748890 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:45:47.748831    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r7f49\" (UniqueName: \"kubernetes.io/projected/19f75e5e-d17e-414e-acf7-81257df99bcf-kube-api-access-r7f49\") pod \"maas-api-revoke-sub-d3fba056-8cvgs\" (UID: \"19f75e5e-d17e-414e-acf7-81257df99bcf\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-d3fba056-8cvgs"
Oct 31 17:45:47.849367 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:45:47.849331    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r7f49\" (UniqueName: \"kubernetes.io/projected/19f75e5e-d17e-414e-acf7-81257df99bcf-kube-api-access-r7f49\") pod \"maas-api-revoke-sub-d3fba056-8cvgs\" (UID: \"19f75e5e-d17e-414e-acf7-81257df99bcf\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-d3fba056-8cvgs"
Oct 31 17:45:47.849528 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:45:47.849417    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/19f75e5e-d17e-414e-acf7-81257df99bcf-maas-api-xks-ca\") pod \"maas-api-revoke-sub-d3fba056-8cvgs\" (UID: \"19f75e5e-d17e-414e-acf7-81257df99bcf\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-d3fba056-8cvgs"
Oct 31 17:45:47.849528 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:45:47.849463    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/19f75e5e-d17e-414e-acf7-81257df99bcf-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-d3fba056-8cvgs\" (UID: \"19f75e5e-d17e-414e-acf7-81257df99bcf\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-d3fba056-8cvgs"
Oct 31 17:45:47.850098 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:45:47.850078    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/19f75e5e-d17e-414e-acf7-81257df99bcf-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-d3fba056-8cvgs\" (UID: \"19f75e5e-d17e-414e-acf7-81257df99bcf\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-d3fba056-8cvgs"
Oct 31 17:45:47.851778 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:45:47.851759    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/19f75e5e-d17e-414e-acf7-81257df99bcf-maas-api-xks-ca\") pod \"maas-api-revoke-sub-d3fba056-8cvgs\" (UID: \"19f75e5e-d17e-414e-acf7-81257df99bcf\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-d3fba056-8cvgs"
Oct 31 17:45:47.867592 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:45:47.867562    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r7f49\" (UniqueName: \"kubernetes.io/projected/19f75e5e-d17e-414e-acf7-81257df99bcf-kube-api-access-r7f49\") pod \"maas-api-revoke-sub-d3fba056-8cvgs\" (UID: \"19f75e5e-d17e-414e-acf7-81257df99bcf\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-d3fba056-8cvgs"
Oct 31 17:45:47.887948 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:45:47.887890    5003 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="bd0dcfdf-0457-4f63-a89a-41733ac10ca9" path="/var/lib/kubelet/pods/bd0dcfdf-0457-4f63-a89a-41733ac10ca9/volumes"
Oct 31 17:45:47.948002 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:45:47.947966    5003 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-d3fba056-8cvgs"
Oct 31 17:45:48.249690 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:45:48.249589    5003 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-d3fba056-8cvgs"]
Oct 31 17:45:48.253168 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:45:48.253137    5003 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod19f75e5e_d17e_414e_acf7_81257df99bcf.slice/crio-90dd1622c6014b046c44330831c6e27965ea2f5f1b03f833359ae9a808d5d033 WatchSource:0}: Error finding container 90dd1622c6014b046c44330831c6e27965ea2f5f1b03f833359ae9a808d5d033: Status 404 returned error can't find the container with id 90dd1622c6014b046c44330831c6e27965ea2f5f1b03f833359ae9a808d5d033
Oct 31 17:45:49.195984 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:45:49.195942    5003 generic.go:356] "Generic (PLEG): container finished" podID="19f75e5e-d17e-414e-acf7-81257df99bcf" containerID="07663e45f965f9e222574cd25df265efb9d54afcd59bd46aa29db22264f6af19" exitCode=0
Oct 31 17:45:49.196188 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:45:49.196044    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-d3fba056-8cvgs" event={"ID":"19f75e5e-d17e-414e-acf7-81257df99bcf","Type":"ContainerDied","Data":"07663e45f965f9e222574cd25df265efb9d54afcd59bd46aa29db22264f6af19"}
Oct 31 17:45:49.196188 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:45:49.196111    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-d3fba056-8cvgs" event={"ID":"19f75e5e-d17e-414e-acf7-81257df99bcf","Type":"ContainerStarted","Data":"90dd1622c6014b046c44330831c6e27965ea2f5f1b03f833359ae9a808d5d033"}
Oct 31 17:45:50.633534 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:45:50.633507    5003 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-d3fba056-8cvgs"
Oct 31 17:45:50.727017 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:45:50.726982    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/19f75e5e-d17e-414e-acf7-81257df99bcf-kube-api-access-r7f49\" (UniqueName: \"kubernetes.io/projected/19f75e5e-d17e-414e-acf7-81257df99bcf-kube-api-access-r7f49\") pod \"19f75e5e-d17e-414e-acf7-81257df99bcf\" (UID: \"19f75e5e-d17e-414e-acf7-81257df99bcf\") "
Oct 31 17:45:50.728035 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:45:50.728005    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/19f75e5e-d17e-414e-acf7-81257df99bcf-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/19f75e5e-d17e-414e-acf7-81257df99bcf-maas-api-xks-ca\") pod \"19f75e5e-d17e-414e-acf7-81257df99bcf\" (UID: \"19f75e5e-d17e-414e-acf7-81257df99bcf\") "
Oct 31 17:45:50.728302 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:45:50.728282    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/19f75e5e-d17e-414e-acf7-81257df99bcf-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/19f75e5e-d17e-414e-acf7-81257df99bcf-maas-api-openshift-ca\") pod \"19f75e5e-d17e-414e-acf7-81257df99bcf\" (UID: \"19f75e5e-d17e-414e-acf7-81257df99bcf\") "
Oct 31 17:45:50.729456 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:45:50.729431    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/19f75e5e-d17e-414e-acf7-81257df99bcf-maas-api-openshift-ca" pod "19f75e5e-d17e-414e-acf7-81257df99bcf" (UID: "19f75e5e-d17e-414e-acf7-81257df99bcf"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 17:45:50.736208 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:45:50.736183    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/19f75e5e-d17e-414e-acf7-81257df99bcf-maas-api-xks-ca" pod "19f75e5e-d17e-414e-acf7-81257df99bcf" (UID: "19f75e5e-d17e-414e-acf7-81257df99bcf"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 17:45:50.738441 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:45:50.738418    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/19f75e5e-d17e-414e-acf7-81257df99bcf-kube-api-access-r7f49" pod "19f75e5e-d17e-414e-acf7-81257df99bcf" (UID: "19f75e5e-d17e-414e-acf7-81257df99bcf"). InnerVolumeSpecName "kube-api-access-r7f49". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 17:45:50.830604 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:45:50.830566    5003 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/19f75e5e-d17e-414e-acf7-81257df99bcf-maas-api-openshift-ca\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:45:50.830968 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:45:50.830945    5003 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r7f49\" (UniqueName: \"kubernetes.io/projected/19f75e5e-d17e-414e-acf7-81257df99bcf-kube-api-access-r7f49\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:45:50.831094 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:45:50.831080    5003 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/19f75e5e-d17e-414e-acf7-81257df99bcf-maas-api-xks-ca\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:45:51.232729 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:45:51.232625    5003 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-d3fba056-8cvgs"
Oct 31 17:45:51.232984 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:45:51.232677    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-d3fba056-8cvgs" event={"ID":"19f75e5e-d17e-414e-acf7-81257df99bcf","Type":"ContainerDied","Data":"90dd1622c6014b046c44330831c6e27965ea2f5f1b03f833359ae9a808d5d033"}
Oct 31 17:45:51.233068 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:45:51.233020    5003 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="90dd1622c6014b046c44330831c6e27965ea2f5f1b03f833359ae9a808d5d033"
Oct 31 17:46:08.966924 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:46:08.966887    5003 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-ae594979-hg5dk"]
Oct 31 17:46:08.967365 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:46:08.967308    5003 cpu_manager.go:414] "containerMap: removing container" podUID="19f75e5e-d17e-414e-acf7-81257df99bcf" containerName="revoke-keys"
Oct 31 17:46:08.967365 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:46:08.967318    5003 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="19f75e5e-d17e-414e-acf7-81257df99bcf" containerName="revoke-keys"
Oct 31 17:46:08.967446 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:46:08.967411    5003 memory_manager.go:365] "RemoveStaleState removing state" podUID="19f75e5e-d17e-414e-acf7-81257df99bcf" containerName="revoke-keys"
Oct 31 17:46:08.970944 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:46:08.970927    5003 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-ae594979-hg5dk"
Oct 31 17:46:08.988338 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:46:08.988311    5003 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-ae594979-hg5dk"]
Oct 31 17:46:08.996115 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:46:08.996089    5003 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\""
Oct 31 17:46:08.996280 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:46:08.996150    5003 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-mr9x2\""
Oct 31 17:46:09.024931 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:46:09.024906    5003 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-36fa73e9-268gh"]
Oct 31 17:46:09.028754 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:46:09.028727    5003 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-36fa73e9-268gh"]
Oct 31 17:46:09.077218 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:46:09.077184    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/fe0e4e20-1cf0-4ecf-9235-50f38ca5da56-maas-api-xks-ca\") pod \"maas-api-revoke-sub-ae594979-hg5dk\" (UID: \"fe0e4e20-1cf0-4ecf-9235-50f38ca5da56\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-ae594979-hg5dk"
Oct 31 17:46:09.077372 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:46:09.077261    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/fe0e4e20-1cf0-4ecf-9235-50f38ca5da56-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-ae594979-hg5dk\" (UID: \"fe0e4e20-1cf0-4ecf-9235-50f38ca5da56\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-ae594979-hg5dk"
Oct 31 17:46:09.077442 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:46:09.077382    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cvsjk\" (UniqueName: \"kubernetes.io/projected/fe0e4e20-1cf0-4ecf-9235-50f38ca5da56-kube-api-access-cvsjk\") pod \"maas-api-revoke-sub-ae594979-hg5dk\" (UID: \"fe0e4e20-1cf0-4ecf-9235-50f38ca5da56\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-ae594979-hg5dk"
Oct 31 17:46:09.178263 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:46:09.178235    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cvsjk\" (UniqueName: \"kubernetes.io/projected/fe0e4e20-1cf0-4ecf-9235-50f38ca5da56-kube-api-access-cvsjk\") pod \"maas-api-revoke-sub-ae594979-hg5dk\" (UID: \"fe0e4e20-1cf0-4ecf-9235-50f38ca5da56\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-ae594979-hg5dk"
Oct 31 17:46:09.178409 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:46:09.178298    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/fe0e4e20-1cf0-4ecf-9235-50f38ca5da56-maas-api-xks-ca\") pod \"maas-api-revoke-sub-ae594979-hg5dk\" (UID: \"fe0e4e20-1cf0-4ecf-9235-50f38ca5da56\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-ae594979-hg5dk"
Oct 31 17:46:09.178409 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:46:09.178360    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/fe0e4e20-1cf0-4ecf-9235-50f38ca5da56-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-ae594979-hg5dk\" (UID: \"fe0e4e20-1cf0-4ecf-9235-50f38ca5da56\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-ae594979-hg5dk"
Oct 31 17:46:09.178990 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:46:09.178969    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/fe0e4e20-1cf0-4ecf-9235-50f38ca5da56-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-ae594979-hg5dk\" (UID: \"fe0e4e20-1cf0-4ecf-9235-50f38ca5da56\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-ae594979-hg5dk"
Oct 31 17:46:09.180637 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:46:09.180618    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/fe0e4e20-1cf0-4ecf-9235-50f38ca5da56-maas-api-xks-ca\") pod \"maas-api-revoke-sub-ae594979-hg5dk\" (UID: \"fe0e4e20-1cf0-4ecf-9235-50f38ca5da56\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-ae594979-hg5dk"
Oct 31 17:46:09.196189 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:46:09.196168    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cvsjk\" (UniqueName: \"kubernetes.io/projected/fe0e4e20-1cf0-4ecf-9235-50f38ca5da56-kube-api-access-cvsjk\") pod \"maas-api-revoke-sub-ae594979-hg5dk\" (UID: \"fe0e4e20-1cf0-4ecf-9235-50f38ca5da56\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-ae594979-hg5dk"
Oct 31 17:46:09.284756 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:46:09.284681    5003 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-ae594979-hg5dk"
Oct 31 17:46:09.581439 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:46:09.581413    5003 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-ae594979-hg5dk"]
Oct 31 17:46:09.584341 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:46:09.584312    5003 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfe0e4e20_1cf0_4ecf_9235_50f38ca5da56.slice/crio-f660e7f06de84bd91987437a3e375d8f55ee9a75369c2fc53bb49fbcbb6d000f WatchSource:0}: Error finding container f660e7f06de84bd91987437a3e375d8f55ee9a75369c2fc53bb49fbcbb6d000f: Status 404 returned error can't find the container with id f660e7f06de84bd91987437a3e375d8f55ee9a75369c2fc53bb49fbcbb6d000f
Oct 31 17:46:09.771167 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:46:09.771137    5003 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-insights/periodic-gathering-rbznb-vn5t8"]
Oct 31 17:46:09.776359 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:46:09.776343    5003 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/periodic-gathering-rbznb-vn5t8"
Oct 31 17:46:09.792383 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:46:09.792357    5003 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/periodic-gathering-rbznb-vn5t8"]
Oct 31 17:46:09.885386 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:46:09.885360    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b2cff6d8-d6c5-4297-a938-d811b39d7043-service-ca-bundle\") pod \"periodic-gathering-rbznb-vn5t8\" (UID: \"b2cff6d8-d6c5-4297-a938-d811b39d7043\") " pod="openshift-insights/periodic-gathering-rbznb-vn5t8"
Oct 31 17:46:09.885504 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:46:09.885392    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b2cff6d8-d6c5-4297-a938-d811b39d7043-trusted-ca-bundle\") pod \"periodic-gathering-rbznb-vn5t8\" (UID: \"b2cff6d8-d6c5-4297-a938-d811b39d7043\") " pod="openshift-insights/periodic-gathering-rbznb-vn5t8"
Oct 31 17:46:09.885555 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:46:09.885506    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w8882\" (UniqueName: \"kubernetes.io/projected/b2cff6d8-d6c5-4297-a938-d811b39d7043-kube-api-access-w8882\") pod \"periodic-gathering-rbznb-vn5t8\" (UID: \"b2cff6d8-d6c5-4297-a938-d811b39d7043\") " pod="openshift-insights/periodic-gathering-rbznb-vn5t8"
Oct 31 17:46:09.885591 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:46:09.885581    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/b2cff6d8-d6c5-4297-a938-d811b39d7043-archives-path\") pod \"periodic-gathering-rbznb-vn5t8\" (UID: \"b2cff6d8-d6c5-4297-a938-d811b39d7043\") " pod="openshift-insights/periodic-gathering-rbznb-vn5t8"
Oct 31 17:46:09.888023 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:46:09.887999    5003 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="98b1e280-c5e1-4ee1-a50a-7326ff715da8" path="/var/lib/kubelet/pods/98b1e280-c5e1-4ee1-a50a-7326ff715da8/volumes"
Oct 31 17:46:09.987022 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:46:09.986988    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b2cff6d8-d6c5-4297-a938-d811b39d7043-service-ca-bundle\") pod \"periodic-gathering-rbznb-vn5t8\" (UID: \"b2cff6d8-d6c5-4297-a938-d811b39d7043\") " pod="openshift-insights/periodic-gathering-rbznb-vn5t8"
Oct 31 17:46:09.987022 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:46:09.987019    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b2cff6d8-d6c5-4297-a938-d811b39d7043-trusted-ca-bundle\") pod \"periodic-gathering-rbznb-vn5t8\" (UID: \"b2cff6d8-d6c5-4297-a938-d811b39d7043\") " pod="openshift-insights/periodic-gathering-rbznb-vn5t8"
Oct 31 17:46:09.987537 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:46:09.987063    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w8882\" (UniqueName: \"kubernetes.io/projected/b2cff6d8-d6c5-4297-a938-d811b39d7043-kube-api-access-w8882\") pod \"periodic-gathering-rbznb-vn5t8\" (UID: \"b2cff6d8-d6c5-4297-a938-d811b39d7043\") " pod="openshift-insights/periodic-gathering-rbznb-vn5t8"
Oct 31 17:46:09.987537 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:46:09.987090    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/b2cff6d8-d6c5-4297-a938-d811b39d7043-archives-path\") pod \"periodic-gathering-rbznb-vn5t8\" (UID: \"b2cff6d8-d6c5-4297-a938-d811b39d7043\") " pod="openshift-insights/periodic-gathering-rbznb-vn5t8"
Oct 31 17:46:09.987685 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:46:09.987535    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/b2cff6d8-d6c5-4297-a938-d811b39d7043-archives-path\") pod \"periodic-gathering-rbznb-vn5t8\" (UID: \"b2cff6d8-d6c5-4297-a938-d811b39d7043\") " pod="openshift-insights/periodic-gathering-rbznb-vn5t8"
Oct 31 17:46:09.987685 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:46:09.987631    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b2cff6d8-d6c5-4297-a938-d811b39d7043-service-ca-bundle\") pod \"periodic-gathering-rbznb-vn5t8\" (UID: \"b2cff6d8-d6c5-4297-a938-d811b39d7043\") " pod="openshift-insights/periodic-gathering-rbznb-vn5t8"
Oct 31 17:46:09.987942 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:46:09.987919    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b2cff6d8-d6c5-4297-a938-d811b39d7043-trusted-ca-bundle\") pod \"periodic-gathering-rbznb-vn5t8\" (UID: \"b2cff6d8-d6c5-4297-a938-d811b39d7043\") " pod="openshift-insights/periodic-gathering-rbznb-vn5t8"
Oct 31 17:46:10.005150 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:46:10.005127    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w8882\" (UniqueName: \"kubernetes.io/projected/b2cff6d8-d6c5-4297-a938-d811b39d7043-kube-api-access-w8882\") pod \"periodic-gathering-rbznb-vn5t8\" (UID: \"b2cff6d8-d6c5-4297-a938-d811b39d7043\") " pod="openshift-insights/periodic-gathering-rbznb-vn5t8"
Oct 31 17:46:10.087776 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:46:10.087740    5003 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/periodic-gathering-rbznb-vn5t8"
Oct 31 17:46:10.330265 ip-10-0-138-17 kubenswrapper[5003]: E1031 17:46:10.330224    5003 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-tdzz5" containerName="extractor"
Oct 31 17:46:10.373727 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:46:10.373693    5003 generic.go:356] "Generic (PLEG): container finished" podID="fe0e4e20-1cf0-4ecf-9235-50f38ca5da56" containerID="24907d803390da8f6e5562e396c49a1c58e9436f8b535e54e474e3bbdce26b50" exitCode=0
Oct 31 17:46:10.373856 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:46:10.373779    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-ae594979-hg5dk" event={"ID":"fe0e4e20-1cf0-4ecf-9235-50f38ca5da56","Type":"ContainerDied","Data":"24907d803390da8f6e5562e396c49a1c58e9436f8b535e54e474e3bbdce26b50"}
Oct 31 17:46:10.373856 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:46:10.373838    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-ae594979-hg5dk" event={"ID":"fe0e4e20-1cf0-4ecf-9235-50f38ca5da56","Type":"ContainerStarted","Data":"f660e7f06de84bd91987437a3e375d8f55ee9a75369c2fc53bb49fbcbb6d000f"}
Oct 31 17:46:10.382362 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:46:10.382337    5003 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/periodic-gathering-rbznb-vn5t8"]
Oct 31 17:46:10.415746 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:46:10.415687    5003 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb2cff6d8_d6c5_4297_a938_d811b39d7043.slice/crio-bbf2f8a9290410d210ababd3618173f9010f449356de5e34490a8f62cd13b045 WatchSource:0}: Error finding container bbf2f8a9290410d210ababd3618173f9010f449356de5e34490a8f62cd13b045: Status 404 returned error can't find the container with id bbf2f8a9290410d210ababd3618173f9010f449356de5e34490a8f62cd13b045
Oct 31 17:46:11.383374 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:46:11.383333    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/periodic-gathering-rbznb-vn5t8" event={"ID":"b2cff6d8-d6c5-4297-a938-d811b39d7043","Type":"ContainerStarted","Data":"bc5e8b99a89f4d1906b6088bf0ce0eabca95b2b2b02c8c6191fa9f476c3ed197"}
Oct 31 17:46:11.383807 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:46:11.383402    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/periodic-gathering-rbznb-vn5t8" event={"ID":"b2cff6d8-d6c5-4297-a938-d811b39d7043","Type":"ContainerStarted","Data":"bbf2f8a9290410d210ababd3618173f9010f449356de5e34490a8f62cd13b045"}
Oct 31 17:46:11.421220 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:46:11.421161    5003 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-insights/periodic-gathering-rbznb-vn5t8" podStartSLOduration=2.421148161 podStartE2EDuration="2.421148161s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 17:46:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 17:46:11.420195833 +0000 UTC m=+1139.675050369" watchObservedRunningTime="2026-10-31 17:46:11.421148161 +0000 UTC m=+1139.676002702"
Oct 31 17:46:11.525793 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:46:11.525770    5003 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-ae594979-hg5dk"
Oct 31 17:46:11.603105 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:46:11.603071    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/fe0e4e20-1cf0-4ecf-9235-50f38ca5da56-kube-api-access-cvsjk\" (UniqueName: \"kubernetes.io/projected/fe0e4e20-1cf0-4ecf-9235-50f38ca5da56-kube-api-access-cvsjk\") pod \"fe0e4e20-1cf0-4ecf-9235-50f38ca5da56\" (UID: \"fe0e4e20-1cf0-4ecf-9235-50f38ca5da56\") "
Oct 31 17:46:11.603265 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:46:11.603119    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/fe0e4e20-1cf0-4ecf-9235-50f38ca5da56-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/fe0e4e20-1cf0-4ecf-9235-50f38ca5da56-maas-api-openshift-ca\") pod \"fe0e4e20-1cf0-4ecf-9235-50f38ca5da56\" (UID: \"fe0e4e20-1cf0-4ecf-9235-50f38ca5da56\") "
Oct 31 17:46:11.603265 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:46:11.603185    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/fe0e4e20-1cf0-4ecf-9235-50f38ca5da56-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/fe0e4e20-1cf0-4ecf-9235-50f38ca5da56-maas-api-xks-ca\") pod \"fe0e4e20-1cf0-4ecf-9235-50f38ca5da56\" (UID: \"fe0e4e20-1cf0-4ecf-9235-50f38ca5da56\") "
Oct 31 17:46:11.603572 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:46:11.603545    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fe0e4e20-1cf0-4ecf-9235-50f38ca5da56-maas-api-openshift-ca" pod "fe0e4e20-1cf0-4ecf-9235-50f38ca5da56" (UID: "fe0e4e20-1cf0-4ecf-9235-50f38ca5da56"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 17:46:11.605295 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:46:11.605268    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fe0e4e20-1cf0-4ecf-9235-50f38ca5da56-maas-api-xks-ca" pod "fe0e4e20-1cf0-4ecf-9235-50f38ca5da56" (UID: "fe0e4e20-1cf0-4ecf-9235-50f38ca5da56"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 17:46:11.605295 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:46:11.605291    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fe0e4e20-1cf0-4ecf-9235-50f38ca5da56-kube-api-access-cvsjk" pod "fe0e4e20-1cf0-4ecf-9235-50f38ca5da56" (UID: "fe0e4e20-1cf0-4ecf-9235-50f38ca5da56"). InnerVolumeSpecName "kube-api-access-cvsjk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 17:46:11.704925 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:46:11.704858    5003 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cvsjk\" (UniqueName: \"kubernetes.io/projected/fe0e4e20-1cf0-4ecf-9235-50f38ca5da56-kube-api-access-cvsjk\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:46:11.704925 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:46:11.704884    5003 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/fe0e4e20-1cf0-4ecf-9235-50f38ca5da56-maas-api-openshift-ca\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:46:11.704925 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:46:11.704895    5003 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/fe0e4e20-1cf0-4ecf-9235-50f38ca5da56-maas-api-xks-ca\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:46:12.391896 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:46:12.391864    5003 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-ae594979-hg5dk"
Oct 31 17:46:12.392289 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:46:12.391891    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-ae594979-hg5dk" event={"ID":"fe0e4e20-1cf0-4ecf-9235-50f38ca5da56","Type":"ContainerDied","Data":"f660e7f06de84bd91987437a3e375d8f55ee9a75369c2fc53bb49fbcbb6d000f"}
Oct 31 17:46:12.392289 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:46:12.391943    5003 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f660e7f06de84bd91987437a3e375d8f55ee9a75369c2fc53bb49fbcbb6d000f"
Oct 31 17:46:12.474324 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:46:12.474295    5003 scope.go:122] "RemoveContainer" containerID="c085f0061c274aaa79fb45e51788e4a1d836daf5a24c386be4a1cf4bc49e13cf"
Oct 31 17:46:14.026512 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:46:14.026478    5003 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-0491c971-xzm5r"]
Oct 31 17:46:14.029800 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:46:14.029770    5003 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-0491c971-xzm5r"]
Oct 31 17:46:15.888920 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:46:15.888887    5003 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="9f845581-2357-4edf-ae5f-4f34d26b2174" path="/var/lib/kubelet/pods/9f845581-2357-4edf-ae5f-4f34d26b2174/volumes"
Oct 31 17:46:24.027668 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:46:24.027499    5003 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-3705b2f7-xc7d9"]
Oct 31 17:46:24.038566 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:46:24.038531    5003 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-3705b2f7-xc7d9"]
Oct 31 17:46:25.284823 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:46:25.284773    5003 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-7d9897b54c-9t8k2 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.88:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 31 17:46:25.285469 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:46:25.285428    5003 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-9t8k2" podUID="c8d0a165-562c-4602-95fe-35a62229fa4f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.88:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 31 17:46:25.887583 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:46:25.887548    5003 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="a5fb95e3-c3f5-4a7f-be50-57dbe873b509" path="/var/lib/kubelet/pods/a5fb95e3-c3f5-4a7f-be50-57dbe873b509/volumes"
Oct 31 17:46:29.360991 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:46:29.360955    5003 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-a4aef7d7-dfg6x"]
Oct 31 17:46:29.361433 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:46:29.361418    5003 cpu_manager.go:414] "containerMap: removing container" podUID="fe0e4e20-1cf0-4ecf-9235-50f38ca5da56" containerName="revoke-keys"
Oct 31 17:46:29.361477 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:46:29.361434    5003 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="fe0e4e20-1cf0-4ecf-9235-50f38ca5da56" containerName="revoke-keys"
Oct 31 17:46:29.361522 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:46:29.361513    5003 memory_manager.go:365] "RemoveStaleState removing state" podUID="fe0e4e20-1cf0-4ecf-9235-50f38ca5da56" containerName="revoke-keys"
Oct 31 17:46:29.364792 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:46:29.364774    5003 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-a4aef7d7-dfg6x"
Oct 31 17:46:29.382674 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:46:29.382614    5003 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-a4aef7d7-dfg6x"]
Oct 31 17:46:29.386781 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:46:29.386752    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/6aa9c6ab-93b6-4ec4-8509-ff559f00e5a0-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-a4aef7d7-dfg6x\" (UID: \"6aa9c6ab-93b6-4ec4-8509-ff559f00e5a0\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-a4aef7d7-dfg6x"
Oct 31 17:46:29.386897 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:46:29.386867    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/6aa9c6ab-93b6-4ec4-8509-ff559f00e5a0-maas-api-xks-ca\") pod \"maas-api-revoke-sub-a4aef7d7-dfg6x\" (UID: \"6aa9c6ab-93b6-4ec4-8509-ff559f00e5a0\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-a4aef7d7-dfg6x"
Oct 31 17:46:29.386966 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:46:29.386942    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b7v25\" (UniqueName: \"kubernetes.io/projected/6aa9c6ab-93b6-4ec4-8509-ff559f00e5a0-kube-api-access-b7v25\") pod \"maas-api-revoke-sub-a4aef7d7-dfg6x\" (UID: \"6aa9c6ab-93b6-4ec4-8509-ff559f00e5a0\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-a4aef7d7-dfg6x"
Oct 31 17:46:29.390555 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:46:29.390531    5003 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\""
Oct 31 17:46:29.390696 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:46:29.390569    5003 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-mr9x2\""
Oct 31 17:46:29.487960 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:46:29.487918    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b7v25\" (UniqueName: \"kubernetes.io/projected/6aa9c6ab-93b6-4ec4-8509-ff559f00e5a0-kube-api-access-b7v25\") pod \"maas-api-revoke-sub-a4aef7d7-dfg6x\" (UID: \"6aa9c6ab-93b6-4ec4-8509-ff559f00e5a0\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-a4aef7d7-dfg6x"
Oct 31 17:46:29.488109 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:46:29.487999    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/6aa9c6ab-93b6-4ec4-8509-ff559f00e5a0-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-a4aef7d7-dfg6x\" (UID: \"6aa9c6ab-93b6-4ec4-8509-ff559f00e5a0\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-a4aef7d7-dfg6x"
Oct 31 17:46:29.488109 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:46:29.488071    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/6aa9c6ab-93b6-4ec4-8509-ff559f00e5a0-maas-api-xks-ca\") pod \"maas-api-revoke-sub-a4aef7d7-dfg6x\" (UID: \"6aa9c6ab-93b6-4ec4-8509-ff559f00e5a0\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-a4aef7d7-dfg6x"
Oct 31 17:46:29.488726 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:46:29.488702    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/6aa9c6ab-93b6-4ec4-8509-ff559f00e5a0-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-a4aef7d7-dfg6x\" (UID: \"6aa9c6ab-93b6-4ec4-8509-ff559f00e5a0\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-a4aef7d7-dfg6x"
Oct 31 17:46:29.490457 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:46:29.490432    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/6aa9c6ab-93b6-4ec4-8509-ff559f00e5a0-maas-api-xks-ca\") pod \"maas-api-revoke-sub-a4aef7d7-dfg6x\" (UID: \"6aa9c6ab-93b6-4ec4-8509-ff559f00e5a0\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-a4aef7d7-dfg6x"
Oct 31 17:46:29.506486 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:46:29.506459    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b7v25\" (UniqueName: \"kubernetes.io/projected/6aa9c6ab-93b6-4ec4-8509-ff559f00e5a0-kube-api-access-b7v25\") pod \"maas-api-revoke-sub-a4aef7d7-dfg6x\" (UID: \"6aa9c6ab-93b6-4ec4-8509-ff559f00e5a0\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-a4aef7d7-dfg6x"
Oct 31 17:46:29.678227 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:46:29.678140    5003 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-a4aef7d7-dfg6x"
Oct 31 17:46:29.976980 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:46:29.976951    5003 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-a4aef7d7-dfg6x"]
Oct 31 17:46:29.979218 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:46:29.979187    5003 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6aa9c6ab_93b6_4ec4_8509_ff559f00e5a0.slice/crio-8c2ba0a3fc2ea4292437bce0c3170c342a7742e996fd9bb116980640657c1b9d WatchSource:0}: Error finding container 8c2ba0a3fc2ea4292437bce0c3170c342a7742e996fd9bb116980640657c1b9d: Status 404 returned error can't find the container with id 8c2ba0a3fc2ea4292437bce0c3170c342a7742e996fd9bb116980640657c1b9d
Oct 31 17:46:30.555215 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:46:30.555145    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-a4aef7d7-dfg6x" event={"ID":"6aa9c6ab-93b6-4ec4-8509-ff559f00e5a0","Type":"ContainerStarted","Data":"24853a3efb9e1ef0b232dac47d04d4a7bb5036ad47c00906c0d6c87245c36247"}
Oct 31 17:46:30.555215 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:46:30.555203    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-a4aef7d7-dfg6x" event={"ID":"6aa9c6ab-93b6-4ec4-8509-ff559f00e5a0","Type":"ContainerStarted","Data":"8c2ba0a3fc2ea4292437bce0c3170c342a7742e996fd9bb116980640657c1b9d"}
Oct 31 17:46:30.593492 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:46:30.593446    5003 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-sub-a4aef7d7-dfg6x" podStartSLOduration=1.5934339610000001 podStartE2EDuration="1.593433961s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 17:46:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 17:46:30.592082338 +0000 UTC m=+1158.846936874" watchObservedRunningTime="2026-10-31 17:46:30.593433961 +0000 UTC m=+1158.848288522"
Oct 31 17:46:31.564821 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:46:31.564788    5003 generic.go:356] "Generic (PLEG): container finished" podID="6aa9c6ab-93b6-4ec4-8509-ff559f00e5a0" containerID="24853a3efb9e1ef0b232dac47d04d4a7bb5036ad47c00906c0d6c87245c36247" exitCode=0
Oct 31 17:46:31.565173 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:46:31.564852    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-a4aef7d7-dfg6x" event={"ID":"6aa9c6ab-93b6-4ec4-8509-ff559f00e5a0","Type":"ContainerDied","Data":"24853a3efb9e1ef0b232dac47d04d4a7bb5036ad47c00906c0d6c87245c36247"}
Oct 31 17:46:32.720556 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:46:32.720528    5003 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-a4aef7d7-dfg6x"
Oct 31 17:46:32.818995 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:46:32.818961    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/6aa9c6ab-93b6-4ec4-8509-ff559f00e5a0-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/6aa9c6ab-93b6-4ec4-8509-ff559f00e5a0-maas-api-openshift-ca\") pod \"6aa9c6ab-93b6-4ec4-8509-ff559f00e5a0\" (UID: \"6aa9c6ab-93b6-4ec4-8509-ff559f00e5a0\") "
Oct 31 17:46:32.819200 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:46:32.819022    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/6aa9c6ab-93b6-4ec4-8509-ff559f00e5a0-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/6aa9c6ab-93b6-4ec4-8509-ff559f00e5a0-maas-api-xks-ca\") pod \"6aa9c6ab-93b6-4ec4-8509-ff559f00e5a0\" (UID: \"6aa9c6ab-93b6-4ec4-8509-ff559f00e5a0\") "
Oct 31 17:46:32.819200 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:46:32.819090    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/6aa9c6ab-93b6-4ec4-8509-ff559f00e5a0-kube-api-access-b7v25\" (UniqueName: \"kubernetes.io/projected/6aa9c6ab-93b6-4ec4-8509-ff559f00e5a0-kube-api-access-b7v25\") pod \"6aa9c6ab-93b6-4ec4-8509-ff559f00e5a0\" (UID: \"6aa9c6ab-93b6-4ec4-8509-ff559f00e5a0\") "
Oct 31 17:46:32.819408 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:46:32.819382    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6aa9c6ab-93b6-4ec4-8509-ff559f00e5a0-maas-api-openshift-ca" pod "6aa9c6ab-93b6-4ec4-8509-ff559f00e5a0" (UID: "6aa9c6ab-93b6-4ec4-8509-ff559f00e5a0"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 17:46:32.821108 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:46:32.821078    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6aa9c6ab-93b6-4ec4-8509-ff559f00e5a0-maas-api-xks-ca" pod "6aa9c6ab-93b6-4ec4-8509-ff559f00e5a0" (UID: "6aa9c6ab-93b6-4ec4-8509-ff559f00e5a0"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 17:46:32.821108 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:46:32.821080    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6aa9c6ab-93b6-4ec4-8509-ff559f00e5a0-kube-api-access-b7v25" pod "6aa9c6ab-93b6-4ec4-8509-ff559f00e5a0" (UID: "6aa9c6ab-93b6-4ec4-8509-ff559f00e5a0"). InnerVolumeSpecName "kube-api-access-b7v25". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 17:46:32.920299 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:46:32.920245    5003 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b7v25\" (UniqueName: \"kubernetes.io/projected/6aa9c6ab-93b6-4ec4-8509-ff559f00e5a0-kube-api-access-b7v25\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:46:32.920299 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:46:32.920287    5003 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/6aa9c6ab-93b6-4ec4-8509-ff559f00e5a0-maas-api-openshift-ca\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:46:32.920299 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:46:32.920300    5003 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/6aa9c6ab-93b6-4ec4-8509-ff559f00e5a0-maas-api-xks-ca\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:46:33.026049 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:46:33.026018    5003 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-dbda3009-9f59b"]
Oct 31 17:46:33.029186 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:46:33.029158    5003 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-dbda3009-9f59b"]
Oct 31 17:46:33.585323 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:46:33.585292    5003 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-a4aef7d7-dfg6x"
Oct 31 17:46:33.585323 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:46:33.585306    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-a4aef7d7-dfg6x" event={"ID":"6aa9c6ab-93b6-4ec4-8509-ff559f00e5a0","Type":"ContainerDied","Data":"8c2ba0a3fc2ea4292437bce0c3170c342a7742e996fd9bb116980640657c1b9d"}
Oct 31 17:46:33.585536 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:46:33.585370    5003 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8c2ba0a3fc2ea4292437bce0c3170c342a7742e996fd9bb116980640657c1b9d"
Oct 31 17:46:33.888530 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:46:33.888458    5003 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="f7cd4b4e-96aa-4c97-806b-0737872186e1" path="/var/lib/kubelet/pods/f7cd4b4e-96aa-4c97-806b-0737872186e1/volumes"
Oct 31 17:46:39.039571 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:46:39.039527    5003 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-be112520-xtwpk"]
Oct 31 17:46:39.041555 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:46:39.041530    5003 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-be112520-xtwpk"]
Oct 31 17:46:39.888947 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:46:39.888916    5003 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="4843ce8c-d62a-41ca-9002-78ab574484bb" path="/var/lib/kubelet/pods/4843ce8c-d62a-41ca-9002-78ab574484bb/volumes"
Oct 31 17:46:40.331087 ip-10-0-138-17 kubenswrapper[5003]: E1031 17:46:40.331045    5003 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-tdzz5" containerName="extractor"
Oct 31 17:46:43.024247 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:46:43.024214    5003 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-d1ea8e75-vr5s4"]
Oct 31 17:46:43.036087 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:46:43.036056    5003 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-d1ea8e75-vr5s4"]
Oct 31 17:46:43.888751 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:46:43.888720    5003 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="1ba61bb8-6c32-451b-ab2c-07b23395d08d" path="/var/lib/kubelet/pods/1ba61bb8-6c32-451b-ab2c-07b23395d08d/volumes"
Oct 31 17:46:45.029323 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:46:45.029290    5003 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-24584738-5hnhv"]
Oct 31 17:46:45.041149 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:46:45.041121    5003 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-24584738-5hnhv"]
Oct 31 17:46:45.888942 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:46:45.888909    5003 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="1d105e9a-34e9-4888-8433-3e2e20b06aea" path="/var/lib/kubelet/pods/1d105e9a-34e9-4888-8433-3e2e20b06aea/volumes"
Oct 31 17:46:52.633552 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:46:52.633506    5003 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-79805ca9-vcdrx"]
Oct 31 17:46:52.634048 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:46:52.634031    5003 cpu_manager.go:414] "containerMap: removing container" podUID="6aa9c6ab-93b6-4ec4-8509-ff559f00e5a0" containerName="revoke-keys"
Oct 31 17:46:52.634094 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:46:52.634049    5003 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="6aa9c6ab-93b6-4ec4-8509-ff559f00e5a0" containerName="revoke-keys"
Oct 31 17:46:52.634137 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:46:52.634128    5003 memory_manager.go:365] "RemoveStaleState removing state" podUID="6aa9c6ab-93b6-4ec4-8509-ff559f00e5a0" containerName="revoke-keys"
Oct 31 17:46:52.638915 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:46:52.638898    5003 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-79805ca9-vcdrx"
Oct 31 17:46:52.655306 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:46:52.655276    5003 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-79805ca9-vcdrx"]
Oct 31 17:46:52.663271 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:46:52.663249    5003 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\""
Oct 31 17:46:52.663393 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:46:52.663379    5003 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-mr9x2\""
Oct 31 17:46:52.669908 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:46:52.669872    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/e88f9a17-0fb1-461b-b515-82e71c03aacf-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-79805ca9-vcdrx\" (UID: \"e88f9a17-0fb1-461b-b515-82e71c03aacf\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-79805ca9-vcdrx"
Oct 31 17:46:52.670062 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:46:52.669911    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/e88f9a17-0fb1-461b-b515-82e71c03aacf-maas-api-xks-ca\") pod \"maas-api-revoke-sub-79805ca9-vcdrx\" (UID: \"e88f9a17-0fb1-461b-b515-82e71c03aacf\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-79805ca9-vcdrx"
Oct 31 17:46:52.670062 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:46:52.670018    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-47hxd\" (UniqueName: \"kubernetes.io/projected/e88f9a17-0fb1-461b-b515-82e71c03aacf-kube-api-access-47hxd\") pod \"maas-api-revoke-sub-79805ca9-vcdrx\" (UID: \"e88f9a17-0fb1-461b-b515-82e71c03aacf\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-79805ca9-vcdrx"
Oct 31 17:46:52.770979 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:46:52.770948    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/e88f9a17-0fb1-461b-b515-82e71c03aacf-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-79805ca9-vcdrx\" (UID: \"e88f9a17-0fb1-461b-b515-82e71c03aacf\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-79805ca9-vcdrx"
Oct 31 17:46:52.770979 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:46:52.770982    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/e88f9a17-0fb1-461b-b515-82e71c03aacf-maas-api-xks-ca\") pod \"maas-api-revoke-sub-79805ca9-vcdrx\" (UID: \"e88f9a17-0fb1-461b-b515-82e71c03aacf\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-79805ca9-vcdrx"
Oct 31 17:46:52.771193 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:46:52.771032    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-47hxd\" (UniqueName: \"kubernetes.io/projected/e88f9a17-0fb1-461b-b515-82e71c03aacf-kube-api-access-47hxd\") pod \"maas-api-revoke-sub-79805ca9-vcdrx\" (UID: \"e88f9a17-0fb1-461b-b515-82e71c03aacf\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-79805ca9-vcdrx"
Oct 31 17:46:52.771591 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:46:52.771563    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/e88f9a17-0fb1-461b-b515-82e71c03aacf-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-79805ca9-vcdrx\" (UID: \"e88f9a17-0fb1-461b-b515-82e71c03aacf\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-79805ca9-vcdrx"
Oct 31 17:46:52.773370 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:46:52.773348    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/e88f9a17-0fb1-461b-b515-82e71c03aacf-maas-api-xks-ca\") pod \"maas-api-revoke-sub-79805ca9-vcdrx\" (UID: \"e88f9a17-0fb1-461b-b515-82e71c03aacf\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-79805ca9-vcdrx"
Oct 31 17:46:52.789159 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:46:52.789136    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-47hxd\" (UniqueName: \"kubernetes.io/projected/e88f9a17-0fb1-461b-b515-82e71c03aacf-kube-api-access-47hxd\") pod \"maas-api-revoke-sub-79805ca9-vcdrx\" (UID: \"e88f9a17-0fb1-461b-b515-82e71c03aacf\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-79805ca9-vcdrx"
Oct 31 17:46:52.951604 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:46:52.951526    5003 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-79805ca9-vcdrx"
Oct 31 17:46:53.249786 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:46:53.249739    5003 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-79805ca9-vcdrx"]
Oct 31 17:46:53.252312 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:46:53.252282    5003 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode88f9a17_0fb1_461b_b515_82e71c03aacf.slice/crio-29bf32817916cdf74a9ea5a75835cf2f2f613156a425fcfe208061e93df0c896 WatchSource:0}: Error finding container 29bf32817916cdf74a9ea5a75835cf2f2f613156a425fcfe208061e93df0c896: Status 404 returned error can't find the container with id 29bf32817916cdf74a9ea5a75835cf2f2f613156a425fcfe208061e93df0c896
Oct 31 17:46:53.766278 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:46:53.766242    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-79805ca9-vcdrx" event={"ID":"e88f9a17-0fb1-461b-b515-82e71c03aacf","Type":"ContainerStarted","Data":"a99b222ced0596895ae1aa8a01f66a681a9bec208d85e878924932abed190355"}
Oct 31 17:46:53.766716 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:46:53.766295    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-79805ca9-vcdrx" event={"ID":"e88f9a17-0fb1-461b-b515-82e71c03aacf","Type":"ContainerStarted","Data":"29bf32817916cdf74a9ea5a75835cf2f2f613156a425fcfe208061e93df0c896"}
Oct 31 17:46:53.802792 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:46:53.802730    5003 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-sub-79805ca9-vcdrx" podStartSLOduration=1.8027162799999998 podStartE2EDuration="1.80271628s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 17:46:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 17:46:53.801713227 +0000 UTC m=+1182.056567768" watchObservedRunningTime="2026-10-31 17:46:53.80271628 +0000 UTC m=+1182.057570823"
Oct 31 17:46:54.774051 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:46:54.774014    5003 generic.go:356] "Generic (PLEG): container finished" podID="e88f9a17-0fb1-461b-b515-82e71c03aacf" containerID="a99b222ced0596895ae1aa8a01f66a681a9bec208d85e878924932abed190355" exitCode=0
Oct 31 17:46:54.774464 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:46:54.774095    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-79805ca9-vcdrx" event={"ID":"e88f9a17-0fb1-461b-b515-82e71c03aacf","Type":"ContainerDied","Data":"a99b222ced0596895ae1aa8a01f66a681a9bec208d85e878924932abed190355"}
Oct 31 17:46:55.922825 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:46:55.922797    5003 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-79805ca9-vcdrx"
Oct 31 17:46:55.996336 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:46:55.996298    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/e88f9a17-0fb1-461b-b515-82e71c03aacf-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/e88f9a17-0fb1-461b-b515-82e71c03aacf-maas-api-xks-ca\") pod \"e88f9a17-0fb1-461b-b515-82e71c03aacf\" (UID: \"e88f9a17-0fb1-461b-b515-82e71c03aacf\") "
Oct 31 17:46:55.996599 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:46:55.996394    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/e88f9a17-0fb1-461b-b515-82e71c03aacf-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/e88f9a17-0fb1-461b-b515-82e71c03aacf-maas-api-openshift-ca\") pod \"e88f9a17-0fb1-461b-b515-82e71c03aacf\" (UID: \"e88f9a17-0fb1-461b-b515-82e71c03aacf\") "
Oct 31 17:46:55.996599 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:46:55.996426    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/e88f9a17-0fb1-461b-b515-82e71c03aacf-kube-api-access-47hxd\" (UniqueName: \"kubernetes.io/projected/e88f9a17-0fb1-461b-b515-82e71c03aacf-kube-api-access-47hxd\") pod \"e88f9a17-0fb1-461b-b515-82e71c03aacf\" (UID: \"e88f9a17-0fb1-461b-b515-82e71c03aacf\") "
Oct 31 17:46:55.996861 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:46:55.996833    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e88f9a17-0fb1-461b-b515-82e71c03aacf-maas-api-openshift-ca" pod "e88f9a17-0fb1-461b-b515-82e71c03aacf" (UID: "e88f9a17-0fb1-461b-b515-82e71c03aacf"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 17:46:55.998459 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:46:55.998434    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e88f9a17-0fb1-461b-b515-82e71c03aacf-maas-api-xks-ca" pod "e88f9a17-0fb1-461b-b515-82e71c03aacf" (UID: "e88f9a17-0fb1-461b-b515-82e71c03aacf"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 17:46:55.998571 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:46:55.998547    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e88f9a17-0fb1-461b-b515-82e71c03aacf-kube-api-access-47hxd" pod "e88f9a17-0fb1-461b-b515-82e71c03aacf" (UID: "e88f9a17-0fb1-461b-b515-82e71c03aacf"). InnerVolumeSpecName "kube-api-access-47hxd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 17:46:56.097419 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:46:56.097381    5003 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/e88f9a17-0fb1-461b-b515-82e71c03aacf-maas-api-xks-ca\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:46:56.097419 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:46:56.097414    5003 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/e88f9a17-0fb1-461b-b515-82e71c03aacf-maas-api-openshift-ca\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:46:56.097607 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:46:56.097431    5003 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-47hxd\" (UniqueName: \"kubernetes.io/projected/e88f9a17-0fb1-461b-b515-82e71c03aacf-kube-api-access-47hxd\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:46:56.788302 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:46:56.788274    5003 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-79805ca9-vcdrx"
Oct 31 17:46:56.788481 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:46:56.788319    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-79805ca9-vcdrx" event={"ID":"e88f9a17-0fb1-461b-b515-82e71c03aacf","Type":"ContainerDied","Data":"29bf32817916cdf74a9ea5a75835cf2f2f613156a425fcfe208061e93df0c896"}
Oct 31 17:46:56.788481 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:46:56.788390    5003 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="29bf32817916cdf74a9ea5a75835cf2f2f613156a425fcfe208061e93df0c896"
Oct 31 17:46:59.026116 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:46:59.026082    5003 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-f827198e-mcgds"]
Oct 31 17:46:59.038126 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:46:59.038075    5003 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-f827198e-mcgds"]
Oct 31 17:46:59.888420 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:46:59.888387    5003 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="bcb7173c-3e08-4d4e-84ef-d88a41aae7dc" path="/var/lib/kubelet/pods/bcb7173c-3e08-4d4e-84ef-d88a41aae7dc/volumes"
Oct 31 17:47:01.026167 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:47:01.026130    5003 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-6ef9a326-tqcgp"]
Oct 31 17:47:01.037844 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:47:01.037813    5003 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-6ef9a326-tqcgp"]
Oct 31 17:47:01.888514 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:47:01.888475    5003 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="b8119054-38c4-4e15-b85c-5b46c13fa1cd" path="/var/lib/kubelet/pods/b8119054-38c4-4e15-b85c-5b46c13fa1cd/volumes"
Oct 31 17:47:10.330984 ip-10-0-138-17 kubenswrapper[5003]: E1031 17:47:10.330945    5003 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-tdzz5" containerName="extractor"
Oct 31 17:47:12.171324 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:47:12.171285    5003 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-b2xxw_f03611db-3bd9-401a-a137-1d4f691b51ea/console-operator/2.log"
Oct 31 17:47:12.172837 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:47:12.172813    5003 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-b2xxw_f03611db-3bd9-401a-a137-1d4f691b51ea/console-operator/2.log"
Oct 31 17:47:12.506901 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:47:12.506818    5003 scope.go:122] "RemoveContainer" containerID="b1b5e46095e81436698b9ad4bb989b730d6c565c3134d075ed41d9cf9fe37079"
Oct 31 17:47:12.516841 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:47:12.516817    5003 scope.go:122] "RemoveContainer" containerID="2c246c66604fae139b041fc37a48dce9f4b97865f301b2dedaabef2bc78b9d22"
Oct 31 17:47:12.527278 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:47:12.527256    5003 scope.go:122] "RemoveContainer" containerID="20b0f24b4fae04407216857d8b4d5688951e298b4493792e86207328fe3fe7a5"
Oct 31 17:47:12.562663 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:47:12.556384    5003 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-0b7e8edb-c474k"]
Oct 31 17:47:12.562663 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:47:12.557386    5003 cpu_manager.go:414] "containerMap: removing container" podUID="e88f9a17-0fb1-461b-b515-82e71c03aacf" containerName="revoke-keys"
Oct 31 17:47:12.562663 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:47:12.557409    5003 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="e88f9a17-0fb1-461b-b515-82e71c03aacf" containerName="revoke-keys"
Oct 31 17:47:12.562663 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:47:12.557604    5003 memory_manager.go:365] "RemoveStaleState removing state" podUID="e88f9a17-0fb1-461b-b515-82e71c03aacf" containerName="revoke-keys"
Oct 31 17:47:12.566175 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:47:12.566155    5003 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-0b7e8edb-c474k"
Oct 31 17:47:12.574927 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:47:12.574902    5003 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-0b7e8edb-c474k"]
Oct 31 17:47:12.582832 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:47:12.582805    5003 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\""
Oct 31 17:47:12.582832 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:47:12.582817    5003 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-mr9x2\""
Oct 31 17:47:12.678662 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:47:12.678616    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/fe21c4f3-887f-4520-bf08-942d0658fdd8-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-0b7e8edb-c474k\" (UID: \"fe21c4f3-887f-4520-bf08-942d0658fdd8\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-0b7e8edb-c474k"
Oct 31 17:47:12.678828 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:47:12.678776    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d7php\" (UniqueName: \"kubernetes.io/projected/fe21c4f3-887f-4520-bf08-942d0658fdd8-kube-api-access-d7php\") pod \"maas-api-revoke-sub-0b7e8edb-c474k\" (UID: \"fe21c4f3-887f-4520-bf08-942d0658fdd8\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-0b7e8edb-c474k"
Oct 31 17:47:12.678828 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:47:12.678803    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/fe21c4f3-887f-4520-bf08-942d0658fdd8-maas-api-xks-ca\") pod \"maas-api-revoke-sub-0b7e8edb-c474k\" (UID: \"fe21c4f3-887f-4520-bf08-942d0658fdd8\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-0b7e8edb-c474k"
Oct 31 17:47:12.779830 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:47:12.779754    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d7php\" (UniqueName: \"kubernetes.io/projected/fe21c4f3-887f-4520-bf08-942d0658fdd8-kube-api-access-d7php\") pod \"maas-api-revoke-sub-0b7e8edb-c474k\" (UID: \"fe21c4f3-887f-4520-bf08-942d0658fdd8\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-0b7e8edb-c474k"
Oct 31 17:47:12.779830 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:47:12.779792    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/fe21c4f3-887f-4520-bf08-942d0658fdd8-maas-api-xks-ca\") pod \"maas-api-revoke-sub-0b7e8edb-c474k\" (UID: \"fe21c4f3-887f-4520-bf08-942d0658fdd8\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-0b7e8edb-c474k"
Oct 31 17:47:12.780004 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:47:12.779850    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/fe21c4f3-887f-4520-bf08-942d0658fdd8-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-0b7e8edb-c474k\" (UID: \"fe21c4f3-887f-4520-bf08-942d0658fdd8\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-0b7e8edb-c474k"
Oct 31 17:47:12.780486 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:47:12.780465    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/fe21c4f3-887f-4520-bf08-942d0658fdd8-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-0b7e8edb-c474k\" (UID: \"fe21c4f3-887f-4520-bf08-942d0658fdd8\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-0b7e8edb-c474k"
Oct 31 17:47:12.782211 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:47:12.782189    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/fe21c4f3-887f-4520-bf08-942d0658fdd8-maas-api-xks-ca\") pod \"maas-api-revoke-sub-0b7e8edb-c474k\" (UID: \"fe21c4f3-887f-4520-bf08-942d0658fdd8\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-0b7e8edb-c474k"
Oct 31 17:47:12.798439 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:47:12.798416    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d7php\" (UniqueName: \"kubernetes.io/projected/fe21c4f3-887f-4520-bf08-942d0658fdd8-kube-api-access-d7php\") pod \"maas-api-revoke-sub-0b7e8edb-c474k\" (UID: \"fe21c4f3-887f-4520-bf08-942d0658fdd8\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-0b7e8edb-c474k"
Oct 31 17:47:12.881260 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:47:12.881235    5003 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-0b7e8edb-c474k"
Oct 31 17:47:13.031633 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:47:13.031553    5003 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-e15c3d5b-79884"]
Oct 31 17:47:13.034594 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:47:13.034568    5003 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-e15c3d5b-79884"]
Oct 31 17:47:13.179221 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:47:13.179125    5003 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-0b7e8edb-c474k"]
Oct 31 17:47:13.182135 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:47:13.182106    5003 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfe21c4f3_887f_4520_bf08_942d0658fdd8.slice/crio-0fb9eb3c28b7a14698d9b1e3751e501200dd749570a243af08b697d249bec3a1 WatchSource:0}: Error finding container 0fb9eb3c28b7a14698d9b1e3751e501200dd749570a243af08b697d249bec3a1: Status 404 returned error can't find the container with id 0fb9eb3c28b7a14698d9b1e3751e501200dd749570a243af08b697d249bec3a1
Oct 31 17:47:13.888972 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:47:13.888940    5003 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="bcf651cc-ecd4-443c-b968-72575fc1174d" path="/var/lib/kubelet/pods/bcf651cc-ecd4-443c-b968-72575fc1174d/volumes"
Oct 31 17:47:13.970763 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:47:13.970726    5003 generic.go:356] "Generic (PLEG): container finished" podID="fe21c4f3-887f-4520-bf08-942d0658fdd8" containerID="03ff8ac40c761d92902f56bc9950837558d0a14e26073a4fe134a1313ff46c8a" exitCode=0
Oct 31 17:47:13.970934 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:47:13.970812    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-0b7e8edb-c474k" event={"ID":"fe21c4f3-887f-4520-bf08-942d0658fdd8","Type":"ContainerDied","Data":"03ff8ac40c761d92902f56bc9950837558d0a14e26073a4fe134a1313ff46c8a"}
Oct 31 17:47:13.970934 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:47:13.970862    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-0b7e8edb-c474k" event={"ID":"fe21c4f3-887f-4520-bf08-942d0658fdd8","Type":"ContainerStarted","Data":"0fb9eb3c28b7a14698d9b1e3751e501200dd749570a243af08b697d249bec3a1"}
Oct 31 17:47:15.026098 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:47:15.026058    5003 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-49c5059e-qq2br"]
Oct 31 17:47:15.040385 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:47:15.040354    5003 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-49c5059e-qq2br"]
Oct 31 17:47:15.130819 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:47:15.130796    5003 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-0b7e8edb-c474k"
Oct 31 17:47:15.206580 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:47:15.206546    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/fe21c4f3-887f-4520-bf08-942d0658fdd8-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/fe21c4f3-887f-4520-bf08-942d0658fdd8-maas-api-xks-ca\") pod \"fe21c4f3-887f-4520-bf08-942d0658fdd8\" (UID: \"fe21c4f3-887f-4520-bf08-942d0658fdd8\") "
Oct 31 17:47:15.206732 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:47:15.206599    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/fe21c4f3-887f-4520-bf08-942d0658fdd8-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/fe21c4f3-887f-4520-bf08-942d0658fdd8-maas-api-openshift-ca\") pod \"fe21c4f3-887f-4520-bf08-942d0658fdd8\" (UID: \"fe21c4f3-887f-4520-bf08-942d0658fdd8\") "
Oct 31 17:47:15.206732 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:47:15.206625    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/fe21c4f3-887f-4520-bf08-942d0658fdd8-kube-api-access-d7php\" (UniqueName: \"kubernetes.io/projected/fe21c4f3-887f-4520-bf08-942d0658fdd8-kube-api-access-d7php\") pod \"fe21c4f3-887f-4520-bf08-942d0658fdd8\" (UID: \"fe21c4f3-887f-4520-bf08-942d0658fdd8\") "
Oct 31 17:47:15.207077 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:47:15.207039    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fe21c4f3-887f-4520-bf08-942d0658fdd8-maas-api-openshift-ca" pod "fe21c4f3-887f-4520-bf08-942d0658fdd8" (UID: "fe21c4f3-887f-4520-bf08-942d0658fdd8"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 17:47:15.208640 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:47:15.208617    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fe21c4f3-887f-4520-bf08-942d0658fdd8-maas-api-xks-ca" pod "fe21c4f3-887f-4520-bf08-942d0658fdd8" (UID: "fe21c4f3-887f-4520-bf08-942d0658fdd8"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 17:47:15.208762 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:47:15.208668    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fe21c4f3-887f-4520-bf08-942d0658fdd8-kube-api-access-d7php" pod "fe21c4f3-887f-4520-bf08-942d0658fdd8" (UID: "fe21c4f3-887f-4520-bf08-942d0658fdd8"). InnerVolumeSpecName "kube-api-access-d7php". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 17:47:15.308166 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:47:15.308139    5003 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/fe21c4f3-887f-4520-bf08-942d0658fdd8-maas-api-xks-ca\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:47:15.308166 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:47:15.308166    5003 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/fe21c4f3-887f-4520-bf08-942d0658fdd8-maas-api-openshift-ca\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:47:15.308343 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:47:15.308176    5003 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d7php\" (UniqueName: \"kubernetes.io/projected/fe21c4f3-887f-4520-bf08-942d0658fdd8-kube-api-access-d7php\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:47:15.888858 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:47:15.888822    5003 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="b51d3573-af2d-4813-ad48-73668757ede7" path="/var/lib/kubelet/pods/b51d3573-af2d-4813-ad48-73668757ede7/volumes"
Oct 31 17:47:15.985282 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:47:15.985252    5003 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-0b7e8edb-c474k"
Oct 31 17:47:15.985441 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:47:15.985292    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-0b7e8edb-c474k" event={"ID":"fe21c4f3-887f-4520-bf08-942d0658fdd8","Type":"ContainerDied","Data":"0fb9eb3c28b7a14698d9b1e3751e501200dd749570a243af08b697d249bec3a1"}
Oct 31 17:47:15.985441 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:47:15.985337    5003 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0fb9eb3c28b7a14698d9b1e3751e501200dd749570a243af08b697d249bec3a1"
Oct 31 17:47:16.025846 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:47:16.025815    5003 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-5d29a9aa-6lrkh"]
Oct 31 17:47:16.033293 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:47:16.031661    5003 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-5d29a9aa-6lrkh"]
Oct 31 17:47:17.889978 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:47:17.889926    5003 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="4bf9b794-ebb8-47f4-b084-e5f6ba0e6453" path="/var/lib/kubelet/pods/4bf9b794-ebb8-47f4-b084-e5f6ba0e6453/volumes"
Oct 31 17:47:19.030735 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:47:19.030698    5003 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-271db076-dn2gx"]
Oct 31 17:47:19.042216 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:47:19.042185    5003 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-271db076-dn2gx"]
Oct 31 17:47:19.888125 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:47:19.888090    5003 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="7984ecfd-fc9a-4343-aae8-8c35b9bae263" path="/var/lib/kubelet/pods/7984ecfd-fc9a-4343-aae8-8c35b9bae263/volumes"
Oct 31 17:47:23.289889 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:47:23.289808    5003 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-9kphz"]
Oct 31 17:47:23.290332 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:47:23.290317    5003 cpu_manager.go:414] "containerMap: removing container" podUID="fe21c4f3-887f-4520-bf08-942d0658fdd8" containerName="revoke-keys"
Oct 31 17:47:23.290386 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:47:23.290333    5003 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="fe21c4f3-887f-4520-bf08-942d0658fdd8" containerName="revoke-keys"
Oct 31 17:47:23.290468 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:47:23.290414    5003 memory_manager.go:365] "RemoveStaleState removing state" podUID="fe21c4f3-887f-4520-bf08-942d0658fdd8" containerName="revoke-keys"
Oct 31 17:47:23.294927 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:47:23.294909    5003 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-9kphz"
Oct 31 17:47:23.311865 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:47:23.311839    5003 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-9kphz"]
Oct 31 17:47:23.319836 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:47:23.319810    5003 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\""
Oct 31 17:47:23.319979 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:47:23.319914    5003 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-mr9x2\""
Oct 31 17:47:23.387904 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:47:23.387865    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/a21b9e43-8e60-4a66-a22a-6362fd1fb87f-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-3d4156f1-9kphz\" (UID: \"a21b9e43-8e60-4a66-a22a-6362fd1fb87f\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-9kphz"
Oct 31 17:47:23.388076 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:47:23.387946    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/a21b9e43-8e60-4a66-a22a-6362fd1fb87f-maas-api-xks-ca\") pod \"maas-api-revoke-sub-3d4156f1-9kphz\" (UID: \"a21b9e43-8e60-4a66-a22a-6362fd1fb87f\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-9kphz"
Oct 31 17:47:23.388147 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:47:23.388073    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xlqp6\" (UniqueName: \"kubernetes.io/projected/a21b9e43-8e60-4a66-a22a-6362fd1fb87f-kube-api-access-xlqp6\") pod \"maas-api-revoke-sub-3d4156f1-9kphz\" (UID: \"a21b9e43-8e60-4a66-a22a-6362fd1fb87f\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-9kphz"
Oct 31 17:47:23.488798 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:47:23.488763    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/a21b9e43-8e60-4a66-a22a-6362fd1fb87f-maas-api-xks-ca\") pod \"maas-api-revoke-sub-3d4156f1-9kphz\" (UID: \"a21b9e43-8e60-4a66-a22a-6362fd1fb87f\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-9kphz"
Oct 31 17:47:23.488978 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:47:23.488850    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xlqp6\" (UniqueName: \"kubernetes.io/projected/a21b9e43-8e60-4a66-a22a-6362fd1fb87f-kube-api-access-xlqp6\") pod \"maas-api-revoke-sub-3d4156f1-9kphz\" (UID: \"a21b9e43-8e60-4a66-a22a-6362fd1fb87f\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-9kphz"
Oct 31 17:47:23.488978 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:47:23.488877    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/a21b9e43-8e60-4a66-a22a-6362fd1fb87f-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-3d4156f1-9kphz\" (UID: \"a21b9e43-8e60-4a66-a22a-6362fd1fb87f\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-9kphz"
Oct 31 17:47:23.489624 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:47:23.489599    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/a21b9e43-8e60-4a66-a22a-6362fd1fb87f-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-3d4156f1-9kphz\" (UID: \"a21b9e43-8e60-4a66-a22a-6362fd1fb87f\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-9kphz"
Oct 31 17:47:23.491246 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:47:23.491223    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/a21b9e43-8e60-4a66-a22a-6362fd1fb87f-maas-api-xks-ca\") pod \"maas-api-revoke-sub-3d4156f1-9kphz\" (UID: \"a21b9e43-8e60-4a66-a22a-6362fd1fb87f\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-9kphz"
Oct 31 17:47:23.507297 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:47:23.507272    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xlqp6\" (UniqueName: \"kubernetes.io/projected/a21b9e43-8e60-4a66-a22a-6362fd1fb87f-kube-api-access-xlqp6\") pod \"maas-api-revoke-sub-3d4156f1-9kphz\" (UID: \"a21b9e43-8e60-4a66-a22a-6362fd1fb87f\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-9kphz"
Oct 31 17:47:23.607565 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:47:23.607538    5003 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-9kphz"
Oct 31 17:47:23.904243 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:47:23.904221    5003 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-9kphz"]
Oct 31 17:47:23.907209 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:47:23.907174    5003 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda21b9e43_8e60_4a66_a22a_6362fd1fb87f.slice/crio-05940f4b9e92e8b34468789d23a35ccfe77df09f8ffa3d22d5dbfde66c261fe6 WatchSource:0}: Error finding container 05940f4b9e92e8b34468789d23a35ccfe77df09f8ffa3d22d5dbfde66c261fe6: Status 404 returned error can't find the container with id 05940f4b9e92e8b34468789d23a35ccfe77df09f8ffa3d22d5dbfde66c261fe6
Oct 31 17:47:24.038697 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:47:24.038663    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-9kphz" event={"ID":"a21b9e43-8e60-4a66-a22a-6362fd1fb87f","Type":"ContainerStarted","Data":"05940f4b9e92e8b34468789d23a35ccfe77df09f8ffa3d22d5dbfde66c261fe6"}
Oct 31 17:47:25.050844 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:47:25.050762    5003 generic.go:356] "Generic (PLEG): container finished" podID="a21b9e43-8e60-4a66-a22a-6362fd1fb87f" containerID="2fc6cd959c1b84e93ab3eb114a3d30128e2b7ed2675d5f6562142671662df9ed" exitCode=0
Oct 31 17:47:25.051232 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:47:25.050850    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-9kphz" event={"ID":"a21b9e43-8e60-4a66-a22a-6362fd1fb87f","Type":"ContainerDied","Data":"2fc6cd959c1b84e93ab3eb114a3d30128e2b7ed2675d5f6562142671662df9ed"}
Oct 31 17:47:26.204793 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:47:26.204766    5003 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-9kphz"
Oct 31 17:47:26.316381 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:47:26.316297    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/a21b9e43-8e60-4a66-a22a-6362fd1fb87f-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/a21b9e43-8e60-4a66-a22a-6362fd1fb87f-maas-api-xks-ca\") pod \"a21b9e43-8e60-4a66-a22a-6362fd1fb87f\" (UID: \"a21b9e43-8e60-4a66-a22a-6362fd1fb87f\") "
Oct 31 17:47:26.316381 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:47:26.316364    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/a21b9e43-8e60-4a66-a22a-6362fd1fb87f-kube-api-access-xlqp6\" (UniqueName: \"kubernetes.io/projected/a21b9e43-8e60-4a66-a22a-6362fd1fb87f-kube-api-access-xlqp6\") pod \"a21b9e43-8e60-4a66-a22a-6362fd1fb87f\" (UID: \"a21b9e43-8e60-4a66-a22a-6362fd1fb87f\") "
Oct 31 17:47:26.316574 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:47:26.316447    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/a21b9e43-8e60-4a66-a22a-6362fd1fb87f-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/a21b9e43-8e60-4a66-a22a-6362fd1fb87f-maas-api-openshift-ca\") pod \"a21b9e43-8e60-4a66-a22a-6362fd1fb87f\" (UID: \"a21b9e43-8e60-4a66-a22a-6362fd1fb87f\") "
Oct 31 17:47:26.316829 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:47:26.316803    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a21b9e43-8e60-4a66-a22a-6362fd1fb87f-maas-api-openshift-ca" pod "a21b9e43-8e60-4a66-a22a-6362fd1fb87f" (UID: "a21b9e43-8e60-4a66-a22a-6362fd1fb87f"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 17:47:26.318543 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:47:26.318515    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a21b9e43-8e60-4a66-a22a-6362fd1fb87f-maas-api-xks-ca" pod "a21b9e43-8e60-4a66-a22a-6362fd1fb87f" (UID: "a21b9e43-8e60-4a66-a22a-6362fd1fb87f"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 17:47:26.318683 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:47:26.318575    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a21b9e43-8e60-4a66-a22a-6362fd1fb87f-kube-api-access-xlqp6" pod "a21b9e43-8e60-4a66-a22a-6362fd1fb87f" (UID: "a21b9e43-8e60-4a66-a22a-6362fd1fb87f"). InnerVolumeSpecName "kube-api-access-xlqp6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 17:47:26.417477 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:47:26.417442    5003 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/a21b9e43-8e60-4a66-a22a-6362fd1fb87f-maas-api-xks-ca\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:47:26.417477 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:47:26.417471    5003 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xlqp6\" (UniqueName: \"kubernetes.io/projected/a21b9e43-8e60-4a66-a22a-6362fd1fb87f-kube-api-access-xlqp6\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:47:26.417477 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:47:26.417484    5003 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/a21b9e43-8e60-4a66-a22a-6362fd1fb87f-maas-api-openshift-ca\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:47:27.072428 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:47:27.072398    5003 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-9kphz"
Oct 31 17:47:27.072614 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:47:27.072434    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-9kphz" event={"ID":"a21b9e43-8e60-4a66-a22a-6362fd1fb87f","Type":"ContainerDied","Data":"05940f4b9e92e8b34468789d23a35ccfe77df09f8ffa3d22d5dbfde66c261fe6"}
Oct 31 17:47:27.072614 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:47:27.072483    5003 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="05940f4b9e92e8b34468789d23a35ccfe77df09f8ffa3d22d5dbfde66c261fe6"
Oct 31 17:47:34.022699 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:47:34.022607    5003 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-49dabe6f-xrmqh"]
Oct 31 17:47:34.034205 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:47:34.034179    5003 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-49dabe6f-xrmqh"]
Oct 31 17:47:35.921787 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:47:35.921752    5003 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="66d82d62-6b08-42ed-8b29-a47110c86879" path="/var/lib/kubelet/pods/66d82d62-6b08-42ed-8b29-a47110c86879/volumes"
Oct 31 17:47:40.330777 ip-10-0-138-17 kubenswrapper[5003]: E1031 17:47:40.330731    5003 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-tdzz5" containerName="extractor"
Oct 31 17:47:43.492898 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:47:43.492859    5003 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-9kphz"]
Oct 31 17:47:43.504315 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:47:43.504284    5003 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-9kphz"]
Oct 31 17:47:43.538953 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:47:43.538917    5003 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-7m9lh"]
Oct 31 17:47:43.539436 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:47:43.539416    5003 cpu_manager.go:414] "containerMap: removing container" podUID="a21b9e43-8e60-4a66-a22a-6362fd1fb87f" containerName="revoke-keys"
Oct 31 17:47:43.539522 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:47:43.539437    5003 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="a21b9e43-8e60-4a66-a22a-6362fd1fb87f" containerName="revoke-keys"
Oct 31 17:47:43.539599 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:47:43.539586    5003 memory_manager.go:365] "RemoveStaleState removing state" podUID="a21b9e43-8e60-4a66-a22a-6362fd1fb87f" containerName="revoke-keys"
Oct 31 17:47:43.543051 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:47:43.543030    5003 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-7m9lh"
Oct 31 17:47:43.558120 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:47:43.558095    5003 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\""
Oct 31 17:47:43.558224 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:47:43.558151    5003 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-mr9x2\""
Oct 31 17:47:43.561502 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:47:43.561476    5003 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-7m9lh"]
Oct 31 17:47:43.701078 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:47:43.701046    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/5fd2a296-faaa-4390-a177-3f36dd962771-maas-api-xks-ca\") pod \"maas-api-revoke-sub-3d4156f1-7m9lh\" (UID: \"5fd2a296-faaa-4390-a177-3f36dd962771\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-7m9lh"
Oct 31 17:47:43.701260 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:47:43.701089    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rbwkp\" (UniqueName: \"kubernetes.io/projected/5fd2a296-faaa-4390-a177-3f36dd962771-kube-api-access-rbwkp\") pod \"maas-api-revoke-sub-3d4156f1-7m9lh\" (UID: \"5fd2a296-faaa-4390-a177-3f36dd962771\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-7m9lh"
Oct 31 17:47:43.701260 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:47:43.701118    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/5fd2a296-faaa-4390-a177-3f36dd962771-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-3d4156f1-7m9lh\" (UID: \"5fd2a296-faaa-4390-a177-3f36dd962771\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-7m9lh"
Oct 31 17:47:43.802021 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:47:43.801911    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/5fd2a296-faaa-4390-a177-3f36dd962771-maas-api-xks-ca\") pod \"maas-api-revoke-sub-3d4156f1-7m9lh\" (UID: \"5fd2a296-faaa-4390-a177-3f36dd962771\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-7m9lh"
Oct 31 17:47:43.802021 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:47:43.801990    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rbwkp\" (UniqueName: \"kubernetes.io/projected/5fd2a296-faaa-4390-a177-3f36dd962771-kube-api-access-rbwkp\") pod \"maas-api-revoke-sub-3d4156f1-7m9lh\" (UID: \"5fd2a296-faaa-4390-a177-3f36dd962771\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-7m9lh"
Oct 31 17:47:43.802021 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:47:43.802023    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/5fd2a296-faaa-4390-a177-3f36dd962771-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-3d4156f1-7m9lh\" (UID: \"5fd2a296-faaa-4390-a177-3f36dd962771\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-7m9lh"
Oct 31 17:47:43.802793 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:47:43.802770    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/5fd2a296-faaa-4390-a177-3f36dd962771-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-3d4156f1-7m9lh\" (UID: \"5fd2a296-faaa-4390-a177-3f36dd962771\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-7m9lh"
Oct 31 17:47:43.804260 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:47:43.804242    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/5fd2a296-faaa-4390-a177-3f36dd962771-maas-api-xks-ca\") pod \"maas-api-revoke-sub-3d4156f1-7m9lh\" (UID: \"5fd2a296-faaa-4390-a177-3f36dd962771\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-7m9lh"
Oct 31 17:47:43.822318 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:47:43.822288    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rbwkp\" (UniqueName: \"kubernetes.io/projected/5fd2a296-faaa-4390-a177-3f36dd962771-kube-api-access-rbwkp\") pod \"maas-api-revoke-sub-3d4156f1-7m9lh\" (UID: \"5fd2a296-faaa-4390-a177-3f36dd962771\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-7m9lh"
Oct 31 17:47:43.855701 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:47:43.855664    5003 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-7m9lh"
Oct 31 17:47:43.889392 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:47:43.889357    5003 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="a21b9e43-8e60-4a66-a22a-6362fd1fb87f" path="/var/lib/kubelet/pods/a21b9e43-8e60-4a66-a22a-6362fd1fb87f/volumes"
Oct 31 17:47:44.150457 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:47:44.150420    5003 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-7m9lh"]
Oct 31 17:47:44.154482 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:47:44.154451    5003 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5fd2a296_faaa_4390_a177_3f36dd962771.slice/crio-a0ec79cb5ed4c3300fc517379ebc2bd09efc666e9f895a0f600573236c3754ed WatchSource:0}: Error finding container a0ec79cb5ed4c3300fc517379ebc2bd09efc666e9f895a0f600573236c3754ed: Status 404 returned error can't find the container with id a0ec79cb5ed4c3300fc517379ebc2bd09efc666e9f895a0f600573236c3754ed
Oct 31 17:47:44.185913 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:47:44.185876    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-7m9lh" event={"ID":"5fd2a296-faaa-4390-a177-3f36dd962771","Type":"ContainerStarted","Data":"a0ec79cb5ed4c3300fc517379ebc2bd09efc666e9f895a0f600573236c3754ed"}
Oct 31 17:47:45.194479 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:47:45.194439    5003 generic.go:356] "Generic (PLEG): container finished" podID="5fd2a296-faaa-4390-a177-3f36dd962771" containerID="eda0ed7688b7824304312f213db9115c3890ca89df4ab7d5ee538ac0ea8546e9" exitCode=0
Oct 31 17:47:45.194974 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:47:45.194514    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-7m9lh" event={"ID":"5fd2a296-faaa-4390-a177-3f36dd962771","Type":"ContainerDied","Data":"eda0ed7688b7824304312f213db9115c3890ca89df4ab7d5ee538ac0ea8546e9"}
Oct 31 17:47:45.196302 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:47:45.196280    5003 generic.go:356] "Generic (PLEG): container finished" podID="b2cff6d8-d6c5-4297-a938-d811b39d7043" containerID="bc5e8b99a89f4d1906b6088bf0ce0eabca95b2b2b02c8c6191fa9f476c3ed197" exitCode=0
Oct 31 17:47:45.196406 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:47:45.196319    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/periodic-gathering-rbznb-vn5t8" event={"ID":"b2cff6d8-d6c5-4297-a938-d811b39d7043","Type":"ContainerDied","Data":"bc5e8b99a89f4d1906b6088bf0ce0eabca95b2b2b02c8c6191fa9f476c3ed197"}
Oct 31 17:47:46.364939 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:47:46.364917    5003 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-7m9lh"
Oct 31 17:47:46.367743 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:47:46.367725    5003 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-insights/periodic-gathering-rbznb-vn5t8"
Oct 31 17:47:46.528857 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:47:46.528779    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/5fd2a296-faaa-4390-a177-3f36dd962771-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/5fd2a296-faaa-4390-a177-3f36dd962771-maas-api-openshift-ca\") pod \"5fd2a296-faaa-4390-a177-3f36dd962771\" (UID: \"5fd2a296-faaa-4390-a177-3f36dd962771\") "
Oct 31 17:47:46.528857 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:47:46.528828    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/b2cff6d8-d6c5-4297-a938-d811b39d7043-kube-api-access-w8882\" (UniqueName: \"kubernetes.io/projected/b2cff6d8-d6c5-4297-a938-d811b39d7043-kube-api-access-w8882\") pod \"b2cff6d8-d6c5-4297-a938-d811b39d7043\" (UID: \"b2cff6d8-d6c5-4297-a938-d811b39d7043\") "
Oct 31 17:47:46.529099 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:47:46.528860    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/b2cff6d8-d6c5-4297-a938-d811b39d7043-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b2cff6d8-d6c5-4297-a938-d811b39d7043-service-ca-bundle\") pod \"b2cff6d8-d6c5-4297-a938-d811b39d7043\" (UID: \"b2cff6d8-d6c5-4297-a938-d811b39d7043\") "
Oct 31 17:47:46.529099 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:47:46.528878    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/b2cff6d8-d6c5-4297-a938-d811b39d7043-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b2cff6d8-d6c5-4297-a938-d811b39d7043-trusted-ca-bundle\") pod \"b2cff6d8-d6c5-4297-a938-d811b39d7043\" (UID: \"b2cff6d8-d6c5-4297-a938-d811b39d7043\") "
Oct 31 17:47:46.529099 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:47:46.528931    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/5fd2a296-faaa-4390-a177-3f36dd962771-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/5fd2a296-faaa-4390-a177-3f36dd962771-maas-api-xks-ca\") pod \"5fd2a296-faaa-4390-a177-3f36dd962771\" (UID: \"5fd2a296-faaa-4390-a177-3f36dd962771\") "
Oct 31 17:47:46.529099 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:47:46.529038    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/5fd2a296-faaa-4390-a177-3f36dd962771-kube-api-access-rbwkp\" (UniqueName: \"kubernetes.io/projected/5fd2a296-faaa-4390-a177-3f36dd962771-kube-api-access-rbwkp\") pod \"5fd2a296-faaa-4390-a177-3f36dd962771\" (UID: \"5fd2a296-faaa-4390-a177-3f36dd962771\") "
Oct 31 17:47:46.529099 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:47:46.529081    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b2cff6d8-d6c5-4297-a938-d811b39d7043-archives-path\" (UniqueName: \"kubernetes.io/empty-dir/b2cff6d8-d6c5-4297-a938-d811b39d7043-archives-path\") pod \"b2cff6d8-d6c5-4297-a938-d811b39d7043\" (UID: \"b2cff6d8-d6c5-4297-a938-d811b39d7043\") "
Oct 31 17:47:46.529343 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:47:46.529211    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5fd2a296-faaa-4390-a177-3f36dd962771-maas-api-openshift-ca" pod "5fd2a296-faaa-4390-a177-3f36dd962771" (UID: "5fd2a296-faaa-4390-a177-3f36dd962771"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 17:47:46.529343 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:47:46.529264    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b2cff6d8-d6c5-4297-a938-d811b39d7043-service-ca-bundle" pod "b2cff6d8-d6c5-4297-a938-d811b39d7043" (UID: "b2cff6d8-d6c5-4297-a938-d811b39d7043"). InnerVolumeSpecName "service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 17:47:46.529343 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:47:46.529320    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b2cff6d8-d6c5-4297-a938-d811b39d7043-trusted-ca-bundle" pod "b2cff6d8-d6c5-4297-a938-d811b39d7043" (UID: "b2cff6d8-d6c5-4297-a938-d811b39d7043"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 17:47:46.529520 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:47:46.529488    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b2cff6d8-d6c5-4297-a938-d811b39d7043-archives-path" pod "b2cff6d8-d6c5-4297-a938-d811b39d7043" (UID: "b2cff6d8-d6c5-4297-a938-d811b39d7043"). InnerVolumeSpecName "archives-path". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 17:47:46.529586 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:47:46.529546    5003 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/5fd2a296-faaa-4390-a177-3f36dd962771-maas-api-openshift-ca\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:47:46.529586 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:47:46.529570    5003 reconciler_common.go:299] "Volume detached for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b2cff6d8-d6c5-4297-a938-d811b39d7043-service-ca-bundle\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:47:46.529586 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:47:46.529583    5003 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b2cff6d8-d6c5-4297-a938-d811b39d7043-trusted-ca-bundle\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:47:46.531078 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:47:46.531057    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5fd2a296-faaa-4390-a177-3f36dd962771-maas-api-xks-ca" pod "5fd2a296-faaa-4390-a177-3f36dd962771" (UID: "5fd2a296-faaa-4390-a177-3f36dd962771"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 17:47:46.531290 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:47:46.531266    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5fd2a296-faaa-4390-a177-3f36dd962771-kube-api-access-rbwkp" pod "5fd2a296-faaa-4390-a177-3f36dd962771" (UID: "5fd2a296-faaa-4390-a177-3f36dd962771"). InnerVolumeSpecName "kube-api-access-rbwkp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 17:47:46.531290 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:47:46.531278    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b2cff6d8-d6c5-4297-a938-d811b39d7043-kube-api-access-w8882" pod "b2cff6d8-d6c5-4297-a938-d811b39d7043" (UID: "b2cff6d8-d6c5-4297-a938-d811b39d7043"). InnerVolumeSpecName "kube-api-access-w8882". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 17:47:46.630389 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:47:46.630356    5003 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/5fd2a296-faaa-4390-a177-3f36dd962771-maas-api-xks-ca\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:47:46.630389 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:47:46.630385    5003 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rbwkp\" (UniqueName: \"kubernetes.io/projected/5fd2a296-faaa-4390-a177-3f36dd962771-kube-api-access-rbwkp\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:47:46.630389 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:47:46.630397    5003 reconciler_common.go:299] "Volume detached for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/b2cff6d8-d6c5-4297-a938-d811b39d7043-archives-path\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:47:46.630631 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:47:46.630407    5003 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w8882\" (UniqueName: \"kubernetes.io/projected/b2cff6d8-d6c5-4297-a938-d811b39d7043-kube-api-access-w8882\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:47:47.210148 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:47:47.210112    5003 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-insights/periodic-gathering-rbznb-vn5t8"
Oct 31 17:47:47.210332 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:47:47.210151    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/periodic-gathering-rbznb-vn5t8" event={"ID":"b2cff6d8-d6c5-4297-a938-d811b39d7043","Type":"ContainerDied","Data":"bbf2f8a9290410d210ababd3618173f9010f449356de5e34490a8f62cd13b045"}
Oct 31 17:47:47.210332 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:47:47.210198    5003 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="bbf2f8a9290410d210ababd3618173f9010f449356de5e34490a8f62cd13b045"
Oct 31 17:47:47.211698 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:47:47.211675    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-7m9lh" event={"ID":"5fd2a296-faaa-4390-a177-3f36dd962771","Type":"ContainerDied","Data":"a0ec79cb5ed4c3300fc517379ebc2bd09efc666e9f895a0f600573236c3754ed"}
Oct 31 17:47:47.211782 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:47:47.211723    5003 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a0ec79cb5ed4c3300fc517379ebc2bd09efc666e9f895a0f600573236c3754ed"
Oct 31 17:47:47.211782 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:47:47.211685    5003 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-7m9lh"
Oct 31 17:47:49.028251 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:47:49.028218    5003 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-fdac4c5b-4jxs4"]
Oct 31 17:47:49.039878 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:47:49.039849    5003 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-fdac4c5b-4jxs4"]
Oct 31 17:47:49.042620 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:47:49.042595    5003 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-f64ceb2b-xh2mb"]
Oct 31 17:47:49.044993 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:47:49.044973    5003 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-f64ceb2b-xh2mb"]
Oct 31 17:47:49.887581 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:47:49.887552    5003 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="bfa2dbca-7f50-4a7a-97a7-e780fa561f47" path="/var/lib/kubelet/pods/bfa2dbca-7f50-4a7a-97a7-e780fa561f47/volumes"
Oct 31 17:47:49.887985 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:47:49.887971    5003 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="c04e8e25-b143-4ff0-85d4-a5f8e569887f" path="/var/lib/kubelet/pods/c04e8e25-b143-4ff0-85d4-a5f8e569887f/volumes"
Oct 31 17:47:50.025166 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:47:50.025127    5003 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-d8e5e35c-xlfxz"]
Oct 31 17:47:50.036969 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:47:50.036936    5003 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-d8e5e35c-xlfxz"]
Oct 31 17:47:51.888424 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:47:51.888393    5003 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="24b256e4-f9ad-4df2-ae67-bd7ddee0118e" path="/var/lib/kubelet/pods/24b256e4-f9ad-4df2-ae67-bd7ddee0118e/volumes"
Oct 31 17:48:10.332260 ip-10-0-138-17 kubenswrapper[5003]: E1031 17:48:10.332217    5003 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-tdzz5" containerName="extractor"
Oct 31 17:48:12.569909 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:48:12.569874    5003 scope.go:122] "RemoveContainer" containerID="dd606934b53a741e49badbbba755c9d9067de86cfeb95525bc22671e70ce6e1a"
Oct 31 17:48:12.579581 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:48:12.579555    5003 scope.go:122] "RemoveContainer" containerID="6bb022f8689624891554c0ad4e79a4d42f91c2e37c7cb2db9f5449a73fa9b965"
Oct 31 17:48:12.588743 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:48:12.588725    5003 scope.go:122] "RemoveContainer" containerID="82070aae68b55710ff8da94a50fd640b3903e7ff67b5b1efd2a6a95ac1ead337"
Oct 31 17:48:12.597572 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:48:12.597554    5003 scope.go:122] "RemoveContainer" containerID="5a25a847de92635875231168a3e91a82070867a446a1bd020b185e6ba3dda605"
Oct 31 17:48:12.607837 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:48:12.607818    5003 scope.go:122] "RemoveContainer" containerID="458cd5a65f3b3a97cebc555559782b4f80b0d7d6f8c4c50242f12bd61432f7cb"
Oct 31 17:48:12.616395 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:48:12.616377    5003 scope.go:122] "RemoveContainer" containerID="73ef962c7f0534b9dfa62cbb0dc7f4b88cfb5e4ee2d46ff702257022ce3a8959"
Oct 31 17:48:12.624972 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:48:12.624949    5003 scope.go:122] "RemoveContainer" containerID="cea4309b51bbb0cfc4ddd57871c6baef7e356a3dfbe408058f4c358caf69d8b8"
Oct 31 17:48:12.636001 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:48:12.635979    5003 scope.go:122] "RemoveContainer" containerID="b7506511188232a55fa210f4e14080cc026e8bbd859d9f1f307284b68ae6a191"
Oct 31 17:48:12.644266 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:48:12.644244    5003 scope.go:122] "RemoveContainer" containerID="9032f86dbc1bf133f7166d4ae278c4f19d5040f47c913cbe1ef9646fcec5173c"
Oct 31 17:48:12.652245 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:48:12.652226    5003 scope.go:122] "RemoveContainer" containerID="a562ccd0a5e85f2280613c779fd25c18353ca0ee0c28ac8aeaa2254c45045f34"
Oct 31 17:48:15.811758 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:48:15.811721    5003 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-e2fc9c5b-qhnvf"]
Oct 31 17:48:15.812232 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:48:15.812180    5003 cpu_manager.go:414] "containerMap: removing container" podUID="b2cff6d8-d6c5-4297-a938-d811b39d7043" containerName="insights-gathering"
Oct 31 17:48:15.812232 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:48:15.812192    5003 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="b2cff6d8-d6c5-4297-a938-d811b39d7043" containerName="insights-gathering"
Oct 31 17:48:15.812232 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:48:15.812214    5003 cpu_manager.go:414] "containerMap: removing container" podUID="5fd2a296-faaa-4390-a177-3f36dd962771" containerName="revoke-keys"
Oct 31 17:48:15.812232 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:48:15.812220    5003 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="5fd2a296-faaa-4390-a177-3f36dd962771" containerName="revoke-keys"
Oct 31 17:48:15.812391 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:48:15.812278    5003 memory_manager.go:365] "RemoveStaleState removing state" podUID="5fd2a296-faaa-4390-a177-3f36dd962771" containerName="revoke-keys"
Oct 31 17:48:15.812391 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:48:15.812291    5003 memory_manager.go:365] "RemoveStaleState removing state" podUID="b2cff6d8-d6c5-4297-a938-d811b39d7043" containerName="insights-gathering"
Oct 31 17:48:15.817662 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:48:15.817626    5003 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-e2fc9c5b-qhnvf"
Oct 31 17:48:15.834376 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:48:15.834343    5003 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-e2fc9c5b-qhnvf"]
Oct 31 17:48:15.843252 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:48:15.843229    5003 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\""
Oct 31 17:48:15.843368 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:48:15.843309    5003 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-mr9x2\""
Oct 31 17:48:15.931379 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:48:15.931346    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hnkp7\" (UniqueName: \"kubernetes.io/projected/53807235-0006-4eef-9410-6c569b66c141-kube-api-access-hnkp7\") pod \"maas-api-revoke-sub-e2fc9c5b-qhnvf\" (UID: \"53807235-0006-4eef-9410-6c569b66c141\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-e2fc9c5b-qhnvf"
Oct 31 17:48:15.931518 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:48:15.931455    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/53807235-0006-4eef-9410-6c569b66c141-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-e2fc9c5b-qhnvf\" (UID: \"53807235-0006-4eef-9410-6c569b66c141\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-e2fc9c5b-qhnvf"
Oct 31 17:48:15.931562 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:48:15.931524    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/53807235-0006-4eef-9410-6c569b66c141-maas-api-xks-ca\") pod \"maas-api-revoke-sub-e2fc9c5b-qhnvf\" (UID: \"53807235-0006-4eef-9410-6c569b66c141\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-e2fc9c5b-qhnvf"
Oct 31 17:48:16.032833 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:48:16.032793    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/53807235-0006-4eef-9410-6c569b66c141-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-e2fc9c5b-qhnvf\" (UID: \"53807235-0006-4eef-9410-6c569b66c141\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-e2fc9c5b-qhnvf"
Oct 31 17:48:16.033040 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:48:16.032876    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/53807235-0006-4eef-9410-6c569b66c141-maas-api-xks-ca\") pod \"maas-api-revoke-sub-e2fc9c5b-qhnvf\" (UID: \"53807235-0006-4eef-9410-6c569b66c141\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-e2fc9c5b-qhnvf"
Oct 31 17:48:16.033040 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:48:16.032953    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hnkp7\" (UniqueName: \"kubernetes.io/projected/53807235-0006-4eef-9410-6c569b66c141-kube-api-access-hnkp7\") pod \"maas-api-revoke-sub-e2fc9c5b-qhnvf\" (UID: \"53807235-0006-4eef-9410-6c569b66c141\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-e2fc9c5b-qhnvf"
Oct 31 17:48:16.033485 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:48:16.033461    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/53807235-0006-4eef-9410-6c569b66c141-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-e2fc9c5b-qhnvf\" (UID: \"53807235-0006-4eef-9410-6c569b66c141\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-e2fc9c5b-qhnvf"
Oct 31 17:48:16.035424 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:48:16.035400    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/53807235-0006-4eef-9410-6c569b66c141-maas-api-xks-ca\") pod \"maas-api-revoke-sub-e2fc9c5b-qhnvf\" (UID: \"53807235-0006-4eef-9410-6c569b66c141\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-e2fc9c5b-qhnvf"
Oct 31 17:48:16.051616 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:48:16.051587    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hnkp7\" (UniqueName: \"kubernetes.io/projected/53807235-0006-4eef-9410-6c569b66c141-kube-api-access-hnkp7\") pod \"maas-api-revoke-sub-e2fc9c5b-qhnvf\" (UID: \"53807235-0006-4eef-9410-6c569b66c141\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-e2fc9c5b-qhnvf"
Oct 31 17:48:16.129952 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:48:16.129860    5003 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-e2fc9c5b-qhnvf"
Oct 31 17:48:16.425992 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:48:16.425843    5003 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-e2fc9c5b-qhnvf"]
Oct 31 17:48:16.428797 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:48:16.428769    5003 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod53807235_0006_4eef_9410_6c569b66c141.slice/crio-582c974b0b4c1abcfa53cb081743818bc2c19e4728a6af8d5ac4b530f40f24dd WatchSource:0}: Error finding container 582c974b0b4c1abcfa53cb081743818bc2c19e4728a6af8d5ac4b530f40f24dd: Status 404 returned error can't find the container with id 582c974b0b4c1abcfa53cb081743818bc2c19e4728a6af8d5ac4b530f40f24dd
Oct 31 17:48:16.439759 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:48:16.439730    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-e2fc9c5b-qhnvf" event={"ID":"53807235-0006-4eef-9410-6c569b66c141","Type":"ContainerStarted","Data":"582c974b0b4c1abcfa53cb081743818bc2c19e4728a6af8d5ac4b530f40f24dd"}
Oct 31 17:48:17.448626 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:48:17.448588    5003 generic.go:356] "Generic (PLEG): container finished" podID="53807235-0006-4eef-9410-6c569b66c141" containerID="f14f9f6914e3edcc120e1cc53597b66a34a45149c39aea0e35d2735fa884a469" exitCode=0
Oct 31 17:48:17.449022 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:48:17.448672    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-e2fc9c5b-qhnvf" event={"ID":"53807235-0006-4eef-9410-6c569b66c141","Type":"ContainerDied","Data":"f14f9f6914e3edcc120e1cc53597b66a34a45149c39aea0e35d2735fa884a469"}
Oct 31 17:48:18.597673 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:48:18.597632    5003 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-e2fc9c5b-qhnvf"
Oct 31 17:48:18.759290 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:48:18.759207    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/53807235-0006-4eef-9410-6c569b66c141-kube-api-access-hnkp7\" (UniqueName: \"kubernetes.io/projected/53807235-0006-4eef-9410-6c569b66c141-kube-api-access-hnkp7\") pod \"53807235-0006-4eef-9410-6c569b66c141\" (UID: \"53807235-0006-4eef-9410-6c569b66c141\") "
Oct 31 17:48:18.759290 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:48:18.759250    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/53807235-0006-4eef-9410-6c569b66c141-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/53807235-0006-4eef-9410-6c569b66c141-maas-api-openshift-ca\") pod \"53807235-0006-4eef-9410-6c569b66c141\" (UID: \"53807235-0006-4eef-9410-6c569b66c141\") "
Oct 31 17:48:18.759531 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:48:18.759293    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/53807235-0006-4eef-9410-6c569b66c141-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/53807235-0006-4eef-9410-6c569b66c141-maas-api-xks-ca\") pod \"53807235-0006-4eef-9410-6c569b66c141\" (UID: \"53807235-0006-4eef-9410-6c569b66c141\") "
Oct 31 17:48:18.759741 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:48:18.759714    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/53807235-0006-4eef-9410-6c569b66c141-maas-api-openshift-ca" pod "53807235-0006-4eef-9410-6c569b66c141" (UID: "53807235-0006-4eef-9410-6c569b66c141"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 17:48:18.761362 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:48:18.761337    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/53807235-0006-4eef-9410-6c569b66c141-maas-api-xks-ca" pod "53807235-0006-4eef-9410-6c569b66c141" (UID: "53807235-0006-4eef-9410-6c569b66c141"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 17:48:18.761430 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:48:18.761411    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/53807235-0006-4eef-9410-6c569b66c141-kube-api-access-hnkp7" pod "53807235-0006-4eef-9410-6c569b66c141" (UID: "53807235-0006-4eef-9410-6c569b66c141"). InnerVolumeSpecName "kube-api-access-hnkp7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 17:48:18.860572 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:48:18.860538    5003 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hnkp7\" (UniqueName: \"kubernetes.io/projected/53807235-0006-4eef-9410-6c569b66c141-kube-api-access-hnkp7\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:48:18.860572 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:48:18.860568    5003 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/53807235-0006-4eef-9410-6c569b66c141-maas-api-openshift-ca\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:48:18.860572 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:48:18.860578    5003 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/53807235-0006-4eef-9410-6c569b66c141-maas-api-xks-ca\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:48:19.465806 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:48:19.465771    5003 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-e2fc9c5b-qhnvf"
Oct 31 17:48:19.465806 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:48:19.465791    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-e2fc9c5b-qhnvf" event={"ID":"53807235-0006-4eef-9410-6c569b66c141","Type":"ContainerDied","Data":"582c974b0b4c1abcfa53cb081743818bc2c19e4728a6af8d5ac4b530f40f24dd"}
Oct 31 17:48:19.466053 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:48:19.465837    5003 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="582c974b0b4c1abcfa53cb081743818bc2c19e4728a6af8d5ac4b530f40f24dd"
Oct 31 17:48:26.163097 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:48:26.163062    5003 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-5a29efb3-dknfd"]
Oct 31 17:48:26.163526 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:48:26.163513    5003 cpu_manager.go:414] "containerMap: removing container" podUID="53807235-0006-4eef-9410-6c569b66c141" containerName="revoke-keys"
Oct 31 17:48:26.163566 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:48:26.163527    5003 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="53807235-0006-4eef-9410-6c569b66c141" containerName="revoke-keys"
Oct 31 17:48:26.163605 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:48:26.163591    5003 memory_manager.go:365] "RemoveStaleState removing state" podUID="53807235-0006-4eef-9410-6c569b66c141" containerName="revoke-keys"
Oct 31 17:48:26.166917 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:48:26.166899    5003 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-5a29efb3-dknfd"
Oct 31 17:48:26.184921 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:48:26.184893    5003 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-5a29efb3-dknfd"]
Oct 31 17:48:26.227467 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:48:26.227435    5003 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\""
Oct 31 17:48:26.227676 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:48:26.227661    5003 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-mr9x2\""
Oct 31 17:48:26.332126 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:48:26.332093    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/98dedc31-9cdf-4a94-b78c-d997d666c478-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-5a29efb3-dknfd\" (UID: \"98dedc31-9cdf-4a94-b78c-d997d666c478\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-5a29efb3-dknfd"
Oct 31 17:48:26.332368 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:48:26.332136    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gdcr2\" (UniqueName: \"kubernetes.io/projected/98dedc31-9cdf-4a94-b78c-d997d666c478-kube-api-access-gdcr2\") pod \"maas-api-revoke-sub-5a29efb3-dknfd\" (UID: \"98dedc31-9cdf-4a94-b78c-d997d666c478\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-5a29efb3-dknfd"
Oct 31 17:48:26.332368 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:48:26.332218    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/98dedc31-9cdf-4a94-b78c-d997d666c478-maas-api-xks-ca\") pod \"maas-api-revoke-sub-5a29efb3-dknfd\" (UID: \"98dedc31-9cdf-4a94-b78c-d997d666c478\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-5a29efb3-dknfd"
Oct 31 17:48:26.433855 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:48:26.433771    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gdcr2\" (UniqueName: \"kubernetes.io/projected/98dedc31-9cdf-4a94-b78c-d997d666c478-kube-api-access-gdcr2\") pod \"maas-api-revoke-sub-5a29efb3-dknfd\" (UID: \"98dedc31-9cdf-4a94-b78c-d997d666c478\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-5a29efb3-dknfd"
Oct 31 17:48:26.433855 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:48:26.433819    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/98dedc31-9cdf-4a94-b78c-d997d666c478-maas-api-xks-ca\") pod \"maas-api-revoke-sub-5a29efb3-dknfd\" (UID: \"98dedc31-9cdf-4a94-b78c-d997d666c478\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-5a29efb3-dknfd"
Oct 31 17:48:26.434062 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:48:26.433925    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/98dedc31-9cdf-4a94-b78c-d997d666c478-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-5a29efb3-dknfd\" (UID: \"98dedc31-9cdf-4a94-b78c-d997d666c478\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-5a29efb3-dknfd"
Oct 31 17:48:26.434551 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:48:26.434522    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/98dedc31-9cdf-4a94-b78c-d997d666c478-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-5a29efb3-dknfd\" (UID: \"98dedc31-9cdf-4a94-b78c-d997d666c478\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-5a29efb3-dknfd"
Oct 31 17:48:26.436218 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:48:26.436195    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/98dedc31-9cdf-4a94-b78c-d997d666c478-maas-api-xks-ca\") pod \"maas-api-revoke-sub-5a29efb3-dknfd\" (UID: \"98dedc31-9cdf-4a94-b78c-d997d666c478\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-5a29efb3-dknfd"
Oct 31 17:48:26.452204 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:48:26.452182    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gdcr2\" (UniqueName: \"kubernetes.io/projected/98dedc31-9cdf-4a94-b78c-d997d666c478-kube-api-access-gdcr2\") pod \"maas-api-revoke-sub-5a29efb3-dknfd\" (UID: \"98dedc31-9cdf-4a94-b78c-d997d666c478\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-5a29efb3-dknfd"
Oct 31 17:48:26.487456 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:48:26.487432    5003 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-5a29efb3-dknfd"
Oct 31 17:48:26.784205 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:48:26.784026    5003 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-5a29efb3-dknfd"]
Oct 31 17:48:26.787445 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:48:26.787405    5003 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod98dedc31_9cdf_4a94_b78c_d997d666c478.slice/crio-ba6480bcc30eb780f60045dd656d98d42eb178a8baac4d90518c3907f455a23c WatchSource:0}: Error finding container ba6480bcc30eb780f60045dd656d98d42eb178a8baac4d90518c3907f455a23c: Status 404 returned error can't find the container with id ba6480bcc30eb780f60045dd656d98d42eb178a8baac4d90518c3907f455a23c
Oct 31 17:48:27.523031 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:48:27.522985    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-5a29efb3-dknfd" event={"ID":"98dedc31-9cdf-4a94-b78c-d997d666c478","Type":"ContainerStarted","Data":"1c577956b5db99e496eb08716d6a48a6bf9f4e1582380ea172e2de9be08b3b0c"}
Oct 31 17:48:27.523564 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:48:27.523058    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-5a29efb3-dknfd" event={"ID":"98dedc31-9cdf-4a94-b78c-d997d666c478","Type":"ContainerStarted","Data":"ba6480bcc30eb780f60045dd656d98d42eb178a8baac4d90518c3907f455a23c"}
Oct 31 17:48:27.564200 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:48:27.564138    5003 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-sub-5a29efb3-dknfd" podStartSLOduration=1.5641203209999999 podStartE2EDuration="1.564120321s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 17:48:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 17:48:27.563989498 +0000 UTC m=+1275.818844040" watchObservedRunningTime="2026-10-31 17:48:27.564120321 +0000 UTC m=+1275.818974863"
Oct 31 17:48:28.536378 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:48:28.536343    5003 generic.go:356] "Generic (PLEG): container finished" podID="98dedc31-9cdf-4a94-b78c-d997d666c478" containerID="1c577956b5db99e496eb08716d6a48a6bf9f4e1582380ea172e2de9be08b3b0c" exitCode=0
Oct 31 17:48:28.536911 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:48:28.536451    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-5a29efb3-dknfd" event={"ID":"98dedc31-9cdf-4a94-b78c-d997d666c478","Type":"ContainerDied","Data":"1c577956b5db99e496eb08716d6a48a6bf9f4e1582380ea172e2de9be08b3b0c"}
Oct 31 17:48:29.934718 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:48:29.934696    5003 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-5a29efb3-dknfd"
Oct 31 17:48:29.937005 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:48:29.936979    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/98dedc31-9cdf-4a94-b78c-d997d666c478-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/98dedc31-9cdf-4a94-b78c-d997d666c478-maas-api-openshift-ca\") pod \"98dedc31-9cdf-4a94-b78c-d997d666c478\" (UID: \"98dedc31-9cdf-4a94-b78c-d997d666c478\") "
Oct 31 17:48:29.937115 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:48:29.937039    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/98dedc31-9cdf-4a94-b78c-d997d666c478-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/98dedc31-9cdf-4a94-b78c-d997d666c478-maas-api-xks-ca\") pod \"98dedc31-9cdf-4a94-b78c-d997d666c478\" (UID: \"98dedc31-9cdf-4a94-b78c-d997d666c478\") "
Oct 31 17:48:29.937115 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:48:29.937105    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/98dedc31-9cdf-4a94-b78c-d997d666c478-kube-api-access-gdcr2\" (UniqueName: \"kubernetes.io/projected/98dedc31-9cdf-4a94-b78c-d997d666c478-kube-api-access-gdcr2\") pod \"98dedc31-9cdf-4a94-b78c-d997d666c478\" (UID: \"98dedc31-9cdf-4a94-b78c-d997d666c478\") "
Oct 31 17:48:29.937915 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:48:29.937886    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/98dedc31-9cdf-4a94-b78c-d997d666c478-maas-api-openshift-ca" pod "98dedc31-9cdf-4a94-b78c-d997d666c478" (UID: "98dedc31-9cdf-4a94-b78c-d997d666c478"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 17:48:29.940387 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:48:29.940365    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/98dedc31-9cdf-4a94-b78c-d997d666c478-kube-api-access-gdcr2" pod "98dedc31-9cdf-4a94-b78c-d997d666c478" (UID: "98dedc31-9cdf-4a94-b78c-d997d666c478"). InnerVolumeSpecName "kube-api-access-gdcr2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 17:48:29.940522 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:48:29.940412    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/98dedc31-9cdf-4a94-b78c-d997d666c478-maas-api-xks-ca" pod "98dedc31-9cdf-4a94-b78c-d997d666c478" (UID: "98dedc31-9cdf-4a94-b78c-d997d666c478"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 17:48:30.038523 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:48:30.038490    5003 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/98dedc31-9cdf-4a94-b78c-d997d666c478-maas-api-openshift-ca\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:48:30.038523 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:48:30.038518    5003 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/98dedc31-9cdf-4a94-b78c-d997d666c478-maas-api-xks-ca\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:48:30.038523 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:48:30.038527    5003 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gdcr2\" (UniqueName: \"kubernetes.io/projected/98dedc31-9cdf-4a94-b78c-d997d666c478-kube-api-access-gdcr2\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:48:30.552478 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:48:30.552446    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-5a29efb3-dknfd" event={"ID":"98dedc31-9cdf-4a94-b78c-d997d666c478","Type":"ContainerDied","Data":"ba6480bcc30eb780f60045dd656d98d42eb178a8baac4d90518c3907f455a23c"}
Oct 31 17:48:30.552478 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:48:30.552472    5003 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-5a29efb3-dknfd"
Oct 31 17:48:30.552729 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:48:30.552516    5003 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ba6480bcc30eb780f60045dd656d98d42eb178a8baac4d90518c3907f455a23c"
Oct 31 17:48:40.025544 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:48:40.025501    5003 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-85237e45-xj79v"]
Oct 31 17:48:40.037344 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:48:40.037313    5003 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-85237e45-xj79v"]
Oct 31 17:48:40.330829 ip-10-0-138-17 kubenswrapper[5003]: E1031 17:48:40.330792    5003 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-tdzz5" containerName="extractor"
Oct 31 17:48:41.888431 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:48:41.888396    5003 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="574515e7-2f46-4caa-96c8-0df032da4d27" path="/var/lib/kubelet/pods/574515e7-2f46-4caa-96c8-0df032da4d27/volumes"
Oct 31 17:48:44.779761 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:48:44.779724    5003 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-7m9lh"]
Oct 31 17:48:44.791388 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:48:44.791357    5003 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-7m9lh"]
Oct 31 17:48:44.829313 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:48:44.829277    5003 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-8qm4p"]
Oct 31 17:48:44.829797 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:48:44.829778    5003 cpu_manager.go:414] "containerMap: removing container" podUID="98dedc31-9cdf-4a94-b78c-d997d666c478" containerName="revoke-keys"
Oct 31 17:48:44.829913 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:48:44.829797    5003 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="98dedc31-9cdf-4a94-b78c-d997d666c478" containerName="revoke-keys"
Oct 31 17:48:44.829989 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:48:44.829926    5003 memory_manager.go:365] "RemoveStaleState removing state" podUID="98dedc31-9cdf-4a94-b78c-d997d666c478" containerName="revoke-keys"
Oct 31 17:48:44.833407 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:48:44.833387    5003 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-8qm4p"
Oct 31 17:48:44.847844 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:48:44.847816    5003 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-mr9x2\""
Oct 31 17:48:44.847942 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:48:44.847925    5003 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\""
Oct 31 17:48:44.850605 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:48:44.850583    5003 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-8qm4p"]
Oct 31 17:48:44.880000 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:48:44.879969    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/80310dba-f967-4f98-892b-360c90b9732e-maas-api-xks-ca\") pod \"maas-api-revoke-sub-3d4156f1-8qm4p\" (UID: \"80310dba-f967-4f98-892b-360c90b9732e\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-8qm4p"
Oct 31 17:48:44.880140 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:48:44.880014    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/80310dba-f967-4f98-892b-360c90b9732e-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-3d4156f1-8qm4p\" (UID: \"80310dba-f967-4f98-892b-360c90b9732e\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-8qm4p"
Oct 31 17:48:44.880140 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:48:44.880040    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7rchp\" (UniqueName: \"kubernetes.io/projected/80310dba-f967-4f98-892b-360c90b9732e-kube-api-access-7rchp\") pod \"maas-api-revoke-sub-3d4156f1-8qm4p\" (UID: \"80310dba-f967-4f98-892b-360c90b9732e\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-8qm4p"
Oct 31 17:48:44.981802 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:48:44.981768    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/80310dba-f967-4f98-892b-360c90b9732e-maas-api-xks-ca\") pod \"maas-api-revoke-sub-3d4156f1-8qm4p\" (UID: \"80310dba-f967-4f98-892b-360c90b9732e\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-8qm4p"
Oct 31 17:48:44.982001 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:48:44.981841    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/80310dba-f967-4f98-892b-360c90b9732e-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-3d4156f1-8qm4p\" (UID: \"80310dba-f967-4f98-892b-360c90b9732e\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-8qm4p"
Oct 31 17:48:44.982001 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:48:44.981887    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7rchp\" (UniqueName: \"kubernetes.io/projected/80310dba-f967-4f98-892b-360c90b9732e-kube-api-access-7rchp\") pod \"maas-api-revoke-sub-3d4156f1-8qm4p\" (UID: \"80310dba-f967-4f98-892b-360c90b9732e\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-8qm4p"
Oct 31 17:48:44.982777 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:48:44.982745    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/80310dba-f967-4f98-892b-360c90b9732e-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-3d4156f1-8qm4p\" (UID: \"80310dba-f967-4f98-892b-360c90b9732e\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-8qm4p"
Oct 31 17:48:44.984802 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:48:44.984771    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/80310dba-f967-4f98-892b-360c90b9732e-maas-api-xks-ca\") pod \"maas-api-revoke-sub-3d4156f1-8qm4p\" (UID: \"80310dba-f967-4f98-892b-360c90b9732e\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-8qm4p"
Oct 31 17:48:45.001120 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:48:45.001086    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7rchp\" (UniqueName: \"kubernetes.io/projected/80310dba-f967-4f98-892b-360c90b9732e-kube-api-access-7rchp\") pod \"maas-api-revoke-sub-3d4156f1-8qm4p\" (UID: \"80310dba-f967-4f98-892b-360c90b9732e\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-8qm4p"
Oct 31 17:48:45.146129 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:48:45.146099    5003 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-8qm4p"
Oct 31 17:48:45.444419 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:48:45.444336    5003 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-8qm4p"]
Oct 31 17:48:45.448091 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:48:45.448063    5003 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod80310dba_f967_4f98_892b_360c90b9732e.slice/crio-ecadd04940120352646a84c715d306047116d42c82d141da4c6554c567f606a6 WatchSource:0}: Error finding container ecadd04940120352646a84c715d306047116d42c82d141da4c6554c567f606a6: Status 404 returned error can't find the container with id ecadd04940120352646a84c715d306047116d42c82d141da4c6554c567f606a6
Oct 31 17:48:45.649846 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:48:45.649809    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-8qm4p" event={"ID":"80310dba-f967-4f98-892b-360c90b9732e","Type":"ContainerStarted","Data":"ecadd04940120352646a84c715d306047116d42c82d141da4c6554c567f606a6"}
Oct 31 17:48:45.888509 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:48:45.888476    5003 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="5fd2a296-faaa-4390-a177-3f36dd962771" path="/var/lib/kubelet/pods/5fd2a296-faaa-4390-a177-3f36dd962771/volumes"
Oct 31 17:48:46.658279 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:48:46.658188    5003 generic.go:356] "Generic (PLEG): container finished" podID="80310dba-f967-4f98-892b-360c90b9732e" containerID="b43080276a55f3938663c6972add42431ca763fe0cef49e96a88c8d8e8b193f4" exitCode=0
Oct 31 17:48:46.658439 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:48:46.658275    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-8qm4p" event={"ID":"80310dba-f967-4f98-892b-360c90b9732e","Type":"ContainerDied","Data":"b43080276a55f3938663c6972add42431ca763fe0cef49e96a88c8d8e8b193f4"}
Oct 31 17:48:47.802101 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:48:47.802076    5003 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-8qm4p"
Oct 31 17:48:47.907021 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:48:47.906990    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/80310dba-f967-4f98-892b-360c90b9732e-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/80310dba-f967-4f98-892b-360c90b9732e-maas-api-xks-ca\") pod \"80310dba-f967-4f98-892b-360c90b9732e\" (UID: \"80310dba-f967-4f98-892b-360c90b9732e\") "
Oct 31 17:48:47.907196 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:48:47.907127    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/80310dba-f967-4f98-892b-360c90b9732e-kube-api-access-7rchp\" (UniqueName: \"kubernetes.io/projected/80310dba-f967-4f98-892b-360c90b9732e-kube-api-access-7rchp\") pod \"80310dba-f967-4f98-892b-360c90b9732e\" (UID: \"80310dba-f967-4f98-892b-360c90b9732e\") "
Oct 31 17:48:47.907196 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:48:47.907162    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/80310dba-f967-4f98-892b-360c90b9732e-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/80310dba-f967-4f98-892b-360c90b9732e-maas-api-openshift-ca\") pod \"80310dba-f967-4f98-892b-360c90b9732e\" (UID: \"80310dba-f967-4f98-892b-360c90b9732e\") "
Oct 31 17:48:47.907563 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:48:47.907533    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/80310dba-f967-4f98-892b-360c90b9732e-maas-api-openshift-ca" pod "80310dba-f967-4f98-892b-360c90b9732e" (UID: "80310dba-f967-4f98-892b-360c90b9732e"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 17:48:47.908986 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:48:47.908964    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/80310dba-f967-4f98-892b-360c90b9732e-maas-api-xks-ca" pod "80310dba-f967-4f98-892b-360c90b9732e" (UID: "80310dba-f967-4f98-892b-360c90b9732e"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 17:48:47.909188 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:48:47.909169    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/80310dba-f967-4f98-892b-360c90b9732e-kube-api-access-7rchp" pod "80310dba-f967-4f98-892b-360c90b9732e" (UID: "80310dba-f967-4f98-892b-360c90b9732e"). InnerVolumeSpecName "kube-api-access-7rchp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 17:48:48.008100 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:48:48.008070    5003 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7rchp\" (UniqueName: \"kubernetes.io/projected/80310dba-f967-4f98-892b-360c90b9732e-kube-api-access-7rchp\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:48:48.008100 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:48:48.008095    5003 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/80310dba-f967-4f98-892b-360c90b9732e-maas-api-openshift-ca\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:48:48.008100 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:48:48.008104    5003 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/80310dba-f967-4f98-892b-360c90b9732e-maas-api-xks-ca\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:48:48.672691 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:48:48.672655    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-8qm4p" event={"ID":"80310dba-f967-4f98-892b-360c90b9732e","Type":"ContainerDied","Data":"ecadd04940120352646a84c715d306047116d42c82d141da4c6554c567f606a6"}
Oct 31 17:48:48.672860 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:48:48.672704    5003 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ecadd04940120352646a84c715d306047116d42c82d141da4c6554c567f606a6"
Oct 31 17:48:48.672860 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:48:48.672673    5003 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-8qm4p"
Oct 31 17:48:58.865206 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:48:58.864752    5003 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-7d9897b54c-7smk2 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.34:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 31 17:48:58.865206 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:48:58.864843    5003 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-7smk2" podUID="effd3895-446f-4877-8218-6414ce2e321b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.34:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 31 17:49:10.330842 ip-10-0-138-17 kubenswrapper[5003]: E1031 17:49:10.330804    5003 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-tdzz5" containerName="extractor"
Oct 31 17:49:12.713432 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:49:12.713396    5003 scope.go:122] "RemoveContainer" containerID="fd0cc54ed56e09a38bcadff7bec3840142c282ace89dbb47c0ee99a11075c0cd"
Oct 31 17:49:12.725248 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:49:12.725227    5003 scope.go:122] "RemoveContainer" containerID="aa939f17a02186e71bb6f043f067d65acc80f52275db45a186401f24885eaa45"
Oct 31 17:49:12.734048 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:49:12.734027    5003 scope.go:122] "RemoveContainer" containerID="def3548ece19314dd11affaf05d0b4337027725aa560fd5cd6514adbc56a6298"
Oct 31 17:49:12.742111 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:49:12.742091    5003 scope.go:122] "RemoveContainer" containerID="a3094af8252436d79261615de9a2316b6b74a6fd674e0b0cd261f533fc71f0eb"
Oct 31 17:49:12.749885 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:49:12.749866    5003 scope.go:122] "RemoveContainer" containerID="d27030d1edd69da8647c4e88327b4a152341a27cce6e9d0bd97690efd06675cb"
Oct 31 17:49:12.757811 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:49:12.757792    5003 scope.go:122] "RemoveContainer" containerID="9917a5d62a4f015c359df9b23c7fc35377c62c61a9b250bd8c8f88fbf2315341"
Oct 31 17:49:12.765709 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:49:12.765687    5003 scope.go:122] "RemoveContainer" containerID="446f3521b44c5c9f3dddf18e68e143b6854934f5ce6f448267bcf68ec93e4eb9"
Oct 31 17:49:38.023484 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:49:38.023445    5003 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-c1e271a9-nv27v"]
Oct 31 17:49:38.034941 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:49:38.034913    5003 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-c1e271a9-nv27v"]
Oct 31 17:49:39.889067 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:49:39.889034    5003 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="63cbff5b-ac34-4694-bd1c-6227c682d961" path="/var/lib/kubelet/pods/63cbff5b-ac34-4694-bd1c-6227c682d961/volumes"
Oct 31 17:49:40.334139 ip-10-0-138-17 kubenswrapper[5003]: E1031 17:49:40.334098    5003 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-tdzz5" containerName="extractor"
Oct 31 17:49:58.028902 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:49:58.028870    5003 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-2e1f5b5f-jh7r2"]
Oct 31 17:49:58.040415 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:49:58.040387    5003 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-2e1f5b5f-jh7r2"]
Oct 31 17:49:59.215787 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:49:59.215753    5003 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-b77c4fe8-4bt67"]
Oct 31 17:49:59.216213 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:49:59.216199    5003 cpu_manager.go:414] "containerMap: removing container" podUID="80310dba-f967-4f98-892b-360c90b9732e" containerName="revoke-keys"
Oct 31 17:49:59.216256 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:49:59.216214    5003 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="80310dba-f967-4f98-892b-360c90b9732e" containerName="revoke-keys"
Oct 31 17:49:59.216314 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:49:59.216305    5003 memory_manager.go:365] "RemoveStaleState removing state" podUID="80310dba-f967-4f98-892b-360c90b9732e" containerName="revoke-keys"
Oct 31 17:49:59.220015 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:49:59.219996    5003 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-b77c4fe8-4bt67"
Oct 31 17:49:59.237150 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:49:59.237122    5003 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-b77c4fe8-4bt67"]
Oct 31 17:49:59.246224 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:49:59.246190    5003 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\""
Oct 31 17:49:59.246350 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:49:59.246286    5003 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-mr9x2\""
Oct 31 17:49:59.341285 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:49:59.341252    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nmcd9\" (UniqueName: \"kubernetes.io/projected/c61d1c97-dec9-49fe-80c4-c787c798a827-kube-api-access-nmcd9\") pod \"maas-api-revoke-sub-b77c4fe8-4bt67\" (UID: \"c61d1c97-dec9-49fe-80c4-c787c798a827\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-b77c4fe8-4bt67"
Oct 31 17:49:59.341511 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:49:59.341297    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/c61d1c97-dec9-49fe-80c4-c787c798a827-maas-api-xks-ca\") pod \"maas-api-revoke-sub-b77c4fe8-4bt67\" (UID: \"c61d1c97-dec9-49fe-80c4-c787c798a827\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-b77c4fe8-4bt67"
Oct 31 17:49:59.341511 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:49:59.341369    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/c61d1c97-dec9-49fe-80c4-c787c798a827-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-b77c4fe8-4bt67\" (UID: \"c61d1c97-dec9-49fe-80c4-c787c798a827\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-b77c4fe8-4bt67"
Oct 31 17:49:59.451784 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:49:59.451748    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nmcd9\" (UniqueName: \"kubernetes.io/projected/c61d1c97-dec9-49fe-80c4-c787c798a827-kube-api-access-nmcd9\") pod \"maas-api-revoke-sub-b77c4fe8-4bt67\" (UID: \"c61d1c97-dec9-49fe-80c4-c787c798a827\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-b77c4fe8-4bt67"
Oct 31 17:49:59.452054 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:49:59.452032    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/c61d1c97-dec9-49fe-80c4-c787c798a827-maas-api-xks-ca\") pod \"maas-api-revoke-sub-b77c4fe8-4bt67\" (UID: \"c61d1c97-dec9-49fe-80c4-c787c798a827\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-b77c4fe8-4bt67"
Oct 31 17:49:59.452193 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:49:59.452179    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/c61d1c97-dec9-49fe-80c4-c787c798a827-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-b77c4fe8-4bt67\" (UID: \"c61d1c97-dec9-49fe-80c4-c787c798a827\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-b77c4fe8-4bt67"
Oct 31 17:49:59.453341 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:49:59.453314    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/c61d1c97-dec9-49fe-80c4-c787c798a827-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-b77c4fe8-4bt67\" (UID: \"c61d1c97-dec9-49fe-80c4-c787c798a827\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-b77c4fe8-4bt67"
Oct 31 17:49:59.459964 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:49:59.459933    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/c61d1c97-dec9-49fe-80c4-c787c798a827-maas-api-xks-ca\") pod \"maas-api-revoke-sub-b77c4fe8-4bt67\" (UID: \"c61d1c97-dec9-49fe-80c4-c787c798a827\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-b77c4fe8-4bt67"
Oct 31 17:49:59.474178 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:49:59.474110    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nmcd9\" (UniqueName: \"kubernetes.io/projected/c61d1c97-dec9-49fe-80c4-c787c798a827-kube-api-access-nmcd9\") pod \"maas-api-revoke-sub-b77c4fe8-4bt67\" (UID: \"c61d1c97-dec9-49fe-80c4-c787c798a827\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-b77c4fe8-4bt67"
Oct 31 17:49:59.532296 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:49:59.532267    5003 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-b77c4fe8-4bt67"
Oct 31 17:49:59.831847 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:49:59.831814    5003 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-b77c4fe8-4bt67"]
Oct 31 17:49:59.835329 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:49:59.835297    5003 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc61d1c97_dec9_49fe_80c4_c787c798a827.slice/crio-104a8a3dbe4e60da3aa09aca91fd0a3ab269781e0fb1dc51a1f113b74d3493db WatchSource:0}: Error finding container 104a8a3dbe4e60da3aa09aca91fd0a3ab269781e0fb1dc51a1f113b74d3493db: Status 404 returned error can't find the container with id 104a8a3dbe4e60da3aa09aca91fd0a3ab269781e0fb1dc51a1f113b74d3493db
Oct 31 17:49:59.888249 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:49:59.888219    5003 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="6803809f-6af1-4857-95c5-a1fbac1b9607" path="/var/lib/kubelet/pods/6803809f-6af1-4857-95c5-a1fbac1b9607/volumes"
Oct 31 17:50:00.133253 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:50:00.133173    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-b77c4fe8-4bt67" event={"ID":"c61d1c97-dec9-49fe-80c4-c787c798a827","Type":"ContainerStarted","Data":"104a8a3dbe4e60da3aa09aca91fd0a3ab269781e0fb1dc51a1f113b74d3493db"}
Oct 31 17:50:01.140965 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:50:01.140932    5003 generic.go:356] "Generic (PLEG): container finished" podID="c61d1c97-dec9-49fe-80c4-c787c798a827" containerID="1581e3798f562eed6cc625b257e1c5fcc08dc7c44dc2db15f0dfca0bae030516" exitCode=0
Oct 31 17:50:01.141373 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:50:01.141011    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-b77c4fe8-4bt67" event={"ID":"c61d1c97-dec9-49fe-80c4-c787c798a827","Type":"ContainerDied","Data":"1581e3798f562eed6cc625b257e1c5fcc08dc7c44dc2db15f0dfca0bae030516"}
Oct 31 17:50:02.291336 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:50:02.291309    5003 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-b77c4fe8-4bt67"
Oct 31 17:50:02.381027 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:50:02.380978    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/c61d1c97-dec9-49fe-80c4-c787c798a827-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/c61d1c97-dec9-49fe-80c4-c787c798a827-maas-api-xks-ca\") pod \"c61d1c97-dec9-49fe-80c4-c787c798a827\" (UID: \"c61d1c97-dec9-49fe-80c4-c787c798a827\") "
Oct 31 17:50:02.381027 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:50:02.381031    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/c61d1c97-dec9-49fe-80c4-c787c798a827-kube-api-access-nmcd9\" (UniqueName: \"kubernetes.io/projected/c61d1c97-dec9-49fe-80c4-c787c798a827-kube-api-access-nmcd9\") pod \"c61d1c97-dec9-49fe-80c4-c787c798a827\" (UID: \"c61d1c97-dec9-49fe-80c4-c787c798a827\") "
Oct 31 17:50:02.381282 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:50:02.381200    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/c61d1c97-dec9-49fe-80c4-c787c798a827-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/c61d1c97-dec9-49fe-80c4-c787c798a827-maas-api-openshift-ca\") pod \"c61d1c97-dec9-49fe-80c4-c787c798a827\" (UID: \"c61d1c97-dec9-49fe-80c4-c787c798a827\") "
Oct 31 17:50:02.381607 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:50:02.381573    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c61d1c97-dec9-49fe-80c4-c787c798a827-maas-api-openshift-ca" pod "c61d1c97-dec9-49fe-80c4-c787c798a827" (UID: "c61d1c97-dec9-49fe-80c4-c787c798a827"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 17:50:02.383347 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:50:02.383314    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c61d1c97-dec9-49fe-80c4-c787c798a827-maas-api-xks-ca" pod "c61d1c97-dec9-49fe-80c4-c787c798a827" (UID: "c61d1c97-dec9-49fe-80c4-c787c798a827"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 17:50:02.383545 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:50:02.383531    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c61d1c97-dec9-49fe-80c4-c787c798a827-kube-api-access-nmcd9" pod "c61d1c97-dec9-49fe-80c4-c787c798a827" (UID: "c61d1c97-dec9-49fe-80c4-c787c798a827"). InnerVolumeSpecName "kube-api-access-nmcd9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 17:50:02.482164 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:50:02.482081    5003 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/c61d1c97-dec9-49fe-80c4-c787c798a827-maas-api-xks-ca\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:50:02.482164 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:50:02.482111    5003 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nmcd9\" (UniqueName: \"kubernetes.io/projected/c61d1c97-dec9-49fe-80c4-c787c798a827-kube-api-access-nmcd9\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:50:02.482164 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:50:02.482121    5003 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/c61d1c97-dec9-49fe-80c4-c787c798a827-maas-api-openshift-ca\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:50:03.154627 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:50:03.154596    5003 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-b77c4fe8-4bt67"
Oct 31 17:50:03.154627 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:50:03.154619    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-b77c4fe8-4bt67" event={"ID":"c61d1c97-dec9-49fe-80c4-c787c798a827","Type":"ContainerDied","Data":"104a8a3dbe4e60da3aa09aca91fd0a3ab269781e0fb1dc51a1f113b74d3493db"}
Oct 31 17:50:03.154899 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:50:03.154697    5003 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="104a8a3dbe4e60da3aa09aca91fd0a3ab269781e0fb1dc51a1f113b74d3493db"
Oct 31 17:50:10.331901 ip-10-0-138-17 kubenswrapper[5003]: E1031 17:50:10.331861    5003 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-tdzz5" containerName="extractor"
Oct 31 17:50:10.783100 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:50:10.783010    5003 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-single-main-60d748-th2rf"]
Oct 31 17:50:10.783540 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:50:10.783520    5003 cpu_manager.go:414] "containerMap: removing container" podUID="c61d1c97-dec9-49fe-80c4-c787c798a827" containerName="revoke-keys"
Oct 31 17:50:10.783637 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:50:10.783544    5003 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="c61d1c97-dec9-49fe-80c4-c787c798a827" containerName="revoke-keys"
Oct 31 17:50:10.783748 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:50:10.783716    5003 memory_manager.go:365] "RemoveStaleState removing state" podUID="c61d1c97-dec9-49fe-80c4-c787c798a827" containerName="revoke-keys"
Oct 31 17:50:10.787225 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:50:10.787203    5003 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-single-main-60d748-th2rf"
Oct 31 17:50:10.814328 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:50:10.814297    5003 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\""
Oct 31 17:50:10.814477 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:50:10.814387    5003 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-mr9x2\""
Oct 31 17:50:10.817576 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:50:10.817554    5003 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-single-main-60d748-th2rf"]
Oct 31 17:50:10.863986 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:50:10.863961    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/a0c03609-d6fe-485d-a94a-db6b1883a4e1-maas-api-openshift-ca\") pod \"maas-api-revoke-keys-e2e-worker-single-main-60d748-th2rf\" (UID: \"a0c03609-d6fe-485d-a94a-db6b1883a4e1\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-single-main-60d748-th2rf"
Oct 31 17:50:10.864100 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:50:10.863996    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g9ftw\" (UniqueName: \"kubernetes.io/projected/a0c03609-d6fe-485d-a94a-db6b1883a4e1-kube-api-access-g9ftw\") pod \"maas-api-revoke-keys-e2e-worker-single-main-60d748-th2rf\" (UID: \"a0c03609-d6fe-485d-a94a-db6b1883a4e1\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-single-main-60d748-th2rf"
Oct 31 17:50:10.864148 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:50:10.864103    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/a0c03609-d6fe-485d-a94a-db6b1883a4e1-maas-api-xks-ca\") pod \"maas-api-revoke-keys-e2e-worker-single-main-60d748-th2rf\" (UID: \"a0c03609-d6fe-485d-a94a-db6b1883a4e1\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-single-main-60d748-th2rf"
Oct 31 17:50:10.965440 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:50:10.965413    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/a0c03609-d6fe-485d-a94a-db6b1883a4e1-maas-api-openshift-ca\") pod \"maas-api-revoke-keys-e2e-worker-single-main-60d748-th2rf\" (UID: \"a0c03609-d6fe-485d-a94a-db6b1883a4e1\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-single-main-60d748-th2rf"
Oct 31 17:50:10.965628 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:50:10.965448    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g9ftw\" (UniqueName: \"kubernetes.io/projected/a0c03609-d6fe-485d-a94a-db6b1883a4e1-kube-api-access-g9ftw\") pod \"maas-api-revoke-keys-e2e-worker-single-main-60d748-th2rf\" (UID: \"a0c03609-d6fe-485d-a94a-db6b1883a4e1\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-single-main-60d748-th2rf"
Oct 31 17:50:10.965628 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:50:10.965573    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/a0c03609-d6fe-485d-a94a-db6b1883a4e1-maas-api-xks-ca\") pod \"maas-api-revoke-keys-e2e-worker-single-main-60d748-th2rf\" (UID: \"a0c03609-d6fe-485d-a94a-db6b1883a4e1\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-single-main-60d748-th2rf"
Oct 31 17:50:10.966241 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:50:10.966218    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/a0c03609-d6fe-485d-a94a-db6b1883a4e1-maas-api-openshift-ca\") pod \"maas-api-revoke-keys-e2e-worker-single-main-60d748-th2rf\" (UID: \"a0c03609-d6fe-485d-a94a-db6b1883a4e1\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-single-main-60d748-th2rf"
Oct 31 17:50:10.968025 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:50:10.968003    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/a0c03609-d6fe-485d-a94a-db6b1883a4e1-maas-api-xks-ca\") pod \"maas-api-revoke-keys-e2e-worker-single-main-60d748-th2rf\" (UID: \"a0c03609-d6fe-485d-a94a-db6b1883a4e1\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-single-main-60d748-th2rf"
Oct 31 17:50:10.984183 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:50:10.984160    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g9ftw\" (UniqueName: \"kubernetes.io/projected/a0c03609-d6fe-485d-a94a-db6b1883a4e1-kube-api-access-g9ftw\") pod \"maas-api-revoke-keys-e2e-worker-single-main-60d748-th2rf\" (UID: \"a0c03609-d6fe-485d-a94a-db6b1883a4e1\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-single-main-60d748-th2rf"
Oct 31 17:50:11.099755 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:50:11.099724    5003 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-single-main-60d748-th2rf"
Oct 31 17:50:11.396604 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:50:11.396534    5003 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-single-main-60d748-th2rf"]
Oct 31 17:50:11.400169 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:50:11.400141    5003 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda0c03609_d6fe_485d_a94a_db6b1883a4e1.slice/crio-9a4ee11fd8250d140637bd78eebf501ceb01f8b9891ff95027979454f187297c WatchSource:0}: Error finding container 9a4ee11fd8250d140637bd78eebf501ceb01f8b9891ff95027979454f187297c: Status 404 returned error can't find the container with id 9a4ee11fd8250d140637bd78eebf501ceb01f8b9891ff95027979454f187297c
Oct 31 17:50:12.215428 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:50:12.215392    5003 generic.go:356] "Generic (PLEG): container finished" podID="a0c03609-d6fe-485d-a94a-db6b1883a4e1" containerID="2733013a9c1ad5c9e2701c3c06f8c81361530f6209156fb7ca6f0c4db63a604c" exitCode=0
Oct 31 17:50:12.215580 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:50:12.215461    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-single-main-60d748-th2rf" event={"ID":"a0c03609-d6fe-485d-a94a-db6b1883a4e1","Type":"ContainerDied","Data":"2733013a9c1ad5c9e2701c3c06f8c81361530f6209156fb7ca6f0c4db63a604c"}
Oct 31 17:50:12.215580 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:50:12.215513    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-single-main-60d748-th2rf" event={"ID":"a0c03609-d6fe-485d-a94a-db6b1883a4e1","Type":"ContainerStarted","Data":"9a4ee11fd8250d140637bd78eebf501ceb01f8b9891ff95027979454f187297c"}
Oct 31 17:50:12.811819 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:50:12.811789    5003 scope.go:122] "RemoveContainer" containerID="1389de1c6382c631bfd366e867a9200f315fd8b76b6d3252b00bb4842df4e2be"
Oct 31 17:50:13.362374 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:50:13.362345    5003 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-single-main-60d748-th2rf"
Oct 31 17:50:13.389398 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:50:13.389368    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/a0c03609-d6fe-485d-a94a-db6b1883a4e1-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/a0c03609-d6fe-485d-a94a-db6b1883a4e1-maas-api-openshift-ca\") pod \"a0c03609-d6fe-485d-a94a-db6b1883a4e1\" (UID: \"a0c03609-d6fe-485d-a94a-db6b1883a4e1\") "
Oct 31 17:50:13.389537 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:50:13.389424    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/a0c03609-d6fe-485d-a94a-db6b1883a4e1-kube-api-access-g9ftw\" (UniqueName: \"kubernetes.io/projected/a0c03609-d6fe-485d-a94a-db6b1883a4e1-kube-api-access-g9ftw\") pod \"a0c03609-d6fe-485d-a94a-db6b1883a4e1\" (UID: \"a0c03609-d6fe-485d-a94a-db6b1883a4e1\") "
Oct 31 17:50:13.389578 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:50:13.389550    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/a0c03609-d6fe-485d-a94a-db6b1883a4e1-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/a0c03609-d6fe-485d-a94a-db6b1883a4e1-maas-api-xks-ca\") pod \"a0c03609-d6fe-485d-a94a-db6b1883a4e1\" (UID: \"a0c03609-d6fe-485d-a94a-db6b1883a4e1\") "
Oct 31 17:50:13.389767 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:50:13.389740    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a0c03609-d6fe-485d-a94a-db6b1883a4e1-maas-api-openshift-ca" pod "a0c03609-d6fe-485d-a94a-db6b1883a4e1" (UID: "a0c03609-d6fe-485d-a94a-db6b1883a4e1"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 17:50:13.389853 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:50:13.389840    5003 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/a0c03609-d6fe-485d-a94a-db6b1883a4e1-maas-api-openshift-ca\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:50:13.391635 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:50:13.391612    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a0c03609-d6fe-485d-a94a-db6b1883a4e1-maas-api-xks-ca" pod "a0c03609-d6fe-485d-a94a-db6b1883a4e1" (UID: "a0c03609-d6fe-485d-a94a-db6b1883a4e1"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 17:50:13.391635 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:50:13.391628    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a0c03609-d6fe-485d-a94a-db6b1883a4e1-kube-api-access-g9ftw" pod "a0c03609-d6fe-485d-a94a-db6b1883a4e1" (UID: "a0c03609-d6fe-485d-a94a-db6b1883a4e1"). InnerVolumeSpecName "kube-api-access-g9ftw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 17:50:13.490404 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:50:13.490326    5003 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/a0c03609-d6fe-485d-a94a-db6b1883a4e1-maas-api-xks-ca\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:50:13.490404 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:50:13.490354    5003 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g9ftw\" (UniqueName: \"kubernetes.io/projected/a0c03609-d6fe-485d-a94a-db6b1883a4e1-kube-api-access-g9ftw\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:50:14.230047 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:50:14.229966    5003 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-single-main-60d748-th2rf"
Oct 31 17:50:14.230047 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:50:14.229991    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-single-main-60d748-th2rf" event={"ID":"a0c03609-d6fe-485d-a94a-db6b1883a4e1","Type":"ContainerDied","Data":"9a4ee11fd8250d140637bd78eebf501ceb01f8b9891ff95027979454f187297c"}
Oct 31 17:50:14.230047 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:50:14.230046    5003 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9a4ee11fd8250d140637bd78eebf501ceb01f8b9891ff95027979454f187297c"
Oct 31 17:50:24.119439 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:50:24.119229    5003 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-single-main-60d748-th2rf"]
Oct 31 17:50:24.134362 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:50:24.134325    5003 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-single-main-60d748-th2rf"]
Oct 31 17:50:25.892983 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:50:25.892944    5003 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="a0c03609-d6fe-485d-a94a-db6b1883a4e1" path="/var/lib/kubelet/pods/a0c03609-d6fe-485d-a94a-db6b1883a4e1/volumes"
Oct 31 17:50:31.975598 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:50:31.975565    5003 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-8qm4p"]
Oct 31 17:50:31.987196 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:50:31.987159    5003 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-8qm4p"]
Oct 31 17:50:32.023785 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:50:32.023757    5003 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-4v8x6"]
Oct 31 17:50:32.025163 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:50:32.025124    5003 cpu_manager.go:414] "containerMap: removing container" podUID="a0c03609-d6fe-485d-a94a-db6b1883a4e1" containerName="revoke-keys"
Oct 31 17:50:32.025351 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:50:32.025329    5003 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="a0c03609-d6fe-485d-a94a-db6b1883a4e1" containerName="revoke-keys"
Oct 31 17:50:32.025773 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:50:32.025755    5003 memory_manager.go:365] "RemoveStaleState removing state" podUID="a0c03609-d6fe-485d-a94a-db6b1883a4e1" containerName="revoke-keys"
Oct 31 17:50:32.031654 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:50:32.031611    5003 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-4v8x6"
Oct 31 17:50:32.045325 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:50:32.045299    5003 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-4v8x6"]
Oct 31 17:50:32.046038 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:50:32.046009    5003 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\""
Oct 31 17:50:32.046157 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:50:32.046146    5003 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-mr9x2\""
Oct 31 17:50:32.183107 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:50:32.183074    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/dcb1e833-016f-4046-a957-37b68adb9d09-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-3d4156f1-4v8x6\" (UID: \"dcb1e833-016f-4046-a957-37b68adb9d09\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-4v8x6"
Oct 31 17:50:32.183107 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:50:32.183109    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9f442\" (UniqueName: \"kubernetes.io/projected/dcb1e833-016f-4046-a957-37b68adb9d09-kube-api-access-9f442\") pod \"maas-api-revoke-sub-3d4156f1-4v8x6\" (UID: \"dcb1e833-016f-4046-a957-37b68adb9d09\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-4v8x6"
Oct 31 17:50:32.183325 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:50:32.183268    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/dcb1e833-016f-4046-a957-37b68adb9d09-maas-api-xks-ca\") pod \"maas-api-revoke-sub-3d4156f1-4v8x6\" (UID: \"dcb1e833-016f-4046-a957-37b68adb9d09\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-4v8x6"
Oct 31 17:50:32.284197 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:50:32.284119    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/dcb1e833-016f-4046-a957-37b68adb9d09-maas-api-xks-ca\") pod \"maas-api-revoke-sub-3d4156f1-4v8x6\" (UID: \"dcb1e833-016f-4046-a957-37b68adb9d09\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-4v8x6"
Oct 31 17:50:32.284197 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:50:32.284192    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/dcb1e833-016f-4046-a957-37b68adb9d09-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-3d4156f1-4v8x6\" (UID: \"dcb1e833-016f-4046-a957-37b68adb9d09\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-4v8x6"
Oct 31 17:50:32.284380 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:50:32.284213    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9f442\" (UniqueName: \"kubernetes.io/projected/dcb1e833-016f-4046-a957-37b68adb9d09-kube-api-access-9f442\") pod \"maas-api-revoke-sub-3d4156f1-4v8x6\" (UID: \"dcb1e833-016f-4046-a957-37b68adb9d09\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-4v8x6"
Oct 31 17:50:32.284909 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:50:32.284880    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/dcb1e833-016f-4046-a957-37b68adb9d09-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-3d4156f1-4v8x6\" (UID: \"dcb1e833-016f-4046-a957-37b68adb9d09\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-4v8x6"
Oct 31 17:50:32.286434 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:50:32.286414    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/dcb1e833-016f-4046-a957-37b68adb9d09-maas-api-xks-ca\") pod \"maas-api-revoke-sub-3d4156f1-4v8x6\" (UID: \"dcb1e833-016f-4046-a957-37b68adb9d09\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-4v8x6"
Oct 31 17:50:32.306036 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:50:32.306012    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9f442\" (UniqueName: \"kubernetes.io/projected/dcb1e833-016f-4046-a957-37b68adb9d09-kube-api-access-9f442\") pod \"maas-api-revoke-sub-3d4156f1-4v8x6\" (UID: \"dcb1e833-016f-4046-a957-37b68adb9d09\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-4v8x6"
Oct 31 17:50:32.346968 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:50:32.346940    5003 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-4v8x6"
Oct 31 17:50:32.642620 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:50:32.642583    5003 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-4v8x6"]
Oct 31 17:50:32.646296 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:50:32.646266    5003 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddcb1e833_016f_4046_a957_37b68adb9d09.slice/crio-dbe743671a23e8301993d7f225c92ebc458e2c16d03c18a17d9db9ce4b5adf4c WatchSource:0}: Error finding container dbe743671a23e8301993d7f225c92ebc458e2c16d03c18a17d9db9ce4b5adf4c: Status 404 returned error can't find the container with id dbe743671a23e8301993d7f225c92ebc458e2c16d03c18a17d9db9ce4b5adf4c
Oct 31 17:50:33.353425 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:50:33.353391    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-4v8x6" event={"ID":"dcb1e833-016f-4046-a957-37b68adb9d09","Type":"ContainerStarted","Data":"3ed88384681a29921f470413842125b23ed38323901a4b2c89ea8b772d50f261"}
Oct 31 17:50:33.353829 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:50:33.353453    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-4v8x6" event={"ID":"dcb1e833-016f-4046-a957-37b68adb9d09","Type":"ContainerStarted","Data":"dbe743671a23e8301993d7f225c92ebc458e2c16d03c18a17d9db9ce4b5adf4c"}
Oct 31 17:50:33.393219 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:50:33.393171    5003 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-4v8x6" podStartSLOduration=1.393157304 podStartE2EDuration="1.393157304s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 17:50:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 17:50:33.389813424 +0000 UTC m=+1401.644667966" watchObservedRunningTime="2026-10-31 17:50:33.393157304 +0000 UTC m=+1401.648011841"
Oct 31 17:50:33.888347 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:50:33.888313    5003 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="80310dba-f967-4f98-892b-360c90b9732e" path="/var/lib/kubelet/pods/80310dba-f967-4f98-892b-360c90b9732e/volumes"
Oct 31 17:50:34.361175 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:50:34.361140    5003 generic.go:356] "Generic (PLEG): container finished" podID="dcb1e833-016f-4046-a957-37b68adb9d09" containerID="3ed88384681a29921f470413842125b23ed38323901a4b2c89ea8b772d50f261" exitCode=0
Oct 31 17:50:34.361620 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:50:34.361222    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-4v8x6" event={"ID":"dcb1e833-016f-4046-a957-37b68adb9d09","Type":"ContainerDied","Data":"3ed88384681a29921f470413842125b23ed38323901a4b2c89ea8b772d50f261"}
Oct 31 17:50:35.507753 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:50:35.507729    5003 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-4v8x6"
Oct 31 17:50:35.617220 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:50:35.617188    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/dcb1e833-016f-4046-a957-37b68adb9d09-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/dcb1e833-016f-4046-a957-37b68adb9d09-maas-api-xks-ca\") pod \"dcb1e833-016f-4046-a957-37b68adb9d09\" (UID: \"dcb1e833-016f-4046-a957-37b68adb9d09\") "
Oct 31 17:50:35.617415 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:50:35.617290    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/dcb1e833-016f-4046-a957-37b68adb9d09-kube-api-access-9f442\" (UniqueName: \"kubernetes.io/projected/dcb1e833-016f-4046-a957-37b68adb9d09-kube-api-access-9f442\") pod \"dcb1e833-016f-4046-a957-37b68adb9d09\" (UID: \"dcb1e833-016f-4046-a957-37b68adb9d09\") "
Oct 31 17:50:35.617415 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:50:35.617326    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/dcb1e833-016f-4046-a957-37b68adb9d09-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/dcb1e833-016f-4046-a957-37b68adb9d09-maas-api-openshift-ca\") pod \"dcb1e833-016f-4046-a957-37b68adb9d09\" (UID: \"dcb1e833-016f-4046-a957-37b68adb9d09\") "
Oct 31 17:50:35.617729 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:50:35.617701    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dcb1e833-016f-4046-a957-37b68adb9d09-maas-api-openshift-ca" pod "dcb1e833-016f-4046-a957-37b68adb9d09" (UID: "dcb1e833-016f-4046-a957-37b68adb9d09"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 17:50:35.619414 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:50:35.619363    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dcb1e833-016f-4046-a957-37b68adb9d09-maas-api-xks-ca" pod "dcb1e833-016f-4046-a957-37b68adb9d09" (UID: "dcb1e833-016f-4046-a957-37b68adb9d09"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 17:50:35.619414 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:50:35.619367    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dcb1e833-016f-4046-a957-37b68adb9d09-kube-api-access-9f442" pod "dcb1e833-016f-4046-a957-37b68adb9d09" (UID: "dcb1e833-016f-4046-a957-37b68adb9d09"). InnerVolumeSpecName "kube-api-access-9f442". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 17:50:35.718228 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:50:35.718192    5003 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9f442\" (UniqueName: \"kubernetes.io/projected/dcb1e833-016f-4046-a957-37b68adb9d09-kube-api-access-9f442\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:50:35.718228 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:50:35.718224    5003 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/dcb1e833-016f-4046-a957-37b68adb9d09-maas-api-openshift-ca\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:50:35.718228 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:50:35.718235    5003 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/dcb1e833-016f-4046-a957-37b68adb9d09-maas-api-xks-ca\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:50:36.375019 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:50:36.374960    5003 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-4v8x6"
Oct 31 17:50:36.375019 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:50:36.374989    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-4v8x6" event={"ID":"dcb1e833-016f-4046-a957-37b68adb9d09","Type":"ContainerDied","Data":"dbe743671a23e8301993d7f225c92ebc458e2c16d03c18a17d9db9ce4b5adf4c"}
Oct 31 17:50:36.375245 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:50:36.375035    5003 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="dbe743671a23e8301993d7f225c92ebc458e2c16d03c18a17d9db9ce4b5adf4c"
Oct 31 17:50:40.330589 ip-10-0-138-17 kubenswrapper[5003]: E1031 17:50:40.330551    5003 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-tdzz5" containerName="extractor"
Oct 31 17:50:41.024791 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:50:41.024757    5003 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-046e1343-mbfbj"]
Oct 31 17:50:41.036428 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:50:41.036392    5003 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-046e1343-mbfbj"]
Oct 31 17:50:41.888151 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:50:41.888119    5003 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="ed5065fa-f0f3-4b7e-9194-0344bc8fc2e3" path="/var/lib/kubelet/pods/ed5065fa-f0f3-4b7e-9194-0344bc8fc2e3/volumes"
Oct 31 17:50:51.024511 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:50:51.024466    5003 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-d3fba056-8cvgs"]
Oct 31 17:50:51.035505 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:50:51.035478    5003 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-d3fba056-8cvgs"]
Oct 31 17:50:51.888190 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:50:51.888158    5003 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="19f75e5e-d17e-414e-acf7-81257df99bcf" path="/var/lib/kubelet/pods/19f75e5e-d17e-414e-acf7-81257df99bcf/volumes"
Oct 31 17:51:10.330953 ip-10-0-138-17 kubenswrapper[5003]: E1031 17:51:10.330913    5003 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-tdzz5" containerName="extractor"
Oct 31 17:51:12.025159 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:51:12.025124    5003 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-ae594979-hg5dk"]
Oct 31 17:51:12.036713 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:51:12.036681    5003 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-ae594979-hg5dk"]
Oct 31 17:51:12.836459 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:51:12.836429    5003 scope.go:122] "RemoveContainer" containerID="d744a19cc837c720ecf1d7a4a575f600bec24d77f4b3f7ff948870a0ae438acf"
Oct 31 17:51:12.846490 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:51:12.846468    5003 scope.go:122] "RemoveContainer" containerID="c3b91be85e558f1f21fc7a4f190329414c1820d47181373522066a61ff1ed666"
Oct 31 17:51:13.888280 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:51:13.888248    5003 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="fe0e4e20-1cf0-4ecf-9235-50f38ca5da56" path="/var/lib/kubelet/pods/fe0e4e20-1cf0-4ecf-9235-50f38ca5da56/volumes"
Oct 31 17:51:33.024187 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:51:33.024147    5003 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-a4aef7d7-dfg6x"]
Oct 31 17:51:33.035749 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:51:33.035717    5003 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-a4aef7d7-dfg6x"]
Oct 31 17:51:33.888085 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:51:33.888055    5003 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="6aa9c6ab-93b6-4ec4-8509-ff559f00e5a0" path="/var/lib/kubelet/pods/6aa9c6ab-93b6-4ec4-8509-ff559f00e5a0/volumes"
Oct 31 17:51:40.331641 ip-10-0-138-17 kubenswrapper[5003]: E1031 17:51:40.330633    5003 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-tdzz5" containerName="extractor"
Oct 31 17:51:56.024940 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:51:56.024851    5003 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-79805ca9-vcdrx"]
Oct 31 17:51:56.036289 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:51:56.036258    5003 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-79805ca9-vcdrx"]
Oct 31 17:51:57.888439 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:51:57.888404    5003 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="e88f9a17-0fb1-461b-b515-82e71c03aacf" path="/var/lib/kubelet/pods/e88f9a17-0fb1-461b-b515-82e71c03aacf/volumes"
Oct 31 17:52:10.330556 ip-10-0-138-17 kubenswrapper[5003]: E1031 17:52:10.330516    5003 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-tdzz5" containerName="extractor"
Oct 31 17:52:12.213084 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:52:12.213056    5003 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-b2xxw_f03611db-3bd9-401a-a137-1d4f691b51ea/console-operator/2.log"
Oct 31 17:52:12.215557 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:52:12.215228    5003 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-b2xxw_f03611db-3bd9-401a-a137-1d4f691b51ea/console-operator/2.log"
Oct 31 17:52:12.874212 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:52:12.874180    5003 scope.go:122] "RemoveContainer" containerID="dc5415d20dc6c79d3925369b9ef280de7c1058bdc9fb5e73a21095cb7c4be4f9"
Oct 31 17:52:12.883389 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:52:12.883370    5003 scope.go:122] "RemoveContainer" containerID="07663e45f965f9e222574cd25df265efb9d54afcd59bd46aa29db22264f6af19"
Oct 31 17:52:12.891233 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:52:12.891213    5003 scope.go:122] "RemoveContainer" containerID="24907d803390da8f6e5562e396c49a1c58e9436f8b535e54e474e3bbdce26b50"
Oct 31 17:52:16.024492 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:52:16.024456    5003 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-0b7e8edb-c474k"]
Oct 31 17:52:16.036051 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:52:16.036024    5003 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-0b7e8edb-c474k"]
Oct 31 17:52:17.888905 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:52:17.888870    5003 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="fe21c4f3-887f-4520-bf08-942d0658fdd8" path="/var/lib/kubelet/pods/fe21c4f3-887f-4520-bf08-942d0658fdd8/volumes"
Oct 31 17:52:21.111276 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:52:21.111225    5003 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-d576e68b-gxn26"]
Oct 31 17:52:21.111715 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:52:21.111672    5003 cpu_manager.go:414] "containerMap: removing container" podUID="dcb1e833-016f-4046-a957-37b68adb9d09" containerName="revoke-keys"
Oct 31 17:52:21.111715 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:52:21.111684    5003 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="dcb1e833-016f-4046-a957-37b68adb9d09" containerName="revoke-keys"
Oct 31 17:52:21.111805 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:52:21.111753    5003 memory_manager.go:365] "RemoveStaleState removing state" podUID="dcb1e833-016f-4046-a957-37b68adb9d09" containerName="revoke-keys"
Oct 31 17:52:21.116458 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:52:21.116438    5003 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-d576e68b-gxn26"
Oct 31 17:52:21.132277 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:52:21.132253    5003 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-d576e68b-gxn26"]
Oct 31 17:52:21.165957 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:52:21.165931    5003 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\""
Oct 31 17:52:21.166106 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:52:21.166058    5003 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-mr9x2\""
Oct 31 17:52:21.192530 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:52:21.192501    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/43616698-c7c7-4945-9f74-2e8b9e4d7ab3-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-d576e68b-gxn26\" (UID: \"43616698-c7c7-4945-9f74-2e8b9e4d7ab3\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-d576e68b-gxn26"
Oct 31 17:52:21.192693 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:52:21.192542    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7gpp7\" (UniqueName: \"kubernetes.io/projected/43616698-c7c7-4945-9f74-2e8b9e4d7ab3-kube-api-access-7gpp7\") pod \"maas-api-revoke-sub-d576e68b-gxn26\" (UID: \"43616698-c7c7-4945-9f74-2e8b9e4d7ab3\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-d576e68b-gxn26"
Oct 31 17:52:21.192693 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:52:21.192566    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/43616698-c7c7-4945-9f74-2e8b9e4d7ab3-maas-api-xks-ca\") pod \"maas-api-revoke-sub-d576e68b-gxn26\" (UID: \"43616698-c7c7-4945-9f74-2e8b9e4d7ab3\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-d576e68b-gxn26"
Oct 31 17:52:21.293613 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:52:21.293582    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/43616698-c7c7-4945-9f74-2e8b9e4d7ab3-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-d576e68b-gxn26\" (UID: \"43616698-c7c7-4945-9f74-2e8b9e4d7ab3\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-d576e68b-gxn26"
Oct 31 17:52:21.293800 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:52:21.293623    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7gpp7\" (UniqueName: \"kubernetes.io/projected/43616698-c7c7-4945-9f74-2e8b9e4d7ab3-kube-api-access-7gpp7\") pod \"maas-api-revoke-sub-d576e68b-gxn26\" (UID: \"43616698-c7c7-4945-9f74-2e8b9e4d7ab3\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-d576e68b-gxn26"
Oct 31 17:52:21.293800 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:52:21.293668    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/43616698-c7c7-4945-9f74-2e8b9e4d7ab3-maas-api-xks-ca\") pod \"maas-api-revoke-sub-d576e68b-gxn26\" (UID: \"43616698-c7c7-4945-9f74-2e8b9e4d7ab3\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-d576e68b-gxn26"
Oct 31 17:52:21.294299 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:52:21.294279    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/43616698-c7c7-4945-9f74-2e8b9e4d7ab3-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-d576e68b-gxn26\" (UID: \"43616698-c7c7-4945-9f74-2e8b9e4d7ab3\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-d576e68b-gxn26"
Oct 31 17:52:21.296158 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:52:21.296136    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/43616698-c7c7-4945-9f74-2e8b9e4d7ab3-maas-api-xks-ca\") pod \"maas-api-revoke-sub-d576e68b-gxn26\" (UID: \"43616698-c7c7-4945-9f74-2e8b9e4d7ab3\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-d576e68b-gxn26"
Oct 31 17:52:21.313835 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:52:21.313805    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7gpp7\" (UniqueName: \"kubernetes.io/projected/43616698-c7c7-4945-9f74-2e8b9e4d7ab3-kube-api-access-7gpp7\") pod \"maas-api-revoke-sub-d576e68b-gxn26\" (UID: \"43616698-c7c7-4945-9f74-2e8b9e4d7ab3\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-d576e68b-gxn26"
Oct 31 17:52:21.428891 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:52:21.428812    5003 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-d576e68b-gxn26"
Oct 31 17:52:21.727844 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:52:21.727767    5003 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-d576e68b-gxn26"]
Oct 31 17:52:21.731326 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:52:21.731300    5003 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod43616698_c7c7_4945_9f74_2e8b9e4d7ab3.slice/crio-e11a5664e14b4d72e2321c88728ca8124c08fad924f71be5c93e61f294fa4fa0 WatchSource:0}: Error finding container e11a5664e14b4d72e2321c88728ca8124c08fad924f71be5c93e61f294fa4fa0: Status 404 returned error can't find the container with id e11a5664e14b4d72e2321c88728ca8124c08fad924f71be5c93e61f294fa4fa0
Oct 31 17:52:22.047954 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:52:22.047875    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-d576e68b-gxn26" event={"ID":"43616698-c7c7-4945-9f74-2e8b9e4d7ab3","Type":"ContainerStarted","Data":"e11a5664e14b4d72e2321c88728ca8124c08fad924f71be5c93e61f294fa4fa0"}
Oct 31 17:52:23.055530 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:52:23.055498    5003 generic.go:356] "Generic (PLEG): container finished" podID="43616698-c7c7-4945-9f74-2e8b9e4d7ab3" containerID="d5a4fcaebd5008bf64ba58c22b20ea72ca380867aa5991811a61d2b0316a7f47" exitCode=0
Oct 31 17:52:23.055925 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:52:23.055579    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-d576e68b-gxn26" event={"ID":"43616698-c7c7-4945-9f74-2e8b9e4d7ab3","Type":"ContainerDied","Data":"d5a4fcaebd5008bf64ba58c22b20ea72ca380867aa5991811a61d2b0316a7f47"}
Oct 31 17:52:24.203328 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:52:24.203294    5003 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-d576e68b-gxn26"
Oct 31 17:52:24.322004 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:52:24.321894    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/43616698-c7c7-4945-9f74-2e8b9e4d7ab3-kube-api-access-7gpp7\" (UniqueName: \"kubernetes.io/projected/43616698-c7c7-4945-9f74-2e8b9e4d7ab3-kube-api-access-7gpp7\") pod \"43616698-c7c7-4945-9f74-2e8b9e4d7ab3\" (UID: \"43616698-c7c7-4945-9f74-2e8b9e4d7ab3\") "
Oct 31 17:52:24.322004 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:52:24.321964    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/43616698-c7c7-4945-9f74-2e8b9e4d7ab3-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/43616698-c7c7-4945-9f74-2e8b9e4d7ab3-maas-api-openshift-ca\") pod \"43616698-c7c7-4945-9f74-2e8b9e4d7ab3\" (UID: \"43616698-c7c7-4945-9f74-2e8b9e4d7ab3\") "
Oct 31 17:52:24.322226 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:52:24.322020    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/43616698-c7c7-4945-9f74-2e8b9e4d7ab3-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/43616698-c7c7-4945-9f74-2e8b9e4d7ab3-maas-api-xks-ca\") pod \"43616698-c7c7-4945-9f74-2e8b9e4d7ab3\" (UID: \"43616698-c7c7-4945-9f74-2e8b9e4d7ab3\") "
Oct 31 17:52:24.322343 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:52:24.322317    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/43616698-c7c7-4945-9f74-2e8b9e4d7ab3-maas-api-openshift-ca" pod "43616698-c7c7-4945-9f74-2e8b9e4d7ab3" (UID: "43616698-c7c7-4945-9f74-2e8b9e4d7ab3"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 17:52:24.324119 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:52:24.324091    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/43616698-c7c7-4945-9f74-2e8b9e4d7ab3-maas-api-xks-ca" pod "43616698-c7c7-4945-9f74-2e8b9e4d7ab3" (UID: "43616698-c7c7-4945-9f74-2e8b9e4d7ab3"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 17:52:24.324225 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:52:24.324137    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/43616698-c7c7-4945-9f74-2e8b9e4d7ab3-kube-api-access-7gpp7" pod "43616698-c7c7-4945-9f74-2e8b9e4d7ab3" (UID: "43616698-c7c7-4945-9f74-2e8b9e4d7ab3"). InnerVolumeSpecName "kube-api-access-7gpp7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 17:52:24.422909 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:52:24.422877    5003 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7gpp7\" (UniqueName: \"kubernetes.io/projected/43616698-c7c7-4945-9f74-2e8b9e4d7ab3-kube-api-access-7gpp7\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:52:24.422909 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:52:24.422906    5003 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/43616698-c7c7-4945-9f74-2e8b9e4d7ab3-maas-api-openshift-ca\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:52:24.422909 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:52:24.422916    5003 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/43616698-c7c7-4945-9f74-2e8b9e4d7ab3-maas-api-xks-ca\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:52:25.074728 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:52:25.074694    5003 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-d576e68b-gxn26"
Oct 31 17:52:25.074728 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:52:25.074707    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-d576e68b-gxn26" event={"ID":"43616698-c7c7-4945-9f74-2e8b9e4d7ab3","Type":"ContainerDied","Data":"e11a5664e14b4d72e2321c88728ca8124c08fad924f71be5c93e61f294fa4fa0"}
Oct 31 17:52:25.074989 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:52:25.074789    5003 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e11a5664e14b4d72e2321c88728ca8124c08fad924f71be5c93e61f294fa4fa0"
Oct 31 17:52:40.330745 ip-10-0-138-17 kubenswrapper[5003]: E1031 17:52:40.330702    5003 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-tdzz5" containerName="extractor"
Oct 31 17:52:42.109545 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:52:42.109490    5003 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-d2bc93bc-xp9z6"]
Oct 31 17:52:42.110122 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:52:42.110022    5003 cpu_manager.go:414] "containerMap: removing container" podUID="43616698-c7c7-4945-9f74-2e8b9e4d7ab3" containerName="revoke-keys"
Oct 31 17:52:42.110122 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:52:42.110036    5003 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="43616698-c7c7-4945-9f74-2e8b9e4d7ab3" containerName="revoke-keys"
Oct 31 17:52:42.110239 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:52:42.110124    5003 memory_manager.go:365] "RemoveStaleState removing state" podUID="43616698-c7c7-4945-9f74-2e8b9e4d7ab3" containerName="revoke-keys"
Oct 31 17:52:42.113422 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:52:42.113401    5003 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-d2bc93bc-xp9z6"
Oct 31 17:52:42.130495 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:52:42.130469    5003 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-d2bc93bc-xp9z6"]
Oct 31 17:52:42.139323 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:52:42.139289    5003 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\""
Oct 31 17:52:42.139459 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:52:42.139411    5003 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-mr9x2\""
Oct 31 17:52:42.201949 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:52:42.201898    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/a8b2dbb4-bc27-488d-b61a-0e972baa4a63-maas-api-xks-ca\") pod \"maas-api-revoke-sub-d2bc93bc-xp9z6\" (UID: \"a8b2dbb4-bc27-488d-b61a-0e972baa4a63\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-d2bc93bc-xp9z6"
Oct 31 17:52:42.202116 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:52:42.202031    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n54bz\" (UniqueName: \"kubernetes.io/projected/a8b2dbb4-bc27-488d-b61a-0e972baa4a63-kube-api-access-n54bz\") pod \"maas-api-revoke-sub-d2bc93bc-xp9z6\" (UID: \"a8b2dbb4-bc27-488d-b61a-0e972baa4a63\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-d2bc93bc-xp9z6"
Oct 31 17:52:42.202116 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:52:42.202103    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/a8b2dbb4-bc27-488d-b61a-0e972baa4a63-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-d2bc93bc-xp9z6\" (UID: \"a8b2dbb4-bc27-488d-b61a-0e972baa4a63\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-d2bc93bc-xp9z6"
Oct 31 17:52:42.303579 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:52:42.303542    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n54bz\" (UniqueName: \"kubernetes.io/projected/a8b2dbb4-bc27-488d-b61a-0e972baa4a63-kube-api-access-n54bz\") pod \"maas-api-revoke-sub-d2bc93bc-xp9z6\" (UID: \"a8b2dbb4-bc27-488d-b61a-0e972baa4a63\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-d2bc93bc-xp9z6"
Oct 31 17:52:42.303795 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:52:42.303609    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/a8b2dbb4-bc27-488d-b61a-0e972baa4a63-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-d2bc93bc-xp9z6\" (UID: \"a8b2dbb4-bc27-488d-b61a-0e972baa4a63\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-d2bc93bc-xp9z6"
Oct 31 17:52:42.303795 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:52:42.303692    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/a8b2dbb4-bc27-488d-b61a-0e972baa4a63-maas-api-xks-ca\") pod \"maas-api-revoke-sub-d2bc93bc-xp9z6\" (UID: \"a8b2dbb4-bc27-488d-b61a-0e972baa4a63\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-d2bc93bc-xp9z6"
Oct 31 17:52:42.304297 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:52:42.304273    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/a8b2dbb4-bc27-488d-b61a-0e972baa4a63-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-d2bc93bc-xp9z6\" (UID: \"a8b2dbb4-bc27-488d-b61a-0e972baa4a63\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-d2bc93bc-xp9z6"
Oct 31 17:52:42.306001 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:52:42.305983    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/a8b2dbb4-bc27-488d-b61a-0e972baa4a63-maas-api-xks-ca\") pod \"maas-api-revoke-sub-d2bc93bc-xp9z6\" (UID: \"a8b2dbb4-bc27-488d-b61a-0e972baa4a63\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-d2bc93bc-xp9z6"
Oct 31 17:52:42.322601 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:52:42.322577    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n54bz\" (UniqueName: \"kubernetes.io/projected/a8b2dbb4-bc27-488d-b61a-0e972baa4a63-kube-api-access-n54bz\") pod \"maas-api-revoke-sub-d2bc93bc-xp9z6\" (UID: \"a8b2dbb4-bc27-488d-b61a-0e972baa4a63\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-d2bc93bc-xp9z6"
Oct 31 17:52:42.430458 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:52:42.430377    5003 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-d2bc93bc-xp9z6"
Oct 31 17:52:42.729345 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:52:42.729258    5003 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-d2bc93bc-xp9z6"]
Oct 31 17:52:42.733049 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:52:42.733014    5003 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda8b2dbb4_bc27_488d_b61a_0e972baa4a63.slice/crio-280570d7037b18f3b317f03270061a939883eb64ec82fe4d46e3f09aaf6699e6 WatchSource:0}: Error finding container 280570d7037b18f3b317f03270061a939883eb64ec82fe4d46e3f09aaf6699e6: Status 404 returned error can't find the container with id 280570d7037b18f3b317f03270061a939883eb64ec82fe4d46e3f09aaf6699e6
Oct 31 17:52:43.180693 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:52:43.180656    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-d2bc93bc-xp9z6" event={"ID":"a8b2dbb4-bc27-488d-b61a-0e972baa4a63","Type":"ContainerStarted","Data":"110bee1c3299734af86cf59e1fa575036ce51d56d45ad93914ccadcbfd5a13da"}
Oct 31 17:52:43.181068 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:52:43.180708    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-d2bc93bc-xp9z6" event={"ID":"a8b2dbb4-bc27-488d-b61a-0e972baa4a63","Type":"ContainerStarted","Data":"280570d7037b18f3b317f03270061a939883eb64ec82fe4d46e3f09aaf6699e6"}
Oct 31 17:52:43.217144 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:52:43.217016    5003 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-sub-d2bc93bc-xp9z6" podStartSLOduration=1.216998577 podStartE2EDuration="1.216998577s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 17:52:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 17:52:43.216893922 +0000 UTC m=+1531.471748463" watchObservedRunningTime="2026-10-31 17:52:43.216998577 +0000 UTC m=+1531.471853114"
Oct 31 17:52:44.188263 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:52:44.188220    5003 generic.go:356] "Generic (PLEG): container finished" podID="a8b2dbb4-bc27-488d-b61a-0e972baa4a63" containerID="110bee1c3299734af86cf59e1fa575036ce51d56d45ad93914ccadcbfd5a13da" exitCode=0
Oct 31 17:52:44.188719 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:52:44.188308    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-d2bc93bc-xp9z6" event={"ID":"a8b2dbb4-bc27-488d-b61a-0e972baa4a63","Type":"ContainerDied","Data":"110bee1c3299734af86cf59e1fa575036ce51d56d45ad93914ccadcbfd5a13da"}
Oct 31 17:52:45.326889 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:52:45.326863    5003 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-d2bc93bc-xp9z6"
Oct 31 17:52:45.433481 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:52:45.433453    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/a8b2dbb4-bc27-488d-b61a-0e972baa4a63-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/a8b2dbb4-bc27-488d-b61a-0e972baa4a63-maas-api-openshift-ca\") pod \"a8b2dbb4-bc27-488d-b61a-0e972baa4a63\" (UID: \"a8b2dbb4-bc27-488d-b61a-0e972baa4a63\") "
Oct 31 17:52:45.433715 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:52:45.433538    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/a8b2dbb4-bc27-488d-b61a-0e972baa4a63-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/a8b2dbb4-bc27-488d-b61a-0e972baa4a63-maas-api-xks-ca\") pod \"a8b2dbb4-bc27-488d-b61a-0e972baa4a63\" (UID: \"a8b2dbb4-bc27-488d-b61a-0e972baa4a63\") "
Oct 31 17:52:45.433715 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:52:45.433563    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/a8b2dbb4-bc27-488d-b61a-0e972baa4a63-kube-api-access-n54bz\" (UniqueName: \"kubernetes.io/projected/a8b2dbb4-bc27-488d-b61a-0e972baa4a63-kube-api-access-n54bz\") pod \"a8b2dbb4-bc27-488d-b61a-0e972baa4a63\" (UID: \"a8b2dbb4-bc27-488d-b61a-0e972baa4a63\") "
Oct 31 17:52:45.433929 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:52:45.433888    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a8b2dbb4-bc27-488d-b61a-0e972baa4a63-maas-api-openshift-ca" pod "a8b2dbb4-bc27-488d-b61a-0e972baa4a63" (UID: "a8b2dbb4-bc27-488d-b61a-0e972baa4a63"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 17:52:45.435773 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:52:45.435749    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a8b2dbb4-bc27-488d-b61a-0e972baa4a63-kube-api-access-n54bz" pod "a8b2dbb4-bc27-488d-b61a-0e972baa4a63" (UID: "a8b2dbb4-bc27-488d-b61a-0e972baa4a63"). InnerVolumeSpecName "kube-api-access-n54bz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 17:52:45.435882 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:52:45.435772    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a8b2dbb4-bc27-488d-b61a-0e972baa4a63-maas-api-xks-ca" pod "a8b2dbb4-bc27-488d-b61a-0e972baa4a63" (UID: "a8b2dbb4-bc27-488d-b61a-0e972baa4a63"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 17:52:45.535095 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:52:45.535006    5003 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/a8b2dbb4-bc27-488d-b61a-0e972baa4a63-maas-api-xks-ca\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:52:45.535095 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:52:45.535039    5003 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n54bz\" (UniqueName: \"kubernetes.io/projected/a8b2dbb4-bc27-488d-b61a-0e972baa4a63-kube-api-access-n54bz\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:52:45.535095 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:52:45.535054    5003 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/a8b2dbb4-bc27-488d-b61a-0e972baa4a63-maas-api-openshift-ca\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:52:46.200822 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:52:46.200748    5003 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-d2bc93bc-xp9z6"
Oct 31 17:52:46.200972 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:52:46.200753    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-d2bc93bc-xp9z6" event={"ID":"a8b2dbb4-bc27-488d-b61a-0e972baa4a63","Type":"ContainerDied","Data":"280570d7037b18f3b317f03270061a939883eb64ec82fe4d46e3f09aaf6699e6"}
Oct 31 17:52:46.200972 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:52:46.200865    5003 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="280570d7037b18f3b317f03270061a939883eb64ec82fe4d46e3f09aaf6699e6"
Oct 31 17:53:10.331046 ip-10-0-138-17 kubenswrapper[5003]: E1031 17:53:10.331004    5003 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-tdzz5" containerName="extractor"
Oct 31 17:53:12.924518 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:53:12.924485    5003 scope.go:122] "RemoveContainer" containerID="24853a3efb9e1ef0b232dac47d04d4a7bb5036ad47c00906c0d6c87245c36247"
Oct 31 17:53:12.933734 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:53:12.933716    5003 scope.go:122] "RemoveContainer" containerID="a99b222ced0596895ae1aa8a01f66a681a9bec208d85e878924932abed190355"
Oct 31 17:53:19.024251 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:53:19.024216    5003 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-e2fc9c5b-qhnvf"]
Oct 31 17:53:19.035905 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:53:19.035875    5003 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-e2fc9c5b-qhnvf"]
Oct 31 17:53:19.888328 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:53:19.888294    5003 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="53807235-0006-4eef-9410-6c569b66c141" path="/var/lib/kubelet/pods/53807235-0006-4eef-9410-6c569b66c141/volumes"
Oct 31 17:53:30.024256 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:53:30.024181    5003 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-5a29efb3-dknfd"]
Oct 31 17:53:30.035887 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:53:30.035856    5003 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-5a29efb3-dknfd"]
Oct 31 17:53:31.888443 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:53:31.888412    5003 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="98dedc31-9cdf-4a94-b78c-d997d666c478" path="/var/lib/kubelet/pods/98dedc31-9cdf-4a94-b78c-d997d666c478/volumes"
Oct 31 17:53:40.330638 ip-10-0-138-17 kubenswrapper[5003]: E1031 17:53:40.330596    5003 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-tdzz5" containerName="extractor"
Oct 31 17:53:46.740013 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:53:46.739975    5003 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-86235c0f-7p5fm"]
Oct 31 17:53:46.740503 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:53:46.740384    5003 cpu_manager.go:414] "containerMap: removing container" podUID="a8b2dbb4-bc27-488d-b61a-0e972baa4a63" containerName="revoke-keys"
Oct 31 17:53:46.740503 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:53:46.740395    5003 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="a8b2dbb4-bc27-488d-b61a-0e972baa4a63" containerName="revoke-keys"
Oct 31 17:53:46.740503 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:53:46.740471    5003 memory_manager.go:365] "RemoveStaleState removing state" podUID="a8b2dbb4-bc27-488d-b61a-0e972baa4a63" containerName="revoke-keys"
Oct 31 17:53:46.743909 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:53:46.743891    5003 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-86235c0f-7p5fm"
Oct 31 17:53:46.770631 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:53:46.770605    5003 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-mr9x2\""
Oct 31 17:53:46.770631 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:53:46.770604    5003 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\""
Oct 31 17:53:46.773175 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:53:46.773153    5003 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-86235c0f-7p5fm"]
Oct 31 17:53:46.892180 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:53:46.892147    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/baf9b809-2b5e-4358-91d7-50ed7b72a266-maas-api-xks-ca\") pod \"maas-api-revoke-sub-86235c0f-7p5fm\" (UID: \"baf9b809-2b5e-4358-91d7-50ed7b72a266\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-86235c0f-7p5fm"
Oct 31 17:53:46.892352 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:53:46.892199    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/baf9b809-2b5e-4358-91d7-50ed7b72a266-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-86235c0f-7p5fm\" (UID: \"baf9b809-2b5e-4358-91d7-50ed7b72a266\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-86235c0f-7p5fm"
Oct 31 17:53:46.892352 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:53:46.892279    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7x6w4\" (UniqueName: \"kubernetes.io/projected/baf9b809-2b5e-4358-91d7-50ed7b72a266-kube-api-access-7x6w4\") pod \"maas-api-revoke-sub-86235c0f-7p5fm\" (UID: \"baf9b809-2b5e-4358-91d7-50ed7b72a266\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-86235c0f-7p5fm"
Oct 31 17:53:46.993715 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:53:46.993602    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/baf9b809-2b5e-4358-91d7-50ed7b72a266-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-86235c0f-7p5fm\" (UID: \"baf9b809-2b5e-4358-91d7-50ed7b72a266\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-86235c0f-7p5fm"
Oct 31 17:53:46.993715 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:53:46.993697    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7x6w4\" (UniqueName: \"kubernetes.io/projected/baf9b809-2b5e-4358-91d7-50ed7b72a266-kube-api-access-7x6w4\") pod \"maas-api-revoke-sub-86235c0f-7p5fm\" (UID: \"baf9b809-2b5e-4358-91d7-50ed7b72a266\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-86235c0f-7p5fm"
Oct 31 17:53:46.994031 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:53:46.994003    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/baf9b809-2b5e-4358-91d7-50ed7b72a266-maas-api-xks-ca\") pod \"maas-api-revoke-sub-86235c0f-7p5fm\" (UID: \"baf9b809-2b5e-4358-91d7-50ed7b72a266\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-86235c0f-7p5fm"
Oct 31 17:53:46.994355 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:53:46.994334    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/baf9b809-2b5e-4358-91d7-50ed7b72a266-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-86235c0f-7p5fm\" (UID: \"baf9b809-2b5e-4358-91d7-50ed7b72a266\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-86235c0f-7p5fm"
Oct 31 17:53:46.996249 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:53:46.996225    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/baf9b809-2b5e-4358-91d7-50ed7b72a266-maas-api-xks-ca\") pod \"maas-api-revoke-sub-86235c0f-7p5fm\" (UID: \"baf9b809-2b5e-4358-91d7-50ed7b72a266\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-86235c0f-7p5fm"
Oct 31 17:53:47.011834 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:53:47.011813    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7x6w4\" (UniqueName: \"kubernetes.io/projected/baf9b809-2b5e-4358-91d7-50ed7b72a266-kube-api-access-7x6w4\") pod \"maas-api-revoke-sub-86235c0f-7p5fm\" (UID: \"baf9b809-2b5e-4358-91d7-50ed7b72a266\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-86235c0f-7p5fm"
Oct 31 17:53:47.056525 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:53:47.056501    5003 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-86235c0f-7p5fm"
Oct 31 17:53:47.352457 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:53:47.352425    5003 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-86235c0f-7p5fm"]
Oct 31 17:53:47.356596 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:53:47.356562    5003 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbaf9b809_2b5e_4358_91d7_50ed7b72a266.slice/crio-be51ca444f240d75e908f863df34ae3c96f087a182d60a92cf54ddb37d6d6a93 WatchSource:0}: Error finding container be51ca444f240d75e908f863df34ae3c96f087a182d60a92cf54ddb37d6d6a93: Status 404 returned error can't find the container with id be51ca444f240d75e908f863df34ae3c96f087a182d60a92cf54ddb37d6d6a93
Oct 31 17:53:47.582619 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:53:47.582590    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-86235c0f-7p5fm" event={"ID":"baf9b809-2b5e-4358-91d7-50ed7b72a266","Type":"ContainerStarted","Data":"be51ca444f240d75e908f863df34ae3c96f087a182d60a92cf54ddb37d6d6a93"}
Oct 31 17:53:48.589696 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:53:48.589639    5003 generic.go:356] "Generic (PLEG): container finished" podID="baf9b809-2b5e-4358-91d7-50ed7b72a266" containerID="cae90a15f8c3bde41e23b6574663cfc0e6d23e17b37970002a1ad4ae6a87ce65" exitCode=0
Oct 31 17:53:48.589696 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:53:48.589679    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-86235c0f-7p5fm" event={"ID":"baf9b809-2b5e-4358-91d7-50ed7b72a266","Type":"ContainerDied","Data":"cae90a15f8c3bde41e23b6574663cfc0e6d23e17b37970002a1ad4ae6a87ce65"}
Oct 31 17:53:49.729360 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:53:49.729336    5003 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-86235c0f-7p5fm"
Oct 31 17:53:49.821404 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:53:49.821373    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/baf9b809-2b5e-4358-91d7-50ed7b72a266-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/baf9b809-2b5e-4358-91d7-50ed7b72a266-maas-api-openshift-ca\") pod \"baf9b809-2b5e-4358-91d7-50ed7b72a266\" (UID: \"baf9b809-2b5e-4358-91d7-50ed7b72a266\") "
Oct 31 17:53:49.821566 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:53:49.821439    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/baf9b809-2b5e-4358-91d7-50ed7b72a266-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/baf9b809-2b5e-4358-91d7-50ed7b72a266-maas-api-xks-ca\") pod \"baf9b809-2b5e-4358-91d7-50ed7b72a266\" (UID: \"baf9b809-2b5e-4358-91d7-50ed7b72a266\") "
Oct 31 17:53:49.821566 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:53:49.821479    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/baf9b809-2b5e-4358-91d7-50ed7b72a266-kube-api-access-7x6w4\" (UniqueName: \"kubernetes.io/projected/baf9b809-2b5e-4358-91d7-50ed7b72a266-kube-api-access-7x6w4\") pod \"baf9b809-2b5e-4358-91d7-50ed7b72a266\" (UID: \"baf9b809-2b5e-4358-91d7-50ed7b72a266\") "
Oct 31 17:53:49.821829 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:53:49.821802    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/baf9b809-2b5e-4358-91d7-50ed7b72a266-maas-api-openshift-ca" pod "baf9b809-2b5e-4358-91d7-50ed7b72a266" (UID: "baf9b809-2b5e-4358-91d7-50ed7b72a266"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 17:53:49.823635 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:53:49.823609    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/baf9b809-2b5e-4358-91d7-50ed7b72a266-kube-api-access-7x6w4" pod "baf9b809-2b5e-4358-91d7-50ed7b72a266" (UID: "baf9b809-2b5e-4358-91d7-50ed7b72a266"). InnerVolumeSpecName "kube-api-access-7x6w4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 17:53:49.823736 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:53:49.823718    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/baf9b809-2b5e-4358-91d7-50ed7b72a266-maas-api-xks-ca" pod "baf9b809-2b5e-4358-91d7-50ed7b72a266" (UID: "baf9b809-2b5e-4358-91d7-50ed7b72a266"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 17:53:49.922671 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:53:49.922621    5003 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/baf9b809-2b5e-4358-91d7-50ed7b72a266-maas-api-openshift-ca\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:53:49.922814 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:53:49.922678    5003 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/baf9b809-2b5e-4358-91d7-50ed7b72a266-maas-api-xks-ca\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:53:49.922814 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:53:49.922694    5003 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7x6w4\" (UniqueName: \"kubernetes.io/projected/baf9b809-2b5e-4358-91d7-50ed7b72a266-kube-api-access-7x6w4\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:53:50.602676 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:53:50.602623    5003 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-86235c0f-7p5fm"
Oct 31 17:53:50.602873 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:53:50.602678    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-86235c0f-7p5fm" event={"ID":"baf9b809-2b5e-4358-91d7-50ed7b72a266","Type":"ContainerDied","Data":"be51ca444f240d75e908f863df34ae3c96f087a182d60a92cf54ddb37d6d6a93"}
Oct 31 17:53:50.602873 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:53:50.602756    5003 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="be51ca444f240d75e908f863df34ae3c96f087a182d60a92cf54ddb37d6d6a93"
Oct 31 17:53:57.715242 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:53:57.715205    5003 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-single-main-78301f-trkvg"]
Oct 31 17:53:57.715688 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:53:57.715666    5003 cpu_manager.go:414] "containerMap: removing container" podUID="baf9b809-2b5e-4358-91d7-50ed7b72a266" containerName="revoke-keys"
Oct 31 17:53:57.715688 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:53:57.715679    5003 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="baf9b809-2b5e-4358-91d7-50ed7b72a266" containerName="revoke-keys"
Oct 31 17:53:57.715783 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:53:57.715740    5003 memory_manager.go:365] "RemoveStaleState removing state" podUID="baf9b809-2b5e-4358-91d7-50ed7b72a266" containerName="revoke-keys"
Oct 31 17:53:57.719312 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:53:57.719295    5003 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-single-main-78301f-trkvg"
Oct 31 17:53:57.737264 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:53:57.737235    5003 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-single-main-78301f-trkvg"]
Oct 31 17:53:57.745921 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:53:57.745857    5003 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\""
Oct 31 17:53:57.746058 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:53:57.745980    5003 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-mr9x2\""
Oct 31 17:53:57.905882 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:53:57.905841    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/89903431-4564-4ed3-a9f6-3c23eb3c46be-maas-api-openshift-ca\") pod \"maas-api-revoke-keys-e2e-worker-single-main-78301f-trkvg\" (UID: \"89903431-4564-4ed3-a9f6-3c23eb3c46be\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-single-main-78301f-trkvg"
Oct 31 17:53:57.906071 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:53:57.906000    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/89903431-4564-4ed3-a9f6-3c23eb3c46be-maas-api-xks-ca\") pod \"maas-api-revoke-keys-e2e-worker-single-main-78301f-trkvg\" (UID: \"89903431-4564-4ed3-a9f6-3c23eb3c46be\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-single-main-78301f-trkvg"
Oct 31 17:53:57.906127 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:53:57.906095    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dpnzz\" (UniqueName: \"kubernetes.io/projected/89903431-4564-4ed3-a9f6-3c23eb3c46be-kube-api-access-dpnzz\") pod \"maas-api-revoke-keys-e2e-worker-single-main-78301f-trkvg\" (UID: \"89903431-4564-4ed3-a9f6-3c23eb3c46be\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-single-main-78301f-trkvg"
Oct 31 17:53:58.007471 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:53:58.007374    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/89903431-4564-4ed3-a9f6-3c23eb3c46be-maas-api-xks-ca\") pod \"maas-api-revoke-keys-e2e-worker-single-main-78301f-trkvg\" (UID: \"89903431-4564-4ed3-a9f6-3c23eb3c46be\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-single-main-78301f-trkvg"
Oct 31 17:53:58.007692 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:53:58.007477    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dpnzz\" (UniqueName: \"kubernetes.io/projected/89903431-4564-4ed3-a9f6-3c23eb3c46be-kube-api-access-dpnzz\") pod \"maas-api-revoke-keys-e2e-worker-single-main-78301f-trkvg\" (UID: \"89903431-4564-4ed3-a9f6-3c23eb3c46be\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-single-main-78301f-trkvg"
Oct 31 17:53:58.007692 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:53:58.007563    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/89903431-4564-4ed3-a9f6-3c23eb3c46be-maas-api-openshift-ca\") pod \"maas-api-revoke-keys-e2e-worker-single-main-78301f-trkvg\" (UID: \"89903431-4564-4ed3-a9f6-3c23eb3c46be\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-single-main-78301f-trkvg"
Oct 31 17:53:58.008288 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:53:58.008266    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/89903431-4564-4ed3-a9f6-3c23eb3c46be-maas-api-openshift-ca\") pod \"maas-api-revoke-keys-e2e-worker-single-main-78301f-trkvg\" (UID: \"89903431-4564-4ed3-a9f6-3c23eb3c46be\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-single-main-78301f-trkvg"
Oct 31 17:53:58.009788 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:53:58.009767    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/89903431-4564-4ed3-a9f6-3c23eb3c46be-maas-api-xks-ca\") pod \"maas-api-revoke-keys-e2e-worker-single-main-78301f-trkvg\" (UID: \"89903431-4564-4ed3-a9f6-3c23eb3c46be\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-single-main-78301f-trkvg"
Oct 31 17:53:58.026259 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:53:58.026228    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dpnzz\" (UniqueName: \"kubernetes.io/projected/89903431-4564-4ed3-a9f6-3c23eb3c46be-kube-api-access-dpnzz\") pod \"maas-api-revoke-keys-e2e-worker-single-main-78301f-trkvg\" (UID: \"89903431-4564-4ed3-a9f6-3c23eb3c46be\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-single-main-78301f-trkvg"
Oct 31 17:53:58.032859 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:53:58.032838    5003 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-single-main-78301f-trkvg"
Oct 31 17:53:58.331273 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:53:58.331232    5003 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-single-main-78301f-trkvg"]
Oct 31 17:53:58.334825 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:53:58.334795    5003 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod89903431_4564_4ed3_a9f6_3c23eb3c46be.slice/crio-4efb5d8372ab242cb45dc3dbf8ec276576985e75edc08834452b0f499cb2475d WatchSource:0}: Error finding container 4efb5d8372ab242cb45dc3dbf8ec276576985e75edc08834452b0f499cb2475d: Status 404 returned error can't find the container with id 4efb5d8372ab242cb45dc3dbf8ec276576985e75edc08834452b0f499cb2475d
Oct 31 17:53:58.650517 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:53:58.650439    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-single-main-78301f-trkvg" event={"ID":"89903431-4564-4ed3-a9f6-3c23eb3c46be","Type":"ContainerStarted","Data":"4efb5d8372ab242cb45dc3dbf8ec276576985e75edc08834452b0f499cb2475d"}
Oct 31 17:53:59.658245 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:53:59.658210    5003 generic.go:356] "Generic (PLEG): container finished" podID="89903431-4564-4ed3-a9f6-3c23eb3c46be" containerID="b4299aed4612f1bb8293242baa5ee2bc658f408d658c5915140b64f740c6325a" exitCode=0
Oct 31 17:53:59.658678 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:53:59.658301    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-single-main-78301f-trkvg" event={"ID":"89903431-4564-4ed3-a9f6-3c23eb3c46be","Type":"ContainerDied","Data":"b4299aed4612f1bb8293242baa5ee2bc658f408d658c5915140b64f740c6325a"}
Oct 31 17:54:00.796769 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:54:00.796745    5003 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-single-main-78301f-trkvg"
Oct 31 17:54:00.937844 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:54:00.937761    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/89903431-4564-4ed3-a9f6-3c23eb3c46be-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/89903431-4564-4ed3-a9f6-3c23eb3c46be-maas-api-openshift-ca\") pod \"89903431-4564-4ed3-a9f6-3c23eb3c46be\" (UID: \"89903431-4564-4ed3-a9f6-3c23eb3c46be\") "
Oct 31 17:54:00.937844 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:54:00.937823    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/89903431-4564-4ed3-a9f6-3c23eb3c46be-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/89903431-4564-4ed3-a9f6-3c23eb3c46be-maas-api-xks-ca\") pod \"89903431-4564-4ed3-a9f6-3c23eb3c46be\" (UID: \"89903431-4564-4ed3-a9f6-3c23eb3c46be\") "
Oct 31 17:54:00.938103 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:54:00.937852    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/89903431-4564-4ed3-a9f6-3c23eb3c46be-kube-api-access-dpnzz\" (UniqueName: \"kubernetes.io/projected/89903431-4564-4ed3-a9f6-3c23eb3c46be-kube-api-access-dpnzz\") pod \"89903431-4564-4ed3-a9f6-3c23eb3c46be\" (UID: \"89903431-4564-4ed3-a9f6-3c23eb3c46be\") "
Oct 31 17:54:00.938280 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:54:00.938251    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/89903431-4564-4ed3-a9f6-3c23eb3c46be-maas-api-openshift-ca" pod "89903431-4564-4ed3-a9f6-3c23eb3c46be" (UID: "89903431-4564-4ed3-a9f6-3c23eb3c46be"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 17:54:00.939965 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:54:00.939939    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/89903431-4564-4ed3-a9f6-3c23eb3c46be-maas-api-xks-ca" pod "89903431-4564-4ed3-a9f6-3c23eb3c46be" (UID: "89903431-4564-4ed3-a9f6-3c23eb3c46be"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 17:54:00.940070 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:54:00.940046    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/89903431-4564-4ed3-a9f6-3c23eb3c46be-kube-api-access-dpnzz" pod "89903431-4564-4ed3-a9f6-3c23eb3c46be" (UID: "89903431-4564-4ed3-a9f6-3c23eb3c46be"). InnerVolumeSpecName "kube-api-access-dpnzz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 17:54:01.039429 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:54:01.039392    5003 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/89903431-4564-4ed3-a9f6-3c23eb3c46be-maas-api-openshift-ca\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:54:01.039429 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:54:01.039424    5003 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/89903431-4564-4ed3-a9f6-3c23eb3c46be-maas-api-xks-ca\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:54:01.039429 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:54:01.039434    5003 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dpnzz\" (UniqueName: \"kubernetes.io/projected/89903431-4564-4ed3-a9f6-3c23eb3c46be-kube-api-access-dpnzz\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:54:01.671729 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:54:01.671687    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-single-main-78301f-trkvg" event={"ID":"89903431-4564-4ed3-a9f6-3c23eb3c46be","Type":"ContainerDied","Data":"4efb5d8372ab242cb45dc3dbf8ec276576985e75edc08834452b0f499cb2475d"}
Oct 31 17:54:01.671909 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:54:01.671775    5003 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4efb5d8372ab242cb45dc3dbf8ec276576985e75edc08834452b0f499cb2475d"
Oct 31 17:54:01.671909 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:54:01.671702    5003 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-single-main-78301f-trkvg"
Oct 31 17:54:10.220258 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:54:10.220214    5003 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-single-main-78301f-trkvg"]
Oct 31 17:54:10.230080 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:54:10.230050    5003 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-single-main-78301f-trkvg"]
Oct 31 17:54:10.331013 ip-10-0-138-17 kubenswrapper[5003]: E1031 17:54:10.330978    5003 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-tdzz5" containerName="extractor"
Oct 31 17:54:11.911869 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:54:11.909411    5003 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="89903431-4564-4ed3-a9f6-3c23eb3c46be" path="/var/lib/kubelet/pods/89903431-4564-4ed3-a9f6-3c23eb3c46be/volumes"
Oct 31 17:54:12.959480 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:54:12.959449    5003 scope.go:122] "RemoveContainer" containerID="03ff8ac40c761d92902f56bc9950837558d0a14e26073a4fe134a1313ff46c8a"
Oct 31 17:54:12.968904 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:54:12.968881    5003 scope.go:122] "RemoveContainer" containerID="2fc6cd959c1b84e93ab3eb114a3d30128e2b7ed2675d5f6562142671662df9ed"
Oct 31 17:54:12.977376 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:54:12.977351    5003 scope.go:122] "RemoveContainer" containerID="eda0ed7688b7824304312f213db9115c3890ca89df4ab7d5ee538ac0ea8546e9"
Oct 31 17:54:40.337033 ip-10-0-138-17 kubenswrapper[5003]: E1031 17:54:40.336972    5003 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-tdzz5" containerName="extractor"
Oct 31 17:55:01.354875 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:55:01.354786    5003 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-452b6d7b-xdjcq"]
Oct 31 17:55:01.355462 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:55:01.355447    5003 cpu_manager.go:414] "containerMap: removing container" podUID="89903431-4564-4ed3-a9f6-3c23eb3c46be" containerName="revoke-keys"
Oct 31 17:55:01.355551 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:55:01.355467    5003 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="89903431-4564-4ed3-a9f6-3c23eb3c46be" containerName="revoke-keys"
Oct 31 17:55:01.355609 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:55:01.355594    5003 memory_manager.go:365] "RemoveStaleState removing state" podUID="89903431-4564-4ed3-a9f6-3c23eb3c46be" containerName="revoke-keys"
Oct 31 17:55:01.359003 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:55:01.358980    5003 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-452b6d7b-xdjcq"
Oct 31 17:55:01.378145 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:55:01.378097    5003 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-452b6d7b-xdjcq"]
Oct 31 17:55:01.385240 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:55:01.385213    5003 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-mr9x2\""
Oct 31 17:55:01.386120 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:55:01.385458    5003 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\""
Oct 31 17:55:01.403880 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:55:01.403854    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bh5t9\" (UniqueName: \"kubernetes.io/projected/8edb0da0-e5b7-42a0-9048-5a44e93200fc-kube-api-access-bh5t9\") pod \"maas-api-revoke-sub-452b6d7b-xdjcq\" (UID: \"8edb0da0-e5b7-42a0-9048-5a44e93200fc\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-452b6d7b-xdjcq"
Oct 31 17:55:01.404032 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:55:01.403996    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/8edb0da0-e5b7-42a0-9048-5a44e93200fc-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-452b6d7b-xdjcq\" (UID: \"8edb0da0-e5b7-42a0-9048-5a44e93200fc\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-452b6d7b-xdjcq"
Oct 31 17:55:01.404107 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:55:01.404045    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/8edb0da0-e5b7-42a0-9048-5a44e93200fc-maas-api-xks-ca\") pod \"maas-api-revoke-sub-452b6d7b-xdjcq\" (UID: \"8edb0da0-e5b7-42a0-9048-5a44e93200fc\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-452b6d7b-xdjcq"
Oct 31 17:55:01.504708 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:55:01.504662    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/8edb0da0-e5b7-42a0-9048-5a44e93200fc-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-452b6d7b-xdjcq\" (UID: \"8edb0da0-e5b7-42a0-9048-5a44e93200fc\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-452b6d7b-xdjcq"
Oct 31 17:55:01.504915 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:55:01.504766    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/8edb0da0-e5b7-42a0-9048-5a44e93200fc-maas-api-xks-ca\") pod \"maas-api-revoke-sub-452b6d7b-xdjcq\" (UID: \"8edb0da0-e5b7-42a0-9048-5a44e93200fc\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-452b6d7b-xdjcq"
Oct 31 17:55:01.504915 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:55:01.504823    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bh5t9\" (UniqueName: \"kubernetes.io/projected/8edb0da0-e5b7-42a0-9048-5a44e93200fc-kube-api-access-bh5t9\") pod \"maas-api-revoke-sub-452b6d7b-xdjcq\" (UID: \"8edb0da0-e5b7-42a0-9048-5a44e93200fc\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-452b6d7b-xdjcq"
Oct 31 17:55:01.505504 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:55:01.505468    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/8edb0da0-e5b7-42a0-9048-5a44e93200fc-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-452b6d7b-xdjcq\" (UID: \"8edb0da0-e5b7-42a0-9048-5a44e93200fc\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-452b6d7b-xdjcq"
Oct 31 17:55:01.507427 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:55:01.507395    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/8edb0da0-e5b7-42a0-9048-5a44e93200fc-maas-api-xks-ca\") pod \"maas-api-revoke-sub-452b6d7b-xdjcq\" (UID: \"8edb0da0-e5b7-42a0-9048-5a44e93200fc\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-452b6d7b-xdjcq"
Oct 31 17:55:01.524837 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:55:01.524801    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bh5t9\" (UniqueName: \"kubernetes.io/projected/8edb0da0-e5b7-42a0-9048-5a44e93200fc-kube-api-access-bh5t9\") pod \"maas-api-revoke-sub-452b6d7b-xdjcq\" (UID: \"8edb0da0-e5b7-42a0-9048-5a44e93200fc\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-452b6d7b-xdjcq"
Oct 31 17:55:01.672882 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:55:01.672773    5003 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-452b6d7b-xdjcq"
Oct 31 17:55:01.984259 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:55:01.984172    5003 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-452b6d7b-xdjcq"]
Oct 31 17:55:01.989213 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:55:01.989164    5003 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8edb0da0_e5b7_42a0_9048_5a44e93200fc.slice/crio-053ecfe9ea4165283960f09e81a035e91e3b45ed27fdd22921d3b32241413f77 WatchSource:0}: Error finding container 053ecfe9ea4165283960f09e81a035e91e3b45ed27fdd22921d3b32241413f77: Status 404 returned error can't find the container with id 053ecfe9ea4165283960f09e81a035e91e3b45ed27fdd22921d3b32241413f77
Oct 31 17:55:02.149048 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:55:02.149012    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-452b6d7b-xdjcq" event={"ID":"8edb0da0-e5b7-42a0-9048-5a44e93200fc","Type":"ContainerStarted","Data":"053ecfe9ea4165283960f09e81a035e91e3b45ed27fdd22921d3b32241413f77"}
Oct 31 17:55:03.029291 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:55:03.029256    5003 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-b77c4fe8-4bt67"]
Oct 31 17:55:03.037909 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:55:03.037873    5003 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-b77c4fe8-4bt67"]
Oct 31 17:55:03.206588 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:55:03.206542    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-452b6d7b-xdjcq" event={"ID":"8edb0da0-e5b7-42a0-9048-5a44e93200fc","Type":"ContainerStarted","Data":"8e444420cf396cee04098ecf11a11f9c9b03209881157ac8bca2afcd72923309"}
Oct 31 17:55:03.267752 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:55:03.267692    5003 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-sub-452b6d7b-xdjcq" podStartSLOduration=2.267670998 podStartE2EDuration="2.267670998s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 17:55:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 17:55:03.266806553 +0000 UTC m=+1671.521661095" watchObservedRunningTime="2026-10-31 17:55:03.267670998 +0000 UTC m=+1671.522525540"
Oct 31 17:55:03.924813 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:55:03.924776    5003 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="c61d1c97-dec9-49fe-80c4-c787c798a827" path="/var/lib/kubelet/pods/c61d1c97-dec9-49fe-80c4-c787c798a827/volumes"
Oct 31 17:55:04.215457 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:55:04.215358    5003 generic.go:356] "Generic (PLEG): container finished" podID="8edb0da0-e5b7-42a0-9048-5a44e93200fc" containerID="8e444420cf396cee04098ecf11a11f9c9b03209881157ac8bca2afcd72923309" exitCode=0
Oct 31 17:55:04.215457 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:55:04.215435    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-452b6d7b-xdjcq" event={"ID":"8edb0da0-e5b7-42a0-9048-5a44e93200fc","Type":"ContainerDied","Data":"8e444420cf396cee04098ecf11a11f9c9b03209881157ac8bca2afcd72923309"}
Oct 31 17:55:05.363089 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:55:05.363063    5003 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-452b6d7b-xdjcq"
Oct 31 17:55:05.457017 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:55:05.456968    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/8edb0da0-e5b7-42a0-9048-5a44e93200fc-kube-api-access-bh5t9\" (UniqueName: \"kubernetes.io/projected/8edb0da0-e5b7-42a0-9048-5a44e93200fc-kube-api-access-bh5t9\") pod \"8edb0da0-e5b7-42a0-9048-5a44e93200fc\" (UID: \"8edb0da0-e5b7-42a0-9048-5a44e93200fc\") "
Oct 31 17:55:05.457017 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:55:05.457022    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/8edb0da0-e5b7-42a0-9048-5a44e93200fc-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/8edb0da0-e5b7-42a0-9048-5a44e93200fc-maas-api-xks-ca\") pod \"8edb0da0-e5b7-42a0-9048-5a44e93200fc\" (UID: \"8edb0da0-e5b7-42a0-9048-5a44e93200fc\") "
Oct 31 17:55:05.457225 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:55:05.457093    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/8edb0da0-e5b7-42a0-9048-5a44e93200fc-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/8edb0da0-e5b7-42a0-9048-5a44e93200fc-maas-api-openshift-ca\") pod \"8edb0da0-e5b7-42a0-9048-5a44e93200fc\" (UID: \"8edb0da0-e5b7-42a0-9048-5a44e93200fc\") "
Oct 31 17:55:05.457489 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:55:05.457463    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8edb0da0-e5b7-42a0-9048-5a44e93200fc-maas-api-openshift-ca" pod "8edb0da0-e5b7-42a0-9048-5a44e93200fc" (UID: "8edb0da0-e5b7-42a0-9048-5a44e93200fc"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 17:55:05.459080 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:55:05.459051    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8edb0da0-e5b7-42a0-9048-5a44e93200fc-maas-api-xks-ca" pod "8edb0da0-e5b7-42a0-9048-5a44e93200fc" (UID: "8edb0da0-e5b7-42a0-9048-5a44e93200fc"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 17:55:05.459164 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:55:05.459111    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8edb0da0-e5b7-42a0-9048-5a44e93200fc-kube-api-access-bh5t9" pod "8edb0da0-e5b7-42a0-9048-5a44e93200fc" (UID: "8edb0da0-e5b7-42a0-9048-5a44e93200fc"). InnerVolumeSpecName "kube-api-access-bh5t9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 17:55:05.557821 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:55:05.557793    5003 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bh5t9\" (UniqueName: \"kubernetes.io/projected/8edb0da0-e5b7-42a0-9048-5a44e93200fc-kube-api-access-bh5t9\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:55:05.557821 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:55:05.557820    5003 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/8edb0da0-e5b7-42a0-9048-5a44e93200fc-maas-api-xks-ca\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:55:05.558032 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:55:05.557830    5003 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/8edb0da0-e5b7-42a0-9048-5a44e93200fc-maas-api-openshift-ca\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:55:06.228521 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:55:06.228436    5003 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-452b6d7b-xdjcq"
Oct 31 17:55:06.228676 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:55:06.228444    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-452b6d7b-xdjcq" event={"ID":"8edb0da0-e5b7-42a0-9048-5a44e93200fc","Type":"ContainerDied","Data":"053ecfe9ea4165283960f09e81a035e91e3b45ed27fdd22921d3b32241413f77"}
Oct 31 17:55:06.228676 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:55:06.228551    5003 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="053ecfe9ea4165283960f09e81a035e91e3b45ed27fdd22921d3b32241413f77"
Oct 31 17:55:10.330587 ip-10-0-138-17 kubenswrapper[5003]: E1031 17:55:10.330553    5003 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-tdzz5" containerName="extractor"
Oct 31 17:55:13.008681 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:55:13.008636    5003 scope.go:122] "RemoveContainer" containerID="b43080276a55f3938663c6972add42431ca763fe0cef49e96a88c8d8e8b193f4"
Oct 31 17:55:13.018072 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:55:13.018050    5003 scope.go:122] "RemoveContainer" containerID="f14f9f6914e3edcc120e1cc53597b66a34a45149c39aea0e35d2735fa884a469"
Oct 31 17:55:13.026752 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:55:13.026731    5003 scope.go:122] "RemoveContainer" containerID="1c577956b5db99e496eb08716d6a48a6bf9f4e1582380ea172e2de9be08b3b0c"
Oct 31 17:55:18.412514 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:55:18.412477    5003 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-3e31a506-slg44"]
Oct 31 17:55:18.412960 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:55:18.412945    5003 cpu_manager.go:414] "containerMap: removing container" podUID="8edb0da0-e5b7-42a0-9048-5a44e93200fc" containerName="revoke-keys"
Oct 31 17:55:18.413008 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:55:18.412962    5003 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="8edb0da0-e5b7-42a0-9048-5a44e93200fc" containerName="revoke-keys"
Oct 31 17:55:18.413053 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:55:18.413042    5003 memory_manager.go:365] "RemoveStaleState removing state" podUID="8edb0da0-e5b7-42a0-9048-5a44e93200fc" containerName="revoke-keys"
Oct 31 17:55:18.418387 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:55:18.418362    5003 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-3e31a506-slg44"
Oct 31 17:55:18.434051 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:55:18.434020    5003 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-3e31a506-slg44"]
Oct 31 17:55:18.442336 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:55:18.442311    5003 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\""
Oct 31 17:55:18.442515 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:55:18.442343    5003 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-mr9x2\""
Oct 31 17:55:18.518000 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:55:18.517969    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mjlx5\" (UniqueName: \"kubernetes.io/projected/645e3fca-7508-4f09-b9df-970054c2d644-kube-api-access-mjlx5\") pod \"maas-api-revoke-sub-3e31a506-slg44\" (UID: \"645e3fca-7508-4f09-b9df-970054c2d644\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-3e31a506-slg44"
Oct 31 17:55:18.518178 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:55:18.518151    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/645e3fca-7508-4f09-b9df-970054c2d644-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-3e31a506-slg44\" (UID: \"645e3fca-7508-4f09-b9df-970054c2d644\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-3e31a506-slg44"
Oct 31 17:55:18.518225 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:55:18.518202    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/645e3fca-7508-4f09-b9df-970054c2d644-maas-api-xks-ca\") pod \"maas-api-revoke-sub-3e31a506-slg44\" (UID: \"645e3fca-7508-4f09-b9df-970054c2d644\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-3e31a506-slg44"
Oct 31 17:55:18.619372 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:55:18.619338    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/645e3fca-7508-4f09-b9df-970054c2d644-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-3e31a506-slg44\" (UID: \"645e3fca-7508-4f09-b9df-970054c2d644\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-3e31a506-slg44"
Oct 31 17:55:18.619372 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:55:18.619375    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/645e3fca-7508-4f09-b9df-970054c2d644-maas-api-xks-ca\") pod \"maas-api-revoke-sub-3e31a506-slg44\" (UID: \"645e3fca-7508-4f09-b9df-970054c2d644\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-3e31a506-slg44"
Oct 31 17:55:18.619601 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:55:18.619407    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mjlx5\" (UniqueName: \"kubernetes.io/projected/645e3fca-7508-4f09-b9df-970054c2d644-kube-api-access-mjlx5\") pod \"maas-api-revoke-sub-3e31a506-slg44\" (UID: \"645e3fca-7508-4f09-b9df-970054c2d644\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-3e31a506-slg44"
Oct 31 17:55:18.619978 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:55:18.619956    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/645e3fca-7508-4f09-b9df-970054c2d644-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-3e31a506-slg44\" (UID: \"645e3fca-7508-4f09-b9df-970054c2d644\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-3e31a506-slg44"
Oct 31 17:55:18.621775 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:55:18.621747    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/645e3fca-7508-4f09-b9df-970054c2d644-maas-api-xks-ca\") pod \"maas-api-revoke-sub-3e31a506-slg44\" (UID: \"645e3fca-7508-4f09-b9df-970054c2d644\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-3e31a506-slg44"
Oct 31 17:55:18.637883 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:55:18.637851    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mjlx5\" (UniqueName: \"kubernetes.io/projected/645e3fca-7508-4f09-b9df-970054c2d644-kube-api-access-mjlx5\") pod \"maas-api-revoke-sub-3e31a506-slg44\" (UID: \"645e3fca-7508-4f09-b9df-970054c2d644\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-3e31a506-slg44"
Oct 31 17:55:18.731309 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:55:18.731238    5003 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-3e31a506-slg44"
Oct 31 17:55:19.028147 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:55:19.028068    5003 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-3e31a506-slg44"]
Oct 31 17:55:19.338849 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:55:19.338807    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-3e31a506-slg44" event={"ID":"645e3fca-7508-4f09-b9df-970054c2d644","Type":"ContainerStarted","Data":"4e8a0bd879865996d73335cc029b2046a25530880333d3d1b070ec79a69b2a41"}
Oct 31 17:55:20.346032 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:55:20.345993    5003 generic.go:356] "Generic (PLEG): container finished" podID="645e3fca-7508-4f09-b9df-970054c2d644" containerID="de1542cbad8da571c9e4b828494148120898f0ec6db2341a37181e57608bd0d6" exitCode=0
Oct 31 17:55:20.346419 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:55:20.346076    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-3e31a506-slg44" event={"ID":"645e3fca-7508-4f09-b9df-970054c2d644","Type":"ContainerDied","Data":"de1542cbad8da571c9e4b828494148120898f0ec6db2341a37181e57608bd0d6"}
Oct 31 17:55:21.580198 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:55:21.580174    5003 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-3e31a506-slg44"
Oct 31 17:55:21.678678 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:55:21.678574    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/645e3fca-7508-4f09-b9df-970054c2d644-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/645e3fca-7508-4f09-b9df-970054c2d644-maas-api-openshift-ca\") pod \"645e3fca-7508-4f09-b9df-970054c2d644\" (UID: \"645e3fca-7508-4f09-b9df-970054c2d644\") "
Oct 31 17:55:21.678678 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:55:21.678610    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/645e3fca-7508-4f09-b9df-970054c2d644-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/645e3fca-7508-4f09-b9df-970054c2d644-maas-api-xks-ca\") pod \"645e3fca-7508-4f09-b9df-970054c2d644\" (UID: \"645e3fca-7508-4f09-b9df-970054c2d644\") "
Oct 31 17:55:21.678931 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:55:21.678750    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/645e3fca-7508-4f09-b9df-970054c2d644-kube-api-access-mjlx5\" (UniqueName: \"kubernetes.io/projected/645e3fca-7508-4f09-b9df-970054c2d644-kube-api-access-mjlx5\") pod \"645e3fca-7508-4f09-b9df-970054c2d644\" (UID: \"645e3fca-7508-4f09-b9df-970054c2d644\") "
Oct 31 17:55:21.679033 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:55:21.679007    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/645e3fca-7508-4f09-b9df-970054c2d644-maas-api-openshift-ca" pod "645e3fca-7508-4f09-b9df-970054c2d644" (UID: "645e3fca-7508-4f09-b9df-970054c2d644"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 17:55:21.679192 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:55:21.679160    5003 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/645e3fca-7508-4f09-b9df-970054c2d644-maas-api-openshift-ca\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:55:21.681009 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:55:21.680983    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/645e3fca-7508-4f09-b9df-970054c2d644-maas-api-xks-ca" pod "645e3fca-7508-4f09-b9df-970054c2d644" (UID: "645e3fca-7508-4f09-b9df-970054c2d644"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 17:55:21.681121 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:55:21.681010    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/645e3fca-7508-4f09-b9df-970054c2d644-kube-api-access-mjlx5" pod "645e3fca-7508-4f09-b9df-970054c2d644" (UID: "645e3fca-7508-4f09-b9df-970054c2d644"). InnerVolumeSpecName "kube-api-access-mjlx5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 17:55:21.780611 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:55:21.780570    5003 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mjlx5\" (UniqueName: \"kubernetes.io/projected/645e3fca-7508-4f09-b9df-970054c2d644-kube-api-access-mjlx5\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:55:21.780611 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:55:21.780607    5003 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/645e3fca-7508-4f09-b9df-970054c2d644-maas-api-xks-ca\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:55:22.359104 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:55:22.359073    5003 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-3e31a506-slg44"
Oct 31 17:55:22.359104 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:55:22.359087    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-3e31a506-slg44" event={"ID":"645e3fca-7508-4f09-b9df-970054c2d644","Type":"ContainerDied","Data":"4e8a0bd879865996d73335cc029b2046a25530880333d3d1b070ec79a69b2a41"}
Oct 31 17:55:22.359306 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:55:22.359175    5003 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4e8a0bd879865996d73335cc029b2046a25530880333d3d1b070ec79a69b2a41"
Oct 31 17:55:36.027640 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:55:36.027602    5003 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-4v8x6"]
Oct 31 17:55:36.037288 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:55:36.037261    5003 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-4v8x6"]
Oct 31 17:55:37.888153 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:55:37.888119    5003 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="dcb1e833-016f-4046-a957-37b68adb9d09" path="/var/lib/kubelet/pods/dcb1e833-016f-4046-a957-37b68adb9d09/volumes"
Oct 31 17:55:40.330386 ip-10-0-138-17 kubenswrapper[5003]: E1031 17:55:40.330343    5003 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-tdzz5" containerName="extractor"
Oct 31 17:55:41.710141 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:55:41.710105    5003 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-0345ff62-k9v59"]
Oct 31 17:55:41.710554 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:55:41.710540    5003 cpu_manager.go:414] "containerMap: removing container" podUID="645e3fca-7508-4f09-b9df-970054c2d644" containerName="revoke-keys"
Oct 31 17:55:41.710554 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:55:41.710554    5003 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="645e3fca-7508-4f09-b9df-970054c2d644" containerName="revoke-keys"
Oct 31 17:55:41.710637 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:55:41.710620    5003 memory_manager.go:365] "RemoveStaleState removing state" podUID="645e3fca-7508-4f09-b9df-970054c2d644" containerName="revoke-keys"
Oct 31 17:55:41.713909 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:55:41.713887    5003 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-0345ff62-k9v59"
Oct 31 17:55:41.728245 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:55:41.728226    5003 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\""
Oct 31 17:55:41.731686 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:55:41.731663    5003 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-0345ff62-k9v59"]
Oct 31 17:55:41.740222 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:55:41.740199    5003 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-mr9x2\""
Oct 31 17:55:41.808109 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:55:41.808078    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/eee1be58-4a01-4002-9830-b7926525b564-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-0345ff62-k9v59\" (UID: \"eee1be58-4a01-4002-9830-b7926525b564\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-0345ff62-k9v59"
Oct 31 17:55:41.808257 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:55:41.808148    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/eee1be58-4a01-4002-9830-b7926525b564-maas-api-xks-ca\") pod \"maas-api-revoke-sub-0345ff62-k9v59\" (UID: \"eee1be58-4a01-4002-9830-b7926525b564\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-0345ff62-k9v59"
Oct 31 17:55:41.808257 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:55:41.808219    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-plx9g\" (UniqueName: \"kubernetes.io/projected/eee1be58-4a01-4002-9830-b7926525b564-kube-api-access-plx9g\") pod \"maas-api-revoke-sub-0345ff62-k9v59\" (UID: \"eee1be58-4a01-4002-9830-b7926525b564\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-0345ff62-k9v59"
Oct 31 17:55:41.909666 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:55:41.909606    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-plx9g\" (UniqueName: \"kubernetes.io/projected/eee1be58-4a01-4002-9830-b7926525b564-kube-api-access-plx9g\") pod \"maas-api-revoke-sub-0345ff62-k9v59\" (UID: \"eee1be58-4a01-4002-9830-b7926525b564\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-0345ff62-k9v59"
Oct 31 17:55:41.909848 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:55:41.909748    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/eee1be58-4a01-4002-9830-b7926525b564-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-0345ff62-k9v59\" (UID: \"eee1be58-4a01-4002-9830-b7926525b564\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-0345ff62-k9v59"
Oct 31 17:55:41.909848 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:55:41.909819    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/eee1be58-4a01-4002-9830-b7926525b564-maas-api-xks-ca\") pod \"maas-api-revoke-sub-0345ff62-k9v59\" (UID: \"eee1be58-4a01-4002-9830-b7926525b564\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-0345ff62-k9v59"
Oct 31 17:55:41.910397 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:55:41.910374    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/eee1be58-4a01-4002-9830-b7926525b564-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-0345ff62-k9v59\" (UID: \"eee1be58-4a01-4002-9830-b7926525b564\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-0345ff62-k9v59"
Oct 31 17:55:41.912181 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:55:41.912152    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/eee1be58-4a01-4002-9830-b7926525b564-maas-api-xks-ca\") pod \"maas-api-revoke-sub-0345ff62-k9v59\" (UID: \"eee1be58-4a01-4002-9830-b7926525b564\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-0345ff62-k9v59"
Oct 31 17:55:41.928074 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:55:41.928051    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-plx9g\" (UniqueName: \"kubernetes.io/projected/eee1be58-4a01-4002-9830-b7926525b564-kube-api-access-plx9g\") pod \"maas-api-revoke-sub-0345ff62-k9v59\" (UID: \"eee1be58-4a01-4002-9830-b7926525b564\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-0345ff62-k9v59"
Oct 31 17:55:42.027273 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:55:42.027140    5003 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-0345ff62-k9v59"
Oct 31 17:55:42.322328 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:55:42.322293    5003 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-0345ff62-k9v59"]
Oct 31 17:55:42.325680 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:55:42.325616    5003 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeee1be58_4a01_4002_9830_b7926525b564.slice/crio-9bbce7beddd4ca98b5a108ce5837ac7c892d5b917592eb7d24c17b33fa29c773 WatchSource:0}: Error finding container 9bbce7beddd4ca98b5a108ce5837ac7c892d5b917592eb7d24c17b33fa29c773: Status 404 returned error can't find the container with id 9bbce7beddd4ca98b5a108ce5837ac7c892d5b917592eb7d24c17b33fa29c773
Oct 31 17:55:42.499721 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:55:42.499688    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-0345ff62-k9v59" event={"ID":"eee1be58-4a01-4002-9830-b7926525b564","Type":"ContainerStarted","Data":"9bbce7beddd4ca98b5a108ce5837ac7c892d5b917592eb7d24c17b33fa29c773"}
Oct 31 17:55:43.507335 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:55:43.507234    5003 generic.go:356] "Generic (PLEG): container finished" podID="eee1be58-4a01-4002-9830-b7926525b564" containerID="7549a6e0a187148dda557b3c63c260a2d102f553b47f2d281fd6f47dac349208" exitCode=0
Oct 31 17:55:43.507335 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:55:43.507315    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-0345ff62-k9v59" event={"ID":"eee1be58-4a01-4002-9830-b7926525b564","Type":"ContainerDied","Data":"7549a6e0a187148dda557b3c63c260a2d102f553b47f2d281fd6f47dac349208"}
Oct 31 17:55:44.655703 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:55:44.655671    5003 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-0345ff62-k9v59"
Oct 31 17:55:44.836719 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:55:44.836689    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/eee1be58-4a01-4002-9830-b7926525b564-kube-api-access-plx9g\" (UniqueName: \"kubernetes.io/projected/eee1be58-4a01-4002-9830-b7926525b564-kube-api-access-plx9g\") pod \"eee1be58-4a01-4002-9830-b7926525b564\" (UID: \"eee1be58-4a01-4002-9830-b7926525b564\") "
Oct 31 17:55:44.836931 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:55:44.836741    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/eee1be58-4a01-4002-9830-b7926525b564-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/eee1be58-4a01-4002-9830-b7926525b564-maas-api-xks-ca\") pod \"eee1be58-4a01-4002-9830-b7926525b564\" (UID: \"eee1be58-4a01-4002-9830-b7926525b564\") "
Oct 31 17:55:44.836931 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:55:44.836766    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/eee1be58-4a01-4002-9830-b7926525b564-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/eee1be58-4a01-4002-9830-b7926525b564-maas-api-openshift-ca\") pod \"eee1be58-4a01-4002-9830-b7926525b564\" (UID: \"eee1be58-4a01-4002-9830-b7926525b564\") "
Oct 31 17:55:44.837137 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:55:44.837113    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/eee1be58-4a01-4002-9830-b7926525b564-maas-api-openshift-ca" pod "eee1be58-4a01-4002-9830-b7926525b564" (UID: "eee1be58-4a01-4002-9830-b7926525b564"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 17:55:44.838877 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:55:44.838850    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/eee1be58-4a01-4002-9830-b7926525b564-maas-api-xks-ca" pod "eee1be58-4a01-4002-9830-b7926525b564" (UID: "eee1be58-4a01-4002-9830-b7926525b564"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 17:55:44.838984 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:55:44.838881    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eee1be58-4a01-4002-9830-b7926525b564-kube-api-access-plx9g" pod "eee1be58-4a01-4002-9830-b7926525b564" (UID: "eee1be58-4a01-4002-9830-b7926525b564"). InnerVolumeSpecName "kube-api-access-plx9g". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 17:55:44.938276 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:55:44.938241    5003 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-plx9g\" (UniqueName: \"kubernetes.io/projected/eee1be58-4a01-4002-9830-b7926525b564-kube-api-access-plx9g\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:55:44.938276 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:55:44.938272    5003 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/eee1be58-4a01-4002-9830-b7926525b564-maas-api-xks-ca\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:55:44.938462 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:55:44.938282    5003 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/eee1be58-4a01-4002-9830-b7926525b564-maas-api-openshift-ca\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:55:45.519913 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:55:45.519883    5003 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-0345ff62-k9v59"
Oct 31 17:55:45.520099 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:55:45.519976    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-0345ff62-k9v59" event={"ID":"eee1be58-4a01-4002-9830-b7926525b564","Type":"ContainerDied","Data":"9bbce7beddd4ca98b5a108ce5837ac7c892d5b917592eb7d24c17b33fa29c773"}
Oct 31 17:55:45.520099 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:55:45.520026    5003 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9bbce7beddd4ca98b5a108ce5837ac7c892d5b917592eb7d24c17b33fa29c773"
Oct 31 17:55:53.950606 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:55:53.950566    5003 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-7bb55cd9d-jd68n"]
Oct 31 17:55:53.951044 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:55:53.951009    5003 cpu_manager.go:414] "containerMap: removing container" podUID="eee1be58-4a01-4002-9830-b7926525b564" containerName="revoke-keys"
Oct 31 17:55:53.951044 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:55:53.951022    5003 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="eee1be58-4a01-4002-9830-b7926525b564" containerName="revoke-keys"
Oct 31 17:55:53.951123 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:55:53.951110    5003 memory_manager.go:365] "RemoveStaleState removing state" podUID="eee1be58-4a01-4002-9830-b7926525b564" containerName="revoke-keys"
Oct 31 17:55:53.954605 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:55:53.954578    5003 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-7bb55cd9d-jd68n"
Oct 31 17:55:53.983955 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:55:53.983921    5003 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-4s8xz\""
Oct 31 17:55:53.984137 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:55:53.984042    5003 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Oct 31 17:55:53.984216 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:55:53.984172    5003 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Oct 31 17:55:53.986766 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:55:53.986739    5003 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-7bb55cd9d-jd68n"]
Oct 31 17:55:54.020539 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:55:54.020506    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qdr49\" (UniqueName: \"kubernetes.io/projected/f6a9c117-c010-4e65-964d-6ac6b6ecbfc5-kube-api-access-qdr49\") pod \"maas-api-7bb55cd9d-jd68n\" (UID: \"f6a9c117-c010-4e65-964d-6ac6b6ecbfc5\") " pod="odh-ai-gateway-infra/maas-api-7bb55cd9d-jd68n"
Oct 31 17:55:54.020742 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:55:54.020618    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f6a9c117-c010-4e65-964d-6ac6b6ecbfc5-openshift-service-ca\") pod \"maas-api-7bb55cd9d-jd68n\" (UID: \"f6a9c117-c010-4e65-964d-6ac6b6ecbfc5\") " pod="odh-ai-gateway-infra/maas-api-7bb55cd9d-jd68n"
Oct 31 17:55:54.020742 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:55:54.020729    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f6a9c117-c010-4e65-964d-6ac6b6ecbfc5-maas-api-tls\") pod \"maas-api-7bb55cd9d-jd68n\" (UID: \"f6a9c117-c010-4e65-964d-6ac6b6ecbfc5\") " pod="odh-ai-gateway-infra/maas-api-7bb55cd9d-jd68n"
Oct 31 17:55:54.020848 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:55:54.020786    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f6a9c117-c010-4e65-964d-6ac6b6ecbfc5-metrics-certs\") pod \"maas-api-7bb55cd9d-jd68n\" (UID: \"f6a9c117-c010-4e65-964d-6ac6b6ecbfc5\") " pod="odh-ai-gateway-infra/maas-api-7bb55cd9d-jd68n"
Oct 31 17:55:54.121330 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:55:54.121294    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f6a9c117-c010-4e65-964d-6ac6b6ecbfc5-metrics-certs\") pod \"maas-api-7bb55cd9d-jd68n\" (UID: \"f6a9c117-c010-4e65-964d-6ac6b6ecbfc5\") " pod="odh-ai-gateway-infra/maas-api-7bb55cd9d-jd68n"
Oct 31 17:55:54.121523 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:55:54.121355    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qdr49\" (UniqueName: \"kubernetes.io/projected/f6a9c117-c010-4e65-964d-6ac6b6ecbfc5-kube-api-access-qdr49\") pod \"maas-api-7bb55cd9d-jd68n\" (UID: \"f6a9c117-c010-4e65-964d-6ac6b6ecbfc5\") " pod="odh-ai-gateway-infra/maas-api-7bb55cd9d-jd68n"
Oct 31 17:55:54.121523 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:55:54.121378    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f6a9c117-c010-4e65-964d-6ac6b6ecbfc5-openshift-service-ca\") pod \"maas-api-7bb55cd9d-jd68n\" (UID: \"f6a9c117-c010-4e65-964d-6ac6b6ecbfc5\") " pod="odh-ai-gateway-infra/maas-api-7bb55cd9d-jd68n"
Oct 31 17:55:54.121523 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:55:54.121416    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f6a9c117-c010-4e65-964d-6ac6b6ecbfc5-maas-api-tls\") pod \"maas-api-7bb55cd9d-jd68n\" (UID: \"f6a9c117-c010-4e65-964d-6ac6b6ecbfc5\") " pod="odh-ai-gateway-infra/maas-api-7bb55cd9d-jd68n"
Oct 31 17:55:54.122180 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:55:54.122155    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f6a9c117-c010-4e65-964d-6ac6b6ecbfc5-openshift-service-ca\") pod \"maas-api-7bb55cd9d-jd68n\" (UID: \"f6a9c117-c010-4e65-964d-6ac6b6ecbfc5\") " pod="odh-ai-gateway-infra/maas-api-7bb55cd9d-jd68n"
Oct 31 17:55:54.123855 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:55:54.123833    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f6a9c117-c010-4e65-964d-6ac6b6ecbfc5-maas-api-tls\") pod \"maas-api-7bb55cd9d-jd68n\" (UID: \"f6a9c117-c010-4e65-964d-6ac6b6ecbfc5\") " pod="odh-ai-gateway-infra/maas-api-7bb55cd9d-jd68n"
Oct 31 17:55:54.123941 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:55:54.123907    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f6a9c117-c010-4e65-964d-6ac6b6ecbfc5-metrics-certs\") pod \"maas-api-7bb55cd9d-jd68n\" (UID: \"f6a9c117-c010-4e65-964d-6ac6b6ecbfc5\") " pod="odh-ai-gateway-infra/maas-api-7bb55cd9d-jd68n"
Oct 31 17:55:54.139695 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:55:54.139671    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qdr49\" (UniqueName: \"kubernetes.io/projected/f6a9c117-c010-4e65-964d-6ac6b6ecbfc5-kube-api-access-qdr49\") pod \"maas-api-7bb55cd9d-jd68n\" (UID: \"f6a9c117-c010-4e65-964d-6ac6b6ecbfc5\") " pod="odh-ai-gateway-infra/maas-api-7bb55cd9d-jd68n"
Oct 31 17:55:54.268423 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:55:54.268345    5003 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-7bb55cd9d-jd68n"
Oct 31 17:55:54.567504 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:55:54.567475    5003 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-7bb55cd9d-jd68n"]
Oct 31 17:55:54.570394 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:55:54.570363    5003 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf6a9c117_c010_4e65_964d_6ac6b6ecbfc5.slice/crio-8b41f747d88b6e8a60cf75aa0b0aed3d300e099182daf04243b8877decde8df3 WatchSource:0}: Error finding container 8b41f747d88b6e8a60cf75aa0b0aed3d300e099182daf04243b8877decde8df3: Status 404 returned error can't find the container with id 8b41f747d88b6e8a60cf75aa0b0aed3d300e099182daf04243b8877decde8df3
Oct 31 17:55:54.571877 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:55:54.571857    5003 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Oct 31 17:55:55.579348 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:55:55.579312    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-7bb55cd9d-jd68n" event={"ID":"f6a9c117-c010-4e65-964d-6ac6b6ecbfc5","Type":"ContainerStarted","Data":"aada8ef6a16032fb3d805c36d97b688e13d12f6cc8fdd0c5614772023e8908f0"}
Oct 31 17:55:55.579788 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:55:55.579365    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-7bb55cd9d-jd68n" event={"ID":"f6a9c117-c010-4e65-964d-6ac6b6ecbfc5","Type":"ContainerStarted","Data":"8b41f747d88b6e8a60cf75aa0b0aed3d300e099182daf04243b8877decde8df3"}
Oct 31 17:55:55.579788 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:55:55.579531    5003 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-7bb55cd9d-jd68n"
Oct 31 17:55:55.617100 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:55:55.617051    5003 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-7bb55cd9d-jd68n" podStartSLOduration=2.203069689 podStartE2EDuration="2.61703525s" totalImagesPullingTime="413.965561ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 17:55:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 17:55:55.616356598 +0000 UTC m=+1723.871211138" watchObservedRunningTime="2026-10-31 17:55:55.61703525 +0000 UTC m=+1723.871889790"
Oct 31 17:56:01.482441 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:56:01.482404    5003 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-7bb55cd9d-jd68n"]
Oct 31 17:56:01.482938 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:56:01.482726    5003 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-7bb55cd9d-jd68n" podUID="f6a9c117-c010-4e65-964d-6ac6b6ecbfc5" containerName="maas-api" containerID="cri-o://aada8ef6a16032fb3d805c36d97b688e13d12f6cc8fdd0c5614772023e8908f0" gracePeriod=30
Oct 31 17:56:01.489007 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:56:01.488983    5003 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-7bb55cd9d-jd68n"
Oct 31 17:56:01.510604 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:56:01.510570    5003 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-f5575fb46-tp6hn"]
Oct 31 17:56:01.514298 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:56:01.514277    5003 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-f5575fb46-tp6hn"
Oct 31 17:56:01.536841 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:56:01.536801    5003 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-f5575fb46-tp6hn"]
Oct 31 17:56:01.604540 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:56:01.604490    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f0697a62-9465-4344-b027-df612f19d387-maas-api-tls\") pod \"maas-api-f5575fb46-tp6hn\" (UID: \"f0697a62-9465-4344-b027-df612f19d387\") " pod="odh-ai-gateway-infra/maas-api-f5575fb46-tp6hn"
Oct 31 17:56:01.604690 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:56:01.604613    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f0697a62-9465-4344-b027-df612f19d387-openshift-service-ca\") pod \"maas-api-f5575fb46-tp6hn\" (UID: \"f0697a62-9465-4344-b027-df612f19d387\") " pod="odh-ai-gateway-infra/maas-api-f5575fb46-tp6hn"
Oct 31 17:56:01.604785 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:56:01.604759    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f0697a62-9465-4344-b027-df612f19d387-metrics-certs\") pod \"maas-api-f5575fb46-tp6hn\" (UID: \"f0697a62-9465-4344-b027-df612f19d387\") " pod="odh-ai-gateway-infra/maas-api-f5575fb46-tp6hn"
Oct 31 17:56:01.604913 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:56:01.604893    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-92xwn\" (UniqueName: \"kubernetes.io/projected/f0697a62-9465-4344-b027-df612f19d387-kube-api-access-92xwn\") pod \"maas-api-f5575fb46-tp6hn\" (UID: \"f0697a62-9465-4344-b027-df612f19d387\") " pod="odh-ai-gateway-infra/maas-api-f5575fb46-tp6hn"
Oct 31 17:56:01.615067 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:56:01.615038    5003 generic.go:356] "Generic (PLEG): container finished" podID="f6a9c117-c010-4e65-964d-6ac6b6ecbfc5" containerID="aada8ef6a16032fb3d805c36d97b688e13d12f6cc8fdd0c5614772023e8908f0" exitCode=0
Oct 31 17:56:01.615231 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:56:01.615112    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-7bb55cd9d-jd68n" event={"ID":"f6a9c117-c010-4e65-964d-6ac6b6ecbfc5","Type":"ContainerDied","Data":"aada8ef6a16032fb3d805c36d97b688e13d12f6cc8fdd0c5614772023e8908f0"}
Oct 31 17:56:01.705817 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:56:01.705779    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f0697a62-9465-4344-b027-df612f19d387-maas-api-tls\") pod \"maas-api-f5575fb46-tp6hn\" (UID: \"f0697a62-9465-4344-b027-df612f19d387\") " pod="odh-ai-gateway-infra/maas-api-f5575fb46-tp6hn"
Oct 31 17:56:01.705817 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:56:01.705826    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f0697a62-9465-4344-b027-df612f19d387-openshift-service-ca\") pod \"maas-api-f5575fb46-tp6hn\" (UID: \"f0697a62-9465-4344-b027-df612f19d387\") " pod="odh-ai-gateway-infra/maas-api-f5575fb46-tp6hn"
Oct 31 17:56:01.706108 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:56:01.705884    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f0697a62-9465-4344-b027-df612f19d387-metrics-certs\") pod \"maas-api-f5575fb46-tp6hn\" (UID: \"f0697a62-9465-4344-b027-df612f19d387\") " pod="odh-ai-gateway-infra/maas-api-f5575fb46-tp6hn"
Oct 31 17:56:01.706108 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:56:01.705981    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-92xwn\" (UniqueName: \"kubernetes.io/projected/f0697a62-9465-4344-b027-df612f19d387-kube-api-access-92xwn\") pod \"maas-api-f5575fb46-tp6hn\" (UID: \"f0697a62-9465-4344-b027-df612f19d387\") " pod="odh-ai-gateway-infra/maas-api-f5575fb46-tp6hn"
Oct 31 17:56:01.706698 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:56:01.706664    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f0697a62-9465-4344-b027-df612f19d387-openshift-service-ca\") pod \"maas-api-f5575fb46-tp6hn\" (UID: \"f0697a62-9465-4344-b027-df612f19d387\") " pod="odh-ai-gateway-infra/maas-api-f5575fb46-tp6hn"
Oct 31 17:56:01.708855 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:56:01.708832    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f0697a62-9465-4344-b027-df612f19d387-maas-api-tls\") pod \"maas-api-f5575fb46-tp6hn\" (UID: \"f0697a62-9465-4344-b027-df612f19d387\") " pod="odh-ai-gateway-infra/maas-api-f5575fb46-tp6hn"
Oct 31 17:56:01.709001 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:56:01.708978    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f0697a62-9465-4344-b027-df612f19d387-metrics-certs\") pod \"maas-api-f5575fb46-tp6hn\" (UID: \"f0697a62-9465-4344-b027-df612f19d387\") " pod="odh-ai-gateway-infra/maas-api-f5575fb46-tp6hn"
Oct 31 17:56:01.724723 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:56:01.724698    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-92xwn\" (UniqueName: \"kubernetes.io/projected/f0697a62-9465-4344-b027-df612f19d387-kube-api-access-92xwn\") pod \"maas-api-f5575fb46-tp6hn\" (UID: \"f0697a62-9465-4344-b027-df612f19d387\") " pod="odh-ai-gateway-infra/maas-api-f5575fb46-tp6hn"
Oct 31 17:56:01.744540 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:56:01.744480    5003 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-7bb55cd9d-jd68n"
Oct 31 17:56:01.806855 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:56:01.806818    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/f6a9c117-c010-4e65-964d-6ac6b6ecbfc5-metrics-certs\" (UniqueName: \"kubernetes.io/secret/f6a9c117-c010-4e65-964d-6ac6b6ecbfc5-metrics-certs\") pod \"f6a9c117-c010-4e65-964d-6ac6b6ecbfc5\" (UID: \"f6a9c117-c010-4e65-964d-6ac6b6ecbfc5\") "
Oct 31 17:56:01.807051 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:56:01.806902    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/f6a9c117-c010-4e65-964d-6ac6b6ecbfc5-kube-api-access-qdr49\" (UniqueName: \"kubernetes.io/projected/f6a9c117-c010-4e65-964d-6ac6b6ecbfc5-kube-api-access-qdr49\") pod \"f6a9c117-c010-4e65-964d-6ac6b6ecbfc5\" (UID: \"f6a9c117-c010-4e65-964d-6ac6b6ecbfc5\") "
Oct 31 17:56:01.807051 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:56:01.807010    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/f6a9c117-c010-4e65-964d-6ac6b6ecbfc5-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f6a9c117-c010-4e65-964d-6ac6b6ecbfc5-maas-api-tls\") pod \"f6a9c117-c010-4e65-964d-6ac6b6ecbfc5\" (UID: \"f6a9c117-c010-4e65-964d-6ac6b6ecbfc5\") "
Oct 31 17:56:01.807182 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:56:01.807053    5003 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/f6a9c117-c010-4e65-964d-6ac6b6ecbfc5-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f6a9c117-c010-4e65-964d-6ac6b6ecbfc5-openshift-service-ca\") pod \"f6a9c117-c010-4e65-964d-6ac6b6ecbfc5\" (UID: \"f6a9c117-c010-4e65-964d-6ac6b6ecbfc5\") "
Oct 31 17:56:01.807453 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:56:01.807423    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f6a9c117-c010-4e65-964d-6ac6b6ecbfc5-openshift-service-ca" pod "f6a9c117-c010-4e65-964d-6ac6b6ecbfc5" (UID: "f6a9c117-c010-4e65-964d-6ac6b6ecbfc5"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 17:56:01.809042 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:56:01.809011    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f6a9c117-c010-4e65-964d-6ac6b6ecbfc5-kube-api-access-qdr49" pod "f6a9c117-c010-4e65-964d-6ac6b6ecbfc5" (UID: "f6a9c117-c010-4e65-964d-6ac6b6ecbfc5"). InnerVolumeSpecName "kube-api-access-qdr49". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 17:56:01.809160 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:56:01.809102    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f6a9c117-c010-4e65-964d-6ac6b6ecbfc5-maas-api-tls" pod "f6a9c117-c010-4e65-964d-6ac6b6ecbfc5" (UID: "f6a9c117-c010-4e65-964d-6ac6b6ecbfc5"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 17:56:01.809333 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:56:01.809313    5003 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f6a9c117-c010-4e65-964d-6ac6b6ecbfc5-metrics-certs" pod "f6a9c117-c010-4e65-964d-6ac6b6ecbfc5" (UID: "f6a9c117-c010-4e65-964d-6ac6b6ecbfc5"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 17:56:01.870153 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:56:01.870115    5003 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-f5575fb46-tp6hn"
Oct 31 17:56:01.907957 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:56:01.907927    5003 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f6a9c117-c010-4e65-964d-6ac6b6ecbfc5-openshift-service-ca\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:56:01.907957 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:56:01.907956    5003 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f6a9c117-c010-4e65-964d-6ac6b6ecbfc5-metrics-certs\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:56:01.908146 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:56:01.907966    5003 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qdr49\" (UniqueName: \"kubernetes.io/projected/f6a9c117-c010-4e65-964d-6ac6b6ecbfc5-kube-api-access-qdr49\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:56:01.908146 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:56:01.907976    5003 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f6a9c117-c010-4e65-964d-6ac6b6ecbfc5-maas-api-tls\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\""
Oct 31 17:56:02.174149 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:56:02.174117    5003 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-f5575fb46-tp6hn"]
Oct 31 17:56:02.177572 ip-10-0-138-17 kubenswrapper[5003]: W1031 17:56:02.177548    5003 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf0697a62_9465_4344_b027_df612f19d387.slice/crio-b110d52a7984f44fbbd4a0fa09972b845c8e7bb5cb53b5fc01ffa72511caf527 WatchSource:0}: Error finding container b110d52a7984f44fbbd4a0fa09972b845c8e7bb5cb53b5fc01ffa72511caf527: Status 404 returned error can't find the container with id b110d52a7984f44fbbd4a0fa09972b845c8e7bb5cb53b5fc01ffa72511caf527
Oct 31 17:56:02.626229 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:56:02.626185    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-f5575fb46-tp6hn" event={"ID":"f0697a62-9465-4344-b027-df612f19d387","Type":"ContainerStarted","Data":"658cf944ef9736a34b57d55aa2dd24efb6c3625ddc053da81cc5ee501ee48d88"}
Oct 31 17:56:02.626658 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:56:02.626289    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-f5575fb46-tp6hn" event={"ID":"f0697a62-9465-4344-b027-df612f19d387","Type":"ContainerStarted","Data":"b110d52a7984f44fbbd4a0fa09972b845c8e7bb5cb53b5fc01ffa72511caf527"}
Oct 31 17:56:02.626658 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:56:02.626321    5003 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-f5575fb46-tp6hn"
Oct 31 17:56:02.627470 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:56:02.627447    5003 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-7bb55cd9d-jd68n"
Oct 31 17:56:02.627695 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:56:02.627471    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-7bb55cd9d-jd68n" event={"ID":"f6a9c117-c010-4e65-964d-6ac6b6ecbfc5","Type":"ContainerDied","Data":"8b41f747d88b6e8a60cf75aa0b0aed3d300e099182daf04243b8877decde8df3"}
Oct 31 17:56:02.627695 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:56:02.627522    5003 scope.go:122] "RemoveContainer" containerID="aada8ef6a16032fb3d805c36d97b688e13d12f6cc8fdd0c5614772023e8908f0"
Oct 31 17:56:02.664499 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:56:02.664435    5003 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-f5575fb46-tp6hn" podStartSLOduration=1.354684461 podStartE2EDuration="1.664420055s" totalImagesPullingTime="309.735594ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 17:56:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 17:56:02.663300596 +0000 UTC m=+1730.918155135" watchObservedRunningTime="2026-10-31 17:56:02.664420055 +0000 UTC m=+1730.919274596"
Oct 31 17:56:02.698047 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:56:02.698012    5003 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-7bb55cd9d-jd68n"]
Oct 31 17:56:02.701801 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:56:02.701774    5003 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-7bb55cd9d-jd68n"]
Oct 31 17:56:03.889340 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:56:03.889307    5003 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="f6a9c117-c010-4e65-964d-6ac6b6ecbfc5" path="/var/lib/kubelet/pods/f6a9c117-c010-4e65-964d-6ac6b6ecbfc5/volumes"
Oct 31 17:56:08.639745 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:56:08.639718    5003 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-f5575fb46-tp6hn"
Oct 31 17:56:10.332727 ip-10-0-138-17 kubenswrapper[5003]: E1031 17:56:10.332689    5003 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-tdzz5" containerName="extractor"
Oct 31 17:56:13.057002 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:56:13.056965    5003 scope.go:122] "RemoveContainer" containerID="1581e3798f562eed6cc625b257e1c5fcc08dc7c44dc2db15f0dfca0bae030516"
Oct 31 17:56:13.066076 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:56:13.066054    5003 scope.go:122] "RemoveContainer" containerID="2733013a9c1ad5c9e2701c3c06f8c81361530f6209156fb7ca6f0c4db63a604c"
Oct 31 17:56:40.334024 ip-10-0-138-17 kubenswrapper[5003]: E1031 17:56:40.333984    5003 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-tdzz5" containerName="extractor"
Oct 31 17:57:10.331734 ip-10-0-138-17 kubenswrapper[5003]: E1031 17:57:10.331697    5003 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-tdzz5" containerName="extractor"
Oct 31 17:57:12.253910 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:57:12.253799    5003 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-b2xxw_f03611db-3bd9-401a-a137-1d4f691b51ea/console-operator/2.log"
Oct 31 17:57:12.256817 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:57:12.256795    5003 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-b2xxw_f03611db-3bd9-401a-a137-1d4f691b51ea/console-operator/2.log"
Oct 31 17:57:13.115803 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:57:13.115773    5003 scope.go:122] "RemoveContainer" containerID="3ed88384681a29921f470413842125b23ed38323901a4b2c89ea8b772d50f261"
Oct 31 17:57:25.025146 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:57:25.025107    5003 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-d576e68b-gxn26"]
Oct 31 17:57:25.036794 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:57:25.036760    5003 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-d576e68b-gxn26"]
Oct 31 17:57:25.888719 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:57:25.888689    5003 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="43616698-c7c7-4945-9f74-2e8b9e4d7ab3" path="/var/lib/kubelet/pods/43616698-c7c7-4945-9f74-2e8b9e4d7ab3/volumes"
Oct 31 17:57:40.330483 ip-10-0-138-17 kubenswrapper[5003]: E1031 17:57:40.330445    5003 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-tdzz5" containerName="extractor"
Oct 31 17:57:46.024849 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:57:46.024813    5003 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-d2bc93bc-xp9z6"]
Oct 31 17:57:46.036735 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:57:46.036708    5003 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-d2bc93bc-xp9z6"]
Oct 31 17:57:47.887827 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:57:47.887792    5003 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="a8b2dbb4-bc27-488d-b61a-0e972baa4a63" path="/var/lib/kubelet/pods/a8b2dbb4-bc27-488d-b61a-0e972baa4a63/volumes"
Oct 31 17:58:10.331054 ip-10-0-138-17 kubenswrapper[5003]: E1031 17:58:10.331012    5003 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-tdzz5" containerName="extractor"
Oct 31 17:58:40.331121 ip-10-0-138-17 kubenswrapper[5003]: E1031 17:58:40.331083    5003 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-tdzz5" containerName="extractor"
Oct 31 17:58:50.025919 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:58:50.025877    5003 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-86235c0f-7p5fm"]
Oct 31 17:58:50.037357 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:58:50.037321    5003 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-86235c0f-7p5fm"]
Oct 31 17:58:51.888567 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:58:51.888534    5003 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="baf9b809-2b5e-4358-91d7-50ed7b72a266" path="/var/lib/kubelet/pods/baf9b809-2b5e-4358-91d7-50ed7b72a266/volumes"
Oct 31 17:59:10.338454 ip-10-0-138-17 kubenswrapper[5003]: E1031 17:59:10.338403    5003 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-tdzz5" containerName="extractor"
Oct 31 17:59:13.148348 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:59:13.148315    5003 scope.go:122] "RemoveContainer" containerID="110bee1c3299734af86cf59e1fa575036ce51d56d45ad93914ccadcbfd5a13da"
Oct 31 17:59:13.157728 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:59:13.157709    5003 scope.go:122] "RemoveContainer" containerID="d5a4fcaebd5008bf64ba58c22b20ea72ca380867aa5991811a61d2b0316a7f47"
Oct 31 17:59:28.874724 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:59:28.873772    5003 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-7d9897b54c-7smk2 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.34:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 31 17:59:28.874724 ip-10-0-138-17 kubenswrapper[5003]: I1031 17:59:28.873881    5003 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-7smk2" podUID="effd3895-446f-4877-8218-6414ce2e321b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.34:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 31 17:59:30.996096 ip-10-0-138-17 kubenswrapper[5003]: E1031 17:59:30.996038    5003 controller.go:251] "Failed to update lease" err="Put \"https://a756852771c0044279d6ba9a0e15a6dd-c7c3820165848559.elb.us-east-2.amazonaws.com:6443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/ip-10-0-138-17.ec2.internal?timeout=10s\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)"
Oct 31 17:59:40.330867 ip-10-0-138-17 kubenswrapper[5003]: E1031 17:59:40.330822    5003 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-tdzz5" containerName="extractor"
Oct 31 17:59:40.996922 ip-10-0-138-17 kubenswrapper[5003]: E1031 17:59:40.996882    5003 controller.go:251] "Failed to update lease" err="Put \"https://a756852771c0044279d6ba9a0e15a6dd-c7c3820165848559.elb.us-east-2.amazonaws.com:6443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/ip-10-0-138-17.ec2.internal?timeout=10s\": context deadline exceeded"
Oct 31 17:59:51.002824 ip-10-0-138-17 kubenswrapper[5003]: E1031 17:59:51.002776    5003 controller.go:251] "Failed to update lease" err="Put \"https://a756852771c0044279d6ba9a0e15a6dd-c7c3820165848559.elb.us-east-2.amazonaws.com:6443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/ip-10-0-138-17.ec2.internal?timeout=10s\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)"
Oct 31 18:00:01.004440 ip-10-0-138-17 kubenswrapper[5003]: E1031 18:00:01.004399    5003 controller.go:251] "Failed to update lease" err="Put \"https://a756852771c0044279d6ba9a0e15a6dd-c7c3820165848559.elb.us-east-2.amazonaws.com:6443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/ip-10-0-138-17.ec2.internal?timeout=10s\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)"
Oct 31 18:00:02.865243 ip-10-0-138-17 kubenswrapper[5003]: E1031 18:00:02.865202    5003 kubelet_node_status.go:524] "Error updating node status, will retry" err="failed to patch status \"{\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"type\\\":\\\"DiskPressure\\\"},{\\\"type\\\":\\\"PIDPressure\\\"},{\\\"type\\\":\\\"Ready\\\"}],\\\"conditions\\\":[{\\\"lastHeartbeatTime\\\":\\\"2026-10-31T17:59:52Z\\\",\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-10-31T17:59:52Z\\\",\\\"type\\\":\\\"DiskPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-10-31T17:59:52Z\\\",\\\"type\\\":\\\"PIDPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-10-31T17:59:52Z\\\",\\\"type\\\":\\\"Ready\\\"}],\\\"runtimeHandlers\\\":[{\\\"features\\\":{\\\"recursiveReadOnlyMounts\\\":true,\\\"userNamespaces\\\":true},\\\"name\\\":\\\"runc\\\"},{\\\"features\\\":{\\\"recursiveReadOnlyMounts\\\":true,\\\"userNamespaces\\\":true},\\\"name\\\":\\\"crun\\\"},{\\\"features\\\":{\\\"recursiveReadOnlyMounts\\\":true,\\\"userNamespaces\\\":true},\\\"name\\\":\\\"\\\"}]}}\" for node \"ip-10-0-138-17.ec2.internal\": Patch \"https://a756852771c0044279d6ba9a0e15a6dd-c7c3820165848559.elb.us-east-2.amazonaws.com:6443/api/v1/nodes/ip-10-0-138-17.ec2.internal/status?timeout=10s\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)"
Oct 31 18:00:03.351439 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:03.351392    5003 reflector.go:578] "Warning: watch ended with error" reflector="object-\"openshift-jobset-operator\"/\"jobset-manager-config\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Oct 31 18:00:03.351439 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:03.351422    5003 reflector.go:578] "Warning: watch ended with error" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-fftjl\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Oct 31 18:00:03.351439 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:03.351430    5003 reflector.go:578] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Oct 31 18:00:03.351439 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:03.351446    5003 reflector.go:578] "Warning: watch ended with error" reflector="object-\"llm\"/\"default-dockercfg-vhxrl\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Oct 31 18:00:03.351932 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:03.351418    5003 reflector.go:578] "Warning: watch ended with error" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Oct 31 18:00:03.351932 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:03.351475    5003 reflector.go:578] "Warning: watch ended with error" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Oct 31 18:00:03.351932 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:03.351485    5003 reflector.go:578] "Warning: watch ended with error" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Oct 31 18:00:03.351932 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:03.351493    5003 reflector.go:578] "Warning: watch ended with error" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Oct 31 18:00:03.351932 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:03.351517    5003 reflector.go:578] "Warning: watch ended with error" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Oct 31 18:00:03.351932 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:03.351517    5003 reflector.go:578] "Warning: watch ended with error" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Oct 31 18:00:03.351932 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:03.351521    5003 reflector.go:578] "Warning: watch ended with error" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Oct 31 18:00:03.351932 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:03.351515    5003 reflector.go:578] "Warning: watch ended with error" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Oct 31 18:00:03.351932 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:03.351540    5003 reflector.go:578] "Warning: watch ended with error" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Oct 31 18:00:03.351932 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:03.351551    5003 reflector.go:578] "Warning: watch ended with error" reflector="object-\"openshift-multus\"/\"multus-node-identity-dockercfg-x4c5q\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Oct 31 18:00:03.351932 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:03.351613    5003 reflector.go:578] "Warning: watch ended with error" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Oct 31 18:00:03.351932 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:03.351625    5003 reflector.go:578] "Warning: watch ended with error" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Oct 31 18:00:03.351932 ip-10-0-138-17 kubenswrapper[5003]: E1031 18:00:03.351619    5003 controller.go:251] "Failed to update lease" err="Put \"https://a756852771c0044279d6ba9a0e15a6dd-c7c3820165848559.elb.us-east-2.amazonaws.com:6443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/ip-10-0-138-17.ec2.internal?timeout=10s\": http2: client connection lost"
Oct 31 18:00:03.351932 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:03.351674    5003 controller.go:171] "failed to update lease using latest lease, fallback to ensure lease" err="failed 5 attempts to update lease"
Oct 31 18:00:03.351932 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:03.351692    5003 reflector.go:578] "Warning: watch ended with error" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-z2hdt\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Oct 31 18:00:03.351932 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:03.351704    5003 reflector.go:578] "Warning: watch ended with error" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Oct 31 18:00:03.351932 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:03.351714    5003 reflector.go:578] "Warning: watch ended with error" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Oct 31 18:00:03.351932 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:03.351747    5003 reflector.go:578] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Oct 31 18:00:03.351932 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:03.351757    5003 reflector.go:578] "Warning: watch ended with error" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Oct 31 18:00:03.351932 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:03.351760    5003 reflector.go:578] "Warning: watch ended with error" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Oct 31 18:00:03.351932 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:03.351781    5003 reflector.go:578] "Warning: watch ended with error" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Oct 31 18:00:03.351932 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:03.351814    5003 reflector.go:578] "Warning: watch ended with error" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-xbzzg\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Oct 31 18:00:03.351932 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:03.351834    5003 reflector.go:578] "Warning: watch ended with error" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Oct 31 18:00:03.351932 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:03.351863    5003 reflector.go:578] "Warning: watch ended with error" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Oct 31 18:00:03.351932 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:03.351875    5003 reflector.go:578] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-v8tmg\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Oct 31 18:00:03.351932 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:03.351873    5003 reflector.go:578] "Warning: watch ended with error" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-8d7mp\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Oct 31 18:00:03.351932 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:03.351904    5003 reflector.go:578] "Warning: watch ended with error" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-dm9tc\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Oct 31 18:00:03.351932 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:03.351916    5003 reflector.go:578] "Warning: watch ended with error" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-wvfmn\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Oct 31 18:00:03.351932 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:03.351932    5003 reflector.go:578] "Warning: watch ended with error" reflector="object-\"openshift-jobset-operator\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Oct 31 18:00:03.351932 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:03.351935    5003 reflector.go:578] "Warning: watch ended with error" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Oct 31 18:00:03.351932 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:03.351955    5003 reflector.go:578] "Warning: watch ended with error" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Oct 31 18:00:03.353203 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:03.351971    5003 reflector.go:578] "Warning: watch ended with error" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Oct 31 18:00:03.353203 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:03.351971    5003 reflector.go:578] "Warning: watch ended with error" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Oct 31 18:00:03.353203 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:03.351994    5003 reflector.go:578] "Warning: watch ended with error" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Oct 31 18:00:03.353203 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:03.352001    5003 reflector.go:578] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.CSIDriver" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Oct 31 18:00:03.353203 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:03.352015    5003 reflector.go:578] "Warning: watch ended with error" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Oct 31 18:00:03.353203 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:03.352028    5003 reflector.go:578] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.RuntimeClass" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Oct 31 18:00:03.353203 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:03.352047    5003 reflector.go:578] "Warning: watch ended with error" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Oct 31 18:00:03.353203 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:03.352068    5003 reflector.go:578] "Warning: watch ended with error" reflector="object-\"openshift-jobset-operator\"/\"metrics-server-cert\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Oct 31 18:00:03.353203 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:03.352086    5003 reflector.go:578] "Warning: watch ended with error" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Oct 31 18:00:03.353203 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:03.352092    5003 reflector.go:578] "Warning: watch ended with error" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Oct 31 18:00:03.353203 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:03.352104    5003 reflector.go:578] "Warning: watch ended with error" reflector="object-\"kube-system\"/\"global-pull-secret-syncer-dockercfg-tj66q\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Oct 31 18:00:03.353203 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:03.352107    5003 reflector.go:578] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Oct 31 18:00:03.353203 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:03.352146    5003 reflector.go:578] "Warning: watch ended with error" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Oct 31 18:00:03.353203 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:03.352182    5003 reflector.go:578] "Warning: watch ended with error" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-gbkhn\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Oct 31 18:00:03.353203 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:03.352206    5003 reflector.go:578] "Warning: watch ended with error" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Oct 31 18:00:03.353203 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:03.352215    5003 reflector.go:578] "Warning: watch ended with error" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Oct 31 18:00:03.353203 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:03.352220    5003 reflector.go:578] "Warning: watch ended with error" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-4wr62\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Oct 31 18:00:03.353203 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:03.352239    5003 reflector.go:578] "Warning: watch ended with error" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-9gvm6\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Oct 31 18:00:03.353203 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:03.352207    5003 reflector.go:578] "Warning: watch ended with error" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Oct 31 18:00:03.353203 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:03.352253    5003 reflector.go:578] "Warning: watch ended with error" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-9kmpm\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Oct 31 18:00:03.353203 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:03.352270    5003 reflector.go:578] "Warning: watch ended with error" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Oct 31 18:00:03.353203 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:03.352252    5003 reflector.go:578] "Warning: watch ended with error" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Oct 31 18:00:03.353203 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:03.352290    5003 reflector.go:578] "Warning: watch ended with error" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Oct 31 18:00:03.353203 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:03.352296    5003 reflector.go:578] "Warning: watch ended with error" reflector="object-\"openshift-ingress\"/\"openshift-ai-inference-openshift-ai-inference-dockercfg-nctf7\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Oct 31 18:00:03.353203 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:03.352307    5003 reflector.go:578] "Warning: watch ended with error" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-dwhr5\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Oct 31 18:00:03.353203 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:03.352311    5003 reflector.go:578] "Warning: watch ended with error" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Oct 31 18:00:03.353203 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:03.352274    5003 reflector.go:578] "Warning: watch ended with error" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Oct 31 18:00:03.353203 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:03.352328    5003 reflector.go:578] "Warning: watch ended with error" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Oct 31 18:00:03.353203 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:03.352331    5003 reflector.go:578] "Warning: watch ended with error" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Oct 31 18:00:03.353203 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:03.352347    5003 reflector.go:578] "Warning: watch ended with error" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Oct 31 18:00:03.353203 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:03.352354    5003 reflector.go:578] "Warning: watch ended with error" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Oct 31 18:00:03.353203 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:03.352345    5003 reflector.go:578] "Warning: watch ended with error" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Oct 31 18:00:03.353203 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:03.352393    5003 reflector.go:578] "Warning: watch ended with error" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Oct 31 18:00:03.353203 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:03.352404    5003 reflector.go:578] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Oct 31 18:00:03.353203 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:03.352405    5003 reflector.go:578] "Warning: watch ended with error" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Oct 31 18:00:03.353203 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:03.352425    5003 reflector.go:578] "Warning: watch ended with error" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Oct 31 18:00:03.353203 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:03.352427    5003 reflector.go:578] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Oct 31 18:00:03.353203 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:03.352446    5003 reflector.go:578] "Warning: watch ended with error" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-g2t4b\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Oct 31 18:00:03.353203 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:03.352456    5003 reflector.go:578] "Warning: watch ended with error" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Oct 31 18:00:03.353203 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:03.352461    5003 reflector.go:578] "Warning: watch ended with error" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Oct 31 18:00:03.353203 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:03.352483    5003 reflector.go:578] "Warning: watch ended with error" reflector="object-\"openshift-network-diagnostics\"/\"network-check-target-dockercfg-nk5tf\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Oct 31 18:00:03.353203 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:03.352489    5003 reflector.go:578] "Warning: watch ended with error" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Oct 31 18:00:03.353203 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:03.352461    5003 reflector.go:578] "Warning: watch ended with error" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Oct 31 18:00:03.353203 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:03.352493    5003 reflector.go:578] "Warning: watch ended with error" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Oct 31 18:00:03.353203 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:03.352533    5003 reflector.go:578] "Warning: watch ended with error" reflector="object-\"opendatahub-operator-system\"/\"opendatahub-operator-controller-manager-dockercfg-wsnj7\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Oct 31 18:00:03.353203 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:03.352545    5003 reflector.go:578] "Warning: watch ended with error" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Oct 31 18:00:03.353203 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:03.352551    5003 reflector.go:578] "Warning: watch ended with error" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Oct 31 18:00:03.353203 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:03.352555    5003 reflector.go:578] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-mcfpr\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Oct 31 18:00:03.353203 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:03.352563    5003 reflector.go:578] "Warning: watch ended with error" reflector="object-\"openshift-jobset-operator\"/\"webhook-server-cert\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Oct 31 18:00:03.353203 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:03.352573    5003 reflector.go:578] "Warning: watch ended with error" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Oct 31 18:00:03.353203 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:03.352537    5003 reflector.go:578] "Warning: watch ended with error" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-vvnlg\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Oct 31 18:00:03.353203 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:03.352593    5003 reflector.go:578] "Warning: watch ended with error" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Oct 31 18:00:03.353203 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:03.352596    5003 reflector.go:578] "Warning: watch ended with error" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-5bhk8\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Oct 31 18:00:03.353203 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:03.352596    5003 reflector.go:578] "Warning: watch ended with error" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-dockercfg-8nkt5\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Oct 31 18:00:03.353203 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:03.352604    5003 reflector.go:578] "Warning: watch ended with error" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-4m7vl\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Oct 31 18:00:03.353203 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:03.352603    5003 reflector.go:578] "Warning: watch ended with error" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Oct 31 18:00:03.353203 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:03.352629    5003 reflector.go:578] "Warning: watch ended with error" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Oct 31 18:00:03.353203 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:03.352663    5003 reflector.go:578] "Warning: watch ended with error" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-zv4z8\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Oct 31 18:00:03.353203 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:03.352669    5003 reflector.go:578] "Warning: watch ended with error" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Oct 31 18:00:03.353203 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:03.352671    5003 reflector.go:578] "Warning: watch ended with error" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Oct 31 18:00:03.353203 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:03.352668    5003 reflector.go:578] "Warning: watch ended with error" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Oct 31 18:00:03.353203 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:03.352698    5003 reflector.go:578] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.Node" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Oct 31 18:00:03.353203 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:03.352697    5003 reflector.go:578] "Warning: watch ended with error" reflector="object-\"kube-system\"/\"original-pull-secret\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Oct 31 18:00:03.353203 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:03.352717    5003 reflector.go:578] "Warning: watch ended with error" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Oct 31 18:00:03.353203 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:03.352722    5003 reflector.go:578] "Warning: watch ended with error" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Oct 31 18:00:03.353203 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:03.352697    5003 reflector.go:578] "Warning: watch ended with error" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Oct 31 18:00:03.353203 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:03.352688    5003 reflector.go:578] "Warning: watch ended with error" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Oct 31 18:00:03.353203 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:03.352735    5003 reflector.go:578] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Oct 31 18:00:03.353203 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:03.352612    5003 reflector.go:578] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.Service" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Oct 31 18:00:03.353203 ip-10-0-138-17 kubenswrapper[5003]: E1031 18:00:03.352601    5003 event.go:368] "Unable to write event (may retry after sleeping)" err="Patch \"https://a756852771c0044279d6ba9a0e15a6dd-c7c3820165848559.elb.us-east-2.amazonaws.com:6443/api/v1/namespaces/openshift-ingress/events/maas-default-gateway-openshift-default-7d9897b54c-7smk2.18e3ae7f68bbbd78\": http2: client connection lost" event=<
Oct 31 18:00:03.353203 ip-10-0-138-17 kubenswrapper[5003]:         &Event{ObjectMeta:{maas-default-gateway-openshift-default-7d9897b54c-7smk2.18e3ae7f68bbbd78  openshift-ingress   51958 0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-ingress,Name:maas-default-gateway-openshift-default-7d9897b54c-7smk2,UID:effd3895-446f-4877-8218-6414ce2e321b,APIVersion:v1,ResourceVersion:9983,FieldPath:spec.containers{istio-proxy},},Reason:ProbeError,Message:Readiness probe error: Get "http://10.132.0.34:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
Oct 31 18:00:03.353203 ip-10-0-138-17 kubenswrapper[5003]:         body:
Oct 31 18:00:03.353203 ip-10-0-138-17 kubenswrapper[5003]:         ,Source:EventSource{Component:kubelet,Host:ip-10-0-138-17.ec2.internal,},FirstTimestamp:2026-10-31 17:48:58 +0000 UTC,LastTimestamp:2026-10-31 17:59:28.873847405 +0000 UTC m=+1937.128701948,Count:2,Type:Warning,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-17.ec2.internal,}
Oct 31 18:00:03.353203 ip-10-0-138-17 kubenswrapper[5003]:  >
Oct 31 18:00:03.353203 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:03.352710    5003 reflector.go:578] "Warning: watch ended with error" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Oct 31 18:00:03.353203 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:03.352755    5003 reflector.go:578] "Warning: watch ended with error" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-fm5qc\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Oct 31 18:00:03.353203 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:03.352731    5003 reflector.go:578] "Warning: watch ended with error" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Oct 31 18:00:03.353203 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:03.352769    5003 reflector.go:578] "Warning: watch ended with error" reflector="object-\"llm\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Oct 31 18:00:03.353203 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:03.352781    5003 reflector.go:578] "Warning: watch ended with error" reflector="object-\"openshift-ingress\"/\"router-dockercfg-qwvn9\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Oct 31 18:00:03.353203 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:03.352785    5003 reflector.go:578] "Warning: watch ended with error" reflector="object-\"kube-system\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Oct 31 18:00:03.353203 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:03.352758    5003 reflector.go:578] "Warning: watch ended with error" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Oct 31 18:00:03.353203 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:03.352787    5003 reflector.go:578] "Warning: watch ended with error" reflector="object-\"kube-system\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Oct 31 18:00:03.353203 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:03.352788    5003 reflector.go:578] "Warning: watch ended with error" reflector="object-\"openshift-jobset-operator\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Oct 31 18:00:03.353203 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:03.352752    5003 reflector.go:578] "Warning: watch ended with error" reflector="object-\"opendatahub-operator-system\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Oct 31 18:00:03.353203 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:03.352802    5003 reflector.go:578] "Warning: watch ended with error" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Oct 31 18:00:03.353203 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:03.352795    5003 reflector.go:578] "Warning: watch ended with error" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-2pt75\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Oct 31 18:00:03.353203 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:03.352833    5003 reflector.go:578] "Warning: watch ended with error" reflector="object-\"llm\"/\"e2e-embedding-simulated-kserve-self-signed-certs\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Oct 31 18:00:03.353203 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:03.352840    5003 reflector.go:578] "Warning: watch ended with error" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Oct 31 18:00:03.353203 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:03.352820    5003 reflector.go:578] "Warning: watch ended with error" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Oct 31 18:00:03.353203 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:03.352851    5003 reflector.go:578] "Warning: watch ended with error" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Oct 31 18:00:03.353203 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:03.352846    5003 reflector.go:578] "Warning: watch ended with error" reflector="pkg/kubelet/config/apiserver.go:66" type="*v1.Pod" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Oct 31 18:00:03.353203 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:03.352869    5003 reflector.go:578] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Oct 31 18:00:03.353203 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:03.352852    5003 reflector.go:578] "Warning: watch ended with error" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-5nxdj\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Oct 31 18:00:03.353203 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:03.352880    5003 reflector.go:578] "Warning: watch ended with error" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Oct 31 18:00:03.353203 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:03.352865    5003 reflector.go:578] "Warning: watch ended with error" reflector="object-\"openshift-insights\"/\"operator-dockercfg-t4mdx\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Oct 31 18:00:03.353203 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:03.352894    5003 reflector.go:578] "Warning: watch ended with error" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Oct 31 18:00:03.353203 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:03.352897    5003 reflector.go:578] "Warning: watch ended with error" reflector="object-\"opendatahub-operator-system\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Oct 31 18:00:03.353203 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:03.352844    5003 reflector.go:578] "Warning: watch ended with error" reflector="object-\"opendatahub-operator-system\"/\"opendatahub-operator-controller-manager-service-cert\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Oct 31 18:00:03.353203 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:03.352854    5003 reflector.go:578] "Warning: watch ended with error" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-lfh5s\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Oct 31 18:00:03.353203 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:03.352883    5003 reflector.go:578] "Warning: watch ended with error" reflector="object-\"openshift-jobset-operator\"/\"jobset-controller-manager-dockercfg-t7wv5\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Oct 31 18:00:03.353203 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:03.352917    5003 reflector.go:578] "Warning: watch ended with error" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-42sgv\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Oct 31 18:00:03.353203 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:03.352921    5003 reflector.go:578] "Warning: watch ended with error" reflector="object-\"openshift-ingress\"/\"cacerts\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Oct 31 18:00:03.353203 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:03.352925    5003 reflector.go:578] "Warning: watch ended with error" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-zw2xk\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Oct 31 18:00:03.353203 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:03.352875    5003 reflector.go:578] "Warning: watch ended with error" reflector="object-\"kube-system\"/\"konnectivity-agent-dockercfg-k6pvq\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Oct 31 18:00:03.353203 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:03.352939    5003 reflector.go:578] "Warning: watch ended with error" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Oct 31 18:00:03.353203 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:03.352945    5003 reflector.go:578] "Warning: watch ended with error" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Oct 31 18:00:03.353203 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:03.352951    5003 reflector.go:578] "Warning: watch ended with error" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-27h6r\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Oct 31 18:00:03.353203 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:03.352892    5003 reflector.go:578] "Warning: watch ended with error" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-jvk7n\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Oct 31 18:00:03.353203 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:03.352899    5003 reflector.go:578] "Warning: watch ended with error" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Oct 31 18:00:03.353203 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:03.352964    5003 reflector.go:578] "Warning: watch ended with error" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-4s8xz\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Oct 31 18:00:03.353203 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:03.352969    5003 reflector.go:578] "Warning: watch ended with error" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Oct 31 18:00:03.353203 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:03.352939    5003 reflector.go:578] "Warning: watch ended with error" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Oct 31 18:00:03.353203 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:03.352911    5003 reflector.go:578] "Warning: watch ended with error" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Oct 31 18:00:03.353203 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:03.352982    5003 reflector.go:578] "Warning: watch ended with error" reflector="object-\"openshift-ingress-canary\"/\"ingress-canary-dockercfg-8gjvp\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Oct 31 18:00:03.353203 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:03.352940    5003 reflector.go:578] "Warning: watch ended with error" reflector="object-\"opendatahub-operator-system\"/\"opendatahub-operator-metrics-tls\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Oct 31 18:00:03.353203 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:03.352890    5003 reflector.go:578] "Warning: watch ended with error" reflector="object-\"openshift-dns\"/\"dns-default\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Oct 31 18:00:03.353203 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:03.352958    5003 reflector.go:578] "Warning: watch ended with error" reflector="object-\"kube-system\"/\"konnectivity-agent\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Oct 31 18:00:03.353203 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:03.352997    5003 reflector.go:578] "Warning: watch ended with error" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Oct 31 18:00:03.353203 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:03.352963    5003 reflector.go:578] "Warning: watch ended with error" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Oct 31 18:00:03.353203 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:03.353006    5003 reflector.go:578] "Warning: watch ended with error" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Oct 31 18:00:03.353203 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:03.352980    5003 reflector.go:578] "Warning: watch ended with error" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Oct 31 18:00:03.353203 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:03.353025    5003 reflector.go:578] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Oct 31 18:00:03.353203 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:03.352983    5003 reflector.go:578] "Warning: watch ended with error" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-config\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Oct 31 18:00:03.353203 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:03.352948    5003 reflector.go:578] "Warning: watch ended with error" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Oct 31 18:00:03.353203 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:03.352960    5003 reflector.go:578] "Warning: watch ended with error" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-6tx6j\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Oct 31 18:00:03.353203 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:03.352999    5003 reflector.go:578] "Warning: watch ended with error" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Oct 31 18:00:03.353203 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:03.353003    5003 reflector.go:578] "Warning: watch ended with error" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Oct 31 18:00:03.353203 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:03.352932    5003 reflector.go:578] "Warning: watch ended with error" reflector="object-\"openshift-dns\"/\"dns-dockercfg-4g54t\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Oct 31 18:00:03.353203 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:03.352904    5003 reflector.go:578] "Warning: watch ended with error" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Oct 31 18:00:03.353203 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:03.352982    5003 reflector.go:578] "Warning: watch ended with error" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-mqrw5\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Oct 31 18:00:03.909331 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:03.909302    5003 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-df4c7dd9c-zpdb8_f3636069-accf-42f5-a091-52838e7a1a72/authorino/0.log"
Oct 31 18:00:04.183108 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:04.183019    5003 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Oct 31 18:00:04.183108 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:04.183060    5003 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Oct 31 18:00:04.197861 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:04.197840    5003 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\""
Oct 31 18:00:04.198115 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:04.198101    5003 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\""
Oct 31 18:00:04.208551 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:04.208528    5003 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Oct 31 18:00:04.210422 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:04.210405    5003 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Oct 31 18:00:04.216152 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:04.216135    5003 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-fftjl\""
Oct 31 18:00:04.217402 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:04.217388    5003 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Oct 31 18:00:04.219286 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:04.219272    5003 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Oct 31 18:00:04.225661 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:04.225629    5003 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Oct 31 18:00:04.231250 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:04.231235    5003 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Oct 31 18:00:04.231327 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:04.231305    5003 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\""
Oct 31 18:00:04.232979 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:04.232964    5003 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-42sgv\""
Oct 31 18:00:04.234280 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:04.234267    5003 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Oct 31 18:00:04.236050 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:04.236031    5003 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Oct 31 18:00:04.238975 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:04.238961    5003 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Oct 31 18:00:04.241024 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:04.241011    5003 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Oct 31 18:00:04.243585 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:04.243570    5003 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Oct 31 18:00:04.243866 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:04.243854    5003 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Oct 31 18:00:04.254444 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:04.254424    5003 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-5nxdj\""
Oct 31 18:00:04.259841 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:04.259824    5003 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-qwvn9\""
Oct 31 18:00:04.267487 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:04.267471    5003 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-jobset-operator\"/\"jobset-manager-config\""
Oct 31 18:00:04.268615 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:04.268598    5003 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Oct 31 18:00:04.268684 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:04.268607    5003 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent-dockercfg-k6pvq\""
Oct 31 18:00:04.272300 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:04.272287    5003 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Oct 31 18:00:04.282949 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:04.282930    5003 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Oct 31 18:00:04.284195 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:04.284182    5003 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Oct 31 18:00:04.287617 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:04.287603    5003 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-g2t4b\""
Oct 31 18:00:04.287693 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:04.287678    5003 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-4g54t\""
Oct 31 18:00:04.289046 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:04.289034    5003 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-zw2xk\""
Oct 31 18:00:04.299890 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:04.299875    5003 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Oct 31 18:00:04.307050 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:04.307036    5003 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-vhxrl\""
Oct 31 18:00:04.323798 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:04.323780    5003 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Oct 31 18:00:04.329033 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:04.329016    5003 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-gbkhn\""
Oct 31 18:00:04.346720 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:04.346700    5003 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Oct 31 18:00:04.353250 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:04.353236    5003 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-mcfpr\""
Oct 31 18:00:04.356344 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:04.356321    5003 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Oct 31 18:00:04.356344 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:04.356331    5003 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Oct 31 18:00:04.384606 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:04.384584    5003 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Oct 31 18:00:04.384606 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:04.384595    5003 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-mqrw5\""
Oct 31 18:00:04.384959 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:04.384942    5003 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Oct 31 18:00:04.386556 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:04.386542    5003 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-jobset-operator\"/\"jobset-controller-manager-dockercfg-t7wv5\""
Oct 31 18:00:04.387719 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:04.387705    5003 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Oct 31 18:00:04.387768 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:04.387724    5003 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-dm9tc\""
Oct 31 18:00:04.390051 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:04.390024    5003 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Oct 31 18:00:04.399170 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:04.399139    5003 reflector.go:446] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 31 18:00:04.408048 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:04.408021    5003 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Oct 31 18:00:04.410564 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:04.410543    5003 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub-operator-system\"/\"opendatahub-operator-controller-manager-dockercfg-wsnj7\""
Oct 31 18:00:04.415458 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:04.415445    5003 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Oct 31 18:00:04.419141 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:04.419125    5003 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Oct 31 18:00:04.424937 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:04.424916    5003 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Oct 31 18:00:04.429411 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:04.429393    5003 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Oct 31 18:00:04.440538 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:04.440481    5003 reflector.go:446] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 31 18:00:04.440622 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:04.440601    5003 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-t4mdx\""
Oct 31 18:00:04.444782 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:04.444764    5003 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Oct 31 18:00:04.445221 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:04.445207    5003 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Oct 31 18:00:04.447690 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:04.447674    5003 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Oct 31 18:00:04.454715 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:04.454699    5003 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-dwhr5\""
Oct 31 18:00:04.454790 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:04.454730    5003 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Oct 31 18:00:04.465549 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:04.465529    5003 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Oct 31 18:00:04.466329 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:04.466314    5003 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Oct 31 18:00:04.477543 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:04.477520    5003 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Oct 31 18:00:04.480818 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:04.480803    5003 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-9gvm6\""
Oct 31 18:00:04.484072 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:04.484052    5003 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Oct 31 18:00:04.502149 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:04.502124    5003 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Oct 31 18:00:04.516010 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:04.515981    5003 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Oct 31 18:00:04.516165 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:04.516140    5003 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Oct 31 18:00:04.516872 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:04.516855    5003 reflector.go:446] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Oct 31 18:00:04.517267 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:04.517251    5003 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-9kmpm\""
Oct 31 18:00:04.520806 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:04.520770    5003 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-8d7mp\""
Oct 31 18:00:04.522835 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:04.522820    5003 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-4m7vl\""
Oct 31 18:00:04.532615 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:04.532598    5003 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Oct 31 18:00:04.549685 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:04.549665    5003 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Oct 31 18:00:04.549787 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:04.549685    5003 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-check-target-dockercfg-nk5tf\""
Oct 31 18:00:04.553050 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:04.553035    5003 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Oct 31 18:00:04.562126 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:04.562108    5003 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Oct 31 18:00:04.571755 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:04.571739    5003 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Oct 31 18:00:04.577918 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:04.577904    5003 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Oct 31 18:00:04.581038 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:04.581022    5003 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-wvfmn\""
Oct 31 18:00:04.592547 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:04.592527    5003 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Oct 31 18:00:04.592547 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:04.592527    5003 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Oct 31 18:00:04.599263 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:04.599245    5003 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"ingress-canary-dockercfg-8gjvp\""
Oct 31 18:00:04.602267 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:04.602252    5003 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-xbzzg\""
Oct 31 18:00:04.602267 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:04.602259    5003 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Oct 31 18:00:04.609139 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:04.609125    5003 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Oct 31 18:00:04.612416 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:04.612401    5003 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Oct 31 18:00:04.614931 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:04.614914    5003 reflector.go:446] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 31 18:00:04.615904 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:04.615889    5003 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub-operator-system\"/\"opendatahub-operator-metrics-tls\""
Oct 31 18:00:04.617515 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:04.617501    5003 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Oct 31 18:00:04.618913 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:04.618900    5003 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-node-identity-dockercfg-x4c5q\""
Oct 31 18:00:04.619962 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:04.619948    5003 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Oct 31 18:00:04.624166 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:04.624149    5003 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-jobset-operator\"/\"openshift-service-ca.crt\""
Oct 31 18:00:04.625793 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:04.625782    5003 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Oct 31 18:00:04.625839 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:04.625787    5003 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub-operator-system\"/\"openshift-service-ca.crt\""
Oct 31 18:00:04.626727 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:04.626713    5003 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Oct 31 18:00:04.632599 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:04.632587    5003 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Oct 31 18:00:04.632668 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:04.632595    5003 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Oct 31 18:00:04.635550 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:04.635536    5003 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-dockercfg-8nkt5\""
Oct 31 18:00:04.640809 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:04.640795    5003 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Oct 31 18:00:04.646511 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:04.646497    5003 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Oct 31 18:00:04.647749 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:04.647737    5003 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-5bhk8\""
Oct 31 18:00:04.654265 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:04.654252    5003 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Oct 31 18:00:04.663306 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:04.663292    5003 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-config\""
Oct 31 18:00:04.685369 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:04.685352    5003 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub-operator-system\"/\"opendatahub-operator-controller-manager-service-cert\""
Oct 31 18:00:04.686358 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:04.686346    5003 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-4wr62\""
Oct 31 18:00:04.690613 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:04.690570    5003 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-2pt75\""
Oct 31 18:00:04.690687 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:04.690657    5003 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-4s8xz\""
Oct 31 18:00:04.696629 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:04.696614    5003 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Oct 31 18:00:04.700969 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:04.700956    5003 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Oct 31 18:00:04.709588 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:04.709572    5003 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Oct 31 18:00:04.709675 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:04.709608    5003 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-embedding-simulated-kserve-self-signed-certs\""
Oct 31 18:00:04.713345 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:04.713330    5003 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Oct 31 18:00:04.714511 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:04.714495    5003 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Oct 31 18:00:04.721701 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:04.721685    5003 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Oct 31 18:00:04.728073 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:04.728052    5003 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-6tx6j\""
Oct 31 18:00:04.737004 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:04.736980    5003 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"openshift-service-ca.crt\""
Oct 31 18:00:04.753752 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:04.753736    5003 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Oct 31 18:00:04.760038 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:04.760022    5003 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"global-pull-secret-syncer-dockercfg-tj66q\""
Oct 31 18:00:04.769073 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:04.769057    5003 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-fm5qc\""
Oct 31 18:00:04.788048 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:04.788030    5003 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"openshift-ai-inference-openshift-ai-inference-dockercfg-nctf7\""
Oct 31 18:00:04.788138 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:04.788124    5003 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Oct 31 18:00:04.791027 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:04.791011    5003 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Oct 31 18:00:04.791136 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:04.791124    5003 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-zv4z8\""
Oct 31 18:00:04.794179 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:04.794164    5003 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Oct 31 18:00:04.797469 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:04.797451    5003 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-jobset-operator\"/\"metrics-server-cert\""
Oct 31 18:00:04.802610 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:04.802596    5003 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-vvnlg\""
Oct 31 18:00:04.826907 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:04.826888    5003 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Oct 31 18:00:04.832251 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:04.832235    5003 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Oct 31 18:00:04.832343 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:04.832329    5003 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-jobset-operator\"/\"webhook-server-cert\""
Oct 31 18:00:04.834265 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:04.834251    5003 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Oct 31 18:00:04.841223 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:04.841203    5003 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Oct 31 18:00:04.843559 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:04.843539    5003 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Oct 31 18:00:04.847812 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:04.847797    5003 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Oct 31 18:00:04.850977 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:04.850965    5003 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-27h6r\""
Oct 31 18:00:04.858106 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:04.858090    5003 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\""
Oct 31 18:00:04.861280 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:04.861265    5003 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Oct 31 18:00:04.869800 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:04.869782    5003 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Oct 31 18:00:04.869800 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:04.869786    5003 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Oct 31 18:00:04.872918 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:04.872905    5003 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-jobset-operator\"/\"kube-root-ca.crt\""
Oct 31 18:00:04.873440 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:04.873431    5003 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-z2hdt\""
Oct 31 18:00:04.873506 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:04.873492    5003 reflector.go:446] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 31 18:00:04.892305 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:04.892290    5003 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Oct 31 18:00:04.892408 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:04.892395    5003 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\""
Oct 31 18:00:04.894338 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:04.894324    5003 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Oct 31 18:00:04.896430 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:04.896416    5003 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Oct 31 18:00:04.899748 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:04.899731    5003 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"kube-root-ca.crt\""
Oct 31 18:00:04.911149 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:04.911118    5003 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Oct 31 18:00:04.921533 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:04.921515    5003 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-jvk7n\""
Oct 31 18:00:04.923485 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:04.923473    5003 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-v8tmg\""
Oct 31 18:00:04.925745 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:04.925729    5003 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Oct 31 18:00:04.925809 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:04.925755    5003 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Oct 31 18:00:04.926500 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:04.926487    5003 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Oct 31 18:00:04.936870 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:04.936854    5003 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Oct 31 18:00:04.939435 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:04.939420    5003 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Oct 31 18:00:04.940324 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:04.940310    5003 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-lfh5s\""
Oct 31 18:00:04.959093 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:04.959045    5003 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub-operator-system\"/\"kube-root-ca.crt\""
Oct 31 18:00:04.965140 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:04.965125    5003 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Oct 31 18:00:04.968243 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:04.968228    5003 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Oct 31 18:00:06.042429 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:06.042396    5003 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-452b6d7b-xdjcq"]
Oct 31 18:00:06.050831 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:06.050802    5003 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-452b6d7b-xdjcq"]
Oct 31 18:00:07.887660 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:07.887622    5003 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="8edb0da0-e5b7-42a0-9048-5a44e93200fc" path="/var/lib/kubelet/pods/8edb0da0-e5b7-42a0-9048-5a44e93200fc/volumes"
Oct 31 18:00:10.331806 ip-10-0-138-17 kubenswrapper[5003]: E1031 18:00:10.331766    5003 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-tdzz5" containerName="extractor"
Oct 31 18:00:13.185179 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:13.185146    5003 scope.go:122] "RemoveContainer" containerID="cae90a15f8c3bde41e23b6574663cfc0e6d23e17b37970002a1ad4ae6a87ce65"
Oct 31 18:00:13.194272 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:13.194240    5003 scope.go:122] "RemoveContainer" containerID="b4299aed4612f1bb8293242baa5ee2bc658f408d658c5915140b64f740c6325a"
Oct 31 18:00:18.656240 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:18.656192    5003 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-f5575fb46-tp6hn_f0697a62-9465-4344-b027-df612f19d387/maas-api/0.log"
Oct 31 18:00:19.206893 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:19.206861    5003 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-sub-0345ff62-k9v59_eee1be58-4a01-4002-9830-b7926525b564/revoke-keys/0.log"
Oct 31 18:00:19.383142 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:19.383096    5003 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-sub-3e31a506-slg44_645e3fca-7508-4f09-b9df-970054c2d644/revoke-keys/0.log"
Oct 31 18:00:19.931761 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:19.931725    5003 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-7cdbf6dc44-6lmsj_27ecda6a-9b88-4a1b-a89b-bd2cd9d35448/postgres/0.log"
Oct 31 18:00:21.613384 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:21.613341    5003 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-df4c7dd9c-zpdb8_f3636069-accf-42f5-a091-52838e7a1a72/authorino/0.log"
Oct 31 18:00:21.849289 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:21.849255    5003 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-7b7bb4bc77-fnjvs_1e05cbb8-2102-41b9-adcd-ad0dd16bbd97/manager/0.log"
Oct 31 18:00:22.029129 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:22.029049    5003 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-3e31a506-slg44"]
Oct 31 18:00:22.037683 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:22.037637    5003 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-8557cbdb84-vmqpq_82b3225d-4b28-457f-b41b-284758aaf104/manager/0.log"
Oct 31 18:00:22.043502 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:22.043479    5003 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-3e31a506-slg44"]
Oct 31 18:00:22.783269 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:22.783237    5003 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-5778bb4449-d2s7v_59a4028e-1e9f-4bc1-8ebb-5db28ed51fdc/manager/1.log"
Oct 31 18:00:23.448298 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:23.448266    5003 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-5778bb4449-d2s7v_59a4028e-1e9f-4bc1-8ebb-5db28ed51fdc/manager/0.log"
Oct 31 18:00:23.888752 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:23.888721    5003 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="645e3fca-7508-4f09-b9df-970054c2d644" path="/var/lib/kubelet/pods/645e3fca-7508-4f09-b9df-970054c2d644/volumes"
Oct 31 18:00:24.010252 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:24.010219    5003 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-858f55f4d98wwvr_0bb9875d-53a6-4105-89da-16e0bbd2c3a1/istio-proxy/0.log"
Oct 31 18:00:24.213258 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:24.213178    5003 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-7ddd9cfdc8-bdlh9_42e93792-9b87-4637-89df-62b5836971f9/discovery/0.log"
Oct 31 18:00:24.947218 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:24.947189    5003 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-7d9897b54c-7smk2_effd3895-446f-4877-8218-6414ce2e321b/istio-proxy/1.log"
Oct 31 18:00:25.313884 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:25.313853    5003 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-7d9897b54c-9t8k2_c8d0a165-562c-4602-95fe-35a62229fa4f/istio-proxy/0.log"
Oct 31 18:00:26.428419 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:26.428386    5003 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-7d9897b54c-z6b99_838478fc-1a24-432e-bb93-15d49ee7e1ed/istio-proxy/0.log"
Oct 31 18:00:26.615369 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:26.615339    5003 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_openshift-ai-inference-openshift-ai-inference-6dd6bfb767-t8zg4_9d187bce-1d54-4dd5-b7d3-ee25ca1057f7/istio-proxy/0.log"
Oct 31 18:00:27.187842 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:27.187812    5003 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-65db5d9749-xvqmh_50e82975-3344-4653-8de3-68e8a64a8757/router/0.log"
Oct 31 18:00:27.596438 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:27.596406    5003 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-7d9897b54c-7smk2_effd3895-446f-4877-8218-6414ce2e321b/istio-proxy/0.log"
Oct 31 18:00:28.453131 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:28.453097    5003 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-embedding-simulated-kserve-67bf594cd6-g8sbz_2bc523a5-fbcd-40d4-a592-9e0898f55d48/main/0.log"
Oct 31 18:00:28.806152 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:28.806121    5003 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8w4lwx_be221e0b-2de3-4826-890e-1bb3182e0d03/main/0.log"
Oct 31 18:00:29.169781 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:29.169708    5003 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-84b4ff656c-sjlmb_be2d5d86-fcd5-4bbc-b426-ac13ebe3d2cc/main/0.log"
Oct 31 18:00:29.342853 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:29.342823    5003 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-5f5c4b459f-82w89_ef5a065b-f98e-4d14-810f-2d0c42c58ce6/main/0.log"
Oct 31 18:00:30.209340 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:30.209312    5003 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-df4c7dd9c-zpdb8_f3636069-accf-42f5-a091-52838e7a1a72/authorino/0.log"
Oct 31 18:00:40.331470 ip-10-0-138-17 kubenswrapper[5003]: E1031 18:00:40.331432    5003 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-tdzz5" containerName="extractor"
Oct 31 18:00:41.180905 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:41.180877    5003 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-f5575fb46-tp6hn_f0697a62-9465-4344-b027-df612f19d387/maas-api/0.log"
Oct 31 18:00:41.553549 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:41.553461    5003 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-sub-0345ff62-k9v59_eee1be58-4a01-4002-9830-b7926525b564/revoke-keys/0.log"
Oct 31 18:00:42.097878 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:42.097841    5003 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-7cdbf6dc44-6lmsj_27ecda6a-9b88-4a1b-a89b-bd2cd9d35448/postgres/0.log"
Oct 31 18:00:43.182008 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:43.181976    5003 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-df4c7dd9c-zpdb8_f3636069-accf-42f5-a091-52838e7a1a72/authorino/0.log"
Oct 31 18:00:43.407690 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:43.407622    5003 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-7b7bb4bc77-fnjvs_1e05cbb8-2102-41b9-adcd-ad0dd16bbd97/manager/0.log"
Oct 31 18:00:43.592067 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:43.592040    5003 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-8557cbdb84-vmqpq_82b3225d-4b28-457f-b41b-284758aaf104/manager/0.log"
Oct 31 18:00:44.361813 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:44.361779    5003 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-5778bb4449-d2s7v_59a4028e-1e9f-4bc1-8ebb-5db28ed51fdc/manager/1.log"
Oct 31 18:00:44.915711 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:44.915668    5003 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-858f55f4d98wwvr_0bb9875d-53a6-4105-89da-16e0bbd2c3a1/istio-proxy/0.log"
Oct 31 18:00:45.027556 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:45.027521    5003 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-0345ff62-k9v59"]
Oct 31 18:00:45.041833 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:45.041802    5003 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-0345ff62-k9v59"]
Oct 31 18:00:45.107207 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:45.107180    5003 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-7ddd9cfdc8-bdlh9_42e93792-9b87-4637-89df-62b5836971f9/discovery/0.log"
Oct 31 18:00:45.874952 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:45.874891    5003 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-7d9897b54c-7smk2_effd3895-446f-4877-8218-6414ce2e321b/istio-proxy/1.log"
Oct 31 18:00:45.888594 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:45.888566    5003 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="eee1be58-4a01-4002-9830-b7926525b564" path="/var/lib/kubelet/pods/eee1be58-4a01-4002-9830-b7926525b564/volumes"
Oct 31 18:00:46.261331 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:46.261233    5003 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-7d9897b54c-9t8k2_c8d0a165-562c-4602-95fe-35a62229fa4f/istio-proxy/0.log"
Oct 31 18:00:47.398304 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:47.398259    5003 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-7d9897b54c-z6b99_838478fc-1a24-432e-bb93-15d49ee7e1ed/istio-proxy/0.log"
Oct 31 18:00:47.593754 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:47.593719    5003 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_openshift-ai-inference-openshift-ai-inference-6dd6bfb767-t8zg4_9d187bce-1d54-4dd5-b7d3-ee25ca1057f7/istio-proxy/0.log"
Oct 31 18:00:48.119954 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:48.119923    5003 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-65db5d9749-xvqmh_50e82975-3344-4653-8de3-68e8a64a8757/router/0.log"
Oct 31 18:00:49.003837 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:49.003808    5003 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-embedding-simulated-kserve-67bf594cd6-g8sbz_2bc523a5-fbcd-40d4-a592-9e0898f55d48/main/0.log"
Oct 31 18:00:49.382182 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:49.382152    5003 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8w4lwx_be221e0b-2de3-4826-890e-1bb3182e0d03/main/0.log"
Oct 31 18:00:49.764906 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:49.764829    5003 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-84b4ff656c-sjlmb_be2d5d86-fcd5-4bbc-b426-ac13ebe3d2cc/main/0.log"
Oct 31 18:00:49.938848 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:00:49.938815    5003 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-5f5c4b459f-82w89_ef5a065b-f98e-4d14-810f-2d0c42c58ce6/main/0.log"
Oct 31 18:01:10.331005 ip-10-0-138-17 kubenswrapper[5003]: E1031 18:01:10.330961    5003 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-tdzz5" containerName="extractor"
Oct 31 18:01:13.221754 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:01:13.221721    5003 scope.go:122] "RemoveContainer" containerID="8e444420cf396cee04098ecf11a11f9c9b03209881157ac8bca2afcd72923309"
Oct 31 18:01:40.330552 ip-10-0-138-17 kubenswrapper[5003]: E1031 18:01:40.330515    5003 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-tdzz5" containerName="extractor"
Oct 31 18:02:10.331511 ip-10-0-138-17 kubenswrapper[5003]: E1031 18:02:10.331477    5003 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-tdzz5" containerName="extractor"
Oct 31 18:02:12.293605 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:02:12.293496    5003 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-b2xxw_f03611db-3bd9-401a-a137-1d4f691b51ea/console-operator/2.log"
Oct 31 18:02:12.298427 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:02:12.298400    5003 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-b2xxw_f03611db-3bd9-401a-a137-1d4f691b51ea/console-operator/2.log"
Oct 31 18:02:13.247379 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:02:13.247348    5003 scope.go:122] "RemoveContainer" containerID="7549a6e0a187148dda557b3c63c260a2d102f553b47f2d281fd6f47dac349208"
Oct 31 18:02:13.256549 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:02:13.256529    5003 scope.go:122] "RemoveContainer" containerID="de1542cbad8da571c9e4b828494148120898f0ec6db2341a37181e57608bd0d6"
Oct 31 18:02:14.497531 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:02:14.497499    5003 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-qgtf4_9179e3c5-ef52-4445-aec0-779c3e99cb07/global-pull-secret-syncer/0.log"
Oct 31 18:02:14.830757 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:02:14.830727    5003 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kas-connection-checker-685895c7c9-6pnp6_26373302-592f-4fd5-bd54-7ac57ef19bfd/connection-checker/0.log"
Oct 31 18:02:14.952894 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:02:14.952866    5003 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kas-connection-checker-685895c7c9-kgdxw_340f062e-e599-4620-87d1-c5be0bb1b319/connection-checker/0.log"
Oct 31 18:02:15.074001 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:02:15.073972    5003 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kas-connection-checker-685895c7c9-ttbkh_9363fb38-792f-41a6-b6b3-d2c508fff328/connection-checker/0.log"
Oct 31 18:02:15.502099 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:02:15.502066    5003 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-vghkb_86312227-efeb-4196-ab2d-3b4b03e5c50f/konnectivity-agent/0.log"
Oct 31 18:02:15.743931 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:02:15.743904    5003 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-138-17.ec2.internal_4b3b7d414562a81671be0e69748417db/haproxy/0.log"
Oct 31 18:02:22.222029 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:02:22.221987    5003 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-df4c7dd9c-zpdb8_f3636069-accf-42f5-a091-52838e7a1a72/authorino/0.log"
Oct 31 18:02:22.325339 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:02:22.325308    5003 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-7b7bb4bc77-fnjvs_1e05cbb8-2102-41b9-adcd-ad0dd16bbd97/manager/0.log"
Oct 31 18:02:22.454866 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:02:22.454832    5003 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-8557cbdb84-vmqpq_82b3225d-4b28-457f-b41b-284758aaf104/manager/0.log"
Oct 31 18:02:22.991631 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:02:22.991543    5003 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-5778bb4449-d2s7v_59a4028e-1e9f-4bc1-8ebb-5db28ed51fdc/manager/0.log"
Oct 31 18:02:23.004696 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:02:23.004664    5003 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-5778bb4449-d2s7v_59a4028e-1e9f-4bc1-8ebb-5db28ed51fdc/manager/1.log"
Oct 31 18:02:24.358821 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:02:24.358781    5003 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-must-gather-csf86/perf-node-gather-daemonset-z6zwr"]
Oct 31 18:02:24.359430 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:02:24.359408    5003 cpu_manager.go:414] "containerMap: removing container" podUID="f6a9c117-c010-4e65-964d-6ac6b6ecbfc5" containerName="maas-api"
Oct 31 18:02:24.359520 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:02:24.359432    5003 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="f6a9c117-c010-4e65-964d-6ac6b6ecbfc5" containerName="maas-api"
Oct 31 18:02:24.359579 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:02:24.359547    5003 memory_manager.go:365] "RemoveStaleState removing state" podUID="f6a9c117-c010-4e65-964d-6ac6b6ecbfc5" containerName="maas-api"
Oct 31 18:02:24.364224 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:02:24.364201    5003 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-csf86/perf-node-gather-daemonset-z6zwr"
Oct 31 18:02:24.382617 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:02:24.382591    5003 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-csf86/perf-node-gather-daemonset-z6zwr"]
Oct 31 18:02:24.393730 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:02:24.393708    5003 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-csf86\"/\"default-dockercfg-5qfvc\""
Oct 31 18:02:24.438322 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:02:24.438295    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/f4e0b292-5066-49c2-92ef-f1ec188d4e21-podres\") pod \"perf-node-gather-daemonset-z6zwr\" (UID: \"f4e0b292-5066-49c2-92ef-f1ec188d4e21\") " pod="openshift-must-gather-csf86/perf-node-gather-daemonset-z6zwr"
Oct 31 18:02:24.438505 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:02:24.438336    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f4e0b292-5066-49c2-92ef-f1ec188d4e21-sys\") pod \"perf-node-gather-daemonset-z6zwr\" (UID: \"f4e0b292-5066-49c2-92ef-f1ec188d4e21\") " pod="openshift-must-gather-csf86/perf-node-gather-daemonset-z6zwr"
Oct 31 18:02:24.438505 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:02:24.438456    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/f4e0b292-5066-49c2-92ef-f1ec188d4e21-proc\") pod \"perf-node-gather-daemonset-z6zwr\" (UID: \"f4e0b292-5066-49c2-92ef-f1ec188d4e21\") " pod="openshift-must-gather-csf86/perf-node-gather-daemonset-z6zwr"
Oct 31 18:02:24.438615 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:02:24.438527    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tpcc9\" (UniqueName: \"kubernetes.io/projected/f4e0b292-5066-49c2-92ef-f1ec188d4e21-kube-api-access-tpcc9\") pod \"perf-node-gather-daemonset-z6zwr\" (UID: \"f4e0b292-5066-49c2-92ef-f1ec188d4e21\") " pod="openshift-must-gather-csf86/perf-node-gather-daemonset-z6zwr"
Oct 31 18:02:24.438670 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:02:24.438615    5003 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f4e0b292-5066-49c2-92ef-f1ec188d4e21-lib-modules\") pod \"perf-node-gather-daemonset-z6zwr\" (UID: \"f4e0b292-5066-49c2-92ef-f1ec188d4e21\") " pod="openshift-must-gather-csf86/perf-node-gather-daemonset-z6zwr"
Oct 31 18:02:24.475998 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:02:24.475962    5003 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-csf86\"/\"openshift-service-ca.crt\""
Oct 31 18:02:24.476142 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:02:24.476060    5003 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-csf86\"/\"kube-root-ca.crt\""
Oct 31 18:02:24.539387 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:02:24.539360    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f4e0b292-5066-49c2-92ef-f1ec188d4e21-lib-modules\") pod \"perf-node-gather-daemonset-z6zwr\" (UID: \"f4e0b292-5066-49c2-92ef-f1ec188d4e21\") " pod="openshift-must-gather-csf86/perf-node-gather-daemonset-z6zwr"
Oct 31 18:02:24.539563 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:02:24.539423    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/f4e0b292-5066-49c2-92ef-f1ec188d4e21-podres\") pod \"perf-node-gather-daemonset-z6zwr\" (UID: \"f4e0b292-5066-49c2-92ef-f1ec188d4e21\") " pod="openshift-must-gather-csf86/perf-node-gather-daemonset-z6zwr"
Oct 31 18:02:24.539563 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:02:24.539446    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f4e0b292-5066-49c2-92ef-f1ec188d4e21-sys\") pod \"perf-node-gather-daemonset-z6zwr\" (UID: \"f4e0b292-5066-49c2-92ef-f1ec188d4e21\") " pod="openshift-must-gather-csf86/perf-node-gather-daemonset-z6zwr"
Oct 31 18:02:24.539563 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:02:24.539489    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/f4e0b292-5066-49c2-92ef-f1ec188d4e21-proc\") pod \"perf-node-gather-daemonset-z6zwr\" (UID: \"f4e0b292-5066-49c2-92ef-f1ec188d4e21\") " pod="openshift-must-gather-csf86/perf-node-gather-daemonset-z6zwr"
Oct 31 18:02:24.539563 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:02:24.539519    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f4e0b292-5066-49c2-92ef-f1ec188d4e21-lib-modules\") pod \"perf-node-gather-daemonset-z6zwr\" (UID: \"f4e0b292-5066-49c2-92ef-f1ec188d4e21\") " pod="openshift-must-gather-csf86/perf-node-gather-daemonset-z6zwr"
Oct 31 18:02:24.539563 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:02:24.539544    5003 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tpcc9\" (UniqueName: \"kubernetes.io/projected/f4e0b292-5066-49c2-92ef-f1ec188d4e21-kube-api-access-tpcc9\") pod \"perf-node-gather-daemonset-z6zwr\" (UID: \"f4e0b292-5066-49c2-92ef-f1ec188d4e21\") " pod="openshift-must-gather-csf86/perf-node-gather-daemonset-z6zwr"
Oct 31 18:02:24.539833 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:02:24.539571    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f4e0b292-5066-49c2-92ef-f1ec188d4e21-sys\") pod \"perf-node-gather-daemonset-z6zwr\" (UID: \"f4e0b292-5066-49c2-92ef-f1ec188d4e21\") " pod="openshift-must-gather-csf86/perf-node-gather-daemonset-z6zwr"
Oct 31 18:02:24.539833 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:02:24.539529    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/f4e0b292-5066-49c2-92ef-f1ec188d4e21-podres\") pod \"perf-node-gather-daemonset-z6zwr\" (UID: \"f4e0b292-5066-49c2-92ef-f1ec188d4e21\") " pod="openshift-must-gather-csf86/perf-node-gather-daemonset-z6zwr"
Oct 31 18:02:24.539833 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:02:24.539728    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/f4e0b292-5066-49c2-92ef-f1ec188d4e21-proc\") pod \"perf-node-gather-daemonset-z6zwr\" (UID: \"f4e0b292-5066-49c2-92ef-f1ec188d4e21\") " pod="openshift-must-gather-csf86/perf-node-gather-daemonset-z6zwr"
Oct 31 18:02:24.560299 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:02:24.560272    5003 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tpcc9\" (UniqueName: \"kubernetes.io/projected/f4e0b292-5066-49c2-92ef-f1ec188d4e21-kube-api-access-tpcc9\") pod \"perf-node-gather-daemonset-z6zwr\" (UID: \"f4e0b292-5066-49c2-92ef-f1ec188d4e21\") " pod="openshift-must-gather-csf86/perf-node-gather-daemonset-z6zwr"
Oct 31 18:02:24.678640 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:02:24.678561    5003 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-csf86/perf-node-gather-daemonset-z6zwr"
Oct 31 18:02:24.975482 ip-10-0-138-17 kubenswrapper[5003]: W1031 18:02:24.975451    5003 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podf4e0b292_5066_49c2_92ef_f1ec188d4e21.slice/crio-68de5945160b976a9cb56e8190dbdb0e0e7f0f883eada701b4b65f1cb33791fe WatchSource:0}: Error finding container 68de5945160b976a9cb56e8190dbdb0e0e7f0f883eada701b4b65f1cb33791fe: Status 404 returned error can't find the container with id 68de5945160b976a9cb56e8190dbdb0e0e7f0f883eada701b4b65f1cb33791fe
Oct 31 18:02:25.069054 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:02:25.069026    5003 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-csf86/perf-node-gather-daemonset-z6zwr"]
Oct 31 18:02:25.396135 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:02:25.396101    5003 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-884576c57-csbxp_a1bea244-6573-4e3c-9849-b27ade411c9f/cluster-monitoring-operator/0.log"
Oct 31 18:02:25.936160 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:02:25.936122    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-csf86/perf-node-gather-daemonset-z6zwr" event={"ID":"f4e0b292-5066-49c2-92ef-f1ec188d4e21","Type":"ContainerStarted","Data":"2982afab365b23463a0c34f2f97db2f032030ceabfcfe46fce04383b258f9b0f"}
Oct 31 18:02:25.936345 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:02:25.936277    5003 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-csf86/perf-node-gather-daemonset-z6zwr"
Oct 31 18:02:25.936345 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:02:25.936322    5003 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-csf86/perf-node-gather-daemonset-z6zwr" event={"ID":"f4e0b292-5066-49c2-92ef-f1ec188d4e21","Type":"ContainerStarted","Data":"68de5945160b976a9cb56e8190dbdb0e0e7f0f883eada701b4b65f1cb33791fe"}
Oct 31 18:02:25.978509 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:02:25.978459    5003 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-must-gather-csf86/perf-node-gather-daemonset-z6zwr" podStartSLOduration=1.978445465 podStartE2EDuration="1.978445465s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-31 18:02:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 18:02:25.977036445 +0000 UTC m=+2114.231890984" watchObservedRunningTime="2026-10-31 18:02:25.978445465 +0000 UTC m=+2114.233300006"
Oct 31 18:02:26.813301 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:02:26.813264    5003 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-tv8g4_282d8289-dbbd-427e-86a1-f17c37ef70e4/node-exporter/0.log"
Oct 31 18:02:26.928158 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:02:26.928129    5003 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-tv8g4_282d8289-dbbd-427e-86a1-f17c37ef70e4/kube-rbac-proxy/0.log"
Oct 31 18:02:27.044175 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:02:27.044140    5003 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-tv8g4_282d8289-dbbd-427e-86a1-f17c37ef70e4/init-textfile/0.log"
Oct 31 18:02:31.094333 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:02:31.094297    5003 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-86c478bb88-rnvgv_9a0cf7f7-c12d-42fe-a83e-28e1f1859cd2/networking-console-plugin/0.log"
Oct 31 18:02:31.952314 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:02:31.952279    5003 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-csf86/perf-node-gather-daemonset-z6zwr"
Oct 31 18:02:32.122559 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:02:32.122525    5003 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-b2xxw_f03611db-3bd9-401a-a137-1d4f691b51ea/console-operator/2.log"
Oct 31 18:02:32.128832 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:02:32.128807    5003 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-b2xxw_f03611db-3bd9-401a-a137-1d4f691b51ea/console-operator/3.log"
Oct 31 18:02:34.498310 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:02:34.498279    5003 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-58c9f5f46d-th5tq_a7959bdf-3723-4ee9-a587-6cd16e28d4b1/volume-data-source-validator/0.log"
Oct 31 18:02:37.070468 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:02:37.070431    5003 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-858f55f4d98wwvr_0bb9875d-53a6-4105-89da-16e0bbd2c3a1/istio-proxy/0.log"
Oct 31 18:02:37.251072 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:02:37.251037    5003 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-7v7x4_25ad5c67-f563-4653-9e86-7e9ecbe78675/dns/0.log"
Oct 31 18:02:37.365799 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:02:37.365697    5003 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-7v7x4_25ad5c67-f563-4653-9e86-7e9ecbe78675/kube-rbac-proxy/0.log"
Oct 31 18:02:37.732130 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:02:37.732025    5003 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-x25tg_eaed4088-d322-48ab-af04-3c9efdea4e73/dns-node-resolver/0.log"
Oct 31 18:02:37.861263 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:02:37.861227    5003 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-7ddd9cfdc8-bdlh9_42e93792-9b87-4637-89df-62b5836971f9/discovery/0.log"
Oct 31 18:02:38.094581 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:02:38.094549    5003 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-7d9897b54c-7smk2_effd3895-446f-4877-8218-6414ce2e321b/istio-proxy/0.log"
Oct 31 18:02:38.096427 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:02:38.096393    5003 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-7d9897b54c-7smk2_effd3895-446f-4877-8218-6414ce2e321b/istio-proxy/1.log"
Oct 31 18:02:38.200192 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:02:38.200162    5003 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-7d9897b54c-9t8k2_c8d0a165-562c-4602-95fe-35a62229fa4f/istio-proxy/0.log"
Oct 31 18:02:38.600418 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:02:38.600387    5003 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-7d9897b54c-z6b99_838478fc-1a24-432e-bb93-15d49ee7e1ed/istio-proxy/0.log"
Oct 31 18:02:38.662249 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:02:38.662217    5003 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_openshift-ai-inference-openshift-ai-inference-6dd6bfb767-t8zg4_9d187bce-1d54-4dd5-b7d3-ee25ca1057f7/istio-proxy/0.log"
Oct 31 18:02:38.851949 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:02:38.851856    5003 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-65db5d9749-xvqmh_50e82975-3344-4653-8de3-68e8a64a8757/router/0.log"
Oct 31 18:02:39.005469 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:02:39.005436    5003 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-lcz9q_c915138c-9050-4958-b442-fee1aca9b002/node-ca/0.log"
Oct 31 18:02:40.331753 ip-10-0-138-17 kubenswrapper[5003]: E1031 18:02:40.331715    5003 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-tdzz5" containerName="extractor"
Oct 31 18:02:40.981751 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:02:40.981721    5003 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-858f55f4d98wwvr_0bb9875d-53a6-4105-89da-16e0bbd2c3a1/istio-proxy/0.log"
Oct 31 18:02:41.379054 ip-10-0-138-17 kubenswrapper[5003]: I1031 18:02:41.379024    5003 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-858f55f4d98wwvr_0bb9875d-53a6-4105-89da-16e0bbd2c3a1/istio-proxy/0.log"