Oct 30 19:44:49.084228 ip-10-0-131-26 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Oct 30 19:44:49.084239 ip-10-0-131-26 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Oct 30 19:44:49.084246 ip-10-0-131-26 systemd[1]: kubelet.service: Failed with result 'resources'.
Oct 30 19:44:49.084489 ip-10-0-131-26 systemd[1]: Failed to start Kubernetes Kubelet.
Oct 30 19:44:59.310496 ip-10-0-131-26 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Oct 30 19:44:59.310513 ip-10-0-131-26 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 3508544556cc4df28755aacbea99658f --
Oct 30 19:46:57.829694 ip-10-0-131-26 systemd[1]: Starting Kubernetes Kubelet...
Oct 30 19:46:58.226660 ip-10-0-131-26 kubenswrapper[2582]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Oct 30 19:46:58.226660 ip-10-0-131-26 kubenswrapper[2582]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Oct 30 19:46:58.226660 ip-10-0-131-26 kubenswrapper[2582]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Oct 30 19:46:58.226660 ip-10-0-131-26 kubenswrapper[2582]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Oct 30 19:46:58.230585 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.230462    2582 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 19:46:58.230585 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.230585    2582 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 19:46:58.230668 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.230590    2582 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 19:46:58.230668 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.230594    2582 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 19:46:58.230668 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.230609    2582 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 19:46:58.230668 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.230612    2582 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 19:46:58.230668 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.230615    2582 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 19:46:58.230668 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.230618    2582 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 19:46:58.230668 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.230620    2582 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 19:46:58.230668 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.230623    2582 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 19:46:58.230668 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.230631    2582 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 19:46:58.230668 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.230634    2582 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 19:46:58.230668 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.230637    2582 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 19:46:58.230668 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.230641    2582 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 19:46:58.230668 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.230644    2582 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 19:46:58.230668 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.230646    2582 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 19:46:58.230668 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.230649    2582 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 19:46:58.230668 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.230652    2582 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 19:46:58.230668 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.230656    2582 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 19:46:58.230668 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.230660    2582 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 19:46:58.230668 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.230663    2582 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 19:46:58.231098 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.230667    2582 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 19:46:58.231098 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.230669    2582 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 19:46:58.231098 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.230673    2582 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 19:46:58.231098 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.230675    2582 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 19:46:58.231098 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.230678    2582 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 19:46:58.231098 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.230681    2582 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 19:46:58.231098 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.230684    2582 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 19:46:58.231098 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.230686    2582 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 19:46:58.231098 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.230689    2582 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 19:46:58.231098 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.230692    2582 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 19:46:58.231098 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.230694    2582 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 19:46:58.231098 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.230697    2582 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 19:46:58.231098 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.230699    2582 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 19:46:58.231098 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.230702    2582 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 19:46:58.231098 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.230704    2582 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 19:46:58.231098 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.230707    2582 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 19:46:58.231098 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.230709    2582 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 19:46:58.231098 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.230712    2582 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 19:46:58.231098 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.230715    2582 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 19:46:58.231551 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.230717    2582 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 19:46:58.231551 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.230720    2582 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 19:46:58.231551 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.230722    2582 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 19:46:58.231551 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.230725    2582 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 19:46:58.231551 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.230728    2582 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 19:46:58.231551 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.230730    2582 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 19:46:58.231551 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.230733    2582 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 19:46:58.231551 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.230735    2582 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 19:46:58.231551 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.230738    2582 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 19:46:58.231551 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.230741    2582 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 19:46:58.231551 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.230745    2582 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 19:46:58.231551 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.230749    2582 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 19:46:58.231551 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.230752    2582 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 19:46:58.231551 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.230755    2582 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 19:46:58.231551 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.230758    2582 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 19:46:58.231551 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.230761    2582 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 19:46:58.231551 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.230764    2582 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 19:46:58.231551 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.230767    2582 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 19:46:58.231551 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.230769    2582 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 19:46:58.231551 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.230772    2582 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 19:46:58.232015 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.230775    2582 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 19:46:58.232015 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.230777    2582 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 19:46:58.232015 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.230780    2582 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 19:46:58.232015 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.230783    2582 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 19:46:58.232015 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.230785    2582 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 19:46:58.232015 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.230788    2582 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 19:46:58.232015 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.230791    2582 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 19:46:58.232015 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.230794    2582 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 19:46:58.232015 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.230796    2582 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 19:46:58.232015 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.230799    2582 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 19:46:58.232015 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.230801    2582 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 19:46:58.232015 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.230804    2582 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 19:46:58.232015 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.230807    2582 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 19:46:58.232015 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.230810    2582 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 19:46:58.232015 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.230812    2582 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 19:46:58.232015 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.230815    2582 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 19:46:58.232015 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.230817    2582 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 19:46:58.232015 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.230820    2582 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 19:46:58.232015 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.230822    2582 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 19:46:58.232468 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.230825    2582 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 19:46:58.232468 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.230828    2582 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 19:46:58.232468 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.230830    2582 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 19:46:58.232468 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.230833    2582 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 19:46:58.232468 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.230835    2582 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 19:46:58.232468 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.230839    2582 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 19:46:58.232468 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.230841    2582 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 19:46:58.232468 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.230845    2582 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 19:46:58.232468 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.230848    2582 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 19:46:58.232468 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.230850    2582 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 19:46:58.232468 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.230853    2582 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 19:46:58.232468 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.230855    2582 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 19:46:58.232468 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.230858    2582 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 19:46:58.232468 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.230860    2582 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 19:46:58.232468 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.230863    2582 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 19:46:58.232468 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.230865    2582 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 19:46:58.232468 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.230868    2582 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 19:46:58.232468 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.230871    2582 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 19:46:58.232468 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.230874    2582 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 19:46:58.232972 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.230877    2582 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 19:46:58.232972 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.230879    2582 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 19:46:58.232972 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.230882    2582 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 19:46:58.232972 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.230884    2582 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 19:46:58.232972 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.230887    2582 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 19:46:58.232972 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.230889    2582 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 19:46:58.232972 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.230892    2582 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 19:46:58.232972 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.230894    2582 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 19:46:58.232972 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.231668    2582 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 19:46:58.232972 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.231674    2582 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 19:46:58.232972 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.231677    2582 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 19:46:58.232972 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.231680    2582 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 19:46:58.232972 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.231682    2582 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 19:46:58.232972 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.231686    2582 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 19:46:58.232972 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.231689    2582 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 19:46:58.232972 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.231691    2582 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 19:46:58.232972 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.231694    2582 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 19:46:58.232972 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.231698    2582 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 19:46:58.232972 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.231703    2582 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 19:46:58.232972 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.231706    2582 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 19:46:58.233487 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.231710    2582 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 19:46:58.233487 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.231713    2582 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 19:46:58.233487 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.231715    2582 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 19:46:58.233487 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.231718    2582 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 19:46:58.233487 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.231721    2582 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 19:46:58.233487 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.231723    2582 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 19:46:58.233487 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.231726    2582 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 19:46:58.233487 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.231728    2582 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 19:46:58.233487 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.231731    2582 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 19:46:58.233487 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.231733    2582 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 19:46:58.233487 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.231736    2582 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 19:46:58.233487 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.231739    2582 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 19:46:58.233487 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.231741    2582 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 19:46:58.233487 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.231747    2582 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 19:46:58.233487 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.231750    2582 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 19:46:58.233487 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.231753    2582 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 19:46:58.233487 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.231755    2582 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 19:46:58.233487 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.231758    2582 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 19:46:58.233487 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.231761    2582 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 19:46:58.233487 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.231763    2582 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 19:46:58.233971 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.231766    2582 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 19:46:58.233971 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.231768    2582 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 19:46:58.233971 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.231771    2582 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 19:46:58.233971 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.231773    2582 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 19:46:58.233971 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.231776    2582 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 19:46:58.233971 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.231779    2582 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 19:46:58.233971 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.231781    2582 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 19:46:58.233971 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.231783    2582 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 19:46:58.233971 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.231786    2582 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 19:46:58.233971 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.231788    2582 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 19:46:58.233971 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.231791    2582 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 19:46:58.233971 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.231794    2582 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 19:46:58.233971 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.231796    2582 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 19:46:58.233971 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.231799    2582 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 19:46:58.233971 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.231802    2582 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 19:46:58.233971 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.231805    2582 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 19:46:58.233971 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.231807    2582 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 19:46:58.233971 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.231810    2582 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 19:46:58.233971 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.231812    2582 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 19:46:58.233971 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.231815    2582 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 19:46:58.234445 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.231817    2582 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 19:46:58.234445 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.231819    2582 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 19:46:58.234445 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.231822    2582 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 19:46:58.234445 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.231825    2582 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 19:46:58.234445 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.231828    2582 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 19:46:58.234445 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.231830    2582 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 19:46:58.234445 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.231833    2582 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 19:46:58.234445 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.231837    2582 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 19:46:58.234445 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.231839    2582 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 19:46:58.234445 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.231842    2582 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 19:46:58.234445 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.231844    2582 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 19:46:58.234445 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.231848    2582 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 19:46:58.234445 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.231852    2582 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 19:46:58.234445 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.231855    2582 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 19:46:58.234445 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.231858    2582 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 19:46:58.234445 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.231861    2582 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 19:46:58.234445 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.231863    2582 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 19:46:58.234445 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.231866    2582 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 19:46:58.234445 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.231869    2582 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 19:46:58.234902 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.231871    2582 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 19:46:58.234902 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.231874    2582 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 19:46:58.234902 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.231876    2582 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 19:46:58.234902 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.231879    2582 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 19:46:58.234902 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.231881    2582 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 19:46:58.234902 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.231883    2582 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 19:46:58.234902 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.231886    2582 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 19:46:58.234902 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.231889    2582 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 19:46:58.234902 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.231892    2582 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 19:46:58.234902 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.231895    2582 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 19:46:58.234902 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.231898    2582 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 19:46:58.234902 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.231900    2582 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 19:46:58.234902 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.231903    2582 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 19:46:58.234902 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.231905    2582 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 19:46:58.234902 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.231908    2582 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 19:46:58.234902 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.231910    2582 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 19:46:58.234902 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.231913    2582 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 19:46:58.234902 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.231915    2582 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 19:46:58.234902 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.231918    2582 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 19:46:58.234902 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.231920    2582 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 19:46:58.235352 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.231924    2582 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 19:46:58.235352 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.231927    2582 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 19:46:58.235352 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.231929    2582 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 19:46:58.235352 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.231932    2582 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 19:46:58.235352 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.231935    2582 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 19:46:58.235352 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.231938    2582 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 19:46:58.235352 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.231941    2582 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 19:46:58.235352 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.231943    2582 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 19:46:58.235352 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.231946    2582 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 19:46:58.235352 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.231950    2582 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 19:46:58.235352 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.231952    2582 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 19:46:58.235352 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.231955    2582 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 19:46:58.235352 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.231958    2582 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 19:46:58.235352 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.231960    2582 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 19:46:58.235352 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.231963    2582 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 19:46:58.235352 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.232473    2582 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 19:46:58.235352 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.232479    2582 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 19:46:58.235352 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.232482    2582 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 19:46:58.235352 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.232485    2582 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 19:46:58.235807 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.232488    2582 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 19:46:58.235807 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.232493    2582 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 19:46:58.235807 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.232496    2582 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 19:46:58.235807 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.232498    2582 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 19:46:58.235807 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.232501    2582 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 19:46:58.235807 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.232504    2582 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 19:46:58.235807 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.232506    2582 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 19:46:58.235807 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.232509    2582 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 19:46:58.235807 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.232511    2582 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 19:46:58.235807 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.232514    2582 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 19:46:58.235807 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.232517    2582 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 19:46:58.235807 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.232519    2582 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 19:46:58.235807 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.232522    2582 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 19:46:58.235807 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.232530    2582 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 19:46:58.235807 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.232533    2582 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 19:46:58.235807 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.232536    2582 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 19:46:58.235807 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.232538    2582 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 19:46:58.235807 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.232541    2582 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 19:46:58.235807 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.232544    2582 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 19:46:58.235807 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.232546    2582 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 19:46:58.236355 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.232549    2582 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 19:46:58.236355 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.232552    2582 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 19:46:58.236355 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.232554    2582 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 19:46:58.236355 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.232558    2582 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 19:46:58.236355 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.232562    2582 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 19:46:58.236355 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.232564    2582 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 19:46:58.236355 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.232567    2582 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 19:46:58.236355 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.232569    2582 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 19:46:58.236355 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.232572    2582 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 19:46:58.236355 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.232574    2582 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 19:46:58.236355 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.232577    2582 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 19:46:58.236355 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.232580    2582 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 19:46:58.236355 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.232582    2582 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 19:46:58.236355 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.232586    2582 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 19:46:58.236355 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.232589    2582 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 19:46:58.236355 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.232591    2582 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 19:46:58.236355 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.232594    2582 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 19:46:58.236355 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.232596    2582 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 19:46:58.236355 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.232599    2582 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 19:46:58.236355 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.232601    2582 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 19:46:58.236833 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.232604    2582 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 19:46:58.236833 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.232606    2582 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 19:46:58.236833 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.232609    2582 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 19:46:58.236833 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.232611    2582 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 19:46:58.236833 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.232614    2582 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 19:46:58.236833 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.232616    2582 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 19:46:58.236833 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.232624    2582 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 19:46:58.236833 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.232627    2582 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 19:46:58.236833 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.232629    2582 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 19:46:58.236833 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.232632    2582 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 19:46:58.236833 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.232634    2582 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 19:46:58.236833 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.232637    2582 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 19:46:58.236833 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.232640    2582 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 19:46:58.236833 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.232643    2582 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 19:46:58.236833 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.232645    2582 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 19:46:58.236833 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.232648    2582 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 19:46:58.236833 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.232650    2582 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 19:46:58.236833 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.232653    2582 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 19:46:58.236833 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.232655    2582 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 19:46:58.236833 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.232657    2582 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 19:46:58.237301 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.232660    2582 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 19:46:58.237301 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.232664    2582 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 19:46:58.237301 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.232666    2582 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 19:46:58.237301 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.232668    2582 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 19:46:58.237301 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.232671    2582 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 19:46:58.237301 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.232675    2582 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 19:46:58.237301 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.232677    2582 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 19:46:58.237301 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.232680    2582 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 19:46:58.237301 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.232682    2582 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 19:46:58.237301 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.232686    2582 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 19:46:58.237301 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.232690    2582 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 19:46:58.237301 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.232693    2582 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 19:46:58.237301 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.232696    2582 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 19:46:58.237301 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.232698    2582 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 19:46:58.237301 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.232701    2582 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 19:46:58.237301 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.232703    2582 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 19:46:58.237301 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.232706    2582 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 19:46:58.237301 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.232708    2582 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 19:46:58.237812 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.232711    2582 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 19:46:58.237812 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.232719    2582 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 19:46:58.237812 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.232721    2582 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 19:46:58.237812 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.232724    2582 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 19:46:58.237812 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.232727    2582 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 19:46:58.237812 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.232730    2582 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 19:46:58.237812 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.232732    2582 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 19:46:58.237812 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.232735    2582 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 19:46:58.237812 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.232738    2582 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 19:46:58.237812 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.232740    2582 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 19:46:58.237812 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.232743    2582 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 19:46:58.237812 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.232745    2582 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 19:46:58.237812 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.232748    2582 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 19:46:58.237812 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.232751    2582 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 19:46:58.237812 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.232753    2582 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 19:46:58.237812 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.232757    2582 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 19:46:58.237812 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.232771    2582 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 19:46:58.237812 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.232774    2582 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 19:46:58.237812 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.232777    2582 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 19:46:58.237812 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.232782    2582 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 19:46:58.238299 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.232785    2582 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 19:46:58.238299 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.232787    2582 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 19:46:58.238299 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.232790    2582 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 19:46:58.238299 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.232792    2582 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 19:46:58.238299 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:46:58.233813    2582 flags.go:64] FLAG: --address="0.0.0.0"
Oct 30 19:46:58.238299 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:46:58.233823    2582 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Oct 30 19:46:58.238299 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:46:58.233833    2582 flags.go:64] FLAG: --anonymous-auth="true"
Oct 30 19:46:58.238299 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:46:58.233841    2582 flags.go:64] FLAG: --application-metrics-count-limit="100"
Oct 30 19:46:58.238299 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:46:58.233846    2582 flags.go:64] FLAG: --authentication-token-webhook="false"
Oct 30 19:46:58.238299 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:46:58.233849    2582 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Oct 30 19:46:58.238299 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:46:58.233854    2582 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Oct 30 19:46:58.238299 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:46:58.233858    2582 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Oct 30 19:46:58.238299 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:46:58.233862    2582 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Oct 30 19:46:58.238299 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:46:58.233865    2582 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Oct 30 19:46:58.238299 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:46:58.233875    2582 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Oct 30 19:46:58.238299 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:46:58.233879    2582 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Oct 30 19:46:58.238299 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:46:58.233882    2582 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Oct 30 19:46:58.238299 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:46:58.233886    2582 flags.go:64] FLAG: --cgroup-root=""
Oct 30 19:46:58.238299 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:46:58.233889    2582 flags.go:64] FLAG: --cgroups-per-qos="true"
Oct 30 19:46:58.238299 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:46:58.233892    2582 flags.go:64] FLAG: --client-ca-file=""
Oct 30 19:46:58.238299 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:46:58.233895    2582 flags.go:64] FLAG: --cloud-provider="external"
Oct 30 19:46:58.238299 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:46:58.233898    2582 flags.go:64] FLAG: --cluster-dns="[]"
Oct 30 19:46:58.238299 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:46:58.233905    2582 flags.go:64] FLAG: --cluster-domain=""
Oct 30 19:46:58.238851 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:46:58.233908    2582 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Oct 30 19:46:58.238851 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:46:58.233911    2582 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Oct 30 19:46:58.238851 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:46:58.233914    2582 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Oct 30 19:46:58.238851 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:46:58.233919    2582 flags.go:64] FLAG: --container-log-max-files="5"
Oct 30 19:46:58.238851 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:46:58.233922    2582 flags.go:64] FLAG: --container-log-max-size="10Mi"
Oct 30 19:46:58.238851 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:46:58.233925    2582 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Oct 30 19:46:58.238851 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:46:58.233928    2582 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Oct 30 19:46:58.238851 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:46:58.233932    2582 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Oct 30 19:46:58.238851 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:46:58.233935    2582 flags.go:64] FLAG: --contention-profiling="false"
Oct 30 19:46:58.238851 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:46:58.233939    2582 flags.go:64] FLAG: --cpu-cfs-quota="true"
Oct 30 19:46:58.238851 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:46:58.233942    2582 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Oct 30 19:46:58.238851 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:46:58.233945    2582 flags.go:64] FLAG: --cpu-manager-policy="none"
Oct 30 19:46:58.238851 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:46:58.233948    2582 flags.go:64] FLAG: --cpu-manager-policy-options=""
Oct 30 19:46:58.238851 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:46:58.233952    2582 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Oct 30 19:46:58.238851 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:46:58.233955    2582 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Oct 30 19:46:58.238851 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:46:58.233959    2582 flags.go:64] FLAG: --enable-debugging-handlers="true"
Oct 30 19:46:58.238851 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:46:58.233961    2582 flags.go:64] FLAG: --enable-load-reader="false"
Oct 30 19:46:58.238851 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:46:58.233964    2582 flags.go:64] FLAG: --enable-server="true"
Oct 30 19:46:58.238851 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:46:58.233967    2582 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Oct 30 19:46:58.238851 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:46:58.233975    2582 flags.go:64] FLAG: --event-burst="100"
Oct 30 19:46:58.238851 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:46:58.233979    2582 flags.go:64] FLAG: --event-qps="50"
Oct 30 19:46:58.238851 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:46:58.233982    2582 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Oct 30 19:46:58.238851 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:46:58.233985    2582 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Oct 30 19:46:58.238851 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:46:58.233988    2582 flags.go:64] FLAG: --eviction-hard=""
Oct 30 19:46:58.239428 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:46:58.234012    2582 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Oct 30 19:46:58.239428 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:46:58.234017    2582 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Oct 30 19:46:58.239428 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:46:58.234020    2582 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Oct 30 19:46:58.239428 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:46:58.234023    2582 flags.go:64] FLAG: --eviction-soft=""
Oct 30 19:46:58.239428 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:46:58.234026    2582 flags.go:64] FLAG: --eviction-soft-grace-period=""
Oct 30 19:46:58.239428 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:46:58.234029    2582 flags.go:64] FLAG: --exit-on-lock-contention="false"
Oct 30 19:46:58.239428 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:46:58.234032    2582 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Oct 30 19:46:58.239428 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:46:58.234035    2582 flags.go:64] FLAG: --experimental-mounter-path=""
Oct 30 19:46:58.239428 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:46:58.234038    2582 flags.go:64] FLAG: --fail-cgroupv1="true"
Oct 30 19:46:58.239428 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:46:58.234040    2582 flags.go:64] FLAG: --fail-swap-on="true"
Oct 30 19:46:58.239428 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:46:58.234044    2582 flags.go:64] FLAG: --feature-gates=""
Oct 30 19:46:58.239428 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:46:58.234048    2582 flags.go:64] FLAG: --file-check-frequency="20s"
Oct 30 19:46:58.239428 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:46:58.234051    2582 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Oct 30 19:46:58.239428 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:46:58.234054    2582 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Oct 30 19:46:58.239428 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:46:58.234057    2582 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Oct 30 19:46:58.239428 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:46:58.234060    2582 flags.go:64] FLAG: --healthz-port="10248"
Oct 30 19:46:58.239428 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:46:58.234063    2582 flags.go:64] FLAG: --help="false"
Oct 30 19:46:58.239428 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:46:58.234066    2582 flags.go:64] FLAG: --hostname-override="ip-10-0-131-26.ec2.internal"
Oct 30 19:46:58.239428 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:46:58.234069    2582 flags.go:64] FLAG: --housekeeping-interval="10s"
Oct 30 19:46:58.239428 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:46:58.234072    2582 flags.go:64] FLAG: --http-check-frequency="20s"
Oct 30 19:46:58.239428 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:46:58.234075    2582 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Oct 30 19:46:58.239428 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:46:58.234078    2582 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Oct 30 19:46:58.239428 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:46:58.234082    2582 flags.go:64] FLAG: --image-gc-high-threshold="85"
Oct 30 19:46:58.239952 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:46:58.234085    2582 flags.go:64] FLAG: --image-gc-low-threshold="80"
Oct 30 19:46:58.239952 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:46:58.234087    2582 flags.go:64] FLAG: --image-service-endpoint=""
Oct 30 19:46:58.239952 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:46:58.234090    2582 flags.go:64] FLAG: --kernel-memcg-notification="false"
Oct 30 19:46:58.239952 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:46:58.234093    2582 flags.go:64] FLAG: --kube-api-burst="100"
Oct 30 19:46:58.239952 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:46:58.234096    2582 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Oct 30 19:46:58.239952 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:46:58.234100    2582 flags.go:64] FLAG: --kube-api-qps="50"
Oct 30 19:46:58.239952 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:46:58.234103    2582 flags.go:64] FLAG: --kube-reserved=""
Oct 30 19:46:58.239952 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:46:58.234106    2582 flags.go:64] FLAG: --kube-reserved-cgroup=""
Oct 30 19:46:58.239952 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:46:58.234108    2582 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Oct 30 19:46:58.239952 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:46:58.234112    2582 flags.go:64] FLAG: --kubelet-cgroups=""
Oct 30 19:46:58.239952 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:46:58.234120    2582 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Oct 30 19:46:58.239952 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:46:58.234124    2582 flags.go:64] FLAG: --lock-file=""
Oct 30 19:46:58.239952 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:46:58.234127    2582 flags.go:64] FLAG: --log-cadvisor-usage="false"
Oct 30 19:46:58.239952 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:46:58.234130    2582 flags.go:64] FLAG: --log-flush-frequency="5s"
Oct 30 19:46:58.239952 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:46:58.234133    2582 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Oct 30 19:46:58.239952 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:46:58.234139    2582 flags.go:64] FLAG: --log-json-split-stream="false"
Oct 30 19:46:58.239952 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:46:58.234142    2582 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Oct 30 19:46:58.239952 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:46:58.234145    2582 flags.go:64] FLAG: --log-text-split-stream="false"
Oct 30 19:46:58.239952 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:46:58.234148    2582 flags.go:64] FLAG: --logging-format="text"
Oct 30 19:46:58.239952 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:46:58.234151    2582 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Oct 30 19:46:58.239952 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:46:58.234154    2582 flags.go:64] FLAG: --make-iptables-util-chains="true"
Oct 30 19:46:58.239952 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:46:58.234157    2582 flags.go:64] FLAG: --manifest-url=""
Oct 30 19:46:58.239952 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:46:58.234160    2582 flags.go:64] FLAG: --manifest-url-header=""
Oct 30 19:46:58.239952 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:46:58.234164    2582 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Oct 30 19:46:58.239952 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:46:58.234167    2582 flags.go:64] FLAG: --max-open-files="1000000"
Oct 30 19:46:58.240826 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:46:58.234171    2582 flags.go:64] FLAG: --max-pods="110"
Oct 30 19:46:58.240826 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:46:58.234175    2582 flags.go:64] FLAG: --maximum-dead-containers="-1"
Oct 30 19:46:58.240826 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:46:58.234178    2582 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Oct 30 19:46:58.240826 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:46:58.234181    2582 flags.go:64] FLAG: --memory-manager-policy="None"
Oct 30 19:46:58.240826 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:46:58.234183    2582 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Oct 30 19:46:58.240826 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:46:58.234187    2582 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Oct 30 19:46:58.240826 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:46:58.234189    2582 flags.go:64] FLAG: --node-ip="0.0.0.0"
Oct 30 19:46:58.240826 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:46:58.234192    2582 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Oct 30 19:46:58.240826 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:46:58.234199    2582 flags.go:64] FLAG: --node-status-max-images="50"
Oct 30 19:46:58.240826 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:46:58.234202    2582 flags.go:64] FLAG: --node-status-update-frequency="10s"
Oct 30 19:46:58.240826 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:46:58.234205    2582 flags.go:64] FLAG: --oom-score-adj="-999"
Oct 30 19:46:58.240826 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:46:58.234208    2582 flags.go:64] FLAG: --pod-cidr=""
Oct 30 19:46:58.240826 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:46:58.234211    2582 flags.go:64] FLAG: --pod-manifest-path=""
Oct 30 19:46:58.240826 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:46:58.234214    2582 flags.go:64] FLAG: --pod-max-pids="-1"
Oct 30 19:46:58.240826 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:46:58.234217    2582 flags.go:64] FLAG: --pods-per-core="0"
Oct 30 19:46:58.240826 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:46:58.234220    2582 flags.go:64] FLAG: --port="10250"
Oct 30 19:46:58.240826 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:46:58.234223    2582 flags.go:64] FLAG: --protect-kernel-defaults="false"
Oct 30 19:46:58.240826 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:46:58.234225    2582 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-04c2e28a1d6c5b9c4"
Oct 30 19:46:58.240826 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:46:58.234237    2582 flags.go:64] FLAG: --qos-reserved=""
Oct 30 19:46:58.240826 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:46:58.234240    2582 flags.go:64] FLAG: --read-only-port="10255"
Oct 30 19:46:58.240826 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:46:58.234243    2582 flags.go:64] FLAG: --register-node="true"
Oct 30 19:46:58.240826 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:46:58.234246    2582 flags.go:64] FLAG: --register-with-taints=""
Oct 30 19:46:58.240826 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:46:58.234250    2582 flags.go:64] FLAG: --registry-burst="10"
Oct 30 19:46:58.240826 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:46:58.234253    2582 flags.go:64] FLAG: --registry-qps="5"
Oct 30 19:46:58.240826 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:46:58.234256    2582 flags.go:64] FLAG: --reserved-cpus=""
Oct 30 19:46:58.240826 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:46:58.234259    2582 flags.go:64] FLAG: --reserved-memory=""
Oct 30 19:46:58.241766 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:46:58.234263    2582 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Oct 30 19:46:58.241766 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:46:58.234266    2582 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Oct 30 19:46:58.241766 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:46:58.234269    2582 flags.go:64] FLAG: --rotate-certificates="false"
Oct 30 19:46:58.241766 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:46:58.234272    2582 flags.go:64] FLAG: --rotate-server-certificates="false"
Oct 30 19:46:58.241766 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:46:58.234275    2582 flags.go:64] FLAG: --runonce="false"
Oct 30 19:46:58.241766 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:46:58.234278    2582 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Oct 30 19:46:58.241766 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:46:58.234281    2582 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Oct 30 19:46:58.241766 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:46:58.234284    2582 flags.go:64] FLAG: --seccomp-default="false"
Oct 30 19:46:58.241766 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:46:58.234287    2582 flags.go:64] FLAG: --serialize-image-pulls="true"
Oct 30 19:46:58.241766 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:46:58.234290    2582 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Oct 30 19:46:58.241766 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:46:58.234293    2582 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Oct 30 19:46:58.241766 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:46:58.234296    2582 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Oct 30 19:46:58.241766 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:46:58.234302    2582 flags.go:64] FLAG: --storage-driver-password="root"
Oct 30 19:46:58.241766 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:46:58.234305    2582 flags.go:64] FLAG: --storage-driver-secure="false"
Oct 30 19:46:58.241766 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:46:58.234308    2582 flags.go:64] FLAG: --storage-driver-table="stats"
Oct 30 19:46:58.241766 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:46:58.234311    2582 flags.go:64] FLAG: --storage-driver-user="root"
Oct 30 19:46:58.241766 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:46:58.234314    2582 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Oct 30 19:46:58.241766 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:46:58.234317    2582 flags.go:64] FLAG: --sync-frequency="1m0s"
Oct 30 19:46:58.241766 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:46:58.234320    2582 flags.go:64] FLAG: --system-cgroups=""
Oct 30 19:46:58.241766 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:46:58.234323    2582 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Oct 30 19:46:58.241766 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:46:58.234328    2582 flags.go:64] FLAG: --system-reserved-cgroup=""
Oct 30 19:46:58.241766 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:46:58.234331    2582 flags.go:64] FLAG: --tls-cert-file=""
Oct 30 19:46:58.241766 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:46:58.234334    2582 flags.go:64] FLAG: --tls-cipher-suites="[]"
Oct 30 19:46:58.241766 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:46:58.234341    2582 flags.go:64] FLAG: --tls-min-version=""
Oct 30 19:46:58.241766 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:46:58.234343    2582 flags.go:64] FLAG: --tls-private-key-file=""
Oct 30 19:46:58.242838 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:46:58.234352    2582 flags.go:64] FLAG: --topology-manager-policy="none"
Oct 30 19:46:58.242838 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:46:58.234355    2582 flags.go:64] FLAG: --topology-manager-policy-options=""
Oct 30 19:46:58.242838 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:46:58.234358    2582 flags.go:64] FLAG: --topology-manager-scope="container"
Oct 30 19:46:58.242838 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:46:58.234361    2582 flags.go:64] FLAG: --v="2"
Oct 30 19:46:58.242838 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:46:58.234365    2582 flags.go:64] FLAG: --version="false"
Oct 30 19:46:58.242838 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:46:58.234369    2582 flags.go:64] FLAG: --vmodule=""
Oct 30 19:46:58.242838 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:46:58.234373    2582 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Oct 30 19:46:58.242838 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:46:58.234376    2582 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Oct 30 19:46:58.242838 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.234589    2582 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 19:46:58.242838 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.234605    2582 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 19:46:58.242838 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.234608    2582 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 19:46:58.242838 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.234611    2582 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 19:46:58.242838 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.234614    2582 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 19:46:58.242838 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.234619    2582 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 19:46:58.242838 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.234621    2582 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 19:46:58.242838 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.234624    2582 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 19:46:58.242838 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.234626    2582 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 19:46:58.242838 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.234629    2582 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 19:46:58.242838 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.234632    2582 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 19:46:58.242838 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.234634    2582 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 19:46:58.243670 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.234637    2582 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 19:46:58.243670 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.234639    2582 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 19:46:58.243670 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.234643    2582 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 19:46:58.243670 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.234646    2582 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 19:46:58.243670 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.234649    2582 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 19:46:58.243670 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.234651    2582 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 19:46:58.243670 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.234654    2582 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 19:46:58.243670 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.234656    2582 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 19:46:58.243670 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.234659    2582 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 19:46:58.243670 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.234662    2582 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 19:46:58.243670 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.234664    2582 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 19:46:58.243670 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.234667    2582 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 19:46:58.243670 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.234670    2582 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 19:46:58.243670 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.234678    2582 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 19:46:58.243670 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.234681    2582 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 19:46:58.243670 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.234683    2582 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 19:46:58.243670 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.234686    2582 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 19:46:58.243670 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.234688    2582 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 19:46:58.243670 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.234691    2582 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 19:46:58.244466 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.234693    2582 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 19:46:58.244466 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.234696    2582 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 19:46:58.244466 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.234699    2582 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 19:46:58.244466 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.234701    2582 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 19:46:58.244466 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.234704    2582 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 19:46:58.244466 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.234707    2582 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 19:46:58.244466 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.234710    2582 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 19:46:58.244466 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.234713    2582 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 19:46:58.244466 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.234721    2582 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 19:46:58.244466 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.234724    2582 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 19:46:58.244466 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.234726    2582 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 19:46:58.244466 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.234729    2582 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 19:46:58.244466 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.234731    2582 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 19:46:58.244466 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.234734    2582 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 19:46:58.244466 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.234736    2582 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 19:46:58.244466 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.234740    2582 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 19:46:58.244466 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.234742    2582 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 19:46:58.244466 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.234745    2582 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 19:46:58.244466 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.234748    2582 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 19:46:58.244466 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.234750    2582 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 19:46:58.245290 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.234753    2582 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 19:46:58.245290 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.234755    2582 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 19:46:58.245290 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.234758    2582 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 19:46:58.245290 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.234760    2582 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 19:46:58.245290 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.234763    2582 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 19:46:58.245290 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.234765    2582 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 19:46:58.245290 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.234768    2582 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 19:46:58.245290 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.234777    2582 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 19:46:58.245290 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.234780    2582 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 19:46:58.245290 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.234783    2582 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 19:46:58.245290 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.234785    2582 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 19:46:58.245290 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.234788    2582 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 19:46:58.245290 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.234790    2582 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 19:46:58.245290 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.234793    2582 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 19:46:58.245290 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.234795    2582 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 19:46:58.245290 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.234798    2582 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 19:46:58.245290 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.234801    2582 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 19:46:58.245290 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.234803    2582 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 19:46:58.245290 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.234807    2582 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 19:46:58.245290 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.234810    2582 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 19:46:58.246215 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.234813    2582 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 19:46:58.246215 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.234815    2582 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 19:46:58.246215 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.234818    2582 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 19:46:58.246215 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.234820    2582 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 19:46:58.246215 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.234822    2582 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 19:46:58.246215 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.234825    2582 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 19:46:58.246215 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.234828    2582 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 19:46:58.246215 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.234831    2582 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 19:46:58.246215 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.234834    2582 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 19:46:58.246215 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.234836    2582 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 19:46:58.246215 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.234839    2582 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 19:46:58.246215 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.234842    2582 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 19:46:58.246215 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.234844    2582 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 19:46:58.246215 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.234847    2582 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 19:46:58.246215 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.234850    2582 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 19:46:58.246215 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.234853    2582 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 19:46:58.246215 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.234857    2582 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 19:46:58.246215 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.234861    2582 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 19:46:58.246215 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.234864    2582 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 19:46:58.246215 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.234866    2582 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 19:46:58.246848 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.234874    2582 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 19:46:58.246848 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.234878    2582 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 19:46:58.246848 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.234882    2582 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 19:46:58.246848 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.234885    2582 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 19:46:58.246848 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.234887    2582 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 19:46:58.246848 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.234890    2582 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 19:46:58.246848 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.234892    2582 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 19:46:58.246848 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.234895    2582 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 19:46:58.246848 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.234898    2582 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 19:46:58.246848 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.234900    2582 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 19:46:58.246848 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.234904    2582 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 19:46:58.246848 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.234907    2582 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 19:46:58.246848 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.234910    2582 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 19:46:58.246848 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.234912    2582 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 19:46:58.246848 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.234915    2582 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 19:46:58.246848 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:46:58.234942    2582 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]}
Oct 30 19:46:58.247478 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.234988    2582 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 19:46:58.247478 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.234992    2582 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 19:46:58.247478 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.234995    2582 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 19:46:58.247478 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.234998    2582 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 19:46:58.247478 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.235001    2582 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 19:46:58.247478 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.235004    2582 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 19:46:58.247478 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.235007    2582 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 19:46:58.247478 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.235010    2582 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 19:46:58.247478 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.235012    2582 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 19:46:58.247478 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.235015    2582 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 19:46:58.247478 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.235017    2582 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 19:46:58.247478 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.235020    2582 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 19:46:58.247478 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.235022    2582 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 19:46:58.247478 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.235025    2582 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 19:46:58.247478 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.235028    2582 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 19:46:58.247478 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.235030    2582 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 19:46:58.247478 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.235033    2582 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 19:46:58.247478 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.235041    2582 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 19:46:58.247478 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.235044    2582 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 19:46:58.248242 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.235046    2582 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 19:46:58.248242 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.235049    2582 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 19:46:58.248242 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.235052    2582 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 19:46:58.248242 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.235055    2582 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 19:46:58.248242 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.235057    2582 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 19:46:58.248242 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.235060    2582 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 19:46:58.248242 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.235062    2582 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 19:46:58.248242 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.235066    2582 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 19:46:58.248242 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.235069    2582 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 19:46:58.248242 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.235071    2582 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 19:46:58.248242 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.235074    2582 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 19:46:58.248242 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.235077    2582 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 19:46:58.248242 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.235079    2582 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 19:46:58.248242 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.235081    2582 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 19:46:58.248242 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.235084    2582 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 19:46:58.248242 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.235087    2582 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 19:46:58.248242 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.235089    2582 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 19:46:58.248242 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.235093    2582 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 19:46:58.248242 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.235095    2582 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 19:46:58.248242 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.235098    2582 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 19:46:58.248791 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.235101    2582 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 19:46:58.248791 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.235103    2582 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 19:46:58.248791 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.235106    2582 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 19:46:58.248791 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.235109    2582 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 19:46:58.248791 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.235111    2582 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 19:46:58.248791 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.235113    2582 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 19:46:58.248791 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.235116    2582 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 19:46:58.248791 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.235119    2582 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 19:46:58.248791 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.235121    2582 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 19:46:58.248791 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.235124    2582 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 19:46:58.248791 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.235126    2582 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 19:46:58.248791 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.235134    2582 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 19:46:58.248791 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.235137    2582 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 19:46:58.248791 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.235140    2582 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 19:46:58.248791 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.235142    2582 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 19:46:58.248791 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.235145    2582 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 19:46:58.248791 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.235147    2582 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 19:46:58.248791 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.235150    2582 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 19:46:58.248791 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.235152    2582 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 19:46:58.248791 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.235156    2582 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 19:46:58.249423 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.235158    2582 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 19:46:58.249423 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.235161    2582 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 19:46:58.249423 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.235163    2582 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 19:46:58.249423 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.235166    2582 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 19:46:58.249423 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.235169    2582 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 19:46:58.249423 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.235171    2582 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 19:46:58.249423 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.235174    2582 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 19:46:58.249423 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.235176    2582 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 19:46:58.249423 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.235185    2582 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 19:46:58.249423 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.235191    2582 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 19:46:58.249423 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.235193    2582 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 19:46:58.249423 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.235196    2582 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 19:46:58.249423 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.235199    2582 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 19:46:58.249423 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.235201    2582 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 19:46:58.249423 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.235204    2582 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 19:46:58.249423 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.235206    2582 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 19:46:58.249423 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.235209    2582 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 19:46:58.249423 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.235211    2582 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 19:46:58.249423 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.235214    2582 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 19:46:58.249423 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.235216    2582 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 19:46:58.249423 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.235219    2582 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 19:46:58.249949 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.235221    2582 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 19:46:58.249949 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.235224    2582 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 19:46:58.249949 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.235226    2582 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 19:46:58.249949 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.235237    2582 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 19:46:58.249949 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.235240    2582 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 19:46:58.249949 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.235244    2582 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 19:46:58.249949 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.235246    2582 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 19:46:58.249949 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.235249    2582 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 19:46:58.249949 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.235252    2582 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 19:46:58.249949 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.235256    2582 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 19:46:58.249949 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.235260    2582 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 19:46:58.249949 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.235263    2582 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 19:46:58.249949 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.235266    2582 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 19:46:58.249949 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.235268    2582 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 19:46:58.249949 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.235271    2582 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 19:46:58.249949 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.235273    2582 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 19:46:58.249949 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.235276    2582 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 19:46:58.249949 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.235278    2582 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 19:46:58.249949 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.235281    2582 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 19:46:58.250585 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.235283    2582 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 19:46:58.250585 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.235287    2582 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 19:46:58.250585 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.235290    2582 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 19:46:58.250585 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.235292    2582 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 19:46:58.250585 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.235296    2582 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 19:46:58.250585 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.235298    2582 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 19:46:58.250585 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.235301    2582 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 19:46:58.250585 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:46:58.244229    2582 server.go:525] "Kubelet version" kubeletVersion="v1.35.9"
Oct 30 19:46:58.250585 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:46:58.244248    2582 server.go:527] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Oct 30 19:46:58.250585 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:46:58.244275    2582 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Oct 30 19:46:58.250585 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:46:58.244283    2582 watchdog_linux.go:138] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Oct 30 19:46:58.250585 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.244398    2582 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 19:46:58.250585 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.244406    2582 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 19:46:58.250585 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.244427    2582 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 19:46:58.250585 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.244433    2582 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 19:46:58.250585 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.244439    2582 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 19:46:58.250585 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.244443    2582 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 19:46:58.250585 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.244447    2582 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 19:46:58.250585 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.244454    2582 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 19:46:58.251112 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.244460    2582 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 19:46:58.251112 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.244465    2582 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 19:46:58.251112 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.244469    2582 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 19:46:58.251112 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.244473    2582 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 19:46:58.251112 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.244477    2582 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 19:46:58.251112 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.244481    2582 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 19:46:58.251112 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.244485    2582 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 19:46:58.251112 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.244489    2582 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 19:46:58.251112 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.244493    2582 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 19:46:58.251112 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.244497    2582 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 19:46:58.251112 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.244501    2582 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 19:46:58.251112 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.244506    2582 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 19:46:58.251112 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.244510    2582 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 19:46:58.251112 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.244515    2582 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 19:46:58.251112 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.244519    2582 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 19:46:58.251112 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.244523    2582 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 19:46:58.251112 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.244534    2582 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 19:46:58.251112 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.244539    2582 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 19:46:58.251112 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.244543    2582 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 19:46:58.251112 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.244547    2582 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 19:46:58.251599 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.244551    2582 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 19:46:58.251599 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.244557    2582 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 19:46:58.251599 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.244561    2582 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 19:46:58.251599 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.244565    2582 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 19:46:58.251599 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.244570    2582 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 19:46:58.251599 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.244574    2582 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 19:46:58.251599 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.244578    2582 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 19:46:58.251599 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.244582    2582 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 19:46:58.251599 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.244586    2582 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 19:46:58.251599 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.244590    2582 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 19:46:58.251599 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.244595    2582 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 19:46:58.251599 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.244599    2582 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 19:46:58.251599 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.244603    2582 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 19:46:58.251599 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.244608    2582 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 19:46:58.251599 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.244612    2582 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 19:46:58.251599 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.244616    2582 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 19:46:58.251599 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.244620    2582 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 19:46:58.251599 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.244624    2582 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 19:46:58.251599 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.244628    2582 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 19:46:58.251599 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.244633    2582 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 19:46:58.252369 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.244637    2582 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 19:46:58.252369 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.244641    2582 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 19:46:58.252369 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.244645    2582 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 19:46:58.252369 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.244649    2582 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 19:46:58.252369 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.244653    2582 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 19:46:58.252369 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.244657    2582 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 19:46:58.252369 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.244670    2582 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 19:46:58.252369 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.244676    2582 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 19:46:58.252369 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.244680    2582 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 19:46:58.252369 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.244685    2582 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 19:46:58.252369 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.244689    2582 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 19:46:58.252369 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.244694    2582 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 19:46:58.252369 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.244698    2582 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 19:46:58.252369 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.244702    2582 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 19:46:58.252369 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.244706    2582 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 19:46:58.252369 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.244710    2582 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 19:46:58.252369 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.244715    2582 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 19:46:58.252369 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.244719    2582 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 19:46:58.252369 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.244723    2582 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 19:46:58.252369 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.244727    2582 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 19:46:58.253173 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.244732    2582 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 19:46:58.253173 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.244736    2582 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 19:46:58.253173 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.244740    2582 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 19:46:58.253173 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.244744    2582 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 19:46:58.253173 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.244748    2582 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 19:46:58.253173 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.244752    2582 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 19:46:58.253173 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.244756    2582 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 19:46:58.253173 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.244761    2582 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 19:46:58.253173 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.244765    2582 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 19:46:58.253173 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.244769    2582 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 19:46:58.253173 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.244773    2582 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 19:46:58.253173 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.244778    2582 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 19:46:58.253173 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.244782    2582 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 19:46:58.253173 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.244786    2582 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 19:46:58.253173 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.244790    2582 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 19:46:58.253173 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.244794    2582 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 19:46:58.253173 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.244799    2582 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 19:46:58.253173 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.244803    2582 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 19:46:58.253173 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.244807    2582 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 19:46:58.253698 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.244811    2582 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 19:46:58.253698 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.244815    2582 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 19:46:58.253698 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.244819    2582 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 19:46:58.253698 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.244824    2582 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 19:46:58.253698 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.244828    2582 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 19:46:58.253698 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.244833    2582 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 19:46:58.253698 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.244837    2582 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 19:46:58.253698 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.244841    2582 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 19:46:58.253698 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.244846    2582 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 19:46:58.253698 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.244852    2582 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 19:46:58.253698 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.244858    2582 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 19:46:58.253698 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.244863    2582 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 19:46:58.253698 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.244867    2582 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 19:46:58.253698 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.244871    2582 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 19:46:58.253698 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.244876    2582 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 19:46:58.253698 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.244880    2582 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 19:46:58.253698 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.244884    2582 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 19:46:58.253698 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.244888    2582 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 19:46:58.253698 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.244893    2582 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 19:46:58.254214 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:46:58.244933    2582 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]}
Oct 30 19:46:58.254214 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.245187    2582 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 19:46:58.254214 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.245196    2582 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 19:46:58.254214 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.245201    2582 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 19:46:58.254214 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.245205    2582 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 19:46:58.254214 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.245209    2582 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 19:46:58.254214 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.245220    2582 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 19:46:58.254214 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.245224    2582 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 19:46:58.254214 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.245229    2582 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 19:46:58.254214 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.245233    2582 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 19:46:58.254214 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.245237    2582 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 19:46:58.254214 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.245242    2582 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 19:46:58.254214 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.245246    2582 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 19:46:58.254214 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.245250    2582 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 19:46:58.254214 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.245255    2582 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 19:46:58.254214 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.245259    2582 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 19:46:58.254665 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.245264    2582 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 19:46:58.254665 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.245268    2582 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 19:46:58.254665 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.245272    2582 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 19:46:58.254665 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.245276    2582 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 19:46:58.254665 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.245280    2582 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 19:46:58.254665 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.245284    2582 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 19:46:58.254665 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.245288    2582 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 19:46:58.254665 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.245292    2582 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 19:46:58.254665 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.245296    2582 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 19:46:58.254665 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.245300    2582 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 19:46:58.254665 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.245304    2582 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 19:46:58.254665 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.245309    2582 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 19:46:58.254665 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.245312    2582 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 19:46:58.254665 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.245316    2582 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 19:46:58.254665 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.245321    2582 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 19:46:58.254665 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.245325    2582 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 19:46:58.254665 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.245330    2582 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 19:46:58.254665 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.245334    2582 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 19:46:58.254665 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.245338    2582 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 19:46:58.255140 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.245342    2582 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 19:46:58.255140 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.245346    2582 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 19:46:58.255140 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.245350    2582 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 19:46:58.255140 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.245361    2582 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 19:46:58.255140 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.245367    2582 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 19:46:58.255140 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.245371    2582 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 19:46:58.255140 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.245375    2582 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 19:46:58.255140 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.245379    2582 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 19:46:58.255140 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.245384    2582 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 19:46:58.255140 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.245387    2582 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 19:46:58.255140 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.245424    2582 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 19:46:58.255140 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.245429    2582 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 19:46:58.255140 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.245433    2582 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 19:46:58.255140 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.245437    2582 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 19:46:58.255140 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.245442    2582 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 19:46:58.255140 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.245446    2582 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 19:46:58.255140 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.245450    2582 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 19:46:58.255140 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.245454    2582 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 19:46:58.255140 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.245461    2582 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 19:46:58.255811 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.245467    2582 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 19:46:58.255811 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.245472    2582 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 19:46:58.255811 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.245478    2582 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 19:46:58.255811 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.245485    2582 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 19:46:58.255811 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.245489    2582 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 19:46:58.255811 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.245493    2582 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 19:46:58.255811 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.245497    2582 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 19:46:58.255811 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.245501    2582 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 19:46:58.255811 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.245506    2582 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 19:46:58.255811 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.245510    2582 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 19:46:58.255811 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.245514    2582 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 19:46:58.255811 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.245518    2582 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 19:46:58.255811 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.245522    2582 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 19:46:58.255811 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.245527    2582 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 19:46:58.255811 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.245531    2582 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 19:46:58.255811 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.245535    2582 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 19:46:58.255811 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.245539    2582 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 19:46:58.255811 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.245544    2582 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 19:46:58.255811 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.245549    2582 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 19:46:58.256254 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.245554    2582 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 19:46:58.256254 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.245558    2582 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 19:46:58.256254 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.245563    2582 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 19:46:58.256254 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.245567    2582 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 19:46:58.256254 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.245571    2582 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 19:46:58.256254 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.245575    2582 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 19:46:58.256254 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.245579    2582 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 19:46:58.256254 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.245583    2582 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 19:46:58.256254 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.245587    2582 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 19:46:58.256254 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.245591    2582 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 19:46:58.256254 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.245596    2582 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 19:46:58.256254 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.245601    2582 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 19:46:58.256254 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.245605    2582 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 19:46:58.256254 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.245612    2582 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 19:46:58.256254 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.245616    2582 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 19:46:58.256254 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.245620    2582 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 19:46:58.256254 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.245624    2582 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 19:46:58.256254 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.245628    2582 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 19:46:58.256254 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.245632    2582 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 19:46:58.256254 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.245637    2582 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 19:46:58.256813 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.245641    2582 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 19:46:58.256813 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.245645    2582 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 19:46:58.256813 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.245649    2582 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 19:46:58.256813 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.245654    2582 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 19:46:58.256813 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.245658    2582 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 19:46:58.256813 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.245662    2582 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 19:46:58.256813 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.245666    2582 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 19:46:58.256813 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.245670    2582 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 19:46:58.256813 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.245674    2582 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 19:46:58.256813 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.245678    2582 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 19:46:58.256813 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.245683    2582 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 19:46:58.256813 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.245687    2582 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 19:46:58.256813 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.245692    2582 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 19:46:58.256813 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.245697    2582 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 19:46:58.256813 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:46:58.245737    2582 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]}
Oct 30 19:46:58.256813 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.245802    2582 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 19:46:58.257198 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.245809    2582 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 19:46:58.257198 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.245814    2582 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 19:46:58.257198 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.245820    2582 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 19:46:58.257198 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.245824    2582 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 19:46:58.257198 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.245828    2582 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 19:46:58.257198 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.245833    2582 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 19:46:58.257198 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.245837    2582 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 19:46:58.257198 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.245841    2582 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 19:46:58.257198 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.245846    2582 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 19:46:58.257198 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.245852    2582 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 19:46:58.257198 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.245856    2582 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 19:46:58.257198 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.245861    2582 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 19:46:58.257198 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.245865    2582 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 19:46:58.257198 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.245870    2582 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 19:46:58.257198 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.245874    2582 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 19:46:58.257198 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.245878    2582 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 19:46:58.257198 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.245883    2582 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 19:46:58.257198 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.245887    2582 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 19:46:58.257198 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.245892    2582 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 19:46:58.257198 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.245896    2582 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 19:46:58.257731 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.245900    2582 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 19:46:58.257731 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.245904    2582 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 19:46:58.257731 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.245909    2582 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 19:46:58.257731 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.245913    2582 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 19:46:58.257731 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.245918    2582 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 19:46:58.257731 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.245922    2582 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 19:46:58.257731 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.245926    2582 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 19:46:58.257731 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.245931    2582 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 19:46:58.257731 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.245936    2582 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 19:46:58.257731 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.245940    2582 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 19:46:58.257731 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.245945    2582 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 19:46:58.257731 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.245949    2582 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 19:46:58.257731 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.245953    2582 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 19:46:58.257731 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.245957    2582 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 19:46:58.257731 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.245961    2582 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 19:46:58.257731 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.245965    2582 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 19:46:58.257731 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.245969    2582 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 19:46:58.257731 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.245973    2582 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 19:46:58.257731 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.245978    2582 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 19:46:58.258179 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.245982    2582 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 19:46:58.258179 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.245992    2582 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 19:46:58.258179 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.245998    2582 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 19:46:58.258179 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.246002    2582 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 19:46:58.258179 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.246007    2582 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 19:46:58.258179 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.246011    2582 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 19:46:58.258179 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.246015    2582 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 19:46:58.258179 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.246019    2582 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 19:46:58.258179 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.246024    2582 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 19:46:58.258179 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.246028    2582 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 19:46:58.258179 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.246032    2582 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 19:46:58.258179 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.246036    2582 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 19:46:58.258179 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.246040    2582 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 19:46:58.258179 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.246044    2582 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 19:46:58.258179 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.246049    2582 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 19:46:58.258179 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.246053    2582 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 19:46:58.258179 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.246058    2582 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 19:46:58.258179 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.246062    2582 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 19:46:58.258179 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.246066    2582 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 19:46:58.258179 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.246070    2582 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 19:46:58.258657 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.246075    2582 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 19:46:58.258657 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.246079    2582 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 19:46:58.258657 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.246083    2582 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 19:46:58.258657 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.246088    2582 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 19:46:58.258657 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.246092    2582 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 19:46:58.258657 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.246096    2582 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 19:46:58.258657 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.246104    2582 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 19:46:58.258657 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.246111    2582 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 19:46:58.258657 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.246115    2582 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 19:46:58.258657 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.246122    2582 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 19:46:58.258657 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.246128    2582 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 19:46:58.258657 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.246133    2582 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 19:46:58.258657 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.246137    2582 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 19:46:58.258657 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.246141    2582 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 19:46:58.258657 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.246147    2582 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 19:46:58.258657 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.246152    2582 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 19:46:58.258657 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.246156    2582 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 19:46:58.258657 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.246160    2582 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 19:46:58.259092 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.246165    2582 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 19:46:58.259092 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.246169    2582 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 19:46:58.259092 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.246173    2582 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 19:46:58.259092 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.246177    2582 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 19:46:58.259092 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.246181    2582 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 19:46:58.259092 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.246186    2582 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 19:46:58.259092 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.246192    2582 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 19:46:58.259092 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.246196    2582 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 19:46:58.259092 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.246200    2582 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 19:46:58.259092 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.246204    2582 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 19:46:58.259092 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.246209    2582 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 19:46:58.259092 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.246212    2582 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 19:46:58.259092 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.246217    2582 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 19:46:58.259092 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.246220    2582 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 19:46:58.259092 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.246224    2582 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 19:46:58.259092 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.246228    2582 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 19:46:58.259092 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.246232    2582 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 19:46:58.259092 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.246236    2582 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 19:46:58.259092 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.246241    2582 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 19:46:58.259092 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.246246    2582 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 19:46:58.259553 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.246250    2582 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 19:46:58.259553 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.246256    2582 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 19:46:58.259553 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.246261    2582 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 19:46:58.259553 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.246265    2582 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 19:46:58.259553 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.246269    2582 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 19:46:58.259553 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.246273    2582 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 19:46:58.259553 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.246277    2582 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 19:46:58.259553 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:58.246282    2582 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 19:46:58.259553 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:46:58.246356    2582 server.go:957] "Client rotation is on, will bootstrap in background"
Oct 30 19:46:58.259553 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:46:58.248888    2582 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Oct 30 19:46:58.259553 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:46:58.249989    2582 server.go:1014] "Starting client certificate rotation"
Oct 30 19:46:58.259553 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:46:58.250088    2582 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Oct 30 19:46:58.259553 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:46:58.250117    2582 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Oct 30 19:46:58.259553 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:46:58.252258    2582 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Oct 30 19:46:58.259553 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:46:58.255670    2582 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Oct 30 19:46:58.265495 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:46:58.265479    2582 log.go:25] "Validated CRI v1 runtime API"
Oct 30 19:46:58.269907 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:46:58.269892    2582 log.go:25] "Validated CRI v1 image API"
Oct 30 19:46:58.270743 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:46:58.270716    2582 server.go:1424] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Oct 30 19:46:58.273061 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:46:58.273042    2582 fs.go:135] Filesystem UUIDs: map[455dd795-fa59-424c-b8ae-e44778e57212:/dev/nvme0n1p4 51a6363d-8227-4b3c-b770-e4f567ac8305:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2]
Oct 30 19:46:58.273125 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:46:58.273062    2582 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:24 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:26 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:32 fsType:tmpfs blockSize:0} composefs_0-34:{mountpoint:/ major:0 minor:34 fsType:overlay blockSize:0}]
Oct 30 19:46:58.278875 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:46:58.278774    2582 manager.go:217] Machine: {Timestamp:2026-10-30 19:46:58.276525597 +0000 UTC m=+0.333100420 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3199649 MemoryCapacity:33164328960 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2381dcb6b9f609efac67e78896aa38 SystemUUID:ec2381dc-b6b9-f609-efac-67e78896aa38 BootID:35085445-56cc-4df2-8755-aacbea99658f Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:24 Capacity:16582164480 Type:vfs Inodes:4048380 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:26 Capacity:6632865792 Type:vfs Inodes:819200 HasInodes:true} {Device:composefs_0-34 DeviceMajor:0 DeviceMinor:34 Capacity:6422528 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:32 Capacity:16582164480 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ff:fb:dc:72:35 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ff:fb:dc:72:35 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:a6:7c:60:ed:53:67 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164328960 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Oct 30 19:46:58.279488 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:46:58.279479    2582 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Oct 30 19:46:58.279562 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:46:58.279550    2582 manager.go:233] Version: {KernelVersion:5.14.0-687.60.1.el9_8.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.8.20261023-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Oct 30 19:46:58.282285 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:46:58.282264    2582 container_manager_linux.go:275] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Oct 30 19:46:58.282421 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:46:58.282287    2582 container_manager_linux.go:280] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-131-26.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"/system.slice","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{},"system-reserved-compressible":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Oct 30 19:46:58.282465 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:46:58.282426    2582 topology_manager.go:143] "Creating topology manager with none policy"
Oct 30 19:46:58.282465 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:46:58.282435    2582 container_manager_linux.go:311] "Creating device plugin manager"
Oct 30 19:46:58.282465 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:46:58.282461    2582 manager.go:144] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Oct 30 19:46:58.282579 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:46:58.282474    2582 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Oct 30 19:46:58.283282 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:46:58.283273    2582 container_manager_linux.go:320] "Creating Dynamic Resource Allocation (DRA) manager"
Oct 30 19:46:58.287006 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:46:58.286994    2582 state_mem.go:41] "Initialized" logger="CPUManager state memory"
Oct 30 19:46:58.287113 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:46:58.287105    2582 server.go:1235] "Using root directory" path="/var/lib/kubelet"
Oct 30 19:46:58.287946 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:46:58.287937    2582 kubelet.go:493] "Attempting to sync node with API server"
Oct 30 19:46:58.287985 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:46:58.287950    2582 kubelet.go:394] "Adding static pod path" path="/etc/kubernetes/manifests"
Oct 30 19:46:58.287985 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:46:58.287959    2582 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Oct 30 19:46:58.287985 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:46:58.287968    2582 kubelet.go:405] "Adding apiserver pod source"
Oct 30 19:46:58.287985 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:46:58.287975    2582 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Oct 30 19:46:58.288290 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:46:58.288276    2582 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Oct 30 19:46:58.290467 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:46:58.290450    2582 kuberuntime_manager.go:304] "Container runtime initialized" containerRuntime="cri-o" version="1.35.10-3.rhaos4.22.git9383502.el9" apiVersion="v1"
Oct 30 19:46:58.295427 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:46:58.295403    2582 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Oct 30 19:46:58.296247 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:46:58.296235    2582 kubelet.go:963] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Oct 30 19:46:58.296288 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:46:58.296265    2582 kubelet.go:990] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Oct 30 19:46:58.296431 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:46:58.296409    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Oct 30 19:46:58.296461 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:46:58.296440    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Oct 30 19:46:58.296461 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:46:58.296447    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Oct 30 19:46:58.296461 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:46:58.296452    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Oct 30 19:46:58.296461 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:46:58.296458    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Oct 30 19:46:58.296559 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:46:58.296469    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Oct 30 19:46:58.296980 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:46:58.296971    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Oct 30 19:46:58.297009 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:46:58.296982    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Oct 30 19:46:58.297009 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:46:58.296989    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Oct 30 19:46:58.297009 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:46:58.296995    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Oct 30 19:46:58.297009 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:46:58.297008    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Oct 30 19:46:58.297161 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:46:58.297017    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Oct 30 19:46:58.297505 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:46:58.297496    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Oct 30 19:46:58.297541 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:46:58.297508    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Oct 30 19:46:58.301139 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:46:58.301126    2582 server.go:1263] "Started kubelet"
Oct 30 19:46:58.301220 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:46:58.301191    2582 server.go:182] "Starting to listen" address="0.0.0.0" port=10250
Oct 30 19:46:58.301774 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:46:58.301722    2582 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Oct 30 19:46:58.301870 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:46:58.301795    2582 server_v1.go:49] "podresources" method="list" useActivePods=true
Oct 30 19:46:58.302023 ip-10-0-131-26 systemd[1]: Started Kubernetes Kubelet.
Oct 30 19:46:58.305144 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:46:58.305105    2582 server.go:254] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Oct 30 19:46:58.306742 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:46:58.306720    2582 server.go:317] "Adding debug handlers to kubelet server"
Oct 30 19:46:58.306948 ip-10-0-131-26 kubenswrapper[2582]: E1030 19:46:58.306924    2582 kubelet.go:1679] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Oct 30 19:46:58.310083 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:46:58.310063    2582 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Oct 30 19:46:58.311479 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:46:58.311464    2582 fs_resource_analyzer.go:69] "Starting FS ResourceAnalyzer"
Oct 30 19:46:58.311646 ip-10-0-131-26 kubenswrapper[2582]: E1030 19:46:58.311622    2582 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-131-26.ec2.internal\" not found"
Oct 30 19:46:58.312120 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:46:58.312105    2582 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Oct 30 19:46:58.312120 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:46:58.312106    2582 volume_manager.go:309] "The desired_state_of_world populator starts"
Oct 30 19:46:58.312257 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:46:58.312129    2582 volume_manager.go:311] "Starting Kubelet Volume Manager"
Oct 30 19:46:58.312257 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:46:58.312198    2582 reconstruct.go:97] "Volume reconstruction finished"
Oct 30 19:46:58.312257 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:46:58.312203    2582 reconciler.go:29] "Reconciler: start to sync state"
Oct 30 19:46:58.312257 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:46:58.312249    2582 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Oct 30 19:46:58.312449 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:46:58.312263    2582 factory.go:55] Registering systemd factory
Oct 30 19:46:58.312449 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:46:58.312272    2582 factory.go:223] Registration of the systemd container factory successfully
Oct 30 19:46:58.312541 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:46:58.312474    2582 factory.go:153] Registering CRI-O factory
Oct 30 19:46:58.312541 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:46:58.312488    2582 factory.go:223] Registration of the crio container factory successfully
Oct 30 19:46:58.312541 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:46:58.312502    2582 factory.go:103] Registering Raw factory
Oct 30 19:46:58.312541 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:46:58.312513    2582 manager.go:1199] Started watching for new ooms in manager
Oct 30 19:46:58.313480 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:46:58.313465    2582 manager.go:319] Starting recovery of all containers
Oct 30 19:46:58.320752 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:46:58.320704    2582 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Oct 30 19:46:58.322300 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:46:58.322280    2582 manager.go:324] Recovery completed
Oct 30 19:46:58.327714 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:46:58.327697    2582 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 30 19:46:58.329667 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:46:58.329296    2582 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-131-26.ec2.internal" event="NodeHasSufficientMemory"
Oct 30 19:46:58.329749 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:46:58.329681    2582 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-131-26.ec2.internal" event="NodeHasNoDiskPressure"
Oct 30 19:46:58.329749 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:46:58.329693    2582 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-131-26.ec2.internal" event="NodeHasSufficientPID"
Oct 30 19:46:58.330259 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:46:58.330245    2582 cpu_manager.go:226] "Starting" policy="none"
Oct 30 19:46:58.330336 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:46:58.330259    2582 cpu_manager.go:227] "Reconciling" reconcilePeriod="10s"
Oct 30 19:46:58.330336 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:46:58.330267    2582 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 30 19:46:58.330336 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:46:58.330278    2582 state_mem.go:41] "Initialized" logger="CPUManager state checkpoint.CPUManager state memory"
Oct 30 19:46:58.330928 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:46:58.330913    2582 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-131-26.ec2.internal" event="NodeHasSufficientMemory"
Oct 30 19:46:58.331019 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:46:58.330942    2582 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-131-26.ec2.internal" event="NodeHasNoDiskPressure"
Oct 30 19:46:58.331019 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:46:58.330954    2582 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-131-26.ec2.internal" event="NodeHasSufficientPID"
Oct 30 19:46:58.332585 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:46:58.332570    2582 policy_none.go:50] "Start"
Oct 30 19:46:58.332667 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:46:58.332595    2582 memory_manager.go:187] "Starting memorymanager" policy="None"
Oct 30 19:46:58.332667 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:46:58.332608    2582 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Oct 30 19:46:58.334580 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:46:58.334567    2582 policy_none.go:44] "Start"
Oct 30 19:46:58.337348 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:46:58.337327    2582 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-131-26.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Oct 30 19:46:58.337464 ip-10-0-131-26 kubenswrapper[2582]: E1030 19:46:58.337362    2582 controller.go:201] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-131-26.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Oct 30 19:46:58.338472 ip-10-0-131-26 kubenswrapper[2582]: E1030 19:46:58.337436    2582 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-131-26.ec2.internal.18e3665b26b5e39e  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-131-26.ec2.internal,UID:,APIVersion:v1,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-131-26.ec2.internal,},FirstTimestamp:2026-10-30 19:46:58.301100958 +0000 UTC m=+0.357675781,LastTimestamp:2026-10-30 19:46:58.301100958 +0000 UTC m=+0.357675781,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-131-26.ec2.internal,}"
Oct 30 19:46:58.348150 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:46:58.348114    2582 reflector.go:446] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Oct 30 19:46:58.352512 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:46:58.352491    2582 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-wqrpv"
Oct 30 19:46:58.352707 ip-10-0-131-26 kubenswrapper[2582]: E1030 19:46:58.352688    2582 reflector.go:204] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.Service"
Oct 30 19:46:58.352805 ip-10-0-131-26 kubenswrapper[2582]: E1030 19:46:58.352784    2582 reflector.go:204] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.CSIDriver"
Oct 30 19:46:58.357166 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:46:58.357126    2582 node_container_manager_linux.go:130] "Enforcing system reserved compressible on cgroup" cgroupName="/system.slice" limits={"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"}
Oct 30 19:46:58.359772 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:46:58.359760    2582 manager.go:341] "Starting Device Plugin manager"
Oct 30 19:46:58.359856 ip-10-0-131-26 kubenswrapper[2582]: E1030 19:46:58.359791    2582 manager.go:525] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Oct 30 19:46:58.359856 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:46:58.359801    2582 server.go:87] "Starting device plugin registration server"
Oct 30 19:46:58.359977 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:46:58.359968    2582 eviction_manager.go:194] "Eviction manager: starting control loop"
Oct 30 19:46:58.360006 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:46:58.359978    2582 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Oct 30 19:46:58.360089 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:46:58.360072    2582 plugin_watcher.go:53] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Oct 30 19:46:58.360176 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:46:58.360162    2582 plugin_manager.go:119] "The desired_state_of_world populator (plugin watcher) starts"
Oct 30 19:46:58.360176 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:46:58.360173    2582 plugin_manager.go:121] "Starting Kubelet Plugin Manager"
Oct 30 19:46:58.360750 ip-10-0-131-26 kubenswrapper[2582]: E1030 19:46:58.360733    2582 eviction_manager.go:272] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Oct 30 19:46:58.360829 ip-10-0-131-26 kubenswrapper[2582]: E1030 19:46:58.360778    2582 eviction_manager.go:297] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-131-26.ec2.internal\" not found"
Oct 30 19:46:58.362141 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:46:58.362123    2582 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-wqrpv"
Oct 30 19:46:58.395205 ip-10-0-131-26 kubenswrapper[2582]: E1030 19:46:58.395185    2582 reflector.go:204] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-131-26.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.Node"
Oct 30 19:46:58.395315 ip-10-0-131-26 kubenswrapper[2582]: E1030 19:46:58.395246    2582 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-131-26.ec2.internal.18e3665b2869be67  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-131-26.ec2.internal,UID:,APIVersion:v1,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-131-26.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-131-26.ec2.internal,},FirstTimestamp:2026-10-30 19:46:58.329665127 +0000 UTC m=+0.386239951,LastTimestamp:2026-10-30 19:46:58.329665127 +0000 UTC m=+0.386239951,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-131-26.ec2.internal,}"
Oct 30 19:46:58.451088 ip-10-0-131-26 kubenswrapper[2582]: E1030 19:46:58.451026    2582 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-131-26.ec2.internal.18e3665b286a14f3  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-131-26.ec2.internal,UID:,APIVersion:v1,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-131-26.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-131-26.ec2.internal,},FirstTimestamp:2026-10-30 19:46:58.329687283 +0000 UTC m=+0.386262107,LastTimestamp:2026-10-30 19:46:58.329687283 +0000 UTC m=+0.386262107,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-131-26.ec2.internal,}"
Oct 30 19:46:58.460669 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:46:58.460647    2582 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 30 19:46:58.461362 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:46:58.461339    2582 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-131-26.ec2.internal" event="NodeHasSufficientMemory"
Oct 30 19:46:58.461466 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:46:58.461372    2582 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-131-26.ec2.internal" event="NodeHasNoDiskPressure"
Oct 30 19:46:58.461466 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:46:58.461382    2582 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-131-26.ec2.internal" event="NodeHasSufficientPID"
Oct 30 19:46:58.461466 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:46:58.461444    2582 kubelet_node_status.go:77] "Attempting to register node" node="ip-10-0-131-26.ec2.internal"
Oct 30 19:46:58.524399 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:46:58.511871    2582 kubelet_node_status.go:80] "Successfully registered node" node="ip-10-0-131-26.ec2.internal"
Oct 30 19:46:58.524399 ip-10-0-131-26 kubenswrapper[2582]: E1030 19:46:58.511888    2582 kubelet_node_status.go:524] "Error updating node status, will retry" err="error getting node \"ip-10-0-131-26.ec2.internal\": node \"ip-10-0-131-26.ec2.internal\" not found"
Oct 30 19:46:58.563878 ip-10-0-131-26 kubenswrapper[2582]: E1030 19:46:58.563858    2582 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-131-26.ec2.internal\" not found"
Oct 30 19:46:58.565682 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:46:58.565665    2582 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Oct 30 19:46:58.565754 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:46:58.565699    2582 status_manager.go:249] "Starting to sync pod status with apiserver"
Oct 30 19:46:58.565754 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:46:58.565715    2582 kubelet.go:2521] "Starting kubelet main sync loop"
Oct 30 19:46:58.565754 ip-10-0-131-26 kubenswrapper[2582]: E1030 19:46:58.565741    2582 kubelet.go:2545] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Oct 30 19:46:58.587804 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:46:58.587778    2582 reflector.go:446] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 30 19:46:58.664518 ip-10-0-131-26 kubenswrapper[2582]: E1030 19:46:58.664501    2582 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-131-26.ec2.internal\" not found"
Oct 30 19:46:58.666658 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:46:58.666644    2582 kubelet.go:2608] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-26.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-131-26.ec2.internal"]
Oct 30 19:46:58.666705 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:46:58.666692    2582 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 30 19:46:58.667341 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:46:58.667326    2582 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-131-26.ec2.internal" event="NodeHasSufficientMemory"
Oct 30 19:46:58.667409 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:46:58.667349    2582 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-131-26.ec2.internal" event="NodeHasNoDiskPressure"
Oct 30 19:46:58.667409 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:46:58.667359    2582 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-131-26.ec2.internal" event="NodeHasSufficientPID"
Oct 30 19:46:58.669361 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:46:58.669343    2582 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 30 19:46:58.669939 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:46:58.669926    2582 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-131-26.ec2.internal" event="NodeHasSufficientMemory"
Oct 30 19:46:58.670017 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:46:58.669945    2582 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-131-26.ec2.internal" event="NodeHasNoDiskPressure"
Oct 30 19:46:58.670017 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:46:58.669955    2582 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-131-26.ec2.internal" event="NodeHasSufficientPID"
Oct 30 19:46:58.670088 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:46:58.670020    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-26.ec2.internal"
Oct 30 19:46:58.670088 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:46:58.670058    2582 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 30 19:46:58.670672 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:46:58.670659    2582 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-131-26.ec2.internal" event="NodeHasSufficientMemory"
Oct 30 19:46:58.670712 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:46:58.670684    2582 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-131-26.ec2.internal" event="NodeHasNoDiskPressure"
Oct 30 19:46:58.670712 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:46:58.670695    2582 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-131-26.ec2.internal" event="NodeHasSufficientPID"
Oct 30 19:46:58.671804 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:46:58.671792    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-26.ec2.internal"
Oct 30 19:46:58.671854 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:46:58.671815    2582 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 30 19:46:58.672436 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:46:58.672410    2582 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-131-26.ec2.internal" event="NodeHasSufficientMemory"
Oct 30 19:46:58.672516 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:46:58.672450    2582 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-131-26.ec2.internal" event="NodeHasNoDiskPressure"
Oct 30 19:46:58.672516 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:46:58.672463    2582 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-131-26.ec2.internal" event="NodeHasSufficientPID"
Oct 30 19:46:58.700405 ip-10-0-131-26 kubenswrapper[2582]: E1030 19:46:58.700390    2582 kubelet.go:3364] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-131-26.ec2.internal\" not found" node="ip-10-0-131-26.ec2.internal"
Oct 30 19:46:58.703311 ip-10-0-131-26 kubenswrapper[2582]: E1030 19:46:58.703294    2582 kubelet.go:3364] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-131-26.ec2.internal\" not found" node="ip-10-0-131-26.ec2.internal"
Oct 30 19:46:58.715707 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:46:58.715687    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a33761d7d0af7c6b314b351b86948829-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-26.ec2.internal\" (UID: \"a33761d7d0af7c6b314b351b86948829\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-26.ec2.internal"
Oct 30 19:46:58.715787 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:46:58.715711    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/3a7534b7f1df1f6e6fe99f614d7ed61c-config\") pod \"kube-apiserver-proxy-ip-10-0-131-26.ec2.internal\" (UID: \"3a7534b7f1df1f6e6fe99f614d7ed61c\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-26.ec2.internal"
Oct 30 19:46:58.715787 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:46:58.715726    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/a33761d7d0af7c6b314b351b86948829-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-26.ec2.internal\" (UID: \"a33761d7d0af7c6b314b351b86948829\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-26.ec2.internal"
Oct 30 19:46:58.764761 ip-10-0-131-26 kubenswrapper[2582]: E1030 19:46:58.764718    2582 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-131-26.ec2.internal\" not found"
Oct 30 19:46:58.816206 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:46:58.816189    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/a33761d7d0af7c6b314b351b86948829-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-26.ec2.internal\" (UID: \"a33761d7d0af7c6b314b351b86948829\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-26.ec2.internal"
Oct 30 19:46:58.816264 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:46:58.816210    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a33761d7d0af7c6b314b351b86948829-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-26.ec2.internal\" (UID: \"a33761d7d0af7c6b314b351b86948829\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-26.ec2.internal"
Oct 30 19:46:58.816264 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:46:58.816226    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/3a7534b7f1df1f6e6fe99f614d7ed61c-config\") pod \"kube-apiserver-proxy-ip-10-0-131-26.ec2.internal\" (UID: \"3a7534b7f1df1f6e6fe99f614d7ed61c\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-26.ec2.internal"
Oct 30 19:46:58.816324 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:46:58.816267    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/3a7534b7f1df1f6e6fe99f614d7ed61c-config\") pod \"kube-apiserver-proxy-ip-10-0-131-26.ec2.internal\" (UID: \"3a7534b7f1df1f6e6fe99f614d7ed61c\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-26.ec2.internal"
Oct 30 19:46:58.816324 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:46:58.816289    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/a33761d7d0af7c6b314b351b86948829-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-26.ec2.internal\" (UID: \"a33761d7d0af7c6b314b351b86948829\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-26.ec2.internal"
Oct 30 19:46:58.816324 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:46:58.816301    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a33761d7d0af7c6b314b351b86948829-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-26.ec2.internal\" (UID: \"a33761d7d0af7c6b314b351b86948829\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-26.ec2.internal"
Oct 30 19:46:58.864892 ip-10-0-131-26 kubenswrapper[2582]: E1030 19:46:58.864865    2582 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-131-26.ec2.internal\" not found"
Oct 30 19:46:58.965141 ip-10-0-131-26 kubenswrapper[2582]: E1030 19:46:58.965125    2582 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-131-26.ec2.internal\" not found"
Oct 30 19:46:59.003971 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:46:59.003955    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-26.ec2.internal"
Oct 30 19:46:59.006531 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:46:59.006517    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-26.ec2.internal"
Oct 30 19:46:59.065969 ip-10-0-131-26 kubenswrapper[2582]: E1030 19:46:59.065925    2582 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-131-26.ec2.internal\" not found"
Oct 30 19:46:59.166448 ip-10-0-131-26 kubenswrapper[2582]: E1030 19:46:59.166430    2582 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-131-26.ec2.internal\" not found"
Oct 30 19:46:59.228745 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:46:59.228729    2582 reflector.go:446] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 30 19:46:59.249808 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:46:59.249790    2582 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Oct 30 19:46:59.249897 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:46:59.249880    2582 reflector.go:578] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:161: Unexpected watch close - watch lasted less than a second and no items received"
Oct 30 19:46:59.249948 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:46:59.249896    2582 reflector.go:578] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:161: Unexpected watch close - watch lasted less than a second and no items received"
Oct 30 19:46:59.267065 ip-10-0-131-26 kubenswrapper[2582]: E1030 19:46:59.267049    2582 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-131-26.ec2.internal\" not found"
Oct 30 19:46:59.368188 ip-10-0-131-26 kubenswrapper[2582]: E1030 19:46:59.368139    2582 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-131-26.ec2.internal\" not found"
Oct 30 19:46:59.468794 ip-10-0-131-26 kubenswrapper[2582]: E1030 19:46:59.468763    2582 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-131-26.ec2.internal\" not found"
Oct 30 19:46:59.473003 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:46:59.472957    2582 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-10-29 19:41:58 +0000 UTC" deadline="2028-04-23 13:25:34.784767962 +0000 UTC"
Oct 30 19:46:59.473003 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:46:59.472997    2582 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12977h38m35.311773817s"
Oct 30 19:46:59.529875 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:46:59.529566    2582 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 30 19:46:59.530956 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:46:59.530924    2582 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-131-26.ec2.internal" event="NodeHasSufficientMemory"
Oct 30 19:46:59.531088 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:46:59.530969    2582 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-131-26.ec2.internal" event="NodeHasNoDiskPressure"
Oct 30 19:46:59.531088 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:46:59.530984    2582 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-131-26.ec2.internal" event="NodeHasSufficientPID"
Oct 30 19:46:59.550991 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:59.550955    2582 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3a7534b7f1df1f6e6fe99f614d7ed61c.slice/crio-b12583b58d445757934cc974f891e7ddb1bd4eee5dc3c66d6f71aa27b0ecbd4d WatchSource:0}: Error finding container b12583b58d445757934cc974f891e7ddb1bd4eee5dc3c66d6f71aa27b0ecbd4d: Status 404 returned error can't find the container with id b12583b58d445757934cc974f891e7ddb1bd4eee5dc3c66d6f71aa27b0ecbd4d
Oct 30 19:46:59.551527 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:46:59.551507    2582 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda33761d7d0af7c6b314b351b86948829.slice/crio-41241145138f8bb696f121cb22714ecd4cfa99755caad8984db4796c91738397 WatchSource:0}: Error finding container 41241145138f8bb696f121cb22714ecd4cfa99755caad8984db4796c91738397: Status 404 returned error can't find the container with id 41241145138f8bb696f121cb22714ecd4cfa99755caad8984db4796c91738397
Oct 30 19:46:59.557129 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:46:59.557114    2582 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Oct 30 19:46:59.568677 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:46:59.568633    2582 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-26.ec2.internal" event={"ID":"a33761d7d0af7c6b314b351b86948829","Type":"ContainerStarted","Data":"41241145138f8bb696f121cb22714ecd4cfa99755caad8984db4796c91738397"}
Oct 30 19:46:59.568818 ip-10-0-131-26 kubenswrapper[2582]: E1030 19:46:59.568802    2582 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-131-26.ec2.internal\" not found"
Oct 30 19:46:59.569876 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:46:59.569855    2582 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-26.ec2.internal" event={"ID":"3a7534b7f1df1f6e6fe99f614d7ed61c","Type":"ContainerStarted","Data":"b12583b58d445757934cc974f891e7ddb1bd4eee5dc3c66d6f71aa27b0ecbd4d"}
Oct 30 19:46:59.671701 ip-10-0-131-26 kubenswrapper[2582]: E1030 19:46:59.671651    2582 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-131-26.ec2.internal\" not found"
Oct 30 19:46:59.772343 ip-10-0-131-26 kubenswrapper[2582]: E1030 19:46:59.772323    2582 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-131-26.ec2.internal\" not found"
Oct 30 19:46:59.788574 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:46:59.788556    2582 reflector.go:446] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 30 19:46:59.813039 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:46:59.813018    2582 kubelet.go:3368] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-26.ec2.internal"
Oct 30 19:46:59.845541 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:46:59.845518    2582 reflector.go:446] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 30 19:46:59.857686 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:46:59.857667    2582 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Oct 30 19:46:59.858558 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:46:59.858545    2582 kubelet.go:3368] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-26.ec2.internal"
Oct 30 19:46:59.881172 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:46:59.881156    2582 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Oct 30 19:47:00.288941 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:00.288915    2582 apiserver.go:52] "Watching apiserver"
Oct 30 19:47:00.311307 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:00.311272    2582 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Oct 30 19:47:00.320426 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:00.320384    2582 reflector.go:446] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Oct 30 19:47:00.320800 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:00.320779    2582 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-multus/network-metrics-daemon-hkjcv","openshift-network-diagnostics/network-check-target-b27jd","openshift-network-operator/iptables-alerter-7gdcx","kube-system/konnectivity-agent-6lj57","kube-system/kube-apiserver-proxy-ip-10-0-131-26.ec2.internal","openshift-cluster-node-tuning-operator/tuned-k865s","openshift-dns/node-resolver-krr87","openshift-image-registry/node-ca-2swph","openshift-multus/multus-pb5c7","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-clzkm","openshift-ovn-kubernetes/ovnkube-node-84v4l","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-26.ec2.internal","openshift-multus/multus-additional-cni-plugins-q8w4d","kube-system/global-pull-secret-syncer-96mhd"]
Oct 30 19:47:00.323591 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:00.323396    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-krr87"
Oct 30 19:47:00.325844 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:00.325824    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-84v4l"
Oct 30 19:47:00.328223 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:00.328196    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-7gdcx"
Oct 30 19:47:00.330817 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:00.330798    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-6lj57"
Oct 30 19:47:00.333416 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:00.333107    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-96mhd"
Oct 30 19:47:00.333416 ip-10-0-131-26 kubenswrapper[2582]: E1030 19:47:00.333178    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-96mhd" podUID="90b35edf-4b09-41df-9374-a514d1417071"
Oct 30 19:47:00.336183 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:00.336161    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-k865s"
Oct 30 19:47:00.338666 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:00.338644    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-pb5c7"
Oct 30 19:47:00.341284 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:00.341266    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-q8w4d"
Oct 30 19:47:00.342942 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:00.342921    2582 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Oct 30 19:47:00.343043 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:00.343033    2582 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Oct 30 19:47:00.343114 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:00.343075    2582 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-cscqg\""
Oct 30 19:47:00.343625 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:00.343606    2582 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Oct 30 19:47:00.343743 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:00.343692    2582 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-97cb9\""
Oct 30 19:47:00.343743 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:00.343609    2582 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Oct 30 19:47:00.343904 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:00.343888    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b27jd"
Oct 30 19:47:00.344052 ip-10-0-131-26 kubenswrapper[2582]: E1030 19:47:00.344017    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b27jd" podUID="aa51899f-52a0-434e-b434-4bc030c94136"
Oct 30 19:47:00.346301 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:00.346286    2582 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-grfkh\""
Oct 30 19:47:00.346781 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:00.346761    2582 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Oct 30 19:47:00.347093 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:00.347058    2582 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Oct 30 19:47:00.347169 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:00.347148    2582 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Oct 30 19:47:00.347528 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:00.347276    2582 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Oct 30 19:47:00.347528 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:00.347311    2582 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Oct 30 19:47:00.347528 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:00.347430    2582 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Oct 30 19:47:00.347528 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:00.347476    2582 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Oct 30 19:47:00.347903 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:00.347881    2582 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Oct 30 19:47:00.348001 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:00.347965    2582 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Oct 30 19:47:00.348533 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:00.348194    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-clzkm"
Oct 30 19:47:00.350348 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:00.350329    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hkjcv"
Oct 30 19:47:00.350498 ip-10-0-131-26 kubenswrapper[2582]: E1030 19:47:00.350406    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hkjcv" podUID="0a8c4dcc-2f62-4efe-993e-2de411ce6654"
Oct 30 19:47:00.351363 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:00.351336    2582 reflector.go:446] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 30 19:47:00.352659 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:00.352638    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-2swph"
Oct 30 19:47:00.354309 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:00.354278    2582 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Oct 30 19:47:00.354415 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:00.354351    2582 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent-dockercfg-h4pgj\""
Oct 30 19:47:00.354415 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:00.354385    2582 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Oct 30 19:47:00.354527 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:00.354444    2582 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-qlg5x\""
Oct 30 19:47:00.372677 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:00.372653    2582 reflector.go:446] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Oct 30 19:47:00.372907 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:00.372890    2582 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-j9rz9"
Oct 30 19:47:00.377898 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:00.377875    2582 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-j9rz9"
Oct 30 19:47:00.413096 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:00.413077    2582 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Oct 30 19:47:00.424646 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:00.424618    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/98dd829b-0745-4229-b781-da2c4ad16f9e-host-cni-bin\") pod \"ovnkube-node-84v4l\" (UID: \"98dd829b-0745-4229-b781-da2c4ad16f9e\") " pod="openshift-ovn-kubernetes/ovnkube-node-84v4l"
Oct 30 19:47:00.424756 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:00.424667    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hk8r5\" (UniqueName: \"kubernetes.io/projected/641c89ab-1e2c-4e67-84b5-d5d0f4f30756-kube-api-access-hk8r5\") pod \"iptables-alerter-7gdcx\" (UID: \"641c89ab-1e2c-4e67-84b5-d5d0f4f30756\") " pod="openshift-network-operator/iptables-alerter-7gdcx"
Oct 30 19:47:00.424756 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:00.424696    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/8d3e77a0-4ee8-4429-9795-97fb3d799dba-hostroot\") pod \"multus-pb5c7\" (UID: \"8d3e77a0-4ee8-4429-9795-97fb3d799dba\") " pod="openshift-multus/multus-pb5c7"
Oct 30 19:47:00.424756 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:00.424737    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/423e0100-284b-48b9-bd4c-3b74005976d2-host\") pod \"node-ca-2swph\" (UID: \"423e0100-284b-48b9-bd4c-3b74005976d2\") " pod="openshift-image-registry/node-ca-2swph"
Oct 30 19:47:00.424916 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:00.424772    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/423e0100-284b-48b9-bd4c-3b74005976d2-serviceca\") pod \"node-ca-2swph\" (UID: \"423e0100-284b-48b9-bd4c-3b74005976d2\") " pod="openshift-image-registry/node-ca-2swph"
Oct 30 19:47:00.424916 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:00.424798    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8d3e77a0-4ee8-4429-9795-97fb3d799dba-host-var-lib-cni-bin\") pod \"multus-pb5c7\" (UID: \"8d3e77a0-4ee8-4429-9795-97fb3d799dba\") " pod="openshift-multus/multus-pb5c7"
Oct 30 19:47:00.424916 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:00.424853    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/8d3e77a0-4ee8-4429-9795-97fb3d799dba-host-var-lib-cni-multus\") pod \"multus-pb5c7\" (UID: \"8d3e77a0-4ee8-4429-9795-97fb3d799dba\") " pod="openshift-multus/multus-pb5c7"
Oct 30 19:47:00.424916 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:00.424888    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/34dfa231-fa1a-400c-82b4-6ee85859d7c4-tmp-dir\") pod \"node-resolver-krr87\" (UID: \"34dfa231-fa1a-400c-82b4-6ee85859d7c4\") " pod="openshift-dns/node-resolver-krr87"
Oct 30 19:47:00.425113 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:00.424933    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/98dd829b-0745-4229-b781-da2c4ad16f9e-host-cni-netd\") pod \"ovnkube-node-84v4l\" (UID: \"98dd829b-0745-4229-b781-da2c4ad16f9e\") " pod="openshift-ovn-kubernetes/ovnkube-node-84v4l"
Oct 30 19:47:00.425113 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:00.424958    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/641c89ab-1e2c-4e67-84b5-d5d0f4f30756-iptables-alerter-script\") pod \"iptables-alerter-7gdcx\" (UID: \"641c89ab-1e2c-4e67-84b5-d5d0f4f30756\") " pod="openshift-network-operator/iptables-alerter-7gdcx"
Oct 30 19:47:00.425113 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:00.424984    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8d3e77a0-4ee8-4429-9795-97fb3d799dba-system-cni-dir\") pod \"multus-pb5c7\" (UID: \"8d3e77a0-4ee8-4429-9795-97fb3d799dba\") " pod="openshift-multus/multus-pb5c7"
Oct 30 19:47:00.425113 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:00.425009    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/8d3e77a0-4ee8-4429-9795-97fb3d799dba-host-run-multus-certs\") pod \"multus-pb5c7\" (UID: \"8d3e77a0-4ee8-4429-9795-97fb3d799dba\") " pod="openshift-multus/multus-pb5c7"
Oct 30 19:47:00.425113 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:00.425102    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7drkj\" (UniqueName: \"kubernetes.io/projected/8d3e77a0-4ee8-4429-9795-97fb3d799dba-kube-api-access-7drkj\") pod \"multus-pb5c7\" (UID: \"8d3e77a0-4ee8-4429-9795-97fb3d799dba\") " pod="openshift-multus/multus-pb5c7"
Oct 30 19:47:00.425364 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:00.425127    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/98dd829b-0745-4229-b781-da2c4ad16f9e-run-systemd\") pod \"ovnkube-node-84v4l\" (UID: \"98dd829b-0745-4229-b781-da2c4ad16f9e\") " pod="openshift-ovn-kubernetes/ovnkube-node-84v4l"
Oct 30 19:47:00.425364 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:00.425153    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/98dd829b-0745-4229-b781-da2c4ad16f9e-ovnkube-config\") pod \"ovnkube-node-84v4l\" (UID: \"98dd829b-0745-4229-b781-da2c4ad16f9e\") " pod="openshift-ovn-kubernetes/ovnkube-node-84v4l"
Oct 30 19:47:00.425364 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:00.425178    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/98dd829b-0745-4229-b781-da2c4ad16f9e-ovn-node-metrics-cert\") pod \"ovnkube-node-84v4l\" (UID: \"98dd829b-0745-4229-b781-da2c4ad16f9e\") " pod="openshift-ovn-kubernetes/ovnkube-node-84v4l"
Oct 30 19:47:00.425364 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:00.425202    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/98dd829b-0745-4229-b781-da2c4ad16f9e-ovnkube-script-lib\") pod \"ovnkube-node-84v4l\" (UID: \"98dd829b-0745-4229-b781-da2c4ad16f9e\") " pod="openshift-ovn-kubernetes/ovnkube-node-84v4l"
Oct 30 19:47:00.425364 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:00.425227    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ac20c88a-e9bd-42c8-bcbe-2080f2393cc3-etc-tuned\") pod \"tuned-k865s\" (UID: \"ac20c88a-e9bd-42c8-bcbe-2080f2393cc3\") " pod="openshift-cluster-node-tuning-operator/tuned-k865s"
Oct 30 19:47:00.425364 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:00.425253    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v75vv\" (UniqueName: \"kubernetes.io/projected/2d3597bf-5138-4272-905b-d2fdd3bfbe7b-kube-api-access-v75vv\") pod \"aws-ebs-csi-driver-node-clzkm\" (UID: \"2d3597bf-5138-4272-905b-d2fdd3bfbe7b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-clzkm"
Oct 30 19:47:00.425364 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:00.425288    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/34dfa231-fa1a-400c-82b4-6ee85859d7c4-hosts-file\") pod \"node-resolver-krr87\" (UID: \"34dfa231-fa1a-400c-82b4-6ee85859d7c4\") " pod="openshift-dns/node-resolver-krr87"
Oct 30 19:47:00.425364 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:00.425352    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ac20c88a-e9bd-42c8-bcbe-2080f2393cc3-sys\") pod \"tuned-k865s\" (UID: \"ac20c88a-e9bd-42c8-bcbe-2080f2393cc3\") " pod="openshift-cluster-node-tuning-operator/tuned-k865s"
Oct 30 19:47:00.425772 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:00.425377    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ac20c88a-e9bd-42c8-bcbe-2080f2393cc3-tmp\") pod \"tuned-k865s\" (UID: \"ac20c88a-e9bd-42c8-bcbe-2080f2393cc3\") " pod="openshift-cluster-node-tuning-operator/tuned-k865s"
Oct 30 19:47:00.425772 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:00.425400    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r4zjc\" (UniqueName: \"kubernetes.io/projected/ac20c88a-e9bd-42c8-bcbe-2080f2393cc3-kube-api-access-r4zjc\") pod \"tuned-k865s\" (UID: \"ac20c88a-e9bd-42c8-bcbe-2080f2393cc3\") " pod="openshift-cluster-node-tuning-operator/tuned-k865s"
Oct 30 19:47:00.425772 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:00.425428    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8d3e77a0-4ee8-4429-9795-97fb3d799dba-multus-conf-dir\") pod \"multus-pb5c7\" (UID: \"8d3e77a0-4ee8-4429-9795-97fb3d799dba\") " pod="openshift-multus/multus-pb5c7"
Oct 30 19:47:00.425772 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:00.425475    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tmmdv\" (UniqueName: \"kubernetes.io/projected/aa51899f-52a0-434e-b434-4bc030c94136-kube-api-access-tmmdv\") pod \"network-check-target-b27jd\" (UID: \"aa51899f-52a0-434e-b434-4bc030c94136\") " pod="openshift-network-diagnostics/network-check-target-b27jd"
Oct 30 19:47:00.425772 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:00.425502    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0a8c4dcc-2f62-4efe-993e-2de411ce6654-metrics-certs\") pod \"network-metrics-daemon-hkjcv\" (UID: \"0a8c4dcc-2f62-4efe-993e-2de411ce6654\") " pod="openshift-multus/network-metrics-daemon-hkjcv"
Oct 30 19:47:00.425772 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:00.425522    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/98dd829b-0745-4229-b781-da2c4ad16f9e-host-kubelet\") pod \"ovnkube-node-84v4l\" (UID: \"98dd829b-0745-4229-b781-da2c4ad16f9e\") " pod="openshift-ovn-kubernetes/ovnkube-node-84v4l"
Oct 30 19:47:00.425772 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:00.425553    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/98dd829b-0745-4229-b781-da2c4ad16f9e-host-run-netns\") pod \"ovnkube-node-84v4l\" (UID: \"98dd829b-0745-4229-b781-da2c4ad16f9e\") " pod="openshift-ovn-kubernetes/ovnkube-node-84v4l"
Oct 30 19:47:00.425772 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:00.425579    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ac20c88a-e9bd-42c8-bcbe-2080f2393cc3-run\") pod \"tuned-k865s\" (UID: \"ac20c88a-e9bd-42c8-bcbe-2080f2393cc3\") " pod="openshift-cluster-node-tuning-operator/tuned-k865s"
Oct 30 19:47:00.425772 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:00.425599    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ac20c88a-e9bd-42c8-bcbe-2080f2393cc3-lib-modules\") pod \"tuned-k865s\" (UID: \"ac20c88a-e9bd-42c8-bcbe-2080f2393cc3\") " pod="openshift-cluster-node-tuning-operator/tuned-k865s"
Oct 30 19:47:00.425772 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:00.425614    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8d3e77a0-4ee8-4429-9795-97fb3d799dba-cnibin\") pod \"multus-pb5c7\" (UID: \"8d3e77a0-4ee8-4429-9795-97fb3d799dba\") " pod="openshift-multus/multus-pb5c7"
Oct 30 19:47:00.425772 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:00.425631    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/98dd829b-0745-4229-b781-da2c4ad16f9e-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-84v4l\" (UID: \"98dd829b-0745-4229-b781-da2c4ad16f9e\") " pod="openshift-ovn-kubernetes/ovnkube-node-84v4l"
Oct 30 19:47:00.425772 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:00.425655    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/90b35edf-4b09-41df-9374-a514d1417071-kubelet-config\") pod \"global-pull-secret-syncer-96mhd\" (UID: \"90b35edf-4b09-41df-9374-a514d1417071\") " pod="kube-system/global-pull-secret-syncer-96mhd"
Oct 30 19:47:00.425772 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:00.425687    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/90b35edf-4b09-41df-9374-a514d1417071-original-pull-secret\") pod \"global-pull-secret-syncer-96mhd\" (UID: \"90b35edf-4b09-41df-9374-a514d1417071\") " pod="kube-system/global-pull-secret-syncer-96mhd"
Oct 30 19:47:00.425772 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:00.425702    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8d3e77a0-4ee8-4429-9795-97fb3d799dba-host-var-lib-kubelet\") pod \"multus-pb5c7\" (UID: \"8d3e77a0-4ee8-4429-9795-97fb3d799dba\") " pod="openshift-multus/multus-pb5c7"
Oct 30 19:47:00.425772 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:00.425717    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/2d3597bf-5138-4272-905b-d2fdd3bfbe7b-device-dir\") pod \"aws-ebs-csi-driver-node-clzkm\" (UID: \"2d3597bf-5138-4272-905b-d2fdd3bfbe7b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-clzkm"
Oct 30 19:47:00.426430 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:00.425823    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/2d3597bf-5138-4272-905b-d2fdd3bfbe7b-registration-dir\") pod \"aws-ebs-csi-driver-node-clzkm\" (UID: \"2d3597bf-5138-4272-905b-d2fdd3bfbe7b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-clzkm"
Oct 30 19:47:00.426430 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:00.425845    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/2d3597bf-5138-4272-905b-d2fdd3bfbe7b-etc-selinux\") pod \"aws-ebs-csi-driver-node-clzkm\" (UID: \"2d3597bf-5138-4272-905b-d2fdd3bfbe7b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-clzkm"
Oct 30 19:47:00.426430 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:00.425869    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l9vw6\" (UniqueName: \"kubernetes.io/projected/0a8c4dcc-2f62-4efe-993e-2de411ce6654-kube-api-access-l9vw6\") pod \"network-metrics-daemon-hkjcv\" (UID: \"0a8c4dcc-2f62-4efe-993e-2de411ce6654\") " pod="openshift-multus/network-metrics-daemon-hkjcv"
Oct 30 19:47:00.426430 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:00.425885    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/98dd829b-0745-4229-b781-da2c4ad16f9e-host-run-ovn-kubernetes\") pod \"ovnkube-node-84v4l\" (UID: \"98dd829b-0745-4229-b781-da2c4ad16f9e\") " pod="openshift-ovn-kubernetes/ovnkube-node-84v4l"
Oct 30 19:47:00.426430 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:00.425903    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8d3e77a0-4ee8-4429-9795-97fb3d799dba-host-run-netns\") pod \"multus-pb5c7\" (UID: \"8d3e77a0-4ee8-4429-9795-97fb3d799dba\") " pod="openshift-multus/multus-pb5c7"
Oct 30 19:47:00.426430 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:00.425927    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/98dd829b-0745-4229-b781-da2c4ad16f9e-var-lib-openvswitch\") pod \"ovnkube-node-84v4l\" (UID: \"98dd829b-0745-4229-b781-da2c4ad16f9e\") " pod="openshift-ovn-kubernetes/ovnkube-node-84v4l"
Oct 30 19:47:00.426430 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:00.425958    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/98dd829b-0745-4229-b781-da2c4ad16f9e-node-log\") pod \"ovnkube-node-84v4l\" (UID: \"98dd829b-0745-4229-b781-da2c4ad16f9e\") " pod="openshift-ovn-kubernetes/ovnkube-node-84v4l"
Oct 30 19:47:00.426430 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:00.425986    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/98dd829b-0745-4229-b781-da2c4ad16f9e-log-socket\") pod \"ovnkube-node-84v4l\" (UID: \"98dd829b-0745-4229-b781-da2c4ad16f9e\") " pod="openshift-ovn-kubernetes/ovnkube-node-84v4l"
Oct 30 19:47:00.426430 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:00.426011    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ac20c88a-e9bd-42c8-bcbe-2080f2393cc3-etc-modprobe-d\") pod \"tuned-k865s\" (UID: \"ac20c88a-e9bd-42c8-bcbe-2080f2393cc3\") " pod="openshift-cluster-node-tuning-operator/tuned-k865s"
Oct 30 19:47:00.426430 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:00.426037    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ac20c88a-e9bd-42c8-bcbe-2080f2393cc3-etc-sysctl-conf\") pod \"tuned-k865s\" (UID: \"ac20c88a-e9bd-42c8-bcbe-2080f2393cc3\") " pod="openshift-cluster-node-tuning-operator/tuned-k865s"
Oct 30 19:47:00.426430 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:00.426057    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8d3e77a0-4ee8-4429-9795-97fb3d799dba-multus-cni-dir\") pod \"multus-pb5c7\" (UID: \"8d3e77a0-4ee8-4429-9795-97fb3d799dba\") " pod="openshift-multus/multus-pb5c7"
Oct 30 19:47:00.426430 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:00.426084    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9898418c-eb0f-41b4-a844-d853caeab57f-cni-binary-copy\") pod \"multus-additional-cni-plugins-q8w4d\" (UID: \"9898418c-eb0f-41b4-a844-d853caeab57f\") " pod="openshift-multus/multus-additional-cni-plugins-q8w4d"
Oct 30 19:47:00.426430 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:00.426110    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/2d3597bf-5138-4272-905b-d2fdd3bfbe7b-socket-dir\") pod \"aws-ebs-csi-driver-node-clzkm\" (UID: \"2d3597bf-5138-4272-905b-d2fdd3bfbe7b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-clzkm"
Oct 30 19:47:00.426430 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:00.426135    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/98dd829b-0745-4229-b781-da2c4ad16f9e-env-overrides\") pod \"ovnkube-node-84v4l\" (UID: \"98dd829b-0745-4229-b781-da2c4ad16f9e\") " pod="openshift-ovn-kubernetes/ovnkube-node-84v4l"
Oct 30 19:47:00.426430 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:00.426161    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8d3e77a0-4ee8-4429-9795-97fb3d799dba-etc-kubernetes\") pod \"multus-pb5c7\" (UID: \"8d3e77a0-4ee8-4429-9795-97fb3d799dba\") " pod="openshift-multus/multus-pb5c7"
Oct 30 19:47:00.426430 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:00.426191    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/9898418c-eb0f-41b4-a844-d853caeab57f-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-q8w4d\" (UID: \"9898418c-eb0f-41b4-a844-d853caeab57f\") " pod="openshift-multus/multus-additional-cni-plugins-q8w4d"
Oct 30 19:47:00.427154 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:00.426218    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mwhbg\" (UniqueName: \"kubernetes.io/projected/34dfa231-fa1a-400c-82b4-6ee85859d7c4-kube-api-access-mwhbg\") pod \"node-resolver-krr87\" (UID: \"34dfa231-fa1a-400c-82b4-6ee85859d7c4\") " pod="openshift-dns/node-resolver-krr87"
Oct 30 19:47:00.427154 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:00.426250    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bz9kn\" (UniqueName: \"kubernetes.io/projected/98dd829b-0745-4229-b781-da2c4ad16f9e-kube-api-access-bz9kn\") pod \"ovnkube-node-84v4l\" (UID: \"98dd829b-0745-4229-b781-da2c4ad16f9e\") " pod="openshift-ovn-kubernetes/ovnkube-node-84v4l"
Oct 30 19:47:00.427154 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:00.426277    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/641c89ab-1e2c-4e67-84b5-d5d0f4f30756-host-slash\") pod \"iptables-alerter-7gdcx\" (UID: \"641c89ab-1e2c-4e67-84b5-d5d0f4f30756\") " pod="openshift-network-operator/iptables-alerter-7gdcx"
Oct 30 19:47:00.427154 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:00.426306    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ac20c88a-e9bd-42c8-bcbe-2080f2393cc3-etc-kubernetes\") pod \"tuned-k865s\" (UID: \"ac20c88a-e9bd-42c8-bcbe-2080f2393cc3\") " pod="openshift-cluster-node-tuning-operator/tuned-k865s"
Oct 30 19:47:00.427154 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:00.426341    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ac20c88a-e9bd-42c8-bcbe-2080f2393cc3-etc-sysctl-d\") pod \"tuned-k865s\" (UID: \"ac20c88a-e9bd-42c8-bcbe-2080f2393cc3\") " pod="openshift-cluster-node-tuning-operator/tuned-k865s"
Oct 30 19:47:00.427154 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:00.426367    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/8d3e77a0-4ee8-4429-9795-97fb3d799dba-multus-socket-dir-parent\") pod \"multus-pb5c7\" (UID: \"8d3e77a0-4ee8-4429-9795-97fb3d799dba\") " pod="openshift-multus/multus-pb5c7"
Oct 30 19:47:00.427154 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:00.426407    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9898418c-eb0f-41b4-a844-d853caeab57f-system-cni-dir\") pod \"multus-additional-cni-plugins-q8w4d\" (UID: \"9898418c-eb0f-41b4-a844-d853caeab57f\") " pod="openshift-multus/multus-additional-cni-plugins-q8w4d"
Oct 30 19:47:00.427154 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:00.426432    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/2d3597bf-5138-4272-905b-d2fdd3bfbe7b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-clzkm\" (UID: \"2d3597bf-5138-4272-905b-d2fdd3bfbe7b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-clzkm"
Oct 30 19:47:00.427154 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:00.426455    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/98dd829b-0745-4229-b781-da2c4ad16f9e-run-ovn\") pod \"ovnkube-node-84v4l\" (UID: \"98dd829b-0745-4229-b781-da2c4ad16f9e\") " pod="openshift-ovn-kubernetes/ovnkube-node-84v4l"
Oct 30 19:47:00.427154 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:00.426481    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ac20c88a-e9bd-42c8-bcbe-2080f2393cc3-etc-systemd\") pod \"tuned-k865s\" (UID: \"ac20c88a-e9bd-42c8-bcbe-2080f2393cc3\") " pod="openshift-cluster-node-tuning-operator/tuned-k865s"
Oct 30 19:47:00.427154 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:00.426519    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ac20c88a-e9bd-42c8-bcbe-2080f2393cc3-var-lib-kubelet\") pod \"tuned-k865s\" (UID: \"ac20c88a-e9bd-42c8-bcbe-2080f2393cc3\") " pod="openshift-cluster-node-tuning-operator/tuned-k865s"
Oct 30 19:47:00.427154 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:00.426544    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ac20c88a-e9bd-42c8-bcbe-2080f2393cc3-host\") pod \"tuned-k865s\" (UID: \"ac20c88a-e9bd-42c8-bcbe-2080f2393cc3\") " pod="openshift-cluster-node-tuning-operator/tuned-k865s"
Oct 30 19:47:00.427154 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:00.426569    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9898418c-eb0f-41b4-a844-d853caeab57f-cnibin\") pod \"multus-additional-cni-plugins-q8w4d\" (UID: \"9898418c-eb0f-41b4-a844-d853caeab57f\") " pod="openshift-multus/multus-additional-cni-plugins-q8w4d"
Oct 30 19:47:00.427154 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:00.426596    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2gglq\" (UniqueName: \"kubernetes.io/projected/9898418c-eb0f-41b4-a844-d853caeab57f-kube-api-access-2gglq\") pod \"multus-additional-cni-plugins-q8w4d\" (UID: \"9898418c-eb0f-41b4-a844-d853caeab57f\") " pod="openshift-multus/multus-additional-cni-plugins-q8w4d"
Oct 30 19:47:00.427154 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:00.426622    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/98dd829b-0745-4229-b781-da2c4ad16f9e-run-openvswitch\") pod \"ovnkube-node-84v4l\" (UID: \"98dd829b-0745-4229-b781-da2c4ad16f9e\") " pod="openshift-ovn-kubernetes/ovnkube-node-84v4l"
Oct 30 19:47:00.427154 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:00.426794    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-njzf8\" (UniqueName: \"kubernetes.io/projected/423e0100-284b-48b9-bd4c-3b74005976d2-kube-api-access-njzf8\") pod \"node-ca-2swph\" (UID: \"423e0100-284b-48b9-bd4c-3b74005976d2\") " pod="openshift-image-registry/node-ca-2swph"
Oct 30 19:47:00.427934 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:00.426813    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/2be7f3a3-8714-491c-8e10-c594d425069a-konnectivity-ca\") pod \"konnectivity-agent-6lj57\" (UID: \"2be7f3a3-8714-491c-8e10-c594d425069a\") " pod="kube-system/konnectivity-agent-6lj57"
Oct 30 19:47:00.427934 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:00.426842    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/8d3e77a0-4ee8-4429-9795-97fb3d799dba-host-run-k8s-cni-cncf-io\") pod \"multus-pb5c7\" (UID: \"8d3e77a0-4ee8-4429-9795-97fb3d799dba\") " pod="openshift-multus/multus-pb5c7"
Oct 30 19:47:00.427934 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:00.426869    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/2d3597bf-5138-4272-905b-d2fdd3bfbe7b-sys-fs\") pod \"aws-ebs-csi-driver-node-clzkm\" (UID: \"2d3597bf-5138-4272-905b-d2fdd3bfbe7b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-clzkm"
Oct 30 19:47:00.427934 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:00.426895    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/98dd829b-0745-4229-b781-da2c4ad16f9e-host-slash\") pod \"ovnkube-node-84v4l\" (UID: \"98dd829b-0745-4229-b781-da2c4ad16f9e\") " pod="openshift-ovn-kubernetes/ovnkube-node-84v4l"
Oct 30 19:47:00.427934 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:00.426923    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/2be7f3a3-8714-491c-8e10-c594d425069a-agent-certs\") pod \"konnectivity-agent-6lj57\" (UID: \"2be7f3a3-8714-491c-8e10-c594d425069a\") " pod="kube-system/konnectivity-agent-6lj57"
Oct 30 19:47:00.427934 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:00.426949    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ac20c88a-e9bd-42c8-bcbe-2080f2393cc3-etc-sysconfig\") pod \"tuned-k865s\" (UID: \"ac20c88a-e9bd-42c8-bcbe-2080f2393cc3\") " pod="openshift-cluster-node-tuning-operator/tuned-k865s"
Oct 30 19:47:00.427934 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:00.426976    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/8d3e77a0-4ee8-4429-9795-97fb3d799dba-multus-daemon-config\") pod \"multus-pb5c7\" (UID: \"8d3e77a0-4ee8-4429-9795-97fb3d799dba\") " pod="openshift-multus/multus-pb5c7"
Oct 30 19:47:00.427934 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:00.427000    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/98dd829b-0745-4229-b781-da2c4ad16f9e-systemd-units\") pod \"ovnkube-node-84v4l\" (UID: \"98dd829b-0745-4229-b781-da2c4ad16f9e\") " pod="openshift-ovn-kubernetes/ovnkube-node-84v4l"
Oct 30 19:47:00.427934 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:00.427025    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/90b35edf-4b09-41df-9374-a514d1417071-dbus\") pod \"global-pull-secret-syncer-96mhd\" (UID: \"90b35edf-4b09-41df-9374-a514d1417071\") " pod="kube-system/global-pull-secret-syncer-96mhd"
Oct 30 19:47:00.427934 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:00.427051    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8d3e77a0-4ee8-4429-9795-97fb3d799dba-cni-binary-copy\") pod \"multus-pb5c7\" (UID: \"8d3e77a0-4ee8-4429-9795-97fb3d799dba\") " pod="openshift-multus/multus-pb5c7"
Oct 30 19:47:00.427934 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:00.427077    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9898418c-eb0f-41b4-a844-d853caeab57f-tuning-conf-dir\") pod \"multus-additional-cni-plugins-q8w4d\" (UID: \"9898418c-eb0f-41b4-a844-d853caeab57f\") " pod="openshift-multus/multus-additional-cni-plugins-q8w4d"
Oct 30 19:47:00.427934 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:00.427105    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/9898418c-eb0f-41b4-a844-d853caeab57f-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-q8w4d\" (UID: \"9898418c-eb0f-41b4-a844-d853caeab57f\") " pod="openshift-multus/multus-additional-cni-plugins-q8w4d"
Oct 30 19:47:00.427934 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:00.427131    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/98dd829b-0745-4229-b781-da2c4ad16f9e-etc-openvswitch\") pod \"ovnkube-node-84v4l\" (UID: \"98dd829b-0745-4229-b781-da2c4ad16f9e\") " pod="openshift-ovn-kubernetes/ovnkube-node-84v4l"
Oct 30 19:47:00.452245 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:00.452213    2582 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Oct 30 19:47:00.452245 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:00.452225    2582 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Oct 30 19:47:00.452460 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:00.452258    2582 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Oct 30 19:47:00.452460 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:00.452398    2582 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Oct 30 19:47:00.452631 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:00.452466    2582 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Oct 30 19:47:00.452631 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:00.452491    2582 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Oct 30 19:47:00.452631 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:00.452499    2582 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Oct 30 19:47:00.452631 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:00.452550    2582 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Oct 30 19:47:00.452631 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:00.452560    2582 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Oct 30 19:47:00.452631 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:00.452470    2582 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Oct 30 19:47:00.452631 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:00.452578    2582 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-d5xr8\""
Oct 30 19:47:00.452631 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:00.452600    2582 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Oct 30 19:47:00.452975 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:00.452670    2582 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-node-identity-dockercfg-bvhff\""
Oct 30 19:47:00.452975 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:00.452679    2582 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-wgtz9\""
Oct 30 19:47:00.452975 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:00.452725    2582 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Oct 30 19:47:00.452975 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:00.452784    2582 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-n5k26\""
Oct 30 19:47:00.527349 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:00.527320    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8d3e77a0-4ee8-4429-9795-97fb3d799dba-host-var-lib-cni-bin\") pod \"multus-pb5c7\" (UID: \"8d3e77a0-4ee8-4429-9795-97fb3d799dba\") " pod="openshift-multus/multus-pb5c7"
Oct 30 19:47:00.527349 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:00.527348    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/8d3e77a0-4ee8-4429-9795-97fb3d799dba-host-var-lib-cni-multus\") pod \"multus-pb5c7\" (UID: \"8d3e77a0-4ee8-4429-9795-97fb3d799dba\") " pod="openshift-multus/multus-pb5c7"
Oct 30 19:47:00.527568 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:00.527365    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/34dfa231-fa1a-400c-82b4-6ee85859d7c4-tmp-dir\") pod \"node-resolver-krr87\" (UID: \"34dfa231-fa1a-400c-82b4-6ee85859d7c4\") " pod="openshift-dns/node-resolver-krr87"
Oct 30 19:47:00.527568 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:00.527385    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/98dd829b-0745-4229-b781-da2c4ad16f9e-host-cni-netd\") pod \"ovnkube-node-84v4l\" (UID: \"98dd829b-0745-4229-b781-da2c4ad16f9e\") " pod="openshift-ovn-kubernetes/ovnkube-node-84v4l"
Oct 30 19:47:00.527568 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:00.527410    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/641c89ab-1e2c-4e67-84b5-d5d0f4f30756-iptables-alerter-script\") pod \"iptables-alerter-7gdcx\" (UID: \"641c89ab-1e2c-4e67-84b5-d5d0f4f30756\") " pod="openshift-network-operator/iptables-alerter-7gdcx"
Oct 30 19:47:00.527568 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:00.527434    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8d3e77a0-4ee8-4429-9795-97fb3d799dba-system-cni-dir\") pod \"multus-pb5c7\" (UID: \"8d3e77a0-4ee8-4429-9795-97fb3d799dba\") " pod="openshift-multus/multus-pb5c7"
Oct 30 19:47:00.527568 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:00.527457    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/8d3e77a0-4ee8-4429-9795-97fb3d799dba-host-run-multus-certs\") pod \"multus-pb5c7\" (UID: \"8d3e77a0-4ee8-4429-9795-97fb3d799dba\") " pod="openshift-multus/multus-pb5c7"
Oct 30 19:47:00.527568 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:00.527460    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/8d3e77a0-4ee8-4429-9795-97fb3d799dba-host-var-lib-cni-multus\") pod \"multus-pb5c7\" (UID: \"8d3e77a0-4ee8-4429-9795-97fb3d799dba\") " pod="openshift-multus/multus-pb5c7"
Oct 30 19:47:00.527568 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:00.527483    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7drkj\" (UniqueName: \"kubernetes.io/projected/8d3e77a0-4ee8-4429-9795-97fb3d799dba-kube-api-access-7drkj\") pod \"multus-pb5c7\" (UID: \"8d3e77a0-4ee8-4429-9795-97fb3d799dba\") " pod="openshift-multus/multus-pb5c7"
Oct 30 19:47:00.527568 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:00.527501    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8d3e77a0-4ee8-4429-9795-97fb3d799dba-host-var-lib-cni-bin\") pod \"multus-pb5c7\" (UID: \"8d3e77a0-4ee8-4429-9795-97fb3d799dba\") " pod="openshift-multus/multus-pb5c7"
Oct 30 19:47:00.527568 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:00.527537    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/98dd829b-0745-4229-b781-da2c4ad16f9e-run-systemd\") pod \"ovnkube-node-84v4l\" (UID: \"98dd829b-0745-4229-b781-da2c4ad16f9e\") " pod="openshift-ovn-kubernetes/ovnkube-node-84v4l"
Oct 30 19:47:00.527568 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:00.527560    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/98dd829b-0745-4229-b781-da2c4ad16f9e-ovnkube-config\") pod \"ovnkube-node-84v4l\" (UID: \"98dd829b-0745-4229-b781-da2c4ad16f9e\") " pod="openshift-ovn-kubernetes/ovnkube-node-84v4l"
Oct 30 19:47:00.527978 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:00.527586    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/98dd829b-0745-4229-b781-da2c4ad16f9e-ovn-node-metrics-cert\") pod \"ovnkube-node-84v4l\" (UID: \"98dd829b-0745-4229-b781-da2c4ad16f9e\") " pod="openshift-ovn-kubernetes/ovnkube-node-84v4l"
Oct 30 19:47:00.527978 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:00.527609    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/98dd829b-0745-4229-b781-da2c4ad16f9e-ovnkube-script-lib\") pod \"ovnkube-node-84v4l\" (UID: \"98dd829b-0745-4229-b781-da2c4ad16f9e\") " pod="openshift-ovn-kubernetes/ovnkube-node-84v4l"
Oct 30 19:47:00.527978 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:00.527642    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ac20c88a-e9bd-42c8-bcbe-2080f2393cc3-etc-tuned\") pod \"tuned-k865s\" (UID: \"ac20c88a-e9bd-42c8-bcbe-2080f2393cc3\") " pod="openshift-cluster-node-tuning-operator/tuned-k865s"
Oct 30 19:47:00.527978 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:00.527667    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v75vv\" (UniqueName: \"kubernetes.io/projected/2d3597bf-5138-4272-905b-d2fdd3bfbe7b-kube-api-access-v75vv\") pod \"aws-ebs-csi-driver-node-clzkm\" (UID: \"2d3597bf-5138-4272-905b-d2fdd3bfbe7b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-clzkm"
Oct 30 19:47:00.527978 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:00.527691    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/34dfa231-fa1a-400c-82b4-6ee85859d7c4-hosts-file\") pod \"node-resolver-krr87\" (UID: \"34dfa231-fa1a-400c-82b4-6ee85859d7c4\") " pod="openshift-dns/node-resolver-krr87"
Oct 30 19:47:00.527978 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:00.527713    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ac20c88a-e9bd-42c8-bcbe-2080f2393cc3-sys\") pod \"tuned-k865s\" (UID: \"ac20c88a-e9bd-42c8-bcbe-2080f2393cc3\") " pod="openshift-cluster-node-tuning-operator/tuned-k865s"
Oct 30 19:47:00.527978 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:00.527734    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ac20c88a-e9bd-42c8-bcbe-2080f2393cc3-tmp\") pod \"tuned-k865s\" (UID: \"ac20c88a-e9bd-42c8-bcbe-2080f2393cc3\") " pod="openshift-cluster-node-tuning-operator/tuned-k865s"
Oct 30 19:47:00.527978 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:00.527760    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r4zjc\" (UniqueName: \"kubernetes.io/projected/ac20c88a-e9bd-42c8-bcbe-2080f2393cc3-kube-api-access-r4zjc\") pod \"tuned-k865s\" (UID: \"ac20c88a-e9bd-42c8-bcbe-2080f2393cc3\") " pod="openshift-cluster-node-tuning-operator/tuned-k865s"
Oct 30 19:47:00.527978 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:00.527786    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8d3e77a0-4ee8-4429-9795-97fb3d799dba-multus-conf-dir\") pod \"multus-pb5c7\" (UID: \"8d3e77a0-4ee8-4429-9795-97fb3d799dba\") " pod="openshift-multus/multus-pb5c7"
Oct 30 19:47:00.527978 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:00.527809    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tmmdv\" (UniqueName: \"kubernetes.io/projected/aa51899f-52a0-434e-b434-4bc030c94136-kube-api-access-tmmdv\") pod \"network-check-target-b27jd\" (UID: \"aa51899f-52a0-434e-b434-4bc030c94136\") " pod="openshift-network-diagnostics/network-check-target-b27jd"
Oct 30 19:47:00.527978 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:00.527834    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0a8c4dcc-2f62-4efe-993e-2de411ce6654-metrics-certs\") pod \"network-metrics-daemon-hkjcv\" (UID: \"0a8c4dcc-2f62-4efe-993e-2de411ce6654\") " pod="openshift-multus/network-metrics-daemon-hkjcv"
Oct 30 19:47:00.527978 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:00.527857    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/98dd829b-0745-4229-b781-da2c4ad16f9e-host-kubelet\") pod \"ovnkube-node-84v4l\" (UID: \"98dd829b-0745-4229-b781-da2c4ad16f9e\") " pod="openshift-ovn-kubernetes/ovnkube-node-84v4l"
Oct 30 19:47:00.527978 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:00.527883    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/98dd829b-0745-4229-b781-da2c4ad16f9e-host-run-netns\") pod \"ovnkube-node-84v4l\" (UID: \"98dd829b-0745-4229-b781-da2c4ad16f9e\") " pod="openshift-ovn-kubernetes/ovnkube-node-84v4l"
Oct 30 19:47:00.527978 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:00.527926    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ac20c88a-e9bd-42c8-bcbe-2080f2393cc3-run\") pod \"tuned-k865s\" (UID: \"ac20c88a-e9bd-42c8-bcbe-2080f2393cc3\") " pod="openshift-cluster-node-tuning-operator/tuned-k865s"
Oct 30 19:47:00.527978 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:00.527948    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ac20c88a-e9bd-42c8-bcbe-2080f2393cc3-lib-modules\") pod \"tuned-k865s\" (UID: \"ac20c88a-e9bd-42c8-bcbe-2080f2393cc3\") " pod="openshift-cluster-node-tuning-operator/tuned-k865s"
Oct 30 19:47:00.527978 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:00.527973    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8d3e77a0-4ee8-4429-9795-97fb3d799dba-cnibin\") pod \"multus-pb5c7\" (UID: \"8d3e77a0-4ee8-4429-9795-97fb3d799dba\") " pod="openshift-multus/multus-pb5c7"
Oct 30 19:47:00.528755 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:00.527998    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/98dd829b-0745-4229-b781-da2c4ad16f9e-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-84v4l\" (UID: \"98dd829b-0745-4229-b781-da2c4ad16f9e\") " pod="openshift-ovn-kubernetes/ovnkube-node-84v4l"
Oct 30 19:47:00.528755 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:00.528026    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/90b35edf-4b09-41df-9374-a514d1417071-kubelet-config\") pod \"global-pull-secret-syncer-96mhd\" (UID: \"90b35edf-4b09-41df-9374-a514d1417071\") " pod="kube-system/global-pull-secret-syncer-96mhd"
Oct 30 19:47:00.528755 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:00.528051    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/90b35edf-4b09-41df-9374-a514d1417071-original-pull-secret\") pod \"global-pull-secret-syncer-96mhd\" (UID: \"90b35edf-4b09-41df-9374-a514d1417071\") " pod="kube-system/global-pull-secret-syncer-96mhd"
Oct 30 19:47:00.528755 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:00.528055    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/34dfa231-fa1a-400c-82b4-6ee85859d7c4-tmp-dir\") pod \"node-resolver-krr87\" (UID: \"34dfa231-fa1a-400c-82b4-6ee85859d7c4\") " pod="openshift-dns/node-resolver-krr87"
Oct 30 19:47:00.528755 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:00.528074    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8d3e77a0-4ee8-4429-9795-97fb3d799dba-host-var-lib-kubelet\") pod \"multus-pb5c7\" (UID: \"8d3e77a0-4ee8-4429-9795-97fb3d799dba\") " pod="openshift-multus/multus-pb5c7"
Oct 30 19:47:00.528755 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:00.528112    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/2d3597bf-5138-4272-905b-d2fdd3bfbe7b-device-dir\") pod \"aws-ebs-csi-driver-node-clzkm\" (UID: \"2d3597bf-5138-4272-905b-d2fdd3bfbe7b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-clzkm"
Oct 30 19:47:00.528755 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:00.528122    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8d3e77a0-4ee8-4429-9795-97fb3d799dba-host-var-lib-kubelet\") pod \"multus-pb5c7\" (UID: \"8d3e77a0-4ee8-4429-9795-97fb3d799dba\") " pod="openshift-multus/multus-pb5c7"
Oct 30 19:47:00.528755 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:00.528140    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/2d3597bf-5138-4272-905b-d2fdd3bfbe7b-registration-dir\") pod \"aws-ebs-csi-driver-node-clzkm\" (UID: \"2d3597bf-5138-4272-905b-d2fdd3bfbe7b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-clzkm"
Oct 30 19:47:00.528755 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:00.528164    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/98dd829b-0745-4229-b781-da2c4ad16f9e-run-systemd\") pod \"ovnkube-node-84v4l\" (UID: \"98dd829b-0745-4229-b781-da2c4ad16f9e\") " pod="openshift-ovn-kubernetes/ovnkube-node-84v4l"
Oct 30 19:47:00.528755 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:00.528167    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/2d3597bf-5138-4272-905b-d2fdd3bfbe7b-etc-selinux\") pod \"aws-ebs-csi-driver-node-clzkm\" (UID: \"2d3597bf-5138-4272-905b-d2fdd3bfbe7b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-clzkm"
Oct 30 19:47:00.528755 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:00.528198    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l9vw6\" (UniqueName: \"kubernetes.io/projected/0a8c4dcc-2f62-4efe-993e-2de411ce6654-kube-api-access-l9vw6\") pod \"network-metrics-daemon-hkjcv\" (UID: \"0a8c4dcc-2f62-4efe-993e-2de411ce6654\") " pod="openshift-multus/network-metrics-daemon-hkjcv"
Oct 30 19:47:00.528755 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:00.528224    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/98dd829b-0745-4229-b781-da2c4ad16f9e-host-run-ovn-kubernetes\") pod \"ovnkube-node-84v4l\" (UID: \"98dd829b-0745-4229-b781-da2c4ad16f9e\") " pod="openshift-ovn-kubernetes/ovnkube-node-84v4l"
Oct 30 19:47:00.528755 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:00.528250    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8d3e77a0-4ee8-4429-9795-97fb3d799dba-host-run-netns\") pod \"multus-pb5c7\" (UID: \"8d3e77a0-4ee8-4429-9795-97fb3d799dba\") " pod="openshift-multus/multus-pb5c7"
Oct 30 19:47:00.528755 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:00.528279    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/98dd829b-0745-4229-b781-da2c4ad16f9e-var-lib-openvswitch\") pod \"ovnkube-node-84v4l\" (UID: \"98dd829b-0745-4229-b781-da2c4ad16f9e\") " pod="openshift-ovn-kubernetes/ovnkube-node-84v4l"
Oct 30 19:47:00.528755 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:00.528303    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/98dd829b-0745-4229-b781-da2c4ad16f9e-node-log\") pod \"ovnkube-node-84v4l\" (UID: \"98dd829b-0745-4229-b781-da2c4ad16f9e\") " pod="openshift-ovn-kubernetes/ovnkube-node-84v4l"
Oct 30 19:47:00.528755 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:00.528327    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/98dd829b-0745-4229-b781-da2c4ad16f9e-log-socket\") pod \"ovnkube-node-84v4l\" (UID: \"98dd829b-0745-4229-b781-da2c4ad16f9e\") " pod="openshift-ovn-kubernetes/ovnkube-node-84v4l"
Oct 30 19:47:00.528755 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:00.528350    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ac20c88a-e9bd-42c8-bcbe-2080f2393cc3-etc-modprobe-d\") pod \"tuned-k865s\" (UID: \"ac20c88a-e9bd-42c8-bcbe-2080f2393cc3\") " pod="openshift-cluster-node-tuning-operator/tuned-k865s"
Oct 30 19:47:00.529429 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:00.528377    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ac20c88a-e9bd-42c8-bcbe-2080f2393cc3-etc-sysctl-conf\") pod \"tuned-k865s\" (UID: \"ac20c88a-e9bd-42c8-bcbe-2080f2393cc3\") " pod="openshift-cluster-node-tuning-operator/tuned-k865s"
Oct 30 19:47:00.529429 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:00.528402    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8d3e77a0-4ee8-4429-9795-97fb3d799dba-multus-cni-dir\") pod \"multus-pb5c7\" (UID: \"8d3e77a0-4ee8-4429-9795-97fb3d799dba\") " pod="openshift-multus/multus-pb5c7"
Oct 30 19:47:00.529429 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:00.528428    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9898418c-eb0f-41b4-a844-d853caeab57f-cni-binary-copy\") pod \"multus-additional-cni-plugins-q8w4d\" (UID: \"9898418c-eb0f-41b4-a844-d853caeab57f\") " pod="openshift-multus/multus-additional-cni-plugins-q8w4d"
Oct 30 19:47:00.529429 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:00.528456    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/2d3597bf-5138-4272-905b-d2fdd3bfbe7b-socket-dir\") pod \"aws-ebs-csi-driver-node-clzkm\" (UID: \"2d3597bf-5138-4272-905b-d2fdd3bfbe7b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-clzkm"
Oct 30 19:47:00.529429 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:00.528481    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/98dd829b-0745-4229-b781-da2c4ad16f9e-env-overrides\") pod \"ovnkube-node-84v4l\" (UID: \"98dd829b-0745-4229-b781-da2c4ad16f9e\") " pod="openshift-ovn-kubernetes/ovnkube-node-84v4l"
Oct 30 19:47:00.529429 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:00.528528    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8d3e77a0-4ee8-4429-9795-97fb3d799dba-etc-kubernetes\") pod \"multus-pb5c7\" (UID: \"8d3e77a0-4ee8-4429-9795-97fb3d799dba\") " pod="openshift-multus/multus-pb5c7"
Oct 30 19:47:00.529429 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:00.528556    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/9898418c-eb0f-41b4-a844-d853caeab57f-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-q8w4d\" (UID: \"9898418c-eb0f-41b4-a844-d853caeab57f\") " pod="openshift-multus/multus-additional-cni-plugins-q8w4d"
Oct 30 19:47:00.529429 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:00.528584    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mwhbg\" (UniqueName: \"kubernetes.io/projected/34dfa231-fa1a-400c-82b4-6ee85859d7c4-kube-api-access-mwhbg\") pod \"node-resolver-krr87\" (UID: \"34dfa231-fa1a-400c-82b4-6ee85859d7c4\") " pod="openshift-dns/node-resolver-krr87"
Oct 30 19:47:00.529429 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:00.528610    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bz9kn\" (UniqueName: \"kubernetes.io/projected/98dd829b-0745-4229-b781-da2c4ad16f9e-kube-api-access-bz9kn\") pod \"ovnkube-node-84v4l\" (UID: \"98dd829b-0745-4229-b781-da2c4ad16f9e\") " pod="openshift-ovn-kubernetes/ovnkube-node-84v4l"
Oct 30 19:47:00.529429 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:00.528638    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/641c89ab-1e2c-4e67-84b5-d5d0f4f30756-host-slash\") pod \"iptables-alerter-7gdcx\" (UID: \"641c89ab-1e2c-4e67-84b5-d5d0f4f30756\") " pod="openshift-network-operator/iptables-alerter-7gdcx"
Oct 30 19:47:00.529429 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:00.528664    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ac20c88a-e9bd-42c8-bcbe-2080f2393cc3-etc-kubernetes\") pod \"tuned-k865s\" (UID: \"ac20c88a-e9bd-42c8-bcbe-2080f2393cc3\") " pod="openshift-cluster-node-tuning-operator/tuned-k865s"
Oct 30 19:47:00.529429 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:00.528692    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ac20c88a-e9bd-42c8-bcbe-2080f2393cc3-etc-sysctl-d\") pod \"tuned-k865s\" (UID: \"ac20c88a-e9bd-42c8-bcbe-2080f2393cc3\") " pod="openshift-cluster-node-tuning-operator/tuned-k865s"
Oct 30 19:47:00.529429 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:00.528719    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/8d3e77a0-4ee8-4429-9795-97fb3d799dba-multus-socket-dir-parent\") pod \"multus-pb5c7\" (UID: \"8d3e77a0-4ee8-4429-9795-97fb3d799dba\") " pod="openshift-multus/multus-pb5c7"
Oct 30 19:47:00.529429 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:00.528747    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9898418c-eb0f-41b4-a844-d853caeab57f-system-cni-dir\") pod \"multus-additional-cni-plugins-q8w4d\" (UID: \"9898418c-eb0f-41b4-a844-d853caeab57f\") " pod="openshift-multus/multus-additional-cni-plugins-q8w4d"
Oct 30 19:47:00.529429 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:00.528776    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/2d3597bf-5138-4272-905b-d2fdd3bfbe7b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-clzkm\" (UID: \"2d3597bf-5138-4272-905b-d2fdd3bfbe7b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-clzkm"
Oct 30 19:47:00.529429 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:00.528792    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/98dd829b-0745-4229-b781-da2c4ad16f9e-ovnkube-config\") pod \"ovnkube-node-84v4l\" (UID: \"98dd829b-0745-4229-b781-da2c4ad16f9e\") " pod="openshift-ovn-kubernetes/ovnkube-node-84v4l"
Oct 30 19:47:00.529429 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:00.528802    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/98dd829b-0745-4229-b781-da2c4ad16f9e-run-ovn\") pod \"ovnkube-node-84v4l\" (UID: \"98dd829b-0745-4229-b781-da2c4ad16f9e\") " pod="openshift-ovn-kubernetes/ovnkube-node-84v4l"
Oct 30 19:47:00.530222 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:00.528840    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ac20c88a-e9bd-42c8-bcbe-2080f2393cc3-etc-systemd\") pod \"tuned-k865s\" (UID: \"ac20c88a-e9bd-42c8-bcbe-2080f2393cc3\") " pod="openshift-cluster-node-tuning-operator/tuned-k865s"
Oct 30 19:47:00.530222 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:00.528867    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ac20c88a-e9bd-42c8-bcbe-2080f2393cc3-var-lib-kubelet\") pod \"tuned-k865s\" (UID: \"ac20c88a-e9bd-42c8-bcbe-2080f2393cc3\") " pod="openshift-cluster-node-tuning-operator/tuned-k865s"
Oct 30 19:47:00.530222 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:00.528893    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ac20c88a-e9bd-42c8-bcbe-2080f2393cc3-host\") pod \"tuned-k865s\" (UID: \"ac20c88a-e9bd-42c8-bcbe-2080f2393cc3\") " pod="openshift-cluster-node-tuning-operator/tuned-k865s"
Oct 30 19:47:00.530222 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:00.528918    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9898418c-eb0f-41b4-a844-d853caeab57f-cnibin\") pod \"multus-additional-cni-plugins-q8w4d\" (UID: \"9898418c-eb0f-41b4-a844-d853caeab57f\") " pod="openshift-multus/multus-additional-cni-plugins-q8w4d"
Oct 30 19:47:00.530222 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:00.528945    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2gglq\" (UniqueName: \"kubernetes.io/projected/9898418c-eb0f-41b4-a844-d853caeab57f-kube-api-access-2gglq\") pod \"multus-additional-cni-plugins-q8w4d\" (UID: \"9898418c-eb0f-41b4-a844-d853caeab57f\") " pod="openshift-multus/multus-additional-cni-plugins-q8w4d"
Oct 30 19:47:00.530222 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:00.528970    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/98dd829b-0745-4229-b781-da2c4ad16f9e-run-openvswitch\") pod \"ovnkube-node-84v4l\" (UID: \"98dd829b-0745-4229-b781-da2c4ad16f9e\") " pod="openshift-ovn-kubernetes/ovnkube-node-84v4l"
Oct 30 19:47:00.530222 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:00.528997    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-njzf8\" (UniqueName: \"kubernetes.io/projected/423e0100-284b-48b9-bd4c-3b74005976d2-kube-api-access-njzf8\") pod \"node-ca-2swph\" (UID: \"423e0100-284b-48b9-bd4c-3b74005976d2\") " pod="openshift-image-registry/node-ca-2swph"
Oct 30 19:47:00.530222 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:00.529032    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/2be7f3a3-8714-491c-8e10-c594d425069a-konnectivity-ca\") pod \"konnectivity-agent-6lj57\" (UID: \"2be7f3a3-8714-491c-8e10-c594d425069a\") " pod="kube-system/konnectivity-agent-6lj57"
Oct 30 19:47:00.530222 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:00.529059    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/8d3e77a0-4ee8-4429-9795-97fb3d799dba-host-run-k8s-cni-cncf-io\") pod \"multus-pb5c7\" (UID: \"8d3e77a0-4ee8-4429-9795-97fb3d799dba\") " pod="openshift-multus/multus-pb5c7"
Oct 30 19:47:00.530222 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:00.529108    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/2d3597bf-5138-4272-905b-d2fdd3bfbe7b-sys-fs\") pod \"aws-ebs-csi-driver-node-clzkm\" (UID: \"2d3597bf-5138-4272-905b-d2fdd3bfbe7b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-clzkm"
Oct 30 19:47:00.530222 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:00.529135    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/98dd829b-0745-4229-b781-da2c4ad16f9e-host-slash\") pod \"ovnkube-node-84v4l\" (UID: \"98dd829b-0745-4229-b781-da2c4ad16f9e\") " pod="openshift-ovn-kubernetes/ovnkube-node-84v4l"
Oct 30 19:47:00.530222 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:00.529163    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/2be7f3a3-8714-491c-8e10-c594d425069a-agent-certs\") pod \"konnectivity-agent-6lj57\" (UID: \"2be7f3a3-8714-491c-8e10-c594d425069a\") " pod="kube-system/konnectivity-agent-6lj57"
Oct 30 19:47:00.530222 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:00.529175    2582 swap_util.go:78] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Oct 30 19:47:00.530222 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:00.529189    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ac20c88a-e9bd-42c8-bcbe-2080f2393cc3-etc-sysconfig\") pod \"tuned-k865s\" (UID: \"ac20c88a-e9bd-42c8-bcbe-2080f2393cc3\") " pod="openshift-cluster-node-tuning-operator/tuned-k865s"
Oct 30 19:47:00.530222 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:00.529218    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/8d3e77a0-4ee8-4429-9795-97fb3d799dba-multus-daemon-config\") pod \"multus-pb5c7\" (UID: \"8d3e77a0-4ee8-4429-9795-97fb3d799dba\") " pod="openshift-multus/multus-pb5c7"
Oct 30 19:47:00.530222 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:00.529243    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/98dd829b-0745-4229-b781-da2c4ad16f9e-systemd-units\") pod \"ovnkube-node-84v4l\" (UID: \"98dd829b-0745-4229-b781-da2c4ad16f9e\") " pod="openshift-ovn-kubernetes/ovnkube-node-84v4l"
Oct 30 19:47:00.530222 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:00.529265    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/90b35edf-4b09-41df-9374-a514d1417071-dbus\") pod \"global-pull-secret-syncer-96mhd\" (UID: \"90b35edf-4b09-41df-9374-a514d1417071\") " pod="kube-system/global-pull-secret-syncer-96mhd"
Oct 30 19:47:00.530222 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:00.529294    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8d3e77a0-4ee8-4429-9795-97fb3d799dba-cni-binary-copy\") pod \"multus-pb5c7\" (UID: \"8d3e77a0-4ee8-4429-9795-97fb3d799dba\") " pod="openshift-multus/multus-pb5c7"
Oct 30 19:47:00.531156 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:00.529320    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9898418c-eb0f-41b4-a844-d853caeab57f-tuning-conf-dir\") pod \"multus-additional-cni-plugins-q8w4d\" (UID: \"9898418c-eb0f-41b4-a844-d853caeab57f\") " pod="openshift-multus/multus-additional-cni-plugins-q8w4d"
Oct 30 19:47:00.531156 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:00.529346    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/9898418c-eb0f-41b4-a844-d853caeab57f-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-q8w4d\" (UID: \"9898418c-eb0f-41b4-a844-d853caeab57f\") " pod="openshift-multus/multus-additional-cni-plugins-q8w4d"
Oct 30 19:47:00.531156 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:00.529376    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/98dd829b-0745-4229-b781-da2c4ad16f9e-etc-openvswitch\") pod \"ovnkube-node-84v4l\" (UID: \"98dd829b-0745-4229-b781-da2c4ad16f9e\") " pod="openshift-ovn-kubernetes/ovnkube-node-84v4l"
Oct 30 19:47:00.531156 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:00.529406    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/98dd829b-0745-4229-b781-da2c4ad16f9e-host-cni-bin\") pod \"ovnkube-node-84v4l\" (UID: \"98dd829b-0745-4229-b781-da2c4ad16f9e\") " pod="openshift-ovn-kubernetes/ovnkube-node-84v4l"
Oct 30 19:47:00.531156 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:00.529433    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hk8r5\" (UniqueName: \"kubernetes.io/projected/641c89ab-1e2c-4e67-84b5-d5d0f4f30756-kube-api-access-hk8r5\") pod \"iptables-alerter-7gdcx\" (UID: \"641c89ab-1e2c-4e67-84b5-d5d0f4f30756\") " pod="openshift-network-operator/iptables-alerter-7gdcx"
Oct 30 19:47:00.531156 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:00.529462    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/8d3e77a0-4ee8-4429-9795-97fb3d799dba-hostroot\") pod \"multus-pb5c7\" (UID: \"8d3e77a0-4ee8-4429-9795-97fb3d799dba\") " pod="openshift-multus/multus-pb5c7"
Oct 30 19:47:00.531156 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:00.529485    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/423e0100-284b-48b9-bd4c-3b74005976d2-host\") pod \"node-ca-2swph\" (UID: \"423e0100-284b-48b9-bd4c-3b74005976d2\") " pod="openshift-image-registry/node-ca-2swph"
Oct 30 19:47:00.531156 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:00.529563    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/423e0100-284b-48b9-bd4c-3b74005976d2-serviceca\") pod \"node-ca-2swph\" (UID: \"423e0100-284b-48b9-bd4c-3b74005976d2\") " pod="openshift-image-registry/node-ca-2swph"
Oct 30 19:47:00.531156 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:00.529626    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ac20c88a-e9bd-42c8-bcbe-2080f2393cc3-lib-modules\") pod \"tuned-k865s\" (UID: \"ac20c88a-e9bd-42c8-bcbe-2080f2393cc3\") " pod="openshift-cluster-node-tuning-operator/tuned-k865s"
Oct 30 19:47:00.531156 ip-10-0-131-26 kubenswrapper[2582]: E1030 19:47:00.529738    2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 19:47:00.531156 ip-10-0-131-26 kubenswrapper[2582]: E1030 19:47:00.529813    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0a8c4dcc-2f62-4efe-993e-2de411ce6654-metrics-certs podName:0a8c4dcc-2f62-4efe-993e-2de411ce6654 nodeName:}" failed. No retries permitted until 2026-10-30 19:47:01.029784666 +0000 UTC m=+3.086359493 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0a8c4dcc-2f62-4efe-993e-2de411ce6654-metrics-certs") pod "network-metrics-daemon-hkjcv" (UID: "0a8c4dcc-2f62-4efe-993e-2de411ce6654") : object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 19:47:00.531156 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:00.530010    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/98dd829b-0745-4229-b781-da2c4ad16f9e-host-kubelet\") pod \"ovnkube-node-84v4l\" (UID: \"98dd829b-0745-4229-b781-da2c4ad16f9e\") " pod="openshift-ovn-kubernetes/ovnkube-node-84v4l"
Oct 30 19:47:00.531156 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:00.530048    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/423e0100-284b-48b9-bd4c-3b74005976d2-serviceca\") pod \"node-ca-2swph\" (UID: \"423e0100-284b-48b9-bd4c-3b74005976d2\") " pod="openshift-image-registry/node-ca-2swph"
Oct 30 19:47:00.531156 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:00.530061    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/98dd829b-0745-4229-b781-da2c4ad16f9e-host-run-netns\") pod \"ovnkube-node-84v4l\" (UID: \"98dd829b-0745-4229-b781-da2c4ad16f9e\") " pod="openshift-ovn-kubernetes/ovnkube-node-84v4l"
Oct 30 19:47:00.531156 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:00.530157    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/98dd829b-0745-4229-b781-da2c4ad16f9e-ovnkube-script-lib\") pod \"ovnkube-node-84v4l\" (UID: \"98dd829b-0745-4229-b781-da2c4ad16f9e\") " pod="openshift-ovn-kubernetes/ovnkube-node-84v4l"
Oct 30 19:47:00.531156 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:00.530197    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ac20c88a-e9bd-42c8-bcbe-2080f2393cc3-run\") pod \"tuned-k865s\" (UID: \"ac20c88a-e9bd-42c8-bcbe-2080f2393cc3\") " pod="openshift-cluster-node-tuning-operator/tuned-k865s"
Oct 30 19:47:00.531156 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:00.530199    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/8d3e77a0-4ee8-4429-9795-97fb3d799dba-multus-socket-dir-parent\") pod \"multus-pb5c7\" (UID: \"8d3e77a0-4ee8-4429-9795-97fb3d799dba\") " pod="openshift-multus/multus-pb5c7"
Oct 30 19:47:00.531937 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:00.530238    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/98dd829b-0745-4229-b781-da2c4ad16f9e-host-cni-netd\") pod \"ovnkube-node-84v4l\" (UID: \"98dd829b-0745-4229-b781-da2c4ad16f9e\") " pod="openshift-ovn-kubernetes/ovnkube-node-84v4l"
Oct 30 19:47:00.531937 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:00.530255    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9898418c-eb0f-41b4-a844-d853caeab57f-system-cni-dir\") pod \"multus-additional-cni-plugins-q8w4d\" (UID: \"9898418c-eb0f-41b4-a844-d853caeab57f\") " pod="openshift-multus/multus-additional-cni-plugins-q8w4d"
Oct 30 19:47:00.531937 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:00.530312    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/2d3597bf-5138-4272-905b-d2fdd3bfbe7b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-clzkm\" (UID: \"2d3597bf-5138-4272-905b-d2fdd3bfbe7b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-clzkm"
Oct 30 19:47:00.531937 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:00.530360    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/98dd829b-0745-4229-b781-da2c4ad16f9e-run-ovn\") pod \"ovnkube-node-84v4l\" (UID: \"98dd829b-0745-4229-b781-da2c4ad16f9e\") " pod="openshift-ovn-kubernetes/ovnkube-node-84v4l"
Oct 30 19:47:00.531937 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:00.530427    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ac20c88a-e9bd-42c8-bcbe-2080f2393cc3-etc-systemd\") pod \"tuned-k865s\" (UID: \"ac20c88a-e9bd-42c8-bcbe-2080f2393cc3\") " pod="openshift-cluster-node-tuning-operator/tuned-k865s"
Oct 30 19:47:00.531937 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:00.530475    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ac20c88a-e9bd-42c8-bcbe-2080f2393cc3-var-lib-kubelet\") pod \"tuned-k865s\" (UID: \"ac20c88a-e9bd-42c8-bcbe-2080f2393cc3\") " pod="openshift-cluster-node-tuning-operator/tuned-k865s"
Oct 30 19:47:00.531937 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:00.530537    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ac20c88a-e9bd-42c8-bcbe-2080f2393cc3-sys\") pod \"tuned-k865s\" (UID: \"ac20c88a-e9bd-42c8-bcbe-2080f2393cc3\") " pod="openshift-cluster-node-tuning-operator/tuned-k865s"
Oct 30 19:47:00.531937 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:00.530538    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ac20c88a-e9bd-42c8-bcbe-2080f2393cc3-host\") pod \"tuned-k865s\" (UID: \"ac20c88a-e9bd-42c8-bcbe-2080f2393cc3\") " pod="openshift-cluster-node-tuning-operator/tuned-k865s"
Oct 30 19:47:00.531937 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:00.530572    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9898418c-eb0f-41b4-a844-d853caeab57f-cnibin\") pod \"multus-additional-cni-plugins-q8w4d\" (UID: \"9898418c-eb0f-41b4-a844-d853caeab57f\") " pod="openshift-multus/multus-additional-cni-plugins-q8w4d"
Oct 30 19:47:00.531937 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:00.530700    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/98dd829b-0745-4229-b781-da2c4ad16f9e-run-openvswitch\") pod \"ovnkube-node-84v4l\" (UID: \"98dd829b-0745-4229-b781-da2c4ad16f9e\") " pod="openshift-ovn-kubernetes/ovnkube-node-84v4l"
Oct 30 19:47:00.531937 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:00.530799    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/641c89ab-1e2c-4e67-84b5-d5d0f4f30756-iptables-alerter-script\") pod \"iptables-alerter-7gdcx\" (UID: \"641c89ab-1e2c-4e67-84b5-d5d0f4f30756\") " pod="openshift-network-operator/iptables-alerter-7gdcx"
Oct 30 19:47:00.531937 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:00.531648    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8d3e77a0-4ee8-4429-9795-97fb3d799dba-multus-cni-dir\") pod \"multus-pb5c7\" (UID: \"8d3e77a0-4ee8-4429-9795-97fb3d799dba\") " pod="openshift-multus/multus-pb5c7"
Oct 30 19:47:00.531937 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:00.531698    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8d3e77a0-4ee8-4429-9795-97fb3d799dba-system-cni-dir\") pod \"multus-pb5c7\" (UID: \"8d3e77a0-4ee8-4429-9795-97fb3d799dba\") " pod="openshift-multus/multus-pb5c7"
Oct 30 19:47:00.531937 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:00.531749    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/8d3e77a0-4ee8-4429-9795-97fb3d799dba-host-run-multus-certs\") pod \"multus-pb5c7\" (UID: \"8d3e77a0-4ee8-4429-9795-97fb3d799dba\") " pod="openshift-multus/multus-pb5c7"
Oct 30 19:47:00.531937 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:00.531800    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/2d3597bf-5138-4272-905b-d2fdd3bfbe7b-device-dir\") pod \"aws-ebs-csi-driver-node-clzkm\" (UID: \"2d3597bf-5138-4272-905b-d2fdd3bfbe7b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-clzkm"
Oct 30 19:47:00.531937 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:00.531837    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/98dd829b-0745-4229-b781-da2c4ad16f9e-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-84v4l\" (UID: \"98dd829b-0745-4229-b781-da2c4ad16f9e\") " pod="openshift-ovn-kubernetes/ovnkube-node-84v4l"
Oct 30 19:47:00.531937 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:00.531888    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/2d3597bf-5138-4272-905b-d2fdd3bfbe7b-registration-dir\") pod \"aws-ebs-csi-driver-node-clzkm\" (UID: \"2d3597bf-5138-4272-905b-d2fdd3bfbe7b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-clzkm"
Oct 30 19:47:00.532724 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:00.531962    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/2d3597bf-5138-4272-905b-d2fdd3bfbe7b-etc-selinux\") pod \"aws-ebs-csi-driver-node-clzkm\" (UID: \"2d3597bf-5138-4272-905b-d2fdd3bfbe7b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-clzkm"
Oct 30 19:47:00.532724 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:00.532176    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8d3e77a0-4ee8-4429-9795-97fb3d799dba-cnibin\") pod \"multus-pb5c7\" (UID: \"8d3e77a0-4ee8-4429-9795-97fb3d799dba\") " pod="openshift-multus/multus-pb5c7"
Oct 30 19:47:00.532724 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:00.532213    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/98dd829b-0745-4229-b781-da2c4ad16f9e-host-run-ovn-kubernetes\") pod \"ovnkube-node-84v4l\" (UID: \"98dd829b-0745-4229-b781-da2c4ad16f9e\") " pod="openshift-ovn-kubernetes/ovnkube-node-84v4l"
Oct 30 19:47:00.532724 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:00.532362    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/2d3597bf-5138-4272-905b-d2fdd3bfbe7b-sys-fs\") pod \"aws-ebs-csi-driver-node-clzkm\" (UID: \"2d3597bf-5138-4272-905b-d2fdd3bfbe7b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-clzkm"
Oct 30 19:47:00.532724 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:00.532403    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8d3e77a0-4ee8-4429-9795-97fb3d799dba-multus-conf-dir\") pod \"multus-pb5c7\" (UID: \"8d3e77a0-4ee8-4429-9795-97fb3d799dba\") " pod="openshift-multus/multus-pb5c7"
Oct 30 19:47:00.532724 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:00.532459    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/8d3e77a0-4ee8-4429-9795-97fb3d799dba-host-run-k8s-cni-cncf-io\") pod \"multus-pb5c7\" (UID: \"8d3e77a0-4ee8-4429-9795-97fb3d799dba\") " pod="openshift-multus/multus-pb5c7"
Oct 30 19:47:00.532724 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:00.532659    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/98dd829b-0745-4229-b781-da2c4ad16f9e-node-log\") pod \"ovnkube-node-84v4l\" (UID: \"98dd829b-0745-4229-b781-da2c4ad16f9e\") " pod="openshift-ovn-kubernetes/ovnkube-node-84v4l"
Oct 30 19:47:00.533061 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:00.532725    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8d3e77a0-4ee8-4429-9795-97fb3d799dba-host-run-netns\") pod \"multus-pb5c7\" (UID: \"8d3e77a0-4ee8-4429-9795-97fb3d799dba\") " pod="openshift-multus/multus-pb5c7"
Oct 30 19:47:00.533061 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:00.532800    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/98dd829b-0745-4229-b781-da2c4ad16f9e-var-lib-openvswitch\") pod \"ovnkube-node-84v4l\" (UID: \"98dd829b-0745-4229-b781-da2c4ad16f9e\") " pod="openshift-ovn-kubernetes/ovnkube-node-84v4l"
Oct 30 19:47:00.533061 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:00.532861    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/423e0100-284b-48b9-bd4c-3b74005976d2-host\") pod \"node-ca-2swph\" (UID: \"423e0100-284b-48b9-bd4c-3b74005976d2\") " pod="openshift-image-registry/node-ca-2swph"
Oct 30 19:47:00.533061 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:00.532901    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ac20c88a-e9bd-42c8-bcbe-2080f2393cc3-etc-sysconfig\") pod \"tuned-k865s\" (UID: \"ac20c88a-e9bd-42c8-bcbe-2080f2393cc3\") " pod="openshift-cluster-node-tuning-operator/tuned-k865s"
Oct 30 19:47:00.533061 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:00.532967    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/90b35edf-4b09-41df-9374-a514d1417071-dbus\") pod \"global-pull-secret-syncer-96mhd\" (UID: \"90b35edf-4b09-41df-9374-a514d1417071\") " pod="kube-system/global-pull-secret-syncer-96mhd"
Oct 30 19:47:00.533061 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:00.532994    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/98dd829b-0745-4229-b781-da2c4ad16f9e-systemd-units\") pod \"ovnkube-node-84v4l\" (UID: \"98dd829b-0745-4229-b781-da2c4ad16f9e\") " pod="openshift-ovn-kubernetes/ovnkube-node-84v4l"
Oct 30 19:47:00.533061 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:00.533035    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/90b35edf-4b09-41df-9374-a514d1417071-kubelet-config\") pod \"global-pull-secret-syncer-96mhd\" (UID: \"90b35edf-4b09-41df-9374-a514d1417071\") " pod="kube-system/global-pull-secret-syncer-96mhd"
Oct 30 19:47:00.533483 ip-10-0-131-26 kubenswrapper[2582]: E1030 19:47:00.533121    2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Oct 30 19:47:00.533483 ip-10-0-131-26 kubenswrapper[2582]: E1030 19:47:00.533209    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/90b35edf-4b09-41df-9374-a514d1417071-original-pull-secret podName:90b35edf-4b09-41df-9374-a514d1417071 nodeName:}" failed. No retries permitted until 2026-10-30 19:47:01.033192077 +0000 UTC m=+3.089766910 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/90b35edf-4b09-41df-9374-a514d1417071-original-pull-secret") pod "global-pull-secret-syncer-96mhd" (UID: "90b35edf-4b09-41df-9374-a514d1417071") : object "kube-system"/"original-pull-secret" not registered
Oct 30 19:47:00.533483 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:00.533454    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/98dd829b-0745-4229-b781-da2c4ad16f9e-host-cni-bin\") pod \"ovnkube-node-84v4l\" (UID: \"98dd829b-0745-4229-b781-da2c4ad16f9e\") " pod="openshift-ovn-kubernetes/ovnkube-node-84v4l"
Oct 30 19:47:00.533680 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:00.533488    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/98dd829b-0745-4229-b781-da2c4ad16f9e-host-slash\") pod \"ovnkube-node-84v4l\" (UID: \"98dd829b-0745-4229-b781-da2c4ad16f9e\") " pod="openshift-ovn-kubernetes/ovnkube-node-84v4l"
Oct 30 19:47:00.533884 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:00.533846    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/8d3e77a0-4ee8-4429-9795-97fb3d799dba-hostroot\") pod \"multus-pb5c7\" (UID: \"8d3e77a0-4ee8-4429-9795-97fb3d799dba\") " pod="openshift-multus/multus-pb5c7"
Oct 30 19:47:00.534061 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:00.534021    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/98dd829b-0745-4229-b781-da2c4ad16f9e-etc-openvswitch\") pod \"ovnkube-node-84v4l\" (UID: \"98dd829b-0745-4229-b781-da2c4ad16f9e\") " pod="openshift-ovn-kubernetes/ovnkube-node-84v4l"
Oct 30 19:47:00.534164 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:00.534058    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ac20c88a-e9bd-42c8-bcbe-2080f2393cc3-etc-tuned\") pod \"tuned-k865s\" (UID: \"ac20c88a-e9bd-42c8-bcbe-2080f2393cc3\") " pod="openshift-cluster-node-tuning-operator/tuned-k865s"
Oct 30 19:47:00.534375 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:00.534339    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/2be7f3a3-8714-491c-8e10-c594d425069a-konnectivity-ca\") pod \"konnectivity-agent-6lj57\" (UID: \"2be7f3a3-8714-491c-8e10-c594d425069a\") " pod="kube-system/konnectivity-agent-6lj57"
Oct 30 19:47:00.534515 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:00.534367    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/34dfa231-fa1a-400c-82b4-6ee85859d7c4-hosts-file\") pod \"node-resolver-krr87\" (UID: \"34dfa231-fa1a-400c-82b4-6ee85859d7c4\") " pod="openshift-dns/node-resolver-krr87"
Oct 30 19:47:00.534515 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:00.534385    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ac20c88a-e9bd-42c8-bcbe-2080f2393cc3-tmp\") pod \"tuned-k865s\" (UID: \"ac20c88a-e9bd-42c8-bcbe-2080f2393cc3\") " pod="openshift-cluster-node-tuning-operator/tuned-k865s"
Oct 30 19:47:00.534623 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:00.534516    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ac20c88a-e9bd-42c8-bcbe-2080f2393cc3-etc-modprobe-d\") pod \"tuned-k865s\" (UID: \"ac20c88a-e9bd-42c8-bcbe-2080f2393cc3\") " pod="openshift-cluster-node-tuning-operator/tuned-k865s"
Oct 30 19:47:00.534623 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:00.534579    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/98dd829b-0745-4229-b781-da2c4ad16f9e-log-socket\") pod \"ovnkube-node-84v4l\" (UID: \"98dd829b-0745-4229-b781-da2c4ad16f9e\") " pod="openshift-ovn-kubernetes/ovnkube-node-84v4l"
Oct 30 19:47:00.534793 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:00.534773    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ac20c88a-e9bd-42c8-bcbe-2080f2393cc3-etc-sysctl-conf\") pod \"tuned-k865s\" (UID: \"ac20c88a-e9bd-42c8-bcbe-2080f2393cc3\") " pod="openshift-cluster-node-tuning-operator/tuned-k865s"
Oct 30 19:47:00.535168 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:00.535148    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/9898418c-eb0f-41b4-a844-d853caeab57f-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-q8w4d\" (UID: \"9898418c-eb0f-41b4-a844-d853caeab57f\") " pod="openshift-multus/multus-additional-cni-plugins-q8w4d"
Oct 30 19:47:00.535295 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:00.535278    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/2d3597bf-5138-4272-905b-d2fdd3bfbe7b-socket-dir\") pod \"aws-ebs-csi-driver-node-clzkm\" (UID: \"2d3597bf-5138-4272-905b-d2fdd3bfbe7b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-clzkm"
Oct 30 19:47:00.535361 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:00.535325    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ac20c88a-e9bd-42c8-bcbe-2080f2393cc3-etc-kubernetes\") pod \"tuned-k865s\" (UID: \"ac20c88a-e9bd-42c8-bcbe-2080f2393cc3\") " pod="openshift-cluster-node-tuning-operator/tuned-k865s"
Oct 30 19:47:00.535420 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:00.535390    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ac20c88a-e9bd-42c8-bcbe-2080f2393cc3-etc-sysctl-d\") pod \"tuned-k865s\" (UID: \"ac20c88a-e9bd-42c8-bcbe-2080f2393cc3\") " pod="openshift-cluster-node-tuning-operator/tuned-k865s"
Oct 30 19:47:00.535489 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:00.535450    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/641c89ab-1e2c-4e67-84b5-d5d0f4f30756-host-slash\") pod \"iptables-alerter-7gdcx\" (UID: \"641c89ab-1e2c-4e67-84b5-d5d0f4f30756\") " pod="openshift-network-operator/iptables-alerter-7gdcx"
Oct 30 19:47:00.535549 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:00.535514    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8d3e77a0-4ee8-4429-9795-97fb3d799dba-etc-kubernetes\") pod \"multus-pb5c7\" (UID: \"8d3e77a0-4ee8-4429-9795-97fb3d799dba\") " pod="openshift-multus/multus-pb5c7"
Oct 30 19:47:00.535729 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:00.535691    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9898418c-eb0f-41b4-a844-d853caeab57f-cni-binary-copy\") pod \"multus-additional-cni-plugins-q8w4d\" (UID: \"9898418c-eb0f-41b4-a844-d853caeab57f\") " pod="openshift-multus/multus-additional-cni-plugins-q8w4d"
Oct 30 19:47:00.535947 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:00.535924    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9898418c-eb0f-41b4-a844-d853caeab57f-tuning-conf-dir\") pod \"multus-additional-cni-plugins-q8w4d\" (UID: \"9898418c-eb0f-41b4-a844-d853caeab57f\") " pod="openshift-multus/multus-additional-cni-plugins-q8w4d"
Oct 30 19:47:00.536218 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:00.536191    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/9898418c-eb0f-41b4-a844-d853caeab57f-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-q8w4d\" (UID: \"9898418c-eb0f-41b4-a844-d853caeab57f\") " pod="openshift-multus/multus-additional-cni-plugins-q8w4d"
Oct 30 19:47:00.536306 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:00.536278    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8d3e77a0-4ee8-4429-9795-97fb3d799dba-cni-binary-copy\") pod \"multus-pb5c7\" (UID: \"8d3e77a0-4ee8-4429-9795-97fb3d799dba\") " pod="openshift-multus/multus-pb5c7"
Oct 30 19:47:00.536447 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:00.536407    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/8d3e77a0-4ee8-4429-9795-97fb3d799dba-multus-daemon-config\") pod \"multus-pb5c7\" (UID: \"8d3e77a0-4ee8-4429-9795-97fb3d799dba\") " pod="openshift-multus/multus-pb5c7"
Oct 30 19:47:00.536447 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:00.536417    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/98dd829b-0745-4229-b781-da2c4ad16f9e-env-overrides\") pod \"ovnkube-node-84v4l\" (UID: \"98dd829b-0745-4229-b781-da2c4ad16f9e\") " pod="openshift-ovn-kubernetes/ovnkube-node-84v4l"
Oct 30 19:47:00.536754 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:00.536733    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/2be7f3a3-8714-491c-8e10-c594d425069a-agent-certs\") pod \"konnectivity-agent-6lj57\" (UID: \"2be7f3a3-8714-491c-8e10-c594d425069a\") " pod="kube-system/konnectivity-agent-6lj57"
Oct 30 19:47:00.538161 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:00.538108    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/98dd829b-0745-4229-b781-da2c4ad16f9e-ovn-node-metrics-cert\") pod \"ovnkube-node-84v4l\" (UID: \"98dd829b-0745-4229-b781-da2c4ad16f9e\") " pod="openshift-ovn-kubernetes/ovnkube-node-84v4l"
Oct 30 19:47:00.553341 ip-10-0-131-26 kubenswrapper[2582]: E1030 19:47:00.553290    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Oct 30 19:47:00.553341 ip-10-0-131-26 kubenswrapper[2582]: E1030 19:47:00.553315    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Oct 30 19:47:00.553341 ip-10-0-131-26 kubenswrapper[2582]: E1030 19:47:00.553336    2582 projected.go:196] Error preparing data for projected volume kube-api-access-tmmdv for pod openshift-network-diagnostics/network-check-target-b27jd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 19:47:00.553564 ip-10-0-131-26 kubenswrapper[2582]: E1030 19:47:00.553426    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/aa51899f-52a0-434e-b434-4bc030c94136-kube-api-access-tmmdv podName:aa51899f-52a0-434e-b434-4bc030c94136 nodeName:}" failed. No retries permitted until 2026-10-30 19:47:01.053411024 +0000 UTC m=+3.109985853 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-tmmdv" (UniqueName: "kubernetes.io/projected/aa51899f-52a0-434e-b434-4bc030c94136-kube-api-access-tmmdv") pod "network-check-target-b27jd" (UID: "aa51899f-52a0-434e-b434-4bc030c94136") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 19:47:00.554304 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:00.554284    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7drkj\" (UniqueName: \"kubernetes.io/projected/8d3e77a0-4ee8-4429-9795-97fb3d799dba-kube-api-access-7drkj\") pod \"multus-pb5c7\" (UID: \"8d3e77a0-4ee8-4429-9795-97fb3d799dba\") " pod="openshift-multus/multus-pb5c7"
Oct 30 19:47:00.560242 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:00.560213    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2gglq\" (UniqueName: \"kubernetes.io/projected/9898418c-eb0f-41b4-a844-d853caeab57f-kube-api-access-2gglq\") pod \"multus-additional-cni-plugins-q8w4d\" (UID: \"9898418c-eb0f-41b4-a844-d853caeab57f\") " pod="openshift-multus/multus-additional-cni-plugins-q8w4d"
Oct 30 19:47:00.560908 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:00.560886    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-njzf8\" (UniqueName: \"kubernetes.io/projected/423e0100-284b-48b9-bd4c-3b74005976d2-kube-api-access-njzf8\") pod \"node-ca-2swph\" (UID: \"423e0100-284b-48b9-bd4c-3b74005976d2\") " pod="openshift-image-registry/node-ca-2swph"
Oct 30 19:47:00.560992 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:00.560946    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r4zjc\" (UniqueName: \"kubernetes.io/projected/ac20c88a-e9bd-42c8-bcbe-2080f2393cc3-kube-api-access-r4zjc\") pod \"tuned-k865s\" (UID: \"ac20c88a-e9bd-42c8-bcbe-2080f2393cc3\") " pod="openshift-cluster-node-tuning-operator/tuned-k865s"
Oct 30 19:47:00.561506 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:00.561475    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l9vw6\" (UniqueName: \"kubernetes.io/projected/0a8c4dcc-2f62-4efe-993e-2de411ce6654-kube-api-access-l9vw6\") pod \"network-metrics-daemon-hkjcv\" (UID: \"0a8c4dcc-2f62-4efe-993e-2de411ce6654\") " pod="openshift-multus/network-metrics-daemon-hkjcv"
Oct 30 19:47:00.561596 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:00.561568    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v75vv\" (UniqueName: \"kubernetes.io/projected/2d3597bf-5138-4272-905b-d2fdd3bfbe7b-kube-api-access-v75vv\") pod \"aws-ebs-csi-driver-node-clzkm\" (UID: \"2d3597bf-5138-4272-905b-d2fdd3bfbe7b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-clzkm"
Oct 30 19:47:00.562316 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:00.562290    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hk8r5\" (UniqueName: \"kubernetes.io/projected/641c89ab-1e2c-4e67-84b5-d5d0f4f30756-kube-api-access-hk8r5\") pod \"iptables-alerter-7gdcx\" (UID: \"641c89ab-1e2c-4e67-84b5-d5d0f4f30756\") " pod="openshift-network-operator/iptables-alerter-7gdcx"
Oct 30 19:47:00.563270 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:00.563249    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mwhbg\" (UniqueName: \"kubernetes.io/projected/34dfa231-fa1a-400c-82b4-6ee85859d7c4-kube-api-access-mwhbg\") pod \"node-resolver-krr87\" (UID: \"34dfa231-fa1a-400c-82b4-6ee85859d7c4\") " pod="openshift-dns/node-resolver-krr87"
Oct 30 19:47:00.563891 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:00.563867    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bz9kn\" (UniqueName: \"kubernetes.io/projected/98dd829b-0745-4229-b781-da2c4ad16f9e-kube-api-access-bz9kn\") pod \"ovnkube-node-84v4l\" (UID: \"98dd829b-0745-4229-b781-da2c4ad16f9e\") " pod="openshift-ovn-kubernetes/ovnkube-node-84v4l"
Oct 30 19:47:00.640604 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:00.640577    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-krr87"
Oct 30 19:47:00.652520 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:47:00.652448    2582 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod34dfa231_fa1a_400c_82b4_6ee85859d7c4.slice/crio-713a63aaf2ee585ab3db9d19c47f6cd31a16bc85735d223ed3868d3e060ffa05 WatchSource:0}: Error finding container 713a63aaf2ee585ab3db9d19c47f6cd31a16bc85735d223ed3868d3e060ffa05: Status 404 returned error can't find the container with id 713a63aaf2ee585ab3db9d19c47f6cd31a16bc85735d223ed3868d3e060ffa05
Oct 30 19:47:00.662771 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:00.662749    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-7gdcx"
Oct 30 19:47:00.669262 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:00.669103    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-84v4l"
Oct 30 19:47:00.670179 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:00.670157    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-6lj57"
Oct 30 19:47:00.674233 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:00.674015    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-k865s"
Oct 30 19:47:00.675210 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:47:00.674653    2582 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod641c89ab_1e2c_4e67_84b5_d5d0f4f30756.slice/crio-7150493b132eee1de4f50e8c442864c7ecc649e2ff6b205c2f287c08945e632a WatchSource:0}: Error finding container 7150493b132eee1de4f50e8c442864c7ecc649e2ff6b205c2f287c08945e632a: Status 404 returned error can't find the container with id 7150493b132eee1de4f50e8c442864c7ecc649e2ff6b205c2f287c08945e632a
Oct 30 19:47:00.683759 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:47:00.683728    2582 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod98dd829b_0745_4229_b781_da2c4ad16f9e.slice/crio-08e9fcba79fcf7911525e4a7031678ea05684ef0cf9bc90dcba9f2553b6ee26d WatchSource:0}: Error finding container 08e9fcba79fcf7911525e4a7031678ea05684ef0cf9bc90dcba9f2553b6ee26d: Status 404 returned error can't find the container with id 08e9fcba79fcf7911525e4a7031678ea05684ef0cf9bc90dcba9f2553b6ee26d
Oct 30 19:47:00.685058 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:00.684892    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-pb5c7"
Oct 30 19:47:00.688017 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:47:00.687991    2582 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podac20c88a_e9bd_42c8_bcbe_2080f2393cc3.slice/crio-ed64366e69767151ab57fc8a9c52b74de065e333947504c69f56fcce8b51a42d WatchSource:0}: Error finding container ed64366e69767151ab57fc8a9c52b74de065e333947504c69f56fcce8b51a42d: Status 404 returned error can't find the container with id ed64366e69767151ab57fc8a9c52b74de065e333947504c69f56fcce8b51a42d
Oct 30 19:47:00.689888 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:47:00.689852    2582 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2be7f3a3_8714_491c_8e10_c594d425069a.slice/crio-6bfca021e25a7be7c0f5098b275d73b34ddbaa220eeb80baa16b70143e6fc01f WatchSource:0}: Error finding container 6bfca021e25a7be7c0f5098b275d73b34ddbaa220eeb80baa16b70143e6fc01f: Status 404 returned error can't find the container with id 6bfca021e25a7be7c0f5098b275d73b34ddbaa220eeb80baa16b70143e6fc01f
Oct 30 19:47:00.697118 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:47:00.697093    2582 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8d3e77a0_4ee8_4429_9795_97fb3d799dba.slice/crio-d1934139957babd59f55f6864275e7623cdebdefc4b4936a58a082f485428377 WatchSource:0}: Error finding container d1934139957babd59f55f6864275e7623cdebdefc4b4936a58a082f485428377: Status 404 returned error can't find the container with id d1934139957babd59f55f6864275e7623cdebdefc4b4936a58a082f485428377
Oct 30 19:47:00.707004 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:00.706982    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-q8w4d"
Oct 30 19:47:00.712211 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:00.712051    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-clzkm"
Oct 30 19:47:00.714253 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:00.714235    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-2swph"
Oct 30 19:47:00.720512 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:47:00.719571    2582 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9898418c_eb0f_41b4_a844_d853caeab57f.slice/crio-afde50971c21129bb07c0fdf20b1a8d49f2c07ca234f26330f66784acd6f135f WatchSource:0}: Error finding container afde50971c21129bb07c0fdf20b1a8d49f2c07ca234f26330f66784acd6f135f: Status 404 returned error can't find the container with id afde50971c21129bb07c0fdf20b1a8d49f2c07ca234f26330f66784acd6f135f
Oct 30 19:47:00.724185 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:47:00.724161    2582 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2d3597bf_5138_4272_905b_d2fdd3bfbe7b.slice/crio-14008bf705641ffb3281fb0bcdc659e9c04920b28abc74ab2d20a32fd522fd1b WatchSource:0}: Error finding container 14008bf705641ffb3281fb0bcdc659e9c04920b28abc74ab2d20a32fd522fd1b: Status 404 returned error can't find the container with id 14008bf705641ffb3281fb0bcdc659e9c04920b28abc74ab2d20a32fd522fd1b
Oct 30 19:47:00.726928 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:47:00.726903    2582 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod423e0100_284b_48b9_bd4c_3b74005976d2.slice/crio-4ebb78fce880638671623bacc3e166cfcd3a4f559203aa81b67ecc6e487a6d17 WatchSource:0}: Error finding container 4ebb78fce880638671623bacc3e166cfcd3a4f559203aa81b67ecc6e487a6d17: Status 404 returned error can't find the container with id 4ebb78fce880638671623bacc3e166cfcd3a4f559203aa81b67ecc6e487a6d17
Oct 30 19:47:01.033998 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:01.033968    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0a8c4dcc-2f62-4efe-993e-2de411ce6654-metrics-certs\") pod \"network-metrics-daemon-hkjcv\" (UID: \"0a8c4dcc-2f62-4efe-993e-2de411ce6654\") " pod="openshift-multus/network-metrics-daemon-hkjcv"
Oct 30 19:47:01.034178 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:01.034007    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/90b35edf-4b09-41df-9374-a514d1417071-original-pull-secret\") pod \"global-pull-secret-syncer-96mhd\" (UID: \"90b35edf-4b09-41df-9374-a514d1417071\") " pod="kube-system/global-pull-secret-syncer-96mhd"
Oct 30 19:47:01.034178 ip-10-0-131-26 kubenswrapper[2582]: E1030 19:47:01.034129    2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 19:47:01.034295 ip-10-0-131-26 kubenswrapper[2582]: E1030 19:47:01.034196    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0a8c4dcc-2f62-4efe-993e-2de411ce6654-metrics-certs podName:0a8c4dcc-2f62-4efe-993e-2de411ce6654 nodeName:}" failed. No retries permitted until 2026-10-30 19:47:02.034182275 +0000 UTC m=+4.090757087 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0a8c4dcc-2f62-4efe-993e-2de411ce6654-metrics-certs") pod "network-metrics-daemon-hkjcv" (UID: "0a8c4dcc-2f62-4efe-993e-2de411ce6654") : object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 19:47:01.034295 ip-10-0-131-26 kubenswrapper[2582]: E1030 19:47:01.034134    2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Oct 30 19:47:01.034295 ip-10-0-131-26 kubenswrapper[2582]: E1030 19:47:01.034289    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/90b35edf-4b09-41df-9374-a514d1417071-original-pull-secret podName:90b35edf-4b09-41df-9374-a514d1417071 nodeName:}" failed. No retries permitted until 2026-10-30 19:47:02.034271665 +0000 UTC m=+4.090846478 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/90b35edf-4b09-41df-9374-a514d1417071-original-pull-secret") pod "global-pull-secret-syncer-96mhd" (UID: "90b35edf-4b09-41df-9374-a514d1417071") : object "kube-system"/"original-pull-secret" not registered
Oct 30 19:47:01.135486 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:01.135436    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tmmdv\" (UniqueName: \"kubernetes.io/projected/aa51899f-52a0-434e-b434-4bc030c94136-kube-api-access-tmmdv\") pod \"network-check-target-b27jd\" (UID: \"aa51899f-52a0-434e-b434-4bc030c94136\") " pod="openshift-network-diagnostics/network-check-target-b27jd"
Oct 30 19:47:01.135658 ip-10-0-131-26 kubenswrapper[2582]: E1030 19:47:01.135619    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Oct 30 19:47:01.135658 ip-10-0-131-26 kubenswrapper[2582]: E1030 19:47:01.135643    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Oct 30 19:47:01.135658 ip-10-0-131-26 kubenswrapper[2582]: E1030 19:47:01.135653    2582 projected.go:196] Error preparing data for projected volume kube-api-access-tmmdv for pod openshift-network-diagnostics/network-check-target-b27jd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 19:47:01.135856 ip-10-0-131-26 kubenswrapper[2582]: E1030 19:47:01.135713    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/aa51899f-52a0-434e-b434-4bc030c94136-kube-api-access-tmmdv podName:aa51899f-52a0-434e-b434-4bc030c94136 nodeName:}" failed. No retries permitted until 2026-10-30 19:47:02.135699275 +0000 UTC m=+4.192274091 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-tmmdv" (UniqueName: "kubernetes.io/projected/aa51899f-52a0-434e-b434-4bc030c94136-kube-api-access-tmmdv") pod "network-check-target-b27jd" (UID: "aa51899f-52a0-434e-b434-4bc030c94136") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 19:47:01.382065 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:01.381748    2582 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-10-29 19:42:00 +0000 UTC" deadline="2028-07-05 01:38:52.916946875 +0000 UTC"
Oct 30 19:47:01.382065 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:01.382003    2582 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14717h51m51.534949158s"
Oct 30 19:47:01.567498 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:01.566898    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b27jd"
Oct 30 19:47:01.567498 ip-10-0-131-26 kubenswrapper[2582]: E1030 19:47:01.567025    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b27jd" podUID="aa51899f-52a0-434e-b434-4bc030c94136"
Oct 30 19:47:01.586764 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:01.586729    2582 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-clzkm" event={"ID":"2d3597bf-5138-4272-905b-d2fdd3bfbe7b","Type":"ContainerStarted","Data":"14008bf705641ffb3281fb0bcdc659e9c04920b28abc74ab2d20a32fd522fd1b"}
Oct 30 19:47:01.588835 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:01.588810    2582 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-6lj57" event={"ID":"2be7f3a3-8714-491c-8e10-c594d425069a","Type":"ContainerStarted","Data":"6bfca021e25a7be7c0f5098b275d73b34ddbaa220eeb80baa16b70143e6fc01f"}
Oct 30 19:47:01.599192 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:01.599132    2582 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-2swph" event={"ID":"423e0100-284b-48b9-bd4c-3b74005976d2","Type":"ContainerStarted","Data":"4ebb78fce880638671623bacc3e166cfcd3a4f559203aa81b67ecc6e487a6d17"}
Oct 30 19:47:01.602603 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:01.601965    2582 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-q8w4d" event={"ID":"9898418c-eb0f-41b4-a844-d853caeab57f","Type":"ContainerStarted","Data":"afde50971c21129bb07c0fdf20b1a8d49f2c07ca234f26330f66784acd6f135f"}
Oct 30 19:47:01.605753 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:01.605674    2582 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-pb5c7" event={"ID":"8d3e77a0-4ee8-4429-9795-97fb3d799dba","Type":"ContainerStarted","Data":"d1934139957babd59f55f6864275e7623cdebdefc4b4936a58a082f485428377"}
Oct 30 19:47:01.611240 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:01.611195    2582 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-k865s" event={"ID":"ac20c88a-e9bd-42c8-bcbe-2080f2393cc3","Type":"ContainerStarted","Data":"ed64366e69767151ab57fc8a9c52b74de065e333947504c69f56fcce8b51a42d"}
Oct 30 19:47:01.625636 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:01.625542    2582 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-84v4l" event={"ID":"98dd829b-0745-4229-b781-da2c4ad16f9e","Type":"ContainerStarted","Data":"08e9fcba79fcf7911525e4a7031678ea05684ef0cf9bc90dcba9f2553b6ee26d"}
Oct 30 19:47:01.628401 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:01.628330    2582 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-7gdcx" event={"ID":"641c89ab-1e2c-4e67-84b5-d5d0f4f30756","Type":"ContainerStarted","Data":"7150493b132eee1de4f50e8c442864c7ecc649e2ff6b205c2f287c08945e632a"}
Oct 30 19:47:01.634835 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:01.634771    2582 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-krr87" event={"ID":"34dfa231-fa1a-400c-82b4-6ee85859d7c4","Type":"ContainerStarted","Data":"713a63aaf2ee585ab3db9d19c47f6cd31a16bc85735d223ed3868d3e060ffa05"}
Oct 30 19:47:01.645618 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:01.644906    2582 generic.go:356] "Generic (PLEG): container finished" podID="a33761d7d0af7c6b314b351b86948829" containerID="85c7d8b471246c4f2fa79b58549083016aac5882b41dd3266174668a6bc24640" exitCode=0
Oct 30 19:47:01.645618 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:01.644944    2582 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-26.ec2.internal" event={"ID":"a33761d7d0af7c6b314b351b86948829","Type":"ContainerDied","Data":"85c7d8b471246c4f2fa79b58549083016aac5882b41dd3266174668a6bc24640"}
Oct 30 19:47:02.041881 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:02.041846    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0a8c4dcc-2f62-4efe-993e-2de411ce6654-metrics-certs\") pod \"network-metrics-daemon-hkjcv\" (UID: \"0a8c4dcc-2f62-4efe-993e-2de411ce6654\") " pod="openshift-multus/network-metrics-daemon-hkjcv"
Oct 30 19:47:02.042033 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:02.041898    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/90b35edf-4b09-41df-9374-a514d1417071-original-pull-secret\") pod \"global-pull-secret-syncer-96mhd\" (UID: \"90b35edf-4b09-41df-9374-a514d1417071\") " pod="kube-system/global-pull-secret-syncer-96mhd"
Oct 30 19:47:02.042076 ip-10-0-131-26 kubenswrapper[2582]: E1030 19:47:02.042036    2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Oct 30 19:47:02.042113 ip-10-0-131-26 kubenswrapper[2582]: E1030 19:47:02.042101    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/90b35edf-4b09-41df-9374-a514d1417071-original-pull-secret podName:90b35edf-4b09-41df-9374-a514d1417071 nodeName:}" failed. No retries permitted until 2026-10-30 19:47:04.04208099 +0000 UTC m=+6.098655819 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/90b35edf-4b09-41df-9374-a514d1417071-original-pull-secret") pod "global-pull-secret-syncer-96mhd" (UID: "90b35edf-4b09-41df-9374-a514d1417071") : object "kube-system"/"original-pull-secret" not registered
Oct 30 19:47:02.042405 ip-10-0-131-26 kubenswrapper[2582]: E1030 19:47:02.042386    2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 19:47:02.042464 ip-10-0-131-26 kubenswrapper[2582]: E1030 19:47:02.042451    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0a8c4dcc-2f62-4efe-993e-2de411ce6654-metrics-certs podName:0a8c4dcc-2f62-4efe-993e-2de411ce6654 nodeName:}" failed. No retries permitted until 2026-10-30 19:47:04.042434602 +0000 UTC m=+6.099009420 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0a8c4dcc-2f62-4efe-993e-2de411ce6654-metrics-certs") pod "network-metrics-daemon-hkjcv" (UID: "0a8c4dcc-2f62-4efe-993e-2de411ce6654") : object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 19:47:02.143464 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:02.142817    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tmmdv\" (UniqueName: \"kubernetes.io/projected/aa51899f-52a0-434e-b434-4bc030c94136-kube-api-access-tmmdv\") pod \"network-check-target-b27jd\" (UID: \"aa51899f-52a0-434e-b434-4bc030c94136\") " pod="openshift-network-diagnostics/network-check-target-b27jd"
Oct 30 19:47:02.143464 ip-10-0-131-26 kubenswrapper[2582]: E1030 19:47:02.143023    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Oct 30 19:47:02.143464 ip-10-0-131-26 kubenswrapper[2582]: E1030 19:47:02.143045    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Oct 30 19:47:02.143464 ip-10-0-131-26 kubenswrapper[2582]: E1030 19:47:02.143059    2582 projected.go:196] Error preparing data for projected volume kube-api-access-tmmdv for pod openshift-network-diagnostics/network-check-target-b27jd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 19:47:02.143464 ip-10-0-131-26 kubenswrapper[2582]: E1030 19:47:02.143111    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/aa51899f-52a0-434e-b434-4bc030c94136-kube-api-access-tmmdv podName:aa51899f-52a0-434e-b434-4bc030c94136 nodeName:}" failed. No retries permitted until 2026-10-30 19:47:04.143094105 +0000 UTC m=+6.199668921 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-tmmdv" (UniqueName: "kubernetes.io/projected/aa51899f-52a0-434e-b434-4bc030c94136-kube-api-access-tmmdv") pod "network-check-target-b27jd" (UID: "aa51899f-52a0-434e-b434-4bc030c94136") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 19:47:02.291262 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:02.291233    2582 reflector.go:446] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 30 19:47:02.382898 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:02.382789    2582 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-10-29 19:42:00 +0000 UTC" deadline="2028-07-07 11:56:56.085608926 +0000 UTC"
Oct 30 19:47:02.382898 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:02.382852    2582 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14776h9m53.702761095s"
Oct 30 19:47:02.572337 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:02.571636    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-96mhd"
Oct 30 19:47:02.572337 ip-10-0-131-26 kubenswrapper[2582]: E1030 19:47:02.571779    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-96mhd" podUID="90b35edf-4b09-41df-9374-a514d1417071"
Oct 30 19:47:02.572991 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:02.572742    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hkjcv"
Oct 30 19:47:02.572991 ip-10-0-131-26 kubenswrapper[2582]: E1030 19:47:02.572871    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hkjcv" podUID="0a8c4dcc-2f62-4efe-993e-2de411ce6654"
Oct 30 19:47:02.684255 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:02.684216    2582 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-26.ec2.internal" event={"ID":"3a7534b7f1df1f6e6fe99f614d7ed61c","Type":"ContainerStarted","Data":"20eeafbcdcc1972d90f2285d223f6f590fc31f3aecb9dd3a816c33f3480790d4"}
Oct 30 19:47:02.708919 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:02.708847    2582 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-26.ec2.internal" event={"ID":"a33761d7d0af7c6b314b351b86948829","Type":"ContainerStarted","Data":"1c9a18ecfbf97301950284ad84307c47b993e6bd60d5164515ed702e0120a520"}
Oct 30 19:47:02.727999 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:02.727935    2582 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-26.ec2.internal" podStartSLOduration=2.727917866 podStartE2EDuration="2.727917866s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 19:47:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 19:47:02.727580332 +0000 UTC m=+4.784155169" watchObservedRunningTime="2026-10-30 19:47:02.727917866 +0000 UTC m=+4.784492705"
Oct 30 19:47:03.565996 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:03.565971    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b27jd"
Oct 30 19:47:03.566387 ip-10-0-131-26 kubenswrapper[2582]: E1030 19:47:03.566102    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b27jd" podUID="aa51899f-52a0-434e-b434-4bc030c94136"
Oct 30 19:47:04.057484 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:04.057388    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0a8c4dcc-2f62-4efe-993e-2de411ce6654-metrics-certs\") pod \"network-metrics-daemon-hkjcv\" (UID: \"0a8c4dcc-2f62-4efe-993e-2de411ce6654\") " pod="openshift-multus/network-metrics-daemon-hkjcv"
Oct 30 19:47:04.057484 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:04.057458    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/90b35edf-4b09-41df-9374-a514d1417071-original-pull-secret\") pod \"global-pull-secret-syncer-96mhd\" (UID: \"90b35edf-4b09-41df-9374-a514d1417071\") " pod="kube-system/global-pull-secret-syncer-96mhd"
Oct 30 19:47:04.057716 ip-10-0-131-26 kubenswrapper[2582]: E1030 19:47:04.057605    2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Oct 30 19:47:04.057716 ip-10-0-131-26 kubenswrapper[2582]: E1030 19:47:04.057675    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/90b35edf-4b09-41df-9374-a514d1417071-original-pull-secret podName:90b35edf-4b09-41df-9374-a514d1417071 nodeName:}" failed. No retries permitted until 2026-10-30 19:47:08.057655835 +0000 UTC m=+10.114230674 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/90b35edf-4b09-41df-9374-a514d1417071-original-pull-secret") pod "global-pull-secret-syncer-96mhd" (UID: "90b35edf-4b09-41df-9374-a514d1417071") : object "kube-system"/"original-pull-secret" not registered
Oct 30 19:47:04.057842 ip-10-0-131-26 kubenswrapper[2582]: E1030 19:47:04.057763    2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 19:47:04.057842 ip-10-0-131-26 kubenswrapper[2582]: E1030 19:47:04.057797    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0a8c4dcc-2f62-4efe-993e-2de411ce6654-metrics-certs podName:0a8c4dcc-2f62-4efe-993e-2de411ce6654 nodeName:}" failed. No retries permitted until 2026-10-30 19:47:08.057784691 +0000 UTC m=+10.114359509 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0a8c4dcc-2f62-4efe-993e-2de411ce6654-metrics-certs") pod "network-metrics-daemon-hkjcv" (UID: "0a8c4dcc-2f62-4efe-993e-2de411ce6654") : object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 19:47:04.158709 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:04.157985    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tmmdv\" (UniqueName: \"kubernetes.io/projected/aa51899f-52a0-434e-b434-4bc030c94136-kube-api-access-tmmdv\") pod \"network-check-target-b27jd\" (UID: \"aa51899f-52a0-434e-b434-4bc030c94136\") " pod="openshift-network-diagnostics/network-check-target-b27jd"
Oct 30 19:47:04.158709 ip-10-0-131-26 kubenswrapper[2582]: E1030 19:47:04.158231    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Oct 30 19:47:04.158709 ip-10-0-131-26 kubenswrapper[2582]: E1030 19:47:04.158257    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Oct 30 19:47:04.158709 ip-10-0-131-26 kubenswrapper[2582]: E1030 19:47:04.158270    2582 projected.go:196] Error preparing data for projected volume kube-api-access-tmmdv for pod openshift-network-diagnostics/network-check-target-b27jd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 19:47:04.158709 ip-10-0-131-26 kubenswrapper[2582]: E1030 19:47:04.158331    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/aa51899f-52a0-434e-b434-4bc030c94136-kube-api-access-tmmdv podName:aa51899f-52a0-434e-b434-4bc030c94136 nodeName:}" failed. No retries permitted until 2026-10-30 19:47:08.158312497 +0000 UTC m=+10.214887330 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-tmmdv" (UniqueName: "kubernetes.io/projected/aa51899f-52a0-434e-b434-4bc030c94136-kube-api-access-tmmdv") pod "network-check-target-b27jd" (UID: "aa51899f-52a0-434e-b434-4bc030c94136") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 19:47:04.566302 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:04.566271    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hkjcv"
Oct 30 19:47:04.566840 ip-10-0-131-26 kubenswrapper[2582]: E1030 19:47:04.566385    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hkjcv" podUID="0a8c4dcc-2f62-4efe-993e-2de411ce6654"
Oct 30 19:47:04.566840 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:04.566729    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-96mhd"
Oct 30 19:47:04.566840 ip-10-0-131-26 kubenswrapper[2582]: E1030 19:47:04.566829    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-96mhd" podUID="90b35edf-4b09-41df-9374-a514d1417071"
Oct 30 19:47:04.729163 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:04.729075    2582 generic.go:356] "Generic (PLEG): container finished" podID="9898418c-eb0f-41b4-a844-d853caeab57f" containerID="c14dc1dca99073887587185be21bedbb4588ca852b74eb8709b8c2a53ad010e7" exitCode=0
Oct 30 19:47:04.729317 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:04.729183    2582 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-q8w4d" event={"ID":"9898418c-eb0f-41b4-a844-d853caeab57f","Type":"ContainerDied","Data":"c14dc1dca99073887587185be21bedbb4588ca852b74eb8709b8c2a53ad010e7"}
Oct 30 19:47:04.736505 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:04.735955    2582 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-6lj57" event={"ID":"2be7f3a3-8714-491c-8e10-c594d425069a","Type":"ContainerStarted","Data":"bad6eabc50f850cce690e0f5dc35c79e44aa56a7dd9586ef7352918d1595a399"}
Oct 30 19:47:04.807200 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:04.807135    2582 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-26.ec2.internal" podStartSLOduration=4.80710991 podStartE2EDuration="4.80710991s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 19:47:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 19:47:02.777521115 +0000 UTC m=+4.834095952" watchObservedRunningTime="2026-10-30 19:47:04.80710991 +0000 UTC m=+6.863684747"
Oct 30 19:47:05.116772 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:05.116699    2582 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-6lj57"
Oct 30 19:47:05.117326 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:05.117306    2582 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-6lj57"
Oct 30 19:47:05.163400 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:05.163334    2582 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/konnectivity-agent-6lj57" podStartSLOduration=2.392578901 podStartE2EDuration="6.16331573s" totalImagesPullingTime="3.770736829s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 19:46:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 19:47:04.838057798 +0000 UTC m=+6.894632626" watchObservedRunningTime="2026-10-30 19:47:05.16331573 +0000 UTC m=+7.219890567"
Oct 30 19:47:05.567259 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:05.566699    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b27jd"
Oct 30 19:47:05.567259 ip-10-0-131-26 kubenswrapper[2582]: E1030 19:47:05.566832    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b27jd" podUID="aa51899f-52a0-434e-b434-4bc030c94136"
Oct 30 19:47:06.573244 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:06.573215    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-96mhd"
Oct 30 19:47:06.573667 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:06.573270    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hkjcv"
Oct 30 19:47:06.573667 ip-10-0-131-26 kubenswrapper[2582]: E1030 19:47:06.573391    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hkjcv" podUID="0a8c4dcc-2f62-4efe-993e-2de411ce6654"
Oct 30 19:47:06.573667 ip-10-0-131-26 kubenswrapper[2582]: E1030 19:47:06.573510    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-96mhd" podUID="90b35edf-4b09-41df-9374-a514d1417071"
Oct 30 19:47:06.743934 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:06.743894    2582 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-clzkm" event={"ID":"2d3597bf-5138-4272-905b-d2fdd3bfbe7b","Type":"ContainerStarted","Data":"13e8d5662fee5d0d585f4c19df1923421dfa5b4fdf334dab63f8d130d7a0d9e7"}
Oct 30 19:47:06.748039 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:06.746878    2582 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness"
Oct 30 19:47:06.748039 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:06.747933    2582 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-2swph" event={"ID":"423e0100-284b-48b9-bd4c-3b74005976d2","Type":"ContainerStarted","Data":"ee743a42ab5ba763210e07b8e435613ec1cba8eedd9eb7b4789ba775a55a7bbb"}
Oct 30 19:47:07.566493 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:07.565967    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b27jd"
Oct 30 19:47:07.566493 ip-10-0-131-26 kubenswrapper[2582]: E1030 19:47:07.566104    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b27jd" podUID="aa51899f-52a0-434e-b434-4bc030c94136"
Oct 30 19:47:08.055311 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:08.055280    2582 plugin_watcher.go:201] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Oct 30 19:47:08.090053 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:08.090030    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0a8c4dcc-2f62-4efe-993e-2de411ce6654-metrics-certs\") pod \"network-metrics-daemon-hkjcv\" (UID: \"0a8c4dcc-2f62-4efe-993e-2de411ce6654\") " pod="openshift-multus/network-metrics-daemon-hkjcv"
Oct 30 19:47:08.090171 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:08.090060    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/90b35edf-4b09-41df-9374-a514d1417071-original-pull-secret\") pod \"global-pull-secret-syncer-96mhd\" (UID: \"90b35edf-4b09-41df-9374-a514d1417071\") " pod="kube-system/global-pull-secret-syncer-96mhd"
Oct 30 19:47:08.090171 ip-10-0-131-26 kubenswrapper[2582]: E1030 19:47:08.090147    2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Oct 30 19:47:08.090270 ip-10-0-131-26 kubenswrapper[2582]: E1030 19:47:08.090184    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/90b35edf-4b09-41df-9374-a514d1417071-original-pull-secret podName:90b35edf-4b09-41df-9374-a514d1417071 nodeName:}" failed. No retries permitted until 2026-10-30 19:47:16.09017252 +0000 UTC m=+18.146747334 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/90b35edf-4b09-41df-9374-a514d1417071-original-pull-secret") pod "global-pull-secret-syncer-96mhd" (UID: "90b35edf-4b09-41df-9374-a514d1417071") : object "kube-system"/"original-pull-secret" not registered
Oct 30 19:47:08.090270 ip-10-0-131-26 kubenswrapper[2582]: E1030 19:47:08.090223    2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 19:47:08.090270 ip-10-0-131-26 kubenswrapper[2582]: E1030 19:47:08.090243    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0a8c4dcc-2f62-4efe-993e-2de411ce6654-metrics-certs podName:0a8c4dcc-2f62-4efe-993e-2de411ce6654 nodeName:}" failed. No retries permitted until 2026-10-30 19:47:16.090236584 +0000 UTC m=+18.146811394 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0a8c4dcc-2f62-4efe-993e-2de411ce6654-metrics-certs") pod "network-metrics-daemon-hkjcv" (UID: "0a8c4dcc-2f62-4efe-993e-2de411ce6654") : object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 19:47:08.190428 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:08.190346    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tmmdv\" (UniqueName: \"kubernetes.io/projected/aa51899f-52a0-434e-b434-4bc030c94136-kube-api-access-tmmdv\") pod \"network-check-target-b27jd\" (UID: \"aa51899f-52a0-434e-b434-4bc030c94136\") " pod="openshift-network-diagnostics/network-check-target-b27jd"
Oct 30 19:47:08.190540 ip-10-0-131-26 kubenswrapper[2582]: E1030 19:47:08.190523    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Oct 30 19:47:08.190574 ip-10-0-131-26 kubenswrapper[2582]: E1030 19:47:08.190545    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Oct 30 19:47:08.190574 ip-10-0-131-26 kubenswrapper[2582]: E1030 19:47:08.190559    2582 projected.go:196] Error preparing data for projected volume kube-api-access-tmmdv for pod openshift-network-diagnostics/network-check-target-b27jd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 19:47:08.190642 ip-10-0-131-26 kubenswrapper[2582]: E1030 19:47:08.190612    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/aa51899f-52a0-434e-b434-4bc030c94136-kube-api-access-tmmdv podName:aa51899f-52a0-434e-b434-4bc030c94136 nodeName:}" failed. No retries permitted until 2026-10-30 19:47:16.19059375 +0000 UTC m=+18.247168582 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-tmmdv" (UniqueName: "kubernetes.io/projected/aa51899f-52a0-434e-b434-4bc030c94136-kube-api-access-tmmdv") pod "network-check-target-b27jd" (UID: "aa51899f-52a0-434e-b434-4bc030c94136") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 19:47:08.365662 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:08.365565    2582 reconciler.go:167] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-10-30T19:47:08.055302916Z","UUID":"b5bc4173-f6f3-453a-a8eb-88feadd3f108","Handler":null,"Name":"","Endpoint":""}
Oct 30 19:47:08.371746 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:08.371724    2582 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Oct 30 19:47:08.371746 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:08.371748    2582 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Oct 30 19:47:08.578449 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:08.570599    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hkjcv"
Oct 30 19:47:08.578449 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:08.570655    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-96mhd"
Oct 30 19:47:08.578449 ip-10-0-131-26 kubenswrapper[2582]: E1030 19:47:08.570955    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hkjcv" podUID="0a8c4dcc-2f62-4efe-993e-2de411ce6654"
Oct 30 19:47:08.578449 ip-10-0-131-26 kubenswrapper[2582]: E1030 19:47:08.571060    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-96mhd" podUID="90b35edf-4b09-41df-9374-a514d1417071"
Oct 30 19:47:08.755073 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:08.754978    2582 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-pb5c7" event={"ID":"8d3e77a0-4ee8-4429-9795-97fb3d799dba","Type":"ContainerStarted","Data":"46e01add5e58696c2a8e04a02280a2e8effe3864e550657e0a8fe85e5ef0132c"}
Oct 30 19:47:08.758332 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:08.758308    2582 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-clzkm" event={"ID":"2d3597bf-5138-4272-905b-d2fdd3bfbe7b","Type":"ContainerStarted","Data":"a73f17755060a1c046a9792f29a5630a4b8ca20f3c75f4660114fdfcfb25d9db"}
Oct 30 19:47:08.799182 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:08.799141    2582 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-image-registry/node-ca-2swph" podStartSLOduration=4.837778653 podStartE2EDuration="9.799127446s" totalImagesPullingTime="4.961348793s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 19:46:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 19:47:06.7915445 +0000 UTC m=+8.848119341" watchObservedRunningTime="2026-10-30 19:47:08.799127446 +0000 UTC m=+10.855702334"
Oct 30 19:47:09.566889 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:09.566859    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b27jd"
Oct 30 19:47:09.567460 ip-10-0-131-26 kubenswrapper[2582]: E1030 19:47:09.566957    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b27jd" podUID="aa51899f-52a0-434e-b434-4bc030c94136"
Oct 30 19:47:09.762878 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:09.762797    2582 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-clzkm" event={"ID":"2d3597bf-5138-4272-905b-d2fdd3bfbe7b","Type":"ContainerStarted","Data":"84fa7b256d0bbfd1b4a44b3872d5767c8070b0c2d7ec2d35c302ff9b2941c70c"}
Oct 30 19:47:09.765351 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:09.765227    2582 generic.go:356] "Generic (PLEG): container finished" podID="9898418c-eb0f-41b4-a844-d853caeab57f" containerID="0cdfca1b6887a7e1b486b893ea067d72e46c1706d6f10c1af7fb5701e4ff6b3b" exitCode=0
Oct 30 19:47:09.765351 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:09.765307    2582 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-q8w4d" event={"ID":"9898418c-eb0f-41b4-a844-d853caeab57f","Type":"ContainerDied","Data":"0cdfca1b6887a7e1b486b893ea067d72e46c1706d6f10c1af7fb5701e4ff6b3b"}
Oct 30 19:47:09.768165 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:09.768140    2582 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-krr87" event={"ID":"34dfa231-fa1a-400c-82b4-6ee85859d7c4","Type":"ContainerStarted","Data":"20204e3e54d5dfc1c3f7e8c4e67dd46757260b290f289e3c7feadbd7d256b39c"}
Oct 30 19:47:09.809444 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:09.809381    2582 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-multus/multus-pb5c7" podStartSLOduration=3.094692396 podStartE2EDuration="10.809369557s" totalImagesPullingTime="7.714677161s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 19:46:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 19:47:08.7994882 +0000 UTC m=+10.856063032" watchObservedRunningTime="2026-10-30 19:47:09.809369557 +0000 UTC m=+11.865944391"
Oct 30 19:47:09.809593 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:09.809501    2582 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-clzkm" podStartSLOduration=2.774033124 podStartE2EDuration="10.80949485s" totalImagesPullingTime="8.035461726s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 19:46:59 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 19:47:09.809055424 +0000 UTC m=+11.865630257" watchObservedRunningTime="2026-10-30 19:47:09.80949485 +0000 UTC m=+11.866069685"
Oct 30 19:47:09.898067 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:09.898022    2582 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-dns/node-resolver-krr87" podStartSLOduration=2.768615731 podStartE2EDuration="10.898008973s" totalImagesPullingTime="8.129393242s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 19:46:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 19:47:09.89788067 +0000 UTC m=+11.954455504" watchObservedRunningTime="2026-10-30 19:47:09.898008973 +0000 UTC m=+11.954583806"
Oct 30 19:47:10.566366 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:10.566294    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hkjcv"
Oct 30 19:47:10.566366 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:10.566323    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-96mhd"
Oct 30 19:47:10.566582 ip-10-0-131-26 kubenswrapper[2582]: E1030 19:47:10.566458    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hkjcv" podUID="0a8c4dcc-2f62-4efe-993e-2de411ce6654"
Oct 30 19:47:10.566885 ip-10-0-131-26 kubenswrapper[2582]: E1030 19:47:10.566856    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-96mhd" podUID="90b35edf-4b09-41df-9374-a514d1417071"
Oct 30 19:47:10.774807 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:10.774385    2582 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-q8w4d" event={"ID":"9898418c-eb0f-41b4-a844-d853caeab57f","Type":"ContainerStarted","Data":"fccc6e558a1d49750942cb7aa7508499d0aa47ee5861af4c812d867356c09ddc"}
Oct 30 19:47:10.776089 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:10.776058    2582 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-7gdcx" event={"ID":"641c89ab-1e2c-4e67-84b5-d5d0f4f30756","Type":"ContainerStarted","Data":"d7410d28a0abb9ca71e188f19719e47d9390a25a955128f50bbbb3f9371d2113"}
Oct 30 19:47:10.874650 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:10.874572    2582 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-7gdcx" podStartSLOduration=3.655376869 podStartE2EDuration="11.874555088s" totalImagesPullingTime="8.219178219s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 19:46:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 19:47:10.874063661 +0000 UTC m=+12.930638492" watchObservedRunningTime="2026-10-30 19:47:10.874555088 +0000 UTC m=+12.931129921"
Oct 30 19:47:11.566782 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:11.566754    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b27jd"
Oct 30 19:47:11.566947 ip-10-0-131-26 kubenswrapper[2582]: E1030 19:47:11.566868    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b27jd" podUID="aa51899f-52a0-434e-b434-4bc030c94136"
Oct 30 19:47:11.780471 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:11.780438    2582 generic.go:356] "Generic (PLEG): container finished" podID="9898418c-eb0f-41b4-a844-d853caeab57f" containerID="fccc6e558a1d49750942cb7aa7508499d0aa47ee5861af4c812d867356c09ddc" exitCode=0
Oct 30 19:47:11.781195 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:11.780478    2582 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-q8w4d" event={"ID":"9898418c-eb0f-41b4-a844-d853caeab57f","Type":"ContainerDied","Data":"fccc6e558a1d49750942cb7aa7508499d0aa47ee5861af4c812d867356c09ddc"}
Oct 30 19:47:11.782206 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:11.782166    2582 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-k865s" event={"ID":"ac20c88a-e9bd-42c8-bcbe-2080f2393cc3","Type":"ContainerStarted","Data":"f07ab74201e421322ab1bc4eb5c5215b07146830744b84135a2004ab9c9ba967"}
Oct 30 19:47:11.872968 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:11.872879    2582 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-k865s" podStartSLOduration=2.52026396 podStartE2EDuration="12.872863003s" totalImagesPullingTime="10.352599043s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 19:46:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 19:47:11.87269197 +0000 UTC m=+13.929266803" watchObservedRunningTime="2026-10-30 19:47:11.872863003 +0000 UTC m=+13.929437837"
Oct 30 19:47:12.566977 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:12.566819    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-96mhd"
Oct 30 19:47:12.567069 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:12.566889    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hkjcv"
Oct 30 19:47:12.567130 ip-10-0-131-26 kubenswrapper[2582]: E1030 19:47:12.567091    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-96mhd" podUID="90b35edf-4b09-41df-9374-a514d1417071"
Oct 30 19:47:12.567183 ip-10-0-131-26 kubenswrapper[2582]: E1030 19:47:12.567162    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hkjcv" podUID="0a8c4dcc-2f62-4efe-993e-2de411ce6654"
Oct 30 19:47:12.786790 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:12.786700    2582 generic.go:356] "Generic (PLEG): container finished" podID="9898418c-eb0f-41b4-a844-d853caeab57f" containerID="bfcd7e6d1668078696ad8a5dac8c453f853b3d0d82f4d0023439c18c00cb5de3" exitCode=0
Oct 30 19:47:12.787180 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:12.786780    2582 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-q8w4d" event={"ID":"9898418c-eb0f-41b4-a844-d853caeab57f","Type":"ContainerDied","Data":"bfcd7e6d1668078696ad8a5dac8c453f853b3d0d82f4d0023439c18c00cb5de3"}
Oct 30 19:47:13.566552 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:13.566078    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b27jd"
Oct 30 19:47:13.566552 ip-10-0-131-26 kubenswrapper[2582]: E1030 19:47:13.566205    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b27jd" podUID="aa51899f-52a0-434e-b434-4bc030c94136"
Oct 30 19:47:14.566831 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:14.566802    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-96mhd"
Oct 30 19:47:14.567191 ip-10-0-131-26 kubenswrapper[2582]: E1030 19:47:14.566937    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-96mhd" podUID="90b35edf-4b09-41df-9374-a514d1417071"
Oct 30 19:47:14.567191 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:14.566976    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hkjcv"
Oct 30 19:47:14.567191 ip-10-0-131-26 kubenswrapper[2582]: E1030 19:47:14.567056    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hkjcv" podUID="0a8c4dcc-2f62-4efe-993e-2de411ce6654"
Oct 30 19:47:14.794022 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:14.793994    2582 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-q8w4d" event={"ID":"9898418c-eb0f-41b4-a844-d853caeab57f","Type":"ContainerStarted","Data":"1ed4b4718e96248ac01e9be68fbd7c9b40695ec522bb4622d8595156c5688556"}
Oct 30 19:47:15.566177 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:15.566155    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b27jd"
Oct 30 19:47:15.566263 ip-10-0-131-26 kubenswrapper[2582]: E1030 19:47:15.566245    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b27jd" podUID="aa51899f-52a0-434e-b434-4bc030c94136"
Oct 30 19:47:15.798986 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:15.798959    2582 generic.go:356] "Generic (PLEG): container finished" podID="9898418c-eb0f-41b4-a844-d853caeab57f" containerID="1ed4b4718e96248ac01e9be68fbd7c9b40695ec522bb4622d8595156c5688556" exitCode=0
Oct 30 19:47:15.799473 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:15.799031    2582 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-q8w4d" event={"ID":"9898418c-eb0f-41b4-a844-d853caeab57f","Type":"ContainerDied","Data":"1ed4b4718e96248ac01e9be68fbd7c9b40695ec522bb4622d8595156c5688556"}
Oct 30 19:47:15.802151 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:15.802129    2582 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-84v4l" event={"ID":"98dd829b-0745-4229-b781-da2c4ad16f9e","Type":"ContainerStarted","Data":"97754603a981c6e23c1034b05338257c2bc8e35b8f368d6382e279a697f18a14"}
Oct 30 19:47:15.802246 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:15.802190    2582 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-84v4l" event={"ID":"98dd829b-0745-4229-b781-da2c4ad16f9e","Type":"ContainerStarted","Data":"782aac0eaa62727717a95efcc70bbaea1d0e2f0e73effe3e19e37634aa0cc54a"}
Oct 30 19:47:15.802246 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:15.802230    2582 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-84v4l" event={"ID":"98dd829b-0745-4229-b781-da2c4ad16f9e","Type":"ContainerStarted","Data":"84d16c31c1da5750180943f8c1660a18e313357ca8e2c1519167a6a5866a011e"}
Oct 30 19:47:15.802327 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:15.802268    2582 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-84v4l" event={"ID":"98dd829b-0745-4229-b781-da2c4ad16f9e","Type":"ContainerStarted","Data":"780a7d28762a3e227e694395367f5540c559dd7a604b2d774ed93cd78ccf9439"}
Oct 30 19:47:15.802327 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:15.802302    2582 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-84v4l" event={"ID":"98dd829b-0745-4229-b781-da2c4ad16f9e","Type":"ContainerStarted","Data":"5ad9d613a7cb83864ed4e4ca7c28973c2db911bfaf604cefee0296d11d218abf"}
Oct 30 19:47:15.802436 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:15.802331    2582 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-84v4l" event={"ID":"98dd829b-0745-4229-b781-da2c4ad16f9e","Type":"ContainerStarted","Data":"804103f7e89a888690648d6712ae9827452153264378aadf36e06fcc7e7c0b4d"}
Oct 30 19:47:16.151881 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:16.151860    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0a8c4dcc-2f62-4efe-993e-2de411ce6654-metrics-certs\") pod \"network-metrics-daemon-hkjcv\" (UID: \"0a8c4dcc-2f62-4efe-993e-2de411ce6654\") " pod="openshift-multus/network-metrics-daemon-hkjcv"
Oct 30 19:47:16.151979 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:16.151889    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/90b35edf-4b09-41df-9374-a514d1417071-original-pull-secret\") pod \"global-pull-secret-syncer-96mhd\" (UID: \"90b35edf-4b09-41df-9374-a514d1417071\") " pod="kube-system/global-pull-secret-syncer-96mhd"
Oct 30 19:47:16.151979 ip-10-0-131-26 kubenswrapper[2582]: E1030 19:47:16.151970    2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Oct 30 19:47:16.152037 ip-10-0-131-26 kubenswrapper[2582]: E1030 19:47:16.151980    2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 19:47:16.152037 ip-10-0-131-26 kubenswrapper[2582]: E1030 19:47:16.152010    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/90b35edf-4b09-41df-9374-a514d1417071-original-pull-secret podName:90b35edf-4b09-41df-9374-a514d1417071 nodeName:}" failed. No retries permitted until 2026-10-30 19:47:32.151998558 +0000 UTC m=+34.208573369 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/90b35edf-4b09-41df-9374-a514d1417071-original-pull-secret") pod "global-pull-secret-syncer-96mhd" (UID: "90b35edf-4b09-41df-9374-a514d1417071") : object "kube-system"/"original-pull-secret" not registered
Oct 30 19:47:16.152037 ip-10-0-131-26 kubenswrapper[2582]: E1030 19:47:16.152023    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0a8c4dcc-2f62-4efe-993e-2de411ce6654-metrics-certs podName:0a8c4dcc-2f62-4efe-993e-2de411ce6654 nodeName:}" failed. No retries permitted until 2026-10-30 19:47:32.152016856 +0000 UTC m=+34.208591666 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0a8c4dcc-2f62-4efe-993e-2de411ce6654-metrics-certs") pod "network-metrics-daemon-hkjcv" (UID: "0a8c4dcc-2f62-4efe-993e-2de411ce6654") : object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 19:47:16.252266 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:16.252218    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tmmdv\" (UniqueName: \"kubernetes.io/projected/aa51899f-52a0-434e-b434-4bc030c94136-kube-api-access-tmmdv\") pod \"network-check-target-b27jd\" (UID: \"aa51899f-52a0-434e-b434-4bc030c94136\") " pod="openshift-network-diagnostics/network-check-target-b27jd"
Oct 30 19:47:16.252375 ip-10-0-131-26 kubenswrapper[2582]: E1030 19:47:16.252359    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Oct 30 19:47:16.252375 ip-10-0-131-26 kubenswrapper[2582]: E1030 19:47:16.252373    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Oct 30 19:47:16.252453 ip-10-0-131-26 kubenswrapper[2582]: E1030 19:47:16.252382    2582 projected.go:196] Error preparing data for projected volume kube-api-access-tmmdv for pod openshift-network-diagnostics/network-check-target-b27jd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 19:47:16.252453 ip-10-0-131-26 kubenswrapper[2582]: E1030 19:47:16.252432    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/aa51899f-52a0-434e-b434-4bc030c94136-kube-api-access-tmmdv podName:aa51899f-52a0-434e-b434-4bc030c94136 nodeName:}" failed. No retries permitted until 2026-10-30 19:47:32.252407373 +0000 UTC m=+34.308982184 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-tmmdv" (UniqueName: "kubernetes.io/projected/aa51899f-52a0-434e-b434-4bc030c94136-kube-api-access-tmmdv") pod "network-check-target-b27jd" (UID: "aa51899f-52a0-434e-b434-4bc030c94136") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 19:47:16.566873 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:16.566830    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hkjcv"
Oct 30 19:47:16.566947 ip-10-0-131-26 kubenswrapper[2582]: E1030 19:47:16.566931    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hkjcv" podUID="0a8c4dcc-2f62-4efe-993e-2de411ce6654"
Oct 30 19:47:16.567008 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:16.566987    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-96mhd"
Oct 30 19:47:16.567100 ip-10-0-131-26 kubenswrapper[2582]: E1030 19:47:16.567083    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-96mhd" podUID="90b35edf-4b09-41df-9374-a514d1417071"
Oct 30 19:47:16.806693 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:16.806668    2582 generic.go:356] "Generic (PLEG): container finished" podID="9898418c-eb0f-41b4-a844-d853caeab57f" containerID="d6cc416dcefd05d99c3785918c06a3ed4233da55c7a97ba3ed78aa73922810d5" exitCode=0
Oct 30 19:47:16.806964 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:16.806726    2582 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-q8w4d" event={"ID":"9898418c-eb0f-41b4-a844-d853caeab57f","Type":"ContainerDied","Data":"d6cc416dcefd05d99c3785918c06a3ed4233da55c7a97ba3ed78aa73922810d5"}
Oct 30 19:47:17.566148 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:17.566121    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b27jd"
Oct 30 19:47:17.566281 ip-10-0-131-26 kubenswrapper[2582]: E1030 19:47:17.566263    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b27jd" podUID="aa51899f-52a0-434e-b434-4bc030c94136"
Oct 30 19:47:17.812965 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:17.812943    2582 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-q8w4d" event={"ID":"9898418c-eb0f-41b4-a844-d853caeab57f","Type":"ContainerStarted","Data":"02de9c9873b18fc1554087bb00b488095c577ce2c5e3dee6977abb207b937028"}
Oct 30 19:47:17.877733 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:17.877689    2582 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-q8w4d" podStartSLOduration=8.323264491 podStartE2EDuration="18.877677826s" totalImagesPullingTime="10.554413335s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 19:46:59 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 19:47:17.87422772 +0000 UTC m=+19.930802553" watchObservedRunningTime="2026-10-30 19:47:17.877677826 +0000 UTC m=+19.934252657"
Oct 30 19:47:18.025600 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:18.025576    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-krr87_34dfa231-fa1a-400c-82b4-6ee85859d7c4/dns-node-resolver/0.log"
Oct 30 19:47:18.566867 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:18.566841    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hkjcv"
Oct 30 19:47:18.566982 ip-10-0-131-26 kubenswrapper[2582]: E1030 19:47:18.566919    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hkjcv" podUID="0a8c4dcc-2f62-4efe-993e-2de411ce6654"
Oct 30 19:47:18.567031 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:18.567011    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-96mhd"
Oct 30 19:47:18.567116 ip-10-0-131-26 kubenswrapper[2582]: E1030 19:47:18.567098    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-96mhd" podUID="90b35edf-4b09-41df-9374-a514d1417071"
Oct 30 19:47:18.818100 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:18.818042    2582 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-84v4l" event={"ID":"98dd829b-0745-4229-b781-da2c4ad16f9e","Type":"ContainerStarted","Data":"9e6c5bfd4f4a009c2f97d3d68feede447c351c285a8566561f85128191af9513"}
Oct 30 19:47:18.936547 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:18.936526    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-2swph_423e0100-284b-48b9-bd4c-3b74005976d2/node-ca/0.log"
Oct 30 19:47:19.566329 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:19.566305    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b27jd"
Oct 30 19:47:19.566498 ip-10-0-131-26 kubenswrapper[2582]: E1030 19:47:19.566390    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b27jd" podUID="aa51899f-52a0-434e-b434-4bc030c94136"
Oct 30 19:47:20.566388 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:20.566162    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-96mhd"
Oct 30 19:47:20.566861 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:20.566224    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hkjcv"
Oct 30 19:47:20.566861 ip-10-0-131-26 kubenswrapper[2582]: E1030 19:47:20.566505    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-96mhd" podUID="90b35edf-4b09-41df-9374-a514d1417071"
Oct 30 19:47:20.566861 ip-10-0-131-26 kubenswrapper[2582]: E1030 19:47:20.566530    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hkjcv" podUID="0a8c4dcc-2f62-4efe-993e-2de411ce6654"
Oct 30 19:47:20.824746 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:20.824686    2582 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-84v4l" event={"ID":"98dd829b-0745-4229-b781-da2c4ad16f9e","Type":"ContainerStarted","Data":"9e14c055dd6893f10912f5db9a90ce14918abc129a876713f8c850c54371ca43"}
Oct 30 19:47:20.824949 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:20.824931    2582 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-84v4l"
Oct 30 19:47:20.842091 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:20.842068    2582 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-84v4l"
Oct 30 19:47:20.918709 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:20.918661    2582 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-84v4l" podStartSLOduration=7.127271749 podStartE2EDuration="21.918651494s" totalImagesPullingTime="14.791379745s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 19:46:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 19:47:20.918195601 +0000 UTC m=+22.974770432" watchObservedRunningTime="2026-10-30 19:47:20.918651494 +0000 UTC m=+22.975226325"
Oct 30 19:47:21.085910 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:21.085838    2582 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-6lj57"
Oct 30 19:47:21.086030 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:21.085946    2582 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness"
Oct 30 19:47:21.086443 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:21.086428    2582 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-6lj57"
Oct 30 19:47:21.565845 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:21.565825    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b27jd"
Oct 30 19:47:21.565961 ip-10-0-131-26 kubenswrapper[2582]: E1030 19:47:21.565904    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b27jd" podUID="aa51899f-52a0-434e-b434-4bc030c94136"
Oct 30 19:47:21.827299 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:21.827254    2582 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-84v4l"
Oct 30 19:47:21.827712 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:21.827307    2582 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-84v4l"
Oct 30 19:47:21.841652 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:21.841634    2582 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-84v4l"
Oct 30 19:47:22.566432 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:22.566391    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hkjcv"
Oct 30 19:47:22.566739 ip-10-0-131-26 kubenswrapper[2582]: E1030 19:47:22.566531    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hkjcv" podUID="0a8c4dcc-2f62-4efe-993e-2de411ce6654"
Oct 30 19:47:22.566739 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:22.566592    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-96mhd"
Oct 30 19:47:22.566739 ip-10-0-131-26 kubenswrapper[2582]: E1030 19:47:22.566684    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-96mhd" podUID="90b35edf-4b09-41df-9374-a514d1417071"
Oct 30 19:47:23.566224 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:23.566198    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b27jd"
Oct 30 19:47:23.566576 ip-10-0-131-26 kubenswrapper[2582]: E1030 19:47:23.566281    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b27jd" podUID="aa51899f-52a0-434e-b434-4bc030c94136"
Oct 30 19:47:24.566381 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:24.566351    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-96mhd"
Oct 30 19:47:24.566760 ip-10-0-131-26 kubenswrapper[2582]: E1030 19:47:24.566486    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-96mhd" podUID="90b35edf-4b09-41df-9374-a514d1417071"
Oct 30 19:47:24.566760 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:24.566536    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hkjcv"
Oct 30 19:47:24.566760 ip-10-0-131-26 kubenswrapper[2582]: E1030 19:47:24.566627    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hkjcv" podUID="0a8c4dcc-2f62-4efe-993e-2de411ce6654"
Oct 30 19:47:25.565897 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:25.565872    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b27jd"
Oct 30 19:47:25.566129 ip-10-0-131-26 kubenswrapper[2582]: E1030 19:47:25.565968    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b27jd" podUID="aa51899f-52a0-434e-b434-4bc030c94136"
Oct 30 19:47:26.566527 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:26.566499    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hkjcv"
Oct 30 19:47:26.566990 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:26.566501    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-96mhd"
Oct 30 19:47:26.566990 ip-10-0-131-26 kubenswrapper[2582]: E1030 19:47:26.566595    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hkjcv" podUID="0a8c4dcc-2f62-4efe-993e-2de411ce6654"
Oct 30 19:47:26.566990 ip-10-0-131-26 kubenswrapper[2582]: E1030 19:47:26.566657    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-96mhd" podUID="90b35edf-4b09-41df-9374-a514d1417071"
Oct 30 19:47:27.566077 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:27.566053    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b27jd"
Oct 30 19:47:27.566228 ip-10-0-131-26 kubenswrapper[2582]: E1030 19:47:27.566137    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b27jd" podUID="aa51899f-52a0-434e-b434-4bc030c94136"
Oct 30 19:47:28.567197 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:28.567166    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hkjcv"
Oct 30 19:47:28.567572 ip-10-0-131-26 kubenswrapper[2582]: E1030 19:47:28.567247    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hkjcv" podUID="0a8c4dcc-2f62-4efe-993e-2de411ce6654"
Oct 30 19:47:28.567572 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:28.567339    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-96mhd"
Oct 30 19:47:28.567572 ip-10-0-131-26 kubenswrapper[2582]: E1030 19:47:28.567428    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-96mhd" podUID="90b35edf-4b09-41df-9374-a514d1417071"
Oct 30 19:47:29.566690 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:29.566664    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b27jd"
Oct 30 19:47:29.566839 ip-10-0-131-26 kubenswrapper[2582]: E1030 19:47:29.566749    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b27jd" podUID="aa51899f-52a0-434e-b434-4bc030c94136"
Oct 30 19:47:30.568938 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:30.568912    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hkjcv"
Oct 30 19:47:30.569291 ip-10-0-131-26 kubenswrapper[2582]: E1030 19:47:30.569022    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hkjcv" podUID="0a8c4dcc-2f62-4efe-993e-2de411ce6654"
Oct 30 19:47:30.569291 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:30.569078    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-96mhd"
Oct 30 19:47:30.569291 ip-10-0-131-26 kubenswrapper[2582]: E1030 19:47:30.569163    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-96mhd" podUID="90b35edf-4b09-41df-9374-a514d1417071"
Oct 30 19:47:31.566366 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:31.566329    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b27jd"
Oct 30 19:47:31.566556 ip-10-0-131-26 kubenswrapper[2582]: E1030 19:47:31.566465    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b27jd" podUID="aa51899f-52a0-434e-b434-4bc030c94136"
Oct 30 19:47:32.161845 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:32.161817    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0a8c4dcc-2f62-4efe-993e-2de411ce6654-metrics-certs\") pod \"network-metrics-daemon-hkjcv\" (UID: \"0a8c4dcc-2f62-4efe-993e-2de411ce6654\") " pod="openshift-multus/network-metrics-daemon-hkjcv"
Oct 30 19:47:32.161845 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:32.161847    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/90b35edf-4b09-41df-9374-a514d1417071-original-pull-secret\") pod \"global-pull-secret-syncer-96mhd\" (UID: \"90b35edf-4b09-41df-9374-a514d1417071\") " pod="kube-system/global-pull-secret-syncer-96mhd"
Oct 30 19:47:32.162284 ip-10-0-131-26 kubenswrapper[2582]: E1030 19:47:32.161948    2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Oct 30 19:47:32.162284 ip-10-0-131-26 kubenswrapper[2582]: E1030 19:47:32.161965    2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 19:47:32.162284 ip-10-0-131-26 kubenswrapper[2582]: E1030 19:47:32.161992    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/90b35edf-4b09-41df-9374-a514d1417071-original-pull-secret podName:90b35edf-4b09-41df-9374-a514d1417071 nodeName:}" failed. No retries permitted until 2026-10-30 19:48:04.161980207 +0000 UTC m=+66.218555018 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/90b35edf-4b09-41df-9374-a514d1417071-original-pull-secret") pod "global-pull-secret-syncer-96mhd" (UID: "90b35edf-4b09-41df-9374-a514d1417071") : object "kube-system"/"original-pull-secret" not registered
Oct 30 19:47:32.162284 ip-10-0-131-26 kubenswrapper[2582]: E1030 19:47:32.162023    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0a8c4dcc-2f62-4efe-993e-2de411ce6654-metrics-certs podName:0a8c4dcc-2f62-4efe-993e-2de411ce6654 nodeName:}" failed. No retries permitted until 2026-10-30 19:48:04.162005036 +0000 UTC m=+66.218579875 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0a8c4dcc-2f62-4efe-993e-2de411ce6654-metrics-certs") pod "network-metrics-daemon-hkjcv" (UID: "0a8c4dcc-2f62-4efe-993e-2de411ce6654") : object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 19:47:32.262694 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:32.262664    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tmmdv\" (UniqueName: \"kubernetes.io/projected/aa51899f-52a0-434e-b434-4bc030c94136-kube-api-access-tmmdv\") pod \"network-check-target-b27jd\" (UID: \"aa51899f-52a0-434e-b434-4bc030c94136\") " pod="openshift-network-diagnostics/network-check-target-b27jd"
Oct 30 19:47:32.262821 ip-10-0-131-26 kubenswrapper[2582]: E1030 19:47:32.262810    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Oct 30 19:47:32.262861 ip-10-0-131-26 kubenswrapper[2582]: E1030 19:47:32.262829    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Oct 30 19:47:32.262861 ip-10-0-131-26 kubenswrapper[2582]: E1030 19:47:32.262838    2582 projected.go:196] Error preparing data for projected volume kube-api-access-tmmdv for pod openshift-network-diagnostics/network-check-target-b27jd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 19:47:32.262920 ip-10-0-131-26 kubenswrapper[2582]: E1030 19:47:32.262881    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/aa51899f-52a0-434e-b434-4bc030c94136-kube-api-access-tmmdv podName:aa51899f-52a0-434e-b434-4bc030c94136 nodeName:}" failed. No retries permitted until 2026-10-30 19:48:04.262866964 +0000 UTC m=+66.319441776 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-tmmdv" (UniqueName: "kubernetes.io/projected/aa51899f-52a0-434e-b434-4bc030c94136-kube-api-access-tmmdv") pod "network-check-target-b27jd" (UID: "aa51899f-52a0-434e-b434-4bc030c94136") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 19:47:32.566127 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:32.566095    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-96mhd"
Oct 30 19:47:32.566127 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:32.566123    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hkjcv"
Oct 30 19:47:32.566332 ip-10-0-131-26 kubenswrapper[2582]: E1030 19:47:32.566222    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-96mhd" podUID="90b35edf-4b09-41df-9374-a514d1417071"
Oct 30 19:47:32.566332 ip-10-0-131-26 kubenswrapper[2582]: E1030 19:47:32.566321    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hkjcv" podUID="0a8c4dcc-2f62-4efe-993e-2de411ce6654"
Oct 30 19:47:33.566035 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:33.566009    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b27jd"
Oct 30 19:47:33.566396 ip-10-0-131-26 kubenswrapper[2582]: E1030 19:47:33.566093    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b27jd" podUID="aa51899f-52a0-434e-b434-4bc030c94136"
Oct 30 19:47:34.566803 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:34.566769    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hkjcv"
Oct 30 19:47:34.567291 ip-10-0-131-26 kubenswrapper[2582]: E1030 19:47:34.566870    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hkjcv" podUID="0a8c4dcc-2f62-4efe-993e-2de411ce6654"
Oct 30 19:47:34.567291 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:34.566945    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-96mhd"
Oct 30 19:47:34.567291 ip-10-0-131-26 kubenswrapper[2582]: E1030 19:47:34.567029    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-96mhd" podUID="90b35edf-4b09-41df-9374-a514d1417071"
Oct 30 19:47:35.566151 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:35.566125    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b27jd"
Oct 30 19:47:35.566311 ip-10-0-131-26 kubenswrapper[2582]: E1030 19:47:35.566208    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b27jd" podUID="aa51899f-52a0-434e-b434-4bc030c94136"
Oct 30 19:47:36.566242 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:36.566217    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hkjcv"
Oct 30 19:47:36.566685 ip-10-0-131-26 kubenswrapper[2582]: E1030 19:47:36.566310    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hkjcv" podUID="0a8c4dcc-2f62-4efe-993e-2de411ce6654"
Oct 30 19:47:36.566685 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:36.566395    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-96mhd"
Oct 30 19:47:36.566685 ip-10-0-131-26 kubenswrapper[2582]: E1030 19:47:36.566514    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-96mhd" podUID="90b35edf-4b09-41df-9374-a514d1417071"
Oct 30 19:47:37.566798 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:37.566771    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b27jd"
Oct 30 19:47:37.567173 ip-10-0-131-26 kubenswrapper[2582]: E1030 19:47:37.566867    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b27jd" podUID="aa51899f-52a0-434e-b434-4bc030c94136"
Oct 30 19:47:38.079267 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:38.079237    2582 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-96mhd"]
Oct 30 19:47:38.079421 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:38.079397    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-96mhd"
Oct 30 19:47:38.079564 ip-10-0-131-26 kubenswrapper[2582]: E1030 19:47:38.079534    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-96mhd" podUID="90b35edf-4b09-41df-9374-a514d1417071"
Oct 30 19:47:38.082266 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:38.082241    2582 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-b27jd"]
Oct 30 19:47:38.082451 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:38.082431    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b27jd"
Oct 30 19:47:38.082764 ip-10-0-131-26 kubenswrapper[2582]: E1030 19:47:38.082569    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b27jd" podUID="aa51899f-52a0-434e-b434-4bc030c94136"
Oct 30 19:47:38.082918 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:38.082898    2582 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-hkjcv"]
Oct 30 19:47:38.083026 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:38.082985    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hkjcv"
Oct 30 19:47:38.083085 ip-10-0-131-26 kubenswrapper[2582]: E1030 19:47:38.083064    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hkjcv" podUID="0a8c4dcc-2f62-4efe-993e-2de411ce6654"
Oct 30 19:47:39.566347 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:39.566309    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hkjcv"
Oct 30 19:47:39.566706 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:39.566328    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-96mhd"
Oct 30 19:47:39.566706 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:39.566442    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b27jd"
Oct 30 19:47:39.566706 ip-10-0-131-26 kubenswrapper[2582]: E1030 19:47:39.566449    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hkjcv" podUID="0a8c4dcc-2f62-4efe-993e-2de411ce6654"
Oct 30 19:47:39.566706 ip-10-0-131-26 kubenswrapper[2582]: E1030 19:47:39.566513    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-96mhd" podUID="90b35edf-4b09-41df-9374-a514d1417071"
Oct 30 19:47:39.566706 ip-10-0-131-26 kubenswrapper[2582]: E1030 19:47:39.566588    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b27jd" podUID="aa51899f-52a0-434e-b434-4bc030c94136"
Oct 30 19:47:41.566692 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:41.566525    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hkjcv"
Oct 30 19:47:41.567136 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:41.566552    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-96mhd"
Oct 30 19:47:41.567136 ip-10-0-131-26 kubenswrapper[2582]: E1030 19:47:41.566767    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hkjcv" podUID="0a8c4dcc-2f62-4efe-993e-2de411ce6654"
Oct 30 19:47:41.567136 ip-10-0-131-26 kubenswrapper[2582]: E1030 19:47:41.566838    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-96mhd" podUID="90b35edf-4b09-41df-9374-a514d1417071"
Oct 30 19:47:41.567136 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:41.566576    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b27jd"
Oct 30 19:47:41.567136 ip-10-0-131-26 kubenswrapper[2582]: E1030 19:47:41.566907    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b27jd" podUID="aa51899f-52a0-434e-b434-4bc030c94136"
Oct 30 19:47:42.242549 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:42.242525    2582 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-131-26.ec2.internal" event="NodeReady"
Oct 30 19:47:42.242669 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:42.242630    2582 kubelet_node_status.go:477] "Fast updating node status as it just became ready"
Oct 30 19:47:42.323998 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:42.323970    2582 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-r6bht"]
Oct 30 19:47:42.327504 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:42.327465    2582 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-kmppx"]
Oct 30 19:47:42.327718 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:42.327690    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-r6bht"
Oct 30 19:47:42.329913 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:42.329891    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-kmppx"
Oct 30 19:47:42.343950 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:42.343933    2582 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-fwc77"]
Oct 30 19:47:42.345793 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:42.345777    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-fwc77"
Oct 30 19:47:42.355630 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:42.355613    2582 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-r6bht"]
Oct 30 19:47:42.370440 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:42.370402    2582 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Oct 30 19:47:42.370825 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:42.370801    2582 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Oct 30 19:47:42.370919 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:42.370845    2582 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-l5g68\""
Oct 30 19:47:42.370919 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:42.370893    2582 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-q7g4j\""
Oct 30 19:47:42.370919 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:42.370910    2582 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"ingress-canary-dockercfg-h5z6r\""
Oct 30 19:47:42.371041 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:42.370933    2582 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Oct 30 19:47:42.382391 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:42.382332    2582 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Oct 30 19:47:42.382497 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:42.382446    2582 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Oct 30 19:47:42.382497 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:42.382457    2582 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Oct 30 19:47:42.382497 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:42.382467    2582 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Oct 30 19:47:42.382760 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:42.382745    2582 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Oct 30 19:47:42.382857 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:42.382845    2582 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Oct 30 19:47:42.383348 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:42.383334    2582 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-fwc77"]
Oct 30 19:47:42.385679 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:42.385665    2582 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-kmppx"]
Oct 30 19:47:42.439297 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:42.439273    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5a23369d-e69d-40e0-a956-a109d6d653c1-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-fwc77\" (UID: \"5a23369d-e69d-40e0-a956-a109d6d653c1\") " pod="openshift-insights/insights-runtime-extractor-fwc77"
Oct 30 19:47:42.439438 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:42.439301    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5a23369d-e69d-40e0-a956-a109d6d653c1-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fwc77\" (UID: \"5a23369d-e69d-40e0-a956-a109d6d653c1\") " pod="openshift-insights/insights-runtime-extractor-fwc77"
Oct 30 19:47:42.439438 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:42.439323    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/5a23369d-e69d-40e0-a956-a109d6d653c1-crio-socket\") pod \"insights-runtime-extractor-fwc77\" (UID: \"5a23369d-e69d-40e0-a956-a109d6d653c1\") " pod="openshift-insights/insights-runtime-extractor-fwc77"
Oct 30 19:47:42.439438 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:42.439383    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/45a7e195-0bbf-46cb-b821-30728122c3fc-cert\") pod \"ingress-canary-r6bht\" (UID: \"45a7e195-0bbf-46cb-b821-30728122c3fc\") " pod="openshift-ingress-canary/ingress-canary-r6bht"
Oct 30 19:47:42.439606 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:42.439514    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4d52cf11-23b8-4b48-92ec-009845eea77f-tmp-dir\") pod \"dns-default-kmppx\" (UID: \"4d52cf11-23b8-4b48-92ec-009845eea77f\") " pod="openshift-dns/dns-default-kmppx"
Oct 30 19:47:42.439606 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:42.439554    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/4d52cf11-23b8-4b48-92ec-009845eea77f-config-volume\") pod \"dns-default-kmppx\" (UID: \"4d52cf11-23b8-4b48-92ec-009845eea77f\") " pod="openshift-dns/dns-default-kmppx"
Oct 30 19:47:42.439606 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:42.439581    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/5a23369d-e69d-40e0-a956-a109d6d653c1-data-volume\") pod \"insights-runtime-extractor-fwc77\" (UID: \"5a23369d-e69d-40e0-a956-a109d6d653c1\") " pod="openshift-insights/insights-runtime-extractor-fwc77"
Oct 30 19:47:42.439733 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:42.439643    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rmn47\" (UniqueName: \"kubernetes.io/projected/4d52cf11-23b8-4b48-92ec-009845eea77f-kube-api-access-rmn47\") pod \"dns-default-kmppx\" (UID: \"4d52cf11-23b8-4b48-92ec-009845eea77f\") " pod="openshift-dns/dns-default-kmppx"
Oct 30 19:47:42.439733 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:42.439671    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-plsvs\" (UniqueName: \"kubernetes.io/projected/5a23369d-e69d-40e0-a956-a109d6d653c1-kube-api-access-plsvs\") pod \"insights-runtime-extractor-fwc77\" (UID: \"5a23369d-e69d-40e0-a956-a109d6d653c1\") " pod="openshift-insights/insights-runtime-extractor-fwc77"
Oct 30 19:47:42.439733 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:42.439705    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4d52cf11-23b8-4b48-92ec-009845eea77f-metrics-tls\") pod \"dns-default-kmppx\" (UID: \"4d52cf11-23b8-4b48-92ec-009845eea77f\") " pod="openshift-dns/dns-default-kmppx"
Oct 30 19:47:42.439838 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:42.439758    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jvx29\" (UniqueName: \"kubernetes.io/projected/45a7e195-0bbf-46cb-b821-30728122c3fc-kube-api-access-jvx29\") pod \"ingress-canary-r6bht\" (UID: \"45a7e195-0bbf-46cb-b821-30728122c3fc\") " pod="openshift-ingress-canary/ingress-canary-r6bht"
Oct 30 19:47:42.540544 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:42.540522    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/45a7e195-0bbf-46cb-b821-30728122c3fc-cert\") pod \"ingress-canary-r6bht\" (UID: \"45a7e195-0bbf-46cb-b821-30728122c3fc\") " pod="openshift-ingress-canary/ingress-canary-r6bht"
Oct 30 19:47:42.540647 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:42.540547    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4d52cf11-23b8-4b48-92ec-009845eea77f-tmp-dir\") pod \"dns-default-kmppx\" (UID: \"4d52cf11-23b8-4b48-92ec-009845eea77f\") " pod="openshift-dns/dns-default-kmppx"
Oct 30 19:47:42.540647 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:42.540567    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/4d52cf11-23b8-4b48-92ec-009845eea77f-config-volume\") pod \"dns-default-kmppx\" (UID: \"4d52cf11-23b8-4b48-92ec-009845eea77f\") " pod="openshift-dns/dns-default-kmppx"
Oct 30 19:47:42.540647 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:42.540580    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/5a23369d-e69d-40e0-a956-a109d6d653c1-data-volume\") pod \"insights-runtime-extractor-fwc77\" (UID: \"5a23369d-e69d-40e0-a956-a109d6d653c1\") " pod="openshift-insights/insights-runtime-extractor-fwc77"
Oct 30 19:47:42.540905 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:42.540888    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rmn47\" (UniqueName: \"kubernetes.io/projected/4d52cf11-23b8-4b48-92ec-009845eea77f-kube-api-access-rmn47\") pod \"dns-default-kmppx\" (UID: \"4d52cf11-23b8-4b48-92ec-009845eea77f\") " pod="openshift-dns/dns-default-kmppx"
Oct 30 19:47:42.540973 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:42.540912    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-plsvs\" (UniqueName: \"kubernetes.io/projected/5a23369d-e69d-40e0-a956-a109d6d653c1-kube-api-access-plsvs\") pod \"insights-runtime-extractor-fwc77\" (UID: \"5a23369d-e69d-40e0-a956-a109d6d653c1\") " pod="openshift-insights/insights-runtime-extractor-fwc77"
Oct 30 19:47:42.540973 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:42.540932    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4d52cf11-23b8-4b48-92ec-009845eea77f-metrics-tls\") pod \"dns-default-kmppx\" (UID: \"4d52cf11-23b8-4b48-92ec-009845eea77f\") " pod="openshift-dns/dns-default-kmppx"
Oct 30 19:47:42.540973 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:42.540934    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/5a23369d-e69d-40e0-a956-a109d6d653c1-data-volume\") pod \"insights-runtime-extractor-fwc77\" (UID: \"5a23369d-e69d-40e0-a956-a109d6d653c1\") " pod="openshift-insights/insights-runtime-extractor-fwc77"
Oct 30 19:47:42.540973 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:42.540958    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jvx29\" (UniqueName: \"kubernetes.io/projected/45a7e195-0bbf-46cb-b821-30728122c3fc-kube-api-access-jvx29\") pod \"ingress-canary-r6bht\" (UID: \"45a7e195-0bbf-46cb-b821-30728122c3fc\") " pod="openshift-ingress-canary/ingress-canary-r6bht"
Oct 30 19:47:42.541188 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:42.540989    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5a23369d-e69d-40e0-a956-a109d6d653c1-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-fwc77\" (UID: \"5a23369d-e69d-40e0-a956-a109d6d653c1\") " pod="openshift-insights/insights-runtime-extractor-fwc77"
Oct 30 19:47:42.541188 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:42.540993    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4d52cf11-23b8-4b48-92ec-009845eea77f-tmp-dir\") pod \"dns-default-kmppx\" (UID: \"4d52cf11-23b8-4b48-92ec-009845eea77f\") " pod="openshift-dns/dns-default-kmppx"
Oct 30 19:47:42.541188 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:42.541015    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5a23369d-e69d-40e0-a956-a109d6d653c1-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fwc77\" (UID: \"5a23369d-e69d-40e0-a956-a109d6d653c1\") " pod="openshift-insights/insights-runtime-extractor-fwc77"
Oct 30 19:47:42.541188 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:42.541043    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/5a23369d-e69d-40e0-a956-a109d6d653c1-crio-socket\") pod \"insights-runtime-extractor-fwc77\" (UID: \"5a23369d-e69d-40e0-a956-a109d6d653c1\") " pod="openshift-insights/insights-runtime-extractor-fwc77"
Oct 30 19:47:42.541188 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:42.541086    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/4d52cf11-23b8-4b48-92ec-009845eea77f-config-volume\") pod \"dns-default-kmppx\" (UID: \"4d52cf11-23b8-4b48-92ec-009845eea77f\") " pod="openshift-dns/dns-default-kmppx"
Oct 30 19:47:42.541390 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:42.541262    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/5a23369d-e69d-40e0-a956-a109d6d653c1-crio-socket\") pod \"insights-runtime-extractor-fwc77\" (UID: \"5a23369d-e69d-40e0-a956-a109d6d653c1\") " pod="openshift-insights/insights-runtime-extractor-fwc77"
Oct 30 19:47:42.541531 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:42.541514    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5a23369d-e69d-40e0-a956-a109d6d653c1-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-fwc77\" (UID: \"5a23369d-e69d-40e0-a956-a109d6d653c1\") " pod="openshift-insights/insights-runtime-extractor-fwc77"
Oct 30 19:47:42.544482 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:42.544463    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5a23369d-e69d-40e0-a956-a109d6d653c1-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fwc77\" (UID: \"5a23369d-e69d-40e0-a956-a109d6d653c1\") " pod="openshift-insights/insights-runtime-extractor-fwc77"
Oct 30 19:47:42.544674 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:42.544654    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4d52cf11-23b8-4b48-92ec-009845eea77f-metrics-tls\") pod \"dns-default-kmppx\" (UID: \"4d52cf11-23b8-4b48-92ec-009845eea77f\") " pod="openshift-dns/dns-default-kmppx"
Oct 30 19:47:42.544784 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:42.544769    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/45a7e195-0bbf-46cb-b821-30728122c3fc-cert\") pod \"ingress-canary-r6bht\" (UID: \"45a7e195-0bbf-46cb-b821-30728122c3fc\") " pod="openshift-ingress-canary/ingress-canary-r6bht"
Oct 30 19:47:42.567218 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:42.567189    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rmn47\" (UniqueName: \"kubernetes.io/projected/4d52cf11-23b8-4b48-92ec-009845eea77f-kube-api-access-rmn47\") pod \"dns-default-kmppx\" (UID: \"4d52cf11-23b8-4b48-92ec-009845eea77f\") " pod="openshift-dns/dns-default-kmppx"
Oct 30 19:47:42.567717 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:42.567478    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-plsvs\" (UniqueName: \"kubernetes.io/projected/5a23369d-e69d-40e0-a956-a109d6d653c1-kube-api-access-plsvs\") pod \"insights-runtime-extractor-fwc77\" (UID: \"5a23369d-e69d-40e0-a956-a109d6d653c1\") " pod="openshift-insights/insights-runtime-extractor-fwc77"
Oct 30 19:47:42.567717 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:42.567524    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jvx29\" (UniqueName: \"kubernetes.io/projected/45a7e195-0bbf-46cb-b821-30728122c3fc-kube-api-access-jvx29\") pod \"ingress-canary-r6bht\" (UID: \"45a7e195-0bbf-46cb-b821-30728122c3fc\") " pod="openshift-ingress-canary/ingress-canary-r6bht"
Oct 30 19:47:42.640039 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:42.639988    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-r6bht"
Oct 30 19:47:42.646351 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:42.646335    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-kmppx"
Oct 30 19:47:42.656183 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:42.656158    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-fwc77"
Oct 30 19:47:42.979524 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:42.979451    2582 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-r6bht"]
Oct 30 19:47:42.981135 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:42.981096    2582 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-kmppx"]
Oct 30 19:47:42.981268 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:42.981164    2582 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-fwc77"]
Oct 30 19:47:42.986519 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:47:42.986488    2582 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d52cf11_23b8_4b48_92ec_009845eea77f.slice/crio-ecd718a1716e1db2862ec587b63e49896ea841b131d4ee2e535d7989dcdf99dc WatchSource:0}: Error finding container ecd718a1716e1db2862ec587b63e49896ea841b131d4ee2e535d7989dcdf99dc: Status 404 returned error can't find the container with id ecd718a1716e1db2862ec587b63e49896ea841b131d4ee2e535d7989dcdf99dc
Oct 30 19:47:42.986709 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:47:42.986693    2582 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod45a7e195_0bbf_46cb_b821_30728122c3fc.slice/crio-4bd6740c4b3c983baf7993ac113f19f2c0659e6ef20b3daaf63c87d7190dee56 WatchSource:0}: Error finding container 4bd6740c4b3c983baf7993ac113f19f2c0659e6ef20b3daaf63c87d7190dee56: Status 404 returned error can't find the container with id 4bd6740c4b3c983baf7993ac113f19f2c0659e6ef20b3daaf63c87d7190dee56
Oct 30 19:47:42.987186 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:47:42.987168    2582 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5a23369d_e69d_40e0_a956_a109d6d653c1.slice/crio-b07a99877d65e3d23e9c7c394189c2b53522da922b3f237f3c29395698d1e1b9 WatchSource:0}: Error finding container b07a99877d65e3d23e9c7c394189c2b53522da922b3f237f3c29395698d1e1b9: Status 404 returned error can't find the container with id b07a99877d65e3d23e9c7c394189c2b53522da922b3f237f3c29395698d1e1b9
Oct 30 19:47:43.566537 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:43.566506    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b27jd"
Oct 30 19:47:43.566537 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:43.566526    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hkjcv"
Oct 30 19:47:43.567192 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:43.567146    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-96mhd"
Oct 30 19:47:43.600585 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:43.600556    2582 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-2gzs4\""
Oct 30 19:47:43.601131 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:43.600609    2582 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"global-pull-secret-syncer-dockercfg-wnngx\""
Oct 30 19:47:43.601131 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:43.600619    2582 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Oct 30 19:47:43.601131 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:43.600806    2582 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Oct 30 19:47:43.601131 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:43.600939    2582 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-check-target-dockercfg-mbspd\""
Oct 30 19:47:43.601131 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:43.601103    2582 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Oct 30 19:47:43.601131 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:43.601116    2582 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Oct 30 19:47:43.838526 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:43.838448    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-krr87_34dfa231-fa1a-400c-82b4-6ee85859d7c4/dns-node-resolver/0.log"
Oct 30 19:47:43.869693 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:43.869662    2582 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-r6bht" event={"ID":"45a7e195-0bbf-46cb-b821-30728122c3fc","Type":"ContainerStarted","Data":"4bd6740c4b3c983baf7993ac113f19f2c0659e6ef20b3daaf63c87d7190dee56"}
Oct 30 19:47:43.872055 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:43.872023    2582 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-fwc77" event={"ID":"5a23369d-e69d-40e0-a956-a109d6d653c1","Type":"ContainerStarted","Data":"2aed22f8b2a5e4b7f6881c5a9ed571dd5460162afbd244d293fe633f277796b5"}
Oct 30 19:47:43.872205 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:43.872075    2582 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-fwc77" event={"ID":"5a23369d-e69d-40e0-a956-a109d6d653c1","Type":"ContainerStarted","Data":"9b5da6f35064a33c9751cacb2adf88b195a65cbd50684f0eb50fbc4b456dbdfa"}
Oct 30 19:47:43.872205 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:43.872105    2582 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-fwc77" event={"ID":"5a23369d-e69d-40e0-a956-a109d6d653c1","Type":"ContainerStarted","Data":"b07a99877d65e3d23e9c7c394189c2b53522da922b3f237f3c29395698d1e1b9"}
Oct 30 19:47:43.873696 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:43.873671    2582 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-kmppx" event={"ID":"4d52cf11-23b8-4b48-92ec-009845eea77f","Type":"ContainerStarted","Data":"ecd718a1716e1db2862ec587b63e49896ea841b131d4ee2e535d7989dcdf99dc"}
Oct 30 19:47:44.877991 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:44.877950    2582 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-kmppx" event={"ID":"4d52cf11-23b8-4b48-92ec-009845eea77f","Type":"ContainerStarted","Data":"827022d65042e68d520712e971a4a1d8cb2f70cd3a86526809048d139fb0e3a2"}
Oct 30 19:47:45.038229 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:45.038201    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-2swph_423e0100-284b-48b9-bd4c-3b74005976d2/node-ca/0.log"
Oct 30 19:47:45.767854 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:45.767696    2582 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-7bd7489957-bxr6q"]
Oct 30 19:47:45.769865 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:45.769845    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-7bd7489957-bxr6q"
Oct 30 19:47:45.787387 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:45.787366    2582 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Oct 30 19:47:45.787512 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:45.787487    2582 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Oct 30 19:47:45.798918 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:45.798887    2582 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-nfj6g\""
Oct 30 19:47:45.798918 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:45.798906    2582 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Oct 30 19:47:45.799067 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:45.799047    2582 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Oct 30 19:47:45.799142 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:45.799118    2582 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Oct 30 19:47:45.800629 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:45.800609    2582 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-7bd7489957-bxr6q"]
Oct 30 19:47:45.822731 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:45.822711    2582 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-lvg9n"]
Oct 30 19:47:45.824673 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:45.824657    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-lvg9n"
Oct 30 19:47:45.867654 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:45.867630    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w27xp\" (UniqueName: \"kubernetes.io/projected/20819707-689f-4b17-8762-802fd5152c71-kube-api-access-w27xp\") pod \"openshift-state-metrics-7bd7489957-bxr6q\" (UID: \"20819707-689f-4b17-8762-802fd5152c71\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-bxr6q"
Oct 30 19:47:45.867759 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:45.867741    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/20819707-689f-4b17-8762-802fd5152c71-metrics-client-ca\") pod \"openshift-state-metrics-7bd7489957-bxr6q\" (UID: \"20819707-689f-4b17-8762-802fd5152c71\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-bxr6q"
Oct 30 19:47:45.867808 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:45.867794    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/20819707-689f-4b17-8762-802fd5152c71-openshift-state-metrics-tls\") pod \"openshift-state-metrics-7bd7489957-bxr6q\" (UID: \"20819707-689f-4b17-8762-802fd5152c71\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-bxr6q"
Oct 30 19:47:45.867845 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:45.867820    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/20819707-689f-4b17-8762-802fd5152c71-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-7bd7489957-bxr6q\" (UID: \"20819707-689f-4b17-8762-802fd5152c71\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-bxr6q"
Oct 30 19:47:45.882564 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:45.882512    2582 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-fwc77" event={"ID":"5a23369d-e69d-40e0-a956-a109d6d653c1","Type":"ContainerStarted","Data":"dc972ebb5e216a5729d25ad381a0600cb4604d045d0a61220efd456780abc26e"}
Oct 30 19:47:45.884294 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:45.884272    2582 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-kmppx" event={"ID":"4d52cf11-23b8-4b48-92ec-009845eea77f","Type":"ContainerStarted","Data":"4a2a6fd2985a227e386d963ee9f8820bf8c3cc305e7d0b0af26e48d01ded632c"}
Oct 30 19:47:45.884365 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:45.884320    2582 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-kmppx"
Oct 30 19:47:45.885835 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:45.885804    2582 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-r6bht" event={"ID":"45a7e195-0bbf-46cb-b821-30728122c3fc","Type":"ContainerStarted","Data":"34e2fb36318ebe7ade0b60be17ceb0b5f104ac22b040f1c947e6e15af287de7b"}
Oct 30 19:47:45.889361 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:45.888212    2582 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Oct 30 19:47:45.889913 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:45.889896    2582 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Oct 30 19:47:45.890335 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:45.890315    2582 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Oct 30 19:47:45.891003 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:45.890988    2582 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-67dw4\""
Oct 30 19:47:45.929219 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:45.929182    2582 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-fwc77" podStartSLOduration=1.8653149089999999 podStartE2EDuration="3.929171845s" totalImagesPullingTime="2.063856936s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 19:47:42 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 19:47:45.927887582 +0000 UTC m=+47.984462414" watchObservedRunningTime="2026-10-30 19:47:45.929171845 +0000 UTC m=+47.985746678"
Oct 30 19:47:45.934431 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:45.934398    2582 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-5dc8d7d89b-zvm7p"]
Oct 30 19:47:45.936334 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:45.936315    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-zvm7p"
Oct 30 19:47:45.968401 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:45.968374    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/dde165c4-1ada-4fd6-af53-32fd75286c79-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-lvg9n\" (UID: \"dde165c4-1ada-4fd6-af53-32fd75286c79\") " pod="openshift-monitoring/node-exporter-lvg9n"
Oct 30 19:47:45.968517 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:45.968487    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w27xp\" (UniqueName: \"kubernetes.io/projected/20819707-689f-4b17-8762-802fd5152c71-kube-api-access-w27xp\") pod \"openshift-state-metrics-7bd7489957-bxr6q\" (UID: \"20819707-689f-4b17-8762-802fd5152c71\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-bxr6q"
Oct 30 19:47:45.968575 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:45.968540    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/dde165c4-1ada-4fd6-af53-32fd75286c79-sys\") pod \"node-exporter-lvg9n\" (UID: \"dde165c4-1ada-4fd6-af53-32fd75286c79\") " pod="openshift-monitoring/node-exporter-lvg9n"
Oct 30 19:47:45.968629 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:45.968606    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/dde165c4-1ada-4fd6-af53-32fd75286c79-node-exporter-textfile\") pod \"node-exporter-lvg9n\" (UID: \"dde165c4-1ada-4fd6-af53-32fd75286c79\") " pod="openshift-monitoring/node-exporter-lvg9n"
Oct 30 19:47:45.968728 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:45.968707    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/dde165c4-1ada-4fd6-af53-32fd75286c79-node-exporter-wtmp\") pod \"node-exporter-lvg9n\" (UID: \"dde165c4-1ada-4fd6-af53-32fd75286c79\") " pod="openshift-monitoring/node-exporter-lvg9n"
Oct 30 19:47:45.968781 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:45.968739    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dde165c4-1ada-4fd6-af53-32fd75286c79-metrics-client-ca\") pod \"node-exporter-lvg9n\" (UID: \"dde165c4-1ada-4fd6-af53-32fd75286c79\") " pod="openshift-monitoring/node-exporter-lvg9n"
Oct 30 19:47:45.968781 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:45.968766    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/dde165c4-1ada-4fd6-af53-32fd75286c79-node-exporter-accelerators-collector-config\") pod \"node-exporter-lvg9n\" (UID: \"dde165c4-1ada-4fd6-af53-32fd75286c79\") " pod="openshift-monitoring/node-exporter-lvg9n"
Oct 30 19:47:45.969148 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:45.969128    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/20819707-689f-4b17-8762-802fd5152c71-metrics-client-ca\") pod \"openshift-state-metrics-7bd7489957-bxr6q\" (UID: \"20819707-689f-4b17-8762-802fd5152c71\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-bxr6q"
Oct 30 19:47:45.969256 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:45.969176    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/20819707-689f-4b17-8762-802fd5152c71-openshift-state-metrics-tls\") pod \"openshift-state-metrics-7bd7489957-bxr6q\" (UID: \"20819707-689f-4b17-8762-802fd5152c71\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-bxr6q"
Oct 30 19:47:45.969256 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:45.969206    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/dde165c4-1ada-4fd6-af53-32fd75286c79-root\") pod \"node-exporter-lvg9n\" (UID: \"dde165c4-1ada-4fd6-af53-32fd75286c79\") " pod="openshift-monitoring/node-exporter-lvg9n"
Oct 30 19:47:45.969256 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:45.969232    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-879bk\" (UniqueName: \"kubernetes.io/projected/dde165c4-1ada-4fd6-af53-32fd75286c79-kube-api-access-879bk\") pod \"node-exporter-lvg9n\" (UID: \"dde165c4-1ada-4fd6-af53-32fd75286c79\") " pod="openshift-monitoring/node-exporter-lvg9n"
Oct 30 19:47:45.969354 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:45.969296    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/20819707-689f-4b17-8762-802fd5152c71-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-7bd7489957-bxr6q\" (UID: \"20819707-689f-4b17-8762-802fd5152c71\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-bxr6q"
Oct 30 19:47:45.969354 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:45.969327    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/dde165c4-1ada-4fd6-af53-32fd75286c79-node-exporter-tls\") pod \"node-exporter-lvg9n\" (UID: \"dde165c4-1ada-4fd6-af53-32fd75286c79\") " pod="openshift-monitoring/node-exporter-lvg9n"
Oct 30 19:47:45.969839 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:45.969824    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/20819707-689f-4b17-8762-802fd5152c71-metrics-client-ca\") pod \"openshift-state-metrics-7bd7489957-bxr6q\" (UID: \"20819707-689f-4b17-8762-802fd5152c71\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-bxr6q"
Oct 30 19:47:45.971785 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:45.971769    2582 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Oct 30 19:47:45.971876 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:45.971772    2582 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Oct 30 19:47:45.971960 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:45.971942    2582 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-4vm82\""
Oct 30 19:47:45.972961 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:45.972939    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/20819707-689f-4b17-8762-802fd5152c71-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-7bd7489957-bxr6q\" (UID: \"20819707-689f-4b17-8762-802fd5152c71\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-bxr6q"
Oct 30 19:47:45.973076 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:45.973051    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/20819707-689f-4b17-8762-802fd5152c71-openshift-state-metrics-tls\") pod \"openshift-state-metrics-7bd7489957-bxr6q\" (UID: \"20819707-689f-4b17-8762-802fd5152c71\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-bxr6q"
Oct 30 19:47:45.973159 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:45.972965    2582 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-5dc8d7d89b-zvm7p"]
Oct 30 19:47:46.002368 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:46.002340    2582 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Oct 30 19:47:46.005382 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:46.005363    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w27xp\" (UniqueName: \"kubernetes.io/projected/20819707-689f-4b17-8762-802fd5152c71-kube-api-access-w27xp\") pod \"openshift-state-metrics-7bd7489957-bxr6q\" (UID: \"20819707-689f-4b17-8762-802fd5152c71\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-bxr6q"
Oct 30 19:47:46.054070 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:46.054029    2582 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-r6bht" podStartSLOduration=1.411983461 podStartE2EDuration="4.054017595s" totalImagesPullingTime="2.642034134s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 19:47:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 19:47:46.002109999 +0000 UTC m=+48.058684834" watchObservedRunningTime="2026-10-30 19:47:46.054017595 +0000 UTC m=+48.110592425"
Oct 30 19:47:46.054275 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:46.054255    2582 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-dns/dns-default-kmppx" podStartSLOduration=2.311960325 podStartE2EDuration="4.054248658s" totalImagesPullingTime="1.742288333s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 19:47:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 19:47:46.05314916 +0000 UTC m=+48.109723994" watchObservedRunningTime="2026-10-30 19:47:46.054248658 +0000 UTC m=+48.110823493"
Oct 30 19:47:46.069600 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:46.069574    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2a71410e-a1ce-479e-a9ea-261a4e41f6e3-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-5dc8d7d89b-zvm7p\" (UID: \"2a71410e-a1ce-479e-a9ea-261a4e41f6e3\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-zvm7p"
Oct 30 19:47:46.069697 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:46.069611    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dde165c4-1ada-4fd6-af53-32fd75286c79-metrics-client-ca\") pod \"node-exporter-lvg9n\" (UID: \"dde165c4-1ada-4fd6-af53-32fd75286c79\") " pod="openshift-monitoring/node-exporter-lvg9n"
Oct 30 19:47:46.069697 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:46.069636    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/2a71410e-a1ce-479e-a9ea-261a4e41f6e3-kube-state-metrics-tls\") pod \"kube-state-metrics-5dc8d7d89b-zvm7p\" (UID: \"2a71410e-a1ce-479e-a9ea-261a4e41f6e3\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-zvm7p"
Oct 30 19:47:46.069697 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:46.069653    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/dde165c4-1ada-4fd6-af53-32fd75286c79-node-exporter-textfile\") pod \"node-exporter-lvg9n\" (UID: \"dde165c4-1ada-4fd6-af53-32fd75286c79\") " pod="openshift-monitoring/node-exporter-lvg9n"
Oct 30 19:47:46.069792 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:46.069774    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/dde165c4-1ada-4fd6-af53-32fd75286c79-node-exporter-accelerators-collector-config\") pod \"node-exporter-lvg9n\" (UID: \"dde165c4-1ada-4fd6-af53-32fd75286c79\") " pod="openshift-monitoring/node-exporter-lvg9n"
Oct 30 19:47:46.069881 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:46.069861    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-879bk\" (UniqueName: \"kubernetes.io/projected/dde165c4-1ada-4fd6-af53-32fd75286c79-kube-api-access-879bk\") pod \"node-exporter-lvg9n\" (UID: \"dde165c4-1ada-4fd6-af53-32fd75286c79\") " pod="openshift-monitoring/node-exporter-lvg9n"
Oct 30 19:47:46.069914 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:46.069885    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/dde165c4-1ada-4fd6-af53-32fd75286c79-node-exporter-textfile\") pod \"node-exporter-lvg9n\" (UID: \"dde165c4-1ada-4fd6-af53-32fd75286c79\") " pod="openshift-monitoring/node-exporter-lvg9n"
Oct 30 19:47:46.069914 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:46.069894    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/dde165c4-1ada-4fd6-af53-32fd75286c79-node-exporter-tls\") pod \"node-exporter-lvg9n\" (UID: \"dde165c4-1ada-4fd6-af53-32fd75286c79\") " pod="openshift-monitoring/node-exporter-lvg9n"
Oct 30 19:47:46.069973 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:46.069924    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/dde165c4-1ada-4fd6-af53-32fd75286c79-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-lvg9n\" (UID: \"dde165c4-1ada-4fd6-af53-32fd75286c79\") " pod="openshift-monitoring/node-exporter-lvg9n"
Oct 30 19:47:46.070018 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:46.069972    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x2lwt\" (UniqueName: \"kubernetes.io/projected/2a71410e-a1ce-479e-a9ea-261a4e41f6e3-kube-api-access-x2lwt\") pod \"kube-state-metrics-5dc8d7d89b-zvm7p\" (UID: \"2a71410e-a1ce-479e-a9ea-261a4e41f6e3\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-zvm7p"
Oct 30 19:47:46.070018 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:46.070010    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/dde165c4-1ada-4fd6-af53-32fd75286c79-sys\") pod \"node-exporter-lvg9n\" (UID: \"dde165c4-1ada-4fd6-af53-32fd75286c79\") " pod="openshift-monitoring/node-exporter-lvg9n"
Oct 30 19:47:46.070110 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:46.070053    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/2a71410e-a1ce-479e-a9ea-261a4e41f6e3-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-5dc8d7d89b-zvm7p\" (UID: \"2a71410e-a1ce-479e-a9ea-261a4e41f6e3\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-zvm7p"
Oct 30 19:47:46.070163 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:46.070132    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/dde165c4-1ada-4fd6-af53-32fd75286c79-node-exporter-wtmp\") pod \"node-exporter-lvg9n\" (UID: \"dde165c4-1ada-4fd6-af53-32fd75286c79\") " pod="openshift-monitoring/node-exporter-lvg9n"
Oct 30 19:47:46.070218 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:46.070154    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/dde165c4-1ada-4fd6-af53-32fd75286c79-sys\") pod \"node-exporter-lvg9n\" (UID: \"dde165c4-1ada-4fd6-af53-32fd75286c79\") " pod="openshift-monitoring/node-exporter-lvg9n"
Oct 30 19:47:46.070218 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:46.070183    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/dde165c4-1ada-4fd6-af53-32fd75286c79-root\") pod \"node-exporter-lvg9n\" (UID: \"dde165c4-1ada-4fd6-af53-32fd75286c79\") " pod="openshift-monitoring/node-exporter-lvg9n"
Oct 30 19:47:46.070218 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:46.070209    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/2a71410e-a1ce-479e-a9ea-261a4e41f6e3-volume-directive-shadow\") pod \"kube-state-metrics-5dc8d7d89b-zvm7p\" (UID: \"2a71410e-a1ce-479e-a9ea-261a4e41f6e3\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-zvm7p"
Oct 30 19:47:46.070358 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:46.070245    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2a71410e-a1ce-479e-a9ea-261a4e41f6e3-metrics-client-ca\") pod \"kube-state-metrics-5dc8d7d89b-zvm7p\" (UID: \"2a71410e-a1ce-479e-a9ea-261a4e41f6e3\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-zvm7p"
Oct 30 19:47:46.070358 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:46.070251    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/dde165c4-1ada-4fd6-af53-32fd75286c79-root\") pod \"node-exporter-lvg9n\" (UID: \"dde165c4-1ada-4fd6-af53-32fd75286c79\") " pod="openshift-monitoring/node-exporter-lvg9n"
Oct 30 19:47:46.070358 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:46.070283    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/dde165c4-1ada-4fd6-af53-32fd75286c79-node-exporter-wtmp\") pod \"node-exporter-lvg9n\" (UID: \"dde165c4-1ada-4fd6-af53-32fd75286c79\") " pod="openshift-monitoring/node-exporter-lvg9n"
Oct 30 19:47:46.070358 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:46.070287    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/dde165c4-1ada-4fd6-af53-32fd75286c79-node-exporter-accelerators-collector-config\") pod \"node-exporter-lvg9n\" (UID: \"dde165c4-1ada-4fd6-af53-32fd75286c79\") " pod="openshift-monitoring/node-exporter-lvg9n"
Oct 30 19:47:46.070358 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:46.070296    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dde165c4-1ada-4fd6-af53-32fd75286c79-metrics-client-ca\") pod \"node-exporter-lvg9n\" (UID: \"dde165c4-1ada-4fd6-af53-32fd75286c79\") " pod="openshift-monitoring/node-exporter-lvg9n"
Oct 30 19:47:46.071997 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:46.071977    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/dde165c4-1ada-4fd6-af53-32fd75286c79-node-exporter-tls\") pod \"node-exporter-lvg9n\" (UID: \"dde165c4-1ada-4fd6-af53-32fd75286c79\") " pod="openshift-monitoring/node-exporter-lvg9n"
Oct 30 19:47:46.072065 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:46.072045    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/dde165c4-1ada-4fd6-af53-32fd75286c79-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-lvg9n\" (UID: \"dde165c4-1ada-4fd6-af53-32fd75286c79\") " pod="openshift-monitoring/node-exporter-lvg9n"
Oct 30 19:47:46.082957 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:46.082941    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-7bd7489957-bxr6q"
Oct 30 19:47:46.102285 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:46.102267    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-879bk\" (UniqueName: \"kubernetes.io/projected/dde165c4-1ada-4fd6-af53-32fd75286c79-kube-api-access-879bk\") pod \"node-exporter-lvg9n\" (UID: \"dde165c4-1ada-4fd6-af53-32fd75286c79\") " pod="openshift-monitoring/node-exporter-lvg9n"
Oct 30 19:47:46.136727 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:46.136671    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-lvg9n"
Oct 30 19:47:46.171043 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:46.171020    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2a71410e-a1ce-479e-a9ea-261a4e41f6e3-metrics-client-ca\") pod \"kube-state-metrics-5dc8d7d89b-zvm7p\" (UID: \"2a71410e-a1ce-479e-a9ea-261a4e41f6e3\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-zvm7p"
Oct 30 19:47:46.171165 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:46.171052    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2a71410e-a1ce-479e-a9ea-261a4e41f6e3-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-5dc8d7d89b-zvm7p\" (UID: \"2a71410e-a1ce-479e-a9ea-261a4e41f6e3\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-zvm7p"
Oct 30 19:47:46.171165 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:46.171084    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/2a71410e-a1ce-479e-a9ea-261a4e41f6e3-kube-state-metrics-tls\") pod \"kube-state-metrics-5dc8d7d89b-zvm7p\" (UID: \"2a71410e-a1ce-479e-a9ea-261a4e41f6e3\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-zvm7p"
Oct 30 19:47:46.171165 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:46.171114    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x2lwt\" (UniqueName: \"kubernetes.io/projected/2a71410e-a1ce-479e-a9ea-261a4e41f6e3-kube-api-access-x2lwt\") pod \"kube-state-metrics-5dc8d7d89b-zvm7p\" (UID: \"2a71410e-a1ce-479e-a9ea-261a4e41f6e3\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-zvm7p"
Oct 30 19:47:46.171165 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:46.171145    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/2a71410e-a1ce-479e-a9ea-261a4e41f6e3-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-5dc8d7d89b-zvm7p\" (UID: \"2a71410e-a1ce-479e-a9ea-261a4e41f6e3\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-zvm7p"
Oct 30 19:47:46.171370 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:46.171170    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/2a71410e-a1ce-479e-a9ea-261a4e41f6e3-volume-directive-shadow\") pod \"kube-state-metrics-5dc8d7d89b-zvm7p\" (UID: \"2a71410e-a1ce-479e-a9ea-261a4e41f6e3\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-zvm7p"
Oct 30 19:47:46.171561 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:46.171516    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/2a71410e-a1ce-479e-a9ea-261a4e41f6e3-volume-directive-shadow\") pod \"kube-state-metrics-5dc8d7d89b-zvm7p\" (UID: \"2a71410e-a1ce-479e-a9ea-261a4e41f6e3\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-zvm7p"
Oct 30 19:47:46.171863 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:46.171834    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2a71410e-a1ce-479e-a9ea-261a4e41f6e3-metrics-client-ca\") pod \"kube-state-metrics-5dc8d7d89b-zvm7p\" (UID: \"2a71410e-a1ce-479e-a9ea-261a4e41f6e3\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-zvm7p"
Oct 30 19:47:46.172162 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:46.172129    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/2a71410e-a1ce-479e-a9ea-261a4e41f6e3-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-5dc8d7d89b-zvm7p\" (UID: \"2a71410e-a1ce-479e-a9ea-261a4e41f6e3\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-zvm7p"
Oct 30 19:47:46.173701 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:46.173678    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2a71410e-a1ce-479e-a9ea-261a4e41f6e3-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-5dc8d7d89b-zvm7p\" (UID: \"2a71410e-a1ce-479e-a9ea-261a4e41f6e3\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-zvm7p"
Oct 30 19:47:46.173787 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:46.173729    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/2a71410e-a1ce-479e-a9ea-261a4e41f6e3-kube-state-metrics-tls\") pod \"kube-state-metrics-5dc8d7d89b-zvm7p\" (UID: \"2a71410e-a1ce-479e-a9ea-261a4e41f6e3\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-zvm7p"
Oct 30 19:47:46.195603 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:46.195577    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x2lwt\" (UniqueName: \"kubernetes.io/projected/2a71410e-a1ce-479e-a9ea-261a4e41f6e3-kube-api-access-x2lwt\") pod \"kube-state-metrics-5dc8d7d89b-zvm7p\" (UID: \"2a71410e-a1ce-479e-a9ea-261a4e41f6e3\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-zvm7p"
Oct 30 19:47:46.248502 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:46.248484    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-zvm7p"
Oct 30 19:47:46.394954 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:46.394701    2582 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-7bd7489957-bxr6q"]
Oct 30 19:47:46.399689 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:47:46.399666    2582 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod20819707_689f_4b17_8762_802fd5152c71.slice/crio-2105619691f7a9f0fb7172d3443de0333e4696cef6b4ef4715185f6820c93fc6 WatchSource:0}: Error finding container 2105619691f7a9f0fb7172d3443de0333e4696cef6b4ef4715185f6820c93fc6: Status 404 returned error can't find the container with id 2105619691f7a9f0fb7172d3443de0333e4696cef6b4ef4715185f6820c93fc6
Oct 30 19:47:46.551033 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:46.551004    2582 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-5dc8d7d89b-zvm7p"]
Oct 30 19:47:46.555137 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:47:46.555096    2582 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2a71410e_a1ce_479e_a9ea_261a4e41f6e3.slice/crio-5e62c1b378371730d47613f8c72078e49fc9fc9ba81df083635f257ea6984719 WatchSource:0}: Error finding container 5e62c1b378371730d47613f8c72078e49fc9fc9ba81df083635f257ea6984719: Status 404 returned error can't find the container with id 5e62c1b378371730d47613f8c72078e49fc9fc9ba81df083635f257ea6984719
Oct 30 19:47:46.891634 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:46.891594    2582 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-7bd7489957-bxr6q" event={"ID":"20819707-689f-4b17-8762-802fd5152c71","Type":"ContainerStarted","Data":"2c0e76975d444b7c38ea0c2656bdbe5fbbb55e57a0c89e1ec59f1509342daf4e"}
Oct 30 19:47:46.892641 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:46.891667    2582 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-7bd7489957-bxr6q" event={"ID":"20819707-689f-4b17-8762-802fd5152c71","Type":"ContainerStarted","Data":"c7d3678382be8563506e3e490f46effbd87f2b3f8ed1067e2c70b58a6aad74ef"}
Oct 30 19:47:46.892641 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:46.891694    2582 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-7bd7489957-bxr6q" event={"ID":"20819707-689f-4b17-8762-802fd5152c71","Type":"ContainerStarted","Data":"2105619691f7a9f0fb7172d3443de0333e4696cef6b4ef4715185f6820c93fc6"}
Oct 30 19:47:46.893251 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:46.893218    2582 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-zvm7p" event={"ID":"2a71410e-a1ce-479e-a9ea-261a4e41f6e3","Type":"ContainerStarted","Data":"5e62c1b378371730d47613f8c72078e49fc9fc9ba81df083635f257ea6984719"}
Oct 30 19:47:46.894796 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:46.894773    2582 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-lvg9n" event={"ID":"dde165c4-1ada-4fd6-af53-32fd75286c79","Type":"ContainerStarted","Data":"ff00162e6d55d62823b7a9c310a3addac8bd4567665c1ecfda4330e1319d2c5a"}
Oct 30 19:47:47.899487 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:47.899452    2582 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-7bd7489957-bxr6q" event={"ID":"20819707-689f-4b17-8762-802fd5152c71","Type":"ContainerStarted","Data":"e527a5b242ad8922b161886e4ac4d33fe68f2e3eba3956a0406216117b297603"}
Oct 30 19:47:47.901536 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:47.901501    2582 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-zvm7p" event={"ID":"2a71410e-a1ce-479e-a9ea-261a4e41f6e3","Type":"ContainerStarted","Data":"4ced362ca5f5e7a9c833418f23a5d30e5b37a87cc2658914c21acd4e8a86ea71"}
Oct 30 19:47:47.901642 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:47.901553    2582 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-zvm7p" event={"ID":"2a71410e-a1ce-479e-a9ea-261a4e41f6e3","Type":"ContainerStarted","Data":"04cbf7a3b46de6462da1653233f6b68f1b87875fc520aeef1af6020356fcfb40"}
Oct 30 19:47:47.901642 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:47.901586    2582 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-zvm7p" event={"ID":"2a71410e-a1ce-479e-a9ea-261a4e41f6e3","Type":"ContainerStarted","Data":"18cc39278fb2edc44798b6809718260d0e2c4003ebfe9adefca7729a9bddbdcf"}
Oct 30 19:47:47.904515 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:47.904441    2582 generic.go:356] "Generic (PLEG): container finished" podID="dde165c4-1ada-4fd6-af53-32fd75286c79" containerID="27ad82f16053875dd9b21a523e3c4fc3615cfc87f11bf6cfb91a0f9f6e6fcdc1" exitCode=0
Oct 30 19:47:47.904515 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:47.904478    2582 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-lvg9n" event={"ID":"dde165c4-1ada-4fd6-af53-32fd75286c79","Type":"ContainerDied","Data":"27ad82f16053875dd9b21a523e3c4fc3615cfc87f11bf6cfb91a0f9f6e6fcdc1"}
Oct 30 19:47:47.949406 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:47.949346    2582 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-7bd7489957-bxr6q" podStartSLOduration=2.027814084 podStartE2EDuration="2.949333089s" totalImagesPullingTime="921.519005ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 19:47:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 19:47:47.949050153 +0000 UTC m=+50.005624986" watchObservedRunningTime="2026-10-30 19:47:47.949333089 +0000 UTC m=+50.005907922"
Oct 30 19:47:48.008838 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:48.008669    2582 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-zvm7p" podStartSLOduration=1.885382251 podStartE2EDuration="3.008652062s" totalImagesPullingTime="1.123269811s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 19:47:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 19:47:48.007868036 +0000 UTC m=+50.064442869" watchObservedRunningTime="2026-10-30 19:47:48.008652062 +0000 UTC m=+50.065226895"
Oct 30 19:47:48.168975 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:48.168942    2582 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-5f8f546c56-w96tg"]
Oct 30 19:47:48.171244 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:48.171225    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-5f8f546c56-w96tg"
Oct 30 19:47:48.194028 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:48.193961    2582 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-g4l62\""
Oct 30 19:47:48.194028 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:48.193969    2582 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Oct 30 19:47:48.194028 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:48.193995    2582 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Oct 30 19:47:48.194176 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:48.194030    2582 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Oct 30 19:47:48.194176 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:48.194049    2582 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-2cj12u7vj8snv\""
Oct 30 19:47:48.195689 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:48.195676    2582 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Oct 30 19:47:48.195816 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:48.195799    2582 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Oct 30 19:47:48.207403 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:48.207382    2582 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-5f8f546c56-w96tg"]
Oct 30 19:47:48.287301 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:48.287269    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6b02f882-10f6-47c4-84a0-8c07533bbb7d-tmp\") pod \"thanos-querier-5f8f546c56-w96tg\" (UID: \"6b02f882-10f6-47c4-84a0-8c07533bbb7d\") " pod="openshift-monitoring/thanos-querier-5f8f546c56-w96tg"
Oct 30 19:47:48.287301 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:48.287308    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/6b02f882-10f6-47c4-84a0-8c07533bbb7d-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5f8f546c56-w96tg\" (UID: \"6b02f882-10f6-47c4-84a0-8c07533bbb7d\") " pod="openshift-monitoring/thanos-querier-5f8f546c56-w96tg"
Oct 30 19:47:48.287574 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:48.287331    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6b02f882-10f6-47c4-84a0-8c07533bbb7d-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5f8f546c56-w96tg\" (UID: \"6b02f882-10f6-47c4-84a0-8c07533bbb7d\") " pod="openshift-monitoring/thanos-querier-5f8f546c56-w96tg"
Oct 30 19:47:48.287574 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:48.287362    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/6b02f882-10f6-47c4-84a0-8c07533bbb7d-secret-grpc-tls\") pod \"thanos-querier-5f8f546c56-w96tg\" (UID: \"6b02f882-10f6-47c4-84a0-8c07533bbb7d\") " pod="openshift-monitoring/thanos-querier-5f8f546c56-w96tg"
Oct 30 19:47:48.287574 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:48.287480    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6b02f882-10f6-47c4-84a0-8c07533bbb7d-metrics-client-ca\") pod \"thanos-querier-5f8f546c56-w96tg\" (UID: \"6b02f882-10f6-47c4-84a0-8c07533bbb7d\") " pod="openshift-monitoring/thanos-querier-5f8f546c56-w96tg"
Oct 30 19:47:48.287712 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:48.287573    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tx724\" (UniqueName: \"kubernetes.io/projected/6b02f882-10f6-47c4-84a0-8c07533bbb7d-kube-api-access-tx724\") pod \"thanos-querier-5f8f546c56-w96tg\" (UID: \"6b02f882-10f6-47c4-84a0-8c07533bbb7d\") " pod="openshift-monitoring/thanos-querier-5f8f546c56-w96tg"
Oct 30 19:47:48.287712 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:48.287628    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6b02f882-10f6-47c4-84a0-8c07533bbb7d-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5f8f546c56-w96tg\" (UID: \"6b02f882-10f6-47c4-84a0-8c07533bbb7d\") " pod="openshift-monitoring/thanos-querier-5f8f546c56-w96tg"
Oct 30 19:47:48.287712 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:48.287687    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/6b02f882-10f6-47c4-84a0-8c07533bbb7d-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5f8f546c56-w96tg\" (UID: \"6b02f882-10f6-47c4-84a0-8c07533bbb7d\") " pod="openshift-monitoring/thanos-querier-5f8f546c56-w96tg"
Oct 30 19:47:48.287802 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:48.287752    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/6b02f882-10f6-47c4-84a0-8c07533bbb7d-secret-thanos-querier-tls\") pod \"thanos-querier-5f8f546c56-w96tg\" (UID: \"6b02f882-10f6-47c4-84a0-8c07533bbb7d\") " pod="openshift-monitoring/thanos-querier-5f8f546c56-w96tg"
Oct 30 19:47:48.388526 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:48.388498    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6b02f882-10f6-47c4-84a0-8c07533bbb7d-tmp\") pod \"thanos-querier-5f8f546c56-w96tg\" (UID: \"6b02f882-10f6-47c4-84a0-8c07533bbb7d\") " pod="openshift-monitoring/thanos-querier-5f8f546c56-w96tg"
Oct 30 19:47:48.388656 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:48.388530    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/6b02f882-10f6-47c4-84a0-8c07533bbb7d-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5f8f546c56-w96tg\" (UID: \"6b02f882-10f6-47c4-84a0-8c07533bbb7d\") " pod="openshift-monitoring/thanos-querier-5f8f546c56-w96tg"
Oct 30 19:47:48.388656 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:48.388554    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6b02f882-10f6-47c4-84a0-8c07533bbb7d-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5f8f546c56-w96tg\" (UID: \"6b02f882-10f6-47c4-84a0-8c07533bbb7d\") " pod="openshift-monitoring/thanos-querier-5f8f546c56-w96tg"
Oct 30 19:47:48.388656 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:48.388583    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/6b02f882-10f6-47c4-84a0-8c07533bbb7d-secret-grpc-tls\") pod \"thanos-querier-5f8f546c56-w96tg\" (UID: \"6b02f882-10f6-47c4-84a0-8c07533bbb7d\") " pod="openshift-monitoring/thanos-querier-5f8f546c56-w96tg"
Oct 30 19:47:48.388656 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:48.388608    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6b02f882-10f6-47c4-84a0-8c07533bbb7d-metrics-client-ca\") pod \"thanos-querier-5f8f546c56-w96tg\" (UID: \"6b02f882-10f6-47c4-84a0-8c07533bbb7d\") " pod="openshift-monitoring/thanos-querier-5f8f546c56-w96tg"
Oct 30 19:47:48.388656 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:48.388651    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tx724\" (UniqueName: \"kubernetes.io/projected/6b02f882-10f6-47c4-84a0-8c07533bbb7d-kube-api-access-tx724\") pod \"thanos-querier-5f8f546c56-w96tg\" (UID: \"6b02f882-10f6-47c4-84a0-8c07533bbb7d\") " pod="openshift-monitoring/thanos-querier-5f8f546c56-w96tg"
Oct 30 19:47:48.388914 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:48.388686    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6b02f882-10f6-47c4-84a0-8c07533bbb7d-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5f8f546c56-w96tg\" (UID: \"6b02f882-10f6-47c4-84a0-8c07533bbb7d\") " pod="openshift-monitoring/thanos-querier-5f8f546c56-w96tg"
Oct 30 19:47:48.388914 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:48.388729    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/6b02f882-10f6-47c4-84a0-8c07533bbb7d-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5f8f546c56-w96tg\" (UID: \"6b02f882-10f6-47c4-84a0-8c07533bbb7d\") " pod="openshift-monitoring/thanos-querier-5f8f546c56-w96tg"
Oct 30 19:47:48.388914 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:48.388872    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/6b02f882-10f6-47c4-84a0-8c07533bbb7d-secret-thanos-querier-tls\") pod \"thanos-querier-5f8f546c56-w96tg\" (UID: \"6b02f882-10f6-47c4-84a0-8c07533bbb7d\") " pod="openshift-monitoring/thanos-querier-5f8f546c56-w96tg"
Oct 30 19:47:48.389039 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:48.388966    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6b02f882-10f6-47c4-84a0-8c07533bbb7d-tmp\") pod \"thanos-querier-5f8f546c56-w96tg\" (UID: \"6b02f882-10f6-47c4-84a0-8c07533bbb7d\") " pod="openshift-monitoring/thanos-querier-5f8f546c56-w96tg"
Oct 30 19:47:48.389452 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:48.389393    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6b02f882-10f6-47c4-84a0-8c07533bbb7d-metrics-client-ca\") pod \"thanos-querier-5f8f546c56-w96tg\" (UID: \"6b02f882-10f6-47c4-84a0-8c07533bbb7d\") " pod="openshift-monitoring/thanos-querier-5f8f546c56-w96tg"
Oct 30 19:47:48.393726 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:48.393698    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6b02f882-10f6-47c4-84a0-8c07533bbb7d-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5f8f546c56-w96tg\" (UID: \"6b02f882-10f6-47c4-84a0-8c07533bbb7d\") " pod="openshift-monitoring/thanos-querier-5f8f546c56-w96tg"
Oct 30 19:47:48.393807 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:48.393752    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/6b02f882-10f6-47c4-84a0-8c07533bbb7d-secret-thanos-querier-tls\") pod \"thanos-querier-5f8f546c56-w96tg\" (UID: \"6b02f882-10f6-47c4-84a0-8c07533bbb7d\") " pod="openshift-monitoring/thanos-querier-5f8f546c56-w96tg"
Oct 30 19:47:48.393807 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:48.393793    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/6b02f882-10f6-47c4-84a0-8c07533bbb7d-secret-grpc-tls\") pod \"thanos-querier-5f8f546c56-w96tg\" (UID: \"6b02f882-10f6-47c4-84a0-8c07533bbb7d\") " pod="openshift-monitoring/thanos-querier-5f8f546c56-w96tg"
Oct 30 19:47:48.393879 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:48.393803    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/6b02f882-10f6-47c4-84a0-8c07533bbb7d-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5f8f546c56-w96tg\" (UID: \"6b02f882-10f6-47c4-84a0-8c07533bbb7d\") " pod="openshift-monitoring/thanos-querier-5f8f546c56-w96tg"
Oct 30 19:47:48.393879 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:48.393847    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6b02f882-10f6-47c4-84a0-8c07533bbb7d-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5f8f546c56-w96tg\" (UID: \"6b02f882-10f6-47c4-84a0-8c07533bbb7d\") " pod="openshift-monitoring/thanos-querier-5f8f546c56-w96tg"
Oct 30 19:47:48.393879 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:48.393857    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/6b02f882-10f6-47c4-84a0-8c07533bbb7d-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5f8f546c56-w96tg\" (UID: \"6b02f882-10f6-47c4-84a0-8c07533bbb7d\") " pod="openshift-monitoring/thanos-querier-5f8f546c56-w96tg"
Oct 30 19:47:48.412967 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:48.412948    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tx724\" (UniqueName: \"kubernetes.io/projected/6b02f882-10f6-47c4-84a0-8c07533bbb7d-kube-api-access-tx724\") pod \"thanos-querier-5f8f546c56-w96tg\" (UID: \"6b02f882-10f6-47c4-84a0-8c07533bbb7d\") " pod="openshift-monitoring/thanos-querier-5f8f546c56-w96tg"
Oct 30 19:47:48.488467 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:48.488440    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-5f8f546c56-w96tg"
Oct 30 19:47:48.813939 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:48.813862    2582 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-5f8f546c56-w96tg"]
Oct 30 19:47:48.818170 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:47:48.818147    2582 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b02f882_10f6_47c4_84a0_8c07533bbb7d.slice/crio-16c973cc9429ce09b3d75aba02e587029e1000442a874babd48302ea6ff644c6 WatchSource:0}: Error finding container 16c973cc9429ce09b3d75aba02e587029e1000442a874babd48302ea6ff644c6: Status 404 returned error can't find the container with id 16c973cc9429ce09b3d75aba02e587029e1000442a874babd48302ea6ff644c6
Oct 30 19:47:48.908703 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:48.908677    2582 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5f8f546c56-w96tg" event={"ID":"6b02f882-10f6-47c4-84a0-8c07533bbb7d","Type":"ContainerStarted","Data":"16c973cc9429ce09b3d75aba02e587029e1000442a874babd48302ea6ff644c6"}
Oct 30 19:47:48.910696 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:48.910667    2582 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-lvg9n" event={"ID":"dde165c4-1ada-4fd6-af53-32fd75286c79","Type":"ContainerStarted","Data":"46d6fe6411b21a8eea2363dcc14881b599692e69fc47d6d5b6f353456828a4eb"}
Oct 30 19:47:48.910796 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:48.910710    2582 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-lvg9n" event={"ID":"dde165c4-1ada-4fd6-af53-32fd75286c79","Type":"ContainerStarted","Data":"58b9a5ad6eed07e70ea7acda066300e6ad81aa57fff37991b175cb735090fd15"}
Oct 30 19:47:48.958563 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:48.958521    2582 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-lvg9n" podStartSLOduration=3.063468424 podStartE2EDuration="3.958509315s" totalImagesPullingTime="813.174995ms" totalInitContainerRuntime="81.865896ms" isStatefulPod=true podCreationTimestamp="2026-10-30 19:47:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 19:47:48.957276486 +0000 UTC m=+51.013851320" watchObservedRunningTime="2026-10-30 19:47:48.958509315 +0000 UTC m=+51.015084147"
Oct 30 19:47:50.625136 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:50.625102    2582 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-77f4f76594-k9gfv"]
Oct 30 19:47:50.627426 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:50.627383    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-77f4f76594-k9gfv"
Oct 30 19:47:50.657774 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:50.657752    2582 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Oct 30 19:47:50.657774 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:50.657753    2582 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-rmgr8\""
Oct 30 19:47:50.658987 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:50.658968    2582 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-77f4f76594-k9gfv"]
Oct 30 19:47:50.707498 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:50.707470    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bvnbm\" (UniqueName: \"kubernetes.io/projected/e7fb91fc-bf9e-42c6-b440-7165063ae5ec-kube-api-access-bvnbm\") pod \"monitoring-plugin-77f4f76594-k9gfv\" (UID: \"e7fb91fc-bf9e-42c6-b440-7165063ae5ec\") " pod="openshift-monitoring/monitoring-plugin-77f4f76594-k9gfv"
Oct 30 19:47:50.707639 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:50.707514    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e7fb91fc-bf9e-42c6-b440-7165063ae5ec-monitoring-plugin-cert\") pod \"monitoring-plugin-77f4f76594-k9gfv\" (UID: \"e7fb91fc-bf9e-42c6-b440-7165063ae5ec\") " pod="openshift-monitoring/monitoring-plugin-77f4f76594-k9gfv"
Oct 30 19:47:50.808565 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:50.808531    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bvnbm\" (UniqueName: \"kubernetes.io/projected/e7fb91fc-bf9e-42c6-b440-7165063ae5ec-kube-api-access-bvnbm\") pod \"monitoring-plugin-77f4f76594-k9gfv\" (UID: \"e7fb91fc-bf9e-42c6-b440-7165063ae5ec\") " pod="openshift-monitoring/monitoring-plugin-77f4f76594-k9gfv"
Oct 30 19:47:50.808565 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:50.808576    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e7fb91fc-bf9e-42c6-b440-7165063ae5ec-monitoring-plugin-cert\") pod \"monitoring-plugin-77f4f76594-k9gfv\" (UID: \"e7fb91fc-bf9e-42c6-b440-7165063ae5ec\") " pod="openshift-monitoring/monitoring-plugin-77f4f76594-k9gfv"
Oct 30 19:47:50.816493 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:50.812204    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e7fb91fc-bf9e-42c6-b440-7165063ae5ec-monitoring-plugin-cert\") pod \"monitoring-plugin-77f4f76594-k9gfv\" (UID: \"e7fb91fc-bf9e-42c6-b440-7165063ae5ec\") " pod="openshift-monitoring/monitoring-plugin-77f4f76594-k9gfv"
Oct 30 19:47:50.835661 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:50.835635    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bvnbm\" (UniqueName: \"kubernetes.io/projected/e7fb91fc-bf9e-42c6-b440-7165063ae5ec-kube-api-access-bvnbm\") pod \"monitoring-plugin-77f4f76594-k9gfv\" (UID: \"e7fb91fc-bf9e-42c6-b440-7165063ae5ec\") " pod="openshift-monitoring/monitoring-plugin-77f4f76594-k9gfv"
Oct 30 19:47:50.940895 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:50.940877    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-77f4f76594-k9gfv"
Oct 30 19:47:51.258468 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:51.258436    2582 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-77f4f76594-k9gfv"]
Oct 30 19:47:51.262688 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:47:51.262664    2582 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode7fb91fc_bf9e_42c6_b440_7165063ae5ec.slice/crio-5b1809f8a15a1c5d1e661b1743ea01f10b50539894af0b0e34d3f8689d5b92ee WatchSource:0}: Error finding container 5b1809f8a15a1c5d1e661b1743ea01f10b50539894af0b0e34d3f8689d5b92ee: Status 404 returned error can't find the container with id 5b1809f8a15a1c5d1e661b1743ea01f10b50539894af0b0e34d3f8689d5b92ee
Oct 30 19:47:51.922474 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:51.922446    2582 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-77f4f76594-k9gfv" event={"ID":"e7fb91fc-bf9e-42c6-b440-7165063ae5ec","Type":"ContainerStarted","Data":"5b1809f8a15a1c5d1e661b1743ea01f10b50539894af0b0e34d3f8689d5b92ee"}
Oct 30 19:47:51.925208 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:51.925184    2582 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5f8f546c56-w96tg" event={"ID":"6b02f882-10f6-47c4-84a0-8c07533bbb7d","Type":"ContainerStarted","Data":"6243ded358957772f1bdaeade174fd90fb1909662a82639de0f4f4f6dab091c1"}
Oct 30 19:47:51.925306 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:51.925239    2582 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5f8f546c56-w96tg" event={"ID":"6b02f882-10f6-47c4-84a0-8c07533bbb7d","Type":"ContainerStarted","Data":"87121fa5374df648384267e69441d339690cac3b899b52ac131a6c00a13b2f02"}
Oct 30 19:47:51.925306 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:51.925265    2582 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5f8f546c56-w96tg" event={"ID":"6b02f882-10f6-47c4-84a0-8c07533bbb7d","Type":"ContainerStarted","Data":"a4f98a837b86acd97f36f8fd906ffd4138c6d0a4b538208235f07a3931756700"}
Oct 30 19:47:51.925306 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:51.925287    2582 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5f8f546c56-w96tg" event={"ID":"6b02f882-10f6-47c4-84a0-8c07533bbb7d","Type":"ContainerStarted","Data":"192c2de2bb7af396792a777b0d851cf91cb74e40e99e05f54f42e5f230826b7f"}
Oct 30 19:47:51.925481 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:51.925310    2582 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5f8f546c56-w96tg" event={"ID":"6b02f882-10f6-47c4-84a0-8c07533bbb7d","Type":"ContainerStarted","Data":"368cf5193a3ffc5f1803e685113e5f68f75d3803927b24433f7675e2eef60253"}
Oct 30 19:47:51.925481 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:51.925332    2582 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5f8f546c56-w96tg" event={"ID":"6b02f882-10f6-47c4-84a0-8c07533bbb7d","Type":"ContainerStarted","Data":"ead4c65904bb13cd943ebb7f3cbe738ef08c50b43aa11ef641e497ee47094901"}
Oct 30 19:47:51.926166 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:51.926150    2582 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-5f8f546c56-w96tg"
Oct 30 19:47:52.003004 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:52.002964    2582 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-5f8f546c56-w96tg" podStartSLOduration=1.2913965059999999 podStartE2EDuration="4.002952004s" totalImagesPullingTime="2.711555498s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 19:47:48 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 19:47:51.990796405 +0000 UTC m=+54.047371239" watchObservedRunningTime="2026-10-30 19:47:52.002952004 +0000 UTC m=+54.059526838"
Oct 30 19:47:52.929560 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:52.929529    2582 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-77f4f76594-k9gfv" event={"ID":"e7fb91fc-bf9e-42c6-b440-7165063ae5ec","Type":"ContainerStarted","Data":"28c4eac7a98f2bc54e0d970d4f61c016b8c96ac2c48717ea36a1a758e5ea469c"}
Oct 30 19:47:52.930084 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:52.929946    2582 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-77f4f76594-k9gfv"
Oct 30 19:47:52.934115 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:52.934090    2582 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-77f4f76594-k9gfv"
Oct 30 19:47:52.983630 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:52.983580    2582 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-77f4f76594-k9gfv" podStartSLOduration=1.770659778 podStartE2EDuration="2.983566809s" totalImagesPullingTime="1.212907031s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 19:47:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 19:47:52.982731789 +0000 UTC m=+55.039306622" watchObservedRunningTime="2026-10-30 19:47:52.983566809 +0000 UTC m=+55.040141658"
Oct 30 19:47:53.840723 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:53.840556    2582 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-84v4l"
Oct 30 19:47:55.896686 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:55.896660    2582 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-kmppx"
Oct 30 19:47:58.938346 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:47:58.938317    2582 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-5f8f546c56-w96tg"
Oct 30 19:48:04.226388 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:48:04.226353    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/90b35edf-4b09-41df-9374-a514d1417071-original-pull-secret\") pod \"global-pull-secret-syncer-96mhd\" (UID: \"90b35edf-4b09-41df-9374-a514d1417071\") " pod="kube-system/global-pull-secret-syncer-96mhd"
Oct 30 19:48:04.226741 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:48:04.226405    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0a8c4dcc-2f62-4efe-993e-2de411ce6654-metrics-certs\") pod \"network-metrics-daemon-hkjcv\" (UID: \"0a8c4dcc-2f62-4efe-993e-2de411ce6654\") " pod="openshift-multus/network-metrics-daemon-hkjcv"
Oct 30 19:48:04.240423 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:48:04.240393    2582 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Oct 30 19:48:04.251015 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:48:04.250986    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0a8c4dcc-2f62-4efe-993e-2de411ce6654-metrics-certs\") pod \"network-metrics-daemon-hkjcv\" (UID: \"0a8c4dcc-2f62-4efe-993e-2de411ce6654\") " pod="openshift-multus/network-metrics-daemon-hkjcv"
Oct 30 19:48:04.252095 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:48:04.252079    2582 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Oct 30 19:48:04.259118 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:48:04.259096    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/90b35edf-4b09-41df-9374-a514d1417071-original-pull-secret\") pod \"global-pull-secret-syncer-96mhd\" (UID: \"90b35edf-4b09-41df-9374-a514d1417071\") " pod="kube-system/global-pull-secret-syncer-96mhd"
Oct 30 19:48:04.303993 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:48:04.303973    2582 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-2gzs4\""
Oct 30 19:48:04.310509 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:48:04.310489    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hkjcv"
Oct 30 19:48:04.310688 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:48:04.310673    2582 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"global-pull-secret-syncer-dockercfg-wnngx\""
Oct 30 19:48:04.316721 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:48:04.316706    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-96mhd"
Oct 30 19:48:04.327649 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:48:04.327625    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tmmdv\" (UniqueName: \"kubernetes.io/projected/aa51899f-52a0-434e-b434-4bc030c94136-kube-api-access-tmmdv\") pod \"network-check-target-b27jd\" (UID: \"aa51899f-52a0-434e-b434-4bc030c94136\") " pod="openshift-network-diagnostics/network-check-target-b27jd"
Oct 30 19:48:04.343241 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:48:04.343204    2582 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Oct 30 19:48:04.362509 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:48:04.362467    2582 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Oct 30 19:48:04.371287 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:48:04.371262    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tmmdv\" (UniqueName: \"kubernetes.io/projected/aa51899f-52a0-434e-b434-4bc030c94136-kube-api-access-tmmdv\") pod \"network-check-target-b27jd\" (UID: \"aa51899f-52a0-434e-b434-4bc030c94136\") " pod="openshift-network-diagnostics/network-check-target-b27jd"
Oct 30 19:48:04.546520 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:48:04.546486    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lj57_2be7f3a3-8714-491c-8e10-c594d425069a/konnectivity-agent/0.log" limit=1024
Oct 30 19:48:04.595749 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:48:04.595726    2582 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-check-target-dockercfg-mbspd\""
Oct 30 19:48:04.602807 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:48:04.602788    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b27jd"
Oct 30 19:48:04.622750 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:48:04.622725    2582 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-hkjcv"]
Oct 30 19:48:04.625631 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:48:04.625601    2582 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0a8c4dcc_2f62_4efe_993e_2de411ce6654.slice/crio-b8e14484065a269f37c47a3f8c7a26eea49c5a9d48fb63f397206fd4940526ba WatchSource:0}: Error finding container b8e14484065a269f37c47a3f8c7a26eea49c5a9d48fb63f397206fd4940526ba: Status 404 returned error can't find the container with id b8e14484065a269f37c47a3f8c7a26eea49c5a9d48fb63f397206fd4940526ba
Oct 30 19:48:04.638058 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:48:04.638033    2582 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-96mhd"]
Oct 30 19:48:04.645577 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:48:04.645510    2582 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod90b35edf_4b09_41df_9374_a514d1417071.slice/crio-6f85a5b9cbb30099b83741b8bcab9fd453d2b5473186a0935db97291bcef7ff4 WatchSource:0}: Error finding container 6f85a5b9cbb30099b83741b8bcab9fd453d2b5473186a0935db97291bcef7ff4: Status 404 returned error can't find the container with id 6f85a5b9cbb30099b83741b8bcab9fd453d2b5473186a0935db97291bcef7ff4
Oct 30 19:48:04.916203 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:48:04.916127    2582 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-b27jd"]
Oct 30 19:48:04.921151 ip-10-0-131-26 kubenswrapper[2582]: W1030 19:48:04.921121    2582 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa51899f_52a0_434e_b434_4bc030c94136.slice/crio-19280f397c327dc16a39273a8783766f604907123b4e5f3f1982a8ca45bfe016 WatchSource:0}: Error finding container 19280f397c327dc16a39273a8783766f604907123b4e5f3f1982a8ca45bfe016: Status 404 returned error can't find the container with id 19280f397c327dc16a39273a8783766f604907123b4e5f3f1982a8ca45bfe016
Oct 30 19:48:04.969471 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:48:04.969442    2582 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-b27jd" event={"ID":"aa51899f-52a0-434e-b434-4bc030c94136","Type":"ContainerStarted","Data":"19280f397c327dc16a39273a8783766f604907123b4e5f3f1982a8ca45bfe016"}
Oct 30 19:48:04.970734 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:48:04.970700    2582 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-96mhd" event={"ID":"90b35edf-4b09-41df-9374-a514d1417071","Type":"ContainerStarted","Data":"6f85a5b9cbb30099b83741b8bcab9fd453d2b5473186a0935db97291bcef7ff4"}
Oct 30 19:48:04.971953 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:48:04.971933    2582 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-hkjcv" event={"ID":"0a8c4dcc-2f62-4efe-993e-2de411ce6654","Type":"ContainerStarted","Data":"b8e14484065a269f37c47a3f8c7a26eea49c5a9d48fb63f397206fd4940526ba"}
Oct 30 19:48:05.985367 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:48:05.985330    2582 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-hkjcv" event={"ID":"0a8c4dcc-2f62-4efe-993e-2de411ce6654","Type":"ContainerStarted","Data":"5271811e4c41e7652f5d698bd6fd68629122b1c1730dd7484fb42a065a690086"}
Oct 30 19:48:05.985843 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:48:05.985400    2582 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-hkjcv" event={"ID":"0a8c4dcc-2f62-4efe-993e-2de411ce6654","Type":"ContainerStarted","Data":"ff761bbeb36673bce93ad860bd5d2b25780c76597762a49aec0184be3e8c3af4"}
Oct 30 19:48:06.030779 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:48:06.030710    2582 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-hkjcv" podStartSLOduration=65.988440017 podStartE2EDuration="1m7.030689624s" totalImagesPullingTime="1.042249607s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 19:46:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 19:48:06.029754863 +0000 UTC m=+68.086329697" watchObservedRunningTime="2026-10-30 19:48:06.030689624 +0000 UTC m=+68.087264461"
Oct 30 19:48:08.998921 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:48:08.998887    2582 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-b27jd" event={"ID":"aa51899f-52a0-434e-b434-4bc030c94136","Type":"ContainerStarted","Data":"876a9ac1aa707176bd489f60192a565b651840ccfacb334cd51e32a16eedb6b2"}
Oct 30 19:48:08.999381 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:48:08.999040    2582 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-b27jd"
Oct 30 19:48:09.043129 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:48:09.043084    2582 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-b27jd" podStartSLOduration=66.988742828 podStartE2EDuration="1m10.043069156s" totalImagesPullingTime="3.054326328s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 19:46:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 19:48:09.041530942 +0000 UTC m=+71.098105775" watchObservedRunningTime="2026-10-30 19:48:09.043069156 +0000 UTC m=+71.099643989"
Oct 30 19:48:09.478841 ip-10-0-131-26 kubenswrapper[2582]: I1030 19:48:09.478791    2582 dynamic_cafile_content.go:175] "Shutting down controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Oct 30 19:48:09.478946 ip-10-0-131-26 systemd[1]: Stopping Kubernetes Kubelet...
Oct 30 19:48:09.490782 ip-10-0-131-26 systemd[1]: kubelet.service: Deactivated successfully.
Oct 30 19:48:09.490947 ip-10-0-131-26 systemd[1]: Stopped Kubernetes Kubelet.
Oct 30 19:48:09.491115 ip-10-0-131-26 systemd[1]: kubelet.service: Consumed 3.587s CPU time.
Oct 30 19:48:09.501044 ip-10-0-131-26 systemd[1]: Starting Kubernetes Kubelet...
Oct 30 19:48:09.570819 ip-10-0-131-26 kubenswrapper[6275]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Oct 30 19:48:09.570819 ip-10-0-131-26 kubenswrapper[6275]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Oct 30 19:48:09.570819 ip-10-0-131-26 kubenswrapper[6275]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Oct 30 19:48:09.570819 ip-10-0-131-26 kubenswrapper[6275]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Oct 30 19:48:09.572860 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.572785    6275 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 19:48:09.572860 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.572859    6275 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 19:48:09.572860 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.572863    6275 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 19:48:09.572965 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.572866    6275 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 19:48:09.572965 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.572869    6275 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 19:48:09.572965 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.572872    6275 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 19:48:09.572965 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.572875    6275 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 19:48:09.572965 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.572877    6275 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 19:48:09.572965 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.572880    6275 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 19:48:09.572965 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.572883    6275 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 19:48:09.572965 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.572885    6275 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 19:48:09.572965 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.572888    6275 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 19:48:09.572965 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.572891    6275 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 19:48:09.572965 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.572893    6275 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 19:48:09.572965 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.572896    6275 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 19:48:09.572965 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.572899    6275 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 19:48:09.572965 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.572903    6275 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 19:48:09.572965 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.572906    6275 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 19:48:09.572965 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.572908    6275 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 19:48:09.572965 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.572911    6275 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 19:48:09.572965 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.572914    6275 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 19:48:09.572965 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.572916    6275 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 19:48:09.572965 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.572919    6275 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 19:48:09.573467 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.572922    6275 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 19:48:09.573467 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.572924    6275 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 19:48:09.573467 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.572927    6275 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 19:48:09.573467 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.572935    6275 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 19:48:09.573467 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.572938    6275 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 19:48:09.573467 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.572941    6275 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 19:48:09.573467 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.572943    6275 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 19:48:09.573467 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.572946    6275 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 19:48:09.573467 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.572948    6275 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 19:48:09.573467 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.572951    6275 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 19:48:09.573467 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.572955    6275 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 19:48:09.573467 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.572959    6275 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 19:48:09.573467 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.572962    6275 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 19:48:09.573467 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.572966    6275 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 19:48:09.573467 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.572969    6275 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 19:48:09.573467 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.572971    6275 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 19:48:09.573467 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.572974    6275 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 19:48:09.573467 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.572977    6275 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 19:48:09.573467 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.572980    6275 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 19:48:09.573957 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.572983    6275 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 19:48:09.573957 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.572986    6275 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 19:48:09.573957 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.572989    6275 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 19:48:09.573957 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.572991    6275 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 19:48:09.573957 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.572994    6275 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 19:48:09.573957 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.572997    6275 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 19:48:09.573957 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.573000    6275 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 19:48:09.573957 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.573003    6275 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 19:48:09.573957 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.573005    6275 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 19:48:09.573957 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.573008    6275 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 19:48:09.573957 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.573011    6275 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 19:48:09.573957 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.573014    6275 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 19:48:09.573957 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.573016    6275 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 19:48:09.573957 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.573019    6275 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 19:48:09.573957 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.573022    6275 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 19:48:09.573957 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.573025    6275 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 19:48:09.573957 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.573027    6275 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 19:48:09.573957 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.573030    6275 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 19:48:09.573957 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.573032    6275 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 19:48:09.574459 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.573035    6275 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 19:48:09.574459 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.573038    6275 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 19:48:09.574459 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.573040    6275 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 19:48:09.574459 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.573043    6275 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 19:48:09.574459 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.573045    6275 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 19:48:09.574459 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.573048    6275 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 19:48:09.574459 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.573051    6275 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 19:48:09.574459 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.573054    6275 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 19:48:09.574459 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.573056    6275 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 19:48:09.574459 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.573059    6275 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 19:48:09.574459 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.573062    6275 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 19:48:09.574459 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.573065    6275 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 19:48:09.574459 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.573069    6275 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 19:48:09.574459 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.573072    6275 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 19:48:09.574459 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.573075    6275 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 19:48:09.574459 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.573078    6275 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 19:48:09.574459 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.573081    6275 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 19:48:09.574459 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.573083    6275 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 19:48:09.574459 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.573087    6275 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 19:48:09.574918 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.573090    6275 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 19:48:09.574918 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.573093    6275 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 19:48:09.574918 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.573095    6275 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 19:48:09.574918 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.573098    6275 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 19:48:09.574918 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.573101    6275 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 19:48:09.574918 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.573103    6275 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 19:48:09.574918 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.573106    6275 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 19:48:09.574918 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.573108    6275 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 19:48:09.574918 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.573111    6275 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 19:48:09.574918 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.573114    6275 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 19:48:09.574918 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.573117    6275 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 19:48:09.574918 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.573119    6275 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 19:48:09.574918 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.573122    6275 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 19:48:09.574918 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.573124    6275 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 19:48:09.574918 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.573127    6275 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 19:48:09.574918 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.573129    6275 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 19:48:09.574918 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.573132    6275 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 19:48:09.574918 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.573135    6275 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 19:48:09.574918 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.573137    6275 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 19:48:09.575389 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.573140    6275 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 19:48:09.575389 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.573142    6275 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 19:48:09.575389 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.573145    6275 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 19:48:09.575389 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.573147    6275 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 19:48:09.575389 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.573150    6275 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 19:48:09.575389 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.573153    6275 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 19:48:09.575389 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.573155    6275 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 19:48:09.575389 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.573908    6275 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 19:48:09.575389 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.573915    6275 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 19:48:09.575389 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.573918    6275 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 19:48:09.575389 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.573920    6275 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 19:48:09.575389 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.573927    6275 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 19:48:09.575389 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.573930    6275 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 19:48:09.575389 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.573936    6275 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 19:48:09.575389 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.573939    6275 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 19:48:09.575389 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.573941    6275 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 19:48:09.575389 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.573944    6275 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 19:48:09.575389 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.573947    6275 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 19:48:09.575389 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.573950    6275 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 19:48:09.575389 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.573953    6275 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 19:48:09.575906 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.573955    6275 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 19:48:09.575906 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.573958    6275 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 19:48:09.575906 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.573961    6275 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 19:48:09.575906 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.573964    6275 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 19:48:09.575906 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.573967    6275 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 19:48:09.575906 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.573969    6275 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 19:48:09.575906 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.573972    6275 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 19:48:09.575906 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.573975    6275 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 19:48:09.575906 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.573977    6275 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 19:48:09.575906 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.573980    6275 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 19:48:09.575906 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.573982    6275 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 19:48:09.575906 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.573985    6275 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 19:48:09.575906 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.573988    6275 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 19:48:09.575906 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.573991    6275 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 19:48:09.575906 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.573993    6275 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 19:48:09.575906 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.573996    6275 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 19:48:09.575906 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.573999    6275 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 19:48:09.575906 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.574001    6275 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 19:48:09.575906 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.574004    6275 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 19:48:09.575906 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.574006    6275 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 19:48:09.576407 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.574009    6275 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 19:48:09.576407 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.574011    6275 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 19:48:09.576407 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.574015    6275 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 19:48:09.576407 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.574021    6275 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 19:48:09.576407 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.574023    6275 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 19:48:09.576407 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.574026    6275 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 19:48:09.576407 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.574034    6275 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 19:48:09.576407 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.574037    6275 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 19:48:09.576407 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.574040    6275 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 19:48:09.576407 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.574043    6275 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 19:48:09.576407 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.574046    6275 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 19:48:09.576407 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.574048    6275 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 19:48:09.576407 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.574051    6275 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 19:48:09.576407 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.574053    6275 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 19:48:09.576407 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.574059    6275 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 19:48:09.576407 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.574062    6275 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 19:48:09.576407 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.574064    6275 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 19:48:09.576407 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.574066    6275 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 19:48:09.576407 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.574069    6275 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 19:48:09.576897 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.574071    6275 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 19:48:09.576897 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.574074    6275 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 19:48:09.576897 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.574077    6275 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 19:48:09.576897 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.574079    6275 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 19:48:09.576897 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.574082    6275 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 19:48:09.576897 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.574087    6275 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 19:48:09.576897 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.574090    6275 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 19:48:09.576897 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.574093    6275 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 19:48:09.576897 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.574095    6275 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 19:48:09.576897 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.574098    6275 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 19:48:09.576897 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.574101    6275 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 19:48:09.576897 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.574103    6275 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 19:48:09.576897 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.574106    6275 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 19:48:09.576897 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.574108    6275 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 19:48:09.576897 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.574111    6275 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 19:48:09.576897 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.574113    6275 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 19:48:09.576897 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.574118    6275 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 19:48:09.576897 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.574121    6275 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 19:48:09.576897 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.574123    6275 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 19:48:09.577367 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.574126    6275 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 19:48:09.577367 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.574129    6275 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 19:48:09.577367 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.574132    6275 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 19:48:09.577367 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.574134    6275 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 19:48:09.577367 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.574137    6275 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 19:48:09.577367 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.574139    6275 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 19:48:09.577367 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.574142    6275 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 19:48:09.577367 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.574144    6275 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 19:48:09.577367 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.574148    6275 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 19:48:09.577367 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.574151    6275 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 19:48:09.577367 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.574154    6275 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 19:48:09.577367 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.574156    6275 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 19:48:09.577367 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.574159    6275 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 19:48:09.577367 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.574161    6275 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 19:48:09.577367 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.574164    6275 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 19:48:09.577367 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.574166    6275 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 19:48:09.577367 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.574169    6275 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 19:48:09.577367 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.574172    6275 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 19:48:09.577367 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.574174    6275 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 19:48:09.577852 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.574177    6275 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 19:48:09.577852 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.574179    6275 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 19:48:09.577852 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.574181    6275 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 19:48:09.577852 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.574184    6275 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 19:48:09.577852 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.574187    6275 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 19:48:09.577852 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.574189    6275 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 19:48:09.577852 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.574191    6275 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 19:48:09.577852 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.574194    6275 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 19:48:09.577852 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.574196    6275 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 19:48:09.577852 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.574199    6275 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 19:48:09.577852 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.574202    6275 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 19:48:09.577852 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.574205    6275 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 19:48:09.577852 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.574208    6275 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 19:48:09.577852 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.574210    6275 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 19:48:09.577852 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.574214    6275 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 19:48:09.577852 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.574217    6275 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 19:48:09.577852 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.574716    6275 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 19:48:09.577852 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.574723    6275 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 19:48:09.577852 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.574726    6275 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 19:48:09.577852 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.574729    6275 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 19:48:09.578377 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.574732    6275 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 19:48:09.578377 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.574737    6275 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 19:48:09.578377 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.574740    6275 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 19:48:09.578377 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.574743    6275 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 19:48:09.578377 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.574746    6275 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 19:48:09.578377 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.574748    6275 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 19:48:09.578377 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.574751    6275 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 19:48:09.578377 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.574754    6275 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 19:48:09.578377 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.574756    6275 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 19:48:09.578377 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.574759    6275 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 19:48:09.578377 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.574762    6275 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 19:48:09.578377 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.574764    6275 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 19:48:09.578377 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.574767    6275 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 19:48:09.578377 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.574770    6275 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 19:48:09.578377 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.574772    6275 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 19:48:09.578377 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.574775    6275 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 19:48:09.578377 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.574777    6275 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 19:48:09.578377 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.574779    6275 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 19:48:09.578377 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.574782    6275 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 19:48:09.578377 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.574785    6275 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 19:48:09.578948 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.574787    6275 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 19:48:09.578948 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.574790    6275 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 19:48:09.578948 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.574793    6275 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 19:48:09.578948 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.574796    6275 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 19:48:09.578948 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.574799    6275 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 19:48:09.578948 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.574801    6275 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 19:48:09.578948 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.574805    6275 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 19:48:09.578948 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.574810    6275 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 19:48:09.578948 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.574813    6275 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 19:48:09.578948 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.574816    6275 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 19:48:09.578948 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.574818    6275 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 19:48:09.578948 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.574821    6275 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 19:48:09.578948 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.574824    6275 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 19:48:09.578948 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.574827    6275 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 19:48:09.578948 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.574830    6275 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 19:48:09.578948 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.574832    6275 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 19:48:09.578948 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.574835    6275 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 19:48:09.578948 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.574838    6275 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 19:48:09.578948 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.574841    6275 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 19:48:09.579728 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.574843    6275 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 19:48:09.579728 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.574846    6275 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 19:48:09.579728 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.574849    6275 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 19:48:09.579728 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.574851    6275 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 19:48:09.579728 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.574854    6275 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 19:48:09.579728 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.574857    6275 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 19:48:09.579728 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.574859    6275 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 19:48:09.579728 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.574862    6275 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 19:48:09.579728 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.574865    6275 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 19:48:09.579728 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.574867    6275 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 19:48:09.579728 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.574870    6275 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 19:48:09.579728 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.574872    6275 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 19:48:09.579728 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.574875    6275 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 19:48:09.579728 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.574877    6275 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 19:48:09.579728 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.574880    6275 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 19:48:09.579728 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.574884    6275 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 19:48:09.579728 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.574887    6275 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 19:48:09.579728 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.574889    6275 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 19:48:09.579728 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.574892    6275 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 19:48:09.580273 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.574895    6275 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 19:48:09.580273 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.574897    6275 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 19:48:09.580273 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.574900    6275 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 19:48:09.580273 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.574903    6275 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 19:48:09.580273 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.574905    6275 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 19:48:09.580273 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.574908    6275 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 19:48:09.580273 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.574911    6275 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 19:48:09.580273 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.574915    6275 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 19:48:09.580273 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.574917    6275 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 19:48:09.580273 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.574920    6275 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 19:48:09.580273 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.574923    6275 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 19:48:09.580273 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.574925    6275 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 19:48:09.580273 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.574928    6275 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 19:48:09.580273 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.574931    6275 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 19:48:09.580273 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.574933    6275 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 19:48:09.580273 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.574936    6275 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 19:48:09.580273 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.574938    6275 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 19:48:09.580273 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.574941    6275 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 19:48:09.580273 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.574943    6275 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 19:48:09.580273 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.574946    6275 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 19:48:09.580787 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.574949    6275 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 19:48:09.580787 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.574951    6275 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 19:48:09.580787 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.574954    6275 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 19:48:09.580787 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.574956    6275 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 19:48:09.580787 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.574959    6275 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 19:48:09.580787 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.574961    6275 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 19:48:09.580787 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.574964    6275 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 19:48:09.580787 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.574966    6275 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 19:48:09.580787 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.574970    6275 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 19:48:09.580787 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.574975    6275 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 19:48:09.580787 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.574978    6275 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 19:48:09.580787 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.574981    6275 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 19:48:09.580787 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.574985    6275 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 19:48:09.580787 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.574988    6275 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 19:48:09.580787 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.574990    6275 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 19:48:09.580787 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.574994    6275 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 19:48:09.580787 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.574997    6275 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 19:48:09.580787 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.574999    6275 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 19:48:09.580787 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.575001    6275 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 19:48:09.580787 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.575005    6275 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 19:48:09.581270 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.575007    6275 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 19:48:09.581270 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.575010    6275 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 19:48:09.581270 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.575012    6275 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 19:48:09.581270 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.575015    6275 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 19:48:09.581270 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.575099    6275 flags.go:64] FLAG: --address="0.0.0.0"
Oct 30 19:48:09.581270 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.575106    6275 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Oct 30 19:48:09.581270 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.575111    6275 flags.go:64] FLAG: --anonymous-auth="true"
Oct 30 19:48:09.581270 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.575116    6275 flags.go:64] FLAG: --application-metrics-count-limit="100"
Oct 30 19:48:09.581270 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.575120    6275 flags.go:64] FLAG: --authentication-token-webhook="false"
Oct 30 19:48:09.581270 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.575124    6275 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Oct 30 19:48:09.581270 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.575128    6275 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Oct 30 19:48:09.581270 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.575132    6275 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Oct 30 19:48:09.581270 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.575135    6275 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Oct 30 19:48:09.581270 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.575138    6275 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Oct 30 19:48:09.581270 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.575141    6275 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Oct 30 19:48:09.581270 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.575144    6275 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Oct 30 19:48:09.581270 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.575148    6275 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Oct 30 19:48:09.581270 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.575151    6275 flags.go:64] FLAG: --cgroup-root=""
Oct 30 19:48:09.581270 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.575153    6275 flags.go:64] FLAG: --cgroups-per-qos="true"
Oct 30 19:48:09.581270 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.575156    6275 flags.go:64] FLAG: --client-ca-file=""
Oct 30 19:48:09.581270 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.575161    6275 flags.go:64] FLAG: --cloud-provider="external"
Oct 30 19:48:09.581270 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.575164    6275 flags.go:64] FLAG: --cluster-dns="[]"
Oct 30 19:48:09.581270 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.575169    6275 flags.go:64] FLAG: --cluster-domain=""
Oct 30 19:48:09.581875 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.575172    6275 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Oct 30 19:48:09.581875 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.575175    6275 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Oct 30 19:48:09.581875 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.575178    6275 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Oct 30 19:48:09.581875 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.575181    6275 flags.go:64] FLAG: --container-log-max-files="5"
Oct 30 19:48:09.581875 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.575185    6275 flags.go:64] FLAG: --container-log-max-size="10Mi"
Oct 30 19:48:09.581875 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.575188    6275 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Oct 30 19:48:09.581875 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.575191    6275 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Oct 30 19:48:09.581875 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.575195    6275 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Oct 30 19:48:09.581875 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.575198    6275 flags.go:64] FLAG: --contention-profiling="false"
Oct 30 19:48:09.581875 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.575201    6275 flags.go:64] FLAG: --cpu-cfs-quota="true"
Oct 30 19:48:09.581875 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.575204    6275 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Oct 30 19:48:09.581875 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.575207    6275 flags.go:64] FLAG: --cpu-manager-policy="none"
Oct 30 19:48:09.581875 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.575210    6275 flags.go:64] FLAG: --cpu-manager-policy-options=""
Oct 30 19:48:09.581875 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.575214    6275 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Oct 30 19:48:09.581875 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.575217    6275 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Oct 30 19:48:09.581875 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.575220    6275 flags.go:64] FLAG: --enable-debugging-handlers="true"
Oct 30 19:48:09.581875 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.575223    6275 flags.go:64] FLAG: --enable-load-reader="false"
Oct 30 19:48:09.581875 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.575226    6275 flags.go:64] FLAG: --enable-server="true"
Oct 30 19:48:09.581875 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.575229    6275 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Oct 30 19:48:09.581875 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.575233    6275 flags.go:64] FLAG: --event-burst="100"
Oct 30 19:48:09.581875 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.575236    6275 flags.go:64] FLAG: --event-qps="50"
Oct 30 19:48:09.581875 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.575239    6275 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Oct 30 19:48:09.581875 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.575242    6275 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Oct 30 19:48:09.581875 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.575245    6275 flags.go:64] FLAG: --eviction-hard=""
Oct 30 19:48:09.582480 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.575249    6275 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Oct 30 19:48:09.582480 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.575252    6275 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Oct 30 19:48:09.582480 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.575255    6275 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Oct 30 19:48:09.582480 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.575258    6275 flags.go:64] FLAG: --eviction-soft=""
Oct 30 19:48:09.582480 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.575261    6275 flags.go:64] FLAG: --eviction-soft-grace-period=""
Oct 30 19:48:09.582480 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.575266    6275 flags.go:64] FLAG: --exit-on-lock-contention="false"
Oct 30 19:48:09.582480 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.575269    6275 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Oct 30 19:48:09.582480 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.575272    6275 flags.go:64] FLAG: --experimental-mounter-path=""
Oct 30 19:48:09.582480 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.575274    6275 flags.go:64] FLAG: --fail-cgroupv1="true"
Oct 30 19:48:09.582480 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.575277    6275 flags.go:64] FLAG: --fail-swap-on="true"
Oct 30 19:48:09.582480 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.575280    6275 flags.go:64] FLAG: --feature-gates=""
Oct 30 19:48:09.582480 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.575284    6275 flags.go:64] FLAG: --file-check-frequency="20s"
Oct 30 19:48:09.582480 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.575287    6275 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Oct 30 19:48:09.582480 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.575290    6275 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Oct 30 19:48:09.582480 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.575294    6275 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Oct 30 19:48:09.582480 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.575297    6275 flags.go:64] FLAG: --healthz-port="10248"
Oct 30 19:48:09.582480 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.575300    6275 flags.go:64] FLAG: --help="false"
Oct 30 19:48:09.582480 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.575303    6275 flags.go:64] FLAG: --hostname-override="ip-10-0-131-26.ec2.internal"
Oct 30 19:48:09.582480 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.575306    6275 flags.go:64] FLAG: --housekeeping-interval="10s"
Oct 30 19:48:09.582480 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.575309    6275 flags.go:64] FLAG: --http-check-frequency="20s"
Oct 30 19:48:09.582480 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.575312    6275 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Oct 30 19:48:09.582480 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.575315    6275 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Oct 30 19:48:09.582480 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.575319    6275 flags.go:64] FLAG: --image-gc-high-threshold="85"
Oct 30 19:48:09.583048 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.575322    6275 flags.go:64] FLAG: --image-gc-low-threshold="80"
Oct 30 19:48:09.583048 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.575325    6275 flags.go:64] FLAG: --image-service-endpoint=""
Oct 30 19:48:09.583048 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.575328    6275 flags.go:64] FLAG: --kernel-memcg-notification="false"
Oct 30 19:48:09.583048 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.575331    6275 flags.go:64] FLAG: --kube-api-burst="100"
Oct 30 19:48:09.583048 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.575334    6275 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Oct 30 19:48:09.583048 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.575337    6275 flags.go:64] FLAG: --kube-api-qps="50"
Oct 30 19:48:09.583048 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.575340    6275 flags.go:64] FLAG: --kube-reserved=""
Oct 30 19:48:09.583048 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.575342    6275 flags.go:64] FLAG: --kube-reserved-cgroup=""
Oct 30 19:48:09.583048 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.575346    6275 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Oct 30 19:48:09.583048 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.575349    6275 flags.go:64] FLAG: --kubelet-cgroups=""
Oct 30 19:48:09.583048 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.575351    6275 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Oct 30 19:48:09.583048 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.575354    6275 flags.go:64] FLAG: --lock-file=""
Oct 30 19:48:09.583048 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.575357    6275 flags.go:64] FLAG: --log-cadvisor-usage="false"
Oct 30 19:48:09.583048 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.575360    6275 flags.go:64] FLAG: --log-flush-frequency="5s"
Oct 30 19:48:09.583048 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.575365    6275 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Oct 30 19:48:09.583048 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.575370    6275 flags.go:64] FLAG: --log-json-split-stream="false"
Oct 30 19:48:09.583048 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.575373    6275 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Oct 30 19:48:09.583048 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.575376    6275 flags.go:64] FLAG: --log-text-split-stream="false"
Oct 30 19:48:09.583048 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.575379    6275 flags.go:64] FLAG: --logging-format="text"
Oct 30 19:48:09.583048 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.575382    6275 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Oct 30 19:48:09.583048 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.575386    6275 flags.go:64] FLAG: --make-iptables-util-chains="true"
Oct 30 19:48:09.583048 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.575389    6275 flags.go:64] FLAG: --manifest-url=""
Oct 30 19:48:09.583048 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.575392    6275 flags.go:64] FLAG: --manifest-url-header=""
Oct 30 19:48:09.583048 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.575396    6275 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Oct 30 19:48:09.583048 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.575400    6275 flags.go:64] FLAG: --max-open-files="1000000"
Oct 30 19:48:09.583675 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.575404    6275 flags.go:64] FLAG: --max-pods="110"
Oct 30 19:48:09.583675 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.575407    6275 flags.go:64] FLAG: --maximum-dead-containers="-1"
Oct 30 19:48:09.583675 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.575425    6275 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Oct 30 19:48:09.583675 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.575429    6275 flags.go:64] FLAG: --memory-manager-policy="None"
Oct 30 19:48:09.583675 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.575432    6275 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Oct 30 19:48:09.583675 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.575435    6275 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Oct 30 19:48:09.583675 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.575438    6275 flags.go:64] FLAG: --node-ip="0.0.0.0"
Oct 30 19:48:09.583675 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.575441    6275 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Oct 30 19:48:09.583675 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.575448    6275 flags.go:64] FLAG: --node-status-max-images="50"
Oct 30 19:48:09.583675 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.575451    6275 flags.go:64] FLAG: --node-status-update-frequency="10s"
Oct 30 19:48:09.583675 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.575454    6275 flags.go:64] FLAG: --oom-score-adj="-999"
Oct 30 19:48:09.583675 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.575457    6275 flags.go:64] FLAG: --pod-cidr=""
Oct 30 19:48:09.583675 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.575460    6275 flags.go:64] FLAG: --pod-manifest-path=""
Oct 30 19:48:09.583675 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.575463    6275 flags.go:64] FLAG: --pod-max-pids="-1"
Oct 30 19:48:09.583675 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.575466    6275 flags.go:64] FLAG: --pods-per-core="0"
Oct 30 19:48:09.583675 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.575469    6275 flags.go:64] FLAG: --port="10250"
Oct 30 19:48:09.583675 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.575472    6275 flags.go:64] FLAG: --protect-kernel-defaults="false"
Oct 30 19:48:09.583675 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.575475    6275 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-04c2e28a1d6c5b9c4"
Oct 30 19:48:09.583675 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.575478    6275 flags.go:64] FLAG: --qos-reserved=""
Oct 30 19:48:09.583675 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.575481    6275 flags.go:64] FLAG: --read-only-port="10255"
Oct 30 19:48:09.583675 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.575484    6275 flags.go:64] FLAG: --register-node="true"
Oct 30 19:48:09.583675 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.575489    6275 flags.go:64] FLAG: --register-with-taints=""
Oct 30 19:48:09.583675 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.575493    6275 flags.go:64] FLAG: --registry-burst="10"
Oct 30 19:48:09.583675 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.575496    6275 flags.go:64] FLAG: --registry-qps="5"
Oct 30 19:48:09.583675 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.575498    6275 flags.go:64] FLAG: --reserved-cpus=""
Oct 30 19:48:09.583675 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.575501    6275 flags.go:64] FLAG: --reserved-memory=""
Oct 30 19:48:09.584306 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.575505    6275 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Oct 30 19:48:09.584306 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.575508    6275 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Oct 30 19:48:09.584306 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.575511    6275 flags.go:64] FLAG: --rotate-certificates="false"
Oct 30 19:48:09.584306 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.575514    6275 flags.go:64] FLAG: --rotate-server-certificates="false"
Oct 30 19:48:09.584306 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.575517    6275 flags.go:64] FLAG: --runonce="false"
Oct 30 19:48:09.584306 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.575520    6275 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Oct 30 19:48:09.584306 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.575523    6275 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Oct 30 19:48:09.584306 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.575526    6275 flags.go:64] FLAG: --seccomp-default="false"
Oct 30 19:48:09.584306 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.575529    6275 flags.go:64] FLAG: --serialize-image-pulls="true"
Oct 30 19:48:09.584306 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.575532    6275 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Oct 30 19:48:09.584306 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.575535    6275 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Oct 30 19:48:09.584306 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.575538    6275 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Oct 30 19:48:09.584306 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.575541    6275 flags.go:64] FLAG: --storage-driver-password="root"
Oct 30 19:48:09.584306 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.575544    6275 flags.go:64] FLAG: --storage-driver-secure="false"
Oct 30 19:48:09.584306 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.575547    6275 flags.go:64] FLAG: --storage-driver-table="stats"
Oct 30 19:48:09.584306 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.575550    6275 flags.go:64] FLAG: --storage-driver-user="root"
Oct 30 19:48:09.584306 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.575552    6275 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Oct 30 19:48:09.584306 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.575555    6275 flags.go:64] FLAG: --sync-frequency="1m0s"
Oct 30 19:48:09.584306 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.575558    6275 flags.go:64] FLAG: --system-cgroups=""
Oct 30 19:48:09.584306 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.575561    6275 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Oct 30 19:48:09.584306 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.575566    6275 flags.go:64] FLAG: --system-reserved-cgroup=""
Oct 30 19:48:09.584306 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.575569    6275 flags.go:64] FLAG: --tls-cert-file=""
Oct 30 19:48:09.584306 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.575571    6275 flags.go:64] FLAG: --tls-cipher-suites="[]"
Oct 30 19:48:09.584306 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.575575    6275 flags.go:64] FLAG: --tls-min-version=""
Oct 30 19:48:09.584306 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.575578    6275 flags.go:64] FLAG: --tls-private-key-file=""
Oct 30 19:48:09.584922 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.575581    6275 flags.go:64] FLAG: --topology-manager-policy="none"
Oct 30 19:48:09.584922 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.575584    6275 flags.go:64] FLAG: --topology-manager-policy-options=""
Oct 30 19:48:09.584922 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.575588    6275 flags.go:64] FLAG: --topology-manager-scope="container"
Oct 30 19:48:09.584922 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.575591    6275 flags.go:64] FLAG: --v="2"
Oct 30 19:48:09.584922 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.575595    6275 flags.go:64] FLAG: --version="false"
Oct 30 19:48:09.584922 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.575599    6275 flags.go:64] FLAG: --vmodule=""
Oct 30 19:48:09.584922 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.575603    6275 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Oct 30 19:48:09.584922 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.575606    6275 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Oct 30 19:48:09.584922 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.575730    6275 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 19:48:09.584922 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.575734    6275 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 19:48:09.584922 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.575737    6275 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 19:48:09.584922 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.575739    6275 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 19:48:09.584922 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.575742    6275 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 19:48:09.584922 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.575745    6275 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 19:48:09.584922 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.575748    6275 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 19:48:09.584922 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.575751    6275 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 19:48:09.584922 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.575753    6275 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 19:48:09.584922 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.575756    6275 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 19:48:09.584922 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.575758    6275 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 19:48:09.584922 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.575761    6275 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 19:48:09.584922 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.575763    6275 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 19:48:09.584922 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.575766    6275 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 19:48:09.585632 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.575768    6275 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 19:48:09.585632 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.575771    6275 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 19:48:09.585632 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.575773    6275 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 19:48:09.585632 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.575776    6275 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 19:48:09.585632 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.575778    6275 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 19:48:09.585632 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.575781    6275 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 19:48:09.585632 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.575783    6275 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 19:48:09.585632 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.575786    6275 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 19:48:09.585632 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.575789    6275 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 19:48:09.585632 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.575791    6275 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 19:48:09.585632 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.575794    6275 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 19:48:09.585632 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.575797    6275 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 19:48:09.585632 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.575801    6275 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 19:48:09.585632 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.575803    6275 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 19:48:09.585632 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.575807    6275 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 19:48:09.585632 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.575811    6275 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 19:48:09.585632 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.575814    6275 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 19:48:09.585632 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.575817    6275 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 19:48:09.585632 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.575819    6275 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 19:48:09.586224 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.575822    6275 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 19:48:09.586224 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.575825    6275 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 19:48:09.586224 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.575827    6275 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 19:48:09.586224 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.575830    6275 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 19:48:09.586224 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.575832    6275 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 19:48:09.586224 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.575835    6275 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 19:48:09.586224 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.575838    6275 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 19:48:09.586224 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.575840    6275 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 19:48:09.586224 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.575843    6275 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 19:48:09.586224 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.575845    6275 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 19:48:09.586224 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.575848    6275 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 19:48:09.586224 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.575851    6275 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 19:48:09.586224 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.575853    6275 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 19:48:09.586224 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.575856    6275 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 19:48:09.586224 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.575860    6275 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 19:48:09.586224 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.575864    6275 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 19:48:09.586224 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.575867    6275 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 19:48:09.586224 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.575870    6275 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 19:48:09.586224 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.575872    6275 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 19:48:09.586737 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.575875    6275 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 19:48:09.586737 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.575877    6275 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 19:48:09.586737 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.575880    6275 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 19:48:09.586737 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.575883    6275 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 19:48:09.586737 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.575886    6275 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 19:48:09.586737 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.575888    6275 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 19:48:09.586737 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.575892    6275 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 19:48:09.586737 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.575895    6275 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 19:48:09.586737 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.575899    6275 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 19:48:09.586737 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.575902    6275 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 19:48:09.586737 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.575904    6275 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 19:48:09.586737 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.575907    6275 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 19:48:09.586737 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.575910    6275 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 19:48:09.586737 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.575913    6275 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 19:48:09.586737 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.575916    6275 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 19:48:09.586737 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.575918    6275 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 19:48:09.586737 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.575921    6275 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 19:48:09.586737 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.575923    6275 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 19:48:09.586737 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.575926    6275 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 19:48:09.587229 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.575928    6275 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 19:48:09.587229 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.575932    6275 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 19:48:09.587229 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.575934    6275 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 19:48:09.587229 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.575937    6275 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 19:48:09.587229 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.575939    6275 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 19:48:09.587229 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.575942    6275 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 19:48:09.587229 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.575944    6275 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 19:48:09.587229 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.575947    6275 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 19:48:09.587229 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.575949    6275 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 19:48:09.587229 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.575952    6275 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 19:48:09.587229 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.575954    6275 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 19:48:09.587229 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.575957    6275 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 19:48:09.587229 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.575959    6275 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 19:48:09.587229 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.575962    6275 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 19:48:09.587229 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.575964    6275 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 19:48:09.587229 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.575967    6275 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 19:48:09.587229 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.575969    6275 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 19:48:09.587229 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.575972    6275 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 19:48:09.587229 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.575974    6275 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 19:48:09.587229 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.575979    6275 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 19:48:09.587867 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.575981    6275 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 19:48:09.587867 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.575985    6275 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 19:48:09.587867 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.575988    6275 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 19:48:09.587867 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.575990    6275 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 19:48:09.587867 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.575993    6275 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 19:48:09.587867 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.575995    6275 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 19:48:09.587867 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.575998    6275 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 19:48:09.587867 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.576000    6275 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 19:48:09.587867 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.576003    6275 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 19:48:09.587867 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.576005    6275 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 19:48:09.587867 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.576008    6275 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 19:48:09.587867 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.576011    6275 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 19:48:09.587867 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.576013    6275 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 19:48:09.587867 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.576016    6275 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 19:48:09.587867 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.576019    6275 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 19:48:09.587867 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.576044    6275 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]}
Oct 30 19:48:09.588448 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.576077    6275 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 19:48:09.588448 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.576081    6275 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 19:48:09.588448 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.576084    6275 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 19:48:09.588448 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.576087    6275 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 19:48:09.588448 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.576090    6275 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 19:48:09.588448 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.576093    6275 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 19:48:09.588448 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.576095    6275 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 19:48:09.588448 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.576098    6275 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 19:48:09.588448 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.576100    6275 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 19:48:09.588448 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.576103    6275 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 19:48:09.588448 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.576105    6275 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 19:48:09.588448 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.576108    6275 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 19:48:09.588448 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.576111    6275 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 19:48:09.588448 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.576113    6275 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 19:48:09.588448 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.576116    6275 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 19:48:09.588448 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.576121    6275 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 19:48:09.588448 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.576123    6275 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 19:48:09.588448 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.576126    6275 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 19:48:09.588448 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.576129    6275 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 19:48:09.589042 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.576132    6275 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 19:48:09.589042 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.576135    6275 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 19:48:09.589042 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.576137    6275 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 19:48:09.589042 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.576140    6275 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 19:48:09.589042 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.576142    6275 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 19:48:09.589042 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.576145    6275 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 19:48:09.589042 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.576148    6275 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 19:48:09.589042 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.576150    6275 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 19:48:09.589042 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.576153    6275 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 19:48:09.589042 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.576155    6275 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 19:48:09.589042 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.576158    6275 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 19:48:09.589042 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.576160    6275 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 19:48:09.589042 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.576164    6275 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 19:48:09.589042 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.576166    6275 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 19:48:09.589042 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.576169    6275 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 19:48:09.589042 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.576171    6275 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 19:48:09.589042 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.576174    6275 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 19:48:09.589042 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.576176    6275 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 19:48:09.589042 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.576179    6275 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 19:48:09.589042 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.576181    6275 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 19:48:09.589547 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.576184    6275 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 19:48:09.589547 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.576187    6275 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 19:48:09.589547 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.576189    6275 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 19:48:09.589547 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.576192    6275 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 19:48:09.589547 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.576194    6275 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 19:48:09.589547 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.576197    6275 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 19:48:09.589547 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.576200    6275 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 19:48:09.589547 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.576202    6275 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 19:48:09.589547 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.576206    6275 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 19:48:09.589547 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.576209    6275 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 19:48:09.589547 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.576212    6275 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 19:48:09.589547 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.576215    6275 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 19:48:09.589547 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.576218    6275 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 19:48:09.589547 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.576221    6275 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 19:48:09.589547 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.576223    6275 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 19:48:09.589547 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.576226    6275 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 19:48:09.589547 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.576228    6275 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 19:48:09.589547 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.576231    6275 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 19:48:09.589547 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.576234    6275 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 19:48:09.589547 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.576236    6275 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 19:48:09.590030 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.576239    6275 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 19:48:09.590030 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.576241    6275 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 19:48:09.590030 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.576244    6275 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 19:48:09.590030 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.576246    6275 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 19:48:09.590030 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.576249    6275 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 19:48:09.590030 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.576253    6275 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 19:48:09.590030 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.576255    6275 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 19:48:09.590030 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.576258    6275 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 19:48:09.590030 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.576261    6275 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 19:48:09.590030 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.576263    6275 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 19:48:09.590030 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.576266    6275 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 19:48:09.590030 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.576268    6275 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 19:48:09.590030 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.576271    6275 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 19:48:09.590030 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.576273    6275 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 19:48:09.590030 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.576276    6275 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 19:48:09.590030 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.576279    6275 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 19:48:09.590030 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.576281    6275 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 19:48:09.590030 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.576284    6275 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 19:48:09.590030 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.576295    6275 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 19:48:09.590030 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.576299    6275 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 19:48:09.590661 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.576302    6275 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 19:48:09.590661 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.576305    6275 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 19:48:09.590661 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.576310    6275 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 19:48:09.590661 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.576315    6275 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 19:48:09.590661 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.576318    6275 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 19:48:09.590661 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.576321    6275 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 19:48:09.590661 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.576324    6275 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 19:48:09.590661 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.576326    6275 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 19:48:09.590661 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.576329    6275 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 19:48:09.590661 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.576331    6275 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 19:48:09.590661 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.576334    6275 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 19:48:09.590661 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.576337    6275 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 19:48:09.590661 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.576339    6275 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 19:48:09.590661 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.576342    6275 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 19:48:09.590661 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.576344    6275 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 19:48:09.590661 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.576347    6275 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 19:48:09.590661 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.576350    6275 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 19:48:09.590661 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.576353    6275 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 19:48:09.590661 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.576356    6275 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 19:48:09.591134 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.576358    6275 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 19:48:09.591134 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.576361    6275 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 19:48:09.591134 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.576365    6275 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 19:48:09.591134 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.576369    6275 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 19:48:09.591134 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.576372    6275 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 19:48:09.591134 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.576375    6275 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 19:48:09.591134 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.576378    6275 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 19:48:09.591134 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.576381    6275 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 19:48:09.591134 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.581074    6275 server.go:525] "Kubelet version" kubeletVersion="v1.35.9"
Oct 30 19:48:09.591134 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.581091    6275 server.go:527] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Oct 30 19:48:09.591134 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.581109    6275 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Oct 30 19:48:09.591134 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.581114    6275 watchdog_linux.go:138] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Oct 30 19:48:09.591134 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.581175    6275 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 19:48:09.591134 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.581180    6275 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 19:48:09.591134 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.581184    6275 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 19:48:09.591134 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.581187    6275 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 19:48:09.591134 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.581189    6275 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 19:48:09.591134 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.581193    6275 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 19:48:09.591134 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.581196    6275 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 19:48:09.591847 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.581199    6275 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 19:48:09.591847 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.581202    6275 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 19:48:09.591847 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.581204    6275 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 19:48:09.591847 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.581207    6275 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 19:48:09.591847 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.581210    6275 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 19:48:09.591847 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.581213    6275 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 19:48:09.591847 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.581216    6275 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 19:48:09.591847 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.581218    6275 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 19:48:09.591847 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.581221    6275 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 19:48:09.591847 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.581223    6275 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 19:48:09.591847 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.581226    6275 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 19:48:09.591847 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.581229    6275 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 19:48:09.591847 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.581232    6275 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 19:48:09.591847 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.581234    6275 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 19:48:09.591847 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.581237    6275 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 19:48:09.591847 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.581240    6275 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 19:48:09.591847 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.581242    6275 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 19:48:09.591847 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.581245    6275 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 19:48:09.591847 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.581248    6275 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 19:48:09.591847 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.581251    6275 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 19:48:09.592650 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.581253    6275 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 19:48:09.592650 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.581261    6275 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 19:48:09.592650 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.581264    6275 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 19:48:09.592650 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.581267    6275 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 19:48:09.592650 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.581269    6275 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 19:48:09.592650 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.581272    6275 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 19:48:09.592650 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.581275    6275 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 19:48:09.592650 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.581278    6275 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 19:48:09.592650 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.581280    6275 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 19:48:09.592650 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.581284    6275 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 19:48:09.592650 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.581289    6275 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 19:48:09.592650 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.581292    6275 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 19:48:09.592650 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.581295    6275 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 19:48:09.592650 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.581298    6275 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 19:48:09.592650 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.581301    6275 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 19:48:09.592650 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.581304    6275 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 19:48:09.592650 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.581307    6275 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 19:48:09.592650 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.581310    6275 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 19:48:09.592650 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.581313    6275 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 19:48:09.593171 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.581315    6275 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 19:48:09.593171 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.581318    6275 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 19:48:09.593171 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.581320    6275 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 19:48:09.593171 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.581323    6275 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 19:48:09.593171 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.581326    6275 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 19:48:09.593171 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.581328    6275 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 19:48:09.593171 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.581331    6275 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 19:48:09.593171 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.581333    6275 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 19:48:09.593171 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.581336    6275 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 19:48:09.593171 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.581339    6275 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 19:48:09.593171 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.581341    6275 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 19:48:09.593171 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.581344    6275 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 19:48:09.593171 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.581346    6275 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 19:48:09.593171 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.581349    6275 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 19:48:09.593171 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.581352    6275 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 19:48:09.593171 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.581354    6275 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 19:48:09.593171 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.581357    6275 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 19:48:09.593171 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.581359    6275 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 19:48:09.593171 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.581362    6275 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 19:48:09.593171 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.581364    6275 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 19:48:09.593762 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.581367    6275 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 19:48:09.593762 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.581370    6275 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 19:48:09.593762 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.581372    6275 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 19:48:09.593762 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.581375    6275 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 19:48:09.593762 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.581377    6275 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 19:48:09.593762 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.581380    6275 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 19:48:09.593762 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.581382    6275 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 19:48:09.593762 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.581385    6275 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 19:48:09.593762 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.581388    6275 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 19:48:09.593762 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.581391    6275 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 19:48:09.593762 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.581394    6275 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 19:48:09.593762 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.581396    6275 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 19:48:09.593762 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.581399    6275 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 19:48:09.593762 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.581402    6275 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 19:48:09.593762 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.581404    6275 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 19:48:09.593762 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.581407    6275 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 19:48:09.593762 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.581409    6275 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 19:48:09.593762 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.581426    6275 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 19:48:09.593762 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.581430    6275 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 19:48:09.594206 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.581432    6275 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 19:48:09.594206 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.581435    6275 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 19:48:09.594206 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.581437    6275 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 19:48:09.594206 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.581440    6275 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 19:48:09.594206 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.581443    6275 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 19:48:09.594206 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.581446    6275 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 19:48:09.594206 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.581449    6275 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 19:48:09.594206 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.581451    6275 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 19:48:09.594206 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.581454    6275 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 19:48:09.594206 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.581456    6275 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 19:48:09.594206 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.581459    6275 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 19:48:09.594206 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.581461    6275 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 19:48:09.594206 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.581464    6275 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 19:48:09.594206 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.581466    6275 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 19:48:09.594206 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.581470    6275 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 19:48:09.594206 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.581474    6275 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 19:48:09.594206 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.581477    6275 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 19:48:09.594206 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.581480    6275 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 19:48:09.594206 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.581483    6275 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 19:48:09.594676 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.581485    6275 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 19:48:09.594676 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.581488    6275 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 19:48:09.594676 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.581515    6275 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]}
Oct 30 19:48:09.594676 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.581672    6275 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 19:48:09.594676 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.581677    6275 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 19:48:09.594676 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.581680    6275 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 19:48:09.594676 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.581683    6275 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 19:48:09.594676 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.581686    6275 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 19:48:09.594676 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.581689    6275 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 19:48:09.594676 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.581692    6275 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 19:48:09.594676 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.581695    6275 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 19:48:09.594676 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.581697    6275 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 19:48:09.594676 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.581700    6275 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 19:48:09.594676 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.581703    6275 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 19:48:09.594676 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.581705    6275 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 19:48:09.594676 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.581708    6275 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 19:48:09.595056 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.581710    6275 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 19:48:09.595056 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.581713    6275 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 19:48:09.595056 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.581716    6275 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 19:48:09.595056 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.581718    6275 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 19:48:09.595056 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.581721    6275 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 19:48:09.595056 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.581724    6275 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 19:48:09.595056 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.581727    6275 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 19:48:09.595056 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.581730    6275 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 19:48:09.595056 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.581733    6275 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 19:48:09.595056 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.581735    6275 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 19:48:09.595056 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.581738    6275 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 19:48:09.595056 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.581741    6275 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 19:48:09.595056 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.581743    6275 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 19:48:09.595056 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.581746    6275 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 19:48:09.595056 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.581748    6275 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 19:48:09.595056 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.581750    6275 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 19:48:09.595056 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.581753    6275 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 19:48:09.595056 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.581755    6275 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 19:48:09.595056 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.581759    6275 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 19:48:09.595056 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.581761    6275 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 19:48:09.595565 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.581764    6275 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 19:48:09.595565 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.581767    6275 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 19:48:09.595565 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.581769    6275 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 19:48:09.595565 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.581772    6275 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 19:48:09.595565 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.581774    6275 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 19:48:09.595565 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.581778    6275 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 19:48:09.595565 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.581781    6275 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 19:48:09.595565 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.581783    6275 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 19:48:09.595565 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.581786    6275 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 19:48:09.595565 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.581788    6275 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 19:48:09.595565 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.581791    6275 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 19:48:09.595565 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.581794    6275 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 19:48:09.595565 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.581796    6275 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 19:48:09.595565 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.581799    6275 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 19:48:09.595565 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.581802    6275 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 19:48:09.595565 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.581805    6275 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 19:48:09.595565 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.581807    6275 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 19:48:09.595565 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.581810    6275 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 19:48:09.595565 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.581812    6275 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 19:48:09.596021 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.581815    6275 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 19:48:09.596021 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.581817    6275 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 19:48:09.596021 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.581820    6275 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 19:48:09.596021 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.581822    6275 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 19:48:09.596021 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.581825    6275 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 19:48:09.596021 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.581827    6275 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 19:48:09.596021 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.581830    6275 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 19:48:09.596021 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.581832    6275 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 19:48:09.596021 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.581835    6275 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 19:48:09.596021 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.581837    6275 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 19:48:09.596021 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.581840    6275 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 19:48:09.596021 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.581843    6275 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 19:48:09.596021 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.581846    6275 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 19:48:09.596021 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.581848    6275 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 19:48:09.596021 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.581851    6275 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 19:48:09.596021 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.581853    6275 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 19:48:09.596021 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.581856    6275 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 19:48:09.596021 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.581858    6275 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 19:48:09.596021 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.581861    6275 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 19:48:09.596021 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.581864    6275 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 19:48:09.596522 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.581868    6275 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 19:48:09.596522 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.581872    6275 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 19:48:09.596522 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.581875    6275 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 19:48:09.596522 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.581878    6275 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 19:48:09.596522 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.581881    6275 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 19:48:09.596522 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.581883    6275 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 19:48:09.596522 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.581886    6275 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 19:48:09.596522 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.581889    6275 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 19:48:09.596522 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.581892    6275 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 19:48:09.596522 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.581895    6275 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 19:48:09.596522 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.581897    6275 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 19:48:09.596522 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.581900    6275 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 19:48:09.596522 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.581902    6275 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 19:48:09.596522 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.581905    6275 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 19:48:09.596522 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.581907    6275 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 19:48:09.596522 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.581910    6275 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 19:48:09.596522 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.581913    6275 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 19:48:09.596522 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.581915    6275 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 19:48:09.596965 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.581919    6275 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 19:48:09.596965 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.581923    6275 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 19:48:09.596965 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.581926    6275 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 19:48:09.596965 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.581929    6275 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 19:48:09.596965 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.581932    6275 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 19:48:09.596965 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.581937    6275 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 19:48:09.596965 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.581940    6275 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 19:48:09.596965 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.581943    6275 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 19:48:09.596965 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.581946    6275 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 19:48:09.596965 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.581948    6275 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 19:48:09.596965 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.581951    6275 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 19:48:09.596965 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.581953    6275 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 19:48:09.596965 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.581956    6275 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 19:48:09.596965 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.581958    6275 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 19:48:09.596965 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.581964    6275 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 19:48:09.596965 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.581967    6275 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 19:48:09.597364 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.581990    6275 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]}
Oct 30 19:48:09.597364 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.582021    6275 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 19:48:09.597364 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.582025    6275 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 19:48:09.597364 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.582028    6275 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 19:48:09.597364 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.582031    6275 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 19:48:09.597364 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.582034    6275 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 19:48:09.597364 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.582037    6275 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 19:48:09.597364 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.582040    6275 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 19:48:09.597364 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.582042    6275 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 19:48:09.597364 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.582045    6275 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 19:48:09.597364 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.582048    6275 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 19:48:09.597364 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.582050    6275 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 19:48:09.597364 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.582053    6275 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 19:48:09.597364 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.582056    6275 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 19:48:09.597364 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.582059    6275 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 19:48:09.597364 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.582062    6275 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 19:48:09.597803 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.582065    6275 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 19:48:09.597803 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.582068    6275 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 19:48:09.597803 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.582070    6275 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 19:48:09.597803 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.582073    6275 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 19:48:09.597803 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.582075    6275 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 19:48:09.597803 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.582078    6275 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 19:48:09.597803 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.582083    6275 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 19:48:09.597803 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.582085    6275 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 19:48:09.597803 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.582088    6275 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 19:48:09.597803 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.582090    6275 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 19:48:09.597803 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.582093    6275 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 19:48:09.597803 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.582095    6275 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 19:48:09.597803 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.582098    6275 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 19:48:09.597803 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.582100    6275 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 19:48:09.597803 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.582103    6275 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 19:48:09.597803 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.582106    6275 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 19:48:09.597803 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.582109    6275 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 19:48:09.597803 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.582111    6275 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 19:48:09.597803 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.582114    6275 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 19:48:09.597803 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.582117    6275 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 19:48:09.598284 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.582119    6275 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 19:48:09.598284 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.582122    6275 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 19:48:09.598284 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.582124    6275 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 19:48:09.598284 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.582127    6275 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 19:48:09.598284 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.582130    6275 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 19:48:09.598284 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.582133    6275 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 19:48:09.598284 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.582135    6275 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 19:48:09.598284 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.582138    6275 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 19:48:09.598284 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.582140    6275 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 19:48:09.598284 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.582143    6275 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 19:48:09.598284 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.582146    6275 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 19:48:09.598284 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.582148    6275 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 19:48:09.598284 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.582150    6275 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 19:48:09.598284 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.582153    6275 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 19:48:09.598284 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.582155    6275 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 19:48:09.598284 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.582158    6275 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 19:48:09.598284 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.582160    6275 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 19:48:09.598284 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.582163    6275 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 19:48:09.598284 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.582167    6275 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 19:48:09.598284 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.582170    6275 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 19:48:09.598765 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.582173    6275 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 19:48:09.598765 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.582175    6275 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 19:48:09.598765 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.582178    6275 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 19:48:09.598765 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.582181    6275 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 19:48:09.598765 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.582184    6275 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 19:48:09.598765 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.582186    6275 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 19:48:09.598765 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.582189    6275 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 19:48:09.598765 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.582192    6275 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 19:48:09.598765 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.582195    6275 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 19:48:09.598765 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.582198    6275 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 19:48:09.598765 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.582200    6275 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 19:48:09.598765 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.582204    6275 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 19:48:09.598765 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.582208    6275 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 19:48:09.598765 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.582211    6275 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 19:48:09.598765 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.582214    6275 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 19:48:09.598765 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.582216    6275 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 19:48:09.598765 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.582219    6275 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 19:48:09.598765 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.582222    6275 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 19:48:09.598765 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.582224    6275 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 19:48:09.598765 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.582227    6275 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 19:48:09.599281 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.582229    6275 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 19:48:09.599281 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.582232    6275 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 19:48:09.599281 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.582235    6275 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 19:48:09.599281 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.582237    6275 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 19:48:09.599281 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.582240    6275 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 19:48:09.599281 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.582242    6275 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 19:48:09.599281 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.582245    6275 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 19:48:09.599281 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.582247    6275 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 19:48:09.599281 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.582250    6275 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 19:48:09.599281 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.582254    6275 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 19:48:09.599281 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.582259    6275 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 19:48:09.599281 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.582262    6275 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 19:48:09.599281 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.582265    6275 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 19:48:09.599281 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.582267    6275 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 19:48:09.599281 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.582272    6275 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 19:48:09.599281 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.582275    6275 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 19:48:09.599281 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.582277    6275 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 19:48:09.599281 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.582280    6275 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 19:48:09.599281 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.582282    6275 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 19:48:09.599743 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.582285    6275 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 19:48:09.599743 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.582288    6275 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 19:48:09.599743 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.582290    6275 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 19:48:09.599743 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.582293    6275 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 19:48:09.599743 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.582296    6275 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 19:48:09.599743 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.582298    6275 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 19:48:09.599743 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.582301    6275 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 19:48:09.599743 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.582304    6275 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 19:48:09.599743 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.582306    6275 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 19:48:09.599743 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.582310    6275 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 19:48:09.599743 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.582313    6275 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 19:48:09.599743 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:09.582315    6275 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 19:48:09.599743 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.582369    6275 server.go:957] "Client rotation is on, will bootstrap in background"
Oct 30 19:48:09.599743 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.583297    6275 bootstrap.go:85] "Current kubeconfig file contents are still valid, no bootstrap necessary"
Oct 30 19:48:09.599743 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.583353    6275 certificate_store.go:147] "Loading cert/key pair from a file" filePath="/var/lib/kubelet/pki/kubelet-client-current.pem"
Oct 30 19:48:09.599743 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.583536    6275 server.go:1014] "Starting client certificate rotation"
Oct 30 19:48:09.599743 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.583676    6275 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Oct 30 19:48:09.600165 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.583731    6275 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-10-29 19:41:58 +0000 UTC" deadline="2028-06-23 01:51:25.638564105 +0000 UTC"
Oct 30 19:48:09.600165 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.583764    6275 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14430h3m16.054802105s"
Oct 30 19:48:09.600165 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.583982    6275 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Oct 30 19:48:09.600165 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.585049    6275 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Oct 30 19:48:09.600165 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.586204    6275 log.go:25] "Validated CRI v1 runtime API"
Oct 30 19:48:09.600165 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.587966    6275 log.go:25] "Validated CRI v1 image API"
Oct 30 19:48:09.600165 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.588696    6275 server.go:1424] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Oct 30 19:48:09.600165 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.590506    6275 fs.go:135] Filesystem UUIDs: map[455dd795-fa59-424c-b8ae-e44778e57212:/dev/nvme0n1p4 51a6363d-8227-4b3c-b770-e4f567ac8305:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2]
Oct 30 19:48:09.600460 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.590527    6275 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:24 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:26 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/08e9fcba79fcf7911525e4a7031678ea05684ef0cf9bc90dcba9f2553b6ee26d/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/08e9fcba79fcf7911525e4a7031678ea05684ef0cf9bc90dcba9f2553b6ee26d/userdata/shm major:0 minor:76 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/14008bf705641ffb3281fb0bcdc659e9c04920b28abc74ab2d20a32fd522fd1b/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/14008bf705641ffb3281fb0bcdc659e9c04920b28abc74ab2d20a32fd522fd1b/userdata/shm major:0 minor:94 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/16c973cc9429ce09b3d75aba02e587029e1000442a874babd48302ea6ff644c6/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/16c973cc9429ce09b3d75aba02e587029e1000442a874babd48302ea6ff644c6/userdata/shm major:0 minor:320 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/19280f397c327dc16a39273a8783766f604907123b4e5f3f1982a8ca45bfe016/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/19280f397c327dc16a39273a8783766f604907123b4e5f3f1982a8ca45bfe016/userdata/shm major:0 minor:374 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/2105619691f7a9f0fb7172d3443de0333e4696cef6b4ef4715185f6820c93fc6/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/2105619691f7a9f0fb7172d3443de0333e4696cef6b4ef4715185f6820c93fc6/userdata/shm major:0 minor:255 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/41241145138f8bb696f121cb22714ecd4cfa99755caad8984db4796c91738397/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/41241145138f8bb696f121cb22714ecd4cfa99755caad8984db4796c91738397/userdata/shm major:0 minor:49 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/4bd6740c4b3c983baf7993ac113f19f2c0659e6ef20b3daaf63c87d7190dee56/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/4bd6740c4b3c983baf7993ac113f19f2c0659e6ef20b3daaf63c87d7190dee56/userdata/shm major:0 minor:205 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/4ebb78fce880638671623bacc3e166cfcd3a4f559203aa81b67ecc6e487a6d17/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/4ebb78fce880638671623bacc3e166cfcd3a4f559203aa81b67ecc6e487a6d17/userdata/shm major:0 minor:98 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/5b1809f8a15a1c5d1e661b1743ea01f10b50539894af0b0e34d3f8689d5b92ee/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/5b1809f8a15a1c5d1e661b1743ea01f10b50539894af0b0e34d3f8689d5b92ee/userdata/shm major:0 minor:333 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/5e62c1b378371730d47613f8c72078e49fc9fc9ba81df083635f257ea6984719/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/5e62c1b378371730d47613f8c72078e49fc9fc9ba81df083635f257ea6984719/userdata/shm major:0 minor:265 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/6bfca021e25a7be7c0f5098b275d73b34ddbaa220eeb80baa16b70143e6fc01f/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/6bfca021e25a7be7c0f5098b275d73b34ddbaa220eeb80baa16b70143e6fc01f/userdata/shm major:0 minor:77 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/6f85a5b9cbb30099b83741b8bcab9fd453d2b5473186a0935db97291bcef7ff4/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/6f85a5b9cbb30099b83741b8bcab9fd453d2b5473186a0935db97291bcef7ff4/userdata/shm major:0 minor:371 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/713a63aaf2ee585ab3db9d19c47f6cd31a16bc85735d223ed3868d3e060ffa05/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/713a63aaf2ee585ab3db9d19c47f6cd31a16bc85735d223ed3868d3e060ffa05/userdata/shm major:0 minor:68 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/7150493b132eee1de4f50e8c442864c7ecc649e2ff6b205c2f287c08945e632a/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/7150493b132eee1de4f50e8c442864c7ecc649e2ff6b205c2f287c08945e632a/userdata/shm major:0 minor:72 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/afde50971c21129bb07c0fdf20b1a8d49f2c07ca234f26330f66784acd6f135f/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/afde50971c21129bb07c0fdf20b1a8d49f2c07ca234f26330f66784acd6f135f/userdata/shm major:0 minor:90 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/b07a99877d65e3d23e9c7c394189c2b53522da922b3f237f3c29395698d1e1b9/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/b07a99877d65e3d23e9c7c394189c2b53522da922b3f237f3c29395698d1e1b9/userdata/shm major:0 minor:209 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/b12583b58d445757934cc974f891e7ddb1bd4eee5dc3c66d6f71aa27b0ecbd4d/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/b12583b58d445757934cc974f891e7ddb1bd4eee5dc3c66d6f71aa27b0ecbd4d/userdata/shm major:0 minor:47 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/b8e14484065a269f37c47a3f8c7a26eea49c5a9d48fb63f397206fd4940526ba/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/b8e14484065a269f37c47a3f8c7a26eea49c5a9d48fb63f397206fd4940526ba/userdata/shm major:0 minor:369 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/d1934139957babd59f55f6864275e7623cdebdefc4b4936a58a082f485428377/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/d1934139957babd59f55f6864275e7623cdebdefc4b4936a58a082f485428377/userdata/shm major:0 minor:86 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/ecd718a1716e1db2862ec587b63e49896ea841b131d4ee2e535d7989dcdf99dc/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/ecd718a1716e1db2862ec587b63e49896ea841b131d4ee2e535d7989dcdf99dc/userdata/shm major:0 minor:207 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/ff00162e6d55d62823b7a9c310a3addac8bd4567665c1ecfda4330e1319d2c5a/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/ff00162e6d55d62823b7a9c310a3addac8bd4567665c1ecfda4330e1319d2c5a/userdata/shm major:0 minor:258 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:32 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/0a8c4dcc-2f62-4efe-993e-2de411ce6654/volumes/kubernetes.io~projected/kube-api-access-l9vw6:{mountpoint:/var/lib/kubelet/pods/0a8c4dcc-2f62-4efe-993e-2de411ce6654/volumes/kubernetes.io~projected/kube-api-access-l9vw6 major:0 minor:64 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/0a8c4dcc-2f62-4efe-993e-2de411ce6654/volumes/kubernetes.io~secret/metrics-certs:{mountpoint:/var/lib/kubelet/pods/0a8c4dcc-2f62-4efe-993e-2de411ce6654/volumes/kubernetes.io~secret/metrics-certs major:0 minor:363 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/20819707-689f-4b17-8762-802fd5152c71/volumes/kubernetes.io~projected/kube-api-access-w27xp:{mountpoint:/var/lib/kubelet/pods/20819707-689f-4b17-8762-802fd5152c71/volumes/kubernetes.io~projected/kube-api-access-w27xp major:0 minor:252 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/20819707-689f-4b17-8762-802fd5152c71/volumes/kubernetes.io~secret/openshift-state-metrics-kube-rbac-proxy-config:{mountpoint:/var/lib/kubelet/pods/20819707-689f-4b17-8762-802fd5152c71/volumes/kubernetes.io~secret/openshift-state-metrics-kube-rbac-proxy-config major:0 minor:246 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/20819707-689f-4b17-8762-802fd5152c71/volumes/kubernetes.io~secret/openshift-state-metrics-tls:{mountpoint:/var/lib/kubelet/pods/20819707-689f-4b17-8762-802fd5152c71/volumes/kubernetes.io~secret/openshift-state-metrics-tls major:0 minor:251 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/2a71410e-a1ce-479e-a9ea-261a4e41f6e3/volumes/kubernetes.io~projected/kube-api-access-x2lwt:{mountpoint:/var/lib/kubelet/pods/2a71410e-a1ce-479e-a9ea-261a4e41f6e3/volumes/kubernetes.io~projected/kube-api-access-x2lwt major:0 minor:264 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/2a71410e-a1ce-479e-a9ea-261a4e41f6e3/volumes/kubernetes.io~secret/kube-state-metrics-kube-rbac-proxy-config:{mountpoint:/var/lib/kubelet/pods/2a71410e-a1ce-479e-a9ea-261a4e41f6e3/volumes/kubernetes.io~secret/kube-state-metrics-kube-rbac-proxy-config major:0 minor:262 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/2a71410e-a1ce-479e-a9ea-261a4e41f6e3/volumes/kubernetes.io~secret/kube-state-metrics-tls:{mountpoint:/var/lib/kubelet/pods/2a71410e-a1ce-479e-a9ea-261a4e41f6e3/volumes/kubernetes.io~secret/kube-state-metrics-tls major:0 minor:263 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/2be7f3a3-8714-491c-8e10-c594d425069a/volumes/kubernetes.io~secret/agent-certs:{mountpoint:/var/lib/kubelet/pods/2be7f3a3-8714-491c-8e10-c594d425069a/volumes/kubernetes.io~secret/agent-certs major:0 minor:58 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/2d3597bf-5138-4272-905b-d2fdd3bfbe7b/volumes/kubernetes.io~projected/kube-api-access-v75vv:{mountpoint:/var/lib/kubelet/pods/2d3597bf-5138-4272-905b-d2fdd3bfbe7b/volumes/kubernetes.io~projected/kube-api-access-v75vv major:0 minor:63 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/34dfa231-fa1a-400c-82b4-6ee85859d7c4/volumes/kubernetes.io~projected/kube-api-access-mwhbg:{mountpoint:/var/lib/kubelet/pods/34dfa231-fa1a-400c-82b4-6ee85859d7c4/volumes/kubernetes.io~projected/kube-api-access-mwhbg major:0 minor:66 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/423e0100-284b-48b9-bd4c-3b74005976d2/volumes/kubernetes.io~projected/kube-api-access-njzf8:{mountpoint:/var/lib/kubelet/pods/423e0100-284b-48b9-bd4c-3b74005976d2/volumes/kubernetes.io~projected/kube-api-access-njzf8 major:0 minor:61 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/45a7e195-0bbf-46cb-b821-30728122c3fc/volumes/kubernetes.io~projected/kube-api-access-jvx29:{mountpoint:/var/lib/kubelet/pods/45a7e195-0bbf-46cb-b821-30728122c3fc/volumes/kubernetes.io~projected/kube-api-access-jvx29 major:0 minor:204 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/45a7e195-0bbf-46cb-b821-30728122c3fc/volumes/kubernetes.io~secret/cert:{mountpoint:/var/lib/kubelet/pods/45a7e195-0bbf-46cb-b821-30728122c3fc/volumes/kubernetes.io~secret/cert major:0 minor:201 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/4d52cf11-23b8-4b48-92ec-009845eea77f/volumes/kubernetes.io~projected/kube-api-access-rmn47:{mountpoint:/var/lib/kubelet/pods/4d52cf11-23b8-4b48-92ec-009845eea77f/volumes/kubernetes.io~projected/kube-api-access-rmn47 major:0 minor:202 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/4d52cf11-23b8-4b48-92ec-009845eea77f/volumes/kubernetes.io~secret/metrics-tls:{mountpoint:/var/lib/kubelet/pods/4d52cf11-23b8-4b48-92ec-009845eea77f/volumes/kubernetes.io~secret/metrics-tls major:0 minor:197 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/5a23369d-e69d-40e0-a956-a109d6d653c1/volumes/kubernetes.io~projected/kube-api-access-plsvs:{mountpoint:/var/lib/kubelet/pods/5a23369d-e69d-40e0-a956-a109d6d653c1/volumes/kubernetes.io~projected/kube-api-access-plsvs major:0 minor:203 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/5a23369d-e69d-40e0-a956-a109d6d653c1/volumes/kubernetes.io~secret/insights-runtime-extractor-tls:{mountpoint:/var/lib/kubelet/pods/5a23369d-e69d-40e0-a956-a109d6d653c1/volumes/kubernetes.io~secret/insights-runtime-extractor-tls major:0 minor:45 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/641c89ab-1e2c-4e67-84b5-d5d0f4f30756/volumes/kubernetes.io~projected/kube-api-access-hk8r5:{mountpoint:/var/lib/kubelet/pods/641c89ab-1e2c-4e67-84b5-d5d0f4f30756/volumes/kubernetes.io~projected/kube-api-access-hk8r5 major:0 minor:65 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/6b02f882-10f6-47c4-84a0-8c07533bbb7d/volumes/kubernetes.io~projected/kube-api-access-tx724:{mountpoint:/var/lib/kubelet/pods/6b02f882-10f6-47c4-84a0-8c07533bbb7d/volumes/kubernetes.io~projected/kube-api-access-tx724 major:0 minor:319 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/6b02f882-10f6-47c4-84a0-8c07533bbb7d/volumes/kubernetes.io~secret/secret-grpc-tls:{mountpoint:/var/lib/kubelet/pods/6b02f882-10f6-47c4-84a0-8c07533bbb7d/volumes/kubernetes.io~secret/secret-grpc-tls major:0 minor:310 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/6b02f882-10f6-47c4-84a0-8c07533bbb7d/volumes/kubernetes.io~secret/secret-thanos-querier-kube-rbac-proxy:{mountpoint:/var/lib/kubelet/pods/6b02f882-10f6-47c4-84a0-8c07533bbb7d/volumes/kubernetes.io~secret/secret-thanos-querier-kube-rbac-proxy major:0 minor:317 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/6b02f882-10f6-47c4-84a0-8c07533bbb7d/volumes/kubernetes.io~secret/secret-thanos-querier-kube-rbac-proxy-metrics:{mountpoint:/var/lib/kubelet/pods/6b02f882-10f6-47c4-84a0-8c07533bbb7d/volumes/kubernetes.io~secret/secret-thanos-querier-kube-rbac-proxy-metrics major:0 minor:314 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/6b02f882-10f6-47c4-84a0-8c07533bbb7d/volumes/kubernetes.io~secret/secret-thanos-querier-kube-rbac-proxy-rules:{mountpoint:/var/lib/kubelet/pods/6b02f882-10f6-47c4-84a0-8c07533bbb7d/volumes/kubernetes.io~secret/secret-thanos-querier-kube-rbac-proxy-rules major:0 minor:315 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/6b02f882-10f6-47c4-84a0-8c07533bbb7d/volumes/kubernetes.io~secret/secret-thanos-querier-kube-rbac-proxy-web:{mountpoint:/var/lib/kubelet/pods/6b02f882-10f6-47c4-84a0-8c07533bbb7d/volumes/kubernetes.io~secret/secret-thanos-querier-kube-rbac-proxy-web major:0 minor:318 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/6b02f882-10f6-47c4-84a0-8c07533bbb7d/volumes/kubernetes.io~secret/secret-thanos-querier-tls:{mountpoint:/var/lib/kubelet/pods/6b02f882-10f6-47c4-84a0-8c07533bbb7d/volumes/kubernetes.io~secret/secret-thanos-querier-tls major:0 minor:316 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/8d3e77a0-4ee8-4429-9795-97fb3d799dba/volumes/kubernetes.io~projected/kube-api-access-7drkj:{mountpoint:/var/lib/kubelet/pods/8d3e77a0-4ee8-4429-9795-97fb3d799dba/volumes/kubernetes.io~projected/kube-api-access-7drkj major:0 minor:59 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/90b35edf-4b09-41df-9374-a514d1417071/volumes/kubernetes.io~secret/original-pull-secret:{mountpoint:/var/lib/kubelet/pods/90b35edf-4b09-41df-9374-a514d1417071/volumes/kubernetes.io~secret/original-pull-secret major:0 minor:368 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/9898418c-eb0f-41b4-a844-d853caeab57f/volumes/kubernetes.io~projected/kube-api-access-2gglq:{mountpoint:/var/lib/kubelet/pods/9898418c-eb0f-41b4-a844-d853caeab57f/volumes/kubernetes.io~projected/kube-api-access-2gglq major:0 minor:60 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/98dd829b-0745-4229-b781-da2c4ad16f9e/volume-subpaths/run-systemd/ovnkube-controller/6:{mountpoint:/var/lib/kubelet/pods/98dd829b-0745-4229-b781-da2c4ad16f9e/volume-subpaths/run-systemd/ovnkube-controller/6 major:0 minor:26 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/98dd829b-0745-4229-b781-da2c4ad16f9e/volumes/kubernetes.io~projected/kube-api-access-bz9kn:{mountpoint:/var/lib/kubelet/pods/98dd829b-0745-4229-b781-da2c4ad16f9e/volumes/kubernetes.io~projected/kube-api-access-bz9kn major:0 minor:67 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/98dd829b-0745-4229-b781-da2c4ad16f9e/volumes/kubernetes.io~secret/ovn-node-metrics-cert:{mountpoint:/var/lib/kubelet/pods/98dd829b-0745-4229-b781-da2c4ad16f9e/volumes/kubernetes.io~secret/ovn-node-metrics-cert major:0 minor:55 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/aa51899f-52a0-434e-b434-4bc030c94136/volumes/kubernetes.io~projected/kube-api-access-tmmdv:{mountpoint:/var/lib/kubelet/pods/aa51899f-52a0-434e-b434-4bc030c94136/volumes/kubernetes.io~projected/kube-api-access-tmmdv major:0 minor:373 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/ac20c88a-e9bd-42c8-bcbe-2080f2393cc3/volumes/kubernetes.io~empty-dir/etc-tuned:{mountpoint:/var/lib/kubelet/pods/ac20c88a-e9bd-42c8-bcbe-2080f2393cc3/volumes/kubernetes.io~empty-dir/etc-tuned major:0 minor:56 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/ac20c88a-e9bd-42c8-bcbe-2080f2393cc3/volumes/kubernetes.io~empty-dir/tmp:{mountpoint:/var/lib/kubelet/pods/ac20c88a-e9bd-42c8-bcbe-2080f2393cc3/volumes/kubernetes.io~empty-dir/tmp major:0 minor:57 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/ac20c88a-e9bd-42c8-bcbe-2080f2393cc3/volumes/kubernetes.io~projected/kube-api-access-r4zjc:{mountpoint:/var/lib/kubelet/pods/ac20c88a-e9bd-42c8-bcbe-2080f2393cc3/volumes/kubernetes.io~projected/kube-api-access-r4zjc major:0 minor:62 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/dde165c4-1ada-4fd6-af53-32fd75286c79/volumes/kubernetes.io~projected/kube-api-access-879bk:{mountpoint:/var/lib/kubelet/pods/dde165c4-1ada-4fd6-af53-32fd75286c79/volumes/kubernetes.io~projected/kube-api-access-879bk major:0 minor:257 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/dde165c4-1ada-4fd6-af53-32fd75286c79/volumes/kubernetes.io~secret/node-exporter-kube-rbac-proxy-config:{mountpoint:/var/lib/kubelet/pods/dde165c4-1ada-4fd6-af53-32fd75286c79/volumes/kubernetes.io~secret/node-exporter-kube-rbac-proxy-config major:0 minor:254 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/dde165c4-1ada-4fd6-af53-32fd75286c79/volumes/kubernetes.io~secret/node-exporter-tls:{mountpoint:/var/lib/kubelet/pods/dde165c4-1ada-4fd6-af53-32fd75286c79/volumes/kubernetes.io~secret/node-exporter-tls major:0 minor:253 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/e7fb91fc-bf9e-42c6-b440-7165063ae5ec/volumes/kubernetes.io~projected/kube-api-access-bvnbm:{mountpoint:/var/lib/kubelet/pods/e7fb91fc-bf9e-42c6-b440-7165063ae5ec/volumes/kubernetes.io~projected/kube-api-access-bvnbm major:0 minor:326 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/e7fb91fc-bf9e-42c6-b440-7165063ae5ec/volumes/kubernetes.io~secret/monitoring-plugin-cert:{mountpoint:/var/lib/kubelet/pods/e7fb91fc-bf9e-42c6-b440-7165063ae5ec/volumes/kubernetes.io~secret/monitoring-plugin-cert major:0 minor:324 fsType:tmpfs blockSize:0} composefs_0-34:{mountpoint:/ major:0 minor:34 fsType:overlay blockSize:0} overlay_0-100:{mountpoint:/var/lib/containers/storage/overlay/f288705bdeb2ba78650ce418e5499f4d078f502c0f53fe486989c5ce4c9b350e/merged major:0 minor:100 fsType:overlay blockSize:0} overlay_0-102:{mountpoint:/var/lib/containers/storage/overlay/83f9c77e4aee9e59ca36fbd46797ffcbd21dc712e3d87feed516cf065f4c63c2/merged major:0 minor:102 fsType:overlay blockSize:0} overlay_0-104:{mountpoint:/var/lib/containers/storage/overlay/2f37c057c5cf2a56c94bc72f3337fa7eb75959badaf51d9374b49b99c82d47e1/merged major:0 minor:104 fsType:overlay blockSize:0} overlay_0-105:{mountpoint:/var/lib/containers/storage/overlay/ee12cea5ccc73c8402ba34bf26e74bf629729cc175e3011ef0d160ab71e5be5f/merged major:0 minor:105 fsType:overlay blockSize:0} overlay_0-114:{mountpoint:/var/lib/containers/storage/overlay/eb8601d7e05cd8f62dada69b8ea99e3ebb244e3d3afff115329a3b1edeac5be2/merged major:0 minor:114 fsType:overlay blockSize:0} overlay_0-119:{mountpoint:/var/lib/containers/storage/overlay/dbc732fe17744a8eaf606c26c39a75a27ff5d5aed6159a36d40b8ea2cc00171b/merged major:0 minor:119 fsType:overlay blockSize:0} overlay_0-124:{mountpoint:/var/lib/containers/storage/overlay/81fe7dd2b36e7f8cc4bc051885f7f504ac597c2248c94542ff1d3d2668482229/merged major:0 minor:124 fsType:overlay blockSize:0} overlay_0-127:{mountpoint:/var/lib/containers/storage/overlay/ddd4638b16674071f36fecb0184fb73d5a81773144a759e6da74689112b07947/merged major:0 minor:127 fsType:overlay blockSize:0} overlay_0-132:{mountpoint:/var/lib/containers/storage/overlay/98bb34251ff1678e30d0cc854a7b6ec2c3487250632c824a01cad7fad147475b/merged major:0 minor:132 fsType:overlay blockSize:0} overlay_0-137:{mountpoint:/var/lib/containers/storage/overlay/1dde252a454fa8ef3e1afcac7e7b894eb124577bd4fbc3ea15c88d1bcf79a6a2/merged major:0 minor:137 fsType:overlay blockSize:0} overlay_0-144:{mountpoint:/var/lib/containers/storage/overlay/33f8679ff9e938f4f7fd226aabe8dc5f736897f83a39417a80104fd6e98ced41/merged major:0 minor:144 fsType:overlay blockSize:0} overlay_0-146:{mountpoint:/var/lib/containers/storage/overlay/2b9d695b3d764977dfe357a3da2e01fe87afb68f429bb51c048881753aa8ce64/merged major:0 minor:146 fsType:overlay blockSize:0} overlay_0-149:{mountpoint:/var/lib/containers/storage/overlay/f6e1d2d69cbee224631ce6154c418d03276599f3c06204df444c91a4b665b220/merged major:0 minor:149 fsType:overlay blockSize:0} overlay_0-157:{mountpoint:/var/lib/containers/storage/overlay/f81dc213cb05bb8b376bca7e0019b7cf602caffcdc9bfe3fa955cc3ff0d6fe9b/merged major:0 minor:157 fsType:overlay blockSize:0} overlay_0-162:{mountpoint:/var/lib/containers/storage/overlay/a3f1e5b514ce14fe82f3488cd6c13b835770047b4785c163545185b4295b9c9b/merged major:0 minor:162 fsType:overlay blockSize:0} overlay_0-167:{mountpoint:/var/lib/containers/storage/overlay/a0b4e05b834c641b0a751b846668433bd620f2aa78c6f2544d7f9ecba292ed14/merged major:0 minor:167 fsType:overlay blockSize:0} overlay_0-172:{mountpoint:/var/lib/containers/storage/overlay/b619f506c78c7435a89fb75026cdea4c99eccd69d0e2d9973e2805f751770eb5/merged major:0 minor:172 fsType:overlay blockSize:0} overlay_0-177:{mountpoint:/var/lib/containers/storage/overlay/450fa5a43ec8802ce63ca8a6b148c9be667ab3d262e6da3f468a28398094220c/merged major:0 minor:177 fsType:overlay blockSize:0} overlay_0-182:{mountpoint:/var/lib/containers/storage/overlay/bb6e74e68aa83965cbb1ba3c743ed66226582040206ffce1b9dd9e3eb39581cf/merged major:0 minor:182 fsType:overlay blockSize:0} overlay_0-187:{mountpoint:/var/lib/containers/storage/overlay/a719f0e6b3dfb0dc5c50981180ec2dce83a8e6fd6a330cb5233e6051c58ced8b/merged major:0 minor:187 fsType:overlay blockSize:0} overlay_0-192:{mountpoint:/var/lib/containers/storage/overlay/7e89eaba476952fe9b61cee9b6e88dafe619626520eedc6313a974103e063b96/merged major:0 minor:192 fsType:overlay blockSize:0} overlay_0-211:{mountpoint:/var/lib/containers/storage/overlay/991ddbd404cbaf72558f52aee8e3df2e246e7334de78128a526223161320460a/merged major:0 minor:211 fsType:overlay blockSize:0} overlay_0-213:{mountpoint:/var/lib/containers/storage/overlay/6ad3d84fe0e001e158ddb6d4e85d7769dd27bfc0cd12ade525369d4728989085/merged major:0 minor:213 fsType:overlay blockSize:0} overlay_0-215:{mountpoint:/var/lib/containers/storage/overlay/0c5061d4f0674a469ee633e9e799e7f4e2ae17af223fe99c18ebb79705a46032/merged major:0 minor:215 fsType:overlay blockSize:0} overlay_0-217:{mountpoint:/var/lib/containers/storage/overlay/5bef371ecc6a02db3e605b618b330afc9b18ac34e4d63d58fa78c41318188d9c/merged major:0 minor:217 fsType:overlay blockSize:0} overlay_0-219:{mountpoint:/var/lib/containers/storage/overlay/397ac6f9d9d9476281d4e9a74b99a5a022ae6b1326a2116b6fcfe19456459cc2/merged major:0 minor:219 fsType:overlay blockSize:0} overlay_0-225:{mountpoint:/var/lib/containers/storage/overlay/b0fcaf92f0db9adf27d25817e56c428003697ac54e54af930f6a0495b832ea12/merged major:0 minor:225 fsType:overlay blockSize:0} overlay_0-230:{mountpoint:/var/lib/containers/storage/overlay/31609e89afa7c81381b37242e9075ec0a2d3f269d5e00e9fce289eff7750992d/merged major:0 minor:230 fsType:overlay blockSize:0} overlay_0-236:{mountpoint:/var/lib/containers/storage/overlay/1f4576278eaf5f2aa099743e74ab827a464fc18057dbd003ad86b2715b64e60e/merged major:0 minor:236 fsType:overlay blockSize:0} overlay_0-241:{mountpoint:/var/lib/containers/storage/overlay/1387a9c0a0999aac806a1e573250055689c7b79a2452194d86fade20673ee56c/merged major:0 minor:241 fsType:overlay blockSize:0} overlay_0-260:{mountpoint:/var/lib/containers/storage/overlay/df291ba8dc87b287314eaa1f4b3979fcb6a3da7817e77bc812b3ee0a0fe38ef5/merged major:0 minor:260 fsType:overlay blockSize:0} overlay_0-267:{mountpoint:/var/lib/containers/storage/overlay/8fddcb65e51c1151528b4c9b66af4fbd160ffb4292a8bd49a7a580d5f11c103e/merged major:0 minor:267 fsType:overlay blockSize:0} overlay_0-269:{mountpoint:/var/lib/containers/storage/overlay/608530be4816b9d47a2e75e856b964254b79772748504532399ada067bce3c2b/merged major:0 minor:269 fsType:overlay blockSize:0} overlay_0-271:{mountpoint:/var/lib/containers/storage/overlay/3bb8941c03c9820d8e31f97cf5c9d00124c411ae14f6318df41f93afcb43006a/merged major:0 minor:271 fsType:overlay blockSize:0} overlay_0-277:{mountpoint:/var/lib/containers/storage/overlay/1e5c6505eb18eeb901910f4a4b9e6e04b47d27c0d2b71d6039acb0040e4e94d5/merged major:0 minor:277 fsType:overlay blockSize:0} overlay_0-282:{mountpoint:/var/lib/containers/storage/overlay/1997ea909680422944d47591a9265debf4c95c5b0940b25f17c8114ffba1cfd2/merged major:0 minor:282 fsType:overlay blockSize:0} overlay_0-284:{mountpoint:/var/lib/containers/storage/overlay/ea3f8a71c1caa5cba9eea3e8d00fdcb42aa264a966dffe48ccf2a7ef2ec63080/merged major:0 minor:284 fsType:overlay blockSize:0} overlay_0-289:{mountpoint:/var/lib/containers/storage/overlay/1074cea0666cd70dfd8a496fbe6a7030628b27fa37da2ec25e2a9855f2fc378c/merged major:0 minor:289 fsType:overlay blockSize:0} overlay_0-295:{mountpoint:/var/lib/containers/storage/overlay/d76032bf00710f562a25bf0a083950319ddc0b82e15e4dcbcef8d8c1b20d2720/merged major:0 minor:295 fsType:overlay blockSize:0} overlay_0-300:{mountpoint:/var/lib/containers/storage/overlay/254494d0854f170abe4e3c410b89fdaad74caf8b46ad1ca7b9442a31b03b0c74/merged major:0 minor:300 fsType:overlay blockSize:0} overlay_0-305:{mountpoint:/var/lib/containers/storage/overlay/1e9c0fc26cb82a6bef17bdd452d68f3638ecf10427844954c9eac75aa4143226/merged major:0 minor:305 fsType:overlay blockSize:0} overlay_0-322:{mountpoint:/var/lib/containers/storage/overlay/d1814e4a0ff1eeb7cf974111d3d41893fcbc484d67ba75c0e4375c410c8b21cc/merged major:0 minor:322 fsType:overlay blockSize:0} overlay_0-325:{mountpoint:/var/lib/containers/storage/overlay/48f9e1a6e87322c43ad5dedf77d3db2c1062206460b0db05dee949d31911f70f/merged major:0 minor:325 fsType:overlay blockSize:0} overlay_0-328:{mountpoint:/var/lib/containers/storage/overlay/5e7c083ea4f9f7e7a14ac91bfd625ae2f0c3021667ce16527f66e541f203e997/merged major:0 minor:328 fsType:overlay blockSize:0} overlay_0-336:{mountpoint:/var/lib/containers/storage/overlay/c437b3919e10ad8566068a95cdcc3c07eb8ad1cfe29f021c5e7a8477c9d4c347/merged major:0 minor:336 fsType:overlay blockSize:0} overlay_0-341:{mountpoint:/var/lib/containers/storage/overlay/c69ad936f078d6aa4bee209b1169fea16255ffab8153d79b1d38e820c117d06d/merged major:0 minor:341 fsType:overlay blockSize:0} overlay_0-346:{mountpoint:/var/lib/containers/storage/overlay/37bf626d3dac44d7358d24c4f1154128d82817c6bab352f11edcb1acb5e1fd4c/merged major:0 minor:346 fsType:overlay blockSize:0} overlay_0-348:{mountpoint:/var/lib/containers/storage/overlay/9b9ccc377a119e7b3bdab73c998cc095149f9b0ab590a9d7ba7cbe70c8909d2b/merged major:0 minor:348 fsType:overlay blockSize:0} overlay_0-353:{mountpoint:/var/lib/containers/storage/overlay/f86a9771a49e0eb9bd56d271d42dc1e698b8f78d22046da47859c26e5c291d2b/merged major:0 minor:353 fsType:overlay blockSize:0} overlay_0-358:{mountpoint:/var/lib/containers/storage/overlay/390ba6d95da6ca7be89850e2d570f4e0bee1bf5cfba03f70fe9f5a3b2a6f2372/merged major:0 minor:358 fsType:overlay blockSize:0} overlay_0-376:{mountpoint:/var/lib/containers/storage/overlay/eddf6d734b32f5f5cae9b8651f81256a4e5dddc62171216ba704a50367c21be6/merged major:0 minor:376 fsType:overlay blockSize:0} overlay_0-378:{mountpoint:/var/lib/containers/storage/overlay/1caf9a32b69ac45790b12efa0cd8d381b8b656d6fc883a3a04eff8e2f83f7095/merged major:0 minor:378 fsType:overlay blockSize:0} overlay_0-380:{mountpoint:/var/lib/containers/storage/overlay/cc432134decc696d9f47d533c979e3b5285efad5c7022b288fa8f33d43e5b63c/merged major:0 minor:380 fsType:overlay blockSize:0} overlay_0-382:{mountpoint:/var/lib/containers/storage/overlay/6a0c16de3fe968f1d1f59f50f97405d62a426c3150c22b210fd1eb4191111bcf/merged major:0 minor:382 fsType:overlay blockSize:0} overlay_0-384:{mountpoint:/var/lib/containers/storage/overlay/8c54b4fdf0ef0073954d773931cc931c45b179259884939a1f3b05f108f16d81/merged major:0 minor:384 fsType:overlay blockSize:0} overlay_0-390:{mountpoint:/var/lib/containers/storage/overlay/d435e55740332014ff7d596cfe45fc4a80ca6ab9169bee5a2b73aab1e241598c/merged major:0 minor:390 fsType:overlay blockSize:0} overlay_0-395:{mountpoint:/var/lib/containers/storage/overlay/d596f5fe44ce6161b63a7c1626e047622a0cc8320d85b5ade781204d8352b2b6/merged major:0 minor:395 fsType:overlay blockSize:0} overlay_0-51:{mountpoint:/var/lib/containers/storage/overlay/6efd35c4d2ced46fd25e5175de083a97aacd1e483c99714a63cabd2a98a3e6f7/merged major:0 minor:51 fsType:overlay blockSize:0} overlay_0-53:{mountpoint:/var/lib/containers/storage/overlay/05c44c8ce2d5590f9b13017813a4b6c03dd6ce260393cab9a16f4e5ab0c60153/merged major:0 minor:53 fsType:overlay blockSize:0} overlay_0-70:{mountpoint:/var/lib/containers/storage/overlay/fcbe6cb9865783a1dc145a156cb7edc5775a9742a35dab2e1ed877f6f4bad9df/merged major:0 minor:70 fsType:overlay blockSize:0} overlay_0-74:{mountpoint:/var/lib/containers/storage/overlay/48e56b604bdd8033c85a670edd406eed7940e65b394b1739bea1fd2511890404/merged major:0 minor:74 fsType:overlay blockSize:0} overlay_0-79:{mountpoint:/var/lib/containers/storage/overlay/e5c79ff940051ede18e6f253e7e8dc9f5198999f175f50e5c12c217efefc3484/merged major:0 minor:79 fsType:overlay blockSize:0} overlay_0-81:{mountpoint:/var/lib/containers/storage/overlay/0e9f5c48070fbabebd47498bfc1631d2b57235bc9bf9bd8f662f79ceaa335ca9/merged major:0 minor:81 fsType:overlay blockSize:0} overlay_0-84:{mountpoint:/var/lib/containers/storage/overlay/fcd2c49b512d2981a638adb87ed43d1a29b9e1adf0bcdc5e0fcad22542fbda34/merged major:0 minor:84 fsType:overlay blockSize:0} overlay_0-88:{mountpoint:/var/lib/containers/storage/overlay/04106639b4e417a6d324618be8a78becfd5214d1df1d846a3a66485154c56ad2/merged major:0 minor:88 fsType:overlay blockSize:0} overlay_0-92:{mountpoint:/var/lib/containers/storage/overlay/b17ca8f045991637916102bf2536e41add1d857816fbfda2ce3ca3b0c9076518/merged major:0 minor:92 fsType:overlay blockSize:0} overlay_0-96:{mountpoint:/var/lib/containers/storage/overlay/2c14a152da5fb63e1de22c03bf6cb12c161df33d2d9329adfd493d963bee5f86/merged major:0 minor:96 fsType:overlay blockSize:0}]
Oct 30 19:48:09.600740 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.598718    6275 manager.go:217] Machine: {Timestamp:2026-10-30 19:48:09.598231057 +0000 UTC m=+0.059957911 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100678 MemoryCapacity:33164328960 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2381dcb6b9f609efac67e78896aa38 SystemUUID:ec2381dc-b6b9-f609-efac-67e78896aa38 BootID:35085445-56cc-4df2-8755-aacbea99658f Filesystems:[{Device:/var/lib/kubelet/pods/6b02f882-10f6-47c4-84a0-8c07533bbb7d/volumes/kubernetes.io~projected/kube-api-access-tx724 DeviceMajor:0 DeviceMinor:319 Capacity:31985729536 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/ac20c88a-e9bd-42c8-bcbe-2080f2393cc3/volumes/kubernetes.io~projected/kube-api-access-r4zjc DeviceMajor:0 DeviceMinor:62 Capacity:31985729536 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-105 DeviceMajor:0 DeviceMinor:105 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-225 DeviceMajor:0 DeviceMinor:225 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-346 DeviceMajor:0 DeviceMinor:346 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/98dd829b-0745-4229-b781-da2c4ad16f9e/volume-subpaths/run-systemd/ovnkube-controller/6 DeviceMajor:0 DeviceMinor:26 Capacity:6632865792 Type:vfs Inodes:819200 HasInodes:true} {Device:overlay_0-390 DeviceMajor:0 DeviceMinor:390 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-104 DeviceMajor:0 DeviceMinor:104 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-119 DeviceMajor:0 DeviceMinor:119 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/ecd718a1716e1db2862ec587b63e49896ea841b131d4ee2e535d7989dcdf99dc/userdata/shm DeviceMajor:0 DeviceMinor:207 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-213 DeviceMajor:0 DeviceMinor:213 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-53 DeviceMajor:0 DeviceMinor:53 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-88 DeviceMajor:0 DeviceMinor:88 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/e7fb91fc-bf9e-42c6-b440-7165063ae5ec/volumes/kubernetes.io~secret/monitoring-plugin-cert DeviceMajor:0 DeviceMinor:324 Capacity:31985729536 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-378 DeviceMajor:0 DeviceMinor:378 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-395 DeviceMajor:0 DeviceMinor:395 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:24 Capacity:16582164480 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-92 DeviceMajor:0 DeviceMinor:92 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/6b02f882-10f6-47c4-84a0-8c07533bbb7d/volumes/kubernetes.io~secret/secret-grpc-tls DeviceMajor:0 DeviceMinor:310 Capacity:31985729536 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-382 DeviceMajor:0 DeviceMinor:382 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/6b02f882-10f6-47c4-84a0-8c07533bbb7d/volumes/kubernetes.io~secret/secret-thanos-querier-kube-rbac-proxy DeviceMajor:0 DeviceMinor:317 Capacity:31985729536 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/90b35edf-4b09-41df-9374-a514d1417071/volumes/kubernetes.io~secret/original-pull-secret DeviceMajor:0 DeviceMinor:368 Capacity:31985729536 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/641c89ab-1e2c-4e67-84b5-d5d0f4f30756/volumes/kubernetes.io~projected/kube-api-access-hk8r5 DeviceMajor:0 DeviceMinor:65 Capacity:31985729536 Type:vfs Inodes:4048380 HasInodes:true} {Device:/run/containers/storage/overlay-containers/afde50971c21129bb07c0fdf20b1a8d49f2c07ca234f26330f66784acd6f135f/userdata/shm DeviceMajor:0 DeviceMinor:90 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-100 DeviceMajor:0 DeviceMinor:100 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-271 DeviceMajor:0 DeviceMinor:271 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/dde165c4-1ada-4fd6-af53-32fd75286c79/volumes/kubernetes.io~projected/kube-api-access-879bk DeviceMajor:0 DeviceMinor:257 Capacity:31985729536 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-284 DeviceMajor:0 DeviceMinor:284 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-305 DeviceMajor:0 DeviceMinor:305 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/41241145138f8bb696f121cb22714ecd4cfa99755caad8984db4796c91738397/userdata/shm DeviceMajor:0 DeviceMinor:49 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-79 DeviceMajor:0 DeviceMinor:79 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-167 DeviceMajor:0 DeviceMinor:167 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-182 DeviceMajor:0 DeviceMinor:182 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-219 DeviceMajor:0 DeviceMinor:219 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/dde165c4-1ada-4fd6-af53-32fd75286c79/volumes/kubernetes.io~secret/node-exporter-kube-rbac-proxy-config DeviceMajor:0 DeviceMinor:254 Capacity:31985729536 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/6b02f882-10f6-47c4-84a0-8c07533bbb7d/volumes/kubernetes.io~secret/secret-thanos-querier-kube-rbac-proxy-metrics DeviceMajor:0 DeviceMinor:314 Capacity:31985729536 Type:vfs Inodes:4048380 HasInodes:true} {Device:/run/containers/storage/overlay-containers/b07a99877d65e3d23e9c7c394189c2b53522da922b3f237f3c29395698d1e1b9/userdata/shm DeviceMajor:0 DeviceMinor:209 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-230 DeviceMajor:0 DeviceMinor:230 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-336 DeviceMajor:0 DeviceMinor:336 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/aa51899f-52a0-434e-b434-4bc030c94136/volumes/kubernetes.io~projected/kube-api-access-tmmdv DeviceMajor:0 DeviceMinor:373 Capacity:31985729536 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-51 DeviceMajor:0 DeviceMinor:51 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/9898418c-eb0f-41b4-a844-d853caeab57f/volumes/kubernetes.io~projected/kube-api-access-2gglq DeviceMajor:0 DeviceMinor:60 Capacity:31985729536 Type:vfs Inodes:4048380 HasInodes:true} {Device:/run/containers/storage/overlay-containers/5e62c1b378371730d47613f8c72078e49fc9fc9ba81df083635f257ea6984719/userdata/shm DeviceMajor:0 DeviceMinor:265 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-289 DeviceMajor:0 DeviceMinor:289 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-341 DeviceMajor:0 DeviceMinor:341 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-358 DeviceMajor:0 DeviceMinor:358 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-102 DeviceMajor:0 DeviceMinor:102 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/6b02f882-10f6-47c4-84a0-8c07533bbb7d/volumes/kubernetes.io~secret/secret-thanos-querier-kube-rbac-proxy-web DeviceMajor:0 DeviceMinor:318 Capacity:31985729536 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-325 DeviceMajor:0 DeviceMinor:325 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/b12583b58d445757934cc974f891e7ddb1bd4eee5dc3c66d6f71aa27b0ecbd4d/userdata/shm DeviceMajor:0 DeviceMinor:47 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-124 DeviceMajor:0 DeviceMinor:124 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-172 DeviceMajor:0 DeviceMinor:172 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-187 DeviceMajor:0 DeviceMinor:187 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-211 DeviceMajor:0 DeviceMinor:211 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-217 DeviceMajor:0 DeviceMinor:217 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-277 DeviceMajor:0 DeviceMinor:277 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-282 DeviceMajor:0 DeviceMinor:282 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:32 Capacity:16582164480 Type:vfs Inodes:1048576 HasInodes:true} {Device:/var/lib/kubelet/pods/ac20c88a-e9bd-42c8-bcbe-2080f2393cc3/volumes/kubernetes.io~empty-dir/etc-tuned DeviceMajor:0 DeviceMinor:56 Capacity:31985729536 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/98dd829b-0745-4229-b781-da2c4ad16f9e/volumes/kubernetes.io~projected/kube-api-access-bz9kn DeviceMajor:0 DeviceMinor:67 Capacity:31985729536 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-70 DeviceMajor:0 DeviceMinor:70 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/2be7f3a3-8714-491c-8e10-c594d425069a/volumes/kubernetes.io~secret/agent-certs DeviceMajor:0 DeviceMinor:58 Capacity:31985729536 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/423e0100-284b-48b9-bd4c-3b74005976d2/volumes/kubernetes.io~projected/kube-api-access-njzf8 DeviceMajor:0 DeviceMinor:61 Capacity:31985729536 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-162 DeviceMajor:0 DeviceMinor:162 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/4d52cf11-23b8-4b48-92ec-009845eea77f/volumes/kubernetes.io~projected/kube-api-access-rmn47 DeviceMajor:0 DeviceMinor:202 Capacity:31985729536 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/20819707-689f-4b17-8762-802fd5152c71/volumes/kubernetes.io~projected/kube-api-access-w27xp DeviceMajor:0 DeviceMinor:252 Capacity:31985729536 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/6b02f882-10f6-47c4-84a0-8c07533bbb7d/volumes/kubernetes.io~secret/secret-thanos-querier-tls DeviceMajor:0 DeviceMinor:316 Capacity:31985729536 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-328 DeviceMajor:0 DeviceMinor:328 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-353 DeviceMajor:0 DeviceMinor:353 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/4bd6740c4b3c983baf7993ac113f19f2c0659e6ef20b3daaf63c87d7190dee56/userdata/shm DeviceMajor:0 DeviceMinor:205 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/2a71410e-a1ce-479e-a9ea-261a4e41f6e3/volumes/kubernetes.io~secret/kube-state-metrics-tls DeviceMajor:0 DeviceMinor:263 Capacity:31985729536 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-348 DeviceMajor:0 DeviceMinor:348 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-376 DeviceMajor:0 DeviceMinor:376 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/0a8c4dcc-2f62-4efe-993e-2de411ce6654/volumes/kubernetes.io~projected/kube-api-access-l9vw6 DeviceMajor:0 DeviceMinor:64 Capacity:31985729536 Type:vfs Inodes:4048380 HasInodes:true} {Device:/run/containers/storage/overlay-containers/ff00162e6d55d62823b7a9c310a3addac8bd4567665c1ecfda4330e1319d2c5a/userdata/shm DeviceMajor:0 DeviceMinor:258 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/5a23369d-e69d-40e0-a956-a109d6d653c1/volumes/kubernetes.io~secret/insights-runtime-extractor-tls DeviceMajor:0 DeviceMinor:45 Capacity:31985729536 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-269 DeviceMajor:0 DeviceMinor:269 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/6f85a5b9cbb30099b83741b8bcab9fd453d2b5473186a0935db97291bcef7ff4/userdata/shm DeviceMajor:0 DeviceMinor:371 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/7150493b132eee1de4f50e8c442864c7ecc649e2ff6b205c2f287c08945e632a/userdata/shm DeviceMajor:0 DeviceMinor:72 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-127 DeviceMajor:0 DeviceMinor:127 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-192 DeviceMajor:0 DeviceMinor:192 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/45a7e195-0bbf-46cb-b821-30728122c3fc/volumes/kubernetes.io~secret/cert DeviceMajor:0 DeviceMinor:201 Capacity:31985729536 Type:vfs Inodes:4048380 HasInodes:true} {Device:/run/containers/storage/overlay-containers/b8e14484065a269f37c47a3f8c7a26eea49c5a9d48fb63f397206fd4940526ba/userdata/shm DeviceMajor:0 DeviceMinor:369 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-380 DeviceMajor:0 DeviceMinor:380 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/98dd829b-0745-4229-b781-da2c4ad16f9e/volumes/kubernetes.io~secret/ovn-node-metrics-cert DeviceMajor:0 DeviceMinor:55 Capacity:31985729536 Type:vfs Inodes:4048380 HasInodes:true} {Device:/run/containers/storage/overlay-containers/08e9fcba79fcf7911525e4a7031678ea05684ef0cf9bc90dcba9f2553b6ee26d/userdata/shm DeviceMajor:0 DeviceMinor:76 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:/run/containers/storage/overlay-containers/6bfca021e25a7be7c0f5098b275d73b34ddbaa220eeb80baa16b70143e6fc01f/userdata/shm DeviceMajor:0 DeviceMinor:77 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/20819707-689f-4b17-8762-802fd5152c71/volumes/kubernetes.io~secret/openshift-state-metrics-kube-rbac-proxy-config DeviceMajor:0 DeviceMinor:246 Capacity:31985729536 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-322 DeviceMajor:0 DeviceMinor:322 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/2d3597bf-5138-4272-905b-d2fdd3bfbe7b/volumes/kubernetes.io~projected/kube-api-access-v75vv DeviceMajor:0 DeviceMinor:63 Capacity:31985729536 Type:vfs Inodes:4048380 HasInodes:true} {Device:/run/containers/storage/overlay-containers/4ebb78fce880638671623bacc3e166cfcd3a4f559203aa81b67ecc6e487a6d17/userdata/shm DeviceMajor:0 DeviceMinor:98 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-132 DeviceMajor:0 DeviceMinor:132 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-144 DeviceMajor:0 DeviceMinor:144 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/4d52cf11-23b8-4b48-92ec-009845eea77f/volumes/kubernetes.io~secret/metrics-tls DeviceMajor:0 DeviceMinor:197 Capacity:31985729536 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/dde165c4-1ada-4fd6-af53-32fd75286c79/volumes/kubernetes.io~secret/node-exporter-tls DeviceMajor:0 DeviceMinor:253 Capacity:31985729536 Type:vfs Inodes:4048380 HasInodes:true} {Device:/run/containers/storage/overlay-containers/2105619691f7a9f0fb7172d3443de0333e4696cef6b4ef4715185f6820c93fc6/userdata/shm DeviceMajor:0 DeviceMinor:255 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/e7fb91fc-bf9e-42c6-b440-7165063ae5ec/volumes/kubernetes.io~projected/kube-api-access-bvnbm DeviceMajor:0 DeviceMinor:326 Capacity:31985729536 Type:vfs Inodes:4048380 HasInodes:true} {Device:composefs_0-34 DeviceMajor:0 DeviceMinor:34 Capacity:6422528 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/var/lib/kubelet/pods/ac20c88a-e9bd-42c8-bcbe-2080f2393cc3/volumes/kubernetes.io~empty-dir/tmp DeviceMajor:0 DeviceMinor:57 Capacity:31985729536 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-84 DeviceMajor:0 DeviceMinor:84 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-96 DeviceMajor:0 DeviceMinor:96 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/5a23369d-e69d-40e0-a956-a109d6d653c1/volumes/kubernetes.io~projected/kube-api-access-plsvs DeviceMajor:0 DeviceMinor:203 Capacity:31985729536 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/0a8c4dcc-2f62-4efe-993e-2de411ce6654/volumes/kubernetes.io~secret/metrics-certs DeviceMajor:0 DeviceMinor:363 Capacity:31985729536 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/8d3e77a0-4ee8-4429-9795-97fb3d799dba/volumes/kubernetes.io~projected/kube-api-access-7drkj DeviceMajor:0 DeviceMinor:59 Capacity:31985729536 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-177 DeviceMajor:0 DeviceMinor:177 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/2a71410e-a1ce-479e-a9ea-261a4e41f6e3/volumes/kubernetes.io~secret/kube-state-metrics-kube-rbac-proxy-config DeviceMajor:0 DeviceMinor:262 Capacity:31985729536 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-300 DeviceMajor:0 DeviceMinor:300 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-215 DeviceMajor:0 DeviceMinor:215 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/6b02f882-10f6-47c4-84a0-8c07533bbb7d/volumes/kubernetes.io~secret/secret-thanos-querier-kube-rbac-proxy-rules DeviceMajor:0 DeviceMinor:315 Capacity:31985729536 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-384 DeviceMajor:0 DeviceMinor:384 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/var/lib/kubelet/pods/34dfa231-fa1a-400c-82b4-6ee85859d7c4/volumes/kubernetes.io~projected/kube-api-access-mwhbg DeviceMajor:0 DeviceMinor:66 Capacity:31985729536 Type:vfs Inodes:4048380 HasInodes:true} {Device:/run/containers/storage/overlay-containers/d1934139957babd59f55f6864275e7623cdebdefc4b4936a58a082f485428377/userdata/shm DeviceMajor:0 DeviceMinor:86 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/45a7e195-0bbf-46cb-b821-30728122c3fc/volumes/kubernetes.io~projected/kube-api-access-jvx29 DeviceMajor:0 DeviceMinor:204 Capacity:31985729536 Type:vfs Inodes:4048380 HasInodes:true} {Device:/run/containers/storage/overlay-containers/19280f397c327dc16a39273a8783766f604907123b4e5f3f1982a8ca45bfe016/userdata/shm DeviceMajor:0 DeviceMinor:374 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-114 DeviceMajor:0 DeviceMinor:114 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-146 DeviceMajor:0 DeviceMinor:146 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-236 DeviceMajor:0 DeviceMinor:236 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/16c973cc9429ce09b3d75aba02e587029e1000442a874babd48302ea6ff644c6/userdata/shm DeviceMajor:0 DeviceMinor:320 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-157 DeviceMajor:0 DeviceMinor:157 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/14008bf705641ffb3281fb0bcdc659e9c04920b28abc74ab2d20a32fd522fd1b/userdata/shm DeviceMajor:0 DeviceMinor:94 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-241 DeviceMajor:0 DeviceMinor:241 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/2a71410e-a1ce-479e-a9ea-261a4e41f6e3/volumes/kubernetes.io~projected/kube-api-access-x2lwt DeviceMajor:0 DeviceMinor:264 Capacity:31985729536 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-267 DeviceMajor:0 DeviceMinor:267 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-295 DeviceMajor:0 DeviceMinor:295 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/5b1809f8a15a1c5d1e661b1743ea01f10b50539894af0b0e34d3f8689d5b92ee/userdata/shm DeviceMajor:0 DeviceMinor:333 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-74 DeviceMajor:0 DeviceMinor:74 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-81 DeviceMajor:0 DeviceMinor:81 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-137 DeviceMajor:0 DeviceMinor:137 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/20819707-689f-4b17-8762-802fd5152c71/volumes/kubernetes.io~secret/openshift-state-metrics-tls DeviceMajor:0 DeviceMinor:251 Capacity:31985729536 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-260 DeviceMajor:0 DeviceMinor:260 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-149 DeviceMajor:0 DeviceMinor:149 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:26 Capacity:6632865792 Type:vfs Inodes:819200 HasInodes:true} {Device:/run/containers/storage/overlay-containers/713a63aaf2ee585ab3db9d19c47f6cd31a16bc85735d223ed3868d3e060ffa05/userdata/shm DeviceMajor:0 DeviceMinor:68 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:16c973cc9429ce0 MacAddress:8a:c9:7e:e9:44:44 Speed:10000 Mtu:8901} {Name:19280f397c327dc MacAddress:32:a7:a9:33:72:d8 Speed:10000 Mtu:8901} {Name:2105619691f7a9f MacAddress:2e:49:25:19:61:91 Speed:10000 Mtu:8901} {Name:4bd6740c4b3c983 MacAddress:92:72:7a:51:5e:e4 Speed:10000 Mtu:8901} {Name:5b1809f8a15a1c5 MacAddress:fe:1b:7d:66:f5:5d Speed:10000 Mtu:8901} {Name:5e62c1b37837173 MacAddress:c6:c1:da:b9:c6:5b Speed:10000 Mtu:8901} {Name:6f85a5b9cbb3009 MacAddress:ca:4a:fb:92:2a:7e Speed:10000 Mtu:8901} {Name:b07a99877d65e3d MacAddress:26:28:c5:1d:b7:07 Speed:10000 Mtu:8901} {Name:b8e14484065a269 MacAddress:d6:00:52:5a:45:8c Speed:10000 Mtu:8901} {Name:br-ex MacAddress:02:ff:fb:dc:72:35 Speed:0 Mtu:9001} {Name:br-int MacAddress:02:20:8f:47:44:29 Speed:0 Mtu:8901} {Name:ecd718a1716e1db MacAddress:0e:85:ca:6f:a4:29 Speed:10000 Mtu:8901} {Name:ens5 MacAddress:02:ff:fb:dc:72:35 Speed:0 Mtu:9001} {Name:genev_sys_6081 MacAddress:26:b6:ee:c0:dc:f0 Speed:0 Mtu:65000} {Name:ovn-k8s-mp0 MacAddress:0a:58:0a:86:00:02 Speed:0 Mtu:8901} {Name:ovs-system MacAddress:a6:7c:60:ed:53:67 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164328960 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Oct 30 19:48:09.600740 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.599068    6275 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Oct 30 19:48:09.600740 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.599108    6275 manager.go:233] Version: {KernelVersion:5.14.0-687.60.1.el9_8.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.8.20261023-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Oct 30 19:48:09.600740 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.599385    6275 container_manager_linux.go:275] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Oct 30 19:48:09.600740 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.599406    6275 container_manager_linux.go:280] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-131-26.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"/system.slice","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{},"system-reserved-compressible":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Oct 30 19:48:09.600740 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.599649    6275 topology_manager.go:143] "Creating topology manager with none policy"
Oct 30 19:48:09.600740 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.599657    6275 container_manager_linux.go:311] "Creating device plugin manager"
Oct 30 19:48:09.600740 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.599668    6275 manager.go:144] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Oct 30 19:48:09.600740 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.599686    6275 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Oct 30 19:48:09.600740 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.599772    6275 container_manager_linux.go:320] "Creating Dynamic Resource Allocation (DRA) manager"
Oct 30 19:48:09.600740 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.599923    6275 state_mem.go:41] "Initialized" logger="CPUManager state memory"
Oct 30 19:48:09.600740 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.600039    6275 server.go:1235] "Using root directory" path="/var/lib/kubelet"
Oct 30 19:48:09.600740 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.600072    6275 kubelet.go:493] "Attempting to sync node with API server"
Oct 30 19:48:09.600740 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.600081    6275 kubelet.go:394] "Adding static pod path" path="/etc/kubernetes/manifests"
Oct 30 19:48:09.600740 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.600091    6275 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Oct 30 19:48:09.600740 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.600099    6275 kubelet.go:405] "Adding apiserver pod source"
Oct 30 19:48:09.600740 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.600107    6275 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Oct 30 19:48:09.600740 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.600728    6275 state_checkpoint.go:81] "State checkpoint: restored pod resource state from checkpoint"
Oct 30 19:48:09.600740 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.600737    6275 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Oct 30 19:48:09.601727 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.601172    6275 kuberuntime_manager.go:304] "Container runtime initialized" containerRuntime="cri-o" version="1.35.10-3.rhaos4.22.git9383502.el9" apiVersion="v1"
Oct 30 19:48:09.603673 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.603655    6275 state_checkpoint.go:81] "State checkpoint: restored pod resource state from checkpoint"
Oct 30 19:48:09.603673 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.603670    6275 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Oct 30 19:48:09.603812 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.603783    6275 certificate_store.go:147] "Loading cert/key pair from a file" filePath="/var/lib/kubelet/pki/kubelet-server-current.pem"
Oct 30 19:48:09.604006 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.603990    6275 kubelet.go:963] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Oct 30 19:48:09.604065 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.604030    6275 kubelet.go:990] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Oct 30 19:48:09.604154 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.604142    6275 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Oct 30 19:48:09.604207 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.604160    6275 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Oct 30 19:48:09.604207 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.604170    6275 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Oct 30 19:48:09.604207 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.604181    6275 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Oct 30 19:48:09.604207 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.604189    6275 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Oct 30 19:48:09.604207 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.604200    6275 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Oct 30 19:48:09.604469 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.604209    6275 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Oct 30 19:48:09.604469 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.604219    6275 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Oct 30 19:48:09.604469 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.604230    6275 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Oct 30 19:48:09.604469 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.604238    6275 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Oct 30 19:48:09.604469 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.604258    6275 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Oct 30 19:48:09.604469 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.604272    6275 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Oct 30 19:48:09.604469 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.604313    6275 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Oct 30 19:48:09.604469 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.604323    6275 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Oct 30 19:48:09.607676 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.607660    6275 server.go:1263] "Started kubelet"
Oct 30 19:48:09.607765 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.607738    6275 server.go:182] "Starting to listen" address="0.0.0.0" port=10250
Oct 30 19:48:09.608463 ip-10-0-131-26 systemd[1]: Started Kubernetes Kubelet.
Oct 30 19:48:09.610642 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.608433    6275 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Oct 30 19:48:09.610642 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.608573    6275 server_v1.go:49] "podresources" method="list" useActivePods=true
Oct 30 19:48:09.610642 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.608869    6275 server.go:254] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Oct 30 19:48:09.611988 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.611972    6275 server.go:317] "Adding debug handlers to kubelet server"
Oct 30 19:48:09.614011 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.613479    6275 fs_resource_analyzer.go:69] "Starting FS ResourceAnalyzer"
Oct 30 19:48:09.614011 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.613506    6275 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Oct 30 19:48:09.614011 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.613546    6275 volume_manager.go:309] "The desired_state_of_world populator starts"
Oct 30 19:48:09.614011 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.613559    6275 volume_manager.go:311] "Starting Kubelet Volume Manager"
Oct 30 19:48:09.614011 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.613571    6275 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-10-29 19:42:00 +0000 UTC" deadline="2028-07-02 17:25:57.721207762 +0000 UTC"
Oct 30 19:48:09.614011 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.613606    6275 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14661h37m48.107604912s"
Oct 30 19:48:09.614011 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.613680    6275 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Oct 30 19:48:09.614011 ip-10-0-131-26 kubenswrapper[6275]: E1030 19:48:09.613552    6275 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-131-26.ec2.internal\" not found"
Oct 30 19:48:09.616872 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.615058    6275 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Oct 30 19:48:09.616872 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.615075    6275 factory.go:55] Registering systemd factory
Oct 30 19:48:09.616872 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.615084    6275 factory.go:223] Registration of the systemd container factory successfully
Oct 30 19:48:09.616872 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.615459    6275 factory.go:153] Registering CRI-O factory
Oct 30 19:48:09.616872 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.615487    6275 factory.go:223] Registration of the crio container factory successfully
Oct 30 19:48:09.616872 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.615506    6275 factory.go:103] Registering Raw factory
Oct 30 19:48:09.616872 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.615525    6275 manager.go:1199] Started watching for new ooms in manager
Oct 30 19:48:09.616872 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.615886    6275 manager.go:319] Starting recovery of all containers
Oct 30 19:48:09.616872 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.615948    6275 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="20819707-689f-4b17-8762-802fd5152c71" volumeName="kubernetes.io/projected/20819707-689f-4b17-8762-802fd5152c71-kube-api-access-w27xp" seLinuxMountContext=""
Oct 30 19:48:09.616872 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.615985    6275 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="34dfa231-fa1a-400c-82b4-6ee85859d7c4" volumeName="kubernetes.io/empty-dir/34dfa231-fa1a-400c-82b4-6ee85859d7c4-tmp-dir" seLinuxMountContext=""
Oct 30 19:48:09.616872 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.616000    6275 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="423e0100-284b-48b9-bd4c-3b74005976d2" volumeName="kubernetes.io/configmap/423e0100-284b-48b9-bd4c-3b74005976d2-serviceca" seLinuxMountContext=""
Oct 30 19:48:09.616872 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.616014    6275 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="641c89ab-1e2c-4e67-84b5-d5d0f4f30756" volumeName="kubernetes.io/configmap/641c89ab-1e2c-4e67-84b5-d5d0f4f30756-iptables-alerter-script" seLinuxMountContext=""
Oct 30 19:48:09.616872 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.616025    6275 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="8d3e77a0-4ee8-4429-9795-97fb3d799dba" volumeName="kubernetes.io/projected/8d3e77a0-4ee8-4429-9795-97fb3d799dba-kube-api-access-7drkj" seLinuxMountContext=""
Oct 30 19:48:09.616872 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.616039    6275 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="98dd829b-0745-4229-b781-da2c4ad16f9e" volumeName="kubernetes.io/configmap/98dd829b-0745-4229-b781-da2c4ad16f9e-ovnkube-script-lib" seLinuxMountContext=""
Oct 30 19:48:09.616872 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.616050    6275 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="0a8c4dcc-2f62-4efe-993e-2de411ce6654" volumeName="kubernetes.io/secret/0a8c4dcc-2f62-4efe-993e-2de411ce6654-metrics-certs" seLinuxMountContext=""
Oct 30 19:48:09.616872 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.616062    6275 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="98dd829b-0745-4229-b781-da2c4ad16f9e" volumeName="kubernetes.io/configmap/98dd829b-0745-4229-b781-da2c4ad16f9e-ovnkube-config" seLinuxMountContext=""
Oct 30 19:48:09.616872 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.616077    6275 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="ac20c88a-e9bd-42c8-bcbe-2080f2393cc3" volumeName="kubernetes.io/projected/ac20c88a-e9bd-42c8-bcbe-2080f2393cc3-kube-api-access-r4zjc" seLinuxMountContext=""
Oct 30 19:48:09.616872 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.616089    6275 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="2a71410e-a1ce-479e-a9ea-261a4e41f6e3" volumeName="kubernetes.io/secret/2a71410e-a1ce-479e-a9ea-261a4e41f6e3-kube-state-metrics-kube-rbac-proxy-config" seLinuxMountContext=""
Oct 30 19:48:09.616872 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.616102    6275 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="2be7f3a3-8714-491c-8e10-c594d425069a" volumeName="kubernetes.io/configmap/2be7f3a3-8714-491c-8e10-c594d425069a-konnectivity-ca" seLinuxMountContext=""
Oct 30 19:48:09.616872 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.616114    6275 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="4d52cf11-23b8-4b48-92ec-009845eea77f" volumeName="kubernetes.io/configmap/4d52cf11-23b8-4b48-92ec-009845eea77f-config-volume" seLinuxMountContext=""
Oct 30 19:48:09.616872 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.616126    6275 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="6b02f882-10f6-47c4-84a0-8c07533bbb7d" volumeName="kubernetes.io/secret/6b02f882-10f6-47c4-84a0-8c07533bbb7d-secret-grpc-tls" seLinuxMountContext=""
Oct 30 19:48:09.616872 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.616137    6275 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="9898418c-eb0f-41b4-a844-d853caeab57f" volumeName="kubernetes.io/configmap/9898418c-eb0f-41b4-a844-d853caeab57f-cni-sysctl-allowlist" seLinuxMountContext=""
Oct 30 19:48:09.616872 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.616152    6275 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="aa51899f-52a0-434e-b434-4bc030c94136" volumeName="kubernetes.io/projected/aa51899f-52a0-434e-b434-4bc030c94136-kube-api-access-tmmdv" seLinuxMountContext=""
Oct 30 19:48:09.616872 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.616164    6275 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="e7fb91fc-bf9e-42c6-b440-7165063ae5ec" volumeName="kubernetes.io/projected/e7fb91fc-bf9e-42c6-b440-7165063ae5ec-kube-api-access-bvnbm" seLinuxMountContext=""
Oct 30 19:48:09.616872 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.616192    6275 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="e7fb91fc-bf9e-42c6-b440-7165063ae5ec" volumeName="kubernetes.io/secret/e7fb91fc-bf9e-42c6-b440-7165063ae5ec-monitoring-plugin-cert" seLinuxMountContext=""
Oct 30 19:48:09.616872 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.616205    6275 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="45a7e195-0bbf-46cb-b821-30728122c3fc" volumeName="kubernetes.io/projected/45a7e195-0bbf-46cb-b821-30728122c3fc-kube-api-access-jvx29" seLinuxMountContext=""
Oct 30 19:48:09.616872 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.616216    6275 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="5a23369d-e69d-40e0-a956-a109d6d653c1" volumeName="kubernetes.io/projected/5a23369d-e69d-40e0-a956-a109d6d653c1-kube-api-access-plsvs" seLinuxMountContext=""
Oct 30 19:48:09.616872 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.616227    6275 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="6b02f882-10f6-47c4-84a0-8c07533bbb7d" volumeName="kubernetes.io/secret/6b02f882-10f6-47c4-84a0-8c07533bbb7d-secret-thanos-querier-tls" seLinuxMountContext=""
Oct 30 19:48:09.616872 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.616238    6275 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="8d3e77a0-4ee8-4429-9795-97fb3d799dba" volumeName="kubernetes.io/configmap/8d3e77a0-4ee8-4429-9795-97fb3d799dba-multus-daemon-config" seLinuxMountContext=""
Oct 30 19:48:09.616872 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.616249    6275 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="20819707-689f-4b17-8762-802fd5152c71" volumeName="kubernetes.io/secret/20819707-689f-4b17-8762-802fd5152c71-openshift-state-metrics-kube-rbac-proxy-config" seLinuxMountContext=""
Oct 30 19:48:09.616872 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.616260    6275 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="2a71410e-a1ce-479e-a9ea-261a4e41f6e3" volumeName="kubernetes.io/configmap/2a71410e-a1ce-479e-a9ea-261a4e41f6e3-kube-state-metrics-custom-resource-state-configmap" seLinuxMountContext=""
Oct 30 19:48:09.616872 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.616273    6275 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="641c89ab-1e2c-4e67-84b5-d5d0f4f30756" volumeName="kubernetes.io/projected/641c89ab-1e2c-4e67-84b5-d5d0f4f30756-kube-api-access-hk8r5" seLinuxMountContext=""
Oct 30 19:48:09.616872 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.616285    6275 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="6b02f882-10f6-47c4-84a0-8c07533bbb7d" volumeName="kubernetes.io/secret/6b02f882-10f6-47c4-84a0-8c07533bbb7d-secret-thanos-querier-kube-rbac-proxy" seLinuxMountContext=""
Oct 30 19:48:09.616872 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.616302    6275 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="9898418c-eb0f-41b4-a844-d853caeab57f" volumeName="kubernetes.io/configmap/9898418c-eb0f-41b4-a844-d853caeab57f-whereabouts-flatfile-configmap" seLinuxMountContext=""
Oct 30 19:48:09.616872 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.616314    6275 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="98dd829b-0745-4229-b781-da2c4ad16f9e" volumeName="kubernetes.io/projected/98dd829b-0745-4229-b781-da2c4ad16f9e-kube-api-access-bz9kn" seLinuxMountContext=""
Oct 30 19:48:09.616872 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.616326    6275 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="20819707-689f-4b17-8762-802fd5152c71" volumeName="kubernetes.io/secret/20819707-689f-4b17-8762-802fd5152c71-openshift-state-metrics-tls" seLinuxMountContext=""
Oct 30 19:48:09.616872 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.616348    6275 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="4d52cf11-23b8-4b48-92ec-009845eea77f" volumeName="kubernetes.io/projected/4d52cf11-23b8-4b48-92ec-009845eea77f-kube-api-access-rmn47" seLinuxMountContext=""
Oct 30 19:48:09.616872 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.616360    6275 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="90b35edf-4b09-41df-9374-a514d1417071" volumeName="kubernetes.io/secret/90b35edf-4b09-41df-9374-a514d1417071-original-pull-secret" seLinuxMountContext=""
Oct 30 19:48:09.616872 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.616371    6275 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="98dd829b-0745-4229-b781-da2c4ad16f9e" volumeName="kubernetes.io/secret/98dd829b-0745-4229-b781-da2c4ad16f9e-ovn-node-metrics-cert" seLinuxMountContext=""
Oct 30 19:48:09.616872 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.616382    6275 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="0a8c4dcc-2f62-4efe-993e-2de411ce6654" volumeName="kubernetes.io/projected/0a8c4dcc-2f62-4efe-993e-2de411ce6654-kube-api-access-l9vw6" seLinuxMountContext=""
Oct 30 19:48:09.616872 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.616394    6275 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="34dfa231-fa1a-400c-82b4-6ee85859d7c4" volumeName="kubernetes.io/projected/34dfa231-fa1a-400c-82b4-6ee85859d7c4-kube-api-access-mwhbg" seLinuxMountContext=""
Oct 30 19:48:09.616872 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.616405    6275 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="98dd829b-0745-4229-b781-da2c4ad16f9e" volumeName="kubernetes.io/configmap/98dd829b-0745-4229-b781-da2c4ad16f9e-env-overrides" seLinuxMountContext=""
Oct 30 19:48:09.616872 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.616431    6275 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="dde165c4-1ada-4fd6-af53-32fd75286c79" volumeName="kubernetes.io/configmap/dde165c4-1ada-4fd6-af53-32fd75286c79-node-exporter-accelerators-collector-config" seLinuxMountContext=""
Oct 30 19:48:09.616872 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.616445    6275 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="2a71410e-a1ce-479e-a9ea-261a4e41f6e3" volumeName="kubernetes.io/configmap/2a71410e-a1ce-479e-a9ea-261a4e41f6e3-metrics-client-ca" seLinuxMountContext=""
Oct 30 19:48:09.616872 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.616456    6275 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="423e0100-284b-48b9-bd4c-3b74005976d2" volumeName="kubernetes.io/projected/423e0100-284b-48b9-bd4c-3b74005976d2-kube-api-access-njzf8" seLinuxMountContext=""
Oct 30 19:48:09.616872 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.616468    6275 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="6b02f882-10f6-47c4-84a0-8c07533bbb7d" volumeName="kubernetes.io/secret/6b02f882-10f6-47c4-84a0-8c07533bbb7d-secret-thanos-querier-kube-rbac-proxy-web" seLinuxMountContext=""
Oct 30 19:48:09.616872 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.616479    6275 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="6b02f882-10f6-47c4-84a0-8c07533bbb7d" volumeName="kubernetes.io/secret/6b02f882-10f6-47c4-84a0-8c07533bbb7d-secret-thanos-querier-kube-rbac-proxy-metrics" seLinuxMountContext=""
Oct 30 19:48:09.616872 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.616489    6275 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="8d3e77a0-4ee8-4429-9795-97fb3d799dba" volumeName="kubernetes.io/configmap/8d3e77a0-4ee8-4429-9795-97fb3d799dba-cni-binary-copy" seLinuxMountContext=""
Oct 30 19:48:09.616872 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.616501    6275 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="2a71410e-a1ce-479e-a9ea-261a4e41f6e3" volumeName="kubernetes.io/empty-dir/2a71410e-a1ce-479e-a9ea-261a4e41f6e3-volume-directive-shadow" seLinuxMountContext=""
Oct 30 19:48:09.616872 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.616513    6275 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="9898418c-eb0f-41b4-a844-d853caeab57f" volumeName="kubernetes.io/projected/9898418c-eb0f-41b4-a844-d853caeab57f-kube-api-access-2gglq" seLinuxMountContext=""
Oct 30 19:48:09.616872 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.616525    6275 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="ac20c88a-e9bd-42c8-bcbe-2080f2393cc3" volumeName="kubernetes.io/empty-dir/ac20c88a-e9bd-42c8-bcbe-2080f2393cc3-etc-tuned" seLinuxMountContext=""
Oct 30 19:48:09.616872 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.616537    6275 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="dde165c4-1ada-4fd6-af53-32fd75286c79" volumeName="kubernetes.io/configmap/dde165c4-1ada-4fd6-af53-32fd75286c79-metrics-client-ca" seLinuxMountContext=""
Oct 30 19:48:09.616872 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.616548    6275 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="6b02f882-10f6-47c4-84a0-8c07533bbb7d" volumeName="kubernetes.io/projected/6b02f882-10f6-47c4-84a0-8c07533bbb7d-kube-api-access-tx724" seLinuxMountContext=""
Oct 30 19:48:09.616872 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.616559    6275 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="dde165c4-1ada-4fd6-af53-32fd75286c79" volumeName="kubernetes.io/secret/dde165c4-1ada-4fd6-af53-32fd75286c79-node-exporter-kube-rbac-proxy-config" seLinuxMountContext=""
Oct 30 19:48:09.616872 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.616582    6275 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="2be7f3a3-8714-491c-8e10-c594d425069a" volumeName="kubernetes.io/secret/2be7f3a3-8714-491c-8e10-c594d425069a-agent-certs" seLinuxMountContext=""
Oct 30 19:48:09.616872 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.616596    6275 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="6b02f882-10f6-47c4-84a0-8c07533bbb7d" volumeName="kubernetes.io/configmap/6b02f882-10f6-47c4-84a0-8c07533bbb7d-metrics-client-ca" seLinuxMountContext=""
Oct 30 19:48:09.616872 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.616608    6275 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="6b02f882-10f6-47c4-84a0-8c07533bbb7d" volumeName="kubernetes.io/secret/6b02f882-10f6-47c4-84a0-8c07533bbb7d-secret-thanos-querier-kube-rbac-proxy-rules" seLinuxMountContext=""
Oct 30 19:48:09.616872 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.616620    6275 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="dde165c4-1ada-4fd6-af53-32fd75286c79" volumeName="kubernetes.io/empty-dir/dde165c4-1ada-4fd6-af53-32fd75286c79-node-exporter-textfile" seLinuxMountContext=""
Oct 30 19:48:09.616872 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.616633    6275 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="2a71410e-a1ce-479e-a9ea-261a4e41f6e3" volumeName="kubernetes.io/projected/2a71410e-a1ce-479e-a9ea-261a4e41f6e3-kube-api-access-x2lwt" seLinuxMountContext=""
Oct 30 19:48:09.616872 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.616644    6275 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="4d52cf11-23b8-4b48-92ec-009845eea77f" volumeName="kubernetes.io/secret/4d52cf11-23b8-4b48-92ec-009845eea77f-metrics-tls" seLinuxMountContext=""
Oct 30 19:48:09.616872 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.616655    6275 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="5a23369d-e69d-40e0-a956-a109d6d653c1" volumeName="kubernetes.io/configmap/5a23369d-e69d-40e0-a956-a109d6d653c1-kube-rbac-proxy-cm" seLinuxMountContext=""
Oct 30 19:48:09.616872 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.616668    6275 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="ac20c88a-e9bd-42c8-bcbe-2080f2393cc3" volumeName="kubernetes.io/empty-dir/ac20c88a-e9bd-42c8-bcbe-2080f2393cc3-tmp" seLinuxMountContext=""
Oct 30 19:48:09.616872 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.616682    6275 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="20819707-689f-4b17-8762-802fd5152c71" volumeName="kubernetes.io/configmap/20819707-689f-4b17-8762-802fd5152c71-metrics-client-ca" seLinuxMountContext=""
Oct 30 19:48:09.616872 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.616694    6275 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="2a71410e-a1ce-479e-a9ea-261a4e41f6e3" volumeName="kubernetes.io/secret/2a71410e-a1ce-479e-a9ea-261a4e41f6e3-kube-state-metrics-tls" seLinuxMountContext=""
Oct 30 19:48:09.616872 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.616727    6275 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="45a7e195-0bbf-46cb-b821-30728122c3fc" volumeName="kubernetes.io/secret/45a7e195-0bbf-46cb-b821-30728122c3fc-cert" seLinuxMountContext=""
Oct 30 19:48:09.616872 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.616776    6275 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="5a23369d-e69d-40e0-a956-a109d6d653c1" volumeName="kubernetes.io/empty-dir/5a23369d-e69d-40e0-a956-a109d6d653c1-data-volume" seLinuxMountContext=""
Oct 30 19:48:09.616872 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.616790    6275 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="5a23369d-e69d-40e0-a956-a109d6d653c1" volumeName="kubernetes.io/secret/5a23369d-e69d-40e0-a956-a109d6d653c1-insights-runtime-extractor-tls" seLinuxMountContext=""
Oct 30 19:48:09.616872 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.616803    6275 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="6b02f882-10f6-47c4-84a0-8c07533bbb7d" volumeName="kubernetes.io/empty-dir/6b02f882-10f6-47c4-84a0-8c07533bbb7d-tmp" seLinuxMountContext=""
Oct 30 19:48:09.616872 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.616817    6275 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="dde165c4-1ada-4fd6-af53-32fd75286c79" volumeName="kubernetes.io/projected/dde165c4-1ada-4fd6-af53-32fd75286c79-kube-api-access-879bk" seLinuxMountContext=""
Oct 30 19:48:09.616872 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.616830    6275 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="2d3597bf-5138-4272-905b-d2fdd3bfbe7b" volumeName="kubernetes.io/projected/2d3597bf-5138-4272-905b-d2fdd3bfbe7b-kube-api-access-v75vv" seLinuxMountContext=""
Oct 30 19:48:09.616872 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.616838    6275 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="4d52cf11-23b8-4b48-92ec-009845eea77f" volumeName="kubernetes.io/empty-dir/4d52cf11-23b8-4b48-92ec-009845eea77f-tmp-dir" seLinuxMountContext=""
Oct 30 19:48:09.616872 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.616848    6275 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="9898418c-eb0f-41b4-a844-d853caeab57f" volumeName="kubernetes.io/configmap/9898418c-eb0f-41b4-a844-d853caeab57f-cni-binary-copy" seLinuxMountContext=""
Oct 30 19:48:09.616872 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.616878    6275 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="dde165c4-1ada-4fd6-af53-32fd75286c79" volumeName="kubernetes.io/secret/dde165c4-1ada-4fd6-af53-32fd75286c79-node-exporter-tls" seLinuxMountContext=""
Oct 30 19:48:09.616872 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.616887    6275 reconstruct.go:97] "Volume reconstruction finished"
Oct 30 19:48:09.616872 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.616893    6275 reconciler.go:29] "Reconciler: start to sync state"
Oct 30 19:48:09.640220 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.640179    6275 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Oct 30 19:48:09.648946 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.648923    6275 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Oct 30 19:48:09.648946 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.648945    6275 status_manager.go:249] "Starting to sync pod status with apiserver"
Oct 30 19:48:09.649072 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.648961    6275 kubelet.go:2521] "Starting kubelet main sync loop"
Oct 30 19:48:09.649072 ip-10-0-131-26 kubenswrapper[6275]: E1030 19:48:09.648995    6275 kubelet.go:2545] "Skipping pod synchronization" err="[container runtime status check may not have completed yet, PLEG is not healthy: pleg has yet to be successful]"
Oct 30 19:48:09.657981 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.657953    6275 generic.go:356] "Generic (PLEG): container finished" podID="dde165c4-1ada-4fd6-af53-32fd75286c79" containerID="27ad82f16053875dd9b21a523e3c4fc3615cfc87f11bf6cfb91a0f9f6e6fcdc1" exitCode=0
Oct 30 19:48:09.667403 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.667382    6275 reconstruct.go:205] "DevicePaths of reconstructed volumes updated"
Oct 30 19:48:09.681667 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.681645    6275 reflector.go:446] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 30 19:48:09.682685 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.682662    6275 generic.go:356] "Generic (PLEG): container finished" podID="9898418c-eb0f-41b4-a844-d853caeab57f" containerID="d6cc416dcefd05d99c3785918c06a3ed4233da55c7a97ba3ed78aa73922810d5" exitCode=0
Oct 30 19:48:09.682685 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.682682    6275 generic.go:356] "Generic (PLEG): container finished" podID="9898418c-eb0f-41b4-a844-d853caeab57f" containerID="1ed4b4718e96248ac01e9be68fbd7c9b40695ec522bb4622d8595156c5688556" exitCode=0
Oct 30 19:48:09.682799 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.682694    6275 generic.go:356] "Generic (PLEG): container finished" podID="9898418c-eb0f-41b4-a844-d853caeab57f" containerID="bfcd7e6d1668078696ad8a5dac8c453f853b3d0d82f4d0023439c18c00cb5de3" exitCode=0
Oct 30 19:48:09.682799 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.682703    6275 generic.go:356] "Generic (PLEG): container finished" podID="9898418c-eb0f-41b4-a844-d853caeab57f" containerID="fccc6e558a1d49750942cb7aa7508499d0aa47ee5861af4c812d867356c09ddc" exitCode=0
Oct 30 19:48:09.682799 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.682711    6275 generic.go:356] "Generic (PLEG): container finished" podID="9898418c-eb0f-41b4-a844-d853caeab57f" containerID="0cdfca1b6887a7e1b486b893ea067d72e46c1706d6f10c1af7fb5701e4ff6b3b" exitCode=0
Oct 30 19:48:09.682799 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.682719    6275 generic.go:356] "Generic (PLEG): container finished" podID="9898418c-eb0f-41b4-a844-d853caeab57f" containerID="c14dc1dca99073887587185be21bedbb4588ca852b74eb8709b8c2a53ad010e7" exitCode=0
Oct 30 19:48:09.691564 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.691540    6275 reflector.go:446] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 30 19:48:09.691652 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.691602    6275 reflector.go:446] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 30 19:48:09.692869 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.692847    6275 reflector.go:446] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 30 19:48:09.692998 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.692915    6275 generic.go:356] "Generic (PLEG): container finished" podID="a33761d7d0af7c6b314b351b86948829" containerID="85c7d8b471246c4f2fa79b58549083016aac5882b41dd3266174668a6bc24640" exitCode=0
Oct 30 19:48:09.714365 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.714345    6275 manager.go:324] Recovery completed
Oct 30 19:48:09.735154 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.735125    6275 cpu_manager.go:226] "Starting" policy="none"
Oct 30 19:48:09.735154 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.735143    6275 cpu_manager.go:227] "Reconciling" reconcilePeriod="10s"
Oct 30 19:48:09.735319 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.735160    6275 state_mem.go:41] "Initialized" logger="CPUManager state checkpoint.CPUManager state memory"
Oct 30 19:48:09.735319 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.735294    6275 state_mem.go:94] "Updated default CPUSet" logger="CPUManager state checkpoint.CPUManager state memory" cpuSet=""
Oct 30 19:48:09.735319 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.735305    6275 state_mem.go:102] "Updated CPUSet assignments" logger="CPUManager state checkpoint.CPUManager state memory" assignments={}
Oct 30 19:48:09.735319 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.735321    6275 state_checkpoint.go:142] "restored state from checkpoint" logger="CPUManager state checkpoint"
Oct 30 19:48:09.735529 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.735327    6275 state_checkpoint.go:143] "defaultCPUSet" logger="CPUManager state checkpoint" defaultCpuSet=""
Oct 30 19:48:09.735529 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.735333    6275 policy_none.go:50] "Start"
Oct 30 19:48:09.735529 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.735341    6275 memory_manager.go:187] "Starting memorymanager" policy="None"
Oct 30 19:48:09.735529 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.735351    6275 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Oct 30 19:48:09.735529 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.735490    6275 state_mem.go:77] "Updated machine memory state" logger="Memory Manager state checkpoint"
Oct 30 19:48:09.735529 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.735498    6275 state_checkpoint.go:85] "State checkpoint: restored state from checkpoint" logger="Memory Manager state checkpoint"
Oct 30 19:48:09.735529 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.735503    6275 policy_none.go:44] "Start"
Oct 30 19:48:09.739750 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.739725    6275 node_container_manager_linux.go:130] "Enforcing system reserved compressible on cgroup" cgroupName="/system.slice" limits={"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"}
Oct 30 19:48:09.742386 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.742363    6275 manager.go:341] "Starting Device Plugin manager"
Oct 30 19:48:09.742839 ip-10-0-131-26 kubenswrapper[6275]: E1030 19:48:09.742393    6275 manager.go:525] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Oct 30 19:48:09.742912 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.742842    6275 server.go:87] "Starting device plugin registration server"
Oct 30 19:48:09.743138 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.743125    6275 eviction_manager.go:194] "Eviction manager: starting control loop"
Oct 30 19:48:09.743200 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.743139    6275 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Oct 30 19:48:09.743253 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.743228    6275 plugin_watcher.go:53] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Oct 30 19:48:09.743362 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.743327    6275 plugin_watcher.go:201] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Oct 30 19:48:09.743429 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.743369    6275 plugin_manager.go:119] "The desired_state_of_world populator (plugin watcher) starts"
Oct 30 19:48:09.743429 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.743376    6275 plugin_manager.go:121] "Starting Kubelet Plugin Manager"
Oct 30 19:48:09.743531 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.743451    6275 reconciler.go:167] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-10-30T19:48:09.743359569Z","UUID":"66639406-550b-4704-ae72-48b72181a7dc","Handler":null,"Name":"","Endpoint":""}
Oct 30 19:48:09.744555 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.744536    6275 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Oct 30 19:48:09.744644 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.744560    6275 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Oct 30 19:48:09.744993 ip-10-0-131-26 kubenswrapper[6275]: E1030 19:48:09.744972    6275 eviction_manager.go:272] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Oct 30 19:48:09.749077 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.749046    6275 kubelet.go:2608] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-26.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-131-26.ec2.internal"]
Oct 30 19:48:09.749664 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.749645    6275 kubelet.go:3368] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-26.ec2.internal"
Oct 30 19:48:09.749864 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.749822    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-26.ec2.internal" event={"ID":"3a7534b7f1df1f6e6fe99f614d7ed61c","Type":"ContainerStarted","Data":"20eeafbcdcc1972d90f2285d223f6f590fc31f3aecb9dd3a816c33f3480790d4"}
Oct 30 19:48:09.749935 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.749873    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-26.ec2.internal" event={"ID":"3a7534b7f1df1f6e6fe99f614d7ed61c","Type":"ContainerStarted","Data":"b12583b58d445757934cc974f891e7ddb1bd4eee5dc3c66d6f71aa27b0ecbd4d"}
Oct 30 19:48:09.750040 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.750025    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-26.ec2.internal" event={"ID":"a33761d7d0af7c6b314b351b86948829","Type":"ContainerStarted","Data":"1c9a18ecfbf97301950284ad84307c47b993e6bd60d5164515ed702e0120a520"}
Oct 30 19:48:09.750115 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.750050    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-26.ec2.internal" event={"ID":"a33761d7d0af7c6b314b351b86948829","Type":"ContainerDied","Data":"85c7d8b471246c4f2fa79b58549083016aac5882b41dd3266174668a6bc24640"}
Oct 30 19:48:09.750115 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.750071    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-26.ec2.internal" event={"ID":"a33761d7d0af7c6b314b351b86948829","Type":"ContainerStarted","Data":"41241145138f8bb696f121cb22714ecd4cfa99755caad8984db4796c91738397"}
Oct 30 19:48:09.750115 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.750092    6275 kubelet.go:3368] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-26.ec2.internal"
Oct 30 19:48:09.774040 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.774019    6275 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Oct 30 19:48:09.774132 ip-10-0-131-26 kubenswrapper[6275]: E1030 19:48:09.774062    6275 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-apiserver-proxy-ip-10-0-131-26.ec2.internal\" already exists" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-26.ec2.internal"
Oct 30 19:48:09.775657 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.775640    6275 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Oct 30 19:48:09.775725 ip-10-0-131-26 kubenswrapper[6275]: E1030 19:48:09.775685    6275 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-rbac-proxy-crio-ip-10-0-131-26.ec2.internal\" already exists" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-26.ec2.internal"
Oct 30 19:48:09.843542 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.843483    6275 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 30 19:48:09.845176 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.845162    6275 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-131-26.ec2.internal" event="NodeHasSufficientMemory"
Oct 30 19:48:09.845280 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.845191    6275 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-131-26.ec2.internal" event="NodeHasNoDiskPressure"
Oct 30 19:48:09.845280 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.845205    6275 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-131-26.ec2.internal" event="NodeHasSufficientPID"
Oct 30 19:48:09.845280 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.845252    6275 kubelet_node_status.go:77] "Attempting to register node" node="ip-10-0-131-26.ec2.internal"
Oct 30 19:48:09.868247 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.868227    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/a33761d7d0af7c6b314b351b86948829-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-26.ec2.internal\" (UID: \"a33761d7d0af7c6b314b351b86948829\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-26.ec2.internal"
Oct 30 19:48:09.868335 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.868259    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a33761d7d0af7c6b314b351b86948829-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-26.ec2.internal\" (UID: \"a33761d7d0af7c6b314b351b86948829\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-26.ec2.internal"
Oct 30 19:48:09.868335 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.868283    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/3a7534b7f1df1f6e6fe99f614d7ed61c-config\") pod \"kube-apiserver-proxy-ip-10-0-131-26.ec2.internal\" (UID: \"3a7534b7f1df1f6e6fe99f614d7ed61c\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-26.ec2.internal"
Oct 30 19:48:09.883293 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.883278    6275 kubelet_node_status.go:126] "Node was previously registered" node="ip-10-0-131-26.ec2.internal"
Oct 30 19:48:09.883357 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.883327    6275 kubelet_node_status.go:80] "Successfully registered node" node="ip-10-0-131-26.ec2.internal"
Oct 30 19:48:09.968886 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.968868    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/a33761d7d0af7c6b314b351b86948829-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-26.ec2.internal\" (UID: \"a33761d7d0af7c6b314b351b86948829\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-26.ec2.internal"
Oct 30 19:48:09.968970 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.968892    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a33761d7d0af7c6b314b351b86948829-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-26.ec2.internal\" (UID: \"a33761d7d0af7c6b314b351b86948829\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-26.ec2.internal"
Oct 30 19:48:09.968970 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.968911    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/3a7534b7f1df1f6e6fe99f614d7ed61c-config\") pod \"kube-apiserver-proxy-ip-10-0-131-26.ec2.internal\" (UID: \"3a7534b7f1df1f6e6fe99f614d7ed61c\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-26.ec2.internal"
Oct 30 19:48:09.968970 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.968953    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/3a7534b7f1df1f6e6fe99f614d7ed61c-config\") pod \"kube-apiserver-proxy-ip-10-0-131-26.ec2.internal\" (UID: \"3a7534b7f1df1f6e6fe99f614d7ed61c\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-26.ec2.internal"
Oct 30 19:48:09.969072 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.968973    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/a33761d7d0af7c6b314b351b86948829-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-26.ec2.internal\" (UID: \"a33761d7d0af7c6b314b351b86948829\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-26.ec2.internal"
Oct 30 19:48:09.969072 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:09.968981    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a33761d7d0af7c6b314b351b86948829-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-26.ec2.internal\" (UID: \"a33761d7d0af7c6b314b351b86948829\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-26.ec2.internal"
Oct 30 19:48:10.600282 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.600250    6275 apiserver.go:52] "Watching apiserver"
Oct 30 19:48:10.657054 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.657021    6275 reflector.go:446] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Oct 30 19:48:10.657769 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.657743    6275 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-131-26.ec2.internal","openshift-monitoring/monitoring-plugin-77f4f76594-k9gfv","openshift-monitoring/node-exporter-lvg9n","openshift-multus/network-metrics-daemon-hkjcv","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-clzkm","openshift-monitoring/thanos-querier-5f8f546c56-w96tg","openshift-dns/node-resolver-krr87","openshift-insights/insights-runtime-extractor-fwc77","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-26.ec2.internal","openshift-network-operator/iptables-alerter-7gdcx","openshift-cluster-node-tuning-operator/tuned-k865s","openshift-ovn-kubernetes/ovnkube-node-84v4l","kube-system/konnectivity-agent-6lj57","openshift-dns/dns-default-kmppx","openshift-monitoring/openshift-state-metrics-7bd7489957-bxr6q","openshift-multus/multus-pb5c7","openshift-monitoring/kube-state-metrics-5dc8d7d89b-zvm7p","openshift-multus/multus-additional-cni-plugins-q8w4d","openshift-ingress-canary/ingress-canary-r6bht","openshift-network-diagnostics/network-check-target-b27jd","kube-system/global-pull-secret-syncer-96mhd","openshift-image-registry/node-ca-2swph"]
Oct 30 19:48:10.675903 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.675880    6275 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Oct 30 19:48:10.676009 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.675976    6275 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Oct 30 19:48:10.676009 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.676003    6275 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Oct 30 19:48:10.676096 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.676049    6275 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Oct 30 19:48:10.676408 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.676394    6275 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-node-identity-dockercfg-bvhff\""
Oct 30 19:48:10.678771 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.678755    6275 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Oct 30 19:48:10.678847 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.678787    6275 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Oct 30 19:48:10.678847 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.678796    6275 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Oct 30 19:48:10.679072 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.679058    6275 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Oct 30 19:48:10.679132 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.679071    6275 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-97cb9\""
Oct 30 19:48:10.679132 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.679095    6275 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Oct 30 19:48:10.679132 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.679126    6275 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Oct 30 19:48:10.679243 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.679161    6275 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-d5xr8\""
Oct 30 19:48:10.679275 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.679241    6275 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Oct 30 19:48:10.679574 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.679555    6275 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Oct 30 19:48:10.679685 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.679594    6275 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Oct 30 19:48:10.679685 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.679604    6275 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Oct 30 19:48:10.679799 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.679730    6275 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Oct 30 19:48:10.679975 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.679960    6275 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-2gzs4\""
Oct 30 19:48:10.680152 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.680138    6275 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-wgtz9\""
Oct 30 19:48:10.680217 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.680158    6275 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Oct 30 19:48:10.680260 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.680245    6275 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"global-pull-secret-syncer-dockercfg-wnngx\""
Oct 30 19:48:10.680303 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.680263    6275 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Oct 30 19:48:10.680303 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.680288    6275 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Oct 30 19:48:10.680360 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.680344    6275 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-cscqg\""
Oct 30 19:48:10.684110 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.684095    6275 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Oct 30 19:48:10.684197 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.684186    6275 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Oct 30 19:48:10.684351 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.684340    6275 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Oct 30 19:48:10.684585 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.684569    6275 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Oct 30 19:48:10.684585 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.684583    6275 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Oct 30 19:48:10.685014 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.685002    6275 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Oct 30 19:48:10.685086 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.685072    6275 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Oct 30 19:48:10.685318 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.685306    6275 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Oct 30 19:48:10.686855 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.686842    6275 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Oct 30 19:48:10.686969 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.686955    6275 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Oct 30 19:48:10.687019 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.686971    6275 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Oct 30 19:48:10.687059 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.687024    6275 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-n5k26\""
Oct 30 19:48:10.687107 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.687094    6275 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Oct 30 19:48:10.687896 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.687884    6275 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Oct 30 19:48:10.688889 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.688872    6275 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Oct 30 19:48:10.688977 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.688963    6275 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Oct 30 19:48:10.689027 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.688985    6275 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Oct 30 19:48:10.689205 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.689181    6275 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"ingress-canary-dockercfg-h5z6r\""
Oct 30 19:48:10.689302 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.689249    6275 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Oct 30 19:48:10.689302 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.689255    6275 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Oct 30 19:48:10.689302 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.689262    6275 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Oct 30 19:48:10.689479 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.689317    6275 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Oct 30 19:48:10.689764 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.689738    6275 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Oct 30 19:48:10.691540 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.691521    6275 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Oct 30 19:48:10.692561 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.692069    6275 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-g4l62\""
Oct 30 19:48:10.692561 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.692099    6275 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Oct 30 19:48:10.692561 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.692130    6275 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent-dockercfg-h4pgj\""
Oct 30 19:48:10.692561 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.692170    6275 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Oct 30 19:48:10.692561 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.692135    6275 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Oct 30 19:48:10.692561 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.692136    6275 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-4vm82\""
Oct 30 19:48:10.692561 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.692172    6275 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-nfj6g\""
Oct 30 19:48:10.692561 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.692242    6275 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Oct 30 19:48:10.692561 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.692261    6275 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Oct 30 19:48:10.692561 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.692242    6275 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-2cj12u7vj8snv\""
Oct 30 19:48:10.692561 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.692264    6275 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-check-target-dockercfg-mbspd\""
Oct 30 19:48:10.692561 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.692169    6275 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Oct 30 19:48:10.692561 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.692336    6275 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-q7g4j\""
Oct 30 19:48:10.692561 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.692321    6275 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-grfkh\""
Oct 30 19:48:10.692561 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.692368    6275 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Oct 30 19:48:10.692561 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.692340    6275 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Oct 30 19:48:10.692561 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.692397    6275 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Oct 30 19:48:10.692561 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.692452    6275 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-rmgr8\""
Oct 30 19:48:10.692561 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.692290    6275 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Oct 30 19:48:10.692561 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.692381    6275 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-qlg5x\""
Oct 30 19:48:10.692561 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.692456    6275 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Oct 30 19:48:10.692561 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.692340    6275 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Oct 30 19:48:10.692561 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.692534    6275 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Oct 30 19:48:10.692561 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.692530    6275 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Oct 30 19:48:10.693496 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.692590    6275 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-67dw4\""
Oct 30 19:48:10.693496 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.692618    6275 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Oct 30 19:48:10.693496 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.692657    6275 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Oct 30 19:48:10.693496 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.692688    6275 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-l5g68\""
Oct 30 19:48:10.693496 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.692727    6275 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Oct 30 19:48:10.702177 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.702155    6275 kubelet.go:3368] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-26.ec2.internal"
Oct 30 19:48:10.702660 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.702643    6275 kubelet.go:3368] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-26.ec2.internal"
Oct 30 19:48:10.715124 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.715104    6275 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Oct 30 19:48:10.727355 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.727336    6275 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Oct 30 19:48:10.727439 ip-10-0-131-26 kubenswrapper[6275]: E1030 19:48:10.727401    6275 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-apiserver-proxy-ip-10-0-131-26.ec2.internal\" already exists" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-26.ec2.internal"
Oct 30 19:48:10.728822 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.728808    6275 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Oct 30 19:48:10.728867 ip-10-0-131-26 kubenswrapper[6275]: E1030 19:48:10.728846    6275 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-rbac-proxy-crio-ip-10-0-131-26.ec2.internal\" already exists" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-26.ec2.internal"
Oct 30 19:48:10.771916 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.771897    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/98dd829b-0745-4229-b781-da2c4ad16f9e-systemd-units\") pod \"ovnkube-node-84v4l\" (UID: \"98dd829b-0745-4229-b781-da2c4ad16f9e\") " pod="openshift-ovn-kubernetes/ovnkube-node-84v4l"
Oct 30 19:48:10.771980 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.771922    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/98dd829b-0745-4229-b781-da2c4ad16f9e-run-openvswitch\") pod \"ovnkube-node-84v4l\" (UID: \"98dd829b-0745-4229-b781-da2c4ad16f9e\") " pod="openshift-ovn-kubernetes/ovnkube-node-84v4l"
Oct 30 19:48:10.771980 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.771942    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/98dd829b-0745-4229-b781-da2c4ad16f9e-env-overrides\") pod \"ovnkube-node-84v4l\" (UID: \"98dd829b-0745-4229-b781-da2c4ad16f9e\") " pod="openshift-ovn-kubernetes/ovnkube-node-84v4l"
Oct 30 19:48:10.771980 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.771966    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/dde165c4-1ada-4fd6-af53-32fd75286c79-node-exporter-tls\") pod \"node-exporter-lvg9n\" (UID: \"dde165c4-1ada-4fd6-af53-32fd75286c79\") " pod="openshift-monitoring/node-exporter-lvg9n"
Oct 30 19:48:10.772105 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.772010    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/641c89ab-1e2c-4e67-84b5-d5d0f4f30756-host-slash\") pod \"iptables-alerter-7gdcx\" (UID: \"641c89ab-1e2c-4e67-84b5-d5d0f4f30756\") " pod="openshift-network-operator/iptables-alerter-7gdcx"
Oct 30 19:48:10.772154 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.772136    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4d52cf11-23b8-4b48-92ec-009845eea77f-metrics-tls\") pod \"dns-default-kmppx\" (UID: \"4d52cf11-23b8-4b48-92ec-009845eea77f\") " pod="openshift-dns/dns-default-kmppx"
Oct 30 19:48:10.772202 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.772174    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/dde165c4-1ada-4fd6-af53-32fd75286c79-node-exporter-tls\") pod \"node-exporter-lvg9n\" (UID: \"dde165c4-1ada-4fd6-af53-32fd75286c79\") " pod="openshift-monitoring/node-exporter-lvg9n"
Oct 30 19:48:10.772202 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.772185    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ac20c88a-e9bd-42c8-bcbe-2080f2393cc3-etc-systemd\") pod \"tuned-k865s\" (UID: \"ac20c88a-e9bd-42c8-bcbe-2080f2393cc3\") " pod="openshift-cluster-node-tuning-operator/tuned-k865s"
Oct 30 19:48:10.772275 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.772220    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/98dd829b-0745-4229-b781-da2c4ad16f9e-env-overrides\") pod \"ovnkube-node-84v4l\" (UID: \"98dd829b-0745-4229-b781-da2c4ad16f9e\") " pod="openshift-ovn-kubernetes/ovnkube-node-84v4l"
Oct 30 19:48:10.772329 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.772310    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8d3e77a0-4ee8-4429-9795-97fb3d799dba-cni-binary-copy\") pod \"multus-pb5c7\" (UID: \"8d3e77a0-4ee8-4429-9795-97fb3d799dba\") " pod="openshift-multus/multus-pb5c7"
Oct 30 19:48:10.772378 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.772339    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/423e0100-284b-48b9-bd4c-3b74005976d2-serviceca\") pod \"node-ca-2swph\" (UID: \"423e0100-284b-48b9-bd4c-3b74005976d2\") " pod="openshift-image-registry/node-ca-2swph"
Oct 30 19:48:10.772378 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.772371    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/4d52cf11-23b8-4b48-92ec-009845eea77f-config-volume\") pod \"dns-default-kmppx\" (UID: \"4d52cf11-23b8-4b48-92ec-009845eea77f\") " pod="openshift-dns/dns-default-kmppx"
Oct 30 19:48:10.772493 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.772401    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4d52cf11-23b8-4b48-92ec-009845eea77f-metrics-tls\") pod \"dns-default-kmppx\" (UID: \"4d52cf11-23b8-4b48-92ec-009845eea77f\") " pod="openshift-dns/dns-default-kmppx"
Oct 30 19:48:10.772493 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.772403    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/98dd829b-0745-4229-b781-da2c4ad16f9e-host-run-netns\") pod \"ovnkube-node-84v4l\" (UID: \"98dd829b-0745-4229-b781-da2c4ad16f9e\") " pod="openshift-ovn-kubernetes/ovnkube-node-84v4l"
Oct 30 19:48:10.772493 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.772464    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dde165c4-1ada-4fd6-af53-32fd75286c79-metrics-client-ca\") pod \"node-exporter-lvg9n\" (UID: \"dde165c4-1ada-4fd6-af53-32fd75286c79\") " pod="openshift-monitoring/node-exporter-lvg9n"
Oct 30 19:48:10.772493 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.772485    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0a8c4dcc-2f62-4efe-993e-2de411ce6654-metrics-certs\") pod \"network-metrics-daemon-hkjcv\" (UID: \"0a8c4dcc-2f62-4efe-993e-2de411ce6654\") " pod="openshift-multus/network-metrics-daemon-hkjcv"
Oct 30 19:48:10.772671 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.772503    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-njzf8\" (UniqueName: \"kubernetes.io/projected/423e0100-284b-48b9-bd4c-3b74005976d2-kube-api-access-njzf8\") pod \"node-ca-2swph\" (UID: \"423e0100-284b-48b9-bd4c-3b74005976d2\") " pod="openshift-image-registry/node-ca-2swph"
Oct 30 19:48:10.772671 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.772530    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6b02f882-10f6-47c4-84a0-8c07533bbb7d-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5f8f546c56-w96tg\" (UID: \"6b02f882-10f6-47c4-84a0-8c07533bbb7d\") " pod="openshift-monitoring/thanos-querier-5f8f546c56-w96tg"
Oct 30 19:48:10.772671 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.772555    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9898418c-eb0f-41b4-a844-d853caeab57f-cni-binary-copy\") pod \"multus-additional-cni-plugins-q8w4d\" (UID: \"9898418c-eb0f-41b4-a844-d853caeab57f\") " pod="openshift-multus/multus-additional-cni-plugins-q8w4d"
Oct 30 19:48:10.772671 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.772554    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8d3e77a0-4ee8-4429-9795-97fb3d799dba-cni-binary-copy\") pod \"multus-pb5c7\" (UID: \"8d3e77a0-4ee8-4429-9795-97fb3d799dba\") " pod="openshift-multus/multus-pb5c7"
Oct 30 19:48:10.772671 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.772624    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/4d52cf11-23b8-4b48-92ec-009845eea77f-config-volume\") pod \"dns-default-kmppx\" (UID: \"4d52cf11-23b8-4b48-92ec-009845eea77f\") " pod="openshift-dns/dns-default-kmppx"
Oct 30 19:48:10.772898 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.772752    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8d3e77a0-4ee8-4429-9795-97fb3d799dba-host-var-lib-cni-bin\") pod \"multus-pb5c7\" (UID: \"8d3e77a0-4ee8-4429-9795-97fb3d799dba\") " pod="openshift-multus/multus-pb5c7"
Oct 30 19:48:10.772898 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.772784    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/98dd829b-0745-4229-b781-da2c4ad16f9e-var-lib-openvswitch\") pod \"ovnkube-node-84v4l\" (UID: \"98dd829b-0745-4229-b781-da2c4ad16f9e\") " pod="openshift-ovn-kubernetes/ovnkube-node-84v4l"
Oct 30 19:48:10.772898 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.772808    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6b02f882-10f6-47c4-84a0-8c07533bbb7d-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5f8f546c56-w96tg\" (UID: \"6b02f882-10f6-47c4-84a0-8c07533bbb7d\") " pod="openshift-monitoring/thanos-querier-5f8f546c56-w96tg"
Oct 30 19:48:10.772898 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.772817    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dde165c4-1ada-4fd6-af53-32fd75286c79-metrics-client-ca\") pod \"node-exporter-lvg9n\" (UID: \"dde165c4-1ada-4fd6-af53-32fd75286c79\") " pod="openshift-monitoring/node-exporter-lvg9n"
Oct 30 19:48:10.772898 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.772836    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/98dd829b-0745-4229-b781-da2c4ad16f9e-run-ovn\") pod \"ovnkube-node-84v4l\" (UID: \"98dd829b-0745-4229-b781-da2c4ad16f9e\") " pod="openshift-ovn-kubernetes/ovnkube-node-84v4l"
Oct 30 19:48:10.772898 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.772881    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/45a7e195-0bbf-46cb-b821-30728122c3fc-cert\") pod \"ingress-canary-r6bht\" (UID: \"45a7e195-0bbf-46cb-b821-30728122c3fc\") " pod="openshift-ingress-canary/ingress-canary-r6bht"
Oct 30 19:48:10.773160 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.772901    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9898418c-eb0f-41b4-a844-d853caeab57f-cni-binary-copy\") pod \"multus-additional-cni-plugins-q8w4d\" (UID: \"9898418c-eb0f-41b4-a844-d853caeab57f\") " pod="openshift-multus/multus-additional-cni-plugins-q8w4d"
Oct 30 19:48:10.773160 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.772919    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8d3e77a0-4ee8-4429-9795-97fb3d799dba-system-cni-dir\") pod \"multus-pb5c7\" (UID: \"8d3e77a0-4ee8-4429-9795-97fb3d799dba\") " pod="openshift-multus/multus-pb5c7"
Oct 30 19:48:10.773160 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.772943    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/5a23369d-e69d-40e0-a956-a109d6d653c1-data-volume\") pod \"insights-runtime-extractor-fwc77\" (UID: \"5a23369d-e69d-40e0-a956-a109d6d653c1\") " pod="openshift-insights/insights-runtime-extractor-fwc77"
Oct 30 19:48:10.773160 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.773022    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/98dd829b-0745-4229-b781-da2c4ad16f9e-etc-openvswitch\") pod \"ovnkube-node-84v4l\" (UID: \"98dd829b-0745-4229-b781-da2c4ad16f9e\") " pod="openshift-ovn-kubernetes/ovnkube-node-84v4l"
Oct 30 19:48:10.773160 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.773027    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/423e0100-284b-48b9-bd4c-3b74005976d2-serviceca\") pod \"node-ca-2swph\" (UID: \"423e0100-284b-48b9-bd4c-3b74005976d2\") " pod="openshift-image-registry/node-ca-2swph"
Oct 30 19:48:10.773160 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.773033    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0a8c4dcc-2f62-4efe-993e-2de411ce6654-metrics-certs\") pod \"network-metrics-daemon-hkjcv\" (UID: \"0a8c4dcc-2f62-4efe-993e-2de411ce6654\") " pod="openshift-multus/network-metrics-daemon-hkjcv"
Oct 30 19:48:10.773160 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.773054    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/2d3597bf-5138-4272-905b-d2fdd3bfbe7b-registration-dir\") pod \"aws-ebs-csi-driver-node-clzkm\" (UID: \"2d3597bf-5138-4272-905b-d2fdd3bfbe7b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-clzkm"
Oct 30 19:48:10.773160 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.773087    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2gglq\" (UniqueName: \"kubernetes.io/projected/9898418c-eb0f-41b4-a844-d853caeab57f-kube-api-access-2gglq\") pod \"multus-additional-cni-plugins-q8w4d\" (UID: \"9898418c-eb0f-41b4-a844-d853caeab57f\") " pod="openshift-multus/multus-additional-cni-plugins-q8w4d"
Oct 30 19:48:10.773160 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.773097    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/5a23369d-e69d-40e0-a956-a109d6d653c1-data-volume\") pod \"insights-runtime-extractor-fwc77\" (UID: \"5a23369d-e69d-40e0-a956-a109d6d653c1\") " pod="openshift-insights/insights-runtime-extractor-fwc77"
Oct 30 19:48:10.773160 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.773105    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ac20c88a-e9bd-42c8-bcbe-2080f2393cc3-etc-tuned\") pod \"tuned-k865s\" (UID: \"ac20c88a-e9bd-42c8-bcbe-2080f2393cc3\") " pod="openshift-cluster-node-tuning-operator/tuned-k865s"
Oct 30 19:48:10.773160 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.773126    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/45a7e195-0bbf-46cb-b821-30728122c3fc-cert\") pod \"ingress-canary-r6bht\" (UID: \"45a7e195-0bbf-46cb-b821-30728122c3fc\") " pod="openshift-ingress-canary/ingress-canary-r6bht"
Oct 30 19:48:10.773160 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.773148    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/8d3e77a0-4ee8-4429-9795-97fb3d799dba-host-run-multus-certs\") pod \"multus-pb5c7\" (UID: \"8d3e77a0-4ee8-4429-9795-97fb3d799dba\") " pod="openshift-multus/multus-pb5c7"
Oct 30 19:48:10.773669 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.773171    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ac20c88a-e9bd-42c8-bcbe-2080f2393cc3-etc-tuned\") pod \"tuned-k865s\" (UID: \"ac20c88a-e9bd-42c8-bcbe-2080f2393cc3\") " pod="openshift-cluster-node-tuning-operator/tuned-k865s"
Oct 30 19:48:10.773669 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.773177    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/98dd829b-0745-4229-b781-da2c4ad16f9e-node-log\") pod \"ovnkube-node-84v4l\" (UID: \"98dd829b-0745-4229-b781-da2c4ad16f9e\") " pod="openshift-ovn-kubernetes/ovnkube-node-84v4l"
Oct 30 19:48:10.773669 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.773226    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/2d3597bf-5138-4272-905b-d2fdd3bfbe7b-socket-dir\") pod \"aws-ebs-csi-driver-node-clzkm\" (UID: \"2d3597bf-5138-4272-905b-d2fdd3bfbe7b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-clzkm"
Oct 30 19:48:10.773669 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.773259    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/2be7f3a3-8714-491c-8e10-c594d425069a-agent-certs\") pod \"konnectivity-agent-6lj57\" (UID: \"2be7f3a3-8714-491c-8e10-c594d425069a\") " pod="kube-system/konnectivity-agent-6lj57"
Oct 30 19:48:10.773669 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.773304    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hk8r5\" (UniqueName: \"kubernetes.io/projected/641c89ab-1e2c-4e67-84b5-d5d0f4f30756-kube-api-access-hk8r5\") pod \"iptables-alerter-7gdcx\" (UID: \"641c89ab-1e2c-4e67-84b5-d5d0f4f30756\") " pod="openshift-network-operator/iptables-alerter-7gdcx"
Oct 30 19:48:10.773669 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.773405    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ac20c88a-e9bd-42c8-bcbe-2080f2393cc3-sys\") pod \"tuned-k865s\" (UID: \"ac20c88a-e9bd-42c8-bcbe-2080f2393cc3\") " pod="openshift-cluster-node-tuning-operator/tuned-k865s"
Oct 30 19:48:10.773669 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.773456    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/20819707-689f-4b17-8762-802fd5152c71-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-7bd7489957-bxr6q\" (UID: \"20819707-689f-4b17-8762-802fd5152c71\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-bxr6q"
Oct 30 19:48:10.773669 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.773508    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/8d3e77a0-4ee8-4429-9795-97fb3d799dba-multus-daemon-config\") pod \"multus-pb5c7\" (UID: \"8d3e77a0-4ee8-4429-9795-97fb3d799dba\") " pod="openshift-multus/multus-pb5c7"
Oct 30 19:48:10.773669 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.773536    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/34dfa231-fa1a-400c-82b4-6ee85859d7c4-hosts-file\") pod \"node-resolver-krr87\" (UID: \"34dfa231-fa1a-400c-82b4-6ee85859d7c4\") " pod="openshift-dns/node-resolver-krr87"
Oct 30 19:48:10.773669 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.773531    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/2be7f3a3-8714-491c-8e10-c594d425069a-agent-certs\") pod \"konnectivity-agent-6lj57\" (UID: \"2be7f3a3-8714-491c-8e10-c594d425069a\") " pod="kube-system/konnectivity-agent-6lj57"
Oct 30 19:48:10.773669 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.773560    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/dde165c4-1ada-4fd6-af53-32fd75286c79-node-exporter-wtmp\") pod \"node-exporter-lvg9n\" (UID: \"dde165c4-1ada-4fd6-af53-32fd75286c79\") " pod="openshift-monitoring/node-exporter-lvg9n"
Oct 30 19:48:10.773669 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.773620    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ac20c88a-e9bd-42c8-bcbe-2080f2393cc3-run\") pod \"tuned-k865s\" (UID: \"ac20c88a-e9bd-42c8-bcbe-2080f2393cc3\") " pod="openshift-cluster-node-tuning-operator/tuned-k865s"
Oct 30 19:48:10.773669 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.773646    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/98dd829b-0745-4229-b781-da2c4ad16f9e-host-kubelet\") pod \"ovnkube-node-84v4l\" (UID: \"98dd829b-0745-4229-b781-da2c4ad16f9e\") " pod="openshift-ovn-kubernetes/ovnkube-node-84v4l"
Oct 30 19:48:10.774234 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.773678    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/98dd829b-0745-4229-b781-da2c4ad16f9e-host-slash\") pod \"ovnkube-node-84v4l\" (UID: \"98dd829b-0745-4229-b781-da2c4ad16f9e\") " pod="openshift-ovn-kubernetes/ovnkube-node-84v4l"
Oct 30 19:48:10.774234 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.773780    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/20819707-689f-4b17-8762-802fd5152c71-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-7bd7489957-bxr6q\" (UID: \"20819707-689f-4b17-8762-802fd5152c71\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-bxr6q"
Oct 30 19:48:10.774234 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.773809    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8d3e77a0-4ee8-4429-9795-97fb3d799dba-multus-cni-dir\") pod \"multus-pb5c7\" (UID: \"8d3e77a0-4ee8-4429-9795-97fb3d799dba\") " pod="openshift-multus/multus-pb5c7"
Oct 30 19:48:10.774234 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.773846    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/8d3e77a0-4ee8-4429-9795-97fb3d799dba-hostroot\") pod \"multus-pb5c7\" (UID: \"8d3e77a0-4ee8-4429-9795-97fb3d799dba\") " pod="openshift-multus/multus-pb5c7"
Oct 30 19:48:10.774234 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.773865    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/8d3e77a0-4ee8-4429-9795-97fb3d799dba-multus-daemon-config\") pod \"multus-pb5c7\" (UID: \"8d3e77a0-4ee8-4429-9795-97fb3d799dba\") " pod="openshift-multus/multus-pb5c7"
Oct 30 19:48:10.774234 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.773868    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/98dd829b-0745-4229-b781-da2c4ad16f9e-host-cni-bin\") pod \"ovnkube-node-84v4l\" (UID: \"98dd829b-0745-4229-b781-da2c4ad16f9e\") " pod="openshift-ovn-kubernetes/ovnkube-node-84v4l"
Oct 30 19:48:10.774234 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.773933    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9898418c-eb0f-41b4-a844-d853caeab57f-system-cni-dir\") pod \"multus-additional-cni-plugins-q8w4d\" (UID: \"9898418c-eb0f-41b4-a844-d853caeab57f\") " pod="openshift-multus/multus-additional-cni-plugins-q8w4d"
Oct 30 19:48:10.774234 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.773984    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w27xp\" (UniqueName: \"kubernetes.io/projected/20819707-689f-4b17-8762-802fd5152c71-kube-api-access-w27xp\") pod \"openshift-state-metrics-7bd7489957-bxr6q\" (UID: \"20819707-689f-4b17-8762-802fd5152c71\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-bxr6q"
Oct 30 19:48:10.774234 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.774020    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/2a71410e-a1ce-479e-a9ea-261a4e41f6e3-kube-state-metrics-tls\") pod \"kube-state-metrics-5dc8d7d89b-zvm7p\" (UID: \"2a71410e-a1ce-479e-a9ea-261a4e41f6e3\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-zvm7p"
Oct 30 19:48:10.774234 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.774049    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7drkj\" (UniqueName: \"kubernetes.io/projected/8d3e77a0-4ee8-4429-9795-97fb3d799dba-kube-api-access-7drkj\") pod \"multus-pb5c7\" (UID: \"8d3e77a0-4ee8-4429-9795-97fb3d799dba\") " pod="openshift-multus/multus-pb5c7"
Oct 30 19:48:10.774234 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.774074    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/98dd829b-0745-4229-b781-da2c4ad16f9e-ovnkube-config\") pod \"ovnkube-node-84v4l\" (UID: \"98dd829b-0745-4229-b781-da2c4ad16f9e\") " pod="openshift-ovn-kubernetes/ovnkube-node-84v4l"
Oct 30 19:48:10.774234 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.774100    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ac20c88a-e9bd-42c8-bcbe-2080f2393cc3-etc-sysctl-conf\") pod \"tuned-k865s\" (UID: \"ac20c88a-e9bd-42c8-bcbe-2080f2393cc3\") " pod="openshift-cluster-node-tuning-operator/tuned-k865s"
Oct 30 19:48:10.774234 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.774124    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r4zjc\" (UniqueName: \"kubernetes.io/projected/ac20c88a-e9bd-42c8-bcbe-2080f2393cc3-kube-api-access-r4zjc\") pod \"tuned-k865s\" (UID: \"ac20c88a-e9bd-42c8-bcbe-2080f2393cc3\") " pod="openshift-cluster-node-tuning-operator/tuned-k865s"
Oct 30 19:48:10.774234 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.774152    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8d3e77a0-4ee8-4429-9795-97fb3d799dba-host-run-netns\") pod \"multus-pb5c7\" (UID: \"8d3e77a0-4ee8-4429-9795-97fb3d799dba\") " pod="openshift-multus/multus-pb5c7"
Oct 30 19:48:10.774234 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.774179    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/6b02f882-10f6-47c4-84a0-8c07533bbb7d-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5f8f546c56-w96tg\" (UID: \"6b02f882-10f6-47c4-84a0-8c07533bbb7d\") " pod="openshift-monitoring/thanos-querier-5f8f546c56-w96tg"
Oct 30 19:48:10.774234 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.774207    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/6b02f882-10f6-47c4-84a0-8c07533bbb7d-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5f8f546c56-w96tg\" (UID: \"6b02f882-10f6-47c4-84a0-8c07533bbb7d\") " pod="openshift-monitoring/thanos-querier-5f8f546c56-w96tg"
Oct 30 19:48:10.774994 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.774261    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bz9kn\" (UniqueName: \"kubernetes.io/projected/98dd829b-0745-4229-b781-da2c4ad16f9e-kube-api-access-bz9kn\") pod \"ovnkube-node-84v4l\" (UID: \"98dd829b-0745-4229-b781-da2c4ad16f9e\") " pod="openshift-ovn-kubernetes/ovnkube-node-84v4l"
Oct 30 19:48:10.774994 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.774473    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/6b02f882-10f6-47c4-84a0-8c07533bbb7d-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5f8f546c56-w96tg\" (UID: \"6b02f882-10f6-47c4-84a0-8c07533bbb7d\") " pod="openshift-monitoring/thanos-querier-5f8f546c56-w96tg"
Oct 30 19:48:10.774994 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.774480    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/98dd829b-0745-4229-b781-da2c4ad16f9e-ovnkube-config\") pod \"ovnkube-node-84v4l\" (UID: \"98dd829b-0745-4229-b781-da2c4ad16f9e\") " pod="openshift-ovn-kubernetes/ovnkube-node-84v4l"
Oct 30 19:48:10.774994 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.774474    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/6b02f882-10f6-47c4-84a0-8c07533bbb7d-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5f8f546c56-w96tg\" (UID: \"6b02f882-10f6-47c4-84a0-8c07533bbb7d\") " pod="openshift-monitoring/thanos-querier-5f8f546c56-w96tg"
Oct 30 19:48:10.774994 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.774519    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/34dfa231-fa1a-400c-82b4-6ee85859d7c4-tmp-dir\") pod \"node-resolver-krr87\" (UID: \"34dfa231-fa1a-400c-82b4-6ee85859d7c4\") " pod="openshift-dns/node-resolver-krr87"
Oct 30 19:48:10.774994 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.774542    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/2d3597bf-5138-4272-905b-d2fdd3bfbe7b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-clzkm\" (UID: \"2d3597bf-5138-4272-905b-d2fdd3bfbe7b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-clzkm"
Oct 30 19:48:10.774994 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.774579    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/9898418c-eb0f-41b4-a844-d853caeab57f-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-q8w4d\" (UID: \"9898418c-eb0f-41b4-a844-d853caeab57f\") " pod="openshift-multus/multus-additional-cni-plugins-q8w4d"
Oct 30 19:48:10.774994 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.774643    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/641c89ab-1e2c-4e67-84b5-d5d0f4f30756-iptables-alerter-script\") pod \"iptables-alerter-7gdcx\" (UID: \"641c89ab-1e2c-4e67-84b5-d5d0f4f30756\") " pod="openshift-network-operator/iptables-alerter-7gdcx"
Oct 30 19:48:10.774994 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.774666    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tx724\" (UniqueName: \"kubernetes.io/projected/6b02f882-10f6-47c4-84a0-8c07533bbb7d-kube-api-access-tx724\") pod \"thanos-querier-5f8f546c56-w96tg\" (UID: \"6b02f882-10f6-47c4-84a0-8c07533bbb7d\") " pod="openshift-monitoring/thanos-querier-5f8f546c56-w96tg"
Oct 30 19:48:10.774994 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.774688    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mwhbg\" (UniqueName: \"kubernetes.io/projected/34dfa231-fa1a-400c-82b4-6ee85859d7c4-kube-api-access-mwhbg\") pod \"node-resolver-krr87\" (UID: \"34dfa231-fa1a-400c-82b4-6ee85859d7c4\") " pod="openshift-dns/node-resolver-krr87"
Oct 30 19:48:10.774994 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.774712    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l9vw6\" (UniqueName: \"kubernetes.io/projected/0a8c4dcc-2f62-4efe-993e-2de411ce6654-kube-api-access-l9vw6\") pod \"network-metrics-daemon-hkjcv\" (UID: \"0a8c4dcc-2f62-4efe-993e-2de411ce6654\") " pod="openshift-multus/network-metrics-daemon-hkjcv"
Oct 30 19:48:10.774994 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.774718    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/34dfa231-fa1a-400c-82b4-6ee85859d7c4-tmp-dir\") pod \"node-resolver-krr87\" (UID: \"34dfa231-fa1a-400c-82b4-6ee85859d7c4\") " pod="openshift-dns/node-resolver-krr87"
Oct 30 19:48:10.774994 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.774736    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e7fb91fc-bf9e-42c6-b440-7165063ae5ec-monitoring-plugin-cert\") pod \"monitoring-plugin-77f4f76594-k9gfv\" (UID: \"e7fb91fc-bf9e-42c6-b440-7165063ae5ec\") " pod="openshift-monitoring/monitoring-plugin-77f4f76594-k9gfv"
Oct 30 19:48:10.774994 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.774910    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/9898418c-eb0f-41b4-a844-d853caeab57f-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-q8w4d\" (UID: \"9898418c-eb0f-41b4-a844-d853caeab57f\") " pod="openshift-multus/multus-additional-cni-plugins-q8w4d"
Oct 30 19:48:10.775523 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.775022    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/641c89ab-1e2c-4e67-84b5-d5d0f4f30756-iptables-alerter-script\") pod \"iptables-alerter-7gdcx\" (UID: \"641c89ab-1e2c-4e67-84b5-d5d0f4f30756\") " pod="openshift-network-operator/iptables-alerter-7gdcx"
Oct 30 19:48:10.775523 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.775024    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5a23369d-e69d-40e0-a956-a109d6d653c1-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-fwc77\" (UID: \"5a23369d-e69d-40e0-a956-a109d6d653c1\") " pod="openshift-insights/insights-runtime-extractor-fwc77"
Oct 30 19:48:10.775523 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.775058    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/98dd829b-0745-4229-b781-da2c4ad16f9e-run-systemd\") pod \"ovnkube-node-84v4l\" (UID: \"98dd829b-0745-4229-b781-da2c4ad16f9e\") " pod="openshift-ovn-kubernetes/ovnkube-node-84v4l"
Oct 30 19:48:10.775523 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.775065    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/2a71410e-a1ce-479e-a9ea-261a4e41f6e3-kube-state-metrics-tls\") pod \"kube-state-metrics-5dc8d7d89b-zvm7p\" (UID: \"2a71410e-a1ce-479e-a9ea-261a4e41f6e3\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-zvm7p"
Oct 30 19:48:10.775523 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.775102    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e7fb91fc-bf9e-42c6-b440-7165063ae5ec-monitoring-plugin-cert\") pod \"monitoring-plugin-77f4f76594-k9gfv\" (UID: \"e7fb91fc-bf9e-42c6-b440-7165063ae5ec\") " pod="openshift-monitoring/monitoring-plugin-77f4f76594-k9gfv"
Oct 30 19:48:10.775523 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.775126    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8d3e77a0-4ee8-4429-9795-97fb3d799dba-etc-kubernetes\") pod \"multus-pb5c7\" (UID: \"8d3e77a0-4ee8-4429-9795-97fb3d799dba\") " pod="openshift-multus/multus-pb5c7"
Oct 30 19:48:10.775523 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.775167    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tmmdv\" (UniqueName: \"kubernetes.io/projected/aa51899f-52a0-434e-b434-4bc030c94136-kube-api-access-tmmdv\") pod \"network-check-target-b27jd\" (UID: \"aa51899f-52a0-434e-b434-4bc030c94136\") " pod="openshift-network-diagnostics/network-check-target-b27jd"
Oct 30 19:48:10.775523 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.775198    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/dde165c4-1ada-4fd6-af53-32fd75286c79-root\") pod \"node-exporter-lvg9n\" (UID: \"dde165c4-1ada-4fd6-af53-32fd75286c79\") " pod="openshift-monitoring/node-exporter-lvg9n"
Oct 30 19:48:10.775523 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.775204    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5a23369d-e69d-40e0-a956-a109d6d653c1-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-fwc77\" (UID: \"5a23369d-e69d-40e0-a956-a109d6d653c1\") " pod="openshift-insights/insights-runtime-extractor-fwc77"
Oct 30 19:48:10.775523 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.775314    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2a71410e-a1ce-479e-a9ea-261a4e41f6e3-metrics-client-ca\") pod \"kube-state-metrics-5dc8d7d89b-zvm7p\" (UID: \"2a71410e-a1ce-479e-a9ea-261a4e41f6e3\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-zvm7p"
Oct 30 19:48:10.775523 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.775358    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2a71410e-a1ce-479e-a9ea-261a4e41f6e3-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-5dc8d7d89b-zvm7p\" (UID: \"2a71410e-a1ce-479e-a9ea-261a4e41f6e3\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-zvm7p"
Oct 30 19:48:10.775523 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.775475    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/8d3e77a0-4ee8-4429-9795-97fb3d799dba-host-run-k8s-cni-cncf-io\") pod \"multus-pb5c7\" (UID: \"8d3e77a0-4ee8-4429-9795-97fb3d799dba\") " pod="openshift-multus/multus-pb5c7"
Oct 30 19:48:10.775523 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.775499    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2a71410e-a1ce-479e-a9ea-261a4e41f6e3-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-5dc8d7d89b-zvm7p\" (UID: \"2a71410e-a1ce-479e-a9ea-261a4e41f6e3\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-zvm7p"
Oct 30 19:48:10.775523 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.775510    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/98dd829b-0745-4229-b781-da2c4ad16f9e-host-run-ovn-kubernetes\") pod \"ovnkube-node-84v4l\" (UID: \"98dd829b-0745-4229-b781-da2c4ad16f9e\") " pod="openshift-ovn-kubernetes/ovnkube-node-84v4l"
Oct 30 19:48:10.776051 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.775550    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/98dd829b-0745-4229-b781-da2c4ad16f9e-ovn-node-metrics-cert\") pod \"ovnkube-node-84v4l\" (UID: \"98dd829b-0745-4229-b781-da2c4ad16f9e\") " pod="openshift-ovn-kubernetes/ovnkube-node-84v4l"
Oct 30 19:48:10.776051 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.775575    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2a71410e-a1ce-479e-a9ea-261a4e41f6e3-metrics-client-ca\") pod \"kube-state-metrics-5dc8d7d89b-zvm7p\" (UID: \"2a71410e-a1ce-479e-a9ea-261a4e41f6e3\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-zvm7p"
Oct 30 19:48:10.776051 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.775583    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v75vv\" (UniqueName: \"kubernetes.io/projected/2d3597bf-5138-4272-905b-d2fdd3bfbe7b-kube-api-access-v75vv\") pod \"aws-ebs-csi-driver-node-clzkm\" (UID: \"2d3597bf-5138-4272-905b-d2fdd3bfbe7b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-clzkm"
Oct 30 19:48:10.776051 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.775599    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/2be7f3a3-8714-491c-8e10-c594d425069a-konnectivity-ca\") pod \"konnectivity-agent-6lj57\" (UID: \"2be7f3a3-8714-491c-8e10-c594d425069a\") " pod="kube-system/konnectivity-agent-6lj57"
Oct 30 19:48:10.776051 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.775615    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/20819707-689f-4b17-8762-802fd5152c71-openshift-state-metrics-tls\") pod \"openshift-state-metrics-7bd7489957-bxr6q\" (UID: \"20819707-689f-4b17-8762-802fd5152c71\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-bxr6q"
Oct 30 19:48:10.776051 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.775648    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bvnbm\" (UniqueName: \"kubernetes.io/projected/e7fb91fc-bf9e-42c6-b440-7165063ae5ec-kube-api-access-bvnbm\") pod \"monitoring-plugin-77f4f76594-k9gfv\" (UID: \"e7fb91fc-bf9e-42c6-b440-7165063ae5ec\") " pod="openshift-monitoring/monitoring-plugin-77f4f76594-k9gfv"
Oct 30 19:48:10.776051 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.775664    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4d52cf11-23b8-4b48-92ec-009845eea77f-tmp-dir\") pod \"dns-default-kmppx\" (UID: \"4d52cf11-23b8-4b48-92ec-009845eea77f\") " pod="openshift-dns/dns-default-kmppx"
Oct 30 19:48:10.776051 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.775690    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/5a23369d-e69d-40e0-a956-a109d6d653c1-crio-socket\") pod \"insights-runtime-extractor-fwc77\" (UID: \"5a23369d-e69d-40e0-a956-a109d6d653c1\") " pod="openshift-insights/insights-runtime-extractor-fwc77"
Oct 30 19:48:10.776051 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.775716    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/98dd829b-0745-4229-b781-da2c4ad16f9e-ovnkube-script-lib\") pod \"ovnkube-node-84v4l\" (UID: \"98dd829b-0745-4229-b781-da2c4ad16f9e\") " pod="openshift-ovn-kubernetes/ovnkube-node-84v4l"
Oct 30 19:48:10.776051 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.775745    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/98dd829b-0745-4229-b781-da2c4ad16f9e-ovn-node-metrics-cert\") pod \"ovnkube-node-84v4l\" (UID: \"98dd829b-0745-4229-b781-da2c4ad16f9e\") " pod="openshift-ovn-kubernetes/ovnkube-node-84v4l"
Oct 30 19:48:10.776051 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.775751    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4d52cf11-23b8-4b48-92ec-009845eea77f-tmp-dir\") pod \"dns-default-kmppx\" (UID: \"4d52cf11-23b8-4b48-92ec-009845eea77f\") " pod="openshift-dns/dns-default-kmppx"
Oct 30 19:48:10.776051 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.775776    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/9898418c-eb0f-41b4-a844-d853caeab57f-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-q8w4d\" (UID: \"9898418c-eb0f-41b4-a844-d853caeab57f\") " pod="openshift-multus/multus-additional-cni-plugins-q8w4d"
Oct 30 19:48:10.776051 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.775798    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/dde165c4-1ada-4fd6-af53-32fd75286c79-sys\") pod \"node-exporter-lvg9n\" (UID: \"dde165c4-1ada-4fd6-af53-32fd75286c79\") " pod="openshift-monitoring/node-exporter-lvg9n"
Oct 30 19:48:10.776051 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.775824    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/2be7f3a3-8714-491c-8e10-c594d425069a-konnectivity-ca\") pod \"konnectivity-agent-6lj57\" (UID: \"2be7f3a3-8714-491c-8e10-c594d425069a\") " pod="kube-system/konnectivity-agent-6lj57"
Oct 30 19:48:10.776051 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.775853    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ac20c88a-e9bd-42c8-bcbe-2080f2393cc3-etc-kubernetes\") pod \"tuned-k865s\" (UID: \"ac20c88a-e9bd-42c8-bcbe-2080f2393cc3\") " pod="openshift-cluster-node-tuning-operator/tuned-k865s"
Oct 30 19:48:10.776051 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.775907    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/20819707-689f-4b17-8762-802fd5152c71-openshift-state-metrics-tls\") pod \"openshift-state-metrics-7bd7489957-bxr6q\" (UID: \"20819707-689f-4b17-8762-802fd5152c71\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-bxr6q"
Oct 30 19:48:10.776051 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.775973    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/9898418c-eb0f-41b4-a844-d853caeab57f-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-q8w4d\" (UID: \"9898418c-eb0f-41b4-a844-d853caeab57f\") " pod="openshift-multus/multus-additional-cni-plugins-q8w4d"
Oct 30 19:48:10.776051 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.775998    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5a23369d-e69d-40e0-a956-a109d6d653c1-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fwc77\" (UID: \"5a23369d-e69d-40e0-a956-a109d6d653c1\") " pod="openshift-insights/insights-runtime-extractor-fwc77"
Oct 30 19:48:10.776051 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.776022    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/98dd829b-0745-4229-b781-da2c4ad16f9e-ovnkube-script-lib\") pod \"ovnkube-node-84v4l\" (UID: \"98dd829b-0745-4229-b781-da2c4ad16f9e\") " pod="openshift-ovn-kubernetes/ovnkube-node-84v4l"
Oct 30 19:48:10.776051 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.776027    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/98dd829b-0745-4229-b781-da2c4ad16f9e-host-cni-netd\") pod \"ovnkube-node-84v4l\" (UID: \"98dd829b-0745-4229-b781-da2c4ad16f9e\") " pod="openshift-ovn-kubernetes/ovnkube-node-84v4l"
Oct 30 19:48:10.776051 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.776055    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ac20c88a-e9bd-42c8-bcbe-2080f2393cc3-etc-sysconfig\") pod \"tuned-k865s\" (UID: \"ac20c88a-e9bd-42c8-bcbe-2080f2393cc3\") " pod="openshift-cluster-node-tuning-operator/tuned-k865s"
Oct 30 19:48:10.776799 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.776091    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6b02f882-10f6-47c4-84a0-8c07533bbb7d-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5f8f546c56-w96tg\" (UID: \"6b02f882-10f6-47c4-84a0-8c07533bbb7d\") " pod="openshift-monitoring/thanos-querier-5f8f546c56-w96tg"
Oct 30 19:48:10.776799 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.776156    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/20819707-689f-4b17-8762-802fd5152c71-metrics-client-ca\") pod \"openshift-state-metrics-7bd7489957-bxr6q\" (UID: \"20819707-689f-4b17-8762-802fd5152c71\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-bxr6q"
Oct 30 19:48:10.776799 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.776177    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5a23369d-e69d-40e0-a956-a109d6d653c1-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fwc77\" (UID: \"5a23369d-e69d-40e0-a956-a109d6d653c1\") " pod="openshift-insights/insights-runtime-extractor-fwc77"
Oct 30 19:48:10.776799 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.776216    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/2a71410e-a1ce-479e-a9ea-261a4e41f6e3-volume-directive-shadow\") pod \"kube-state-metrics-5dc8d7d89b-zvm7p\" (UID: \"2a71410e-a1ce-479e-a9ea-261a4e41f6e3\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-zvm7p"
Oct 30 19:48:10.776799 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.776276    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/2a71410e-a1ce-479e-a9ea-261a4e41f6e3-volume-directive-shadow\") pod \"kube-state-metrics-5dc8d7d89b-zvm7p\" (UID: \"2a71410e-a1ce-479e-a9ea-261a4e41f6e3\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-zvm7p"
Oct 30 19:48:10.776799 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.776289    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-plsvs\" (UniqueName: \"kubernetes.io/projected/5a23369d-e69d-40e0-a956-a109d6d653c1-kube-api-access-plsvs\") pod \"insights-runtime-extractor-fwc77\" (UID: \"5a23369d-e69d-40e0-a956-a109d6d653c1\") " pod="openshift-insights/insights-runtime-extractor-fwc77"
Oct 30 19:48:10.776799 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.776318    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/2d3597bf-5138-4272-905b-d2fdd3bfbe7b-sys-fs\") pod \"aws-ebs-csi-driver-node-clzkm\" (UID: \"2d3597bf-5138-4272-905b-d2fdd3bfbe7b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-clzkm"
Oct 30 19:48:10.776799 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.776331    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/423e0100-284b-48b9-bd4c-3b74005976d2-host\") pod \"node-ca-2swph\" (UID: \"423e0100-284b-48b9-bd4c-3b74005976d2\") " pod="openshift-image-registry/node-ca-2swph"
Oct 30 19:48:10.776799 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.776351    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6b02f882-10f6-47c4-84a0-8c07533bbb7d-tmp\") pod \"thanos-querier-5f8f546c56-w96tg\" (UID: \"6b02f882-10f6-47c4-84a0-8c07533bbb7d\") " pod="openshift-monitoring/thanos-querier-5f8f546c56-w96tg"
Oct 30 19:48:10.776799 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.776383    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/2d3597bf-5138-4272-905b-d2fdd3bfbe7b-device-dir\") pod \"aws-ebs-csi-driver-node-clzkm\" (UID: \"2d3597bf-5138-4272-905b-d2fdd3bfbe7b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-clzkm"
Oct 30 19:48:10.776799 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.776394    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/20819707-689f-4b17-8762-802fd5152c71-metrics-client-ca\") pod \"openshift-state-metrics-7bd7489957-bxr6q\" (UID: \"20819707-689f-4b17-8762-802fd5152c71\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-bxr6q"
Oct 30 19:48:10.776799 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.776443    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6b02f882-10f6-47c4-84a0-8c07533bbb7d-tmp\") pod \"thanos-querier-5f8f546c56-w96tg\" (UID: \"6b02f882-10f6-47c4-84a0-8c07533bbb7d\") " pod="openshift-monitoring/thanos-querier-5f8f546c56-w96tg"
Oct 30 19:48:10.776799 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.776446    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/dde165c4-1ada-4fd6-af53-32fd75286c79-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-lvg9n\" (UID: \"dde165c4-1ada-4fd6-af53-32fd75286c79\") " pod="openshift-monitoring/node-exporter-lvg9n"
Oct 30 19:48:10.776799 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.776444    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6b02f882-10f6-47c4-84a0-8c07533bbb7d-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5f8f546c56-w96tg\" (UID: \"6b02f882-10f6-47c4-84a0-8c07533bbb7d\") " pod="openshift-monitoring/thanos-querier-5f8f546c56-w96tg"
Oct 30 19:48:10.776799 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.776577    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/2a71410e-a1ce-479e-a9ea-261a4e41f6e3-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-5dc8d7d89b-zvm7p\" (UID: \"2a71410e-a1ce-479e-a9ea-261a4e41f6e3\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-zvm7p"
Oct 30 19:48:10.776799 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.776597    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/dde165c4-1ada-4fd6-af53-32fd75286c79-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-lvg9n\" (UID: \"dde165c4-1ada-4fd6-af53-32fd75286c79\") " pod="openshift-monitoring/node-exporter-lvg9n"
Oct 30 19:48:10.776799 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.776620    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8d3e77a0-4ee8-4429-9795-97fb3d799dba-cnibin\") pod \"multus-pb5c7\" (UID: \"8d3e77a0-4ee8-4429-9795-97fb3d799dba\") " pod="openshift-multus/multus-pb5c7"
Oct 30 19:48:10.776799 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.776637    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/98dd829b-0745-4229-b781-da2c4ad16f9e-log-socket\") pod \"ovnkube-node-84v4l\" (UID: \"98dd829b-0745-4229-b781-da2c4ad16f9e\") " pod="openshift-ovn-kubernetes/ovnkube-node-84v4l"
Oct 30 19:48:10.776799 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.776654    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/dde165c4-1ada-4fd6-af53-32fd75286c79-node-exporter-accelerators-collector-config\") pod \"node-exporter-lvg9n\" (UID: \"dde165c4-1ada-4fd6-af53-32fd75286c79\") " pod="openshift-monitoring/node-exporter-lvg9n"
Oct 30 19:48:10.776799 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.776681    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/90b35edf-4b09-41df-9374-a514d1417071-kubelet-config\") pod \"global-pull-secret-syncer-96mhd\" (UID: \"90b35edf-4b09-41df-9374-a514d1417071\") " pod="kube-system/global-pull-secret-syncer-96mhd"
Oct 30 19:48:10.776799 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.776709    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jvx29\" (UniqueName: \"kubernetes.io/projected/45a7e195-0bbf-46cb-b821-30728122c3fc-kube-api-access-jvx29\") pod \"ingress-canary-r6bht\" (UID: \"45a7e195-0bbf-46cb-b821-30728122c3fc\") " pod="openshift-ingress-canary/ingress-canary-r6bht"
Oct 30 19:48:10.776799 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.776733    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8d3e77a0-4ee8-4429-9795-97fb3d799dba-host-var-lib-kubelet\") pod \"multus-pb5c7\" (UID: \"8d3e77a0-4ee8-4429-9795-97fb3d799dba\") " pod="openshift-multus/multus-pb5c7"
Oct 30 19:48:10.776799 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.776749    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rmn47\" (UniqueName: \"kubernetes.io/projected/4d52cf11-23b8-4b48-92ec-009845eea77f-kube-api-access-rmn47\") pod \"dns-default-kmppx\" (UID: \"4d52cf11-23b8-4b48-92ec-009845eea77f\") " pod="openshift-dns/dns-default-kmppx"
Oct 30 19:48:10.776799 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.776762    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/2a71410e-a1ce-479e-a9ea-261a4e41f6e3-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-5dc8d7d89b-zvm7p\" (UID: \"2a71410e-a1ce-479e-a9ea-261a4e41f6e3\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-zvm7p"
Oct 30 19:48:10.776799 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.776769    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6b02f882-10f6-47c4-84a0-8c07533bbb7d-metrics-client-ca\") pod \"thanos-querier-5f8f546c56-w96tg\" (UID: \"6b02f882-10f6-47c4-84a0-8c07533bbb7d\") " pod="openshift-monitoring/thanos-querier-5f8f546c56-w96tg"
Oct 30 19:48:10.776799 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.776809    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/90b35edf-4b09-41df-9374-a514d1417071-dbus\") pod \"global-pull-secret-syncer-96mhd\" (UID: \"90b35edf-4b09-41df-9374-a514d1417071\") " pod="kube-system/global-pull-secret-syncer-96mhd"
Oct 30 19:48:10.777641 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.776820    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/dde165c4-1ada-4fd6-af53-32fd75286c79-node-exporter-accelerators-collector-config\") pod \"node-exporter-lvg9n\" (UID: \"dde165c4-1ada-4fd6-af53-32fd75286c79\") " pod="openshift-monitoring/node-exporter-lvg9n"
Oct 30 19:48:10.777641 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.776870    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9898418c-eb0f-41b4-a844-d853caeab57f-tuning-conf-dir\") pod \"multus-additional-cni-plugins-q8w4d\" (UID: \"9898418c-eb0f-41b4-a844-d853caeab57f\") " pod="openshift-multus/multus-additional-cni-plugins-q8w4d"
Oct 30 19:48:10.777641 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.776903    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-879bk\" (UniqueName: \"kubernetes.io/projected/dde165c4-1ada-4fd6-af53-32fd75286c79-kube-api-access-879bk\") pod \"node-exporter-lvg9n\" (UID: \"dde165c4-1ada-4fd6-af53-32fd75286c79\") " pod="openshift-monitoring/node-exporter-lvg9n"
Oct 30 19:48:10.777641 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.776931    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/6b02f882-10f6-47c4-84a0-8c07533bbb7d-secret-thanos-querier-tls\") pod \"thanos-querier-5f8f546c56-w96tg\" (UID: \"6b02f882-10f6-47c4-84a0-8c07533bbb7d\") " pod="openshift-monitoring/thanos-querier-5f8f546c56-w96tg"
Oct 30 19:48:10.777641 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.776934    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6b02f882-10f6-47c4-84a0-8c07533bbb7d-metrics-client-ca\") pod \"thanos-querier-5f8f546c56-w96tg\" (UID: \"6b02f882-10f6-47c4-84a0-8c07533bbb7d\") " pod="openshift-monitoring/thanos-querier-5f8f546c56-w96tg"
Oct 30 19:48:10.777641 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.776998    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/98dd829b-0745-4229-b781-da2c4ad16f9e-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-84v4l\" (UID: \"98dd829b-0745-4229-b781-da2c4ad16f9e\") " pod="openshift-ovn-kubernetes/ovnkube-node-84v4l"
Oct 30 19:48:10.777641 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.777041    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ac20c88a-e9bd-42c8-bcbe-2080f2393cc3-etc-modprobe-d\") pod \"tuned-k865s\" (UID: \"ac20c88a-e9bd-42c8-bcbe-2080f2393cc3\") " pod="openshift-cluster-node-tuning-operator/tuned-k865s"
Oct 30 19:48:10.777641 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.777076    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ac20c88a-e9bd-42c8-bcbe-2080f2393cc3-tmp\") pod \"tuned-k865s\" (UID: \"ac20c88a-e9bd-42c8-bcbe-2080f2393cc3\") " pod="openshift-cluster-node-tuning-operator/tuned-k865s"
Oct 30 19:48:10.777641 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.777110    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ac20c88a-e9bd-42c8-bcbe-2080f2393cc3-tmp\") pod \"tuned-k865s\" (UID: \"ac20c88a-e9bd-42c8-bcbe-2080f2393cc3\") " pod="openshift-cluster-node-tuning-operator/tuned-k865s"
Oct 30 19:48:10.777641 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.777113    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/8d3e77a0-4ee8-4429-9795-97fb3d799dba-multus-socket-dir-parent\") pod \"multus-pb5c7\" (UID: \"8d3e77a0-4ee8-4429-9795-97fb3d799dba\") " pod="openshift-multus/multus-pb5c7"
Oct 30 19:48:10.777641 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.777137    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/6b02f882-10f6-47c4-84a0-8c07533bbb7d-secret-thanos-querier-tls\") pod \"thanos-querier-5f8f546c56-w96tg\" (UID: \"6b02f882-10f6-47c4-84a0-8c07533bbb7d\") " pod="openshift-monitoring/thanos-querier-5f8f546c56-w96tg"
Oct 30 19:48:10.777641 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.777141    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x2lwt\" (UniqueName: \"kubernetes.io/projected/2a71410e-a1ce-479e-a9ea-261a4e41f6e3-kube-api-access-x2lwt\") pod \"kube-state-metrics-5dc8d7d89b-zvm7p\" (UID: \"2a71410e-a1ce-479e-a9ea-261a4e41f6e3\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-zvm7p"
Oct 30 19:48:10.777641 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.777178    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8d3e77a0-4ee8-4429-9795-97fb3d799dba-multus-conf-dir\") pod \"multus-pb5c7\" (UID: \"8d3e77a0-4ee8-4429-9795-97fb3d799dba\") " pod="openshift-multus/multus-pb5c7"
Oct 30 19:48:10.777641 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.777208    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/90b35edf-4b09-41df-9374-a514d1417071-original-pull-secret\") pod \"global-pull-secret-syncer-96mhd\" (UID: \"90b35edf-4b09-41df-9374-a514d1417071\") " pod="kube-system/global-pull-secret-syncer-96mhd"
Oct 30 19:48:10.777641 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.777246    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9898418c-eb0f-41b4-a844-d853caeab57f-cnibin\") pod \"multus-additional-cni-plugins-q8w4d\" (UID: \"9898418c-eb0f-41b4-a844-d853caeab57f\") " pod="openshift-multus/multus-additional-cni-plugins-q8w4d"
Oct 30 19:48:10.777641 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.777273    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/dde165c4-1ada-4fd6-af53-32fd75286c79-node-exporter-textfile\") pod \"node-exporter-lvg9n\" (UID: \"dde165c4-1ada-4fd6-af53-32fd75286c79\") " pod="openshift-monitoring/node-exporter-lvg9n"
Oct 30 19:48:10.777641 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.777339    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ac20c88a-e9bd-42c8-bcbe-2080f2393cc3-etc-sysctl-d\") pod \"tuned-k865s\" (UID: \"ac20c88a-e9bd-42c8-bcbe-2080f2393cc3\") " pod="openshift-cluster-node-tuning-operator/tuned-k865s"
Oct 30 19:48:10.777641 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.777366    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/dde165c4-1ada-4fd6-af53-32fd75286c79-node-exporter-textfile\") pod \"node-exporter-lvg9n\" (UID: \"dde165c4-1ada-4fd6-af53-32fd75286c79\") " pod="openshift-monitoring/node-exporter-lvg9n"
Oct 30 19:48:10.777641 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.777367    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ac20c88a-e9bd-42c8-bcbe-2080f2393cc3-var-lib-kubelet\") pod \"tuned-k865s\" (UID: \"ac20c88a-e9bd-42c8-bcbe-2080f2393cc3\") " pod="openshift-cluster-node-tuning-operator/tuned-k865s"
Oct 30 19:48:10.777641 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.777392    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/2d3597bf-5138-4272-905b-d2fdd3bfbe7b-etc-selinux\") pod \"aws-ebs-csi-driver-node-clzkm\" (UID: \"2d3597bf-5138-4272-905b-d2fdd3bfbe7b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-clzkm"
Oct 30 19:48:10.777641 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.777431    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ac20c88a-e9bd-42c8-bcbe-2080f2393cc3-lib-modules\") pod \"tuned-k865s\" (UID: \"ac20c88a-e9bd-42c8-bcbe-2080f2393cc3\") " pod="openshift-cluster-node-tuning-operator/tuned-k865s"
Oct 30 19:48:10.777641 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.777448    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ac20c88a-e9bd-42c8-bcbe-2080f2393cc3-host\") pod \"tuned-k865s\" (UID: \"ac20c88a-e9bd-42c8-bcbe-2080f2393cc3\") " pod="openshift-cluster-node-tuning-operator/tuned-k865s"
Oct 30 19:48:10.777641 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.777463    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/8d3e77a0-4ee8-4429-9795-97fb3d799dba-host-var-lib-cni-multus\") pod \"multus-pb5c7\" (UID: \"8d3e77a0-4ee8-4429-9795-97fb3d799dba\") " pod="openshift-multus/multus-pb5c7"
Oct 30 19:48:10.777641 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.777480    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/6b02f882-10f6-47c4-84a0-8c07533bbb7d-secret-grpc-tls\") pod \"thanos-querier-5f8f546c56-w96tg\" (UID: \"6b02f882-10f6-47c4-84a0-8c07533bbb7d\") " pod="openshift-monitoring/thanos-querier-5f8f546c56-w96tg"
Oct 30 19:48:10.777641 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.777505    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/90b35edf-4b09-41df-9374-a514d1417071-original-pull-secret\") pod \"global-pull-secret-syncer-96mhd\" (UID: \"90b35edf-4b09-41df-9374-a514d1417071\") " pod="kube-system/global-pull-secret-syncer-96mhd"
Oct 30 19:48:10.778273 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.777685    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/6b02f882-10f6-47c4-84a0-8c07533bbb7d-secret-grpc-tls\") pod \"thanos-querier-5f8f546c56-w96tg\" (UID: \"6b02f882-10f6-47c4-84a0-8c07533bbb7d\") " pod="openshift-monitoring/thanos-querier-5f8f546c56-w96tg"
Oct 30 19:48:10.796404 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.796386    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2gglq\" (UniqueName: \"kubernetes.io/projected/9898418c-eb0f-41b4-a844-d853caeab57f-kube-api-access-2gglq\") pod \"multus-additional-cni-plugins-q8w4d\" (UID: \"9898418c-eb0f-41b4-a844-d853caeab57f\") " pod="openshift-multus/multus-additional-cni-plugins-q8w4d"
Oct 30 19:48:10.796493 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.796390    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-njzf8\" (UniqueName: \"kubernetes.io/projected/423e0100-284b-48b9-bd4c-3b74005976d2-kube-api-access-njzf8\") pod \"node-ca-2swph\" (UID: \"423e0100-284b-48b9-bd4c-3b74005976d2\") " pod="openshift-image-registry/node-ca-2swph"
Oct 30 19:48:10.796893 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.796878    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hk8r5\" (UniqueName: \"kubernetes.io/projected/641c89ab-1e2c-4e67-84b5-d5d0f4f30756-kube-api-access-hk8r5\") pod \"iptables-alerter-7gdcx\" (UID: \"641c89ab-1e2c-4e67-84b5-d5d0f4f30756\") " pod="openshift-network-operator/iptables-alerter-7gdcx"
Oct 30 19:48:10.798761 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.798743    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w27xp\" (UniqueName: \"kubernetes.io/projected/20819707-689f-4b17-8762-802fd5152c71-kube-api-access-w27xp\") pod \"openshift-state-metrics-7bd7489957-bxr6q\" (UID: \"20819707-689f-4b17-8762-802fd5152c71\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-bxr6q"
Oct 30 19:48:10.801046 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.801027    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tmmdv\" (UniqueName: \"kubernetes.io/projected/aa51899f-52a0-434e-b434-4bc030c94136-kube-api-access-tmmdv\") pod \"network-check-target-b27jd\" (UID: \"aa51899f-52a0-434e-b434-4bc030c94136\") " pod="openshift-network-diagnostics/network-check-target-b27jd"
Oct 30 19:48:10.801389 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.801370    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r4zjc\" (UniqueName: \"kubernetes.io/projected/ac20c88a-e9bd-42c8-bcbe-2080f2393cc3-kube-api-access-r4zjc\") pod \"tuned-k865s\" (UID: \"ac20c88a-e9bd-42c8-bcbe-2080f2393cc3\") " pod="openshift-cluster-node-tuning-operator/tuned-k865s"
Oct 30 19:48:10.802268 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.802253    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mwhbg\" (UniqueName: \"kubernetes.io/projected/34dfa231-fa1a-400c-82b4-6ee85859d7c4-kube-api-access-mwhbg\") pod \"node-resolver-krr87\" (UID: \"34dfa231-fa1a-400c-82b4-6ee85859d7c4\") " pod="openshift-dns/node-resolver-krr87"
Oct 30 19:48:10.804965 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.804942    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v75vv\" (UniqueName: \"kubernetes.io/projected/2d3597bf-5138-4272-905b-d2fdd3bfbe7b-kube-api-access-v75vv\") pod \"aws-ebs-csi-driver-node-clzkm\" (UID: \"2d3597bf-5138-4272-905b-d2fdd3bfbe7b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-clzkm"
Oct 30 19:48:10.805115 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.805101    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bvnbm\" (UniqueName: \"kubernetes.io/projected/e7fb91fc-bf9e-42c6-b440-7165063ae5ec-kube-api-access-bvnbm\") pod \"monitoring-plugin-77f4f76594-k9gfv\" (UID: \"e7fb91fc-bf9e-42c6-b440-7165063ae5ec\") " pod="openshift-monitoring/monitoring-plugin-77f4f76594-k9gfv"
Oct 30 19:48:10.805971 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.805948    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l9vw6\" (UniqueName: \"kubernetes.io/projected/0a8c4dcc-2f62-4efe-993e-2de411ce6654-kube-api-access-l9vw6\") pod \"network-metrics-daemon-hkjcv\" (UID: \"0a8c4dcc-2f62-4efe-993e-2de411ce6654\") " pod="openshift-multus/network-metrics-daemon-hkjcv"
Oct 30 19:48:10.806062 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.806001    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-plsvs\" (UniqueName: \"kubernetes.io/projected/5a23369d-e69d-40e0-a956-a109d6d653c1-kube-api-access-plsvs\") pod \"insights-runtime-extractor-fwc77\" (UID: \"5a23369d-e69d-40e0-a956-a109d6d653c1\") " pod="openshift-insights/insights-runtime-extractor-fwc77"
Oct 30 19:48:10.806709 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.806690    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rmn47\" (UniqueName: \"kubernetes.io/projected/4d52cf11-23b8-4b48-92ec-009845eea77f-kube-api-access-rmn47\") pod \"dns-default-kmppx\" (UID: \"4d52cf11-23b8-4b48-92ec-009845eea77f\") " pod="openshift-dns/dns-default-kmppx"
Oct 30 19:48:10.807522 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.807506    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tx724\" (UniqueName: \"kubernetes.io/projected/6b02f882-10f6-47c4-84a0-8c07533bbb7d-kube-api-access-tx724\") pod \"thanos-querier-5f8f546c56-w96tg\" (UID: \"6b02f882-10f6-47c4-84a0-8c07533bbb7d\") " pod="openshift-monitoring/thanos-querier-5f8f546c56-w96tg"
Oct 30 19:48:10.808758 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.808739    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bz9kn\" (UniqueName: \"kubernetes.io/projected/98dd829b-0745-4229-b781-da2c4ad16f9e-kube-api-access-bz9kn\") pod \"ovnkube-node-84v4l\" (UID: \"98dd829b-0745-4229-b781-da2c4ad16f9e\") " pod="openshift-ovn-kubernetes/ovnkube-node-84v4l"
Oct 30 19:48:10.809104 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.809085    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jvx29\" (UniqueName: \"kubernetes.io/projected/45a7e195-0bbf-46cb-b821-30728122c3fc-kube-api-access-jvx29\") pod \"ingress-canary-r6bht\" (UID: \"45a7e195-0bbf-46cb-b821-30728122c3fc\") " pod="openshift-ingress-canary/ingress-canary-r6bht"
Oct 30 19:48:10.810687 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.810663    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-879bk\" (UniqueName: \"kubernetes.io/projected/dde165c4-1ada-4fd6-af53-32fd75286c79-kube-api-access-879bk\") pod \"node-exporter-lvg9n\" (UID: \"dde165c4-1ada-4fd6-af53-32fd75286c79\") " pod="openshift-monitoring/node-exporter-lvg9n"
Oct 30 19:48:10.810900 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.810884    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x2lwt\" (UniqueName: \"kubernetes.io/projected/2a71410e-a1ce-479e-a9ea-261a4e41f6e3-kube-api-access-x2lwt\") pod \"kube-state-metrics-5dc8d7d89b-zvm7p\" (UID: \"2a71410e-a1ce-479e-a9ea-261a4e41f6e3\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-zvm7p"
Oct 30 19:48:10.811116 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.811092    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7drkj\" (UniqueName: \"kubernetes.io/projected/8d3e77a0-4ee8-4429-9795-97fb3d799dba-kube-api-access-7drkj\") pod \"multus-pb5c7\" (UID: \"8d3e77a0-4ee8-4429-9795-97fb3d799dba\") " pod="openshift-multus/multus-pb5c7"
Oct 30 19:48:10.877730 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.877678    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/423e0100-284b-48b9-bd4c-3b74005976d2-host\") pod \"node-ca-2swph\" (UID: \"423e0100-284b-48b9-bd4c-3b74005976d2\") " pod="openshift-image-registry/node-ca-2swph"
Oct 30 19:48:10.877730 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.877705    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/2d3597bf-5138-4272-905b-d2fdd3bfbe7b-device-dir\") pod \"aws-ebs-csi-driver-node-clzkm\" (UID: \"2d3597bf-5138-4272-905b-d2fdd3bfbe7b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-clzkm"
Oct 30 19:48:10.877730 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.877721    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8d3e77a0-4ee8-4429-9795-97fb3d799dba-cnibin\") pod \"multus-pb5c7\" (UID: \"8d3e77a0-4ee8-4429-9795-97fb3d799dba\") " pod="openshift-multus/multus-pb5c7"
Oct 30 19:48:10.877926 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.877735    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/98dd829b-0745-4229-b781-da2c4ad16f9e-log-socket\") pod \"ovnkube-node-84v4l\" (UID: \"98dd829b-0745-4229-b781-da2c4ad16f9e\") " pod="openshift-ovn-kubernetes/ovnkube-node-84v4l"
Oct 30 19:48:10.877926 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.877786    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/2d3597bf-5138-4272-905b-d2fdd3bfbe7b-device-dir\") pod \"aws-ebs-csi-driver-node-clzkm\" (UID: \"2d3597bf-5138-4272-905b-d2fdd3bfbe7b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-clzkm"
Oct 30 19:48:10.877926 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.877798    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/423e0100-284b-48b9-bd4c-3b74005976d2-host\") pod \"node-ca-2swph\" (UID: \"423e0100-284b-48b9-bd4c-3b74005976d2\") " pod="openshift-image-registry/node-ca-2swph"
Oct 30 19:48:10.877926 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.877789    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/90b35edf-4b09-41df-9374-a514d1417071-kubelet-config\") pod \"global-pull-secret-syncer-96mhd\" (UID: \"90b35edf-4b09-41df-9374-a514d1417071\") " pod="kube-system/global-pull-secret-syncer-96mhd"
Oct 30 19:48:10.877926 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.877826    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/98dd829b-0745-4229-b781-da2c4ad16f9e-log-socket\") pod \"ovnkube-node-84v4l\" (UID: \"98dd829b-0745-4229-b781-da2c4ad16f9e\") " pod="openshift-ovn-kubernetes/ovnkube-node-84v4l"
Oct 30 19:48:10.877926 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.877830    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/90b35edf-4b09-41df-9374-a514d1417071-kubelet-config\") pod \"global-pull-secret-syncer-96mhd\" (UID: \"90b35edf-4b09-41df-9374-a514d1417071\") " pod="kube-system/global-pull-secret-syncer-96mhd"
Oct 30 19:48:10.877926 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.877788    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8d3e77a0-4ee8-4429-9795-97fb3d799dba-cnibin\") pod \"multus-pb5c7\" (UID: \"8d3e77a0-4ee8-4429-9795-97fb3d799dba\") " pod="openshift-multus/multus-pb5c7"
Oct 30 19:48:10.877926 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.877851    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8d3e77a0-4ee8-4429-9795-97fb3d799dba-host-var-lib-kubelet\") pod \"multus-pb5c7\" (UID: \"8d3e77a0-4ee8-4429-9795-97fb3d799dba\") " pod="openshift-multus/multus-pb5c7"
Oct 30 19:48:10.877926 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.877876    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/90b35edf-4b09-41df-9374-a514d1417071-dbus\") pod \"global-pull-secret-syncer-96mhd\" (UID: \"90b35edf-4b09-41df-9374-a514d1417071\") " pod="kube-system/global-pull-secret-syncer-96mhd"
Oct 30 19:48:10.877926 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.877900    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9898418c-eb0f-41b4-a844-d853caeab57f-tuning-conf-dir\") pod \"multus-additional-cni-plugins-q8w4d\" (UID: \"9898418c-eb0f-41b4-a844-d853caeab57f\") " pod="openshift-multus/multus-additional-cni-plugins-q8w4d"
Oct 30 19:48:10.877926 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.877919    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8d3e77a0-4ee8-4429-9795-97fb3d799dba-host-var-lib-kubelet\") pod \"multus-pb5c7\" (UID: \"8d3e77a0-4ee8-4429-9795-97fb3d799dba\") " pod="openshift-multus/multus-pb5c7"
Oct 30 19:48:10.877926 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.877927    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/98dd829b-0745-4229-b781-da2c4ad16f9e-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-84v4l\" (UID: \"98dd829b-0745-4229-b781-da2c4ad16f9e\") " pod="openshift-ovn-kubernetes/ovnkube-node-84v4l"
Oct 30 19:48:10.877926 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.877940    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/90b35edf-4b09-41df-9374-a514d1417071-dbus\") pod \"global-pull-secret-syncer-96mhd\" (UID: \"90b35edf-4b09-41df-9374-a514d1417071\") " pod="kube-system/global-pull-secret-syncer-96mhd"
Oct 30 19:48:10.878659 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.877952    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ac20c88a-e9bd-42c8-bcbe-2080f2393cc3-etc-modprobe-d\") pod \"tuned-k865s\" (UID: \"ac20c88a-e9bd-42c8-bcbe-2080f2393cc3\") " pod="openshift-cluster-node-tuning-operator/tuned-k865s"
Oct 30 19:48:10.878659 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.877955    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9898418c-eb0f-41b4-a844-d853caeab57f-tuning-conf-dir\") pod \"multus-additional-cni-plugins-q8w4d\" (UID: \"9898418c-eb0f-41b4-a844-d853caeab57f\") " pod="openshift-multus/multus-additional-cni-plugins-q8w4d"
Oct 30 19:48:10.878659 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.877966    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/98dd829b-0745-4229-b781-da2c4ad16f9e-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-84v4l\" (UID: \"98dd829b-0745-4229-b781-da2c4ad16f9e\") " pod="openshift-ovn-kubernetes/ovnkube-node-84v4l"
Oct 30 19:48:10.878659 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.877977    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/8d3e77a0-4ee8-4429-9795-97fb3d799dba-multus-socket-dir-parent\") pod \"multus-pb5c7\" (UID: \"8d3e77a0-4ee8-4429-9795-97fb3d799dba\") " pod="openshift-multus/multus-pb5c7"
Oct 30 19:48:10.878659 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.878000    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8d3e77a0-4ee8-4429-9795-97fb3d799dba-multus-conf-dir\") pod \"multus-pb5c7\" (UID: \"8d3e77a0-4ee8-4429-9795-97fb3d799dba\") " pod="openshift-multus/multus-pb5c7"
Oct 30 19:48:10.878659 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.878029    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9898418c-eb0f-41b4-a844-d853caeab57f-cnibin\") pod \"multus-additional-cni-plugins-q8w4d\" (UID: \"9898418c-eb0f-41b4-a844-d853caeab57f\") " pod="openshift-multus/multus-additional-cni-plugins-q8w4d"
Oct 30 19:48:10.878659 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.878031    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ac20c88a-e9bd-42c8-bcbe-2080f2393cc3-etc-modprobe-d\") pod \"tuned-k865s\" (UID: \"ac20c88a-e9bd-42c8-bcbe-2080f2393cc3\") " pod="openshift-cluster-node-tuning-operator/tuned-k865s"
Oct 30 19:48:10.878659 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.878053    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ac20c88a-e9bd-42c8-bcbe-2080f2393cc3-etc-sysctl-d\") pod \"tuned-k865s\" (UID: \"ac20c88a-e9bd-42c8-bcbe-2080f2393cc3\") " pod="openshift-cluster-node-tuning-operator/tuned-k865s"
Oct 30 19:48:10.878659 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.878067    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/8d3e77a0-4ee8-4429-9795-97fb3d799dba-multus-socket-dir-parent\") pod \"multus-pb5c7\" (UID: \"8d3e77a0-4ee8-4429-9795-97fb3d799dba\") " pod="openshift-multus/multus-pb5c7"
Oct 30 19:48:10.878659 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.878060    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9898418c-eb0f-41b4-a844-d853caeab57f-cnibin\") pod \"multus-additional-cni-plugins-q8w4d\" (UID: \"9898418c-eb0f-41b4-a844-d853caeab57f\") " pod="openshift-multus/multus-additional-cni-plugins-q8w4d"
Oct 30 19:48:10.878659 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.878090    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ac20c88a-e9bd-42c8-bcbe-2080f2393cc3-var-lib-kubelet\") pod \"tuned-k865s\" (UID: \"ac20c88a-e9bd-42c8-bcbe-2080f2393cc3\") " pod="openshift-cluster-node-tuning-operator/tuned-k865s"
Oct 30 19:48:10.878659 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.878109    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/2d3597bf-5138-4272-905b-d2fdd3bfbe7b-etc-selinux\") pod \"aws-ebs-csi-driver-node-clzkm\" (UID: \"2d3597bf-5138-4272-905b-d2fdd3bfbe7b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-clzkm"
Oct 30 19:48:10.878659 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.878126    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ac20c88a-e9bd-42c8-bcbe-2080f2393cc3-lib-modules\") pod \"tuned-k865s\" (UID: \"ac20c88a-e9bd-42c8-bcbe-2080f2393cc3\") " pod="openshift-cluster-node-tuning-operator/tuned-k865s"
Oct 30 19:48:10.878659 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.878056    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8d3e77a0-4ee8-4429-9795-97fb3d799dba-multus-conf-dir\") pod \"multus-pb5c7\" (UID: \"8d3e77a0-4ee8-4429-9795-97fb3d799dba\") " pod="openshift-multus/multus-pb5c7"
Oct 30 19:48:10.878659 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.878156    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ac20c88a-e9bd-42c8-bcbe-2080f2393cc3-host\") pod \"tuned-k865s\" (UID: \"ac20c88a-e9bd-42c8-bcbe-2080f2393cc3\") " pod="openshift-cluster-node-tuning-operator/tuned-k865s"
Oct 30 19:48:10.878659 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.878157    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ac20c88a-e9bd-42c8-bcbe-2080f2393cc3-etc-sysctl-d\") pod \"tuned-k865s\" (UID: \"ac20c88a-e9bd-42c8-bcbe-2080f2393cc3\") " pod="openshift-cluster-node-tuning-operator/tuned-k865s"
Oct 30 19:48:10.878659 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.878166    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ac20c88a-e9bd-42c8-bcbe-2080f2393cc3-var-lib-kubelet\") pod \"tuned-k865s\" (UID: \"ac20c88a-e9bd-42c8-bcbe-2080f2393cc3\") " pod="openshift-cluster-node-tuning-operator/tuned-k865s"
Oct 30 19:48:10.878659 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.878167    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/2d3597bf-5138-4272-905b-d2fdd3bfbe7b-etc-selinux\") pod \"aws-ebs-csi-driver-node-clzkm\" (UID: \"2d3597bf-5138-4272-905b-d2fdd3bfbe7b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-clzkm"
Oct 30 19:48:10.878659 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.878182    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/8d3e77a0-4ee8-4429-9795-97fb3d799dba-host-var-lib-cni-multus\") pod \"multus-pb5c7\" (UID: \"8d3e77a0-4ee8-4429-9795-97fb3d799dba\") " pod="openshift-multus/multus-pb5c7"
Oct 30 19:48:10.878659 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.878206    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ac20c88a-e9bd-42c8-bcbe-2080f2393cc3-lib-modules\") pod \"tuned-k865s\" (UID: \"ac20c88a-e9bd-42c8-bcbe-2080f2393cc3\") " pod="openshift-cluster-node-tuning-operator/tuned-k865s"
Oct 30 19:48:10.878659 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.878208    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/98dd829b-0745-4229-b781-da2c4ad16f9e-systemd-units\") pod \"ovnkube-node-84v4l\" (UID: \"98dd829b-0745-4229-b781-da2c4ad16f9e\") " pod="openshift-ovn-kubernetes/ovnkube-node-84v4l"
Oct 30 19:48:10.878659 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.878234    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/8d3e77a0-4ee8-4429-9795-97fb3d799dba-host-var-lib-cni-multus\") pod \"multus-pb5c7\" (UID: \"8d3e77a0-4ee8-4429-9795-97fb3d799dba\") " pod="openshift-multus/multus-pb5c7"
Oct 30 19:48:10.878659 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.878240    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/98dd829b-0745-4229-b781-da2c4ad16f9e-systemd-units\") pod \"ovnkube-node-84v4l\" (UID: \"98dd829b-0745-4229-b781-da2c4ad16f9e\") " pod="openshift-ovn-kubernetes/ovnkube-node-84v4l"
Oct 30 19:48:10.878659 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.878237    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/98dd829b-0745-4229-b781-da2c4ad16f9e-run-openvswitch\") pod \"ovnkube-node-84v4l\" (UID: \"98dd829b-0745-4229-b781-da2c4ad16f9e\") " pod="openshift-ovn-kubernetes/ovnkube-node-84v4l"
Oct 30 19:48:10.878659 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.878274    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/98dd829b-0745-4229-b781-da2c4ad16f9e-run-openvswitch\") pod \"ovnkube-node-84v4l\" (UID: \"98dd829b-0745-4229-b781-da2c4ad16f9e\") " pod="openshift-ovn-kubernetes/ovnkube-node-84v4l"
Oct 30 19:48:10.878659 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.878281    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/641c89ab-1e2c-4e67-84b5-d5d0f4f30756-host-slash\") pod \"iptables-alerter-7gdcx\" (UID: \"641c89ab-1e2c-4e67-84b5-d5d0f4f30756\") " pod="openshift-network-operator/iptables-alerter-7gdcx"
Oct 30 19:48:10.878659 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.878209    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ac20c88a-e9bd-42c8-bcbe-2080f2393cc3-host\") pod \"tuned-k865s\" (UID: \"ac20c88a-e9bd-42c8-bcbe-2080f2393cc3\") " pod="openshift-cluster-node-tuning-operator/tuned-k865s"
Oct 30 19:48:10.878659 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.878308    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ac20c88a-e9bd-42c8-bcbe-2080f2393cc3-etc-systemd\") pod \"tuned-k865s\" (UID: \"ac20c88a-e9bd-42c8-bcbe-2080f2393cc3\") " pod="openshift-cluster-node-tuning-operator/tuned-k865s"
Oct 30 19:48:10.878659 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.878328    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/98dd829b-0745-4229-b781-da2c4ad16f9e-host-run-netns\") pod \"ovnkube-node-84v4l\" (UID: \"98dd829b-0745-4229-b781-da2c4ad16f9e\") " pod="openshift-ovn-kubernetes/ovnkube-node-84v4l"
Oct 30 19:48:10.878659 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.878345    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8d3e77a0-4ee8-4429-9795-97fb3d799dba-host-var-lib-cni-bin\") pod \"multus-pb5c7\" (UID: \"8d3e77a0-4ee8-4429-9795-97fb3d799dba\") " pod="openshift-multus/multus-pb5c7"
Oct 30 19:48:10.878659 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.878327    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/641c89ab-1e2c-4e67-84b5-d5d0f4f30756-host-slash\") pod \"iptables-alerter-7gdcx\" (UID: \"641c89ab-1e2c-4e67-84b5-d5d0f4f30756\") " pod="openshift-network-operator/iptables-alerter-7gdcx"
Oct 30 19:48:10.878659 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.878365    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/98dd829b-0745-4229-b781-da2c4ad16f9e-var-lib-openvswitch\") pod \"ovnkube-node-84v4l\" (UID: \"98dd829b-0745-4229-b781-da2c4ad16f9e\") " pod="openshift-ovn-kubernetes/ovnkube-node-84v4l"
Oct 30 19:48:10.878659 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.878378    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/98dd829b-0745-4229-b781-da2c4ad16f9e-host-run-netns\") pod \"ovnkube-node-84v4l\" (UID: \"98dd829b-0745-4229-b781-da2c4ad16f9e\") " pod="openshift-ovn-kubernetes/ovnkube-node-84v4l"
Oct 30 19:48:10.878659 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.878388    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/98dd829b-0745-4229-b781-da2c4ad16f9e-run-ovn\") pod \"ovnkube-node-84v4l\" (UID: \"98dd829b-0745-4229-b781-da2c4ad16f9e\") " pod="openshift-ovn-kubernetes/ovnkube-node-84v4l"
Oct 30 19:48:10.878659 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.878405    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8d3e77a0-4ee8-4429-9795-97fb3d799dba-host-var-lib-cni-bin\") pod \"multus-pb5c7\" (UID: \"8d3e77a0-4ee8-4429-9795-97fb3d799dba\") " pod="openshift-multus/multus-pb5c7"
Oct 30 19:48:10.878659 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.878432    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8d3e77a0-4ee8-4429-9795-97fb3d799dba-system-cni-dir\") pod \"multus-pb5c7\" (UID: \"8d3e77a0-4ee8-4429-9795-97fb3d799dba\") " pod="openshift-multus/multus-pb5c7"
Oct 30 19:48:10.878659 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.878447    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/98dd829b-0745-4229-b781-da2c4ad16f9e-var-lib-openvswitch\") pod \"ovnkube-node-84v4l\" (UID: \"98dd829b-0745-4229-b781-da2c4ad16f9e\") " pod="openshift-ovn-kubernetes/ovnkube-node-84v4l"
Oct 30 19:48:10.878659 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.878457    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/98dd829b-0745-4229-b781-da2c4ad16f9e-etc-openvswitch\") pod \"ovnkube-node-84v4l\" (UID: \"98dd829b-0745-4229-b781-da2c4ad16f9e\") " pod="openshift-ovn-kubernetes/ovnkube-node-84v4l"
Oct 30 19:48:10.878659 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.878462    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/98dd829b-0745-4229-b781-da2c4ad16f9e-run-ovn\") pod \"ovnkube-node-84v4l\" (UID: \"98dd829b-0745-4229-b781-da2c4ad16f9e\") " pod="openshift-ovn-kubernetes/ovnkube-node-84v4l"
Oct 30 19:48:10.878659 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.878407    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ac20c88a-e9bd-42c8-bcbe-2080f2393cc3-etc-systemd\") pod \"tuned-k865s\" (UID: \"ac20c88a-e9bd-42c8-bcbe-2080f2393cc3\") " pod="openshift-cluster-node-tuning-operator/tuned-k865s"
Oct 30 19:48:10.878659 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.878476    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8d3e77a0-4ee8-4429-9795-97fb3d799dba-system-cni-dir\") pod \"multus-pb5c7\" (UID: \"8d3e77a0-4ee8-4429-9795-97fb3d799dba\") " pod="openshift-multus/multus-pb5c7"
Oct 30 19:48:10.878659 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.878489    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/2d3597bf-5138-4272-905b-d2fdd3bfbe7b-registration-dir\") pod \"aws-ebs-csi-driver-node-clzkm\" (UID: \"2d3597bf-5138-4272-905b-d2fdd3bfbe7b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-clzkm"
Oct 30 19:48:10.878659 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.878517    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/8d3e77a0-4ee8-4429-9795-97fb3d799dba-host-run-multus-certs\") pod \"multus-pb5c7\" (UID: \"8d3e77a0-4ee8-4429-9795-97fb3d799dba\") " pod="openshift-multus/multus-pb5c7"
Oct 30 19:48:10.878659 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.878540    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/98dd829b-0745-4229-b781-da2c4ad16f9e-node-log\") pod \"ovnkube-node-84v4l\" (UID: \"98dd829b-0745-4229-b781-da2c4ad16f9e\") " pod="openshift-ovn-kubernetes/ovnkube-node-84v4l"
Oct 30 19:48:10.878659 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.878543    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/2d3597bf-5138-4272-905b-d2fdd3bfbe7b-registration-dir\") pod \"aws-ebs-csi-driver-node-clzkm\" (UID: \"2d3597bf-5138-4272-905b-d2fdd3bfbe7b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-clzkm"
Oct 30 19:48:10.878659 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.878494    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/98dd829b-0745-4229-b781-da2c4ad16f9e-etc-openvswitch\") pod \"ovnkube-node-84v4l\" (UID: \"98dd829b-0745-4229-b781-da2c4ad16f9e\") " pod="openshift-ovn-kubernetes/ovnkube-node-84v4l"
Oct 30 19:48:10.878659 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.878565    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/2d3597bf-5138-4272-905b-d2fdd3bfbe7b-socket-dir\") pod \"aws-ebs-csi-driver-node-clzkm\" (UID: \"2d3597bf-5138-4272-905b-d2fdd3bfbe7b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-clzkm"
Oct 30 19:48:10.878659 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.878575    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/8d3e77a0-4ee8-4429-9795-97fb3d799dba-host-run-multus-certs\") pod \"multus-pb5c7\" (UID: \"8d3e77a0-4ee8-4429-9795-97fb3d799dba\") " pod="openshift-multus/multus-pb5c7"
Oct 30 19:48:10.878659 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.878582    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/98dd829b-0745-4229-b781-da2c4ad16f9e-node-log\") pod \"ovnkube-node-84v4l\" (UID: \"98dd829b-0745-4229-b781-da2c4ad16f9e\") " pod="openshift-ovn-kubernetes/ovnkube-node-84v4l"
Oct 30 19:48:10.878659 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.878599    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ac20c88a-e9bd-42c8-bcbe-2080f2393cc3-sys\") pod \"tuned-k865s\" (UID: \"ac20c88a-e9bd-42c8-bcbe-2080f2393cc3\") " pod="openshift-cluster-node-tuning-operator/tuned-k865s"
Oct 30 19:48:10.878659 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.878613    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/2d3597bf-5138-4272-905b-d2fdd3bfbe7b-socket-dir\") pod \"aws-ebs-csi-driver-node-clzkm\" (UID: \"2d3597bf-5138-4272-905b-d2fdd3bfbe7b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-clzkm"
Oct 30 19:48:10.878659 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.878617    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/34dfa231-fa1a-400c-82b4-6ee85859d7c4-hosts-file\") pod \"node-resolver-krr87\" (UID: \"34dfa231-fa1a-400c-82b4-6ee85859d7c4\") " pod="openshift-dns/node-resolver-krr87"
Oct 30 19:48:10.878659 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.878641    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/34dfa231-fa1a-400c-82b4-6ee85859d7c4-hosts-file\") pod \"node-resolver-krr87\" (UID: \"34dfa231-fa1a-400c-82b4-6ee85859d7c4\") " pod="openshift-dns/node-resolver-krr87"
Oct 30 19:48:10.878659 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.878651    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/dde165c4-1ada-4fd6-af53-32fd75286c79-node-exporter-wtmp\") pod \"node-exporter-lvg9n\" (UID: \"dde165c4-1ada-4fd6-af53-32fd75286c79\") " pod="openshift-monitoring/node-exporter-lvg9n"
Oct 30 19:48:10.878659 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.878660    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ac20c88a-e9bd-42c8-bcbe-2080f2393cc3-sys\") pod \"tuned-k865s\" (UID: \"ac20c88a-e9bd-42c8-bcbe-2080f2393cc3\") " pod="openshift-cluster-node-tuning-operator/tuned-k865s"
Oct 30 19:48:10.878659 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.878673    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ac20c88a-e9bd-42c8-bcbe-2080f2393cc3-run\") pod \"tuned-k865s\" (UID: \"ac20c88a-e9bd-42c8-bcbe-2080f2393cc3\") " pod="openshift-cluster-node-tuning-operator/tuned-k865s"
Oct 30 19:48:10.878659 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.878695    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/98dd829b-0745-4229-b781-da2c4ad16f9e-host-kubelet\") pod \"ovnkube-node-84v4l\" (UID: \"98dd829b-0745-4229-b781-da2c4ad16f9e\") " pod="openshift-ovn-kubernetes/ovnkube-node-84v4l"
Oct 30 19:48:10.880382 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.878716    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/98dd829b-0745-4229-b781-da2c4ad16f9e-host-slash\") pod \"ovnkube-node-84v4l\" (UID: \"98dd829b-0745-4229-b781-da2c4ad16f9e\") " pod="openshift-ovn-kubernetes/ovnkube-node-84v4l"
Oct 30 19:48:10.880382 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.878727    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/dde165c4-1ada-4fd6-af53-32fd75286c79-node-exporter-wtmp\") pod \"node-exporter-lvg9n\" (UID: \"dde165c4-1ada-4fd6-af53-32fd75286c79\") " pod="openshift-monitoring/node-exporter-lvg9n"
Oct 30 19:48:10.880382 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.878733    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ac20c88a-e9bd-42c8-bcbe-2080f2393cc3-run\") pod \"tuned-k865s\" (UID: \"ac20c88a-e9bd-42c8-bcbe-2080f2393cc3\") " pod="openshift-cluster-node-tuning-operator/tuned-k865s"
Oct 30 19:48:10.880382 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.878738    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8d3e77a0-4ee8-4429-9795-97fb3d799dba-multus-cni-dir\") pod \"multus-pb5c7\" (UID: \"8d3e77a0-4ee8-4429-9795-97fb3d799dba\") " pod="openshift-multus/multus-pb5c7"
Oct 30 19:48:10.880382 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.878752    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/98dd829b-0745-4229-b781-da2c4ad16f9e-host-kubelet\") pod \"ovnkube-node-84v4l\" (UID: \"98dd829b-0745-4229-b781-da2c4ad16f9e\") " pod="openshift-ovn-kubernetes/ovnkube-node-84v4l"
Oct 30 19:48:10.880382 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.878763    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/98dd829b-0745-4229-b781-da2c4ad16f9e-host-slash\") pod \"ovnkube-node-84v4l\" (UID: \"98dd829b-0745-4229-b781-da2c4ad16f9e\") " pod="openshift-ovn-kubernetes/ovnkube-node-84v4l"
Oct 30 19:48:10.880382 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.878776    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/8d3e77a0-4ee8-4429-9795-97fb3d799dba-hostroot\") pod \"multus-pb5c7\" (UID: \"8d3e77a0-4ee8-4429-9795-97fb3d799dba\") " pod="openshift-multus/multus-pb5c7"
Oct 30 19:48:10.880382 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.878788    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8d3e77a0-4ee8-4429-9795-97fb3d799dba-multus-cni-dir\") pod \"multus-pb5c7\" (UID: \"8d3e77a0-4ee8-4429-9795-97fb3d799dba\") " pod="openshift-multus/multus-pb5c7"
Oct 30 19:48:10.880382 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.878800    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/98dd829b-0745-4229-b781-da2c4ad16f9e-host-cni-bin\") pod \"ovnkube-node-84v4l\" (UID: \"98dd829b-0745-4229-b781-da2c4ad16f9e\") " pod="openshift-ovn-kubernetes/ovnkube-node-84v4l"
Oct 30 19:48:10.880382 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.878825    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9898418c-eb0f-41b4-a844-d853caeab57f-system-cni-dir\") pod \"multus-additional-cni-plugins-q8w4d\" (UID: \"9898418c-eb0f-41b4-a844-d853caeab57f\") " pod="openshift-multus/multus-additional-cni-plugins-q8w4d"
Oct 30 19:48:10.880382 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.878833    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/8d3e77a0-4ee8-4429-9795-97fb3d799dba-hostroot\") pod \"multus-pb5c7\" (UID: \"8d3e77a0-4ee8-4429-9795-97fb3d799dba\") " pod="openshift-multus/multus-pb5c7"
Oct 30 19:48:10.880382 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.878857    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/98dd829b-0745-4229-b781-da2c4ad16f9e-host-cni-bin\") pod \"ovnkube-node-84v4l\" (UID: \"98dd829b-0745-4229-b781-da2c4ad16f9e\") " pod="openshift-ovn-kubernetes/ovnkube-node-84v4l"
Oct 30 19:48:10.880382 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.878877    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ac20c88a-e9bd-42c8-bcbe-2080f2393cc3-etc-sysctl-conf\") pod \"tuned-k865s\" (UID: \"ac20c88a-e9bd-42c8-bcbe-2080f2393cc3\") " pod="openshift-cluster-node-tuning-operator/tuned-k865s"
Oct 30 19:48:10.880382 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.878895    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8d3e77a0-4ee8-4429-9795-97fb3d799dba-host-run-netns\") pod \"multus-pb5c7\" (UID: \"8d3e77a0-4ee8-4429-9795-97fb3d799dba\") " pod="openshift-multus/multus-pb5c7"
Oct 30 19:48:10.880382 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.878876    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9898418c-eb0f-41b4-a844-d853caeab57f-system-cni-dir\") pod \"multus-additional-cni-plugins-q8w4d\" (UID: \"9898418c-eb0f-41b4-a844-d853caeab57f\") " pod="openshift-multus/multus-additional-cni-plugins-q8w4d"
Oct 30 19:48:10.880382 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.878914    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/2d3597bf-5138-4272-905b-d2fdd3bfbe7b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-clzkm\" (UID: \"2d3597bf-5138-4272-905b-d2fdd3bfbe7b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-clzkm"
Oct 30 19:48:10.880382 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.878936    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/98dd829b-0745-4229-b781-da2c4ad16f9e-run-systemd\") pod \"ovnkube-node-84v4l\" (UID: \"98dd829b-0745-4229-b781-da2c4ad16f9e\") " pod="openshift-ovn-kubernetes/ovnkube-node-84v4l"
Oct 30 19:48:10.880382 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.878950    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8d3e77a0-4ee8-4429-9795-97fb3d799dba-etc-kubernetes\") pod \"multus-pb5c7\" (UID: \"8d3e77a0-4ee8-4429-9795-97fb3d799dba\") " pod="openshift-multus/multus-pb5c7"
Oct 30 19:48:10.880382 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.878963    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/dde165c4-1ada-4fd6-af53-32fd75286c79-root\") pod \"node-exporter-lvg9n\" (UID: \"dde165c4-1ada-4fd6-af53-32fd75286c79\") " pod="openshift-monitoring/node-exporter-lvg9n"
Oct 30 19:48:10.880382 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.878969    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8d3e77a0-4ee8-4429-9795-97fb3d799dba-host-run-netns\") pod \"multus-pb5c7\" (UID: \"8d3e77a0-4ee8-4429-9795-97fb3d799dba\") " pod="openshift-multus/multus-pb5c7"
Oct 30 19:48:10.880382 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.878979    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/8d3e77a0-4ee8-4429-9795-97fb3d799dba-host-run-k8s-cni-cncf-io\") pod \"multus-pb5c7\" (UID: \"8d3e77a0-4ee8-4429-9795-97fb3d799dba\") " pod="openshift-multus/multus-pb5c7"
Oct 30 19:48:10.880382 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.878991    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/98dd829b-0745-4229-b781-da2c4ad16f9e-run-systemd\") pod \"ovnkube-node-84v4l\" (UID: \"98dd829b-0745-4229-b781-da2c4ad16f9e\") " pod="openshift-ovn-kubernetes/ovnkube-node-84v4l"
Oct 30 19:48:10.880382 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.878996    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/2d3597bf-5138-4272-905b-d2fdd3bfbe7b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-clzkm\" (UID: \"2d3597bf-5138-4272-905b-d2fdd3bfbe7b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-clzkm"
Oct 30 19:48:10.880382 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.879004    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/98dd829b-0745-4229-b781-da2c4ad16f9e-host-run-ovn-kubernetes\") pod \"ovnkube-node-84v4l\" (UID: \"98dd829b-0745-4229-b781-da2c4ad16f9e\") " pod="openshift-ovn-kubernetes/ovnkube-node-84v4l"
Oct 30 19:48:10.880382 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.879008    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/dde165c4-1ada-4fd6-af53-32fd75286c79-root\") pod \"node-exporter-lvg9n\" (UID: \"dde165c4-1ada-4fd6-af53-32fd75286c79\") " pod="openshift-monitoring/node-exporter-lvg9n"
Oct 30 19:48:10.880382 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.879008    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8d3e77a0-4ee8-4429-9795-97fb3d799dba-etc-kubernetes\") pod \"multus-pb5c7\" (UID: \"8d3e77a0-4ee8-4429-9795-97fb3d799dba\") " pod="openshift-multus/multus-pb5c7"
Oct 30 19:48:10.880382 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.879014    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ac20c88a-e9bd-42c8-bcbe-2080f2393cc3-etc-sysctl-conf\") pod \"tuned-k865s\" (UID: \"ac20c88a-e9bd-42c8-bcbe-2080f2393cc3\") " pod="openshift-cluster-node-tuning-operator/tuned-k865s"
Oct 30 19:48:10.880382 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.879032    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/5a23369d-e69d-40e0-a956-a109d6d653c1-crio-socket\") pod \"insights-runtime-extractor-fwc77\" (UID: \"5a23369d-e69d-40e0-a956-a109d6d653c1\") " pod="openshift-insights/insights-runtime-extractor-fwc77"
Oct 30 19:48:10.880382 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.879057    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/dde165c4-1ada-4fd6-af53-32fd75286c79-sys\") pod \"node-exporter-lvg9n\" (UID: \"dde165c4-1ada-4fd6-af53-32fd75286c79\") " pod="openshift-monitoring/node-exporter-lvg9n"
Oct 30 19:48:10.880382 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.879036    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/8d3e77a0-4ee8-4429-9795-97fb3d799dba-host-run-k8s-cni-cncf-io\") pod \"multus-pb5c7\" (UID: \"8d3e77a0-4ee8-4429-9795-97fb3d799dba\") " pod="openshift-multus/multus-pb5c7"
Oct 30 19:48:10.880382 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.879060    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/98dd829b-0745-4229-b781-da2c4ad16f9e-host-run-ovn-kubernetes\") pod \"ovnkube-node-84v4l\" (UID: \"98dd829b-0745-4229-b781-da2c4ad16f9e\") " pod="openshift-ovn-kubernetes/ovnkube-node-84v4l"
Oct 30 19:48:10.880382 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.879074    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ac20c88a-e9bd-42c8-bcbe-2080f2393cc3-etc-kubernetes\") pod \"tuned-k865s\" (UID: \"ac20c88a-e9bd-42c8-bcbe-2080f2393cc3\") " pod="openshift-cluster-node-tuning-operator/tuned-k865s"
Oct 30 19:48:10.880382 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.879100    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/5a23369d-e69d-40e0-a956-a109d6d653c1-crio-socket\") pod \"insights-runtime-extractor-fwc77\" (UID: \"5a23369d-e69d-40e0-a956-a109d6d653c1\") " pod="openshift-insights/insights-runtime-extractor-fwc77"
Oct 30 19:48:10.880382 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.879109    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/dde165c4-1ada-4fd6-af53-32fd75286c79-sys\") pod \"node-exporter-lvg9n\" (UID: \"dde165c4-1ada-4fd6-af53-32fd75286c79\") " pod="openshift-monitoring/node-exporter-lvg9n"
Oct 30 19:48:10.880382 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.879115    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/98dd829b-0745-4229-b781-da2c4ad16f9e-host-cni-netd\") pod \"ovnkube-node-84v4l\" (UID: \"98dd829b-0745-4229-b781-da2c4ad16f9e\") " pod="openshift-ovn-kubernetes/ovnkube-node-84v4l"
Oct 30 19:48:10.880382 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.879136    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ac20c88a-e9bd-42c8-bcbe-2080f2393cc3-etc-kubernetes\") pod \"tuned-k865s\" (UID: \"ac20c88a-e9bd-42c8-bcbe-2080f2393cc3\") " pod="openshift-cluster-node-tuning-operator/tuned-k865s"
Oct 30 19:48:10.880382 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.879150    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/98dd829b-0745-4229-b781-da2c4ad16f9e-host-cni-netd\") pod \"ovnkube-node-84v4l\" (UID: \"98dd829b-0745-4229-b781-da2c4ad16f9e\") " pod="openshift-ovn-kubernetes/ovnkube-node-84v4l"
Oct 30 19:48:10.880382 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.879141    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ac20c88a-e9bd-42c8-bcbe-2080f2393cc3-etc-sysconfig\") pod \"tuned-k865s\" (UID: \"ac20c88a-e9bd-42c8-bcbe-2080f2393cc3\") " pod="openshift-cluster-node-tuning-operator/tuned-k865s"
Oct 30 19:48:10.880382 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.879163    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ac20c88a-e9bd-42c8-bcbe-2080f2393cc3-etc-sysconfig\") pod \"tuned-k865s\" (UID: \"ac20c88a-e9bd-42c8-bcbe-2080f2393cc3\") " pod="openshift-cluster-node-tuning-operator/tuned-k865s"
Oct 30 19:48:10.880382 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.879179    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/2d3597bf-5138-4272-905b-d2fdd3bfbe7b-sys-fs\") pod \"aws-ebs-csi-driver-node-clzkm\" (UID: \"2d3597bf-5138-4272-905b-d2fdd3bfbe7b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-clzkm"
Oct 30 19:48:10.880382 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:10.879207    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/2d3597bf-5138-4272-905b-d2fdd3bfbe7b-sys-fs\") pod \"aws-ebs-csi-driver-node-clzkm\" (UID: \"2d3597bf-5138-4272-905b-d2fdd3bfbe7b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-clzkm"
Oct 30 19:48:12.445484 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:12.445450    6275 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-5f8f546c56-w96tg"
Oct 30 19:48:12.817382 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:12.817358    6275 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-kmppx"
Oct 30 19:48:15.460345 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:15.460317    6275 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-77f4f76594-k9gfv"
Oct 30 19:48:16.786810 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:16.786782    6275 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-b27jd"
Oct 30 19:48:19.996919 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:19.996890    6275 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-84v4l"
Oct 30 19:48:20.462248 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:20.461564    6275 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-84v4l"
Oct 30 19:48:20.732861 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:20.732798    6275 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness"
Oct 30 19:48:26.253310 ip-10-0-131-26 kubenswrapper[6275]: E1030 19:48:26.253276    6275 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-fwc77" containerName="extractor"
Oct 30 19:48:31.039359 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:31.039323    6275 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Oct 30 19:48:31.046125 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:31.046098    6275 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Oct 30 19:48:31.063559 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:31.063539    6275 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Oct 30 19:48:31.063716 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:31.063683    6275 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Oct 30 19:48:31.063830 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:31.063814    6275 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Oct 30 19:48:31.065313 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:31.065297    6275 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Oct 30 19:48:31.092070 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:31.092049    6275 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Oct 30 19:48:31.092531 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:31.092509    6275 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Oct 30 19:48:31.164814 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:31.164792    6275 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Oct 30 19:48:31.164915 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:31.164890    6275 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Oct 30 19:48:31.164965 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:31.164926    6275 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-2llhk\""
Oct 30 19:48:31.164965 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:31.164932    6275 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Oct 30 19:48:31.165036 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:31.164972    6275 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Oct 30 19:48:31.200396 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:31.200376    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/2ce2ec33-5684-425b-a0a5-31769367737f-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"2ce2ec33-5684-425b-a0a5-31769367737f\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 19:48:31.200478 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:31.200401    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2ce2ec33-5684-425b-a0a5-31769367737f-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"2ce2ec33-5684-425b-a0a5-31769367737f\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 19:48:31.200478 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:31.200436    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/2ce2ec33-5684-425b-a0a5-31769367737f-config-volume\") pod \"alertmanager-main-0\" (UID: \"2ce2ec33-5684-425b-a0a5-31769367737f\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 19:48:31.200478 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:31.200459    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2ce2ec33-5684-425b-a0a5-31769367737f-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"2ce2ec33-5684-425b-a0a5-31769367737f\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 19:48:31.200587 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:31.200562    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/2ce2ec33-5684-425b-a0a5-31769367737f-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"2ce2ec33-5684-425b-a0a5-31769367737f\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 19:48:31.200628 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:31.200587    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z9hdb\" (UniqueName: \"kubernetes.io/projected/2ce2ec33-5684-425b-a0a5-31769367737f-kube-api-access-z9hdb\") pod \"alertmanager-main-0\" (UID: \"2ce2ec33-5684-425b-a0a5-31769367737f\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 19:48:31.200628 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:31.200606    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2ce2ec33-5684-425b-a0a5-31769367737f-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"2ce2ec33-5684-425b-a0a5-31769367737f\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 19:48:31.200701 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:31.200631    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2ce2ec33-5684-425b-a0a5-31769367737f-web-config\") pod \"alertmanager-main-0\" (UID: \"2ce2ec33-5684-425b-a0a5-31769367737f\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 19:48:31.200701 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:31.200660    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/2ce2ec33-5684-425b-a0a5-31769367737f-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"2ce2ec33-5684-425b-a0a5-31769367737f\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 19:48:31.200763 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:31.200712    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2ce2ec33-5684-425b-a0a5-31769367737f-config-out\") pod \"alertmanager-main-0\" (UID: \"2ce2ec33-5684-425b-a0a5-31769367737f\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 19:48:31.200763 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:31.200733    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/2ce2ec33-5684-425b-a0a5-31769367737f-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"2ce2ec33-5684-425b-a0a5-31769367737f\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 19:48:31.200830 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:31.200773    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2ce2ec33-5684-425b-a0a5-31769367737f-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"2ce2ec33-5684-425b-a0a5-31769367737f\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 19:48:31.200830 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:31.200788    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2ce2ec33-5684-425b-a0a5-31769367737f-tls-assets\") pod \"alertmanager-main-0\" (UID: \"2ce2ec33-5684-425b-a0a5-31769367737f\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 19:48:31.301675 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:31.301627    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2ce2ec33-5684-425b-a0a5-31769367737f-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"2ce2ec33-5684-425b-a0a5-31769367737f\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 19:48:31.301675 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:31.301665    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/2ce2ec33-5684-425b-a0a5-31769367737f-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"2ce2ec33-5684-425b-a0a5-31769367737f\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 19:48:31.301772 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:31.301683    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z9hdb\" (UniqueName: \"kubernetes.io/projected/2ce2ec33-5684-425b-a0a5-31769367737f-kube-api-access-z9hdb\") pod \"alertmanager-main-0\" (UID: \"2ce2ec33-5684-425b-a0a5-31769367737f\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 19:48:31.301772 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:31.301699    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2ce2ec33-5684-425b-a0a5-31769367737f-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"2ce2ec33-5684-425b-a0a5-31769367737f\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 19:48:31.301859 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:31.301823    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2ce2ec33-5684-425b-a0a5-31769367737f-web-config\") pod \"alertmanager-main-0\" (UID: \"2ce2ec33-5684-425b-a0a5-31769367737f\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 19:48:31.301894 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:31.301854    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/2ce2ec33-5684-425b-a0a5-31769367737f-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"2ce2ec33-5684-425b-a0a5-31769367737f\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 19:48:31.301894 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:31.301880    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2ce2ec33-5684-425b-a0a5-31769367737f-config-out\") pod \"alertmanager-main-0\" (UID: \"2ce2ec33-5684-425b-a0a5-31769367737f\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 19:48:31.301987 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:31.301902    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/2ce2ec33-5684-425b-a0a5-31769367737f-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"2ce2ec33-5684-425b-a0a5-31769367737f\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 19:48:31.301987 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:31.301932    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2ce2ec33-5684-425b-a0a5-31769367737f-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"2ce2ec33-5684-425b-a0a5-31769367737f\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 19:48:31.301987 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:31.301957    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2ce2ec33-5684-425b-a0a5-31769367737f-tls-assets\") pod \"alertmanager-main-0\" (UID: \"2ce2ec33-5684-425b-a0a5-31769367737f\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 19:48:31.302138 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:31.301994    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/2ce2ec33-5684-425b-a0a5-31769367737f-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"2ce2ec33-5684-425b-a0a5-31769367737f\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 19:48:31.302138 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:31.302022    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2ce2ec33-5684-425b-a0a5-31769367737f-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"2ce2ec33-5684-425b-a0a5-31769367737f\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 19:48:31.302138 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:31.302030    6275 swap_util.go:78] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Oct 30 19:48:31.302138 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:31.302051    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/2ce2ec33-5684-425b-a0a5-31769367737f-config-volume\") pod \"alertmanager-main-0\" (UID: \"2ce2ec33-5684-425b-a0a5-31769367737f\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 19:48:31.303149 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:31.303119    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2ce2ec33-5684-425b-a0a5-31769367737f-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"2ce2ec33-5684-425b-a0a5-31769367737f\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 19:48:31.303798 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:31.303772    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2ce2ec33-5684-425b-a0a5-31769367737f-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"2ce2ec33-5684-425b-a0a5-31769367737f\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 19:48:31.304343 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:31.304311    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/2ce2ec33-5684-425b-a0a5-31769367737f-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"2ce2ec33-5684-425b-a0a5-31769367737f\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 19:48:31.305272 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:31.305246    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/2ce2ec33-5684-425b-a0a5-31769367737f-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"2ce2ec33-5684-425b-a0a5-31769367737f\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 19:48:31.305272 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:31.305255    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/2ce2ec33-5684-425b-a0a5-31769367737f-config-volume\") pod \"alertmanager-main-0\" (UID: \"2ce2ec33-5684-425b-a0a5-31769367737f\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 19:48:31.305587 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:31.305563    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2ce2ec33-5684-425b-a0a5-31769367737f-config-out\") pod \"alertmanager-main-0\" (UID: \"2ce2ec33-5684-425b-a0a5-31769367737f\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 19:48:31.305820 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:31.305687    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2ce2ec33-5684-425b-a0a5-31769367737f-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"2ce2ec33-5684-425b-a0a5-31769367737f\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 19:48:31.305820 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:31.305726    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2ce2ec33-5684-425b-a0a5-31769367737f-tls-assets\") pod \"alertmanager-main-0\" (UID: \"2ce2ec33-5684-425b-a0a5-31769367737f\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 19:48:31.305820 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:31.305758    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/2ce2ec33-5684-425b-a0a5-31769367737f-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"2ce2ec33-5684-425b-a0a5-31769367737f\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 19:48:31.306033 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:31.306014    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2ce2ec33-5684-425b-a0a5-31769367737f-web-config\") pod \"alertmanager-main-0\" (UID: \"2ce2ec33-5684-425b-a0a5-31769367737f\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 19:48:31.306102 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:31.306083    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/2ce2ec33-5684-425b-a0a5-31769367737f-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"2ce2ec33-5684-425b-a0a5-31769367737f\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 19:48:31.306548 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:31.306531    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2ce2ec33-5684-425b-a0a5-31769367737f-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"2ce2ec33-5684-425b-a0a5-31769367737f\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 19:48:31.327336 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:31.327314    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z9hdb\" (UniqueName: \"kubernetes.io/projected/2ce2ec33-5684-425b-a0a5-31769367737f-kube-api-access-z9hdb\") pod \"alertmanager-main-0\" (UID: \"2ce2ec33-5684-425b-a0a5-31769367737f\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 19:48:31.362168 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:31.362147    6275 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Oct 30 19:48:31.696912 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:31.696890    6275 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Oct 30 19:48:31.698195 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:31.698170    6275 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2ce2ec33_5684_425b_a0a5_31769367737f.slice/crio-a198594183f60cf699d313a8774b4be078de5788af6801844e5aa2f84953baba WatchSource:0}: Error finding container a198594183f60cf699d313a8774b4be078de5788af6801844e5aa2f84953baba: Status 404 returned error can't find the container with id a198594183f60cf699d313a8774b4be078de5788af6801844e5aa2f84953baba
Oct 30 19:48:31.699995 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:31.699980    6275 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Oct 30 19:48:31.768005 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:31.767976    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2ce2ec33-5684-425b-a0a5-31769367737f","Type":"ContainerStarted","Data":"a198594183f60cf699d313a8774b4be078de5788af6801844e5aa2f84953baba"}
Oct 30 19:48:32.461954 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:32.461928    6275 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-84v4l"
Oct 30 19:48:32.663388 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:32.663363    6275 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-75b4dc455f-q57jq"]
Oct 30 19:48:32.666346 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:32.666326    6275 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-75b4dc455f-q57jq"
Oct 30 19:48:32.692674 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:32.692649    6275 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Oct 30 19:48:32.692775 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:32.692669    6275 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Oct 30 19:48:32.704902 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:32.704883    6275 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Oct 30 19:48:32.705002 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:32.704906    6275 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Oct 30 19:48:32.705048 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:32.705041    6275 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-xhwf5\""
Oct 30 19:48:32.705537 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:32.705522    6275 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-75b4dc455f-q57jq"]
Oct 30 19:48:32.724364 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:32.724301    6275 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Oct 30 19:48:32.738193 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:32.738165    6275 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-28r105lbnph2c\""
Oct 30 19:48:32.772580 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:32.772554    6275 generic.go:356] "Generic (PLEG): container finished" podID="2ce2ec33-5684-425b-a0a5-31769367737f" containerID="ff7cf17485f60f5ab4801de0297dc1558d18ec5cc8ce3951bbde61a230598ff9" exitCode=0
Oct 30 19:48:32.772651 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:32.772629    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2ce2ec33-5684-425b-a0a5-31769367737f","Type":"ContainerDied","Data":"ff7cf17485f60f5ab4801de0297dc1558d18ec5cc8ce3951bbde61a230598ff9"}
Oct 30 19:48:32.814312 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:32.814293    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d6b46262-71f5-44de-a798-2ac90b936184-telemeter-trusted-ca-bundle\") pod \"telemeter-client-75b4dc455f-q57jq\" (UID: \"d6b46262-71f5-44de-a798-2ac90b936184\") " pod="openshift-monitoring/telemeter-client-75b4dc455f-q57jq"
Oct 30 19:48:32.814403 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:32.814321    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rp864\" (UniqueName: \"kubernetes.io/projected/d6b46262-71f5-44de-a798-2ac90b936184-kube-api-access-rp864\") pod \"telemeter-client-75b4dc455f-q57jq\" (UID: \"d6b46262-71f5-44de-a798-2ac90b936184\") " pod="openshift-monitoring/telemeter-client-75b4dc455f-q57jq"
Oct 30 19:48:32.814403 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:32.814341    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/d6b46262-71f5-44de-a798-2ac90b936184-secret-telemeter-client\") pod \"telemeter-client-75b4dc455f-q57jq\" (UID: \"d6b46262-71f5-44de-a798-2ac90b936184\") " pod="openshift-monitoring/telemeter-client-75b4dc455f-q57jq"
Oct 30 19:48:32.814403 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:32.814369    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d6b46262-71f5-44de-a798-2ac90b936184-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-75b4dc455f-q57jq\" (UID: \"d6b46262-71f5-44de-a798-2ac90b936184\") " pod="openshift-monitoring/telemeter-client-75b4dc455f-q57jq"
Oct 30 19:48:32.814541 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:32.814522    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d6b46262-71f5-44de-a798-2ac90b936184-serving-certs-ca-bundle\") pod \"telemeter-client-75b4dc455f-q57jq\" (UID: \"d6b46262-71f5-44de-a798-2ac90b936184\") " pod="openshift-monitoring/telemeter-client-75b4dc455f-q57jq"
Oct 30 19:48:32.814579 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:32.814565    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d6b46262-71f5-44de-a798-2ac90b936184-metrics-client-ca\") pod \"telemeter-client-75b4dc455f-q57jq\" (UID: \"d6b46262-71f5-44de-a798-2ac90b936184\") " pod="openshift-monitoring/telemeter-client-75b4dc455f-q57jq"
Oct 30 19:48:32.814611 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:32.814595    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/d6b46262-71f5-44de-a798-2ac90b936184-federate-client-tls\") pod \"telemeter-client-75b4dc455f-q57jq\" (UID: \"d6b46262-71f5-44de-a798-2ac90b936184\") " pod="openshift-monitoring/telemeter-client-75b4dc455f-q57jq"
Oct 30 19:48:32.814640 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:32.814613    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/d6b46262-71f5-44de-a798-2ac90b936184-telemeter-client-tls\") pod \"telemeter-client-75b4dc455f-q57jq\" (UID: \"d6b46262-71f5-44de-a798-2ac90b936184\") " pod="openshift-monitoring/telemeter-client-75b4dc455f-q57jq"
Oct 30 19:48:32.914944 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:32.914913    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d6b46262-71f5-44de-a798-2ac90b936184-telemeter-trusted-ca-bundle\") pod \"telemeter-client-75b4dc455f-q57jq\" (UID: \"d6b46262-71f5-44de-a798-2ac90b936184\") " pod="openshift-monitoring/telemeter-client-75b4dc455f-q57jq"
Oct 30 19:48:32.914944 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:32.914953    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rp864\" (UniqueName: \"kubernetes.io/projected/d6b46262-71f5-44de-a798-2ac90b936184-kube-api-access-rp864\") pod \"telemeter-client-75b4dc455f-q57jq\" (UID: \"d6b46262-71f5-44de-a798-2ac90b936184\") " pod="openshift-monitoring/telemeter-client-75b4dc455f-q57jq"
Oct 30 19:48:32.915145 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:32.914996    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/d6b46262-71f5-44de-a798-2ac90b936184-secret-telemeter-client\") pod \"telemeter-client-75b4dc455f-q57jq\" (UID: \"d6b46262-71f5-44de-a798-2ac90b936184\") " pod="openshift-monitoring/telemeter-client-75b4dc455f-q57jq"
Oct 30 19:48:32.915145 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:32.915047    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d6b46262-71f5-44de-a798-2ac90b936184-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-75b4dc455f-q57jq\" (UID: \"d6b46262-71f5-44de-a798-2ac90b936184\") " pod="openshift-monitoring/telemeter-client-75b4dc455f-q57jq"
Oct 30 19:48:32.915273 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:32.915253    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d6b46262-71f5-44de-a798-2ac90b936184-serving-certs-ca-bundle\") pod \"telemeter-client-75b4dc455f-q57jq\" (UID: \"d6b46262-71f5-44de-a798-2ac90b936184\") " pod="openshift-monitoring/telemeter-client-75b4dc455f-q57jq"
Oct 30 19:48:32.915384 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:32.915358    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d6b46262-71f5-44de-a798-2ac90b936184-metrics-client-ca\") pod \"telemeter-client-75b4dc455f-q57jq\" (UID: \"d6b46262-71f5-44de-a798-2ac90b936184\") " pod="openshift-monitoring/telemeter-client-75b4dc455f-q57jq"
Oct 30 19:48:32.916124 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:32.915505    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/d6b46262-71f5-44de-a798-2ac90b936184-federate-client-tls\") pod \"telemeter-client-75b4dc455f-q57jq\" (UID: \"d6b46262-71f5-44de-a798-2ac90b936184\") " pod="openshift-monitoring/telemeter-client-75b4dc455f-q57jq"
Oct 30 19:48:32.916124 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:32.915862    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/d6b46262-71f5-44de-a798-2ac90b936184-telemeter-client-tls\") pod \"telemeter-client-75b4dc455f-q57jq\" (UID: \"d6b46262-71f5-44de-a798-2ac90b936184\") " pod="openshift-monitoring/telemeter-client-75b4dc455f-q57jq"
Oct 30 19:48:32.916124 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:32.915880    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d6b46262-71f5-44de-a798-2ac90b936184-telemeter-trusted-ca-bundle\") pod \"telemeter-client-75b4dc455f-q57jq\" (UID: \"d6b46262-71f5-44de-a798-2ac90b936184\") " pod="openshift-monitoring/telemeter-client-75b4dc455f-q57jq"
Oct 30 19:48:32.916124 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:32.916111    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d6b46262-71f5-44de-a798-2ac90b936184-serving-certs-ca-bundle\") pod \"telemeter-client-75b4dc455f-q57jq\" (UID: \"d6b46262-71f5-44de-a798-2ac90b936184\") " pod="openshift-monitoring/telemeter-client-75b4dc455f-q57jq"
Oct 30 19:48:32.916379 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:32.916132    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d6b46262-71f5-44de-a798-2ac90b936184-metrics-client-ca\") pod \"telemeter-client-75b4dc455f-q57jq\" (UID: \"d6b46262-71f5-44de-a798-2ac90b936184\") " pod="openshift-monitoring/telemeter-client-75b4dc455f-q57jq"
Oct 30 19:48:32.917803 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:32.917778    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/d6b46262-71f5-44de-a798-2ac90b936184-secret-telemeter-client\") pod \"telemeter-client-75b4dc455f-q57jq\" (UID: \"d6b46262-71f5-44de-a798-2ac90b936184\") " pod="openshift-monitoring/telemeter-client-75b4dc455f-q57jq"
Oct 30 19:48:32.918115 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:32.918092    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d6b46262-71f5-44de-a798-2ac90b936184-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-75b4dc455f-q57jq\" (UID: \"d6b46262-71f5-44de-a798-2ac90b936184\") " pod="openshift-monitoring/telemeter-client-75b4dc455f-q57jq"
Oct 30 19:48:32.918164 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:32.918102    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/d6b46262-71f5-44de-a798-2ac90b936184-telemeter-client-tls\") pod \"telemeter-client-75b4dc455f-q57jq\" (UID: \"d6b46262-71f5-44de-a798-2ac90b936184\") " pod="openshift-monitoring/telemeter-client-75b4dc455f-q57jq"
Oct 30 19:48:32.918164 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:32.918143    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/d6b46262-71f5-44de-a798-2ac90b936184-federate-client-tls\") pod \"telemeter-client-75b4dc455f-q57jq\" (UID: \"d6b46262-71f5-44de-a798-2ac90b936184\") " pod="openshift-monitoring/telemeter-client-75b4dc455f-q57jq"
Oct 30 19:48:32.940222 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:32.940200    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rp864\" (UniqueName: \"kubernetes.io/projected/d6b46262-71f5-44de-a798-2ac90b936184-kube-api-access-rp864\") pod \"telemeter-client-75b4dc455f-q57jq\" (UID: \"d6b46262-71f5-44de-a798-2ac90b936184\") " pod="openshift-monitoring/telemeter-client-75b4dc455f-q57jq"
Oct 30 19:48:32.980098 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:32.980049    6275 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-75b4dc455f-q57jq"
Oct 30 19:48:33.308558 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:33.308524    6275 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-75b4dc455f-q57jq"]
Oct 30 19:48:33.312614 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:48:33.312583    6275 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd6b46262_71f5_44de_a798_2ac90b936184.slice/crio-e7c16b855bb4d87ffaa67e15710fa011daa45a65794fb48d9aed1cfc21626418 WatchSource:0}: Error finding container e7c16b855bb4d87ffaa67e15710fa011daa45a65794fb48d9aed1cfc21626418: Status 404 returned error can't find the container with id e7c16b855bb4d87ffaa67e15710fa011daa45a65794fb48d9aed1cfc21626418
Oct 30 19:48:33.777924 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:33.777884    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-75b4dc455f-q57jq" event={"ID":"d6b46262-71f5-44de-a798-2ac90b936184","Type":"ContainerStarted","Data":"e7c16b855bb4d87ffaa67e15710fa011daa45a65794fb48d9aed1cfc21626418"}
Oct 30 19:48:34.785552 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:34.785512    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2ce2ec33-5684-425b-a0a5-31769367737f","Type":"ContainerStarted","Data":"7d66ee7626ed1178b4f8e6930b6c9ccb0e8ed0aa23a79c3ff14b16b0edacda93"}
Oct 30 19:48:34.785992 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:34.785587    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2ce2ec33-5684-425b-a0a5-31769367737f","Type":"ContainerStarted","Data":"4eab47ff86e3d0b28db9796cf883baa9f26896e506037aeba898293c63f795c9"}
Oct 30 19:48:34.785992 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:34.785615    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2ce2ec33-5684-425b-a0a5-31769367737f","Type":"ContainerStarted","Data":"afd35e1b43e899b338fff7bfc727fdf93bba25c0ac7e321a381607423b872c0c"}
Oct 30 19:48:34.785992 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:34.785651    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2ce2ec33-5684-425b-a0a5-31769367737f","Type":"ContainerStarted","Data":"605e826a6b92f153c5798bb8064cac2e89e9e0f484e99ed5942803205e8489b6"}
Oct 30 19:48:34.785992 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:34.785681    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2ce2ec33-5684-425b-a0a5-31769367737f","Type":"ContainerStarted","Data":"446ff3da01b6c78ce473f3916085a88b6ad737855c65ad085d4c6044cab9625c"}
Oct 30 19:48:34.785992 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:34.785718    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2ce2ec33-5684-425b-a0a5-31769367737f","Type":"ContainerStarted","Data":"d68218935abd0d8b89a696d629bf914c6f8c6657076c0732da7ffd3a030eb5fe"}
Oct 30 19:48:34.881974 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:34.881926    6275 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.609372841 podStartE2EDuration="4.881911294s" totalImagesPullingTime="2.259971345s" totalInitContainerRuntime="12.567108ms" isStatefulPod=false podCreationTimestamp="2026-10-30 19:48:30 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 19:48:34.868667112 +0000 UTC m=+25.330393976" watchObservedRunningTime="2026-10-30 19:48:34.881911294 +0000 UTC m=+25.343638155"
Oct 30 19:48:35.790518 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:35.790481    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-75b4dc455f-q57jq" event={"ID":"d6b46262-71f5-44de-a798-2ac90b936184","Type":"ContainerStarted","Data":"f30c34e4e110cd1c66ad9f7e3fac9e280692b5758943e92b3f4b2d0f5a9835ad"}
Oct 30 19:48:35.790884 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:35.790543    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-75b4dc455f-q57jq" event={"ID":"d6b46262-71f5-44de-a798-2ac90b936184","Type":"ContainerStarted","Data":"2fcb63715bdfcd3b9f9fa18b2847c0d7379873e8cba6455ee209752ebe3461cd"}
Oct 30 19:48:35.790884 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:35.790570    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-75b4dc455f-q57jq" event={"ID":"d6b46262-71f5-44de-a798-2ac90b936184","Type":"ContainerStarted","Data":"6628c431c6d1f9738d74160d84bd7381ad16284941594b2951154b0557ec4c79"}
Oct 30 19:48:35.867396 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:35.867341    6275 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-75b4dc455f-q57jq" podStartSLOduration=2.250415165 podStartE2EDuration="3.867323666s" totalImagesPullingTime="1.616908501s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 19:48:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 19:48:35.853930844 +0000 UTC m=+26.315657734" watchObservedRunningTime="2026-10-30 19:48:35.867323666 +0000 UTC m=+26.329050534"
Oct 30 19:48:37.412257 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:37.412225    6275 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-6lj57"
Oct 30 19:48:46.789299 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:48:46.789268    6275 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-b27jd"
Oct 30 19:48:56.253589 ip-10-0-131-26 kubenswrapper[6275]: E1030 19:48:56.253553    6275 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-fwc77" containerName="extractor"
Oct 30 19:49:26.253989 ip-10-0-131-26 kubenswrapper[6275]: E1030 19:49:26.253951    6275 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-fwc77" containerName="extractor"
Oct 30 19:49:56.253369 ip-10-0-131-26 kubenswrapper[6275]: E1030 19:49:56.253282    6275 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-fwc77" containerName="extractor"
Oct 30 19:50:26.253717 ip-10-0-131-26 kubenswrapper[6275]: E1030 19:50:26.253681    6275 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-fwc77" containerName="extractor"
Oct 30 19:50:56.252552 ip-10-0-131-26 kubenswrapper[6275]: E1030 19:50:56.252519    6275 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-fwc77" containerName="extractor"
Oct 30 19:51:10.713375 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:51:10.713346    6275 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cffhmc"]
Oct 30 19:51:10.716914 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:51:10.716893    6275 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cffhmc"
Oct 30 19:51:10.734466 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:51:10.734449    6275 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Oct 30 19:51:10.747362 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:51:10.747344    6275 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Oct 30 19:51:10.747580 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:51:10.747561    6275 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"c7537007944577f64df34960ace3c69136c416-139ec370-dockercfg-4hj7g\""
Oct 30 19:51:10.748177 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:51:10.748160    6275 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cffhmc"]
Oct 30 19:51:10.754362 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:51:10.754343    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jj6d7\" (UniqueName: \"kubernetes.io/projected/d1e536f0-78ba-45a1-b9a7-97dd90a41d84-kube-api-access-jj6d7\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cffhmc\" (UID: \"d1e536f0-78ba-45a1-b9a7-97dd90a41d84\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cffhmc"
Oct 30 19:51:10.754459 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:51:10.754400    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d1e536f0-78ba-45a1-b9a7-97dd90a41d84-bundle\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cffhmc\" (UID: \"d1e536f0-78ba-45a1-b9a7-97dd90a41d84\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cffhmc"
Oct 30 19:51:10.754522 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:51:10.754498    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d1e536f0-78ba-45a1-b9a7-97dd90a41d84-util\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cffhmc\" (UID: \"d1e536f0-78ba-45a1-b9a7-97dd90a41d84\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cffhmc"
Oct 30 19:51:10.855211 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:51:10.855186    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jj6d7\" (UniqueName: \"kubernetes.io/projected/d1e536f0-78ba-45a1-b9a7-97dd90a41d84-kube-api-access-jj6d7\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cffhmc\" (UID: \"d1e536f0-78ba-45a1-b9a7-97dd90a41d84\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cffhmc"
Oct 30 19:51:10.855311 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:51:10.855224    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d1e536f0-78ba-45a1-b9a7-97dd90a41d84-bundle\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cffhmc\" (UID: \"d1e536f0-78ba-45a1-b9a7-97dd90a41d84\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cffhmc"
Oct 30 19:51:10.855311 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:51:10.855251    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d1e536f0-78ba-45a1-b9a7-97dd90a41d84-util\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cffhmc\" (UID: \"d1e536f0-78ba-45a1-b9a7-97dd90a41d84\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cffhmc"
Oct 30 19:51:10.855564 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:51:10.855546    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d1e536f0-78ba-45a1-b9a7-97dd90a41d84-bundle\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cffhmc\" (UID: \"d1e536f0-78ba-45a1-b9a7-97dd90a41d84\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cffhmc"
Oct 30 19:51:10.855628 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:51:10.855581    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d1e536f0-78ba-45a1-b9a7-97dd90a41d84-util\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cffhmc\" (UID: \"d1e536f0-78ba-45a1-b9a7-97dd90a41d84\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cffhmc"
Oct 30 19:51:10.881808 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:51:10.881788    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jj6d7\" (UniqueName: \"kubernetes.io/projected/d1e536f0-78ba-45a1-b9a7-97dd90a41d84-kube-api-access-jj6d7\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cffhmc\" (UID: \"d1e536f0-78ba-45a1-b9a7-97dd90a41d84\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cffhmc"
Oct 30 19:51:11.031594 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:51:11.031578    6275 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cffhmc"
Oct 30 19:51:11.327422 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:51:11.327385    6275 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cffhmc"]
Oct 30 19:51:11.329195 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:51:11.329171    6275 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd1e536f0_78ba_45a1_b9a7_97dd90a41d84.slice/crio-b4e0b65d1ed585ca85e04eea2e8a1ab7a10de0d5e851c79bc85d18be87d58c46 WatchSource:0}: Error finding container b4e0b65d1ed585ca85e04eea2e8a1ab7a10de0d5e851c79bc85d18be87d58c46: Status 404 returned error can't find the container with id b4e0b65d1ed585ca85e04eea2e8a1ab7a10de0d5e851c79bc85d18be87d58c46
Oct 30 19:51:12.300292 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:51:12.300254    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cffhmc" event={"ID":"d1e536f0-78ba-45a1-b9a7-97dd90a41d84","Type":"ContainerStarted","Data":"b4e0b65d1ed585ca85e04eea2e8a1ab7a10de0d5e851c79bc85d18be87d58c46"}
Oct 30 19:51:17.321373 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:51:17.321336    6275 generic.go:356] "Generic (PLEG): container finished" podID="d1e536f0-78ba-45a1-b9a7-97dd90a41d84" containerID="cf019cec49e863268d7616c4a184e16d94dcef2ff96924fd586f836df03c2a70" exitCode=0
Oct 30 19:51:17.321905 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:51:17.321398    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cffhmc" event={"ID":"d1e536f0-78ba-45a1-b9a7-97dd90a41d84","Type":"ContainerDied","Data":"cf019cec49e863268d7616c4a184e16d94dcef2ff96924fd586f836df03c2a70"}
Oct 30 19:51:20.335101 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:51:20.335067    6275 generic.go:356] "Generic (PLEG): container finished" podID="d1e536f0-78ba-45a1-b9a7-97dd90a41d84" containerID="0c6daa4cbecc4b2d9cbb4e721a5dfcdecd7de85a55e3584e5b7f79dcc5b0c1a6" exitCode=0
Oct 30 19:51:20.335513 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:51:20.335118    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cffhmc" event={"ID":"d1e536f0-78ba-45a1-b9a7-97dd90a41d84","Type":"ContainerDied","Data":"0c6daa4cbecc4b2d9cbb4e721a5dfcdecd7de85a55e3584e5b7f79dcc5b0c1a6"}
Oct 30 19:51:26.252110 ip-10-0-131-26 kubenswrapper[6275]: E1030 19:51:26.252071    6275 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-fwc77" containerName="extractor"
Oct 30 19:51:26.359819 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:51:26.359783    6275 generic.go:356] "Generic (PLEG): container finished" podID="d1e536f0-78ba-45a1-b9a7-97dd90a41d84" containerID="ce70e0cfb50928e1e76e635856b2044e2ad16c0c7f19d0f736b00ad09f05279b" exitCode=0
Oct 30 19:51:26.359954 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:51:26.359840    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cffhmc" event={"ID":"d1e536f0-78ba-45a1-b9a7-97dd90a41d84","Type":"ContainerDied","Data":"ce70e0cfb50928e1e76e635856b2044e2ad16c0c7f19d0f736b00ad09f05279b"}
Oct 30 19:51:27.479138 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:51:27.479114    6275 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cffhmc"
Oct 30 19:51:27.584679 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:51:27.584651    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/d1e536f0-78ba-45a1-b9a7-97dd90a41d84-kube-api-access-jj6d7\" (UniqueName: \"kubernetes.io/projected/d1e536f0-78ba-45a1-b9a7-97dd90a41d84-kube-api-access-jj6d7\") pod \"d1e536f0-78ba-45a1-b9a7-97dd90a41d84\" (UID: \"d1e536f0-78ba-45a1-b9a7-97dd90a41d84\") "
Oct 30 19:51:27.584821 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:51:27.584724    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d1e536f0-78ba-45a1-b9a7-97dd90a41d84-bundle\" (UniqueName: \"kubernetes.io/empty-dir/d1e536f0-78ba-45a1-b9a7-97dd90a41d84-bundle\") pod \"d1e536f0-78ba-45a1-b9a7-97dd90a41d84\" (UID: \"d1e536f0-78ba-45a1-b9a7-97dd90a41d84\") "
Oct 30 19:51:27.584821 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:51:27.584782    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d1e536f0-78ba-45a1-b9a7-97dd90a41d84-util\" (UniqueName: \"kubernetes.io/empty-dir/d1e536f0-78ba-45a1-b9a7-97dd90a41d84-util\") pod \"d1e536f0-78ba-45a1-b9a7-97dd90a41d84\" (UID: \"d1e536f0-78ba-45a1-b9a7-97dd90a41d84\") "
Oct 30 19:51:27.585348 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:51:27.585317    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d1e536f0-78ba-45a1-b9a7-97dd90a41d84-bundle" pod "d1e536f0-78ba-45a1-b9a7-97dd90a41d84" (UID: "d1e536f0-78ba-45a1-b9a7-97dd90a41d84"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 19:51:27.586760 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:51:27.586737    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d1e536f0-78ba-45a1-b9a7-97dd90a41d84-kube-api-access-jj6d7" pod "d1e536f0-78ba-45a1-b9a7-97dd90a41d84" (UID: "d1e536f0-78ba-45a1-b9a7-97dd90a41d84"). InnerVolumeSpecName "kube-api-access-jj6d7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 19:51:27.590352 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:51:27.590323    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d1e536f0-78ba-45a1-b9a7-97dd90a41d84-util" pod "d1e536f0-78ba-45a1-b9a7-97dd90a41d84" (UID: "d1e536f0-78ba-45a1-b9a7-97dd90a41d84"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 19:51:27.685624 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:51:27.685603    6275 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jj6d7\" (UniqueName: \"kubernetes.io/projected/d1e536f0-78ba-45a1-b9a7-97dd90a41d84-kube-api-access-jj6d7\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 19:51:27.685624 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:51:27.685625    6275 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d1e536f0-78ba-45a1-b9a7-97dd90a41d84-bundle\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 19:51:27.685758 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:51:27.685636    6275 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d1e536f0-78ba-45a1-b9a7-97dd90a41d84-util\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 19:51:28.368771 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:51:28.368736    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cffhmc" event={"ID":"d1e536f0-78ba-45a1-b9a7-97dd90a41d84","Type":"ContainerDied","Data":"b4e0b65d1ed585ca85e04eea2e8a1ab7a10de0d5e851c79bc85d18be87d58c46"}
Oct 30 19:51:28.368926 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:51:28.368774    6275 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cffhmc"
Oct 30 19:51:28.368926 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:51:28.368782    6275 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b4e0b65d1ed585ca85e04eea2e8a1ab7a10de0d5e851c79bc85d18be87d58c46"
Oct 30 19:51:33.874588 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:51:33.874557    6275 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-89fdbf7dc-5xqjp"]
Oct 30 19:51:33.874977 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:51:33.874848    6275 cpu_manager.go:414] "containerMap: removing container" podUID="d1e536f0-78ba-45a1-b9a7-97dd90a41d84" containerName="util"
Oct 30 19:51:33.874977 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:51:33.874858    6275 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="d1e536f0-78ba-45a1-b9a7-97dd90a41d84" containerName="util"
Oct 30 19:51:33.874977 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:51:33.874872    6275 cpu_manager.go:414] "containerMap: removing container" podUID="d1e536f0-78ba-45a1-b9a7-97dd90a41d84" containerName="pull"
Oct 30 19:51:33.874977 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:51:33.874879    6275 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="d1e536f0-78ba-45a1-b9a7-97dd90a41d84" containerName="pull"
Oct 30 19:51:33.874977 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:51:33.874888    6275 cpu_manager.go:414] "containerMap: removing container" podUID="d1e536f0-78ba-45a1-b9a7-97dd90a41d84" containerName="extract"
Oct 30 19:51:33.874977 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:51:33.874893    6275 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="d1e536f0-78ba-45a1-b9a7-97dd90a41d84" containerName="extract"
Oct 30 19:51:33.874977 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:51:33.874941    6275 memory_manager.go:365] "RemoveStaleState removing state" podUID="d1e536f0-78ba-45a1-b9a7-97dd90a41d84" containerName="extract"
Oct 30 19:51:33.876991 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:51:33.876974    6275 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-89fdbf7dc-5xqjp"
Oct 30 19:51:33.894886 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:51:33.894867    6275 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\""
Oct 30 19:51:33.894984 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:51:33.894898    6275 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\""
Oct 30 19:51:33.895247 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:51:33.895234    6275 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-rxzt2\""
Oct 30 19:51:33.911277 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:51:33.911256    6275 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-89fdbf7dc-5xqjp"]
Oct 30 19:51:33.929961 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:51:33.929939    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0bdac45a-c1bb-49ff-8d25-634f93b00913-tmp\") pod \"cert-manager-operator-controller-manager-89fdbf7dc-5xqjp\" (UID: \"0bdac45a-c1bb-49ff-8d25-634f93b00913\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-89fdbf7dc-5xqjp"
Oct 30 19:51:33.930052 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:51:33.929986    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hccbb\" (UniqueName: \"kubernetes.io/projected/0bdac45a-c1bb-49ff-8d25-634f93b00913-kube-api-access-hccbb\") pod \"cert-manager-operator-controller-manager-89fdbf7dc-5xqjp\" (UID: \"0bdac45a-c1bb-49ff-8d25-634f93b00913\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-89fdbf7dc-5xqjp"
Oct 30 19:51:34.030778 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:51:34.030752    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hccbb\" (UniqueName: \"kubernetes.io/projected/0bdac45a-c1bb-49ff-8d25-634f93b00913-kube-api-access-hccbb\") pod \"cert-manager-operator-controller-manager-89fdbf7dc-5xqjp\" (UID: \"0bdac45a-c1bb-49ff-8d25-634f93b00913\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-89fdbf7dc-5xqjp"
Oct 30 19:51:34.030917 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:51:34.030800    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0bdac45a-c1bb-49ff-8d25-634f93b00913-tmp\") pod \"cert-manager-operator-controller-manager-89fdbf7dc-5xqjp\" (UID: \"0bdac45a-c1bb-49ff-8d25-634f93b00913\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-89fdbf7dc-5xqjp"
Oct 30 19:51:34.031113 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:51:34.031098    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0bdac45a-c1bb-49ff-8d25-634f93b00913-tmp\") pod \"cert-manager-operator-controller-manager-89fdbf7dc-5xqjp\" (UID: \"0bdac45a-c1bb-49ff-8d25-634f93b00913\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-89fdbf7dc-5xqjp"
Oct 30 19:51:34.059987 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:51:34.059959    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hccbb\" (UniqueName: \"kubernetes.io/projected/0bdac45a-c1bb-49ff-8d25-634f93b00913-kube-api-access-hccbb\") pod \"cert-manager-operator-controller-manager-89fdbf7dc-5xqjp\" (UID: \"0bdac45a-c1bb-49ff-8d25-634f93b00913\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-89fdbf7dc-5xqjp"
Oct 30 19:51:34.187449 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:51:34.187368    6275 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-89fdbf7dc-5xqjp"
Oct 30 19:51:34.520301 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:51:34.520224    6275 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-89fdbf7dc-5xqjp"]
Oct 30 19:51:34.522672 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:51:34.522634    6275 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0bdac45a_c1bb_49ff_8d25_634f93b00913.slice/crio-a7f9eb8c89ce4d8251da7a21dd035bd7f1beccc3ec02a47e5357499d8cc7dedb WatchSource:0}: Error finding container a7f9eb8c89ce4d8251da7a21dd035bd7f1beccc3ec02a47e5357499d8cc7dedb: Status 404 returned error can't find the container with id a7f9eb8c89ce4d8251da7a21dd035bd7f1beccc3ec02a47e5357499d8cc7dedb
Oct 30 19:51:35.395080 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:51:35.395035    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-89fdbf7dc-5xqjp" event={"ID":"0bdac45a-c1bb-49ff-8d25-634f93b00913","Type":"ContainerStarted","Data":"a7f9eb8c89ce4d8251da7a21dd035bd7f1beccc3ec02a47e5357499d8cc7dedb"}
Oct 30 19:51:36.400813 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:51:36.400775    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-89fdbf7dc-5xqjp" event={"ID":"0bdac45a-c1bb-49ff-8d25-634f93b00913","Type":"ContainerStarted","Data":"e468e105eaded0f5b18625d84a5de449b39444df39e1ff11e1aa5213dfbd36f1"}
Oct 30 19:51:36.504343 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:51:36.504300    6275 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-89fdbf7dc-5xqjp" podStartSLOduration=2.120187259 podStartE2EDuration="3.504287954s" totalImagesPullingTime="1.384100695s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 19:51:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 19:51:36.491309201 +0000 UTC m=+206.953036063" watchObservedRunningTime="2026-10-30 19:51:36.504287954 +0000 UTC m=+206.966014817"
Oct 30 19:51:37.898406 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:51:37.898370    6275 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-5dbbbf75cc-vfqhv"]
Oct 30 19:51:37.900614 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:51:37.900593    6275 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-5dbbbf75cc-vfqhv"
Oct 30 19:51:37.922554 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:51:37.922530    6275 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-marketplace/61b1ff68c7255ee5c5329fe19a5d96293a95788d9734a0a79829e8dc85wtc9l"]
Oct 30 19:51:37.924568 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:51:37.924554    6275 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/61b1ff68c7255ee5c5329fe19a5d96293a95788d9734a0a79829e8dc85wtc9l"
Oct 30 19:51:37.934662 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:51:37.934642    6275 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Oct 30 19:51:37.934768 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:51:37.934705    6275 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Oct 30 19:51:37.934812 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:51:37.934778    6275 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-86s6v\""
Oct 30 19:51:37.935291 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:51:37.935268    6275 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-5dbbbf75cc-vfqhv"]
Oct 30 19:51:37.959991 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:51:37.959962    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4k8vx\" (UniqueName: \"kubernetes.io/projected/ae2b0dcf-ee6f-447a-bf93-08e3deac5c41-kube-api-access-4k8vx\") pod \"cert-manager-webhook-5dbbbf75cc-vfqhv\" (UID: \"ae2b0dcf-ee6f-447a-bf93-08e3deac5c41\") " pod="cert-manager/cert-manager-webhook-5dbbbf75cc-vfqhv"
Oct 30 19:51:37.960097 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:51:37.960000    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ae2b0dcf-ee6f-447a-bf93-08e3deac5c41-bound-sa-token\") pod \"cert-manager-webhook-5dbbbf75cc-vfqhv\" (UID: \"ae2b0dcf-ee6f-447a-bf93-08e3deac5c41\") " pod="cert-manager/cert-manager-webhook-5dbbbf75cc-vfqhv"
Oct 30 19:51:37.969385 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:51:37.969362    6275 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/61b1ff68c7255ee5c5329fe19a5d96293a95788d9734a0a79829e8dc85wtc9l"]
Oct 30 19:51:38.026531 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:51:38.026504    6275 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Oct 30 19:51:38.026531 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:51:38.026517    6275 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Oct 30 19:51:38.026748 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:51:38.026533    6275 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"61b1ff68c7255ee5c5329fe19a5d96293a9578-ce91a85d-dockercfg-48p8p\""
Oct 30 19:51:38.061166 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:51:38.061141    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ae2b0dcf-ee6f-447a-bf93-08e3deac5c41-bound-sa-token\") pod \"cert-manager-webhook-5dbbbf75cc-vfqhv\" (UID: \"ae2b0dcf-ee6f-447a-bf93-08e3deac5c41\") " pod="cert-manager/cert-manager-webhook-5dbbbf75cc-vfqhv"
Oct 30 19:51:38.061272 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:51:38.061219    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/46caece6-2c46-41df-ad0d-7585dbde471b-bundle\") pod \"61b1ff68c7255ee5c5329fe19a5d96293a95788d9734a0a79829e8dc85wtc9l\" (UID: \"46caece6-2c46-41df-ad0d-7585dbde471b\") " pod="openshift-marketplace/61b1ff68c7255ee5c5329fe19a5d96293a95788d9734a0a79829e8dc85wtc9l"
Oct 30 19:51:38.061272 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:51:38.061252    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q68dq\" (UniqueName: \"kubernetes.io/projected/46caece6-2c46-41df-ad0d-7585dbde471b-kube-api-access-q68dq\") pod \"61b1ff68c7255ee5c5329fe19a5d96293a95788d9734a0a79829e8dc85wtc9l\" (UID: \"46caece6-2c46-41df-ad0d-7585dbde471b\") " pod="openshift-marketplace/61b1ff68c7255ee5c5329fe19a5d96293a95788d9734a0a79829e8dc85wtc9l"
Oct 30 19:51:38.061399 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:51:38.061343    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/46caece6-2c46-41df-ad0d-7585dbde471b-util\") pod \"61b1ff68c7255ee5c5329fe19a5d96293a95788d9734a0a79829e8dc85wtc9l\" (UID: \"46caece6-2c46-41df-ad0d-7585dbde471b\") " pod="openshift-marketplace/61b1ff68c7255ee5c5329fe19a5d96293a95788d9734a0a79829e8dc85wtc9l"
Oct 30 19:51:38.061399 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:51:38.061377    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4k8vx\" (UniqueName: \"kubernetes.io/projected/ae2b0dcf-ee6f-447a-bf93-08e3deac5c41-kube-api-access-4k8vx\") pod \"cert-manager-webhook-5dbbbf75cc-vfqhv\" (UID: \"ae2b0dcf-ee6f-447a-bf93-08e3deac5c41\") " pod="cert-manager/cert-manager-webhook-5dbbbf75cc-vfqhv"
Oct 30 19:51:38.087817 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:51:38.087797    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4k8vx\" (UniqueName: \"kubernetes.io/projected/ae2b0dcf-ee6f-447a-bf93-08e3deac5c41-kube-api-access-4k8vx\") pod \"cert-manager-webhook-5dbbbf75cc-vfqhv\" (UID: \"ae2b0dcf-ee6f-447a-bf93-08e3deac5c41\") " pod="cert-manager/cert-manager-webhook-5dbbbf75cc-vfqhv"
Oct 30 19:51:38.091878 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:51:38.091857    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ae2b0dcf-ee6f-447a-bf93-08e3deac5c41-bound-sa-token\") pod \"cert-manager-webhook-5dbbbf75cc-vfqhv\" (UID: \"ae2b0dcf-ee6f-447a-bf93-08e3deac5c41\") " pod="cert-manager/cert-manager-webhook-5dbbbf75cc-vfqhv"
Oct 30 19:51:38.161990 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:51:38.161939    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/46caece6-2c46-41df-ad0d-7585dbde471b-bundle\") pod \"61b1ff68c7255ee5c5329fe19a5d96293a95788d9734a0a79829e8dc85wtc9l\" (UID: \"46caece6-2c46-41df-ad0d-7585dbde471b\") " pod="openshift-marketplace/61b1ff68c7255ee5c5329fe19a5d96293a95788d9734a0a79829e8dc85wtc9l"
Oct 30 19:51:38.161990 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:51:38.161969    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q68dq\" (UniqueName: \"kubernetes.io/projected/46caece6-2c46-41df-ad0d-7585dbde471b-kube-api-access-q68dq\") pod \"61b1ff68c7255ee5c5329fe19a5d96293a95788d9734a0a79829e8dc85wtc9l\" (UID: \"46caece6-2c46-41df-ad0d-7585dbde471b\") " pod="openshift-marketplace/61b1ff68c7255ee5c5329fe19a5d96293a95788d9734a0a79829e8dc85wtc9l"
Oct 30 19:51:38.162178 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:51:38.161996    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/46caece6-2c46-41df-ad0d-7585dbde471b-util\") pod \"61b1ff68c7255ee5c5329fe19a5d96293a95788d9734a0a79829e8dc85wtc9l\" (UID: \"46caece6-2c46-41df-ad0d-7585dbde471b\") " pod="openshift-marketplace/61b1ff68c7255ee5c5329fe19a5d96293a95788d9734a0a79829e8dc85wtc9l"
Oct 30 19:51:38.162298 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:51:38.162276    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/46caece6-2c46-41df-ad0d-7585dbde471b-bundle\") pod \"61b1ff68c7255ee5c5329fe19a5d96293a95788d9734a0a79829e8dc85wtc9l\" (UID: \"46caece6-2c46-41df-ad0d-7585dbde471b\") " pod="openshift-marketplace/61b1ff68c7255ee5c5329fe19a5d96293a95788d9734a0a79829e8dc85wtc9l"
Oct 30 19:51:38.162346 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:51:38.162306    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/46caece6-2c46-41df-ad0d-7585dbde471b-util\") pod \"61b1ff68c7255ee5c5329fe19a5d96293a95788d9734a0a79829e8dc85wtc9l\" (UID: \"46caece6-2c46-41df-ad0d-7585dbde471b\") " pod="openshift-marketplace/61b1ff68c7255ee5c5329fe19a5d96293a95788d9734a0a79829e8dc85wtc9l"
Oct 30 19:51:38.194800 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:51:38.194778    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q68dq\" (UniqueName: \"kubernetes.io/projected/46caece6-2c46-41df-ad0d-7585dbde471b-kube-api-access-q68dq\") pod \"61b1ff68c7255ee5c5329fe19a5d96293a95788d9734a0a79829e8dc85wtc9l\" (UID: \"46caece6-2c46-41df-ad0d-7585dbde471b\") " pod="openshift-marketplace/61b1ff68c7255ee5c5329fe19a5d96293a95788d9734a0a79829e8dc85wtc9l"
Oct 30 19:51:38.227701 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:51:38.227669    6275 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-5dbbbf75cc-vfqhv"
Oct 30 19:51:38.238552 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:51:38.238424    6275 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/61b1ff68c7255ee5c5329fe19a5d96293a95788d9734a0a79829e8dc85wtc9l"
Oct 30 19:51:38.573849 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:51:38.573822    6275 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/61b1ff68c7255ee5c5329fe19a5d96293a95788d9734a0a79829e8dc85wtc9l"]
Oct 30 19:51:38.576153 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:51:38.576133    6275 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-5dbbbf75cc-vfqhv"]
Oct 30 19:51:38.586044 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:51:38.586022    6275 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod46caece6_2c46_41df_ad0d_7585dbde471b.slice/crio-f5e49adc885f2bb06fb660a6530bc1bc38662c0047e6e32374264dbfde6cdc26 WatchSource:0}: Error finding container f5e49adc885f2bb06fb660a6530bc1bc38662c0047e6e32374264dbfde6cdc26: Status 404 returned error can't find the container with id f5e49adc885f2bb06fb660a6530bc1bc38662c0047e6e32374264dbfde6cdc26
Oct 30 19:51:38.588764 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:51:38.588739    6275 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podae2b0dcf_ee6f_447a_bf93_08e3deac5c41.slice/crio-077a09a21ca7de71f54806efa55f73a9c617d6c519774c5e85fda44ed545f37c WatchSource:0}: Error finding container 077a09a21ca7de71f54806efa55f73a9c617d6c519774c5e85fda44ed545f37c: Status 404 returned error can't find the container with id 077a09a21ca7de71f54806efa55f73a9c617d6c519774c5e85fda44ed545f37c
Oct 30 19:51:39.419720 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:51:39.419683    6275 generic.go:356] "Generic (PLEG): container finished" podID="46caece6-2c46-41df-ad0d-7585dbde471b" containerID="b62387554f7b9b57a89eeac7408074f14290148073057368cfe0b47d78570ef9" exitCode=0
Oct 30 19:51:39.420162 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:51:39.419771    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/61b1ff68c7255ee5c5329fe19a5d96293a95788d9734a0a79829e8dc85wtc9l" event={"ID":"46caece6-2c46-41df-ad0d-7585dbde471b","Type":"ContainerDied","Data":"b62387554f7b9b57a89eeac7408074f14290148073057368cfe0b47d78570ef9"}
Oct 30 19:51:39.420162 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:51:39.419850    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/61b1ff68c7255ee5c5329fe19a5d96293a95788d9734a0a79829e8dc85wtc9l" event={"ID":"46caece6-2c46-41df-ad0d-7585dbde471b","Type":"ContainerStarted","Data":"f5e49adc885f2bb06fb660a6530bc1bc38662c0047e6e32374264dbfde6cdc26"}
Oct 30 19:51:39.421179 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:51:39.421149    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-5dbbbf75cc-vfqhv" event={"ID":"ae2b0dcf-ee6f-447a-bf93-08e3deac5c41","Type":"ContainerStarted","Data":"077a09a21ca7de71f54806efa55f73a9c617d6c519774c5e85fda44ed545f37c"}
Oct 30 19:51:39.630283 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:51:39.630247    6275 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-5c57bbd4fc-jl9ml"]
Oct 30 19:51:39.633761 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:51:39.633742    6275 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-5c57bbd4fc-jl9ml"
Oct 30 19:51:39.654142 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:51:39.654120    6275 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-jdkxm\""
Oct 30 19:51:39.658472 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:51:39.658444    6275 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-5c57bbd4fc-jl9ml"]
Oct 30 19:51:39.778719 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:51:39.778686    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8fb6de5c-fc00-4a62-ab5b-daec8fb23df0-bound-sa-token\") pod \"cert-manager-cainjector-5c57bbd4fc-jl9ml\" (UID: \"8fb6de5c-fc00-4a62-ab5b-daec8fb23df0\") " pod="cert-manager/cert-manager-cainjector-5c57bbd4fc-jl9ml"
Oct 30 19:51:39.778886 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:51:39.778793    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xg8vr\" (UniqueName: \"kubernetes.io/projected/8fb6de5c-fc00-4a62-ab5b-daec8fb23df0-kube-api-access-xg8vr\") pod \"cert-manager-cainjector-5c57bbd4fc-jl9ml\" (UID: \"8fb6de5c-fc00-4a62-ab5b-daec8fb23df0\") " pod="cert-manager/cert-manager-cainjector-5c57bbd4fc-jl9ml"
Oct 30 19:51:39.880042 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:51:39.880015    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8fb6de5c-fc00-4a62-ab5b-daec8fb23df0-bound-sa-token\") pod \"cert-manager-cainjector-5c57bbd4fc-jl9ml\" (UID: \"8fb6de5c-fc00-4a62-ab5b-daec8fb23df0\") " pod="cert-manager/cert-manager-cainjector-5c57bbd4fc-jl9ml"
Oct 30 19:51:39.880208 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:51:39.880085    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xg8vr\" (UniqueName: \"kubernetes.io/projected/8fb6de5c-fc00-4a62-ab5b-daec8fb23df0-kube-api-access-xg8vr\") pod \"cert-manager-cainjector-5c57bbd4fc-jl9ml\" (UID: \"8fb6de5c-fc00-4a62-ab5b-daec8fb23df0\") " pod="cert-manager/cert-manager-cainjector-5c57bbd4fc-jl9ml"
Oct 30 19:51:39.906601 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:51:39.906576    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8fb6de5c-fc00-4a62-ab5b-daec8fb23df0-bound-sa-token\") pod \"cert-manager-cainjector-5c57bbd4fc-jl9ml\" (UID: \"8fb6de5c-fc00-4a62-ab5b-daec8fb23df0\") " pod="cert-manager/cert-manager-cainjector-5c57bbd4fc-jl9ml"
Oct 30 19:51:39.906793 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:51:39.906770    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xg8vr\" (UniqueName: \"kubernetes.io/projected/8fb6de5c-fc00-4a62-ab5b-daec8fb23df0-kube-api-access-xg8vr\") pod \"cert-manager-cainjector-5c57bbd4fc-jl9ml\" (UID: \"8fb6de5c-fc00-4a62-ab5b-daec8fb23df0\") " pod="cert-manager/cert-manager-cainjector-5c57bbd4fc-jl9ml"
Oct 30 19:51:39.947480 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:51:39.947455    6275 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-5c57bbd4fc-jl9ml"
Oct 30 19:51:40.259922 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:51:40.259817    6275 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-5c57bbd4fc-jl9ml"]
Oct 30 19:51:40.262596 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:51:40.262571    6275 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8fb6de5c_fc00_4a62_ab5b_daec8fb23df0.slice/crio-2e9719e3a29f40d4e42b45929b9b56fcb9d12aaebee2dffb92d1fa7f62b75eac WatchSource:0}: Error finding container 2e9719e3a29f40d4e42b45929b9b56fcb9d12aaebee2dffb92d1fa7f62b75eac: Status 404 returned error can't find the container with id 2e9719e3a29f40d4e42b45929b9b56fcb9d12aaebee2dffb92d1fa7f62b75eac
Oct 30 19:51:40.426549 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:51:40.426503    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-5c57bbd4fc-jl9ml" event={"ID":"8fb6de5c-fc00-4a62-ab5b-daec8fb23df0","Type":"ContainerStarted","Data":"2e9719e3a29f40d4e42b45929b9b56fcb9d12aaebee2dffb92d1fa7f62b75eac"}
Oct 30 19:51:41.432518 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:51:41.432390    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-5dbbbf75cc-vfqhv" event={"ID":"ae2b0dcf-ee6f-447a-bf93-08e3deac5c41","Type":"ContainerStarted","Data":"5d1466c25c2125d0c4c6aebcba459ceef12e51e8bb2aa9640201aa0db9466634"}
Oct 30 19:51:41.432958 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:51:41.432589    6275 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-5dbbbf75cc-vfqhv"
Oct 30 19:51:41.489806 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:51:41.489753    6275 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-5dbbbf75cc-vfqhv" podStartSLOduration=1.913619322 podStartE2EDuration="4.489740069s" totalImagesPullingTime="2.576120747s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 19:51:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 19:51:41.476437537 +0000 UTC m=+211.938164401" watchObservedRunningTime="2026-10-30 19:51:41.489740069 +0000 UTC m=+211.951466933"
Oct 30 19:51:42.440835 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:51:42.440723    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-5c57bbd4fc-jl9ml" event={"ID":"8fb6de5c-fc00-4a62-ab5b-daec8fb23df0","Type":"ContainerStarted","Data":"3060725671d7281247867cc81746d0c20b6f01e343dc2c3e4d3479f0b1d12b82"}
Oct 30 19:51:42.494908 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:51:42.494853    6275 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-5c57bbd4fc-jl9ml" podStartSLOduration=1.694337776 podStartE2EDuration="3.494835979s" totalImagesPullingTime="1.800498203s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 19:51:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 19:51:42.493901592 +0000 UTC m=+212.955628469" watchObservedRunningTime="2026-10-30 19:51:42.494835979 +0000 UTC m=+212.956562844"
Oct 30 19:51:47.443261 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:51:47.443229    6275 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-5dbbbf75cc-vfqhv"
Oct 30 19:51:47.460194 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:51:47.460167    6275 generic.go:356] "Generic (PLEG): container finished" podID="46caece6-2c46-41df-ad0d-7585dbde471b" containerID="a6b444a5347e04cd45cc1b3b2f5ae54648e2cab607eaae71e15622fcdb8fc4ea" exitCode=0
Oct 30 19:51:47.460338 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:51:47.460265    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/61b1ff68c7255ee5c5329fe19a5d96293a95788d9734a0a79829e8dc85wtc9l" event={"ID":"46caece6-2c46-41df-ad0d-7585dbde471b","Type":"ContainerDied","Data":"a6b444a5347e04cd45cc1b3b2f5ae54648e2cab607eaae71e15622fcdb8fc4ea"}
Oct 30 19:51:48.466038 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:51:48.466007    6275 generic.go:356] "Generic (PLEG): container finished" podID="46caece6-2c46-41df-ad0d-7585dbde471b" containerID="5a0432191399525ddc707361129575bbd4d1657a007fdcccc568ab17b117381a" exitCode=0
Oct 30 19:51:48.466505 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:51:48.466056    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/61b1ff68c7255ee5c5329fe19a5d96293a95788d9734a0a79829e8dc85wtc9l" event={"ID":"46caece6-2c46-41df-ad0d-7585dbde471b","Type":"ContainerDied","Data":"5a0432191399525ddc707361129575bbd4d1657a007fdcccc568ab17b117381a"}
Oct 30 19:51:49.591252 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:51:49.591228    6275 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/61b1ff68c7255ee5c5329fe19a5d96293a95788d9734a0a79829e8dc85wtc9l"
Oct 30 19:51:49.754795 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:51:49.754765    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/46caece6-2c46-41df-ad0d-7585dbde471b-bundle\" (UniqueName: \"kubernetes.io/empty-dir/46caece6-2c46-41df-ad0d-7585dbde471b-bundle\") pod \"46caece6-2c46-41df-ad0d-7585dbde471b\" (UID: \"46caece6-2c46-41df-ad0d-7585dbde471b\") "
Oct 30 19:51:49.754959 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:51:49.754800    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/46caece6-2c46-41df-ad0d-7585dbde471b-kube-api-access-q68dq\" (UniqueName: \"kubernetes.io/projected/46caece6-2c46-41df-ad0d-7585dbde471b-kube-api-access-q68dq\") pod \"46caece6-2c46-41df-ad0d-7585dbde471b\" (UID: \"46caece6-2c46-41df-ad0d-7585dbde471b\") "
Oct 30 19:51:49.754959 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:51:49.754862    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/46caece6-2c46-41df-ad0d-7585dbde471b-util\" (UniqueName: \"kubernetes.io/empty-dir/46caece6-2c46-41df-ad0d-7585dbde471b-util\") pod \"46caece6-2c46-41df-ad0d-7585dbde471b\" (UID: \"46caece6-2c46-41df-ad0d-7585dbde471b\") "
Oct 30 19:51:49.755174 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:51:49.755120    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/46caece6-2c46-41df-ad0d-7585dbde471b-bundle" pod "46caece6-2c46-41df-ad0d-7585dbde471b" (UID: "46caece6-2c46-41df-ad0d-7585dbde471b"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 19:51:49.756875 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:51:49.756856    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/46caece6-2c46-41df-ad0d-7585dbde471b-kube-api-access-q68dq" pod "46caece6-2c46-41df-ad0d-7585dbde471b" (UID: "46caece6-2c46-41df-ad0d-7585dbde471b"). InnerVolumeSpecName "kube-api-access-q68dq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 19:51:49.760698 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:51:49.760670    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/46caece6-2c46-41df-ad0d-7585dbde471b-util" pod "46caece6-2c46-41df-ad0d-7585dbde471b" (UID: "46caece6-2c46-41df-ad0d-7585dbde471b"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 19:51:49.855678 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:51:49.855651    6275 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/46caece6-2c46-41df-ad0d-7585dbde471b-util\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 19:51:49.855678 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:51:49.855678    6275 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/46caece6-2c46-41df-ad0d-7585dbde471b-bundle\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 19:51:49.855853 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:51:49.855690    6275 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q68dq\" (UniqueName: \"kubernetes.io/projected/46caece6-2c46-41df-ad0d-7585dbde471b-kube-api-access-q68dq\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 19:51:50.475958 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:51:50.475914    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/61b1ff68c7255ee5c5329fe19a5d96293a95788d9734a0a79829e8dc85wtc9l" event={"ID":"46caece6-2c46-41df-ad0d-7585dbde471b","Type":"ContainerDied","Data":"f5e49adc885f2bb06fb660a6530bc1bc38662c0047e6e32374264dbfde6cdc26"}
Oct 30 19:51:50.475958 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:51:50.475953    6275 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/61b1ff68c7255ee5c5329fe19a5d96293a95788d9734a0a79829e8dc85wtc9l"
Oct 30 19:51:50.476198 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:51:50.475980    6275 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f5e49adc885f2bb06fb660a6530bc1bc38662c0047e6e32374264dbfde6cdc26"
Oct 30 19:51:55.858371 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:51:55.858342    6275 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-8465994787-n8m4c"]
Oct 30 19:51:55.858750 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:51:55.858646    6275 cpu_manager.go:414] "containerMap: removing container" podUID="46caece6-2c46-41df-ad0d-7585dbde471b" containerName="pull"
Oct 30 19:51:55.858750 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:51:55.858657    6275 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="46caece6-2c46-41df-ad0d-7585dbde471b" containerName="pull"
Oct 30 19:51:55.858750 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:51:55.858675    6275 cpu_manager.go:414] "containerMap: removing container" podUID="46caece6-2c46-41df-ad0d-7585dbde471b" containerName="util"
Oct 30 19:51:55.858750 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:51:55.858680    6275 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="46caece6-2c46-41df-ad0d-7585dbde471b" containerName="util"
Oct 30 19:51:55.858750 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:51:55.858694    6275 cpu_manager.go:414] "containerMap: removing container" podUID="46caece6-2c46-41df-ad0d-7585dbde471b" containerName="extract"
Oct 30 19:51:55.858750 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:51:55.858699    6275 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="46caece6-2c46-41df-ad0d-7585dbde471b" containerName="extract"
Oct 30 19:51:55.858929 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:51:55.858755    6275 memory_manager.go:365] "RemoveStaleState removing state" podUID="46caece6-2c46-41df-ad0d-7585dbde471b" containerName="extract"
Oct 30 19:51:55.891066 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:51:55.891046    6275 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-8465994787-n8m4c"
Oct 30 19:51:55.901963 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:51:55.901941    6275 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-8465994787-n8m4c"]
Oct 30 19:51:55.913401 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:51:55.913380    6275 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-n8hzl\""
Oct 30 19:51:55.923066 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:51:55.923049    6275 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Oct 30 19:51:55.935056 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:51:55.935039    6275 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Oct 30 19:51:55.999656 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:51:55.999632    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qpzpf\" (UniqueName: \"kubernetes.io/projected/46d36812-ffd6-451e-a7fd-b6935185f298-kube-api-access-qpzpf\") pod \"openshift-lws-operator-8465994787-n8m4c\" (UID: \"46d36812-ffd6-451e-a7fd-b6935185f298\") " pod="openshift-lws-operator/openshift-lws-operator-8465994787-n8m4c"
Oct 30 19:51:55.999770 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:51:55.999665    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/46d36812-ffd6-451e-a7fd-b6935185f298-tmp\") pod \"openshift-lws-operator-8465994787-n8m4c\" (UID: \"46d36812-ffd6-451e-a7fd-b6935185f298\") " pod="openshift-lws-operator/openshift-lws-operator-8465994787-n8m4c"
Oct 30 19:51:56.099945 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:51:56.099919    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qpzpf\" (UniqueName: \"kubernetes.io/projected/46d36812-ffd6-451e-a7fd-b6935185f298-kube-api-access-qpzpf\") pod \"openshift-lws-operator-8465994787-n8m4c\" (UID: \"46d36812-ffd6-451e-a7fd-b6935185f298\") " pod="openshift-lws-operator/openshift-lws-operator-8465994787-n8m4c"
Oct 30 19:51:56.100029 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:51:56.099956    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/46d36812-ffd6-451e-a7fd-b6935185f298-tmp\") pod \"openshift-lws-operator-8465994787-n8m4c\" (UID: \"46d36812-ffd6-451e-a7fd-b6935185f298\") " pod="openshift-lws-operator/openshift-lws-operator-8465994787-n8m4c"
Oct 30 19:51:56.100342 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:51:56.100324    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/46d36812-ffd6-451e-a7fd-b6935185f298-tmp\") pod \"openshift-lws-operator-8465994787-n8m4c\" (UID: \"46d36812-ffd6-451e-a7fd-b6935185f298\") " pod="openshift-lws-operator/openshift-lws-operator-8465994787-n8m4c"
Oct 30 19:51:56.131905 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:51:56.131853    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qpzpf\" (UniqueName: \"kubernetes.io/projected/46d36812-ffd6-451e-a7fd-b6935185f298-kube-api-access-qpzpf\") pod \"openshift-lws-operator-8465994787-n8m4c\" (UID: \"46d36812-ffd6-451e-a7fd-b6935185f298\") " pod="openshift-lws-operator/openshift-lws-operator-8465994787-n8m4c"
Oct 30 19:51:56.213215 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:51:56.213193    6275 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-8465994787-n8m4c"
Oct 30 19:51:56.256135 ip-10-0-131-26 kubenswrapper[6275]: E1030 19:51:56.256108    6275 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-fwc77" containerName="extractor"
Oct 30 19:51:56.530872 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:51:56.530850    6275 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-8465994787-n8m4c"]
Oct 30 19:51:56.532463 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:51:56.532439    6275 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod46d36812_ffd6_451e_a7fd_b6935185f298.slice/crio-3b34165df5c93b09de88aba66b0180d75071b4f16b58512a248557d8d0fa2414 WatchSource:0}: Error finding container 3b34165df5c93b09de88aba66b0180d75071b4f16b58512a248557d8d0fa2414: Status 404 returned error can't find the container with id 3b34165df5c93b09de88aba66b0180d75071b4f16b58512a248557d8d0fa2414
Oct 30 19:51:57.509047 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:51:57.509015    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-8465994787-n8m4c" event={"ID":"46d36812-ffd6-451e-a7fd-b6935185f298","Type":"ContainerStarted","Data":"3b34165df5c93b09de88aba66b0180d75071b4f16b58512a248557d8d0fa2414"}
Oct 30 19:52:00.522782 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:52:00.522735    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-8465994787-n8m4c" event={"ID":"46d36812-ffd6-451e-a7fd-b6935185f298","Type":"ContainerStarted","Data":"a4873f3356e599741276a93da6e1331b97fba082247ab804357750b63afb3854"}
Oct 30 19:52:00.567753 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:52:00.567698    6275 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-8465994787-n8m4c" podStartSLOduration=2.431826931 podStartE2EDuration="5.567682441s" totalImagesPullingTime="3.13585551s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 19:51:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 19:52:00.566727042 +0000 UTC m=+231.028453903" watchObservedRunningTime="2026-10-30 19:52:00.567682441 +0000 UTC m=+231.029409305"
Oct 30 19:52:04.027006 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:52:04.026973    6275 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71mmglh"]
Oct 30 19:52:04.029608 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:52:04.029583    6275 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71mmglh"
Oct 30 19:52:04.046693 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:52:04.046676    6275 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Oct 30 19:52:04.059624 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:52:04.059601    6275 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Oct 30 19:52:04.059713 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:52:04.059690    6275 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"e644421527c169d876fdb59235c927986d6bd2-9d2815fc-dockercfg-ljvhn\""
Oct 30 19:52:04.060525 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:52:04.060502    6275 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71mmglh"]
Oct 30 19:52:04.167321 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:52:04.167295    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jvqpq\" (UniqueName: \"kubernetes.io/projected/dfeb32cc-eba2-4c83-8331-027cb886a343-kube-api-access-jvqpq\") pod \"e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71mmglh\" (UID: \"dfeb32cc-eba2-4c83-8331-027cb886a343\") " pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71mmglh"
Oct 30 19:52:04.167451 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:52:04.167324    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/dfeb32cc-eba2-4c83-8331-027cb886a343-util\") pod \"e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71mmglh\" (UID: \"dfeb32cc-eba2-4c83-8331-027cb886a343\") " pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71mmglh"
Oct 30 19:52:04.167451 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:52:04.167348    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/dfeb32cc-eba2-4c83-8331-027cb886a343-bundle\") pod \"e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71mmglh\" (UID: \"dfeb32cc-eba2-4c83-8331-027cb886a343\") " pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71mmglh"
Oct 30 19:52:04.268229 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:52:04.268201    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/dfeb32cc-eba2-4c83-8331-027cb886a343-util\") pod \"e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71mmglh\" (UID: \"dfeb32cc-eba2-4c83-8331-027cb886a343\") " pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71mmglh"
Oct 30 19:52:04.268317 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:52:04.268239    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/dfeb32cc-eba2-4c83-8331-027cb886a343-bundle\") pod \"e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71mmglh\" (UID: \"dfeb32cc-eba2-4c83-8331-027cb886a343\") " pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71mmglh"
Oct 30 19:52:04.268317 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:52:04.268292    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jvqpq\" (UniqueName: \"kubernetes.io/projected/dfeb32cc-eba2-4c83-8331-027cb886a343-kube-api-access-jvqpq\") pod \"e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71mmglh\" (UID: \"dfeb32cc-eba2-4c83-8331-027cb886a343\") " pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71mmglh"
Oct 30 19:52:04.268598 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:52:04.268582    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/dfeb32cc-eba2-4c83-8331-027cb886a343-util\") pod \"e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71mmglh\" (UID: \"dfeb32cc-eba2-4c83-8331-027cb886a343\") " pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71mmglh"
Oct 30 19:52:04.268654 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:52:04.268639    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/dfeb32cc-eba2-4c83-8331-027cb886a343-bundle\") pod \"e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71mmglh\" (UID: \"dfeb32cc-eba2-4c83-8331-027cb886a343\") " pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71mmglh"
Oct 30 19:52:04.294471 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:52:04.294405    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jvqpq\" (UniqueName: \"kubernetes.io/projected/dfeb32cc-eba2-4c83-8331-027cb886a343-kube-api-access-jvqpq\") pod \"e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71mmglh\" (UID: \"dfeb32cc-eba2-4c83-8331-027cb886a343\") " pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71mmglh"
Oct 30 19:52:04.342162 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:52:04.342140    6275 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71mmglh"
Oct 30 19:52:04.639949 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:52:04.639808    6275 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71mmglh"]
Oct 30 19:52:04.642385 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:52:04.642360    6275 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddfeb32cc_eba2_4c83_8331_027cb886a343.slice/crio-e9d7804570f67fa904f5765cdbe5be9ab31a0304f37be5db50c04aafe84eed67 WatchSource:0}: Error finding container e9d7804570f67fa904f5765cdbe5be9ab31a0304f37be5db50c04aafe84eed67: Status 404 returned error can't find the container with id e9d7804570f67fa904f5765cdbe5be9ab31a0304f37be5db50c04aafe84eed67
Oct 30 19:52:05.545090 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:52:05.545058    6275 generic.go:356] "Generic (PLEG): container finished" podID="dfeb32cc-eba2-4c83-8331-027cb886a343" containerID="7bf6288bbd79468147e0264b3633997d61c3b6124f54d8d4164f4bf2dba91ff8" exitCode=0
Oct 30 19:52:05.545090 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:52:05.545092    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71mmglh" event={"ID":"dfeb32cc-eba2-4c83-8331-027cb886a343","Type":"ContainerDied","Data":"7bf6288bbd79468147e0264b3633997d61c3b6124f54d8d4164f4bf2dba91ff8"}
Oct 30 19:52:05.545498 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:52:05.545124    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71mmglh" event={"ID":"dfeb32cc-eba2-4c83-8331-027cb886a343","Type":"ContainerStarted","Data":"e9d7804570f67fa904f5765cdbe5be9ab31a0304f37be5db50c04aafe84eed67"}
Oct 30 19:52:06.551288 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:52:06.551246    6275 generic.go:356] "Generic (PLEG): container finished" podID="dfeb32cc-eba2-4c83-8331-027cb886a343" containerID="6aaae33a46352db662d7ea0e32d4f2cc3245d8f7471a5cd2b91067f7aca47743" exitCode=0
Oct 30 19:52:06.551709 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:52:06.551293    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71mmglh" event={"ID":"dfeb32cc-eba2-4c83-8331-027cb886a343","Type":"ContainerDied","Data":"6aaae33a46352db662d7ea0e32d4f2cc3245d8f7471a5cd2b91067f7aca47743"}
Oct 30 19:52:07.557187 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:52:07.557153    6275 generic.go:356] "Generic (PLEG): container finished" podID="dfeb32cc-eba2-4c83-8331-027cb886a343" containerID="61351b3eba19eaaab0608d5575ca6733271a58c1819669e4da7befe4414344ad" exitCode=0
Oct 30 19:52:07.557585 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:52:07.557212    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71mmglh" event={"ID":"dfeb32cc-eba2-4c83-8331-027cb886a343","Type":"ContainerDied","Data":"61351b3eba19eaaab0608d5575ca6733271a58c1819669e4da7befe4414344ad"}
Oct 30 19:52:08.681281 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:52:08.681259    6275 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71mmglh"
Oct 30 19:52:08.800103 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:52:08.800075    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/dfeb32cc-eba2-4c83-8331-027cb886a343-kube-api-access-jvqpq\" (UniqueName: \"kubernetes.io/projected/dfeb32cc-eba2-4c83-8331-027cb886a343-kube-api-access-jvqpq\") pod \"dfeb32cc-eba2-4c83-8331-027cb886a343\" (UID: \"dfeb32cc-eba2-4c83-8331-027cb886a343\") "
Oct 30 19:52:08.800214 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:52:08.800117    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/dfeb32cc-eba2-4c83-8331-027cb886a343-bundle\" (UniqueName: \"kubernetes.io/empty-dir/dfeb32cc-eba2-4c83-8331-027cb886a343-bundle\") pod \"dfeb32cc-eba2-4c83-8331-027cb886a343\" (UID: \"dfeb32cc-eba2-4c83-8331-027cb886a343\") "
Oct 30 19:52:08.800214 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:52:08.800165    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/dfeb32cc-eba2-4c83-8331-027cb886a343-util\" (UniqueName: \"kubernetes.io/empty-dir/dfeb32cc-eba2-4c83-8331-027cb886a343-util\") pod \"dfeb32cc-eba2-4c83-8331-027cb886a343\" (UID: \"dfeb32cc-eba2-4c83-8331-027cb886a343\") "
Oct 30 19:52:08.800714 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:52:08.800689    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dfeb32cc-eba2-4c83-8331-027cb886a343-bundle" pod "dfeb32cc-eba2-4c83-8331-027cb886a343" (UID: "dfeb32cc-eba2-4c83-8331-027cb886a343"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 19:52:08.802093 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:52:08.802068    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dfeb32cc-eba2-4c83-8331-027cb886a343-kube-api-access-jvqpq" pod "dfeb32cc-eba2-4c83-8331-027cb886a343" (UID: "dfeb32cc-eba2-4c83-8331-027cb886a343"). InnerVolumeSpecName "kube-api-access-jvqpq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 19:52:08.805448 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:52:08.805428    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dfeb32cc-eba2-4c83-8331-027cb886a343-util" pod "dfeb32cc-eba2-4c83-8331-027cb886a343" (UID: "dfeb32cc-eba2-4c83-8331-027cb886a343"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 19:52:08.901119 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:52:08.901061    6275 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jvqpq\" (UniqueName: \"kubernetes.io/projected/dfeb32cc-eba2-4c83-8331-027cb886a343-kube-api-access-jvqpq\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 19:52:08.901119 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:52:08.901090    6275 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/dfeb32cc-eba2-4c83-8331-027cb886a343-bundle\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 19:52:08.901119 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:52:08.901100    6275 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/dfeb32cc-eba2-4c83-8331-027cb886a343-util\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 19:52:09.567576 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:52:09.567514    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71mmglh" event={"ID":"dfeb32cc-eba2-4c83-8331-027cb886a343","Type":"ContainerDied","Data":"e9d7804570f67fa904f5765cdbe5be9ab31a0304f37be5db50c04aafe84eed67"}
Oct 30 19:52:09.567809 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:52:09.567596    6275 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e9d7804570f67fa904f5765cdbe5be9ab31a0304f37be5db50c04aafe84eed67"
Oct 30 19:52:09.567809 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:52:09.567555    6275 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71mmglh"
Oct 30 19:52:12.211347 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:52:12.211315    6275 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-77f878f8c6-lrq8x"]
Oct 30 19:52:12.211784 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:52:12.211637    6275 cpu_manager.go:414] "containerMap: removing container" podUID="dfeb32cc-eba2-4c83-8331-027cb886a343" containerName="extract"
Oct 30 19:52:12.211784 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:52:12.211649    6275 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="dfeb32cc-eba2-4c83-8331-027cb886a343" containerName="extract"
Oct 30 19:52:12.211784 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:52:12.211667    6275 cpu_manager.go:414] "containerMap: removing container" podUID="dfeb32cc-eba2-4c83-8331-027cb886a343" containerName="util"
Oct 30 19:52:12.211784 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:52:12.211672    6275 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="dfeb32cc-eba2-4c83-8331-027cb886a343" containerName="util"
Oct 30 19:52:12.211784 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:52:12.211696    6275 cpu_manager.go:414] "containerMap: removing container" podUID="dfeb32cc-eba2-4c83-8331-027cb886a343" containerName="pull"
Oct 30 19:52:12.211784 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:52:12.211701    6275 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="dfeb32cc-eba2-4c83-8331-027cb886a343" containerName="pull"
Oct 30 19:52:12.211784 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:52:12.211753    6275 memory_manager.go:365] "RemoveStaleState removing state" podUID="dfeb32cc-eba2-4c83-8331-027cb886a343" containerName="extract"
Oct 30 19:52:12.214093 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:52:12.214078    6275 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-77f878f8c6-lrq8x"
Oct 30 19:52:12.239973 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:52:12.239948    6275 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-77f878f8c6-lrq8x"]
Oct 30 19:52:12.300153 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:52:12.300134    6275 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Oct 30 19:52:12.300610 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:52:12.300593    6275 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Oct 30 19:52:12.300689 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:52:12.300666    6275 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Oct 30 19:52:12.300772 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:52:12.300760    6275 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-74w9p\""
Oct 30 19:52:12.324563 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:52:12.324541    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/fadf5c51-ea22-4370-8bdc-96801f7bfc4a-metrics-cert\") pod \"lws-controller-manager-77f878f8c6-lrq8x\" (UID: \"fadf5c51-ea22-4370-8bdc-96801f7bfc4a\") " pod="openshift-lws-operator/lws-controller-manager-77f878f8c6-lrq8x"
Oct 30 19:52:12.324628 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:52:12.324588    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/fadf5c51-ea22-4370-8bdc-96801f7bfc4a-manager-config\") pod \"lws-controller-manager-77f878f8c6-lrq8x\" (UID: \"fadf5c51-ea22-4370-8bdc-96801f7bfc4a\") " pod="openshift-lws-operator/lws-controller-manager-77f878f8c6-lrq8x"
Oct 30 19:52:12.324628 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:52:12.324608    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lmzl4\" (UniqueName: \"kubernetes.io/projected/fadf5c51-ea22-4370-8bdc-96801f7bfc4a-kube-api-access-lmzl4\") pod \"lws-controller-manager-77f878f8c6-lrq8x\" (UID: \"fadf5c51-ea22-4370-8bdc-96801f7bfc4a\") " pod="openshift-lws-operator/lws-controller-manager-77f878f8c6-lrq8x"
Oct 30 19:52:12.324751 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:52:12.324733    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fadf5c51-ea22-4370-8bdc-96801f7bfc4a-cert\") pod \"lws-controller-manager-77f878f8c6-lrq8x\" (UID: \"fadf5c51-ea22-4370-8bdc-96801f7bfc4a\") " pod="openshift-lws-operator/lws-controller-manager-77f878f8c6-lrq8x"
Oct 30 19:52:12.426098 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:52:12.426077    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/fadf5c51-ea22-4370-8bdc-96801f7bfc4a-metrics-cert\") pod \"lws-controller-manager-77f878f8c6-lrq8x\" (UID: \"fadf5c51-ea22-4370-8bdc-96801f7bfc4a\") " pod="openshift-lws-operator/lws-controller-manager-77f878f8c6-lrq8x"
Oct 30 19:52:12.426200 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:52:12.426112    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/fadf5c51-ea22-4370-8bdc-96801f7bfc4a-manager-config\") pod \"lws-controller-manager-77f878f8c6-lrq8x\" (UID: \"fadf5c51-ea22-4370-8bdc-96801f7bfc4a\") " pod="openshift-lws-operator/lws-controller-manager-77f878f8c6-lrq8x"
Oct 30 19:52:12.426200 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:52:12.426133    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lmzl4\" (UniqueName: \"kubernetes.io/projected/fadf5c51-ea22-4370-8bdc-96801f7bfc4a-kube-api-access-lmzl4\") pod \"lws-controller-manager-77f878f8c6-lrq8x\" (UID: \"fadf5c51-ea22-4370-8bdc-96801f7bfc4a\") " pod="openshift-lws-operator/lws-controller-manager-77f878f8c6-lrq8x"
Oct 30 19:52:12.426200 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:52:12.426155    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fadf5c51-ea22-4370-8bdc-96801f7bfc4a-cert\") pod \"lws-controller-manager-77f878f8c6-lrq8x\" (UID: \"fadf5c51-ea22-4370-8bdc-96801f7bfc4a\") " pod="openshift-lws-operator/lws-controller-manager-77f878f8c6-lrq8x"
Oct 30 19:52:12.426841 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:52:12.426824    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/fadf5c51-ea22-4370-8bdc-96801f7bfc4a-manager-config\") pod \"lws-controller-manager-77f878f8c6-lrq8x\" (UID: \"fadf5c51-ea22-4370-8bdc-96801f7bfc4a\") " pod="openshift-lws-operator/lws-controller-manager-77f878f8c6-lrq8x"
Oct 30 19:52:12.428682 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:52:12.428659    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fadf5c51-ea22-4370-8bdc-96801f7bfc4a-cert\") pod \"lws-controller-manager-77f878f8c6-lrq8x\" (UID: \"fadf5c51-ea22-4370-8bdc-96801f7bfc4a\") " pod="openshift-lws-operator/lws-controller-manager-77f878f8c6-lrq8x"
Oct 30 19:52:12.428682 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:52:12.428672    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/fadf5c51-ea22-4370-8bdc-96801f7bfc4a-metrics-cert\") pod \"lws-controller-manager-77f878f8c6-lrq8x\" (UID: \"fadf5c51-ea22-4370-8bdc-96801f7bfc4a\") " pod="openshift-lws-operator/lws-controller-manager-77f878f8c6-lrq8x"
Oct 30 19:52:12.451871 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:52:12.451846    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lmzl4\" (UniqueName: \"kubernetes.io/projected/fadf5c51-ea22-4370-8bdc-96801f7bfc4a-kube-api-access-lmzl4\") pod \"lws-controller-manager-77f878f8c6-lrq8x\" (UID: \"fadf5c51-ea22-4370-8bdc-96801f7bfc4a\") " pod="openshift-lws-operator/lws-controller-manager-77f878f8c6-lrq8x"
Oct 30 19:52:12.524707 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:52:12.524686    6275 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-77f878f8c6-lrq8x"
Oct 30 19:52:12.824743 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:52:12.824715    6275 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfadf5c51_ea22_4370_8bdc_96801f7bfc4a.slice/crio-6c6f5a653e4688e9839b877773bbafed0d2d67ba7597701efd7a48eb952f8b0c WatchSource:0}: Error finding container 6c6f5a653e4688e9839b877773bbafed0d2d67ba7597701efd7a48eb952f8b0c: Status 404 returned error can't find the container with id 6c6f5a653e4688e9839b877773bbafed0d2d67ba7597701efd7a48eb952f8b0c
Oct 30 19:52:12.824875 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:52:12.824830    6275 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-77f878f8c6-lrq8x"]
Oct 30 19:52:13.586091 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:52:13.586059    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-77f878f8c6-lrq8x" event={"ID":"fadf5c51-ea22-4370-8bdc-96801f7bfc4a","Type":"ContainerStarted","Data":"6c6f5a653e4688e9839b877773bbafed0d2d67ba7597701efd7a48eb952f8b0c"}
Oct 30 19:52:14.594068 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:52:14.594022    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-77f878f8c6-lrq8x" event={"ID":"fadf5c51-ea22-4370-8bdc-96801f7bfc4a","Type":"ContainerStarted","Data":"5ae0eac0112e791ed34ab8fcbf6e86e434f7ab62ce56132168fe0237f9755c10"}
Oct 30 19:52:14.594552 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:52:14.594115    6275 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-77f878f8c6-lrq8x"
Oct 30 19:52:14.640554 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:52:14.640507    6275 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-77f878f8c6-lrq8x" podStartSLOduration=1.051555792 podStartE2EDuration="2.640491397s" totalImagesPullingTime="1.588935605s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 19:52:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 19:52:14.63928263 +0000 UTC m=+245.101009493" watchObservedRunningTime="2026-10-30 19:52:14.640491397 +0000 UTC m=+245.102218261"
Oct 30 19:52:15.409944 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:52:15.409908    6275 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6f6c7b487f-9wrps"]
Oct 30 19:52:15.412501 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:52:15.412479    6275 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6f6c7b487f-9wrps"
Oct 30 19:52:15.442941 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:52:15.442915    6275 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6f6c7b487f-9wrps"]
Oct 30 19:52:15.467771 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:52:15.467747    6275 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Oct 30 19:52:15.468065 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:52:15.468049    6275 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Oct 30 19:52:15.468382 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:52:15.468368    6275 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-4r48g\""
Oct 30 19:52:15.468382 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:52:15.468370    6275 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-metrics-tls\""
Oct 30 19:52:15.469090 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:52:15.469079    6275 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Oct 30 19:52:15.469144 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:52:15.469135    6275 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Oct 30 19:52:15.548356 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:52:15.548324    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/e79d3c32-fbe3-4b67-8772-de5e85f5451f-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6f6c7b487f-9wrps\" (UID: \"e79d3c32-fbe3-4b67-8772-de5e85f5451f\") " pod="opendatahub/opendatahub-operator-controller-manager-6f6c7b487f-9wrps"
Oct 30 19:52:15.548506 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:52:15.548410    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/e79d3c32-fbe3-4b67-8772-de5e85f5451f-metrics-cert\") pod \"opendatahub-operator-controller-manager-6f6c7b487f-9wrps\" (UID: \"e79d3c32-fbe3-4b67-8772-de5e85f5451f\") " pod="opendatahub/opendatahub-operator-controller-manager-6f6c7b487f-9wrps"
Oct 30 19:52:15.548506 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:52:15.548481    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/e79d3c32-fbe3-4b67-8772-de5e85f5451f-manifests\") pod \"opendatahub-operator-controller-manager-6f6c7b487f-9wrps\" (UID: \"e79d3c32-fbe3-4b67-8772-de5e85f5451f\") " pod="opendatahub/opendatahub-operator-controller-manager-6f6c7b487f-9wrps"
Oct 30 19:52:15.548617 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:52:15.548515    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jkgts\" (UniqueName: \"kubernetes.io/projected/e79d3c32-fbe3-4b67-8772-de5e85f5451f-kube-api-access-jkgts\") pod \"opendatahub-operator-controller-manager-6f6c7b487f-9wrps\" (UID: \"e79d3c32-fbe3-4b67-8772-de5e85f5451f\") " pod="opendatahub/opendatahub-operator-controller-manager-6f6c7b487f-9wrps"
Oct 30 19:52:15.548617 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:52:15.548551    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e79d3c32-fbe3-4b67-8772-de5e85f5451f-webhook-cert\") pod \"opendatahub-operator-controller-manager-6f6c7b487f-9wrps\" (UID: \"e79d3c32-fbe3-4b67-8772-de5e85f5451f\") " pod="opendatahub/opendatahub-operator-controller-manager-6f6c7b487f-9wrps"
Oct 30 19:52:15.548617 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:52:15.548606    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e79d3c32-fbe3-4b67-8772-de5e85f5451f-tmp\") pod \"opendatahub-operator-controller-manager-6f6c7b487f-9wrps\" (UID: \"e79d3c32-fbe3-4b67-8772-de5e85f5451f\") " pod="opendatahub/opendatahub-operator-controller-manager-6f6c7b487f-9wrps"
Oct 30 19:52:15.648889 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:52:15.648860    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/e79d3c32-fbe3-4b67-8772-de5e85f5451f-manifests\") pod \"opendatahub-operator-controller-manager-6f6c7b487f-9wrps\" (UID: \"e79d3c32-fbe3-4b67-8772-de5e85f5451f\") " pod="opendatahub/opendatahub-operator-controller-manager-6f6c7b487f-9wrps"
Oct 30 19:52:15.648889 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:52:15.648892    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jkgts\" (UniqueName: \"kubernetes.io/projected/e79d3c32-fbe3-4b67-8772-de5e85f5451f-kube-api-access-jkgts\") pod \"opendatahub-operator-controller-manager-6f6c7b487f-9wrps\" (UID: \"e79d3c32-fbe3-4b67-8772-de5e85f5451f\") " pod="opendatahub/opendatahub-operator-controller-manager-6f6c7b487f-9wrps"
Oct 30 19:52:15.649366 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:52:15.648909    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e79d3c32-fbe3-4b67-8772-de5e85f5451f-webhook-cert\") pod \"opendatahub-operator-controller-manager-6f6c7b487f-9wrps\" (UID: \"e79d3c32-fbe3-4b67-8772-de5e85f5451f\") " pod="opendatahub/opendatahub-operator-controller-manager-6f6c7b487f-9wrps"
Oct 30 19:52:15.649366 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:52:15.648936    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e79d3c32-fbe3-4b67-8772-de5e85f5451f-tmp\") pod \"opendatahub-operator-controller-manager-6f6c7b487f-9wrps\" (UID: \"e79d3c32-fbe3-4b67-8772-de5e85f5451f\") " pod="opendatahub/opendatahub-operator-controller-manager-6f6c7b487f-9wrps"
Oct 30 19:52:15.649366 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:52:15.648978    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/e79d3c32-fbe3-4b67-8772-de5e85f5451f-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6f6c7b487f-9wrps\" (UID: \"e79d3c32-fbe3-4b67-8772-de5e85f5451f\") " pod="opendatahub/opendatahub-operator-controller-manager-6f6c7b487f-9wrps"
Oct 30 19:52:15.649366 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:52:15.649017    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/e79d3c32-fbe3-4b67-8772-de5e85f5451f-metrics-cert\") pod \"opendatahub-operator-controller-manager-6f6c7b487f-9wrps\" (UID: \"e79d3c32-fbe3-4b67-8772-de5e85f5451f\") " pod="opendatahub/opendatahub-operator-controller-manager-6f6c7b487f-9wrps"
Oct 30 19:52:15.649366 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:52:15.649333    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/e79d3c32-fbe3-4b67-8772-de5e85f5451f-manifests\") pod \"opendatahub-operator-controller-manager-6f6c7b487f-9wrps\" (UID: \"e79d3c32-fbe3-4b67-8772-de5e85f5451f\") " pod="opendatahub/opendatahub-operator-controller-manager-6f6c7b487f-9wrps"
Oct 30 19:52:15.651213 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:52:15.651190    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e79d3c32-fbe3-4b67-8772-de5e85f5451f-tmp\") pod \"opendatahub-operator-controller-manager-6f6c7b487f-9wrps\" (UID: \"e79d3c32-fbe3-4b67-8772-de5e85f5451f\") " pod="opendatahub/opendatahub-operator-controller-manager-6f6c7b487f-9wrps"
Oct 30 19:52:15.651909 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:52:15.651883    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/e79d3c32-fbe3-4b67-8772-de5e85f5451f-metrics-cert\") pod \"opendatahub-operator-controller-manager-6f6c7b487f-9wrps\" (UID: \"e79d3c32-fbe3-4b67-8772-de5e85f5451f\") " pod="opendatahub/opendatahub-operator-controller-manager-6f6c7b487f-9wrps"
Oct 30 19:52:15.652009 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:52:15.651885    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e79d3c32-fbe3-4b67-8772-de5e85f5451f-webhook-cert\") pod \"opendatahub-operator-controller-manager-6f6c7b487f-9wrps\" (UID: \"e79d3c32-fbe3-4b67-8772-de5e85f5451f\") " pod="opendatahub/opendatahub-operator-controller-manager-6f6c7b487f-9wrps"
Oct 30 19:52:15.652009 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:52:15.651885    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/e79d3c32-fbe3-4b67-8772-de5e85f5451f-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6f6c7b487f-9wrps\" (UID: \"e79d3c32-fbe3-4b67-8772-de5e85f5451f\") " pod="opendatahub/opendatahub-operator-controller-manager-6f6c7b487f-9wrps"
Oct 30 19:52:15.675597 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:52:15.675552    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jkgts\" (UniqueName: \"kubernetes.io/projected/e79d3c32-fbe3-4b67-8772-de5e85f5451f-kube-api-access-jkgts\") pod \"opendatahub-operator-controller-manager-6f6c7b487f-9wrps\" (UID: \"e79d3c32-fbe3-4b67-8772-de5e85f5451f\") " pod="opendatahub/opendatahub-operator-controller-manager-6f6c7b487f-9wrps"
Oct 30 19:52:15.725361 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:52:15.725339    6275 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6f6c7b487f-9wrps"
Oct 30 19:52:16.085870 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:52:16.085848    6275 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6f6c7b487f-9wrps"]
Oct 30 19:52:16.087291 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:52:16.087265    6275 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode79d3c32_fbe3_4b67_8772_de5e85f5451f.slice/crio-95fbaaf5e5627e6f483e6be06bf4de0884408ce14c3ec1fb9910b78a6417aeba WatchSource:0}: Error finding container 95fbaaf5e5627e6f483e6be06bf4de0884408ce14c3ec1fb9910b78a6417aeba: Status 404 returned error can't find the container with id 95fbaaf5e5627e6f483e6be06bf4de0884408ce14c3ec1fb9910b78a6417aeba
Oct 30 19:52:16.606103 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:52:16.606063    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6f6c7b487f-9wrps" event={"ID":"e79d3c32-fbe3-4b67-8772-de5e85f5451f","Type":"ContainerStarted","Data":"95fbaaf5e5627e6f483e6be06bf4de0884408ce14c3ec1fb9910b78a6417aeba"}
Oct 30 19:52:19.622334 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:52:19.622258    6275 generic.go:356] "Generic (PLEG): container finished" podID="e79d3c32-fbe3-4b67-8772-de5e85f5451f" containerID="1db9f29afa249fab791d80605b2e6db6aa1ca5a189a56f47323234d72af40b3c" exitCode=0
Oct 30 19:52:19.622334 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:52:19.622328    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6f6c7b487f-9wrps" event={"ID":"e79d3c32-fbe3-4b67-8772-de5e85f5451f","Type":"ContainerDied","Data":"1db9f29afa249fab791d80605b2e6db6aa1ca5a189a56f47323234d72af40b3c"}
Oct 30 19:52:20.628319 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:52:20.628279    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6f6c7b487f-9wrps" event={"ID":"e79d3c32-fbe3-4b67-8772-de5e85f5451f","Type":"ContainerStarted","Data":"ccd2405421dcd2d7e97cec2cff7632a763394f5b90ee34e743cb378f03e1e862"}
Oct 30 19:52:20.628682 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:52:20.628406    6275 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-6f6c7b487f-9wrps"
Oct 30 19:52:20.722153 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:52:20.722114    6275 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-6f6c7b487f-9wrps" podStartSLOduration=2.152634531 podStartE2EDuration="5.72210323s" totalImagesPullingTime="3.07555472s" totalInitContainerRuntime="493.913979ms" isStatefulPod=false podCreationTimestamp="2026-10-30 19:52:15 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 19:52:20.708876005 +0000 UTC m=+251.170602865" watchObservedRunningTime="2026-10-30 19:52:20.72210323 +0000 UTC m=+251.183830092"
Oct 30 19:52:25.601056 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:52:25.601027    6275 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-77f878f8c6-lrq8x"
Oct 30 19:52:26.254645 ip-10-0-131-26 kubenswrapper[6275]: E1030 19:52:26.254606    6275 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-fwc77" containerName="extractor"
Oct 30 19:52:30.668803 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:52:30.668776    6275 generic.go:356] "Generic (PLEG): container finished" podID="e79d3c32-fbe3-4b67-8772-de5e85f5451f" containerID="ccd2405421dcd2d7e97cec2cff7632a763394f5b90ee34e743cb378f03e1e862" exitCode=1
Oct 30 19:52:30.669196 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:52:30.668857    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6f6c7b487f-9wrps" event={"ID":"e79d3c32-fbe3-4b67-8772-de5e85f5451f","Type":"ContainerDied","Data":"ccd2405421dcd2d7e97cec2cff7632a763394f5b90ee34e743cb378f03e1e862"}
Oct 30 19:52:30.669236 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:52:30.669192    6275 scope.go:122] "RemoveContainer" containerID="ccd2405421dcd2d7e97cec2cff7632a763394f5b90ee34e743cb378f03e1e862"
Oct 30 19:52:31.674940 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:52:31.674901    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6f6c7b487f-9wrps" event={"ID":"e79d3c32-fbe3-4b67-8772-de5e85f5451f","Type":"ContainerStarted","Data":"0f5905deff99e3b266e9cb0db6f712e4ba944dd77f1d12cdf1dc4f51ddfa5acc"}
Oct 30 19:52:31.675306 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:52:31.675182    6275 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-6f6c7b487f-9wrps"
Oct 30 19:52:42.682080 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:52:42.682049    6275 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-6f6c7b487f-9wrps"
Oct 30 19:52:56.254552 ip-10-0-131-26 kubenswrapper[6275]: E1030 19:52:56.254515    6275 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-fwc77" containerName="extractor"
Oct 30 19:52:59.531422 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:52:59.531391    6275 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/odh-observability-584f99c788-rzhh7"]
Oct 30 19:52:59.533709 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:52:59.533693    6275 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-observability-584f99c788-rzhh7"
Oct 30 19:52:59.560360 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:52:59.560335    6275 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-observability-dockercfg-rqkbd\""
Oct 30 19:52:59.573259 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:52:59.573239    6275 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-observability-webhook-cert\""
Oct 30 19:52:59.574540 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:52:59.574522    6275 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-observability-584f99c788-rzhh7"]
Oct 30 19:52:59.646686 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:52:59.646656    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xrjgz\" (UniqueName: \"kubernetes.io/projected/e79579e3-262a-48af-b264-b1fbb2268025-kube-api-access-xrjgz\") pod \"odh-observability-584f99c788-rzhh7\" (UID: \"e79579e3-262a-48af-b264-b1fbb2268025\") " pod="opendatahub/odh-observability-584f99c788-rzhh7"
Oct 30 19:52:59.646796 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:52:59.646720    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-certs\" (UniqueName: \"kubernetes.io/secret/e79579e3-262a-48af-b264-b1fbb2268025-webhook-certs\") pod \"odh-observability-584f99c788-rzhh7\" (UID: \"e79579e3-262a-48af-b264-b1fbb2268025\") " pod="opendatahub/odh-observability-584f99c788-rzhh7"
Oct 30 19:52:59.748037 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:52:59.748003    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xrjgz\" (UniqueName: \"kubernetes.io/projected/e79579e3-262a-48af-b264-b1fbb2268025-kube-api-access-xrjgz\") pod \"odh-observability-584f99c788-rzhh7\" (UID: \"e79579e3-262a-48af-b264-b1fbb2268025\") " pod="opendatahub/odh-observability-584f99c788-rzhh7"
Oct 30 19:52:59.748202 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:52:59.748079    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-certs\" (UniqueName: \"kubernetes.io/secret/e79579e3-262a-48af-b264-b1fbb2268025-webhook-certs\") pod \"odh-observability-584f99c788-rzhh7\" (UID: \"e79579e3-262a-48af-b264-b1fbb2268025\") " pod="opendatahub/odh-observability-584f99c788-rzhh7"
Oct 30 19:52:59.748280 ip-10-0-131-26 kubenswrapper[6275]: E1030 19:52:59.748252    6275 secret.go:189] Couldn't get secret opendatahub/odh-observability-webhook-cert: secret "odh-observability-webhook-cert" not found
Oct 30 19:52:59.748341 ip-10-0-131-26 kubenswrapper[6275]: E1030 19:52:59.748330    6275 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e79579e3-262a-48af-b264-b1fbb2268025-webhook-certs podName:e79579e3-262a-48af-b264-b1fbb2268025 nodeName:}" failed. No retries permitted until 2026-10-30 19:53:00.24830979 +0000 UTC m=+290.710036647 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-certs" (UniqueName: "kubernetes.io/secret/e79579e3-262a-48af-b264-b1fbb2268025-webhook-certs") pod "odh-observability-584f99c788-rzhh7" (UID: "e79579e3-262a-48af-b264-b1fbb2268025") : secret "odh-observability-webhook-cert" not found
Oct 30 19:52:59.776476 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:52:59.776452    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xrjgz\" (UniqueName: \"kubernetes.io/projected/e79579e3-262a-48af-b264-b1fbb2268025-kube-api-access-xrjgz\") pod \"odh-observability-584f99c788-rzhh7\" (UID: \"e79579e3-262a-48af-b264-b1fbb2268025\") " pod="opendatahub/odh-observability-584f99c788-rzhh7"
Oct 30 19:53:00.251131 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:53:00.251100    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-certs\" (UniqueName: \"kubernetes.io/secret/e79579e3-262a-48af-b264-b1fbb2268025-webhook-certs\") pod \"odh-observability-584f99c788-rzhh7\" (UID: \"e79579e3-262a-48af-b264-b1fbb2268025\") " pod="opendatahub/odh-observability-584f99c788-rzhh7"
Oct 30 19:53:00.253442 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:53:00.253384    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-certs\" (UniqueName: \"kubernetes.io/secret/e79579e3-262a-48af-b264-b1fbb2268025-webhook-certs\") pod \"odh-observability-584f99c788-rzhh7\" (UID: \"e79579e3-262a-48af-b264-b1fbb2268025\") " pod="opendatahub/odh-observability-584f99c788-rzhh7"
Oct 30 19:53:00.444682 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:53:00.444656    6275 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-observability-584f99c788-rzhh7"
Oct 30 19:53:00.759443 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:53:00.759364    6275 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-observability-584f99c788-rzhh7"]
Oct 30 19:53:00.762213 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:53:00.762185    6275 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode79579e3_262a_48af_b264_b1fbb2268025.slice/crio-4a67d1982c16ac48523f2f75c4efe492ace955cf4863b2e0cb15184893bb1ae3 WatchSource:0}: Error finding container 4a67d1982c16ac48523f2f75c4efe492ace955cf4863b2e0cb15184893bb1ae3: Status 404 returned error can't find the container with id 4a67d1982c16ac48523f2f75c4efe492ace955cf4863b2e0cb15184893bb1ae3
Oct 30 19:53:00.790940 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:53:00.790908    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-observability-584f99c788-rzhh7" event={"ID":"e79579e3-262a-48af-b264-b1fbb2268025","Type":"ContainerStarted","Data":"4a67d1982c16ac48523f2f75c4efe492ace955cf4863b2e0cb15184893bb1ae3"}
Oct 30 19:53:03.805739 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:53:03.805698    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-observability-584f99c788-rzhh7" event={"ID":"e79579e3-262a-48af-b264-b1fbb2268025","Type":"ContainerStarted","Data":"821f07493b04ef73496712b7461bd0663b85027f1d7c41902055981c4b1dbaca"}
Oct 30 19:53:03.806145 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:53:03.805815    6275 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-observability-584f99c788-rzhh7"
Oct 30 19:53:03.850580 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:53:03.850531    6275 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/odh-observability-584f99c788-rzhh7" podStartSLOduration=2.508005517 podStartE2EDuration="4.850518164s" totalImagesPullingTime="2.342512647s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 19:52:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 19:53:03.849765369 +0000 UTC m=+294.311492233" watchObservedRunningTime="2026-10-30 19:53:03.850518164 +0000 UTC m=+294.312245027"
Oct 30 19:53:14.812340 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:53:14.812307    6275 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-observability-584f99c788-rzhh7"
Oct 30 19:53:23.525566 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:53:23.525523    6275 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-module-controller-manager-5cfb77bf8c-d7bt4"]
Oct 30 19:53:23.528836 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:53:23.528813    6275 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-module-controller-manager-5cfb77bf8c-d7bt4"
Oct 30 19:53:23.586057 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:53:23.586021    6275 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-module-controller-manager-dockercfg-zq24v\""
Oct 30 19:53:23.586057 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:53:23.586054    6275 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"odh-trusted-ca-bundle\""
Oct 30 19:53:23.587376 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:53:23.587357    6275 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-module-controller-manager-5cfb77bf8c-d7bt4"]
Oct 30 19:53:23.642131 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:53:23.642091    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l8w7q\" (UniqueName: \"kubernetes.io/projected/a8ef00a1-8bb4-4fb2-b361-32260131472e-kube-api-access-l8w7q\") pod \"kserve-module-controller-manager-5cfb77bf8c-d7bt4\" (UID: \"a8ef00a1-8bb4-4fb2-b361-32260131472e\") " pod="opendatahub/kserve-module-controller-manager-5cfb77bf8c-d7bt4"
Oct 30 19:53:23.642282 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:53:23.642167    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a8ef00a1-8bb4-4fb2-b361-32260131472e-trusted-ca\") pod \"kserve-module-controller-manager-5cfb77bf8c-d7bt4\" (UID: \"a8ef00a1-8bb4-4fb2-b361-32260131472e\") " pod="opendatahub/kserve-module-controller-manager-5cfb77bf8c-d7bt4"
Oct 30 19:53:23.642282 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:53:23.642258    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/a8ef00a1-8bb4-4fb2-b361-32260131472e-manifests\") pod \"kserve-module-controller-manager-5cfb77bf8c-d7bt4\" (UID: \"a8ef00a1-8bb4-4fb2-b361-32260131472e\") " pod="opendatahub/kserve-module-controller-manager-5cfb77bf8c-d7bt4"
Oct 30 19:53:23.642356 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:53:23.642278    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a8ef00a1-8bb4-4fb2-b361-32260131472e-tmp\") pod \"kserve-module-controller-manager-5cfb77bf8c-d7bt4\" (UID: \"a8ef00a1-8bb4-4fb2-b361-32260131472e\") " pod="opendatahub/kserve-module-controller-manager-5cfb77bf8c-d7bt4"
Oct 30 19:53:23.742810 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:53:23.742776    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l8w7q\" (UniqueName: \"kubernetes.io/projected/a8ef00a1-8bb4-4fb2-b361-32260131472e-kube-api-access-l8w7q\") pod \"kserve-module-controller-manager-5cfb77bf8c-d7bt4\" (UID: \"a8ef00a1-8bb4-4fb2-b361-32260131472e\") " pod="opendatahub/kserve-module-controller-manager-5cfb77bf8c-d7bt4"
Oct 30 19:53:23.742994 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:53:23.742833    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a8ef00a1-8bb4-4fb2-b361-32260131472e-trusted-ca\") pod \"kserve-module-controller-manager-5cfb77bf8c-d7bt4\" (UID: \"a8ef00a1-8bb4-4fb2-b361-32260131472e\") " pod="opendatahub/kserve-module-controller-manager-5cfb77bf8c-d7bt4"
Oct 30 19:53:23.742994 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:53:23.742863    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/a8ef00a1-8bb4-4fb2-b361-32260131472e-manifests\") pod \"kserve-module-controller-manager-5cfb77bf8c-d7bt4\" (UID: \"a8ef00a1-8bb4-4fb2-b361-32260131472e\") " pod="opendatahub/kserve-module-controller-manager-5cfb77bf8c-d7bt4"
Oct 30 19:53:23.742994 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:53:23.742878    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a8ef00a1-8bb4-4fb2-b361-32260131472e-tmp\") pod \"kserve-module-controller-manager-5cfb77bf8c-d7bt4\" (UID: \"a8ef00a1-8bb4-4fb2-b361-32260131472e\") " pod="opendatahub/kserve-module-controller-manager-5cfb77bf8c-d7bt4"
Oct 30 19:53:23.747439 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:53:23.743673    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a8ef00a1-8bb4-4fb2-b361-32260131472e-tmp\") pod \"kserve-module-controller-manager-5cfb77bf8c-d7bt4\" (UID: \"a8ef00a1-8bb4-4fb2-b361-32260131472e\") " pod="opendatahub/kserve-module-controller-manager-5cfb77bf8c-d7bt4"
Oct 30 19:53:23.747439 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:53:23.743705    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/a8ef00a1-8bb4-4fb2-b361-32260131472e-manifests\") pod \"kserve-module-controller-manager-5cfb77bf8c-d7bt4\" (UID: \"a8ef00a1-8bb4-4fb2-b361-32260131472e\") " pod="opendatahub/kserve-module-controller-manager-5cfb77bf8c-d7bt4"
Oct 30 19:53:23.747439 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:53:23.744643    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a8ef00a1-8bb4-4fb2-b361-32260131472e-trusted-ca\") pod \"kserve-module-controller-manager-5cfb77bf8c-d7bt4\" (UID: \"a8ef00a1-8bb4-4fb2-b361-32260131472e\") " pod="opendatahub/kserve-module-controller-manager-5cfb77bf8c-d7bt4"
Oct 30 19:53:23.769241 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:53:23.769215    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l8w7q\" (UniqueName: \"kubernetes.io/projected/a8ef00a1-8bb4-4fb2-b361-32260131472e-kube-api-access-l8w7q\") pod \"kserve-module-controller-manager-5cfb77bf8c-d7bt4\" (UID: \"a8ef00a1-8bb4-4fb2-b361-32260131472e\") " pod="opendatahub/kserve-module-controller-manager-5cfb77bf8c-d7bt4"
Oct 30 19:53:23.841514 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:53:23.841437    6275 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-module-controller-manager-5cfb77bf8c-d7bt4"
Oct 30 19:53:24.160154 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:53:24.160127    6275 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-module-controller-manager-5cfb77bf8c-d7bt4"]
Oct 30 19:53:24.163051 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:53:24.163021    6275 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda8ef00a1_8bb4_4fb2_b361_32260131472e.slice/crio-d2f134cc8ac085fca655743850c3e283ec81f734394d643c89031db5aaf174b6 WatchSource:0}: Error finding container d2f134cc8ac085fca655743850c3e283ec81f734394d643c89031db5aaf174b6: Status 404 returned error can't find the container with id d2f134cc8ac085fca655743850c3e283ec81f734394d643c89031db5aaf174b6
Oct 30 19:53:24.899286 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:53:24.899244    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-module-controller-manager-5cfb77bf8c-d7bt4" event={"ID":"a8ef00a1-8bb4-4fb2-b361-32260131472e","Type":"ContainerStarted","Data":"d2f134cc8ac085fca655743850c3e283ec81f734394d643c89031db5aaf174b6"}
Oct 30 19:53:26.257216 ip-10-0-131-26 kubenswrapper[6275]: E1030 19:53:26.257155    6275 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-fwc77" containerName="extractor"
Oct 30 19:53:26.909510 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:53:26.909401    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-module-controller-manager-5cfb77bf8c-d7bt4" event={"ID":"a8ef00a1-8bb4-4fb2-b361-32260131472e","Type":"ContainerStarted","Data":"345abb828f4336ba32c85b5b00eafb8d2dd6eae8eeb539fd4f49e5e12802cc59"}
Oct 30 19:53:26.909510 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:53:26.909489    6275 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-module-controller-manager-5cfb77bf8c-d7bt4"
Oct 30 19:53:26.971703 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:53:26.971656    6275 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/kserve-module-controller-manager-5cfb77bf8c-d7bt4" podStartSLOduration=1.6524977889999999 podStartE2EDuration="3.971642551s" totalImagesPullingTime="2.319144762s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 19:53:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 19:53:26.971018389 +0000 UTC m=+317.432745252" watchObservedRunningTime="2026-10-30 19:53:26.971642551 +0000 UTC m=+317.433369413"
Oct 30 19:53:47.915815 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:53:47.915779    6275 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-module-controller-manager-5cfb77bf8c-d7bt4"
Oct 30 19:53:56.254292 ip-10-0-131-26 kubenswrapper[6275]: E1030 19:53:56.254257    6275 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-fwc77" containerName="extractor"
Oct 30 19:54:12.186542 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:54:12.186514    6275 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-776cc66d47-bl2tv"]
Oct 30 19:54:12.197037 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:54:12.197011    6275 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-776cc66d47-bl2tv"
Oct 30 19:54:12.211396 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:54:12.211374    6275 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-869d5dcc5d-4m9v9"]
Oct 30 19:54:12.214711 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:54:12.214695    6275 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-4m9v9"
Oct 30 19:54:12.224636 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:54:12.224616    6275 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-4klb6\""
Oct 30 19:54:12.224717 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:54:12.224620    6275 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Oct 30 19:54:12.245129 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:54:12.245104    6275 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-776cc66d47-bl2tv"]
Oct 30 19:54:12.246138 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:54:12.246113    6275 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-869d5dcc5d-4m9v9"]
Oct 30 19:54:12.317287 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:54:12.317260    6275 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-75bd89fdfc-8284h"]
Oct 30 19:54:12.322299 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:54:12.322271    6275 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-75bd89fdfc-8284h"
Oct 30 19:54:12.323174 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:54:12.323141    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/42142d9b-b2be-44a2-9226-9d62b9a5487f-cert\") pod \"llmisvc-controller-manager-869d5dcc5d-4m9v9\" (UID: \"42142d9b-b2be-44a2-9226-9d62b9a5487f\") " pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-4m9v9"
Oct 30 19:54:12.323271 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:54:12.323190    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kg96m\" (UniqueName: \"kubernetes.io/projected/42142d9b-b2be-44a2-9226-9d62b9a5487f-kube-api-access-kg96m\") pod \"llmisvc-controller-manager-869d5dcc5d-4m9v9\" (UID: \"42142d9b-b2be-44a2-9226-9d62b9a5487f\") " pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-4m9v9"
Oct 30 19:54:12.323350 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:54:12.323284    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b42eee11-4948-4d80-87c8-5343d07a0c5a-cert\") pod \"kserve-controller-manager-776cc66d47-bl2tv\" (UID: \"b42eee11-4948-4d80-87c8-5343d07a0c5a\") " pod="opendatahub/kserve-controller-manager-776cc66d47-bl2tv"
Oct 30 19:54:12.323350 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:54:12.323311    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q5mzg\" (UniqueName: \"kubernetes.io/projected/b42eee11-4948-4d80-87c8-5343d07a0c5a-kube-api-access-q5mzg\") pod \"kserve-controller-manager-776cc66d47-bl2tv\" (UID: \"b42eee11-4948-4d80-87c8-5343d07a0c5a\") " pod="opendatahub/kserve-controller-manager-776cc66d47-bl2tv"
Oct 30 19:54:12.328694 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:54:12.328674    6275 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\""
Oct 30 19:54:12.328795 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:54:12.328728    6275 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-csw8f\""
Oct 30 19:54:12.340837 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:54:12.340820    6275 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-z8rwb\""
Oct 30 19:54:12.367552 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:54:12.367529    6275 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-75bd89fdfc-8284h"]
Oct 30 19:54:12.423620 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:54:12.423600    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9269c7aa-930c-4a33-a2e6-157e1d617757-tls-certs\") pod \"model-serving-api-75bd89fdfc-8284h\" (UID: \"9269c7aa-930c-4a33-a2e6-157e1d617757\") " pod="opendatahub/model-serving-api-75bd89fdfc-8284h"
Oct 30 19:54:12.423731 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:54:12.423630    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/42142d9b-b2be-44a2-9226-9d62b9a5487f-cert\") pod \"llmisvc-controller-manager-869d5dcc5d-4m9v9\" (UID: \"42142d9b-b2be-44a2-9226-9d62b9a5487f\") " pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-4m9v9"
Oct 30 19:54:12.423731 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:54:12.423659    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kg96m\" (UniqueName: \"kubernetes.io/projected/42142d9b-b2be-44a2-9226-9d62b9a5487f-kube-api-access-kg96m\") pod \"llmisvc-controller-manager-869d5dcc5d-4m9v9\" (UID: \"42142d9b-b2be-44a2-9226-9d62b9a5487f\") " pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-4m9v9"
Oct 30 19:54:12.423731 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:54:12.423715    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b42eee11-4948-4d80-87c8-5343d07a0c5a-cert\") pod \"kserve-controller-manager-776cc66d47-bl2tv\" (UID: \"b42eee11-4948-4d80-87c8-5343d07a0c5a\") " pod="opendatahub/kserve-controller-manager-776cc66d47-bl2tv"
Oct 30 19:54:12.423842 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:54:12.423748    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q5mzg\" (UniqueName: \"kubernetes.io/projected/b42eee11-4948-4d80-87c8-5343d07a0c5a-kube-api-access-q5mzg\") pod \"kserve-controller-manager-776cc66d47-bl2tv\" (UID: \"b42eee11-4948-4d80-87c8-5343d07a0c5a\") " pod="opendatahub/kserve-controller-manager-776cc66d47-bl2tv"
Oct 30 19:54:12.423842 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:54:12.423771    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mjplb\" (UniqueName: \"kubernetes.io/projected/9269c7aa-930c-4a33-a2e6-157e1d617757-kube-api-access-mjplb\") pod \"model-serving-api-75bd89fdfc-8284h\" (UID: \"9269c7aa-930c-4a33-a2e6-157e1d617757\") " pod="opendatahub/model-serving-api-75bd89fdfc-8284h"
Oct 30 19:54:12.426125 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:54:12.426106    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/42142d9b-b2be-44a2-9226-9d62b9a5487f-cert\") pod \"llmisvc-controller-manager-869d5dcc5d-4m9v9\" (UID: \"42142d9b-b2be-44a2-9226-9d62b9a5487f\") " pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-4m9v9"
Oct 30 19:54:12.426255 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:54:12.426239    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b42eee11-4948-4d80-87c8-5343d07a0c5a-cert\") pod \"kserve-controller-manager-776cc66d47-bl2tv\" (UID: \"b42eee11-4948-4d80-87c8-5343d07a0c5a\") " pod="opendatahub/kserve-controller-manager-776cc66d47-bl2tv"
Oct 30 19:54:12.470199 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:54:12.470148    6275 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Oct 30 19:54:12.483431 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:54:12.483401    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q5mzg\" (UniqueName: \"kubernetes.io/projected/b42eee11-4948-4d80-87c8-5343d07a0c5a-kube-api-access-q5mzg\") pod \"kserve-controller-manager-776cc66d47-bl2tv\" (UID: \"b42eee11-4948-4d80-87c8-5343d07a0c5a\") " pod="opendatahub/kserve-controller-manager-776cc66d47-bl2tv"
Oct 30 19:54:12.509380 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:54:12.509360    6275 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-776cc66d47-bl2tv"
Oct 30 19:54:12.512054 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:54:12.512033    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kg96m\" (UniqueName: \"kubernetes.io/projected/42142d9b-b2be-44a2-9226-9d62b9a5487f-kube-api-access-kg96m\") pod \"llmisvc-controller-manager-869d5dcc5d-4m9v9\" (UID: \"42142d9b-b2be-44a2-9226-9d62b9a5487f\") " pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-4m9v9"
Oct 30 19:54:12.524742 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:54:12.524721    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mjplb\" (UniqueName: \"kubernetes.io/projected/9269c7aa-930c-4a33-a2e6-157e1d617757-kube-api-access-mjplb\") pod \"model-serving-api-75bd89fdfc-8284h\" (UID: \"9269c7aa-930c-4a33-a2e6-157e1d617757\") " pod="opendatahub/model-serving-api-75bd89fdfc-8284h"
Oct 30 19:54:12.524852 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:54:12.524799    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9269c7aa-930c-4a33-a2e6-157e1d617757-tls-certs\") pod \"model-serving-api-75bd89fdfc-8284h\" (UID: \"9269c7aa-930c-4a33-a2e6-157e1d617757\") " pod="opendatahub/model-serving-api-75bd89fdfc-8284h"
Oct 30 19:54:12.526538 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:54:12.526520    6275 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-4m9v9"
Oct 30 19:54:12.527093 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:54:12.527075    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9269c7aa-930c-4a33-a2e6-157e1d617757-tls-certs\") pod \"model-serving-api-75bd89fdfc-8284h\" (UID: \"9269c7aa-930c-4a33-a2e6-157e1d617757\") " pod="opendatahub/model-serving-api-75bd89fdfc-8284h"
Oct 30 19:54:12.617693 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:54:12.617671    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mjplb\" (UniqueName: \"kubernetes.io/projected/9269c7aa-930c-4a33-a2e6-157e1d617757-kube-api-access-mjplb\") pod \"model-serving-api-75bd89fdfc-8284h\" (UID: \"9269c7aa-930c-4a33-a2e6-157e1d617757\") " pod="opendatahub/model-serving-api-75bd89fdfc-8284h"
Oct 30 19:54:12.635618 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:54:12.635598    6275 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-75bd89fdfc-8284h"
Oct 30 19:54:12.825812 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:54:12.825706    6275 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-776cc66d47-bl2tv"]
Oct 30 19:54:12.827953 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:54:12.827929    6275 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb42eee11_4948_4d80_87c8_5343d07a0c5a.slice/crio-2e893f6a94736c4e72a6a4c2ff46ec7e89561e0cfe555ec8b869792c635b3d4d WatchSource:0}: Error finding container 2e893f6a94736c4e72a6a4c2ff46ec7e89561e0cfe555ec8b869792c635b3d4d: Status 404 returned error can't find the container with id 2e893f6a94736c4e72a6a4c2ff46ec7e89561e0cfe555ec8b869792c635b3d4d
Oct 30 19:54:12.829350 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:54:12.829332    6275 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Oct 30 19:54:12.850461 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:54:12.850382    6275 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-869d5dcc5d-4m9v9"]
Oct 30 19:54:12.852328 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:54:12.852306    6275 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod42142d9b_b2be_44a2_9226_9d62b9a5487f.slice/crio-98507317a1ec891b9dfd1525f29b2d63e849cda495f603501e20898324e39a29 WatchSource:0}: Error finding container 98507317a1ec891b9dfd1525f29b2d63e849cda495f603501e20898324e39a29: Status 404 returned error can't find the container with id 98507317a1ec891b9dfd1525f29b2d63e849cda495f603501e20898324e39a29
Oct 30 19:54:12.939321 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:54:12.939301    6275 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-75bd89fdfc-8284h"]
Oct 30 19:54:12.940802 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:54:12.940779    6275 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9269c7aa_930c_4a33_a2e6_157e1d617757.slice/crio-eb65dc2abcbb38615a2e3dbe80c5963d9fbb4f26429d67316d76db9be208f00d WatchSource:0}: Error finding container eb65dc2abcbb38615a2e3dbe80c5963d9fbb4f26429d67316d76db9be208f00d: Status 404 returned error can't find the container with id eb65dc2abcbb38615a2e3dbe80c5963d9fbb4f26429d67316d76db9be208f00d
Oct 30 19:54:13.109516 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:54:13.109462    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-776cc66d47-bl2tv" event={"ID":"b42eee11-4948-4d80-87c8-5343d07a0c5a","Type":"ContainerStarted","Data":"2e893f6a94736c4e72a6a4c2ff46ec7e89561e0cfe555ec8b869792c635b3d4d"}
Oct 30 19:54:13.110648 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:54:13.110622    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-75bd89fdfc-8284h" event={"ID":"9269c7aa-930c-4a33-a2e6-157e1d617757","Type":"ContainerStarted","Data":"eb65dc2abcbb38615a2e3dbe80c5963d9fbb4f26429d67316d76db9be208f00d"}
Oct 30 19:54:13.111745 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:54:13.111724    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-4m9v9" event={"ID":"42142d9b-b2be-44a2-9226-9d62b9a5487f","Type":"ContainerStarted","Data":"98507317a1ec891b9dfd1525f29b2d63e849cda495f603501e20898324e39a29"}
Oct 30 19:54:16.132298 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:54:16.132257    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-75bd89fdfc-8284h" event={"ID":"9269c7aa-930c-4a33-a2e6-157e1d617757","Type":"ContainerStarted","Data":"f3dde80dd61ae4ab4c5cbf1a7969f98d65388ee11232b21064ac4a70b3605205"}
Oct 30 19:54:16.132752 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:54:16.132326    6275 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-75bd89fdfc-8284h"
Oct 30 19:54:16.133916 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:54:16.133880    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-4m9v9" event={"ID":"42142d9b-b2be-44a2-9226-9d62b9a5487f","Type":"ContainerStarted","Data":"0aa02378c784473be31b31213e922c52a29597c9d7097326b589abd59d3a35fb"}
Oct 30 19:54:16.134198 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:54:16.133958    6275 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-4m9v9"
Oct 30 19:54:16.135743 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:54:16.135716    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-776cc66d47-bl2tv" event={"ID":"b42eee11-4948-4d80-87c8-5343d07a0c5a","Type":"ContainerStarted","Data":"4d03710a739e8b54b630071f7617e741ced5f4c1e6a48e8b5b5afa95f683dba1"}
Oct 30 19:54:16.135887 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:54:16.135848    6275 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-776cc66d47-bl2tv"
Oct 30 19:54:16.185830 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:54:16.185788    6275 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/model-serving-api-75bd89fdfc-8284h" podStartSLOduration=2.034835182 podStartE2EDuration="4.185777627s" totalImagesPullingTime="2.150942445s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 19:54:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 19:54:16.183941237 +0000 UTC m=+366.645668101" watchObservedRunningTime="2026-10-30 19:54:16.185777627 +0000 UTC m=+366.647504490"
Oct 30 19:54:16.233176 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:54:16.233089    6275 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-776cc66d47-bl2tv" podStartSLOduration=1.7489957 podStartE2EDuration="4.23307703s" totalImagesPullingTime="2.48408133s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 19:54:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 19:54:16.231079843 +0000 UTC m=+366.692806708" watchObservedRunningTime="2026-10-30 19:54:16.23307703 +0000 UTC m=+366.694803893"
Oct 30 19:54:16.279482 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:54:16.279450    6275 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-4m9v9" podStartSLOduration=1.7735710230000001 podStartE2EDuration="4.279436222s" totalImagesPullingTime="2.505865199s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 19:54:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 19:54:16.278573619 +0000 UTC m=+366.740300483" watchObservedRunningTime="2026-10-30 19:54:16.279436222 +0000 UTC m=+366.741163083"
Oct 30 19:54:26.257792 ip-10-0-131-26 kubenswrapper[6275]: E1030 19:54:26.257701    6275 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-fwc77" containerName="extractor"
Oct 30 19:54:27.144852 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:54:27.144821    6275 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-75bd89fdfc-8284h"
Oct 30 19:54:47.142540 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:54:47.142509    6275 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-4m9v9"
Oct 30 19:54:47.145856 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:54:47.145833    6275 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-776cc66d47-bl2tv"
Oct 30 19:54:56.258301 ip-10-0-131-26 kubenswrapper[6275]: E1030 19:54:56.258260    6275 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-fwc77" containerName="extractor"
Oct 30 19:55:11.835624 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:55:11.835582    6275 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7dg8mh"]
Oct 30 19:55:11.838332 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:55:11.838312    6275 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7dg8mh"
Oct 30 19:55:11.867649 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:55:11.867621    6275 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Oct 30 19:55:11.867765 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:55:11.867681    6275 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Oct 30 19:55:11.867765 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:55:11.867681    6275 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"da112bd609bff87f7bacd2ba941225d7cff15c-bd73b2fc-dockercfg-6bnkd\""
Oct 30 19:55:11.868967 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:55:11.868949    6275 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7dg8mh"]
Oct 30 19:55:11.880273 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:55:11.880249    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nldtx\" (UniqueName: \"kubernetes.io/projected/822eeb8f-609a-4b5c-8e66-1d9a917e2c71-kube-api-access-nldtx\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7dg8mh\" (UID: \"822eeb8f-609a-4b5c-8e66-1d9a917e2c71\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7dg8mh"
Oct 30 19:55:11.880382 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:55:11.880362    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/822eeb8f-609a-4b5c-8e66-1d9a917e2c71-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7dg8mh\" (UID: \"822eeb8f-609a-4b5c-8e66-1d9a917e2c71\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7dg8mh"
Oct 30 19:55:11.880468 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:55:11.880435    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/822eeb8f-609a-4b5c-8e66-1d9a917e2c71-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7dg8mh\" (UID: \"822eeb8f-609a-4b5c-8e66-1d9a917e2c71\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7dg8mh"
Oct 30 19:55:11.981741 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:55:11.981710    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nldtx\" (UniqueName: \"kubernetes.io/projected/822eeb8f-609a-4b5c-8e66-1d9a917e2c71-kube-api-access-nldtx\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7dg8mh\" (UID: \"822eeb8f-609a-4b5c-8e66-1d9a917e2c71\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7dg8mh"
Oct 30 19:55:11.981877 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:55:11.981762    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/822eeb8f-609a-4b5c-8e66-1d9a917e2c71-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7dg8mh\" (UID: \"822eeb8f-609a-4b5c-8e66-1d9a917e2c71\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7dg8mh"
Oct 30 19:55:11.981877 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:55:11.981798    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/822eeb8f-609a-4b5c-8e66-1d9a917e2c71-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7dg8mh\" (UID: \"822eeb8f-609a-4b5c-8e66-1d9a917e2c71\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7dg8mh"
Oct 30 19:55:11.982174 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:55:11.982154    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/822eeb8f-609a-4b5c-8e66-1d9a917e2c71-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7dg8mh\" (UID: \"822eeb8f-609a-4b5c-8e66-1d9a917e2c71\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7dg8mh"
Oct 30 19:55:11.982243 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:55:11.982195    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/822eeb8f-609a-4b5c-8e66-1d9a917e2c71-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7dg8mh\" (UID: \"822eeb8f-609a-4b5c-8e66-1d9a917e2c71\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7dg8mh"
Oct 30 19:55:11.984952 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:55:11.984932    6275 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a7xtkg"]
Oct 30 19:55:11.987335 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:55:11.987321    6275 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a7xtkg"
Oct 30 19:55:12.009676 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:55:12.009651    6275 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"6541d93aaee335d6227a8778ab4e840bbe7f52-f98fbcf8-dockercfg-8dv8f\""
Oct 30 19:55:12.016856 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:55:12.016837    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nldtx\" (UniqueName: \"kubernetes.io/projected/822eeb8f-609a-4b5c-8e66-1d9a917e2c71-kube-api-access-nldtx\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7dg8mh\" (UID: \"822eeb8f-609a-4b5c-8e66-1d9a917e2c71\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7dg8mh"
Oct 30 19:55:12.050637 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:55:12.050617    6275 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a7xtkg"]
Oct 30 19:55:12.082605 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:55:12.082580    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t76kc\" (UniqueName: \"kubernetes.io/projected/6d5e48eb-f7d9-48f2-a32e-3d1b546826b9-kube-api-access-t76kc\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a7xtkg\" (UID: \"6d5e48eb-f7d9-48f2-a32e-3d1b546826b9\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a7xtkg"
Oct 30 19:55:12.082695 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:55:12.082631    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6d5e48eb-f7d9-48f2-a32e-3d1b546826b9-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a7xtkg\" (UID: \"6d5e48eb-f7d9-48f2-a32e-3d1b546826b9\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a7xtkg"
Oct 30 19:55:12.082745 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:55:12.082716    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6d5e48eb-f7d9-48f2-a32e-3d1b546826b9-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a7xtkg\" (UID: \"6d5e48eb-f7d9-48f2-a32e-3d1b546826b9\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a7xtkg"
Oct 30 19:55:12.138998 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:55:12.138948    6275 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6lmwpv"]
Oct 30 19:55:12.141658 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:55:12.141641    6275 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6lmwpv"
Oct 30 19:55:12.151128 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:55:12.151113    6275 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7dg8mh"
Oct 30 19:55:12.157384 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:55:12.157363    6275 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3-b83c8cba-dockercfg-v2mdv\""
Oct 30 19:55:12.166363 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:55:12.166340    6275 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6lmwpv"]
Oct 30 19:55:12.183955 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:55:12.183892    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/dec753ae-3ee6-44a1-ae22-c70df1f6e9b1-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6lmwpv\" (UID: \"dec753ae-3ee6-44a1-ae22-c70df1f6e9b1\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6lmwpv"
Oct 30 19:55:12.184077 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:55:12.184059    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t76kc\" (UniqueName: \"kubernetes.io/projected/6d5e48eb-f7d9-48f2-a32e-3d1b546826b9-kube-api-access-t76kc\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a7xtkg\" (UID: \"6d5e48eb-f7d9-48f2-a32e-3d1b546826b9\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a7xtkg"
Oct 30 19:55:12.184154 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:55:12.184137    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6d5e48eb-f7d9-48f2-a32e-3d1b546826b9-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a7xtkg\" (UID: \"6d5e48eb-f7d9-48f2-a32e-3d1b546826b9\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a7xtkg"
Oct 30 19:55:12.184228 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:55:12.184176    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vrdrb\" (UniqueName: \"kubernetes.io/projected/dec753ae-3ee6-44a1-ae22-c70df1f6e9b1-kube-api-access-vrdrb\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6lmwpv\" (UID: \"dec753ae-3ee6-44a1-ae22-c70df1f6e9b1\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6lmwpv"
Oct 30 19:55:12.184282 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:55:12.184228    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6d5e48eb-f7d9-48f2-a32e-3d1b546826b9-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a7xtkg\" (UID: \"6d5e48eb-f7d9-48f2-a32e-3d1b546826b9\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a7xtkg"
Oct 30 19:55:12.184282 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:55:12.184261    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/dec753ae-3ee6-44a1-ae22-c70df1f6e9b1-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6lmwpv\" (UID: \"dec753ae-3ee6-44a1-ae22-c70df1f6e9b1\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6lmwpv"
Oct 30 19:55:12.184766 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:55:12.184730    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6d5e48eb-f7d9-48f2-a32e-3d1b546826b9-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a7xtkg\" (UID: \"6d5e48eb-f7d9-48f2-a32e-3d1b546826b9\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a7xtkg"
Oct 30 19:55:12.184766 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:55:12.184757    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6d5e48eb-f7d9-48f2-a32e-3d1b546826b9-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a7xtkg\" (UID: \"6d5e48eb-f7d9-48f2-a32e-3d1b546826b9\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a7xtkg"
Oct 30 19:55:12.210441 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:55:12.210389    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t76kc\" (UniqueName: \"kubernetes.io/projected/6d5e48eb-f7d9-48f2-a32e-3d1b546826b9-kube-api-access-t76kc\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a7xtkg\" (UID: \"6d5e48eb-f7d9-48f2-a32e-3d1b546826b9\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a7xtkg"
Oct 30 19:55:12.232847 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:55:12.232825    6275 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cnrz29"]
Oct 30 19:55:12.236096 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:55:12.236080    6275 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cnrz29"
Oct 30 19:55:12.253043 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:55:12.253026    6275 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"e3d011e69d9573cabb8c359e5ac709eb5ac240-be78d160-dockercfg-dgrpc\""
Oct 30 19:55:12.258946 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:55:12.258926    6275 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cnrz29"]
Oct 30 19:55:12.287278 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:55:12.287248    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/dec753ae-3ee6-44a1-ae22-c70df1f6e9b1-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6lmwpv\" (UID: \"dec753ae-3ee6-44a1-ae22-c70df1f6e9b1\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6lmwpv"
Oct 30 19:55:12.287383 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:55:12.287297    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-99bt6\" (UniqueName: \"kubernetes.io/projected/55949af3-36c1-4a9c-8cec-a345e5f8c0f3-kube-api-access-99bt6\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cnrz29\" (UID: \"55949af3-36c1-4a9c-8cec-a345e5f8c0f3\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cnrz29"
Oct 30 19:55:12.287383 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:55:12.287316    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/55949af3-36c1-4a9c-8cec-a345e5f8c0f3-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cnrz29\" (UID: \"55949af3-36c1-4a9c-8cec-a345e5f8c0f3\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cnrz29"
Oct 30 19:55:12.287520 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:55:12.287484    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vrdrb\" (UniqueName: \"kubernetes.io/projected/dec753ae-3ee6-44a1-ae22-c70df1f6e9b1-kube-api-access-vrdrb\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6lmwpv\" (UID: \"dec753ae-3ee6-44a1-ae22-c70df1f6e9b1\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6lmwpv"
Oct 30 19:55:12.287568 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:55:12.287526    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/55949af3-36c1-4a9c-8cec-a345e5f8c0f3-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cnrz29\" (UID: \"55949af3-36c1-4a9c-8cec-a345e5f8c0f3\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cnrz29"
Oct 30 19:55:12.287622 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:55:12.287575    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/dec753ae-3ee6-44a1-ae22-c70df1f6e9b1-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6lmwpv\" (UID: \"dec753ae-3ee6-44a1-ae22-c70df1f6e9b1\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6lmwpv"
Oct 30 19:55:12.287723 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:55:12.287703    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/dec753ae-3ee6-44a1-ae22-c70df1f6e9b1-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6lmwpv\" (UID: \"dec753ae-3ee6-44a1-ae22-c70df1f6e9b1\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6lmwpv"
Oct 30 19:55:12.287843 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:55:12.287828    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/dec753ae-3ee6-44a1-ae22-c70df1f6e9b1-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6lmwpv\" (UID: \"dec753ae-3ee6-44a1-ae22-c70df1f6e9b1\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6lmwpv"
Oct 30 19:55:12.299901 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:55:12.299875    6275 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a7xtkg"
Oct 30 19:55:12.313252 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:55:12.313229    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vrdrb\" (UniqueName: \"kubernetes.io/projected/dec753ae-3ee6-44a1-ae22-c70df1f6e9b1-kube-api-access-vrdrb\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6lmwpv\" (UID: \"dec753ae-3ee6-44a1-ae22-c70df1f6e9b1\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6lmwpv"
Oct 30 19:55:12.388132 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:55:12.388099    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/55949af3-36c1-4a9c-8cec-a345e5f8c0f3-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cnrz29\" (UID: \"55949af3-36c1-4a9c-8cec-a345e5f8c0f3\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cnrz29"
Oct 30 19:55:12.388250 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:55:12.388202    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-99bt6\" (UniqueName: \"kubernetes.io/projected/55949af3-36c1-4a9c-8cec-a345e5f8c0f3-kube-api-access-99bt6\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cnrz29\" (UID: \"55949af3-36c1-4a9c-8cec-a345e5f8c0f3\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cnrz29"
Oct 30 19:55:12.388250 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:55:12.388233    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/55949af3-36c1-4a9c-8cec-a345e5f8c0f3-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cnrz29\" (UID: \"55949af3-36c1-4a9c-8cec-a345e5f8c0f3\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cnrz29"
Oct 30 19:55:12.388565 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:55:12.388539    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/55949af3-36c1-4a9c-8cec-a345e5f8c0f3-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cnrz29\" (UID: \"55949af3-36c1-4a9c-8cec-a345e5f8c0f3\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cnrz29"
Oct 30 19:55:12.388649 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:55:12.388565    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/55949af3-36c1-4a9c-8cec-a345e5f8c0f3-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cnrz29\" (UID: \"55949af3-36c1-4a9c-8cec-a345e5f8c0f3\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cnrz29"
Oct 30 19:55:12.414233 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:55:12.414189    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-99bt6\" (UniqueName: \"kubernetes.io/projected/55949af3-36c1-4a9c-8cec-a345e5f8c0f3-kube-api-access-99bt6\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cnrz29\" (UID: \"55949af3-36c1-4a9c-8cec-a345e5f8c0f3\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cnrz29"
Oct 30 19:55:12.454281 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:55:12.454261    6275 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7dg8mh"]
Oct 30 19:55:12.454353 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:55:12.454336    6275 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6lmwpv"
Oct 30 19:55:12.456148 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:55:12.456128    6275 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod822eeb8f_609a_4b5c_8e66_1d9a917e2c71.slice/crio-4ef896d2ce801f471f0539579318f6bd7ccdb7df323d02b06ac0d271325eeb2a WatchSource:0}: Error finding container 4ef896d2ce801f471f0539579318f6bd7ccdb7df323d02b06ac0d271325eeb2a: Status 404 returned error can't find the container with id 4ef896d2ce801f471f0539579318f6bd7ccdb7df323d02b06ac0d271325eeb2a
Oct 30 19:55:12.549386 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:55:12.549353    6275 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cnrz29"
Oct 30 19:55:12.607373 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:55:12.607348    6275 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a7xtkg"]
Oct 30 19:55:12.626751 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:55:12.626715    6275 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6d5e48eb_f7d9_48f2_a32e_3d1b546826b9.slice/crio-e01d206525cb0b0dc0278495c99259c2ca6ad3b217c14c748aa28ab9d04529a5 WatchSource:0}: Error finding container e01d206525cb0b0dc0278495c99259c2ca6ad3b217c14c748aa28ab9d04529a5: Status 404 returned error can't find the container with id e01d206525cb0b0dc0278495c99259c2ca6ad3b217c14c748aa28ab9d04529a5
Oct 30 19:55:12.755736 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:55:12.755714    6275 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6lmwpv"]
Oct 30 19:55:12.777134 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:55:12.777111    6275 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddec753ae_3ee6_44a1_ae22_c70df1f6e9b1.slice/crio-c969a1501994132038b9504fd8c76b600b13fdee8064296fbe53de51ff383a35 WatchSource:0}: Error finding container c969a1501994132038b9504fd8c76b600b13fdee8064296fbe53de51ff383a35: Status 404 returned error can't find the container with id c969a1501994132038b9504fd8c76b600b13fdee8064296fbe53de51ff383a35
Oct 30 19:55:12.852384 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:55:12.852361    6275 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cnrz29"]
Oct 30 19:55:12.855738 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:55:12.855716    6275 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod55949af3_36c1_4a9c_8cec_a345e5f8c0f3.slice/crio-e91f4f4f381bd231b0f8f38847a48a0062cc32dd5fa239cda754ec1221cf1fc1 WatchSource:0}: Error finding container e91f4f4f381bd231b0f8f38847a48a0062cc32dd5fa239cda754ec1221cf1fc1: Status 404 returned error can't find the container with id e91f4f4f381bd231b0f8f38847a48a0062cc32dd5fa239cda754ec1221cf1fc1
Oct 30 19:55:13.402251 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:55:13.402218    6275 generic.go:356] "Generic (PLEG): container finished" podID="55949af3-36c1-4a9c-8cec-a345e5f8c0f3" containerID="cea5d3dfdcbf397551ca740314bc89326845c560d12c85da4ef6c520fc0af210" exitCode=0
Oct 30 19:55:13.402406 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:55:13.402319    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cnrz29" event={"ID":"55949af3-36c1-4a9c-8cec-a345e5f8c0f3","Type":"ContainerDied","Data":"cea5d3dfdcbf397551ca740314bc89326845c560d12c85da4ef6c520fc0af210"}
Oct 30 19:55:13.402406 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:55:13.402382    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cnrz29" event={"ID":"55949af3-36c1-4a9c-8cec-a345e5f8c0f3","Type":"ContainerStarted","Data":"e91f4f4f381bd231b0f8f38847a48a0062cc32dd5fa239cda754ec1221cf1fc1"}
Oct 30 19:55:13.404302 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:55:13.404217    6275 generic.go:356] "Generic (PLEG): container finished" podID="6d5e48eb-f7d9-48f2-a32e-3d1b546826b9" containerID="33362cca094bb44bd13ab1c6506b20104e61481b24367812c4d531d2461461aa" exitCode=0
Oct 30 19:55:13.404362 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:55:13.404294    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a7xtkg" event={"ID":"6d5e48eb-f7d9-48f2-a32e-3d1b546826b9","Type":"ContainerDied","Data":"33362cca094bb44bd13ab1c6506b20104e61481b24367812c4d531d2461461aa"}
Oct 30 19:55:13.404362 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:55:13.404340    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a7xtkg" event={"ID":"6d5e48eb-f7d9-48f2-a32e-3d1b546826b9","Type":"ContainerStarted","Data":"e01d206525cb0b0dc0278495c99259c2ca6ad3b217c14c748aa28ab9d04529a5"}
Oct 30 19:55:13.406223 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:55:13.406199    6275 generic.go:356] "Generic (PLEG): container finished" podID="dec753ae-3ee6-44a1-ae22-c70df1f6e9b1" containerID="6a0f08ca70aa741ea9203f4717ea560f7ff017d92b52af3ec3d0078d7a0a3288" exitCode=0
Oct 30 19:55:13.406312 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:55:13.406284    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6lmwpv" event={"ID":"dec753ae-3ee6-44a1-ae22-c70df1f6e9b1","Type":"ContainerDied","Data":"6a0f08ca70aa741ea9203f4717ea560f7ff017d92b52af3ec3d0078d7a0a3288"}
Oct 30 19:55:13.406375 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:55:13.406352    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6lmwpv" event={"ID":"dec753ae-3ee6-44a1-ae22-c70df1f6e9b1","Type":"ContainerStarted","Data":"c969a1501994132038b9504fd8c76b600b13fdee8064296fbe53de51ff383a35"}
Oct 30 19:55:13.408307 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:55:13.408284    6275 generic.go:356] "Generic (PLEG): container finished" podID="822eeb8f-609a-4b5c-8e66-1d9a917e2c71" containerID="ca9b3857a40ea1850a511bd369742c1f81d9b2ec4804d52d35c0fe34278491d6" exitCode=0
Oct 30 19:55:13.408405 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:55:13.408336    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7dg8mh" event={"ID":"822eeb8f-609a-4b5c-8e66-1d9a917e2c71","Type":"ContainerDied","Data":"ca9b3857a40ea1850a511bd369742c1f81d9b2ec4804d52d35c0fe34278491d6"}
Oct 30 19:55:13.408405 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:55:13.408388    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7dg8mh" event={"ID":"822eeb8f-609a-4b5c-8e66-1d9a917e2c71","Type":"ContainerStarted","Data":"4ef896d2ce801f471f0539579318f6bd7ccdb7df323d02b06ac0d271325eeb2a"}
Oct 30 19:55:14.414956 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:55:14.414927    6275 generic.go:356] "Generic (PLEG): container finished" podID="dec753ae-3ee6-44a1-ae22-c70df1f6e9b1" containerID="fd6498864f5e962b181de90a29d45da45e7270860e4891962c23573bf5c157da" exitCode=0
Oct 30 19:55:14.415324 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:55:14.415011    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6lmwpv" event={"ID":"dec753ae-3ee6-44a1-ae22-c70df1f6e9b1","Type":"ContainerDied","Data":"fd6498864f5e962b181de90a29d45da45e7270860e4891962c23573bf5c157da"}
Oct 30 19:55:14.416886 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:55:14.416869    6275 generic.go:356] "Generic (PLEG): container finished" podID="822eeb8f-609a-4b5c-8e66-1d9a917e2c71" containerID="be7b6199aac6b434e94f20b49578d9f8019c3746abad05a91764b735dcf7e4c3" exitCode=0
Oct 30 19:55:14.416971 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:55:14.416949    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7dg8mh" event={"ID":"822eeb8f-609a-4b5c-8e66-1d9a917e2c71","Type":"ContainerDied","Data":"be7b6199aac6b434e94f20b49578d9f8019c3746abad05a91764b735dcf7e4c3"}
Oct 30 19:55:14.419220 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:55:14.419194    6275 generic.go:356] "Generic (PLEG): container finished" podID="55949af3-36c1-4a9c-8cec-a345e5f8c0f3" containerID="ddccdb5df2325e23beadb4325eb99988f6c7b502884e7663aa64a1223be9bb3f" exitCode=0
Oct 30 19:55:14.419307 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:55:14.419248    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cnrz29" event={"ID":"55949af3-36c1-4a9c-8cec-a345e5f8c0f3","Type":"ContainerDied","Data":"ddccdb5df2325e23beadb4325eb99988f6c7b502884e7663aa64a1223be9bb3f"}
Oct 30 19:55:15.426428 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:55:15.426351    6275 generic.go:356] "Generic (PLEG): container finished" podID="dec753ae-3ee6-44a1-ae22-c70df1f6e9b1" containerID="5192ca3b0023e3aba9ead11b11176e5296628003fc88e848d69045f204eff446" exitCode=0
Oct 30 19:55:15.426785 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:55:15.426447    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6lmwpv" event={"ID":"dec753ae-3ee6-44a1-ae22-c70df1f6e9b1","Type":"ContainerDied","Data":"5192ca3b0023e3aba9ead11b11176e5296628003fc88e848d69045f204eff446"}
Oct 30 19:55:15.431189 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:55:15.429410    6275 generic.go:356] "Generic (PLEG): container finished" podID="822eeb8f-609a-4b5c-8e66-1d9a917e2c71" containerID="29298afe25aa136751d5394409174368af746155c230706f7db7d22b4c9ff3b7" exitCode=0
Oct 30 19:55:15.431189 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:55:15.429547    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7dg8mh" event={"ID":"822eeb8f-609a-4b5c-8e66-1d9a917e2c71","Type":"ContainerDied","Data":"29298afe25aa136751d5394409174368af746155c230706f7db7d22b4c9ff3b7"}
Oct 30 19:55:15.432527 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:55:15.432504    6275 generic.go:356] "Generic (PLEG): container finished" podID="55949af3-36c1-4a9c-8cec-a345e5f8c0f3" containerID="5fc20fd0ee7050568286121437c7bb5c4d408c8931c919174f0c80b93f522285" exitCode=0
Oct 30 19:55:15.432617 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:55:15.432593    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cnrz29" event={"ID":"55949af3-36c1-4a9c-8cec-a345e5f8c0f3","Type":"ContainerDied","Data":"5fc20fd0ee7050568286121437c7bb5c4d408c8931c919174f0c80b93f522285"}
Oct 30 19:55:15.434354 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:55:15.434335    6275 generic.go:356] "Generic (PLEG): container finished" podID="6d5e48eb-f7d9-48f2-a32e-3d1b546826b9" containerID="0a5c2f2d1b735d4f21321d9659124264e43cc990666e10ca3441af7806d5facc" exitCode=0
Oct 30 19:55:15.434459 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:55:15.434362    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a7xtkg" event={"ID":"6d5e48eb-f7d9-48f2-a32e-3d1b546826b9","Type":"ContainerDied","Data":"0a5c2f2d1b735d4f21321d9659124264e43cc990666e10ca3441af7806d5facc"}
Oct 30 19:55:16.441545 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:55:16.441515    6275 generic.go:356] "Generic (PLEG): container finished" podID="6d5e48eb-f7d9-48f2-a32e-3d1b546826b9" containerID="5d6331404c2969689cfe92eddca054caf4e7a833f028e98af838f148b5081903" exitCode=0
Oct 30 19:55:16.441956 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:55:16.441606    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a7xtkg" event={"ID":"6d5e48eb-f7d9-48f2-a32e-3d1b546826b9","Type":"ContainerDied","Data":"5d6331404c2969689cfe92eddca054caf4e7a833f028e98af838f148b5081903"}
Oct 30 19:55:16.591456 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:55:16.591433    6275 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cnrz29"
Oct 30 19:55:16.618105 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:55:16.618075    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/55949af3-36c1-4a9c-8cec-a345e5f8c0f3-bundle\" (UniqueName: \"kubernetes.io/empty-dir/55949af3-36c1-4a9c-8cec-a345e5f8c0f3-bundle\") pod \"55949af3-36c1-4a9c-8cec-a345e5f8c0f3\" (UID: \"55949af3-36c1-4a9c-8cec-a345e5f8c0f3\") "
Oct 30 19:55:16.618208 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:55:16.618173    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/55949af3-36c1-4a9c-8cec-a345e5f8c0f3-util\" (UniqueName: \"kubernetes.io/empty-dir/55949af3-36c1-4a9c-8cec-a345e5f8c0f3-util\") pod \"55949af3-36c1-4a9c-8cec-a345e5f8c0f3\" (UID: \"55949af3-36c1-4a9c-8cec-a345e5f8c0f3\") "
Oct 30 19:55:16.618376 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:55:16.618222    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/55949af3-36c1-4a9c-8cec-a345e5f8c0f3-kube-api-access-99bt6\" (UniqueName: \"kubernetes.io/projected/55949af3-36c1-4a9c-8cec-a345e5f8c0f3-kube-api-access-99bt6\") pod \"55949af3-36c1-4a9c-8cec-a345e5f8c0f3\" (UID: \"55949af3-36c1-4a9c-8cec-a345e5f8c0f3\") "
Oct 30 19:55:16.618684 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:55:16.618658    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/55949af3-36c1-4a9c-8cec-a345e5f8c0f3-bundle" pod "55949af3-36c1-4a9c-8cec-a345e5f8c0f3" (UID: "55949af3-36c1-4a9c-8cec-a345e5f8c0f3"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 19:55:16.620235 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:55:16.620214    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/55949af3-36c1-4a9c-8cec-a345e5f8c0f3-kube-api-access-99bt6" pod "55949af3-36c1-4a9c-8cec-a345e5f8c0f3" (UID: "55949af3-36c1-4a9c-8cec-a345e5f8c0f3"). InnerVolumeSpecName "kube-api-access-99bt6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 19:55:16.627374 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:55:16.627347    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/55949af3-36c1-4a9c-8cec-a345e5f8c0f3-util" pod "55949af3-36c1-4a9c-8cec-a345e5f8c0f3" (UID: "55949af3-36c1-4a9c-8cec-a345e5f8c0f3"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 19:55:16.643832 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:55:16.643809    6275 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7dg8mh"
Oct 30 19:55:16.647499 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:55:16.647482    6275 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6lmwpv"
Oct 30 19:55:16.719304 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:55:16.719236    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/822eeb8f-609a-4b5c-8e66-1d9a917e2c71-kube-api-access-nldtx\" (UniqueName: \"kubernetes.io/projected/822eeb8f-609a-4b5c-8e66-1d9a917e2c71-kube-api-access-nldtx\") pod \"822eeb8f-609a-4b5c-8e66-1d9a917e2c71\" (UID: \"822eeb8f-609a-4b5c-8e66-1d9a917e2c71\") "
Oct 30 19:55:16.719304 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:55:16.719272    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/dec753ae-3ee6-44a1-ae22-c70df1f6e9b1-bundle\" (UniqueName: \"kubernetes.io/empty-dir/dec753ae-3ee6-44a1-ae22-c70df1f6e9b1-bundle\") pod \"dec753ae-3ee6-44a1-ae22-c70df1f6e9b1\" (UID: \"dec753ae-3ee6-44a1-ae22-c70df1f6e9b1\") "
Oct 30 19:55:16.719507 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:55:16.719332    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/822eeb8f-609a-4b5c-8e66-1d9a917e2c71-bundle\" (UniqueName: \"kubernetes.io/empty-dir/822eeb8f-609a-4b5c-8e66-1d9a917e2c71-bundle\") pod \"822eeb8f-609a-4b5c-8e66-1d9a917e2c71\" (UID: \"822eeb8f-609a-4b5c-8e66-1d9a917e2c71\") "
Oct 30 19:55:16.719507 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:55:16.719362    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/822eeb8f-609a-4b5c-8e66-1d9a917e2c71-util\" (UniqueName: \"kubernetes.io/empty-dir/822eeb8f-609a-4b5c-8e66-1d9a917e2c71-util\") pod \"822eeb8f-609a-4b5c-8e66-1d9a917e2c71\" (UID: \"822eeb8f-609a-4b5c-8e66-1d9a917e2c71\") "
Oct 30 19:55:16.719507 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:55:16.719403    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/dec753ae-3ee6-44a1-ae22-c70df1f6e9b1-kube-api-access-vrdrb\" (UniqueName: \"kubernetes.io/projected/dec753ae-3ee6-44a1-ae22-c70df1f6e9b1-kube-api-access-vrdrb\") pod \"dec753ae-3ee6-44a1-ae22-c70df1f6e9b1\" (UID: \"dec753ae-3ee6-44a1-ae22-c70df1f6e9b1\") "
Oct 30 19:55:16.719507 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:55:16.719472    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/dec753ae-3ee6-44a1-ae22-c70df1f6e9b1-util\" (UniqueName: \"kubernetes.io/empty-dir/dec753ae-3ee6-44a1-ae22-c70df1f6e9b1-util\") pod \"dec753ae-3ee6-44a1-ae22-c70df1f6e9b1\" (UID: \"dec753ae-3ee6-44a1-ae22-c70df1f6e9b1\") "
Oct 30 19:55:16.719788 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:55:16.719769    6275 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-99bt6\" (UniqueName: \"kubernetes.io/projected/55949af3-36c1-4a9c-8cec-a345e5f8c0f3-kube-api-access-99bt6\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 19:55:16.719841 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:55:16.719793    6275 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/55949af3-36c1-4a9c-8cec-a345e5f8c0f3-bundle\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 19:55:16.719841 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:55:16.719808    6275 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/55949af3-36c1-4a9c-8cec-a345e5f8c0f3-util\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 19:55:16.720001 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:55:16.719976    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/822eeb8f-609a-4b5c-8e66-1d9a917e2c71-bundle" pod "822eeb8f-609a-4b5c-8e66-1d9a917e2c71" (UID: "822eeb8f-609a-4b5c-8e66-1d9a917e2c71"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 19:55:16.720235 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:55:16.720211    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dec753ae-3ee6-44a1-ae22-c70df1f6e9b1-bundle" pod "dec753ae-3ee6-44a1-ae22-c70df1f6e9b1" (UID: "dec753ae-3ee6-44a1-ae22-c70df1f6e9b1"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 19:55:16.721429 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:55:16.721388    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/822eeb8f-609a-4b5c-8e66-1d9a917e2c71-kube-api-access-nldtx" pod "822eeb8f-609a-4b5c-8e66-1d9a917e2c71" (UID: "822eeb8f-609a-4b5c-8e66-1d9a917e2c71"). InnerVolumeSpecName "kube-api-access-nldtx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 19:55:16.721514 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:55:16.721458    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dec753ae-3ee6-44a1-ae22-c70df1f6e9b1-kube-api-access-vrdrb" pod "dec753ae-3ee6-44a1-ae22-c70df1f6e9b1" (UID: "dec753ae-3ee6-44a1-ae22-c70df1f6e9b1"). InnerVolumeSpecName "kube-api-access-vrdrb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 19:55:16.725289 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:55:16.725253    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dec753ae-3ee6-44a1-ae22-c70df1f6e9b1-util" pod "dec753ae-3ee6-44a1-ae22-c70df1f6e9b1" (UID: "dec753ae-3ee6-44a1-ae22-c70df1f6e9b1"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 19:55:16.725402 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:55:16.725383    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/822eeb8f-609a-4b5c-8e66-1d9a917e2c71-util" pod "822eeb8f-609a-4b5c-8e66-1d9a917e2c71" (UID: "822eeb8f-609a-4b5c-8e66-1d9a917e2c71"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 19:55:16.821029 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:55:16.821000    6275 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nldtx\" (UniqueName: \"kubernetes.io/projected/822eeb8f-609a-4b5c-8e66-1d9a917e2c71-kube-api-access-nldtx\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 19:55:16.821029 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:55:16.821024    6275 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/dec753ae-3ee6-44a1-ae22-c70df1f6e9b1-bundle\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 19:55:16.821029 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:55:16.821035    6275 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/822eeb8f-609a-4b5c-8e66-1d9a917e2c71-bundle\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 19:55:16.821216 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:55:16.821043    6275 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/822eeb8f-609a-4b5c-8e66-1d9a917e2c71-util\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 19:55:16.821216 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:55:16.821052    6275 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vrdrb\" (UniqueName: \"kubernetes.io/projected/dec753ae-3ee6-44a1-ae22-c70df1f6e9b1-kube-api-access-vrdrb\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 19:55:16.821216 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:55:16.821060    6275 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/dec753ae-3ee6-44a1-ae22-c70df1f6e9b1-util\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 19:55:17.448163 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:55:17.448136    6275 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cnrz29"
Oct 30 19:55:17.448163 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:55:17.448155    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cnrz29" event={"ID":"55949af3-36c1-4a9c-8cec-a345e5f8c0f3","Type":"ContainerDied","Data":"e91f4f4f381bd231b0f8f38847a48a0062cc32dd5fa239cda754ec1221cf1fc1"}
Oct 30 19:55:17.448614 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:55:17.448211    6275 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e91f4f4f381bd231b0f8f38847a48a0062cc32dd5fa239cda754ec1221cf1fc1"
Oct 30 19:55:17.450173 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:55:17.450156    6275 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6lmwpv"
Oct 30 19:55:17.450302 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:55:17.450172    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6lmwpv" event={"ID":"dec753ae-3ee6-44a1-ae22-c70df1f6e9b1","Type":"ContainerDied","Data":"c969a1501994132038b9504fd8c76b600b13fdee8064296fbe53de51ff383a35"}
Oct 30 19:55:17.450302 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:55:17.450213    6275 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c969a1501994132038b9504fd8c76b600b13fdee8064296fbe53de51ff383a35"
Oct 30 19:55:17.452211 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:55:17.452193    6275 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7dg8mh"
Oct 30 19:55:17.452297 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:55:17.452212    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7dg8mh" event={"ID":"822eeb8f-609a-4b5c-8e66-1d9a917e2c71","Type":"ContainerDied","Data":"4ef896d2ce801f471f0539579318f6bd7ccdb7df323d02b06ac0d271325eeb2a"}
Oct 30 19:55:17.452297 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:55:17.452254    6275 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4ef896d2ce801f471f0539579318f6bd7ccdb7df323d02b06ac0d271325eeb2a"
Oct 30 19:55:17.583660 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:55:17.583639    6275 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a7xtkg"
Oct 30 19:55:17.626952 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:55:17.626926    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/6d5e48eb-f7d9-48f2-a32e-3d1b546826b9-kube-api-access-t76kc\" (UniqueName: \"kubernetes.io/projected/6d5e48eb-f7d9-48f2-a32e-3d1b546826b9-kube-api-access-t76kc\") pod \"6d5e48eb-f7d9-48f2-a32e-3d1b546826b9\" (UID: \"6d5e48eb-f7d9-48f2-a32e-3d1b546826b9\") "
Oct 30 19:55:17.627072 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:55:17.627047    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/6d5e48eb-f7d9-48f2-a32e-3d1b546826b9-util\" (UniqueName: \"kubernetes.io/empty-dir/6d5e48eb-f7d9-48f2-a32e-3d1b546826b9-util\") pod \"6d5e48eb-f7d9-48f2-a32e-3d1b546826b9\" (UID: \"6d5e48eb-f7d9-48f2-a32e-3d1b546826b9\") "
Oct 30 19:55:17.627143 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:55:17.627090    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/6d5e48eb-f7d9-48f2-a32e-3d1b546826b9-bundle\" (UniqueName: \"kubernetes.io/empty-dir/6d5e48eb-f7d9-48f2-a32e-3d1b546826b9-bundle\") pod \"6d5e48eb-f7d9-48f2-a32e-3d1b546826b9\" (UID: \"6d5e48eb-f7d9-48f2-a32e-3d1b546826b9\") "
Oct 30 19:55:17.627835 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:55:17.627809    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6d5e48eb-f7d9-48f2-a32e-3d1b546826b9-bundle" pod "6d5e48eb-f7d9-48f2-a32e-3d1b546826b9" (UID: "6d5e48eb-f7d9-48f2-a32e-3d1b546826b9"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 19:55:17.629392 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:55:17.629363    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6d5e48eb-f7d9-48f2-a32e-3d1b546826b9-kube-api-access-t76kc" pod "6d5e48eb-f7d9-48f2-a32e-3d1b546826b9" (UID: "6d5e48eb-f7d9-48f2-a32e-3d1b546826b9"). InnerVolumeSpecName "kube-api-access-t76kc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 19:55:17.634235 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:55:17.634208    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6d5e48eb-f7d9-48f2-a32e-3d1b546826b9-util" pod "6d5e48eb-f7d9-48f2-a32e-3d1b546826b9" (UID: "6d5e48eb-f7d9-48f2-a32e-3d1b546826b9"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 19:55:17.728052 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:55:17.727987    6275 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6d5e48eb-f7d9-48f2-a32e-3d1b546826b9-bundle\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 19:55:17.728052 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:55:17.728014    6275 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t76kc\" (UniqueName: \"kubernetes.io/projected/6d5e48eb-f7d9-48f2-a32e-3d1b546826b9-kube-api-access-t76kc\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 19:55:17.728052 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:55:17.728024    6275 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6d5e48eb-f7d9-48f2-a32e-3d1b546826b9-util\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 19:55:18.460220 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:55:18.460186    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a7xtkg" event={"ID":"6d5e48eb-f7d9-48f2-a32e-3d1b546826b9","Type":"ContainerDied","Data":"e01d206525cb0b0dc0278495c99259c2ca6ad3b217c14c748aa28ab9d04529a5"}
Oct 30 19:55:18.460661 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:55:18.460238    6275 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a7xtkg"
Oct 30 19:55:18.460661 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:55:18.460263    6275 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e01d206525cb0b0dc0278495c99259c2ca6ad3b217c14c748aa28ab9d04529a5"
Oct 30 19:55:26.257535 ip-10-0-131-26 kubenswrapper[6275]: E1030 19:55:26.257483    6275 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-fwc77" containerName="extractor"
Oct 30 19:55:43.449617 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:55:43.449584    6275 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66c4fb575d-d7zvq"]
Oct 30 19:55:43.450071 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:55:43.449926    6275 cpu_manager.go:414] "containerMap: removing container" podUID="55949af3-36c1-4a9c-8cec-a345e5f8c0f3" containerName="util"
Oct 30 19:55:43.450071 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:55:43.449937    6275 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="55949af3-36c1-4a9c-8cec-a345e5f8c0f3" containerName="util"
Oct 30 19:55:43.450071 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:55:43.449958    6275 cpu_manager.go:414] "containerMap: removing container" podUID="dec753ae-3ee6-44a1-ae22-c70df1f6e9b1" containerName="pull"
Oct 30 19:55:43.450071 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:55:43.449963    6275 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="dec753ae-3ee6-44a1-ae22-c70df1f6e9b1" containerName="pull"
Oct 30 19:55:43.450071 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:55:43.449970    6275 cpu_manager.go:414] "containerMap: removing container" podUID="55949af3-36c1-4a9c-8cec-a345e5f8c0f3" containerName="pull"
Oct 30 19:55:43.450071 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:55:43.449975    6275 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="55949af3-36c1-4a9c-8cec-a345e5f8c0f3" containerName="pull"
Oct 30 19:55:43.450071 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:55:43.449982    6275 cpu_manager.go:414] "containerMap: removing container" podUID="6d5e48eb-f7d9-48f2-a32e-3d1b546826b9" containerName="extract"
Oct 30 19:55:43.450071 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:55:43.449987    6275 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="6d5e48eb-f7d9-48f2-a32e-3d1b546826b9" containerName="extract"
Oct 30 19:55:43.450071 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:55:43.449994    6275 cpu_manager.go:414] "containerMap: removing container" podUID="822eeb8f-609a-4b5c-8e66-1d9a917e2c71" containerName="pull"
Oct 30 19:55:43.450071 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:55:43.449998    6275 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="822eeb8f-609a-4b5c-8e66-1d9a917e2c71" containerName="pull"
Oct 30 19:55:43.450071 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:55:43.450008    6275 cpu_manager.go:414] "containerMap: removing container" podUID="822eeb8f-609a-4b5c-8e66-1d9a917e2c71" containerName="util"
Oct 30 19:55:43.450071 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:55:43.450013    6275 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="822eeb8f-609a-4b5c-8e66-1d9a917e2c71" containerName="util"
Oct 30 19:55:43.450071 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:55:43.450020    6275 cpu_manager.go:414] "containerMap: removing container" podUID="55949af3-36c1-4a9c-8cec-a345e5f8c0f3" containerName="extract"
Oct 30 19:55:43.450071 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:55:43.450024    6275 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="55949af3-36c1-4a9c-8cec-a345e5f8c0f3" containerName="extract"
Oct 30 19:55:43.450071 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:55:43.450033    6275 cpu_manager.go:414] "containerMap: removing container" podUID="dec753ae-3ee6-44a1-ae22-c70df1f6e9b1" containerName="util"
Oct 30 19:55:43.450071 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:55:43.450038    6275 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="dec753ae-3ee6-44a1-ae22-c70df1f6e9b1" containerName="util"
Oct 30 19:55:43.450071 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:55:43.450043    6275 cpu_manager.go:414] "containerMap: removing container" podUID="822eeb8f-609a-4b5c-8e66-1d9a917e2c71" containerName="extract"
Oct 30 19:55:43.450071 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:55:43.450049    6275 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="822eeb8f-609a-4b5c-8e66-1d9a917e2c71" containerName="extract"
Oct 30 19:55:43.450071 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:55:43.450056    6275 cpu_manager.go:414] "containerMap: removing container" podUID="6d5e48eb-f7d9-48f2-a32e-3d1b546826b9" containerName="pull"
Oct 30 19:55:43.450071 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:55:43.450060    6275 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="6d5e48eb-f7d9-48f2-a32e-3d1b546826b9" containerName="pull"
Oct 30 19:55:43.450071 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:55:43.450071    6275 cpu_manager.go:414] "containerMap: removing container" podUID="dec753ae-3ee6-44a1-ae22-c70df1f6e9b1" containerName="extract"
Oct 30 19:55:43.450071 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:55:43.450075    6275 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="dec753ae-3ee6-44a1-ae22-c70df1f6e9b1" containerName="extract"
Oct 30 19:55:43.450071 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:55:43.450083    6275 cpu_manager.go:414] "containerMap: removing container" podUID="6d5e48eb-f7d9-48f2-a32e-3d1b546826b9" containerName="util"
Oct 30 19:55:43.450766 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:55:43.450087    6275 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="6d5e48eb-f7d9-48f2-a32e-3d1b546826b9" containerName="util"
Oct 30 19:55:43.450766 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:55:43.450132    6275 memory_manager.go:365] "RemoveStaleState removing state" podUID="822eeb8f-609a-4b5c-8e66-1d9a917e2c71" containerName="extract"
Oct 30 19:55:43.450766 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:55:43.450139    6275 memory_manager.go:365] "RemoveStaleState removing state" podUID="dec753ae-3ee6-44a1-ae22-c70df1f6e9b1" containerName="extract"
Oct 30 19:55:43.450766 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:55:43.450148    6275 memory_manager.go:365] "RemoveStaleState removing state" podUID="6d5e48eb-f7d9-48f2-a32e-3d1b546826b9" containerName="extract"
Oct 30 19:55:43.450766 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:55:43.450154    6275 memory_manager.go:365] "RemoveStaleState removing state" podUID="55949af3-36c1-4a9c-8cec-a345e5f8c0f3" containerName="extract"
Oct 30 19:55:43.453465 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:55:43.453449    6275 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66c4fb575d-d7zvq"
Oct 30 19:55:43.491648 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:55:43.491620    6275 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\""
Oct 30 19:55:43.491781 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:55:43.491682    6275 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Oct 30 19:55:43.491781 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:55:43.491718    6275 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Oct 30 19:55:43.493317 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:55:43.493298    6275 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66c4fb575d-d7zvq"]
Oct 30 19:55:43.493777 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:55:43.493763    6275 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-ssn2n\""
Oct 30 19:55:43.493862 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:55:43.493846    6275 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\""
Oct 30 19:55:43.516912 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:55:43.516887    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/3d7702f4-3e67-4cc6-b8aa-78d6ef24deee-nginx-conf\") pod \"kuadrant-console-plugin-66c4fb575d-d7zvq\" (UID: \"3d7702f4-3e67-4cc6-b8aa-78d6ef24deee\") " pod="kuadrant-system/kuadrant-console-plugin-66c4fb575d-d7zvq"
Oct 30 19:55:43.517016 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:55:43.516946    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w66pb\" (UniqueName: \"kubernetes.io/projected/3d7702f4-3e67-4cc6-b8aa-78d6ef24deee-kube-api-access-w66pb\") pod \"kuadrant-console-plugin-66c4fb575d-d7zvq\" (UID: \"3d7702f4-3e67-4cc6-b8aa-78d6ef24deee\") " pod="kuadrant-system/kuadrant-console-plugin-66c4fb575d-d7zvq"
Oct 30 19:55:43.517058 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:55:43.517014    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/3d7702f4-3e67-4cc6-b8aa-78d6ef24deee-plugin-serving-cert\") pod \"kuadrant-console-plugin-66c4fb575d-d7zvq\" (UID: \"3d7702f4-3e67-4cc6-b8aa-78d6ef24deee\") " pod="kuadrant-system/kuadrant-console-plugin-66c4fb575d-d7zvq"
Oct 30 19:55:43.618174 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:55:43.618150    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/3d7702f4-3e67-4cc6-b8aa-78d6ef24deee-nginx-conf\") pod \"kuadrant-console-plugin-66c4fb575d-d7zvq\" (UID: \"3d7702f4-3e67-4cc6-b8aa-78d6ef24deee\") " pod="kuadrant-system/kuadrant-console-plugin-66c4fb575d-d7zvq"
Oct 30 19:55:43.618297 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:55:43.618212    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w66pb\" (UniqueName: \"kubernetes.io/projected/3d7702f4-3e67-4cc6-b8aa-78d6ef24deee-kube-api-access-w66pb\") pod \"kuadrant-console-plugin-66c4fb575d-d7zvq\" (UID: \"3d7702f4-3e67-4cc6-b8aa-78d6ef24deee\") " pod="kuadrant-system/kuadrant-console-plugin-66c4fb575d-d7zvq"
Oct 30 19:55:43.618362 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:55:43.618320    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/3d7702f4-3e67-4cc6-b8aa-78d6ef24deee-plugin-serving-cert\") pod \"kuadrant-console-plugin-66c4fb575d-d7zvq\" (UID: \"3d7702f4-3e67-4cc6-b8aa-78d6ef24deee\") " pod="kuadrant-system/kuadrant-console-plugin-66c4fb575d-d7zvq"
Oct 30 19:55:43.618862 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:55:43.618839    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/3d7702f4-3e67-4cc6-b8aa-78d6ef24deee-nginx-conf\") pod \"kuadrant-console-plugin-66c4fb575d-d7zvq\" (UID: \"3d7702f4-3e67-4cc6-b8aa-78d6ef24deee\") " pod="kuadrant-system/kuadrant-console-plugin-66c4fb575d-d7zvq"
Oct 30 19:55:43.620597 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:55:43.620580    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/3d7702f4-3e67-4cc6-b8aa-78d6ef24deee-plugin-serving-cert\") pod \"kuadrant-console-plugin-66c4fb575d-d7zvq\" (UID: \"3d7702f4-3e67-4cc6-b8aa-78d6ef24deee\") " pod="kuadrant-system/kuadrant-console-plugin-66c4fb575d-d7zvq"
Oct 30 19:55:43.649746 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:55:43.649721    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w66pb\" (UniqueName: \"kubernetes.io/projected/3d7702f4-3e67-4cc6-b8aa-78d6ef24deee-kube-api-access-w66pb\") pod \"kuadrant-console-plugin-66c4fb575d-d7zvq\" (UID: \"3d7702f4-3e67-4cc6-b8aa-78d6ef24deee\") " pod="kuadrant-system/kuadrant-console-plugin-66c4fb575d-d7zvq"
Oct 30 19:55:43.765810 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:55:43.765790    6275 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66c4fb575d-d7zvq"
Oct 30 19:55:44.067995 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:55:44.067958    6275 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66c4fb575d-d7zvq"]
Oct 30 19:55:44.069387 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:55:44.069360    6275 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3d7702f4_3e67_4cc6_b8aa_78d6ef24deee.slice/crio-a86ab848e65b4d077bbd8a03f97dabdb3945872f322098d5cf10c4d277f3799e WatchSource:0}: Error finding container a86ab848e65b4d077bbd8a03f97dabdb3945872f322098d5cf10c4d277f3799e: Status 404 returned error can't find the container with id a86ab848e65b4d077bbd8a03f97dabdb3945872f322098d5cf10c4d277f3799e
Oct 30 19:55:44.590029 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:55:44.589996    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66c4fb575d-d7zvq" event={"ID":"3d7702f4-3e67-4cc6-b8aa-78d6ef24deee","Type":"ContainerStarted","Data":"a86ab848e65b4d077bbd8a03f97dabdb3945872f322098d5cf10c4d277f3799e"}
Oct 30 19:55:48.615159 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:55:48.615128    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66c4fb575d-d7zvq" event={"ID":"3d7702f4-3e67-4cc6-b8aa-78d6ef24deee","Type":"ContainerStarted","Data":"975ceea28b146c765c1654f07a7c0039903ecb246bc3b51dda05bbbb40b24201"}
Oct 30 19:55:48.659183 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:55:48.659133    6275 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66c4fb575d-d7zvq" podStartSLOduration=1.271335675 podStartE2EDuration="5.659119992s" totalImagesPullingTime="4.387784317s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 19:55:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 19:55:48.656987007 +0000 UTC m=+459.118713869" watchObservedRunningTime="2026-10-30 19:55:48.659119992 +0000 UTC m=+459.120846855"
Oct 30 19:55:53.262080 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:55:53.262045    6275 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6b76784d48-mfzkx"]
Oct 30 19:55:53.266095 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:55:53.266076    6275 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6b76784d48-mfzkx"
Oct 30 19:55:53.284842 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:55:53.284823    6275 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-5pgqn\""
Oct 30 19:55:53.317211 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:55:53.317181    6275 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6b76784d48-mfzkx"]
Oct 30 19:55:53.404496 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:55:53.404460    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4ltc6\" (UniqueName: \"kubernetes.io/projected/865656be-da1e-4b37-9470-469ffc821015-kube-api-access-4ltc6\") pod \"kuadrant-operator-controller-manager-6b76784d48-mfzkx\" (UID: \"865656be-da1e-4b37-9470-469ffc821015\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6b76784d48-mfzkx"
Oct 30 19:55:53.404645 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:55:53.404522    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/865656be-da1e-4b37-9470-469ffc821015-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6b76784d48-mfzkx\" (UID: \"865656be-da1e-4b37-9470-469ffc821015\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6b76784d48-mfzkx"
Oct 30 19:55:53.505782 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:55:53.505754    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4ltc6\" (UniqueName: \"kubernetes.io/projected/865656be-da1e-4b37-9470-469ffc821015-kube-api-access-4ltc6\") pod \"kuadrant-operator-controller-manager-6b76784d48-mfzkx\" (UID: \"865656be-da1e-4b37-9470-469ffc821015\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6b76784d48-mfzkx"
Oct 30 19:55:53.505920 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:55:53.505794    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/865656be-da1e-4b37-9470-469ffc821015-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6b76784d48-mfzkx\" (UID: \"865656be-da1e-4b37-9470-469ffc821015\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6b76784d48-mfzkx"
Oct 30 19:55:53.506138 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:55:53.506119    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/865656be-da1e-4b37-9470-469ffc821015-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6b76784d48-mfzkx\" (UID: \"865656be-da1e-4b37-9470-469ffc821015\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6b76784d48-mfzkx"
Oct 30 19:55:53.534202 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:55:53.534140    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4ltc6\" (UniqueName: \"kubernetes.io/projected/865656be-da1e-4b37-9470-469ffc821015-kube-api-access-4ltc6\") pod \"kuadrant-operator-controller-manager-6b76784d48-mfzkx\" (UID: \"865656be-da1e-4b37-9470-469ffc821015\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6b76784d48-mfzkx"
Oct 30 19:55:53.546034 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:55:53.546007    6275 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6b76784d48-mfzkx"]
Oct 30 19:55:53.546293 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:55:53.546278    6275 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6b76784d48-mfzkx"
Oct 30 19:55:53.884580 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:55:53.884544    6275 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6b76784d48-mfzkx"]
Oct 30 19:55:53.888900 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:55:53.888862    6275 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod865656be_da1e_4b37_9470_469ffc821015.slice/crio-decbc060230d3a035b9956009410d081004edddb403b8c876b7c2dc557f6772e WatchSource:0}: Error finding container decbc060230d3a035b9956009410d081004edddb403b8c876b7c2dc557f6772e: Status 404 returned error can't find the container with id decbc060230d3a035b9956009410d081004edddb403b8c876b7c2dc557f6772e
Oct 30 19:55:54.651973 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:55:54.651929    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6b76784d48-mfzkx" event={"ID":"865656be-da1e-4b37-9470-469ffc821015","Type":"ContainerStarted","Data":"decbc060230d3a035b9956009410d081004edddb403b8c876b7c2dc557f6772e"}
Oct 30 19:55:55.409167 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:55:55.409078    6275 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6b76784d48-mfzkx"]
Oct 30 19:55:55.409350 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:55:55.409183    6275 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6b76784d48-mfzkx"]
Oct 30 19:55:55.469219 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:55:55.469186    6275 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-956956bc4-9gtfp"]
Oct 30 19:55:55.478217 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:55:55.478190    6275 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-956956bc4-9gtfp"
Oct 30 19:55:55.504808 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:55:55.504781    6275 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-956956bc4-9gtfp"]
Oct 30 19:55:55.626096 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:55:55.626059    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c5eaf47e-7d7e-4af6-9e43-1fced31cea5c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-956956bc4-9gtfp\" (UID: \"c5eaf47e-7d7e-4af6-9e43-1fced31cea5c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-956956bc4-9gtfp"
Oct 30 19:55:55.626277 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:55:55.626248    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nmwtq\" (UniqueName: \"kubernetes.io/projected/c5eaf47e-7d7e-4af6-9e43-1fced31cea5c-kube-api-access-nmwtq\") pod \"kuadrant-operator-controller-manager-956956bc4-9gtfp\" (UID: \"c5eaf47e-7d7e-4af6-9e43-1fced31cea5c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-956956bc4-9gtfp"
Oct 30 19:55:55.726891 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:55:55.726819    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nmwtq\" (UniqueName: \"kubernetes.io/projected/c5eaf47e-7d7e-4af6-9e43-1fced31cea5c-kube-api-access-nmwtq\") pod \"kuadrant-operator-controller-manager-956956bc4-9gtfp\" (UID: \"c5eaf47e-7d7e-4af6-9e43-1fced31cea5c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-956956bc4-9gtfp"
Oct 30 19:55:55.726891 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:55:55.726884    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c5eaf47e-7d7e-4af6-9e43-1fced31cea5c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-956956bc4-9gtfp\" (UID: \"c5eaf47e-7d7e-4af6-9e43-1fced31cea5c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-956956bc4-9gtfp"
Oct 30 19:55:55.727443 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:55:55.727282    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c5eaf47e-7d7e-4af6-9e43-1fced31cea5c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-956956bc4-9gtfp\" (UID: \"c5eaf47e-7d7e-4af6-9e43-1fced31cea5c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-956956bc4-9gtfp"
Oct 30 19:55:55.765612 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:55:55.765580    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nmwtq\" (UniqueName: \"kubernetes.io/projected/c5eaf47e-7d7e-4af6-9e43-1fced31cea5c-kube-api-access-nmwtq\") pod \"kuadrant-operator-controller-manager-956956bc4-9gtfp\" (UID: \"c5eaf47e-7d7e-4af6-9e43-1fced31cea5c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-956956bc4-9gtfp"
Oct 30 19:55:55.799218 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:55:55.799186    6275 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-956956bc4-9gtfp"
Oct 30 19:55:56.175901 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:55:56.175861    6275 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc5eaf47e_7d7e_4af6_9e43_1fced31cea5c.slice/crio-99ed58377fdd77b4e4860a96bcd4a32580e636f29cfe05121a6b36e1dd4f3de1 WatchSource:0}: Error finding container 99ed58377fdd77b4e4860a96bcd4a32580e636f29cfe05121a6b36e1dd4f3de1: Status 404 returned error can't find the container with id 99ed58377fdd77b4e4860a96bcd4a32580e636f29cfe05121a6b36e1dd4f3de1
Oct 30 19:55:56.178302 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:55:56.178277    6275 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-956956bc4-9gtfp"]
Oct 30 19:55:56.258300 ip-10-0-131-26 kubenswrapper[6275]: E1030 19:55:56.258263    6275 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-fwc77" containerName="extractor"
Oct 30 19:55:56.668836 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:55:56.668806    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-956956bc4-9gtfp" event={"ID":"c5eaf47e-7d7e-4af6-9e43-1fced31cea5c","Type":"ContainerStarted","Data":"99ed58377fdd77b4e4860a96bcd4a32580e636f29cfe05121a6b36e1dd4f3de1"}
Oct 30 19:55:58.680955 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:55:58.680845    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-956956bc4-9gtfp" event={"ID":"c5eaf47e-7d7e-4af6-9e43-1fced31cea5c","Type":"ContainerStarted","Data":"276aea2eef139145afbada16a9d79e0a3b3f1615575f91d1e998cd179f8c4bc4"}
Oct 30 19:55:58.681553 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:55:58.681455    6275 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-956956bc4-9gtfp"
Oct 30 19:55:58.683805 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:55:58.683772    6275 kuberuntime_container.go:898] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-6b76784d48-mfzkx" podUID="865656be-da1e-4b37-9470-469ffc821015" containerName="manager" containerID="cri-o://08b38cf9251026d193605d63a7ffd93065d70b98db095818ff5c0636910503c1" gracePeriod=2
Oct 30 19:55:58.779343 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:55:58.779293    6275 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-956956bc4-9gtfp" podStartSLOduration=1.350503593 podStartE2EDuration="3.779273984s" totalImagesPullingTime="2.428770391s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 19:55:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 19:55:58.764598176 +0000 UTC m=+469.226325063" watchObservedRunningTime="2026-10-30 19:55:58.779273984 +0000 UTC m=+469.241000848"
Oct 30 19:55:58.936936 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:55:58.936915    6275 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6b76784d48-mfzkx"
Oct 30 19:55:58.950969 ip-10-0-131-26 kubenswrapper[6275]: E1030 19:55:58.950944    6275 status_manager.go:1045] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6b76784d48-mfzkx\" is forbidden: User \"system:node:ip-10-0-131-26.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-26.ec2.internal' and this object" podUID="865656be-da1e-4b37-9470-469ffc821015" pod="kuadrant-system/kuadrant-operator-controller-manager-6b76784d48-mfzkx"
Oct 30 19:55:59.054732 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:55:59.054705    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/865656be-da1e-4b37-9470-469ffc821015-kube-api-access-4ltc6\" (UniqueName: \"kubernetes.io/projected/865656be-da1e-4b37-9470-469ffc821015-kube-api-access-4ltc6\") pod \"865656be-da1e-4b37-9470-469ffc821015\" (UID: \"865656be-da1e-4b37-9470-469ffc821015\") "
Oct 30 19:55:59.054843 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:55:59.054744    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/865656be-da1e-4b37-9470-469ffc821015-extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/865656be-da1e-4b37-9470-469ffc821015-extensions-socket-volume\") pod \"865656be-da1e-4b37-9470-469ffc821015\" (UID: \"865656be-da1e-4b37-9470-469ffc821015\") "
Oct 30 19:55:59.055039 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:55:59.055019    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/865656be-da1e-4b37-9470-469ffc821015-extensions-socket-volume" pod "865656be-da1e-4b37-9470-469ffc821015" (UID: "865656be-da1e-4b37-9470-469ffc821015"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 19:55:59.056850 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:55:59.056825    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/865656be-da1e-4b37-9470-469ffc821015-kube-api-access-4ltc6" pod "865656be-da1e-4b37-9470-469ffc821015" (UID: "865656be-da1e-4b37-9470-469ffc821015"). InnerVolumeSpecName "kube-api-access-4ltc6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 19:55:59.155644 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:55:59.155581    6275 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4ltc6\" (UniqueName: \"kubernetes.io/projected/865656be-da1e-4b37-9470-469ffc821015-kube-api-access-4ltc6\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 19:55:59.155644 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:55:59.155612    6275 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/865656be-da1e-4b37-9470-469ffc821015-extensions-socket-volume\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 19:55:59.655750 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:55:59.655717    6275 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="865656be-da1e-4b37-9470-469ffc821015" path="/var/lib/kubelet/pods/865656be-da1e-4b37-9470-469ffc821015/volumes"
Oct 30 19:55:59.667808 ip-10-0-131-26 kubenswrapper[6275]: E1030 19:55:59.667782    6275 status_manager.go:1045] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6b76784d48-mfzkx\" is forbidden: User \"system:node:ip-10-0-131-26.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-26.ec2.internal' and this object" podUID="865656be-da1e-4b37-9470-469ffc821015" pod="kuadrant-system/kuadrant-operator-controller-manager-6b76784d48-mfzkx"
Oct 30 19:55:59.689697 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:55:59.689671    6275 generic.go:356] "Generic (PLEG): container finished" podID="865656be-da1e-4b37-9470-469ffc821015" containerID="08b38cf9251026d193605d63a7ffd93065d70b98db095818ff5c0636910503c1" exitCode=2
Oct 30 19:55:59.690023 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:55:59.689711    6275 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6b76784d48-mfzkx"
Oct 30 19:55:59.690023 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:55:59.689758    6275 scope.go:122] "RemoveContainer" containerID="08b38cf9251026d193605d63a7ffd93065d70b98db095818ff5c0636910503c1"
Oct 30 19:55:59.703985 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:55:59.703965    6275 scope.go:122] "RemoveContainer" containerID="08b38cf9251026d193605d63a7ffd93065d70b98db095818ff5c0636910503c1"
Oct 30 19:55:59.704266 ip-10-0-131-26 kubenswrapper[6275]: E1030 19:55:59.704242    6275 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"08b38cf9251026d193605d63a7ffd93065d70b98db095818ff5c0636910503c1\": container with ID starting with 08b38cf9251026d193605d63a7ffd93065d70b98db095818ff5c0636910503c1 not found: ID does not exist" containerID="08b38cf9251026d193605d63a7ffd93065d70b98db095818ff5c0636910503c1"
Oct 30 19:55:59.704308 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:55:59.704276    6275 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"08b38cf9251026d193605d63a7ffd93065d70b98db095818ff5c0636910503c1"} err="failed to get container status \"08b38cf9251026d193605d63a7ffd93065d70b98db095818ff5c0636910503c1\": rpc error: code = NotFound desc = could not find container \"08b38cf9251026d193605d63a7ffd93065d70b98db095818ff5c0636910503c1\": container with ID starting with 08b38cf9251026d193605d63a7ffd93065d70b98db095818ff5c0636910503c1 not found: ID does not exist"
Oct 30 19:55:59.706583 ip-10-0-131-26 kubenswrapper[6275]: E1030 19:55:59.706562    6275 status_manager.go:1045] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6b76784d48-mfzkx\" is forbidden: User \"system:node:ip-10-0-131-26.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-26.ec2.internal' and this object" podUID="865656be-da1e-4b37-9470-469ffc821015" pod="kuadrant-system/kuadrant-operator-controller-manager-6b76784d48-mfzkx"
Oct 30 19:56:10.698461 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:56:10.698409    6275 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-956956bc4-9gtfp"
Oct 30 19:56:23.704851 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:56:23.704818    6275 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-956956bc4-9gtfp"]
Oct 30 19:56:23.705357 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:56:23.705008    6275 kuberuntime_container.go:898] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-956956bc4-9gtfp" podUID="c5eaf47e-7d7e-4af6-9e43-1fced31cea5c" containerName="manager" containerID="cri-o://276aea2eef139145afbada16a9d79e0a3b3f1615575f91d1e998cd179f8c4bc4" gracePeriod=10
Oct 30 19:56:23.973849 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:56:23.973828    6275 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-956956bc4-9gtfp"
Oct 30 19:56:24.047799 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:56:24.047771    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/c5eaf47e-7d7e-4af6-9e43-1fced31cea5c-kube-api-access-nmwtq\" (UniqueName: \"kubernetes.io/projected/c5eaf47e-7d7e-4af6-9e43-1fced31cea5c-kube-api-access-nmwtq\") pod \"c5eaf47e-7d7e-4af6-9e43-1fced31cea5c\" (UID: \"c5eaf47e-7d7e-4af6-9e43-1fced31cea5c\") "
Oct 30 19:56:24.047912 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:56:24.047862    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c5eaf47e-7d7e-4af6-9e43-1fced31cea5c-extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c5eaf47e-7d7e-4af6-9e43-1fced31cea5c-extensions-socket-volume\") pod \"c5eaf47e-7d7e-4af6-9e43-1fced31cea5c\" (UID: \"c5eaf47e-7d7e-4af6-9e43-1fced31cea5c\") "
Oct 30 19:56:24.048228 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:56:24.048201    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c5eaf47e-7d7e-4af6-9e43-1fced31cea5c-extensions-socket-volume" pod "c5eaf47e-7d7e-4af6-9e43-1fced31cea5c" (UID: "c5eaf47e-7d7e-4af6-9e43-1fced31cea5c"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 19:56:24.049675 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:56:24.049652    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c5eaf47e-7d7e-4af6-9e43-1fced31cea5c-kube-api-access-nmwtq" pod "c5eaf47e-7d7e-4af6-9e43-1fced31cea5c" (UID: "c5eaf47e-7d7e-4af6-9e43-1fced31cea5c"). InnerVolumeSpecName "kube-api-access-nmwtq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 19:56:24.148972 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:56:24.148944    6275 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nmwtq\" (UniqueName: \"kubernetes.io/projected/c5eaf47e-7d7e-4af6-9e43-1fced31cea5c-kube-api-access-nmwtq\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 19:56:24.148972 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:56:24.148968    6275 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c5eaf47e-7d7e-4af6-9e43-1fced31cea5c-extensions-socket-volume\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 19:56:24.809092 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:56:24.809053    6275 generic.go:356] "Generic (PLEG): container finished" podID="c5eaf47e-7d7e-4af6-9e43-1fced31cea5c" containerID="276aea2eef139145afbada16a9d79e0a3b3f1615575f91d1e998cd179f8c4bc4" exitCode=0
Oct 30 19:56:24.809556 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:56:24.809098    6275 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-956956bc4-9gtfp"
Oct 30 19:56:24.809556 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:56:24.809137    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-956956bc4-9gtfp" event={"ID":"c5eaf47e-7d7e-4af6-9e43-1fced31cea5c","Type":"ContainerDied","Data":"276aea2eef139145afbada16a9d79e0a3b3f1615575f91d1e998cd179f8c4bc4"}
Oct 30 19:56:24.809556 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:56:24.809193    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-956956bc4-9gtfp" event={"ID":"c5eaf47e-7d7e-4af6-9e43-1fced31cea5c","Type":"ContainerDied","Data":"99ed58377fdd77b4e4860a96bcd4a32580e636f29cfe05121a6b36e1dd4f3de1"}
Oct 30 19:56:24.809556 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:56:24.809219    6275 scope.go:122] "RemoveContainer" containerID="276aea2eef139145afbada16a9d79e0a3b3f1615575f91d1e998cd179f8c4bc4"
Oct 30 19:56:24.818389 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:56:24.818373    6275 scope.go:122] "RemoveContainer" containerID="276aea2eef139145afbada16a9d79e0a3b3f1615575f91d1e998cd179f8c4bc4"
Oct 30 19:56:24.818714 ip-10-0-131-26 kubenswrapper[6275]: E1030 19:56:24.818694    6275 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"276aea2eef139145afbada16a9d79e0a3b3f1615575f91d1e998cd179f8c4bc4\": container with ID starting with 276aea2eef139145afbada16a9d79e0a3b3f1615575f91d1e998cd179f8c4bc4 not found: ID does not exist" containerID="276aea2eef139145afbada16a9d79e0a3b3f1615575f91d1e998cd179f8c4bc4"
Oct 30 19:56:24.818755 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:56:24.818733    6275 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"276aea2eef139145afbada16a9d79e0a3b3f1615575f91d1e998cd179f8c4bc4"} err="failed to get container status \"276aea2eef139145afbada16a9d79e0a3b3f1615575f91d1e998cd179f8c4bc4\": rpc error: code = NotFound desc = could not find container \"276aea2eef139145afbada16a9d79e0a3b3f1615575f91d1e998cd179f8c4bc4\": container with ID starting with 276aea2eef139145afbada16a9d79e0a3b3f1615575f91d1e998cd179f8c4bc4 not found: ID does not exist"
Oct 30 19:56:24.878266 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:56:24.878236    6275 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-956956bc4-9gtfp"]
Oct 30 19:56:24.894233 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:56:24.894208    6275 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-956956bc4-9gtfp"]
Oct 30 19:56:25.655375 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:56:25.655341    6275 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="c5eaf47e-7d7e-4af6-9e43-1fced31cea5c" path="/var/lib/kubelet/pods/c5eaf47e-7d7e-4af6-9e43-1fced31cea5c/volumes"
Oct 30 19:56:26.254642 ip-10-0-131-26 kubenswrapper[6275]: E1030 19:56:26.254601    6275 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-fwc77" containerName="extractor"
Oct 30 19:56:43.540218 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:56:43.540182    6275 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-74dfcfb894-l2k2x"]
Oct 30 19:56:43.540601 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:56:43.540538    6275 cpu_manager.go:414] "containerMap: removing container" podUID="c5eaf47e-7d7e-4af6-9e43-1fced31cea5c" containerName="manager"
Oct 30 19:56:43.540601 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:56:43.540550    6275 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="c5eaf47e-7d7e-4af6-9e43-1fced31cea5c" containerName="manager"
Oct 30 19:56:43.540601 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:56:43.540584    6275 cpu_manager.go:414] "containerMap: removing container" podUID="865656be-da1e-4b37-9470-469ffc821015" containerName="manager"
Oct 30 19:56:43.540601 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:56:43.540589    6275 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="865656be-da1e-4b37-9470-469ffc821015" containerName="manager"
Oct 30 19:56:43.540734 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:56:43.540647    6275 memory_manager.go:365] "RemoveStaleState removing state" podUID="865656be-da1e-4b37-9470-469ffc821015" containerName="manager"
Oct 30 19:56:43.540734 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:56:43.540656    6275 memory_manager.go:365] "RemoveStaleState removing state" podUID="c5eaf47e-7d7e-4af6-9e43-1fced31cea5c" containerName="manager"
Oct 30 19:56:43.545274 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:56:43.545257    6275 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-74dfcfb894-l2k2x"
Oct 30 19:56:43.564399 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:56:43.564375    6275 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-74dfcfb894-l2k2x"]
Oct 30 19:56:43.566007 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:56:43.565984    6275 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Oct 30 19:56:43.590205 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:56:43.590183    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/38bb1b51-f4b6-492f-9e00-f7c51d03a130-config-file\") pod \"limitador-limitador-74dfcfb894-l2k2x\" (UID: \"38bb1b51-f4b6-492f-9e00-f7c51d03a130\") " pod="kuadrant-system/limitador-limitador-74dfcfb894-l2k2x"
Oct 30 19:56:43.590317 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:56:43.590224    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6fzhw\" (UniqueName: \"kubernetes.io/projected/38bb1b51-f4b6-492f-9e00-f7c51d03a130-kube-api-access-6fzhw\") pod \"limitador-limitador-74dfcfb894-l2k2x\" (UID: \"38bb1b51-f4b6-492f-9e00-f7c51d03a130\") " pod="kuadrant-system/limitador-limitador-74dfcfb894-l2k2x"
Oct 30 19:56:43.671134 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:56:43.671106    6275 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-74dfcfb894-l2k2x"]
Oct 30 19:56:43.690914 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:56:43.690887    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/38bb1b51-f4b6-492f-9e00-f7c51d03a130-config-file\") pod \"limitador-limitador-74dfcfb894-l2k2x\" (UID: \"38bb1b51-f4b6-492f-9e00-f7c51d03a130\") " pod="kuadrant-system/limitador-limitador-74dfcfb894-l2k2x"
Oct 30 19:56:43.691017 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:56:43.690928    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6fzhw\" (UniqueName: \"kubernetes.io/projected/38bb1b51-f4b6-492f-9e00-f7c51d03a130-kube-api-access-6fzhw\") pod \"limitador-limitador-74dfcfb894-l2k2x\" (UID: \"38bb1b51-f4b6-492f-9e00-f7c51d03a130\") " pod="kuadrant-system/limitador-limitador-74dfcfb894-l2k2x"
Oct 30 19:56:43.691522 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:56:43.691506    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/38bb1b51-f4b6-492f-9e00-f7c51d03a130-config-file\") pod \"limitador-limitador-74dfcfb894-l2k2x\" (UID: \"38bb1b51-f4b6-492f-9e00-f7c51d03a130\") " pod="kuadrant-system/limitador-limitador-74dfcfb894-l2k2x"
Oct 30 19:56:43.716265 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:56:43.716236    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6fzhw\" (UniqueName: \"kubernetes.io/projected/38bb1b51-f4b6-492f-9e00-f7c51d03a130-kube-api-access-6fzhw\") pod \"limitador-limitador-74dfcfb894-l2k2x\" (UID: \"38bb1b51-f4b6-492f-9e00-f7c51d03a130\") " pod="kuadrant-system/limitador-limitador-74dfcfb894-l2k2x"
Oct 30 19:56:43.856911 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:56:43.856859    6275 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-74dfcfb894-l2k2x"
Oct 30 19:56:44.158242 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:56:44.158213    6275 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-74dfcfb894-l2k2x"]
Oct 30 19:56:44.160053 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:56:44.160023    6275 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod38bb1b51_f4b6_492f_9e00_f7c51d03a130.slice/crio-16fead7deaf17bf2498020dc258cb076ed60dc5d0ec4c4b98c5a348599dad7b3 WatchSource:0}: Error finding container 16fead7deaf17bf2498020dc258cb076ed60dc5d0ec4c4b98c5a348599dad7b3: Status 404 returned error can't find the container with id 16fead7deaf17bf2498020dc258cb076ed60dc5d0ec4c4b98c5a348599dad7b3
Oct 30 19:56:44.913828 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:56:44.913791    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-74dfcfb894-l2k2x" event={"ID":"38bb1b51-f4b6-492f-9e00-f7c51d03a130","Type":"ContainerStarted","Data":"16fead7deaf17bf2498020dc258cb076ed60dc5d0ec4c4b98c5a348599dad7b3"}
Oct 30 19:56:45.422752 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:56:45.422715    6275 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-56c6c9ddd5-xzqjs"]
Oct 30 19:56:45.426049 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:56:45.426019    6275 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-56c6c9ddd5-xzqjs"
Oct 30 19:56:45.442720 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:56:45.442691    6275 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-56c6c9ddd5-xzqjs"]
Oct 30 19:56:45.453359 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:56:45.453326    6275 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-fznln\""
Oct 30 19:56:45.505547 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:56:45.505522    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zk94h\" (UniqueName: \"kubernetes.io/projected/af9e2ff5-5b25-4487-9580-358924734c7c-kube-api-access-zk94h\") pod \"authorino-56c6c9ddd5-xzqjs\" (UID: \"af9e2ff5-5b25-4487-9580-358924734c7c\") " pod="kuadrant-system/authorino-56c6c9ddd5-xzqjs"
Oct 30 19:56:45.606246 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:56:45.606220    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zk94h\" (UniqueName: \"kubernetes.io/projected/af9e2ff5-5b25-4487-9580-358924734c7c-kube-api-access-zk94h\") pod \"authorino-56c6c9ddd5-xzqjs\" (UID: \"af9e2ff5-5b25-4487-9580-358924734c7c\") " pod="kuadrant-system/authorino-56c6c9ddd5-xzqjs"
Oct 30 19:56:45.631228 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:56:45.631206    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zk94h\" (UniqueName: \"kubernetes.io/projected/af9e2ff5-5b25-4487-9580-358924734c7c-kube-api-access-zk94h\") pod \"authorino-56c6c9ddd5-xzqjs\" (UID: \"af9e2ff5-5b25-4487-9580-358924734c7c\") " pod="kuadrant-system/authorino-56c6c9ddd5-xzqjs"
Oct 30 19:56:45.739123 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:56:45.739104    6275 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-56c6c9ddd5-xzqjs"
Oct 30 19:56:45.920809 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:56:45.920776    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-74dfcfb894-l2k2x" event={"ID":"38bb1b51-f4b6-492f-9e00-f7c51d03a130","Type":"ContainerStarted","Data":"cdd20f01b5b5bbf70754e3717e150f96995eb38062b9ffab46b5276c2db137c3"}
Oct 30 19:56:45.921239 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:56:45.920882    6275 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-74dfcfb894-l2k2x"
Oct 30 19:56:45.966210 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:56:45.966167    6275 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-74dfcfb894-l2k2x" podStartSLOduration=1.609893708 podStartE2EDuration="2.966155853s" totalImagesPullingTime="1.356262145s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 19:56:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 19:56:45.964699755 +0000 UTC m=+516.426426618" watchObservedRunningTime="2026-10-30 19:56:45.966155853 +0000 UTC m=+516.427882721"
Oct 30 19:56:46.033133 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:56:46.033113    6275 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-56c6c9ddd5-xzqjs"]
Oct 30 19:56:46.034471 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:56:46.034444    6275 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podaf9e2ff5_5b25_4487_9580_358924734c7c.slice/crio-6f55683ba4d56864d0f4089f9d951c428a9295c9a9dfef662b0b8f073b9ddae5 WatchSource:0}: Error finding container 6f55683ba4d56864d0f4089f9d951c428a9295c9a9dfef662b0b8f073b9ddae5: Status 404 returned error can't find the container with id 6f55683ba4d56864d0f4089f9d951c428a9295c9a9dfef662b0b8f073b9ddae5
Oct 30 19:56:46.926899 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:56:46.926865    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-56c6c9ddd5-xzqjs" event={"ID":"af9e2ff5-5b25-4487-9580-358924734c7c","Type":"ContainerStarted","Data":"6f55683ba4d56864d0f4089f9d951c428a9295c9a9dfef662b0b8f073b9ddae5"}
Oct 30 19:56:48.937963 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:56:48.937924    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-56c6c9ddd5-xzqjs" event={"ID":"af9e2ff5-5b25-4487-9580-358924734c7c","Type":"ContainerStarted","Data":"929d5d237992798d6dd179c80de8cd68573c6d3f14f2a2f693e23b5c639a0b39"}
Oct 30 19:56:48.982835 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:56:48.982781    6275 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/authorino-56c6c9ddd5-xzqjs" podStartSLOduration=2.139118876 podStartE2EDuration="3.982766573s" totalImagesPullingTime="1.843647697s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 19:56:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 19:56:48.981601331 +0000 UTC m=+519.443328197" watchObservedRunningTime="2026-10-30 19:56:48.982766573 +0000 UTC m=+519.444493435"
Oct 30 19:56:56.254585 ip-10-0-131-26 kubenswrapper[6275]: E1030 19:56:56.254532    6275 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-fwc77" containerName="extractor"
Oct 30 19:56:56.927916 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:56:56.927885    6275 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-74dfcfb894-l2k2x"
Oct 30 19:57:00.377359 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:57:00.377327    6275 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-74dfcfb894-l2k2x"]
Oct 30 19:57:00.379787 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:57:00.377526    6275 kuberuntime_container.go:898] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-74dfcfb894-l2k2x" podUID="38bb1b51-f4b6-492f-9e00-f7c51d03a130" containerName="limitador" containerID="cri-o://cdd20f01b5b5bbf70754e3717e150f96995eb38062b9ffab46b5276c2db137c3" gracePeriod=30
Oct 30 19:57:00.997990 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:57:00.997960    6275 generic.go:356] "Generic (PLEG): container finished" podID="38bb1b51-f4b6-492f-9e00-f7c51d03a130" containerID="cdd20f01b5b5bbf70754e3717e150f96995eb38062b9ffab46b5276c2db137c3" exitCode=0
Oct 30 19:57:00.998120 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:57:00.998035    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-74dfcfb894-l2k2x" event={"ID":"38bb1b51-f4b6-492f-9e00-f7c51d03a130","Type":"ContainerDied","Data":"cdd20f01b5b5bbf70754e3717e150f96995eb38062b9ffab46b5276c2db137c3"}
Oct 30 19:57:01.316698 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:57:01.316677    6275 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-74dfcfb894-l2k2x"
Oct 30 19:57:01.431957 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:57:01.431928    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/38bb1b51-f4b6-492f-9e00-f7c51d03a130-config-file\" (UniqueName: \"kubernetes.io/configmap/38bb1b51-f4b6-492f-9e00-f7c51d03a130-config-file\") pod \"38bb1b51-f4b6-492f-9e00-f7c51d03a130\" (UID: \"38bb1b51-f4b6-492f-9e00-f7c51d03a130\") "
Oct 30 19:57:01.432274 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:57:01.431970    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/38bb1b51-f4b6-492f-9e00-f7c51d03a130-kube-api-access-6fzhw\" (UniqueName: \"kubernetes.io/projected/38bb1b51-f4b6-492f-9e00-f7c51d03a130-kube-api-access-6fzhw\") pod \"38bb1b51-f4b6-492f-9e00-f7c51d03a130\" (UID: \"38bb1b51-f4b6-492f-9e00-f7c51d03a130\") "
Oct 30 19:57:01.432274 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:57:01.432239    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/38bb1b51-f4b6-492f-9e00-f7c51d03a130-config-file" pod "38bb1b51-f4b6-492f-9e00-f7c51d03a130" (UID: "38bb1b51-f4b6-492f-9e00-f7c51d03a130"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 19:57:01.433881 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:57:01.433862    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/38bb1b51-f4b6-492f-9e00-f7c51d03a130-kube-api-access-6fzhw" pod "38bb1b51-f4b6-492f-9e00-f7c51d03a130" (UID: "38bb1b51-f4b6-492f-9e00-f7c51d03a130"). InnerVolumeSpecName "kube-api-access-6fzhw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 19:57:01.533365 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:57:01.533340    6275 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/38bb1b51-f4b6-492f-9e00-f7c51d03a130-config-file\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 19:57:01.533365 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:57:01.533365    6275 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6fzhw\" (UniqueName: \"kubernetes.io/projected/38bb1b51-f4b6-492f-9e00-f7c51d03a130-kube-api-access-6fzhw\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 19:57:02.004864 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:57:02.004837    6275 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-74dfcfb894-l2k2x"
Oct 30 19:57:02.005017 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:57:02.004858    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-74dfcfb894-l2k2x" event={"ID":"38bb1b51-f4b6-492f-9e00-f7c51d03a130","Type":"ContainerDied","Data":"16fead7deaf17bf2498020dc258cb076ed60dc5d0ec4c4b98c5a348599dad7b3"}
Oct 30 19:57:02.005017 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:57:02.004916    6275 scope.go:122] "RemoveContainer" containerID="cdd20f01b5b5bbf70754e3717e150f96995eb38062b9ffab46b5276c2db137c3"
Oct 30 19:57:02.065177 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:57:02.065146    6275 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-74dfcfb894-l2k2x"]
Oct 30 19:57:02.077992 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:57:02.077970    6275 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-74dfcfb894-l2k2x"]
Oct 30 19:57:03.415072 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:57:03.415041    6275 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-7cdbf6dc44-6gzlb"]
Oct 30 19:57:03.415450 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:57:03.415402    6275 cpu_manager.go:414] "containerMap: removing container" podUID="38bb1b51-f4b6-492f-9e00-f7c51d03a130" containerName="limitador"
Oct 30 19:57:03.415450 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:57:03.415427    6275 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="38bb1b51-f4b6-492f-9e00-f7c51d03a130" containerName="limitador"
Oct 30 19:57:03.415530 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:57:03.415511    6275 memory_manager.go:365] "RemoveStaleState removing state" podUID="38bb1b51-f4b6-492f-9e00-f7c51d03a130" containerName="limitador"
Oct 30 19:57:03.419763 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:57:03.419747    6275 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-6gzlb"
Oct 30 19:57:03.439528 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:57:03.439508    6275 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-7cdbf6dc44-6gzlb"]
Oct 30 19:57:03.450640 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:57:03.450617    6275 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\""
Oct 30 19:57:03.450640 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:57:03.450637    6275 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Oct 30 19:57:03.450805 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:57:03.450644    6275 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Oct 30 19:57:03.450805 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:57:03.450725    6275 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-t46gv\""
Oct 30 19:57:03.552240 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:57:03.552211    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/063c67e9-98a2-410d-84d9-26c97e78ec2d-data\") pod \"postgres-7cdbf6dc44-6gzlb\" (UID: \"063c67e9-98a2-410d-84d9-26c97e78ec2d\") " pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-6gzlb"
Oct 30 19:57:03.552387 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:57:03.552253    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jmx27\" (UniqueName: \"kubernetes.io/projected/063c67e9-98a2-410d-84d9-26c97e78ec2d-kube-api-access-jmx27\") pod \"postgres-7cdbf6dc44-6gzlb\" (UID: \"063c67e9-98a2-410d-84d9-26c97e78ec2d\") " pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-6gzlb"
Oct 30 19:57:03.653372 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:57:03.653345    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/063c67e9-98a2-410d-84d9-26c97e78ec2d-data\") pod \"postgres-7cdbf6dc44-6gzlb\" (UID: \"063c67e9-98a2-410d-84d9-26c97e78ec2d\") " pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-6gzlb"
Oct 30 19:57:03.653506 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:57:03.653380    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jmx27\" (UniqueName: \"kubernetes.io/projected/063c67e9-98a2-410d-84d9-26c97e78ec2d-kube-api-access-jmx27\") pod \"postgres-7cdbf6dc44-6gzlb\" (UID: \"063c67e9-98a2-410d-84d9-26c97e78ec2d\") " pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-6gzlb"
Oct 30 19:57:03.653744 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:57:03.653724    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/063c67e9-98a2-410d-84d9-26c97e78ec2d-data\") pod \"postgres-7cdbf6dc44-6gzlb\" (UID: \"063c67e9-98a2-410d-84d9-26c97e78ec2d\") " pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-6gzlb"
Oct 30 19:57:03.655205 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:57:03.655176    6275 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="38bb1b51-f4b6-492f-9e00-f7c51d03a130" path="/var/lib/kubelet/pods/38bb1b51-f4b6-492f-9e00-f7c51d03a130/volumes"
Oct 30 19:57:03.679151 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:57:03.679096    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jmx27\" (UniqueName: \"kubernetes.io/projected/063c67e9-98a2-410d-84d9-26c97e78ec2d-kube-api-access-jmx27\") pod \"postgres-7cdbf6dc44-6gzlb\" (UID: \"063c67e9-98a2-410d-84d9-26c97e78ec2d\") " pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-6gzlb"
Oct 30 19:57:03.732057 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:57:03.732039    6275 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-6gzlb"
Oct 30 19:57:04.032224 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:57:04.032189    6275 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-7cdbf6dc44-6gzlb"]
Oct 30 19:57:04.033899 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:57:04.033870    6275 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod063c67e9_98a2_410d_84d9_26c97e78ec2d.slice/crio-ff0dc6db970370df1fa1b58d81c22ed8df413bdd85a8e08d8f23cb9c17d4a8d6 WatchSource:0}: Error finding container ff0dc6db970370df1fa1b58d81c22ed8df413bdd85a8e08d8f23cb9c17d4a8d6: Status 404 returned error can't find the container with id ff0dc6db970370df1fa1b58d81c22ed8df413bdd85a8e08d8f23cb9c17d4a8d6
Oct 30 19:57:05.024098 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:57:05.024028    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-6gzlb" event={"ID":"063c67e9-98a2-410d-84d9-26c97e78ec2d","Type":"ContainerStarted","Data":"ff0dc6db970370df1fa1b58d81c22ed8df413bdd85a8e08d8f23cb9c17d4a8d6"}
Oct 30 19:57:09.047095 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:57:09.047060    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-6gzlb" event={"ID":"063c67e9-98a2-410d-84d9-26c97e78ec2d","Type":"ContainerStarted","Data":"cb5bee86b3770d861107847233183cedfeab4abbad31a5cb180d85333dac8826"}
Oct 30 19:57:09.047471 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:57:09.047163    6275 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-6gzlb"
Oct 30 19:57:09.091188 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:57:09.091101    6275 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-6gzlb" podStartSLOduration=1.298960897 podStartE2EDuration="6.09108878s" totalImagesPullingTime="4.792127883s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 19:57:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 19:57:09.090256989 +0000 UTC m=+539.551983853" watchObservedRunningTime="2026-10-30 19:57:09.09108878 +0000 UTC m=+539.552815703"
Oct 30 19:57:15.082261 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:57:15.082224    6275 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-6gzlb"
Oct 30 19:57:17.866171 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:57:17.866136    6275 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-56c6c9ddd5-xzqjs"]
Oct 30 19:57:17.866659 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:57:17.866348    6275 kuberuntime_container.go:898] "Killing container with a grace period" pod="kuadrant-system/authorino-56c6c9ddd5-xzqjs" podUID="af9e2ff5-5b25-4487-9580-358924734c7c" containerName="authorino" containerID="cri-o://929d5d237992798d6dd179c80de8cd68573c6d3f14f2a2f693e23b5c639a0b39" gracePeriod=30
Oct 30 19:57:18.096239 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:57:18.096202    6275 generic.go:356] "Generic (PLEG): container finished" podID="af9e2ff5-5b25-4487-9580-358924734c7c" containerID="929d5d237992798d6dd179c80de8cd68573c6d3f14f2a2f693e23b5c639a0b39" exitCode=0
Oct 30 19:57:18.096383 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:57:18.096279    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-56c6c9ddd5-xzqjs" event={"ID":"af9e2ff5-5b25-4487-9580-358924734c7c","Type":"ContainerDied","Data":"929d5d237992798d6dd179c80de8cd68573c6d3f14f2a2f693e23b5c639a0b39"}
Oct 30 19:57:18.118381 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:57:18.118332    6275 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-56c6c9ddd5-xzqjs"
Oct 30 19:57:18.280329 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:57:18.280300    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/af9e2ff5-5b25-4487-9580-358924734c7c-kube-api-access-zk94h\" (UniqueName: \"kubernetes.io/projected/af9e2ff5-5b25-4487-9580-358924734c7c-kube-api-access-zk94h\") pod \"af9e2ff5-5b25-4487-9580-358924734c7c\" (UID: \"af9e2ff5-5b25-4487-9580-358924734c7c\") "
Oct 30 19:57:18.282261 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:57:18.282235    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/af9e2ff5-5b25-4487-9580-358924734c7c-kube-api-access-zk94h" pod "af9e2ff5-5b25-4487-9580-358924734c7c" (UID: "af9e2ff5-5b25-4487-9580-358924734c7c"). InnerVolumeSpecName "kube-api-access-zk94h". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 19:57:18.381731 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:57:18.381678    6275 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zk94h\" (UniqueName: \"kubernetes.io/projected/af9e2ff5-5b25-4487-9580-358924734c7c-kube-api-access-zk94h\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 19:57:19.102698 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:57:19.102666    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-56c6c9ddd5-xzqjs" event={"ID":"af9e2ff5-5b25-4487-9580-358924734c7c","Type":"ContainerDied","Data":"6f55683ba4d56864d0f4089f9d951c428a9295c9a9dfef662b0b8f073b9ddae5"}
Oct 30 19:57:19.102698 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:57:19.102694    6275 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-56c6c9ddd5-xzqjs"
Oct 30 19:57:19.103153 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:57:19.102714    6275 scope.go:122] "RemoveContainer" containerID="929d5d237992798d6dd179c80de8cd68573c6d3f14f2a2f693e23b5c639a0b39"
Oct 30 19:57:19.160423 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:57:19.160381    6275 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-56c6c9ddd5-xzqjs"]
Oct 30 19:57:19.173155 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:57:19.173133    6275 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-56c6c9ddd5-xzqjs"]
Oct 30 19:57:19.654973 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:57:19.654950    6275 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="af9e2ff5-5b25-4487-9580-358924734c7c" path="/var/lib/kubelet/pods/af9e2ff5-5b25-4487-9580-358924734c7c/volumes"
Oct 30 19:57:25.454329 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:57:25.454258    6275 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-577f596567-qjrlc"]
Oct 30 19:57:25.454684 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:57:25.454652    6275 cpu_manager.go:414] "containerMap: removing container" podUID="af9e2ff5-5b25-4487-9580-358924734c7c" containerName="authorino"
Oct 30 19:57:25.454684 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:57:25.454664    6275 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="af9e2ff5-5b25-4487-9580-358924734c7c" containerName="authorino"
Oct 30 19:57:25.454756 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:57:25.454742    6275 memory_manager.go:365] "RemoveStaleState removing state" podUID="af9e2ff5-5b25-4487-9580-358924734c7c" containerName="authorino"
Oct 30 19:57:25.457977 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:57:25.457960    6275 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-577f596567-qjrlc"
Oct 30 19:57:25.482369 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:57:25.482350    6275 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\""
Oct 30 19:57:25.486949 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:57:25.486912    6275 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Oct 30 19:57:25.489175 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:57:25.489117    6275 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Oct 30 19:57:25.491094 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:57:25.491076    6275 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-577f596567-qjrlc"]
Oct 30 19:57:25.495003 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:57:25.494985    6275 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-wcnv4\""
Oct 30 19:57:25.640255 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:57:25.640230    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7bd41bb0-d03d-4135-a7dc-001fe9c6055f-metrics-certs\") pod \"maas-controller-577f596567-qjrlc\" (UID: \"7bd41bb0-d03d-4135-a7dc-001fe9c6055f\") " pod="opendatahub/maas-controller-577f596567-qjrlc"
Oct 30 19:57:25.640369 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:57:25.640280    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mptwh\" (UniqueName: \"kubernetes.io/projected/7bd41bb0-d03d-4135-a7dc-001fe9c6055f-kube-api-access-mptwh\") pod \"maas-controller-577f596567-qjrlc\" (UID: \"7bd41bb0-d03d-4135-a7dc-001fe9c6055f\") " pod="opendatahub/maas-controller-577f596567-qjrlc"
Oct 30 19:57:25.640369 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:57:25.640302    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7bd41bb0-d03d-4135-a7dc-001fe9c6055f-webhook-cert\") pod \"maas-controller-577f596567-qjrlc\" (UID: \"7bd41bb0-d03d-4135-a7dc-001fe9c6055f\") " pod="opendatahub/maas-controller-577f596567-qjrlc"
Oct 30 19:57:25.741128 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:57:25.741095    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mptwh\" (UniqueName: \"kubernetes.io/projected/7bd41bb0-d03d-4135-a7dc-001fe9c6055f-kube-api-access-mptwh\") pod \"maas-controller-577f596567-qjrlc\" (UID: \"7bd41bb0-d03d-4135-a7dc-001fe9c6055f\") " pod="opendatahub/maas-controller-577f596567-qjrlc"
Oct 30 19:57:25.741266 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:57:25.741137    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7bd41bb0-d03d-4135-a7dc-001fe9c6055f-webhook-cert\") pod \"maas-controller-577f596567-qjrlc\" (UID: \"7bd41bb0-d03d-4135-a7dc-001fe9c6055f\") " pod="opendatahub/maas-controller-577f596567-qjrlc"
Oct 30 19:57:25.741266 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:57:25.741208    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7bd41bb0-d03d-4135-a7dc-001fe9c6055f-metrics-certs\") pod \"maas-controller-577f596567-qjrlc\" (UID: \"7bd41bb0-d03d-4135-a7dc-001fe9c6055f\") " pod="opendatahub/maas-controller-577f596567-qjrlc"
Oct 30 19:57:25.743677 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:57:25.743653    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7bd41bb0-d03d-4135-a7dc-001fe9c6055f-metrics-certs\") pod \"maas-controller-577f596567-qjrlc\" (UID: \"7bd41bb0-d03d-4135-a7dc-001fe9c6055f\") " pod="opendatahub/maas-controller-577f596567-qjrlc"
Oct 30 19:57:25.743773 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:57:25.743687    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7bd41bb0-d03d-4135-a7dc-001fe9c6055f-webhook-cert\") pod \"maas-controller-577f596567-qjrlc\" (UID: \"7bd41bb0-d03d-4135-a7dc-001fe9c6055f\") " pod="opendatahub/maas-controller-577f596567-qjrlc"
Oct 30 19:57:25.767118 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:57:25.767094    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mptwh\" (UniqueName: \"kubernetes.io/projected/7bd41bb0-d03d-4135-a7dc-001fe9c6055f-kube-api-access-mptwh\") pod \"maas-controller-577f596567-qjrlc\" (UID: \"7bd41bb0-d03d-4135-a7dc-001fe9c6055f\") " pod="opendatahub/maas-controller-577f596567-qjrlc"
Oct 30 19:57:25.770938 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:57:25.770921    6275 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-577f596567-qjrlc"
Oct 30 19:57:25.889252 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:57:25.889217    6275 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-774477d6c-n9tw6"]
Oct 30 19:57:25.894001 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:57:25.893981    6275 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-774477d6c-n9tw6"
Oct 30 19:57:25.920998 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:57:25.920978    6275 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-774477d6c-n9tw6"]
Oct 30 19:57:26.043137 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:57:26.043082    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7aed72fd-804a-45b7-9bda-ed055d3a3d6f-metrics-certs\") pod \"maas-controller-774477d6c-n9tw6\" (UID: \"7aed72fd-804a-45b7-9bda-ed055d3a3d6f\") " pod="opendatahub/maas-controller-774477d6c-n9tw6"
Oct 30 19:57:26.043137 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:57:26.043126    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7aed72fd-804a-45b7-9bda-ed055d3a3d6f-webhook-cert\") pod \"maas-controller-774477d6c-n9tw6\" (UID: \"7aed72fd-804a-45b7-9bda-ed055d3a3d6f\") " pod="opendatahub/maas-controller-774477d6c-n9tw6"
Oct 30 19:57:26.043276 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:57:26.043245    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6b4hx\" (UniqueName: \"kubernetes.io/projected/7aed72fd-804a-45b7-9bda-ed055d3a3d6f-kube-api-access-6b4hx\") pod \"maas-controller-774477d6c-n9tw6\" (UID: \"7aed72fd-804a-45b7-9bda-ed055d3a3d6f\") " pod="opendatahub/maas-controller-774477d6c-n9tw6"
Oct 30 19:57:26.074275 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:57:26.074254    6275 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-577f596567-qjrlc"]
Oct 30 19:57:26.076038 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:57:26.076012    6275 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7bd41bb0_d03d_4135_a7dc_001fe9c6055f.slice/crio-518d6bc2d5a0e03a6610fcdb745f498b373cd8d0924325bf9cb29479b1fbdc58 WatchSource:0}: Error finding container 518d6bc2d5a0e03a6610fcdb745f498b373cd8d0924325bf9cb29479b1fbdc58: Status 404 returned error can't find the container with id 518d6bc2d5a0e03a6610fcdb745f498b373cd8d0924325bf9cb29479b1fbdc58
Oct 30 19:57:26.144130 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:57:26.144106    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6b4hx\" (UniqueName: \"kubernetes.io/projected/7aed72fd-804a-45b7-9bda-ed055d3a3d6f-kube-api-access-6b4hx\") pod \"maas-controller-774477d6c-n9tw6\" (UID: \"7aed72fd-804a-45b7-9bda-ed055d3a3d6f\") " pod="opendatahub/maas-controller-774477d6c-n9tw6"
Oct 30 19:57:26.144246 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:57:26.144144    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7aed72fd-804a-45b7-9bda-ed055d3a3d6f-metrics-certs\") pod \"maas-controller-774477d6c-n9tw6\" (UID: \"7aed72fd-804a-45b7-9bda-ed055d3a3d6f\") " pod="opendatahub/maas-controller-774477d6c-n9tw6"
Oct 30 19:57:26.144246 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:57:26.144170    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7aed72fd-804a-45b7-9bda-ed055d3a3d6f-webhook-cert\") pod \"maas-controller-774477d6c-n9tw6\" (UID: \"7aed72fd-804a-45b7-9bda-ed055d3a3d6f\") " pod="opendatahub/maas-controller-774477d6c-n9tw6"
Oct 30 19:57:26.146707 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:57:26.146681    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7aed72fd-804a-45b7-9bda-ed055d3a3d6f-metrics-certs\") pod \"maas-controller-774477d6c-n9tw6\" (UID: \"7aed72fd-804a-45b7-9bda-ed055d3a3d6f\") " pod="opendatahub/maas-controller-774477d6c-n9tw6"
Oct 30 19:57:26.146805 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:57:26.146693    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7aed72fd-804a-45b7-9bda-ed055d3a3d6f-webhook-cert\") pod \"maas-controller-774477d6c-n9tw6\" (UID: \"7aed72fd-804a-45b7-9bda-ed055d3a3d6f\") " pod="opendatahub/maas-controller-774477d6c-n9tw6"
Oct 30 19:57:26.146805 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:57:26.146743    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-577f596567-qjrlc" event={"ID":"7bd41bb0-d03d-4135-a7dc-001fe9c6055f","Type":"ContainerStarted","Data":"518d6bc2d5a0e03a6610fcdb745f498b373cd8d0924325bf9cb29479b1fbdc58"}
Oct 30 19:57:26.170341 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:57:26.170316    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6b4hx\" (UniqueName: \"kubernetes.io/projected/7aed72fd-804a-45b7-9bda-ed055d3a3d6f-kube-api-access-6b4hx\") pod \"maas-controller-774477d6c-n9tw6\" (UID: \"7aed72fd-804a-45b7-9bda-ed055d3a3d6f\") " pod="opendatahub/maas-controller-774477d6c-n9tw6"
Oct 30 19:57:26.207203 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:57:26.207180    6275 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-774477d6c-n9tw6"
Oct 30 19:57:26.253837 ip-10-0-131-26 kubenswrapper[6275]: E1030 19:57:26.253800    6275 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-fwc77" containerName="extractor"
Oct 30 19:57:26.532868 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:57:26.532841    6275 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7aed72fd_804a_45b7_9bda_ed055d3a3d6f.slice/crio-baa3ca781a35c6429f4797ab9561c4372f7c2a7a20e2e7e44e466686b2bbc7a7 WatchSource:0}: Error finding container baa3ca781a35c6429f4797ab9561c4372f7c2a7a20e2e7e44e466686b2bbc7a7: Status 404 returned error can't find the container with id baa3ca781a35c6429f4797ab9561c4372f7c2a7a20e2e7e44e466686b2bbc7a7
Oct 30 19:57:26.554559 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:57:26.554536    6275 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-774477d6c-n9tw6"]
Oct 30 19:57:27.157580 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:57:27.157541    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-774477d6c-n9tw6" event={"ID":"7aed72fd-804a-45b7-9bda-ed055d3a3d6f","Type":"ContainerStarted","Data":"baa3ca781a35c6429f4797ab9561c4372f7c2a7a20e2e7e44e466686b2bbc7a7"}
Oct 30 19:57:29.170950 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:57:29.170866    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-577f596567-qjrlc" event={"ID":"7bd41bb0-d03d-4135-a7dc-001fe9c6055f","Type":"ContainerStarted","Data":"3f31c2e39cb77a7d5c8b31b8e3298088d274394105866542d658205b03628ad7"}
Oct 30 19:57:29.170950 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:57:29.170932    6275 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-577f596567-qjrlc"
Oct 30 19:57:29.220689 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:57:29.220642    6275 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/maas-controller-577f596567-qjrlc" podStartSLOduration=1.4757440179999999 podStartE2EDuration="4.220624965s" totalImagesPullingTime="2.744880947s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 19:57:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 19:57:29.218364459 +0000 UTC m=+559.680091322" watchObservedRunningTime="2026-10-30 19:57:29.220624965 +0000 UTC m=+559.682351831"
Oct 30 19:57:30.177647 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:57:30.177607    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-774477d6c-n9tw6" event={"ID":"7aed72fd-804a-45b7-9bda-ed055d3a3d6f","Type":"ContainerStarted","Data":"4134c5b5f7c9bf89465d87d0f11fe6dea93337767b8440cd280aa9f73d98204c"}
Oct 30 19:57:30.178083 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:57:30.177673    6275 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-774477d6c-n9tw6"
Oct 30 19:57:30.227739 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:57:30.227693    6275 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/maas-controller-774477d6c-n9tw6" podStartSLOduration=2.587788579 podStartE2EDuration="5.22767719s" totalImagesPullingTime="2.639888611s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 19:57:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 19:57:30.226740184 +0000 UTC m=+560.688467044" watchObservedRunningTime="2026-10-30 19:57:30.22767719 +0000 UTC m=+560.689404053"
Oct 30 19:57:33.000265 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:57:33.000230    6275 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/usage-logs-tenancy-proxy-7d94f55f4b-pqsbj"]
Oct 30 19:57:33.003889 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:57:33.003861    6275 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/usage-logs-tenancy-proxy-7d94f55f4b-pqsbj"
Oct 30 19:57:33.025902 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:57:33.025875    6275 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/usage-logs-tenancy-proxy-7d94f55f4b-pqsbj"]
Oct 30 19:57:33.035770 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:57:33.035744    6275 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"usage-logs-tenancy-proxy-tls\""
Oct 30 19:57:33.035770 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:57:33.035748    6275 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"usage-tenancy-proxy-source\""
Oct 30 19:57:33.035913 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:57:33.035789    6275 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"usage-logs-tenancy-proxy-ca-bundle\""
Oct 30 19:57:33.035913 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:57:33.035811    6275 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"usage-tenancy-proxy-dockercfg-zvlf5\""
Oct 30 19:57:33.103919 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:57:33.103892    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/c7ff9a1f-9026-493f-a87a-c9b96f593403-tls-cert\") pod \"usage-logs-tenancy-proxy-7d94f55f4b-pqsbj\" (UID: \"c7ff9a1f-9026-493f-a87a-c9b96f593403\") " pod="opendatahub/usage-logs-tenancy-proxy-7d94f55f4b-pqsbj"
Oct 30 19:57:33.104051 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:57:33.103934    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c7ff9a1f-9026-493f-a87a-c9b96f593403-service-ca\") pod \"usage-logs-tenancy-proxy-7d94f55f4b-pqsbj\" (UID: \"c7ff9a1f-9026-493f-a87a-c9b96f593403\") " pod="opendatahub/usage-logs-tenancy-proxy-7d94f55f4b-pqsbj"
Oct 30 19:57:33.104051 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:57:33.104038    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-source\" (UniqueName: \"kubernetes.io/configmap/c7ff9a1f-9026-493f-a87a-c9b96f593403-proxy-source\") pod \"usage-logs-tenancy-proxy-7d94f55f4b-pqsbj\" (UID: \"c7ff9a1f-9026-493f-a87a-c9b96f593403\") " pod="opendatahub/usage-logs-tenancy-proxy-7d94f55f4b-pqsbj"
Oct 30 19:57:33.104118 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:57:33.104084    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j69wm\" (UniqueName: \"kubernetes.io/projected/c7ff9a1f-9026-493f-a87a-c9b96f593403-kube-api-access-j69wm\") pod \"usage-logs-tenancy-proxy-7d94f55f4b-pqsbj\" (UID: \"c7ff9a1f-9026-493f-a87a-c9b96f593403\") " pod="opendatahub/usage-logs-tenancy-proxy-7d94f55f4b-pqsbj"
Oct 30 19:57:33.205134 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:57:33.205099    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c7ff9a1f-9026-493f-a87a-c9b96f593403-service-ca\") pod \"usage-logs-tenancy-proxy-7d94f55f4b-pqsbj\" (UID: \"c7ff9a1f-9026-493f-a87a-c9b96f593403\") " pod="opendatahub/usage-logs-tenancy-proxy-7d94f55f4b-pqsbj"
Oct 30 19:57:33.205276 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:57:33.205166    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-source\" (UniqueName: \"kubernetes.io/configmap/c7ff9a1f-9026-493f-a87a-c9b96f593403-proxy-source\") pod \"usage-logs-tenancy-proxy-7d94f55f4b-pqsbj\" (UID: \"c7ff9a1f-9026-493f-a87a-c9b96f593403\") " pod="opendatahub/usage-logs-tenancy-proxy-7d94f55f4b-pqsbj"
Oct 30 19:57:33.205276 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:57:33.205216    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j69wm\" (UniqueName: \"kubernetes.io/projected/c7ff9a1f-9026-493f-a87a-c9b96f593403-kube-api-access-j69wm\") pod \"usage-logs-tenancy-proxy-7d94f55f4b-pqsbj\" (UID: \"c7ff9a1f-9026-493f-a87a-c9b96f593403\") " pod="opendatahub/usage-logs-tenancy-proxy-7d94f55f4b-pqsbj"
Oct 30 19:57:33.205276 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:57:33.205266    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/c7ff9a1f-9026-493f-a87a-c9b96f593403-tls-cert\") pod \"usage-logs-tenancy-proxy-7d94f55f4b-pqsbj\" (UID: \"c7ff9a1f-9026-493f-a87a-c9b96f593403\") " pod="opendatahub/usage-logs-tenancy-proxy-7d94f55f4b-pqsbj"
Oct 30 19:57:33.205827 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:57:33.205804    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c7ff9a1f-9026-493f-a87a-c9b96f593403-service-ca\") pod \"usage-logs-tenancy-proxy-7d94f55f4b-pqsbj\" (UID: \"c7ff9a1f-9026-493f-a87a-c9b96f593403\") " pod="opendatahub/usage-logs-tenancy-proxy-7d94f55f4b-pqsbj"
Oct 30 19:57:33.205920 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:57:33.205901    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-source\" (UniqueName: \"kubernetes.io/configmap/c7ff9a1f-9026-493f-a87a-c9b96f593403-proxy-source\") pod \"usage-logs-tenancy-proxy-7d94f55f4b-pqsbj\" (UID: \"c7ff9a1f-9026-493f-a87a-c9b96f593403\") " pod="opendatahub/usage-logs-tenancy-proxy-7d94f55f4b-pqsbj"
Oct 30 19:57:33.207583 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:57:33.207563    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/c7ff9a1f-9026-493f-a87a-c9b96f593403-tls-cert\") pod \"usage-logs-tenancy-proxy-7d94f55f4b-pqsbj\" (UID: \"c7ff9a1f-9026-493f-a87a-c9b96f593403\") " pod="opendatahub/usage-logs-tenancy-proxy-7d94f55f4b-pqsbj"
Oct 30 19:57:33.233208 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:57:33.233185    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j69wm\" (UniqueName: \"kubernetes.io/projected/c7ff9a1f-9026-493f-a87a-c9b96f593403-kube-api-access-j69wm\") pod \"usage-logs-tenancy-proxy-7d94f55f4b-pqsbj\" (UID: \"c7ff9a1f-9026-493f-a87a-c9b96f593403\") " pod="opendatahub/usage-logs-tenancy-proxy-7d94f55f4b-pqsbj"
Oct 30 19:57:33.317253 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:57:33.317196    6275 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/usage-logs-tenancy-proxy-7d94f55f4b-pqsbj"
Oct 30 19:57:33.617829 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:57:33.617798    6275 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/usage-logs-tenancy-proxy-7d94f55f4b-pqsbj"]
Oct 30 19:57:33.619249 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:57:33.619225    6275 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc7ff9a1f_9026_493f_a87a_c9b96f593403.slice/crio-30f9ae1b2a46da7124695e077dd7ed9fcc6a47e0fdb0c846a81d866242513e3a WatchSource:0}: Error finding container 30f9ae1b2a46da7124695e077dd7ed9fcc6a47e0fdb0c846a81d866242513e3a: Status 404 returned error can't find the container with id 30f9ae1b2a46da7124695e077dd7ed9fcc6a47e0fdb0c846a81d866242513e3a
Oct 30 19:57:34.197727 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:57:34.197692    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/usage-logs-tenancy-proxy-7d94f55f4b-pqsbj" event={"ID":"c7ff9a1f-9026-493f-a87a-c9b96f593403","Type":"ContainerStarted","Data":"30f9ae1b2a46da7124695e077dd7ed9fcc6a47e0fdb0c846a81d866242513e3a"}
Oct 30 19:57:40.180702 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:57:40.180662    6275 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-577f596567-qjrlc"
Oct 30 19:57:41.185437 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:57:41.185390    6275 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-774477d6c-n9tw6"
Oct 30 19:57:41.273265 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:57:41.272873    6275 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-577f596567-qjrlc"]
Oct 30 19:57:41.273265 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:57:41.273126    6275 kuberuntime_container.go:898] "Killing container with a grace period" pod="opendatahub/maas-controller-577f596567-qjrlc" podUID="7bd41bb0-d03d-4135-a7dc-001fe9c6055f" containerName="manager" containerID="cri-o://3f31c2e39cb77a7d5c8b31b8e3298088d274394105866542d658205b03628ad7" gracePeriod=30
Oct 30 19:57:41.541570 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:57:41.541541    6275 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-577f596567-qjrlc"
Oct 30 19:57:41.580521 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:57:41.580494    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/7bd41bb0-d03d-4135-a7dc-001fe9c6055f-webhook-cert\" (UniqueName: \"kubernetes.io/secret/7bd41bb0-d03d-4135-a7dc-001fe9c6055f-webhook-cert\") pod \"7bd41bb0-d03d-4135-a7dc-001fe9c6055f\" (UID: \"7bd41bb0-d03d-4135-a7dc-001fe9c6055f\") "
Oct 30 19:57:41.580675 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:57:41.580537    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/7bd41bb0-d03d-4135-a7dc-001fe9c6055f-kube-api-access-mptwh\" (UniqueName: \"kubernetes.io/projected/7bd41bb0-d03d-4135-a7dc-001fe9c6055f-kube-api-access-mptwh\") pod \"7bd41bb0-d03d-4135-a7dc-001fe9c6055f\" (UID: \"7bd41bb0-d03d-4135-a7dc-001fe9c6055f\") "
Oct 30 19:57:41.580675 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:57:41.580575    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/7bd41bb0-d03d-4135-a7dc-001fe9c6055f-metrics-certs\" (UniqueName: \"kubernetes.io/secret/7bd41bb0-d03d-4135-a7dc-001fe9c6055f-metrics-certs\") pod \"7bd41bb0-d03d-4135-a7dc-001fe9c6055f\" (UID: \"7bd41bb0-d03d-4135-a7dc-001fe9c6055f\") "
Oct 30 19:57:41.582909 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:57:41.582881    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7bd41bb0-d03d-4135-a7dc-001fe9c6055f-webhook-cert" pod "7bd41bb0-d03d-4135-a7dc-001fe9c6055f" (UID: "7bd41bb0-d03d-4135-a7dc-001fe9c6055f"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 19:57:41.583134 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:57:41.583102    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7bd41bb0-d03d-4135-a7dc-001fe9c6055f-metrics-certs" pod "7bd41bb0-d03d-4135-a7dc-001fe9c6055f" (UID: "7bd41bb0-d03d-4135-a7dc-001fe9c6055f"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 19:57:41.583240 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:57:41.583143    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7bd41bb0-d03d-4135-a7dc-001fe9c6055f-kube-api-access-mptwh" pod "7bd41bb0-d03d-4135-a7dc-001fe9c6055f" (UID: "7bd41bb0-d03d-4135-a7dc-001fe9c6055f"). InnerVolumeSpecName "kube-api-access-mptwh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 19:57:41.681660 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:57:41.681633    6275 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7bd41bb0-d03d-4135-a7dc-001fe9c6055f-metrics-certs\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 19:57:41.681660 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:57:41.681661    6275 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7bd41bb0-d03d-4135-a7dc-001fe9c6055f-webhook-cert\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 19:57:41.681828 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:57:41.681674    6275 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mptwh\" (UniqueName: \"kubernetes.io/projected/7bd41bb0-d03d-4135-a7dc-001fe9c6055f-kube-api-access-mptwh\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 19:57:42.245846 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:57:42.245810    6275 generic.go:356] "Generic (PLEG): container finished" podID="7bd41bb0-d03d-4135-a7dc-001fe9c6055f" containerID="3f31c2e39cb77a7d5c8b31b8e3298088d274394105866542d658205b03628ad7" exitCode=0
Oct 30 19:57:42.246293 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:57:42.245873    6275 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-577f596567-qjrlc"
Oct 30 19:57:42.246293 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:57:42.245899    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-577f596567-qjrlc" event={"ID":"7bd41bb0-d03d-4135-a7dc-001fe9c6055f","Type":"ContainerDied","Data":"3f31c2e39cb77a7d5c8b31b8e3298088d274394105866542d658205b03628ad7"}
Oct 30 19:57:42.246293 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:57:42.245972    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-577f596567-qjrlc" event={"ID":"7bd41bb0-d03d-4135-a7dc-001fe9c6055f","Type":"ContainerDied","Data":"518d6bc2d5a0e03a6610fcdb745f498b373cd8d0924325bf9cb29479b1fbdc58"}
Oct 30 19:57:42.246293 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:57:42.246004    6275 scope.go:122] "RemoveContainer" containerID="3f31c2e39cb77a7d5c8b31b8e3298088d274394105866542d658205b03628ad7"
Oct 30 19:57:42.256510 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:57:42.256484    6275 scope.go:122] "RemoveContainer" containerID="3f31c2e39cb77a7d5c8b31b8e3298088d274394105866542d658205b03628ad7"
Oct 30 19:57:42.256836 ip-10-0-131-26 kubenswrapper[6275]: E1030 19:57:42.256811    6275 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3f31c2e39cb77a7d5c8b31b8e3298088d274394105866542d658205b03628ad7\": container with ID starting with 3f31c2e39cb77a7d5c8b31b8e3298088d274394105866542d658205b03628ad7 not found: ID does not exist" containerID="3f31c2e39cb77a7d5c8b31b8e3298088d274394105866542d658205b03628ad7"
Oct 30 19:57:42.256914 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:57:42.256848    6275 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3f31c2e39cb77a7d5c8b31b8e3298088d274394105866542d658205b03628ad7"} err="failed to get container status \"3f31c2e39cb77a7d5c8b31b8e3298088d274394105866542d658205b03628ad7\": rpc error: code = NotFound desc = could not find container \"3f31c2e39cb77a7d5c8b31b8e3298088d274394105866542d658205b03628ad7\": container with ID starting with 3f31c2e39cb77a7d5c8b31b8e3298088d274394105866542d658205b03628ad7 not found: ID does not exist"
Oct 30 19:57:42.302836 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:57:42.302804    6275 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-577f596567-qjrlc"]
Oct 30 19:57:42.315604 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:57:42.315579    6275 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-577f596567-qjrlc"]
Oct 30 19:57:43.656499 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:57:43.656463    6275 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="7bd41bb0-d03d-4135-a7dc-001fe9c6055f" path="/var/lib/kubelet/pods/7bd41bb0-d03d-4135-a7dc-001fe9c6055f/volumes"
Oct 30 19:57:44.258423 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:57:44.258390    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/usage-logs-tenancy-proxy-7d94f55f4b-pqsbj" event={"ID":"c7ff9a1f-9026-493f-a87a-c9b96f593403","Type":"ContainerStarted","Data":"7e8aad9703ad8e8bad2299a402fc630ee087b174957eae7f354d1f3a69002664"}
Oct 30 19:57:44.258554 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:57:44.258470    6275 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/usage-logs-tenancy-proxy-7d94f55f4b-pqsbj"
Oct 30 19:57:44.305324 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:57:44.305249    6275 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/usage-logs-tenancy-proxy-7d94f55f4b-pqsbj" podStartSLOduration=1.8930471660000001 podStartE2EDuration="12.305235393s" totalImagesPullingTime="10.412188227s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 19:57:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 19:57:44.303164956 +0000 UTC m=+574.764891820" watchObservedRunningTime="2026-10-30 19:57:44.305235393 +0000 UTC m=+574.766962256"
Oct 30 19:57:55.268640 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:57:55.268611    6275 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/usage-logs-tenancy-proxy-7d94f55f4b-pqsbj"
Oct 30 19:57:56.257756 ip-10-0-131-26 kubenswrapper[6275]: E1030 19:57:56.257714    6275 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-fwc77" containerName="extractor"
Oct 30 19:58:14.140583 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:58:14.140542    6275 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-6466c554d8-dzsl9"]
Oct 30 19:58:14.141071 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:58:14.140932    6275 cpu_manager.go:414] "containerMap: removing container" podUID="7bd41bb0-d03d-4135-a7dc-001fe9c6055f" containerName="manager"
Oct 30 19:58:14.141071 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:58:14.140943    6275 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="7bd41bb0-d03d-4135-a7dc-001fe9c6055f" containerName="manager"
Oct 30 19:58:14.141071 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:58:14.141021    6275 memory_manager.go:365] "RemoveStaleState removing state" podUID="7bd41bb0-d03d-4135-a7dc-001fe9c6055f" containerName="manager"
Oct 30 19:58:14.388941 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:58:14.388908    6275 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-6466c554d8-dzsl9"]
Oct 30 19:58:14.389101 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:58:14.389032    6275 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-6466c554d8-dzsl9"
Oct 30 19:58:14.541831 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:58:14.541793    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ww7fj\" (UniqueName: \"kubernetes.io/projected/96ccbb74-7a9a-40d8-a63f-0f4f34624d51-kube-api-access-ww7fj\") pod \"llmisvc-controller-manager-6466c554d8-dzsl9\" (UID: \"96ccbb74-7a9a-40d8-a63f-0f4f34624d51\") " pod="opendatahub/llmisvc-controller-manager-6466c554d8-dzsl9"
Oct 30 19:58:14.541995 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:58:14.541850    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/96ccbb74-7a9a-40d8-a63f-0f4f34624d51-cert\") pod \"llmisvc-controller-manager-6466c554d8-dzsl9\" (UID: \"96ccbb74-7a9a-40d8-a63f-0f4f34624d51\") " pod="opendatahub/llmisvc-controller-manager-6466c554d8-dzsl9"
Oct 30 19:58:14.642378 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:58:14.642339    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ww7fj\" (UniqueName: \"kubernetes.io/projected/96ccbb74-7a9a-40d8-a63f-0f4f34624d51-kube-api-access-ww7fj\") pod \"llmisvc-controller-manager-6466c554d8-dzsl9\" (UID: \"96ccbb74-7a9a-40d8-a63f-0f4f34624d51\") " pod="opendatahub/llmisvc-controller-manager-6466c554d8-dzsl9"
Oct 30 19:58:14.642550 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:58:14.642429    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/96ccbb74-7a9a-40d8-a63f-0f4f34624d51-cert\") pod \"llmisvc-controller-manager-6466c554d8-dzsl9\" (UID: \"96ccbb74-7a9a-40d8-a63f-0f4f34624d51\") " pod="opendatahub/llmisvc-controller-manager-6466c554d8-dzsl9"
Oct 30 19:58:14.644868 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:58:14.644838    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/96ccbb74-7a9a-40d8-a63f-0f4f34624d51-cert\") pod \"llmisvc-controller-manager-6466c554d8-dzsl9\" (UID: \"96ccbb74-7a9a-40d8-a63f-0f4f34624d51\") " pod="opendatahub/llmisvc-controller-manager-6466c554d8-dzsl9"
Oct 30 19:58:14.671246 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:58:14.671188    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ww7fj\" (UniqueName: \"kubernetes.io/projected/96ccbb74-7a9a-40d8-a63f-0f4f34624d51-kube-api-access-ww7fj\") pod \"llmisvc-controller-manager-6466c554d8-dzsl9\" (UID: \"96ccbb74-7a9a-40d8-a63f-0f4f34624d51\") " pod="opendatahub/llmisvc-controller-manager-6466c554d8-dzsl9"
Oct 30 19:58:14.725404 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:58:14.725381    6275 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-6466c554d8-dzsl9"
Oct 30 19:58:15.053943 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:58:15.053914    6275 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-6466c554d8-dzsl9"]
Oct 30 19:58:15.055006 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:58:15.054978    6275 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod96ccbb74_7a9a_40d8_a63f_0f4f34624d51.slice/crio-f5fcdaa9f791afbc3a9ce84be53dd8f62a4f109f6222f276dd4b95fe8c192675 WatchSource:0}: Error finding container f5fcdaa9f791afbc3a9ce84be53dd8f62a4f109f6222f276dd4b95fe8c192675: Status 404 returned error can't find the container with id f5fcdaa9f791afbc3a9ce84be53dd8f62a4f109f6222f276dd4b95fe8c192675
Oct 30 19:58:15.414797 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:58:15.414730    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-6466c554d8-dzsl9" event={"ID":"96ccbb74-7a9a-40d8-a63f-0f4f34624d51","Type":"ContainerStarted","Data":"f5fcdaa9f791afbc3a9ce84be53dd8f62a4f109f6222f276dd4b95fe8c192675"}
Oct 30 19:58:16.421174 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:58:16.421138    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-6466c554d8-dzsl9" event={"ID":"96ccbb74-7a9a-40d8-a63f-0f4f34624d51","Type":"ContainerStarted","Data":"4c736bef19b2b30ca693769f29e9ed3d2e4af0705459cdc4b4a557569c3a7546"}
Oct 30 19:58:16.421637 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:58:16.421283    6275 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-6466c554d8-dzsl9"
Oct 30 19:58:16.465774 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:58:16.465730    6275 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-6466c554d8-dzsl9" podStartSLOduration=1.935375681 podStartE2EDuration="2.465718267s" totalImagesPullingTime="530.342586ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 19:58:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 19:58:16.46544771 +0000 UTC m=+606.927174570" watchObservedRunningTime="2026-10-30 19:58:16.465718267 +0000 UTC m=+606.927445130"
Oct 30 19:58:26.256158 ip-10-0-131-26 kubenswrapper[6275]: E1030 19:58:26.256117    6275 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-fwc77" containerName="extractor"
Oct 30 19:58:47.429278 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:58:47.429246    6275 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-6466c554d8-dzsl9"
Oct 30 19:58:47.507147 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:58:47.507108    6275 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["opendatahub/llmisvc-controller-manager-869d5dcc5d-4m9v9"]
Oct 30 19:58:47.507364 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:58:47.507336    6275 kuberuntime_container.go:898] "Killing container with a grace period" pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-4m9v9" podUID="42142d9b-b2be-44a2-9226-9d62b9a5487f" containerName="manager" containerID="cri-o://0aa02378c784473be31b31213e922c52a29597c9d7097326b589abd59d3a35fb" gracePeriod=30
Oct 30 19:58:47.748539 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:58:47.748509    6275 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-4m9v9"
Oct 30 19:58:47.808400 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:58:47.808375    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/42142d9b-b2be-44a2-9226-9d62b9a5487f-kube-api-access-kg96m\" (UniqueName: \"kubernetes.io/projected/42142d9b-b2be-44a2-9226-9d62b9a5487f-kube-api-access-kg96m\") pod \"42142d9b-b2be-44a2-9226-9d62b9a5487f\" (UID: \"42142d9b-b2be-44a2-9226-9d62b9a5487f\") "
Oct 30 19:58:47.808545 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:58:47.808409    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/42142d9b-b2be-44a2-9226-9d62b9a5487f-cert\" (UniqueName: \"kubernetes.io/secret/42142d9b-b2be-44a2-9226-9d62b9a5487f-cert\") pod \"42142d9b-b2be-44a2-9226-9d62b9a5487f\" (UID: \"42142d9b-b2be-44a2-9226-9d62b9a5487f\") "
Oct 30 19:58:47.810358 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:58:47.810335    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/42142d9b-b2be-44a2-9226-9d62b9a5487f-cert" pod "42142d9b-b2be-44a2-9226-9d62b9a5487f" (UID: "42142d9b-b2be-44a2-9226-9d62b9a5487f"). InnerVolumeSpecName "cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 19:58:47.810468 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:58:47.810365    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/42142d9b-b2be-44a2-9226-9d62b9a5487f-kube-api-access-kg96m" pod "42142d9b-b2be-44a2-9226-9d62b9a5487f" (UID: "42142d9b-b2be-44a2-9226-9d62b9a5487f"). InnerVolumeSpecName "kube-api-access-kg96m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 19:58:47.909382 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:58:47.909357    6275 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kg96m\" (UniqueName: \"kubernetes.io/projected/42142d9b-b2be-44a2-9226-9d62b9a5487f-kube-api-access-kg96m\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 19:58:47.909382 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:58:47.909379    6275 reconciler_common.go:299] "Volume detached for volume \"cert\" (UniqueName: \"kubernetes.io/secret/42142d9b-b2be-44a2-9226-9d62b9a5487f-cert\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 19:58:48.594424 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:58:48.594389    6275 generic.go:356] "Generic (PLEG): container finished" podID="42142d9b-b2be-44a2-9226-9d62b9a5487f" containerID="0aa02378c784473be31b31213e922c52a29597c9d7097326b589abd59d3a35fb" exitCode=0
Oct 30 19:58:48.594820 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:58:48.594462    6275 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-4m9v9"
Oct 30 19:58:48.594820 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:58:48.594473    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-4m9v9" event={"ID":"42142d9b-b2be-44a2-9226-9d62b9a5487f","Type":"ContainerDied","Data":"0aa02378c784473be31b31213e922c52a29597c9d7097326b589abd59d3a35fb"}
Oct 30 19:58:48.594820 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:58:48.594557    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-4m9v9" event={"ID":"42142d9b-b2be-44a2-9226-9d62b9a5487f","Type":"ContainerDied","Data":"98507317a1ec891b9dfd1525f29b2d63e849cda495f603501e20898324e39a29"}
Oct 30 19:58:48.594820 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:58:48.594582    6275 scope.go:122] "RemoveContainer" containerID="0aa02378c784473be31b31213e922c52a29597c9d7097326b589abd59d3a35fb"
Oct 30 19:58:48.604092 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:58:48.604076    6275 scope.go:122] "RemoveContainer" containerID="0aa02378c784473be31b31213e922c52a29597c9d7097326b589abd59d3a35fb"
Oct 30 19:58:48.604374 ip-10-0-131-26 kubenswrapper[6275]: E1030 19:58:48.604354    6275 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0aa02378c784473be31b31213e922c52a29597c9d7097326b589abd59d3a35fb\": container with ID starting with 0aa02378c784473be31b31213e922c52a29597c9d7097326b589abd59d3a35fb not found: ID does not exist" containerID="0aa02378c784473be31b31213e922c52a29597c9d7097326b589abd59d3a35fb"
Oct 30 19:58:48.604452 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:58:48.604382    6275 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0aa02378c784473be31b31213e922c52a29597c9d7097326b589abd59d3a35fb"} err="failed to get container status \"0aa02378c784473be31b31213e922c52a29597c9d7097326b589abd59d3a35fb\": rpc error: code = NotFound desc = could not find container \"0aa02378c784473be31b31213e922c52a29597c9d7097326b589abd59d3a35fb\": container with ID starting with 0aa02378c784473be31b31213e922c52a29597c9d7097326b589abd59d3a35fb not found: ID does not exist"
Oct 30 19:58:48.662364 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:58:48.662340    6275 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["opendatahub/llmisvc-controller-manager-869d5dcc5d-4m9v9"]
Oct 30 19:58:48.675035 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:58:48.675013    6275 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["opendatahub/llmisvc-controller-manager-869d5dcc5d-4m9v9"]
Oct 30 19:58:49.654575 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:58:49.654546    6275 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="42142d9b-b2be-44a2-9226-9d62b9a5487f" path="/var/lib/kubelet/pods/42142d9b-b2be-44a2-9226-9d62b9a5487f/volumes"
Oct 30 19:58:56.253765 ip-10-0-131-26 kubenswrapper[6275]: E1030 19:58:56.253729    6275 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-fwc77" containerName="extractor"
Oct 30 19:59:24.307733 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:59:24.307696    6275 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-wtnz5"]
Oct 30 19:59:24.308205 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:59:24.308079    6275 cpu_manager.go:414] "containerMap: removing container" podUID="42142d9b-b2be-44a2-9226-9d62b9a5487f" containerName="manager"
Oct 30 19:59:24.308205 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:59:24.308089    6275 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="42142d9b-b2be-44a2-9226-9d62b9a5487f" containerName="manager"
Oct 30 19:59:24.308205 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:59:24.308160    6275 memory_manager.go:365] "RemoveStaleState removing state" podUID="42142d9b-b2be-44a2-9226-9d62b9a5487f" containerName="manager"
Oct 30 19:59:24.311169 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:59:24.311148    6275 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-wtnz5"
Oct 30 19:59:24.328434 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:59:24.328393    6275 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Oct 30 19:59:24.328434 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:59:24.328393    6275 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Oct 30 19:59:24.340067 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:59:24.340046    6275 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Oct 30 19:59:24.340303 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:59:24.340136    6275 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-wbdhc\""
Oct 30 19:59:24.343154 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:59:24.343132    6275 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-wtnz5"]
Oct 30 19:59:24.402116 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:59:24.402086    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/286f2fb7-0dc1-4d1f-9bf5-20be2e0a31cf-istio-token\") pod \"maas-default-gateway-openshift-default-7f5667f86c-wtnz5\" (UID: \"286f2fb7-0dc1-4d1f-9bf5-20be2e0a31cf\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-wtnz5"
Oct 30 19:59:24.402116 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:59:24.402115    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/286f2fb7-0dc1-4d1f-9bf5-20be2e0a31cf-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-7f5667f86c-wtnz5\" (UID: \"286f2fb7-0dc1-4d1f-9bf5-20be2e0a31cf\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-wtnz5"
Oct 30 19:59:24.402281 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:59:24.402136    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/286f2fb7-0dc1-4d1f-9bf5-20be2e0a31cf-credential-socket\") pod \"maas-default-gateway-openshift-default-7f5667f86c-wtnz5\" (UID: \"286f2fb7-0dc1-4d1f-9bf5-20be2e0a31cf\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-wtnz5"
Oct 30 19:59:24.402281 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:59:24.402157    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/286f2fb7-0dc1-4d1f-9bf5-20be2e0a31cf-workload-socket\") pod \"maas-default-gateway-openshift-default-7f5667f86c-wtnz5\" (UID: \"286f2fb7-0dc1-4d1f-9bf5-20be2e0a31cf\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-wtnz5"
Oct 30 19:59:24.402281 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:59:24.402232    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-99hnx\" (UniqueName: \"kubernetes.io/projected/286f2fb7-0dc1-4d1f-9bf5-20be2e0a31cf-kube-api-access-99hnx\") pod \"maas-default-gateway-openshift-default-7f5667f86c-wtnz5\" (UID: \"286f2fb7-0dc1-4d1f-9bf5-20be2e0a31cf\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-wtnz5"
Oct 30 19:59:24.402464 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:59:24.402296    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/286f2fb7-0dc1-4d1f-9bf5-20be2e0a31cf-istio-envoy\") pod \"maas-default-gateway-openshift-default-7f5667f86c-wtnz5\" (UID: \"286f2fb7-0dc1-4d1f-9bf5-20be2e0a31cf\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-wtnz5"
Oct 30 19:59:24.402464 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:59:24.402360    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/286f2fb7-0dc1-4d1f-9bf5-20be2e0a31cf-workload-certs\") pod \"maas-default-gateway-openshift-default-7f5667f86c-wtnz5\" (UID: \"286f2fb7-0dc1-4d1f-9bf5-20be2e0a31cf\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-wtnz5"
Oct 30 19:59:24.402464 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:59:24.402435    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/286f2fb7-0dc1-4d1f-9bf5-20be2e0a31cf-istio-data\") pod \"maas-default-gateway-openshift-default-7f5667f86c-wtnz5\" (UID: \"286f2fb7-0dc1-4d1f-9bf5-20be2e0a31cf\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-wtnz5"
Oct 30 19:59:24.402580 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:59:24.402475    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/286f2fb7-0dc1-4d1f-9bf5-20be2e0a31cf-istio-podinfo\") pod \"maas-default-gateway-openshift-default-7f5667f86c-wtnz5\" (UID: \"286f2fb7-0dc1-4d1f-9bf5-20be2e0a31cf\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-wtnz5"
Oct 30 19:59:24.503437 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:59:24.503391    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/286f2fb7-0dc1-4d1f-9bf5-20be2e0a31cf-istio-envoy\") pod \"maas-default-gateway-openshift-default-7f5667f86c-wtnz5\" (UID: \"286f2fb7-0dc1-4d1f-9bf5-20be2e0a31cf\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-wtnz5"
Oct 30 19:59:24.503560 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:59:24.503447    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/286f2fb7-0dc1-4d1f-9bf5-20be2e0a31cf-workload-certs\") pod \"maas-default-gateway-openshift-default-7f5667f86c-wtnz5\" (UID: \"286f2fb7-0dc1-4d1f-9bf5-20be2e0a31cf\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-wtnz5"
Oct 30 19:59:24.503560 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:59:24.503474    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/286f2fb7-0dc1-4d1f-9bf5-20be2e0a31cf-istio-data\") pod \"maas-default-gateway-openshift-default-7f5667f86c-wtnz5\" (UID: \"286f2fb7-0dc1-4d1f-9bf5-20be2e0a31cf\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-wtnz5"
Oct 30 19:59:24.503560 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:59:24.503497    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/286f2fb7-0dc1-4d1f-9bf5-20be2e0a31cf-istio-podinfo\") pod \"maas-default-gateway-openshift-default-7f5667f86c-wtnz5\" (UID: \"286f2fb7-0dc1-4d1f-9bf5-20be2e0a31cf\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-wtnz5"
Oct 30 19:59:24.503560 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:59:24.503540    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/286f2fb7-0dc1-4d1f-9bf5-20be2e0a31cf-istio-token\") pod \"maas-default-gateway-openshift-default-7f5667f86c-wtnz5\" (UID: \"286f2fb7-0dc1-4d1f-9bf5-20be2e0a31cf\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-wtnz5"
Oct 30 19:59:24.503765 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:59:24.503565    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/286f2fb7-0dc1-4d1f-9bf5-20be2e0a31cf-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-7f5667f86c-wtnz5\" (UID: \"286f2fb7-0dc1-4d1f-9bf5-20be2e0a31cf\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-wtnz5"
Oct 30 19:59:24.503828 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:59:24.503758    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/286f2fb7-0dc1-4d1f-9bf5-20be2e0a31cf-credential-socket\") pod \"maas-default-gateway-openshift-default-7f5667f86c-wtnz5\" (UID: \"286f2fb7-0dc1-4d1f-9bf5-20be2e0a31cf\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-wtnz5"
Oct 30 19:59:24.503828 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:59:24.503818    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/286f2fb7-0dc1-4d1f-9bf5-20be2e0a31cf-workload-socket\") pod \"maas-default-gateway-openshift-default-7f5667f86c-wtnz5\" (UID: \"286f2fb7-0dc1-4d1f-9bf5-20be2e0a31cf\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-wtnz5"
Oct 30 19:59:24.503924 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:59:24.503856    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-99hnx\" (UniqueName: \"kubernetes.io/projected/286f2fb7-0dc1-4d1f-9bf5-20be2e0a31cf-kube-api-access-99hnx\") pod \"maas-default-gateway-openshift-default-7f5667f86c-wtnz5\" (UID: \"286f2fb7-0dc1-4d1f-9bf5-20be2e0a31cf\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-wtnz5"
Oct 30 19:59:24.504002 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:59:24.503980    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/286f2fb7-0dc1-4d1f-9bf5-20be2e0a31cf-istio-data\") pod \"maas-default-gateway-openshift-default-7f5667f86c-wtnz5\" (UID: \"286f2fb7-0dc1-4d1f-9bf5-20be2e0a31cf\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-wtnz5"
Oct 30 19:59:24.504066 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:59:24.504026    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/286f2fb7-0dc1-4d1f-9bf5-20be2e0a31cf-workload-certs\") pod \"maas-default-gateway-openshift-default-7f5667f86c-wtnz5\" (UID: \"286f2fb7-0dc1-4d1f-9bf5-20be2e0a31cf\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-wtnz5"
Oct 30 19:59:24.504218 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:59:24.504193    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/286f2fb7-0dc1-4d1f-9bf5-20be2e0a31cf-credential-socket\") pod \"maas-default-gateway-openshift-default-7f5667f86c-wtnz5\" (UID: \"286f2fb7-0dc1-4d1f-9bf5-20be2e0a31cf\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-wtnz5"
Oct 30 19:59:24.504277 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:59:24.504207    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/286f2fb7-0dc1-4d1f-9bf5-20be2e0a31cf-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-7f5667f86c-wtnz5\" (UID: \"286f2fb7-0dc1-4d1f-9bf5-20be2e0a31cf\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-wtnz5"
Oct 30 19:59:24.504569 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:59:24.504546    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/286f2fb7-0dc1-4d1f-9bf5-20be2e0a31cf-workload-socket\") pod \"maas-default-gateway-openshift-default-7f5667f86c-wtnz5\" (UID: \"286f2fb7-0dc1-4d1f-9bf5-20be2e0a31cf\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-wtnz5"
Oct 30 19:59:24.505638 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:59:24.505614    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/286f2fb7-0dc1-4d1f-9bf5-20be2e0a31cf-istio-envoy\") pod \"maas-default-gateway-openshift-default-7f5667f86c-wtnz5\" (UID: \"286f2fb7-0dc1-4d1f-9bf5-20be2e0a31cf\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-wtnz5"
Oct 30 19:59:24.505963 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:59:24.505947    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/286f2fb7-0dc1-4d1f-9bf5-20be2e0a31cf-istio-podinfo\") pod \"maas-default-gateway-openshift-default-7f5667f86c-wtnz5\" (UID: \"286f2fb7-0dc1-4d1f-9bf5-20be2e0a31cf\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-wtnz5"
Oct 30 19:59:24.528496 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:59:24.528471    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/286f2fb7-0dc1-4d1f-9bf5-20be2e0a31cf-istio-token\") pod \"maas-default-gateway-openshift-default-7f5667f86c-wtnz5\" (UID: \"286f2fb7-0dc1-4d1f-9bf5-20be2e0a31cf\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-wtnz5"
Oct 30 19:59:24.528672 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:59:24.528656    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-99hnx\" (UniqueName: \"kubernetes.io/projected/286f2fb7-0dc1-4d1f-9bf5-20be2e0a31cf-kube-api-access-99hnx\") pod \"maas-default-gateway-openshift-default-7f5667f86c-wtnz5\" (UID: \"286f2fb7-0dc1-4d1f-9bf5-20be2e0a31cf\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-wtnz5"
Oct 30 19:59:24.624368 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:59:24.624311    6275 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-wtnz5"
Oct 30 19:59:24.940432 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:59:24.940384    6275 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-wtnz5"]
Oct 30 19:59:24.941873 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:59:24.941846    6275 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod286f2fb7_0dc1_4d1f_9bf5_20be2e0a31cf.slice/crio-95f099bb69384ca164db743f6a749e6e3f26c6c0f01363778a9a829d6b0ea98e WatchSource:0}: Error finding container 95f099bb69384ca164db743f6a749e6e3f26c6c0f01363778a9a829d6b0ea98e: Status 404 returned error can't find the container with id 95f099bb69384ca164db743f6a749e6e3f26c6c0f01363778a9a829d6b0ea98e
Oct 30 19:59:24.943701 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:59:24.943684    6275 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Oct 30 19:59:25.777768 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:59:25.777728    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-wtnz5" event={"ID":"286f2fb7-0dc1-4d1f-9bf5-20be2e0a31cf","Type":"ContainerStarted","Data":"95f099bb69384ca164db743f6a749e6e3f26c6c0f01363778a9a829d6b0ea98e"}
Oct 30 19:59:26.258589 ip-10-0-131-26 kubenswrapper[6275]: E1030 19:59:26.258554    6275 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-fwc77" containerName="extractor"
Oct 30 19:59:27.843590 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:59:27.843557    6275 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Oct 30 19:59:27.843921 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:59:27.843626    6275 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Oct 30 19:59:27.843921 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:59:27.843655    6275 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Oct 30 19:59:28.798951 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:59:28.798919    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-wtnz5" event={"ID":"286f2fb7-0dc1-4d1f-9bf5-20be2e0a31cf","Type":"ContainerStarted","Data":"2419b6a8dc3b4fb1b87d04213ed2870f41b3040ce436793de1a9a39606c45a99"}
Oct 30 19:59:28.863837 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:59:28.863788    6275 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-wtnz5" podStartSLOduration=1.9649212010000001 podStartE2EDuration="4.863775722s" totalImagesPullingTime="2.898854521s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 19:59:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 19:59:28.862915241 +0000 UTC m=+679.324642104" watchObservedRunningTime="2026-10-30 19:59:28.863775722 +0000 UTC m=+679.325502584"
Oct 30 19:59:29.625347 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:59:29.625313    6275 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-wtnz5"
Oct 30 19:59:29.626626 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:59:29.626597    6275 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-7f5667f86c-wtnz5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused" start-of-body=
Oct 30 19:59:29.626741 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:59:29.626646    6275 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-wtnz5" podUID="286f2fb7-0dc1-4d1f-9bf5-20be2e0a31cf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused"
Oct 30 19:59:30.625066 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:59:30.625028    6275 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-7f5667f86c-wtnz5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused" start-of-body=
Oct 30 19:59:30.625472 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:59:30.625085    6275 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-wtnz5" podUID="286f2fb7-0dc1-4d1f-9bf5-20be2e0a31cf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused"
Oct 30 19:59:31.625393 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:59:31.625360    6275 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-7f5667f86c-wtnz5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused" start-of-body=
Oct 30 19:59:31.625778 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:59:31.625433    6275 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-wtnz5" podUID="286f2fb7-0dc1-4d1f-9bf5-20be2e0a31cf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused"
Oct 30 19:59:32.624736 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:59:32.624703    6275 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-7f5667f86c-wtnz5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused" start-of-body=
Oct 30 19:59:32.624919 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:59:32.624763    6275 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-wtnz5" podUID="286f2fb7-0dc1-4d1f-9bf5-20be2e0a31cf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused"
Oct 30 19:59:33.625327 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:59:33.625279    6275 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-7f5667f86c-wtnz5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused" start-of-body=
Oct 30 19:59:33.625727 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:59:33.625348    6275 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-wtnz5" podUID="286f2fb7-0dc1-4d1f-9bf5-20be2e0a31cf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused"
Oct 30 19:59:34.625571 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:59:34.625536    6275 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-7f5667f86c-wtnz5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused" start-of-body=
Oct 30 19:59:34.625970 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:59:34.625585    6275 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-wtnz5" podUID="286f2fb7-0dc1-4d1f-9bf5-20be2e0a31cf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused"
Oct 30 19:59:36.626373 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:59:36.626331    6275 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-7f5667f86c-wtnz5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.43:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 19:59:36.626878 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:59:36.626409    6275 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-wtnz5" podUID="286f2fb7-0dc1-4d1f-9bf5-20be2e0a31cf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.43:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 19:59:37.669552 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:59:37.669515    6275 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-7f5667f86c-wtnz5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.43:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 19:59:37.670022 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:59:37.669584    6275 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-wtnz5" podUID="286f2fb7-0dc1-4d1f-9bf5-20be2e0a31cf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.43:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 19:59:38.128336 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:59:38.128302    6275 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-wtnz5"
Oct 30 19:59:38.129092 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:59:38.129064    6275 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-wtnz5"
Oct 30 19:59:38.129842 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:59:38.129820    6275 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-wtnz5"
Oct 30 19:59:39.381906 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:59:39.381874    6275 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-mxxll"]
Oct 30 19:59:39.385992 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:59:39.385970    6275 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-mxxll"
Oct 30 19:59:39.412574 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:59:39.412546    6275 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-mxxll"]
Oct 30 19:59:39.455974 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:59:39.455944    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b3c62e4b-11c3-45ba-9e82-274e66592e69-credential-socket\") pod \"maas-default-gateway-openshift-default-7f5667f86c-mxxll\" (UID: \"b3c62e4b-11c3-45ba-9e82-274e66592e69\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-mxxll"
Oct 30 19:59:39.456133 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:59:39.455977    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b3c62e4b-11c3-45ba-9e82-274e66592e69-istio-podinfo\") pod \"maas-default-gateway-openshift-default-7f5667f86c-mxxll\" (UID: \"b3c62e4b-11c3-45ba-9e82-274e66592e69\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-mxxll"
Oct 30 19:59:39.456133 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:59:39.455995    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b3c62e4b-11c3-45ba-9e82-274e66592e69-istio-envoy\") pod \"maas-default-gateway-openshift-default-7f5667f86c-mxxll\" (UID: \"b3c62e4b-11c3-45ba-9e82-274e66592e69\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-mxxll"
Oct 30 19:59:39.456133 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:59:39.456010    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b3c62e4b-11c3-45ba-9e82-274e66592e69-istio-token\") pod \"maas-default-gateway-openshift-default-7f5667f86c-mxxll\" (UID: \"b3c62e4b-11c3-45ba-9e82-274e66592e69\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-mxxll"
Oct 30 19:59:39.456133 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:59:39.456098    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b3c62e4b-11c3-45ba-9e82-274e66592e69-workload-socket\") pod \"maas-default-gateway-openshift-default-7f5667f86c-mxxll\" (UID: \"b3c62e4b-11c3-45ba-9e82-274e66592e69\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-mxxll"
Oct 30 19:59:39.456271 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:59:39.456201    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b3c62e4b-11c3-45ba-9e82-274e66592e69-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-7f5667f86c-mxxll\" (UID: \"b3c62e4b-11c3-45ba-9e82-274e66592e69\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-mxxll"
Oct 30 19:59:39.456271 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:59:39.456229    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-njkzj\" (UniqueName: \"kubernetes.io/projected/b3c62e4b-11c3-45ba-9e82-274e66592e69-kube-api-access-njkzj\") pod \"maas-default-gateway-openshift-default-7f5667f86c-mxxll\" (UID: \"b3c62e4b-11c3-45ba-9e82-274e66592e69\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-mxxll"
Oct 30 19:59:39.456271 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:59:39.456256    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b3c62e4b-11c3-45ba-9e82-274e66592e69-istio-data\") pod \"maas-default-gateway-openshift-default-7f5667f86c-mxxll\" (UID: \"b3c62e4b-11c3-45ba-9e82-274e66592e69\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-mxxll"
Oct 30 19:59:39.456361 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:59:39.456346    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b3c62e4b-11c3-45ba-9e82-274e66592e69-workload-certs\") pod \"maas-default-gateway-openshift-default-7f5667f86c-mxxll\" (UID: \"b3c62e4b-11c3-45ba-9e82-274e66592e69\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-mxxll"
Oct 30 19:59:39.557082 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:59:39.557052    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b3c62e4b-11c3-45ba-9e82-274e66592e69-credential-socket\") pod \"maas-default-gateway-openshift-default-7f5667f86c-mxxll\" (UID: \"b3c62e4b-11c3-45ba-9e82-274e66592e69\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-mxxll"
Oct 30 19:59:39.557082 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:59:39.557081    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b3c62e4b-11c3-45ba-9e82-274e66592e69-istio-podinfo\") pod \"maas-default-gateway-openshift-default-7f5667f86c-mxxll\" (UID: \"b3c62e4b-11c3-45ba-9e82-274e66592e69\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-mxxll"
Oct 30 19:59:39.557250 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:59:39.557104    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b3c62e4b-11c3-45ba-9e82-274e66592e69-istio-envoy\") pod \"maas-default-gateway-openshift-default-7f5667f86c-mxxll\" (UID: \"b3c62e4b-11c3-45ba-9e82-274e66592e69\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-mxxll"
Oct 30 19:59:39.557250 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:59:39.557121    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b3c62e4b-11c3-45ba-9e82-274e66592e69-istio-token\") pod \"maas-default-gateway-openshift-default-7f5667f86c-mxxll\" (UID: \"b3c62e4b-11c3-45ba-9e82-274e66592e69\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-mxxll"
Oct 30 19:59:39.557339 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:59:39.557247    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b3c62e4b-11c3-45ba-9e82-274e66592e69-workload-socket\") pod \"maas-default-gateway-openshift-default-7f5667f86c-mxxll\" (UID: \"b3c62e4b-11c3-45ba-9e82-274e66592e69\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-mxxll"
Oct 30 19:59:39.557339 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:59:39.557297    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b3c62e4b-11c3-45ba-9e82-274e66592e69-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-7f5667f86c-mxxll\" (UID: \"b3c62e4b-11c3-45ba-9e82-274e66592e69\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-mxxll"
Oct 30 19:59:39.557339 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:59:39.557323    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-njkzj\" (UniqueName: \"kubernetes.io/projected/b3c62e4b-11c3-45ba-9e82-274e66592e69-kube-api-access-njkzj\") pod \"maas-default-gateway-openshift-default-7f5667f86c-mxxll\" (UID: \"b3c62e4b-11c3-45ba-9e82-274e66592e69\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-mxxll"
Oct 30 19:59:39.557537 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:59:39.557364    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b3c62e4b-11c3-45ba-9e82-274e66592e69-istio-data\") pod \"maas-default-gateway-openshift-default-7f5667f86c-mxxll\" (UID: \"b3c62e4b-11c3-45ba-9e82-274e66592e69\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-mxxll"
Oct 30 19:59:39.557537 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:59:39.557454    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b3c62e4b-11c3-45ba-9e82-274e66592e69-workload-certs\") pod \"maas-default-gateway-openshift-default-7f5667f86c-mxxll\" (UID: \"b3c62e4b-11c3-45ba-9e82-274e66592e69\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-mxxll"
Oct 30 19:59:39.557641 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:59:39.557589    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b3c62e4b-11c3-45ba-9e82-274e66592e69-credential-socket\") pod \"maas-default-gateway-openshift-default-7f5667f86c-mxxll\" (UID: \"b3c62e4b-11c3-45ba-9e82-274e66592e69\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-mxxll"
Oct 30 19:59:39.557699 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:59:39.557651    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b3c62e4b-11c3-45ba-9e82-274e66592e69-workload-socket\") pod \"maas-default-gateway-openshift-default-7f5667f86c-mxxll\" (UID: \"b3c62e4b-11c3-45ba-9e82-274e66592e69\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-mxxll"
Oct 30 19:59:39.557863 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:59:39.557838    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b3c62e4b-11c3-45ba-9e82-274e66592e69-istio-data\") pod \"maas-default-gateway-openshift-default-7f5667f86c-mxxll\" (UID: \"b3c62e4b-11c3-45ba-9e82-274e66592e69\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-mxxll"
Oct 30 19:59:39.557934 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:59:39.557878    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b3c62e4b-11c3-45ba-9e82-274e66592e69-workload-certs\") pod \"maas-default-gateway-openshift-default-7f5667f86c-mxxll\" (UID: \"b3c62e4b-11c3-45ba-9e82-274e66592e69\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-mxxll"
Oct 30 19:59:39.558115 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:59:39.558097    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b3c62e4b-11c3-45ba-9e82-274e66592e69-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-7f5667f86c-mxxll\" (UID: \"b3c62e4b-11c3-45ba-9e82-274e66592e69\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-mxxll"
Oct 30 19:59:39.559315 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:59:39.559290    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b3c62e4b-11c3-45ba-9e82-274e66592e69-istio-envoy\") pod \"maas-default-gateway-openshift-default-7f5667f86c-mxxll\" (UID: \"b3c62e4b-11c3-45ba-9e82-274e66592e69\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-mxxll"
Oct 30 19:59:39.559459 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:59:39.559442    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b3c62e4b-11c3-45ba-9e82-274e66592e69-istio-podinfo\") pod \"maas-default-gateway-openshift-default-7f5667f86c-mxxll\" (UID: \"b3c62e4b-11c3-45ba-9e82-274e66592e69\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-mxxll"
Oct 30 19:59:39.582287 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:59:39.582263    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b3c62e4b-11c3-45ba-9e82-274e66592e69-istio-token\") pod \"maas-default-gateway-openshift-default-7f5667f86c-mxxll\" (UID: \"b3c62e4b-11c3-45ba-9e82-274e66592e69\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-mxxll"
Oct 30 19:59:39.582499 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:59:39.582481    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-njkzj\" (UniqueName: \"kubernetes.io/projected/b3c62e4b-11c3-45ba-9e82-274e66592e69-kube-api-access-njkzj\") pod \"maas-default-gateway-openshift-default-7f5667f86c-mxxll\" (UID: \"b3c62e4b-11c3-45ba-9e82-274e66592e69\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-mxxll"
Oct 30 19:59:39.699959 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:59:39.699903    6275 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-mxxll"
Oct 30 19:59:40.018603 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:59:40.018572    6275 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-mxxll"]
Oct 30 19:59:40.020025 ip-10-0-131-26 kubenswrapper[6275]: W1030 19:59:40.020000    6275 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb3c62e4b_11c3_45ba_9e82_274e66592e69.slice/crio-5d2e28d8213ea147b2c402cef995cb4263c8f999c589209b2121e0af8ca7630d WatchSource:0}: Error finding container 5d2e28d8213ea147b2c402cef995cb4263c8f999c589209b2121e0af8ca7630d: Status 404 returned error can't find the container with id 5d2e28d8213ea147b2c402cef995cb4263c8f999c589209b2121e0af8ca7630d
Oct 30 19:59:40.021983 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:59:40.021952    6275 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Oct 30 19:59:40.022057 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:59:40.022012    6275 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Oct 30 19:59:40.022091 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:59:40.022058    6275 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Oct 30 19:59:40.861391 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:59:40.861356    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-mxxll" event={"ID":"b3c62e4b-11c3-45ba-9e82-274e66592e69","Type":"ContainerStarted","Data":"08bdf478c227ad9cfd87ec12421d6a8df8108b5d4221833ca9310e187548421c"}
Oct 30 19:59:40.861843 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:59:40.861409    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-mxxll" event={"ID":"b3c62e4b-11c3-45ba-9e82-274e66592e69","Type":"ContainerStarted","Data":"5d2e28d8213ea147b2c402cef995cb4263c8f999c589209b2121e0af8ca7630d"}
Oct 30 19:59:40.930776 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:59:40.930722    6275 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-mxxll" podStartSLOduration=1.930708665 podStartE2EDuration="1.930708665s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 19:59:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 19:59:40.929097592 +0000 UTC m=+691.390824466" watchObservedRunningTime="2026-10-30 19:59:40.930708665 +0000 UTC m=+691.392435528"
Oct 30 19:59:41.700477 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:59:41.700443    6275 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-mxxll"
Oct 30 19:59:41.701993 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:59:41.701970    6275 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-7f5667f86c-mxxll container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused" start-of-body=
Oct 30 19:59:41.702054 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:59:41.702018    6275 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-mxxll" podUID="b3c62e4b-11c3-45ba-9e82-274e66592e69" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused"
Oct 30 19:59:42.700454 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:59:42.700404    6275 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-7f5667f86c-mxxll container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused" start-of-body=
Oct 30 19:59:42.700843 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:59:42.700484    6275 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-mxxll" podUID="b3c62e4b-11c3-45ba-9e82-274e66592e69" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused"
Oct 30 19:59:43.701061 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:59:43.701028    6275 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-7f5667f86c-mxxll container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused" start-of-body=
Oct 30 19:59:43.701511 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:59:43.701080    6275 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-mxxll" podUID="b3c62e4b-11c3-45ba-9e82-274e66592e69" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused"
Oct 30 19:59:44.700803 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:59:44.700760    6275 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-7f5667f86c-mxxll container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused" start-of-body=
Oct 30 19:59:44.700966 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:59:44.700840    6275 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-mxxll" podUID="b3c62e4b-11c3-45ba-9e82-274e66592e69" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused"
Oct 30 19:59:45.701110 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:59:45.701068    6275 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-7f5667f86c-mxxll container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused" start-of-body=
Oct 30 19:59:45.701621 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:59:45.701144    6275 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-mxxll" podUID="b3c62e4b-11c3-45ba-9e82-274e66592e69" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused"
Oct 30 19:59:46.701073 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:59:46.701032    6275 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-7f5667f86c-mxxll container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused" start-of-body=
Oct 30 19:59:46.701242 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:59:46.701110    6275 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-mxxll" podUID="b3c62e4b-11c3-45ba-9e82-274e66592e69" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused"
Oct 30 19:59:48.215784 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:59:48.215749    6275 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-mxxll"
Oct 30 19:59:48.216301 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:59:48.216173    6275 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-mxxll"
Oct 30 19:59:48.216956 ip-10-0-131-26 kubenswrapper[6275]: I1030 19:59:48.216935    6275 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-mxxll"
Oct 30 19:59:56.254506 ip-10-0-131-26 kubenswrapper[6275]: E1030 19:59:56.254472    6275 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-fwc77" containerName="extractor"
Oct 30 20:00:26.254461 ip-10-0-131-26 kubenswrapper[6275]: E1030 20:00:26.254358    6275 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-fwc77" containerName="extractor"
Oct 30 20:00:30.282255 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:00:30.282220    6275 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w5-626870-7fd9798fc9-njdrh"]
Oct 30 20:00:30.286134 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:00:30.286111    6275 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w5-626870-7fd9798fc9-njdrh"
Oct 30 20:00:30.306195 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:00:30.306172    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6nf25\" (UniqueName: \"kubernetes.io/projected/17234422-ae1c-4356-8250-afe91f192888-kube-api-access-6nf25\") pod \"payload-pre-processing-e2e-worker-w5-626870-7fd9798fc9-njdrh\" (UID: \"17234422-ae1c-4356-8250-afe91f192888\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w5-626870-7fd9798fc9-njdrh"
Oct 30 20:00:30.306290 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:00:30.306208    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/17234422-ae1c-4356-8250-afe91f192888-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w5-626870-7fd9798fc9-njdrh\" (UID: \"17234422-ae1c-4356-8250-afe91f192888\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w5-626870-7fd9798fc9-njdrh"
Oct 30 20:00:30.311593 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:00:30.311567    6275 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-worker-w5-626870-dockercfg-cnc7f\""
Oct 30 20:00:30.324156 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:00:30.324133    6275 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-worker-w5-626870\""
Oct 30 20:00:30.326079 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:00:30.326054    6275 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w5-626870-7fd9798fc9-njdrh"]
Oct 30 20:00:30.407189 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:00:30.407156    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6nf25\" (UniqueName: \"kubernetes.io/projected/17234422-ae1c-4356-8250-afe91f192888-kube-api-access-6nf25\") pod \"payload-pre-processing-e2e-worker-w5-626870-7fd9798fc9-njdrh\" (UID: \"17234422-ae1c-4356-8250-afe91f192888\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w5-626870-7fd9798fc9-njdrh"
Oct 30 20:00:30.407400 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:00:30.407210    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/17234422-ae1c-4356-8250-afe91f192888-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w5-626870-7fd9798fc9-njdrh\" (UID: \"17234422-ae1c-4356-8250-afe91f192888\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w5-626870-7fd9798fc9-njdrh"
Oct 30 20:00:30.408055 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:00:30.408031    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/17234422-ae1c-4356-8250-afe91f192888-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w5-626870-7fd9798fc9-njdrh\" (UID: \"17234422-ae1c-4356-8250-afe91f192888\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w5-626870-7fd9798fc9-njdrh"
Oct 30 20:00:30.442116 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:00:30.442091    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6nf25\" (UniqueName: \"kubernetes.io/projected/17234422-ae1c-4356-8250-afe91f192888-kube-api-access-6nf25\") pod \"payload-pre-processing-e2e-worker-w5-626870-7fd9798fc9-njdrh\" (UID: \"17234422-ae1c-4356-8250-afe91f192888\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w5-626870-7fd9798fc9-njdrh"
Oct 30 20:00:30.598860 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:00:30.598777    6275 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w5-626870-7fd9798fc9-njdrh"
Oct 30 20:00:30.901942 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:00:30.901917    6275 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w5-626870-7fd9798fc9-njdrh"]
Oct 30 20:00:30.903979 ip-10-0-131-26 kubenswrapper[6275]: W1030 20:00:30.903945    6275 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod17234422_ae1c_4356_8250_afe91f192888.slice/crio-5854d88d48eea672f14ec72df7630f1e8ee109e8b5609a22e04a51b4ed3c41c4 WatchSource:0}: Error finding container 5854d88d48eea672f14ec72df7630f1e8ee109e8b5609a22e04a51b4ed3c41c4: Status 404 returned error can't find the container with id 5854d88d48eea672f14ec72df7630f1e8ee109e8b5609a22e04a51b4ed3c41c4
Oct 30 20:00:31.133106 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:00:31.133063    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w5-626870-7fd9798fc9-njdrh" event={"ID":"17234422-ae1c-4356-8250-afe91f192888","Type":"ContainerStarted","Data":"5854d88d48eea672f14ec72df7630f1e8ee109e8b5609a22e04a51b4ed3c41c4"}
Oct 30 20:00:32.210837 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:00:32.210795    6275 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w2-efbac3-7bbf454b5c-w9rzj"]
Oct 30 20:00:32.220826 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:00:32.220797    6275 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w2-efbac3-7bbf454b5c-w9rzj"
Oct 30 20:00:32.234994 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:00:32.234964    6275 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w2-efbac3-7bbf454b5c-w9rzj"]
Oct 30 20:00:32.245290 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:00:32.245261    6275 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-worker-w2-efbac3-dockercfg-jvj4w\""
Oct 30 20:00:32.250968 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:00:32.250941    6275 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-worker-w2-efbac3\""
Oct 30 20:00:32.322018 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:00:32.321983    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4p92w\" (UniqueName: \"kubernetes.io/projected/186a15c4-0926-472b-9524-ea6f2d31f30f-kube-api-access-4p92w\") pod \"payload-processing-e2e-worker-w2-efbac3-7bbf454b5c-w9rzj\" (UID: \"186a15c4-0926-472b-9524-ea6f2d31f30f\") " pod="openshift-ingress/payload-processing-e2e-worker-w2-efbac3-7bbf454b5c-w9rzj"
Oct 30 20:00:32.322186 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:00:32.322122    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/186a15c4-0926-472b-9524-ea6f2d31f30f-plugins-config-volume\") pod \"payload-processing-e2e-worker-w2-efbac3-7bbf454b5c-w9rzj\" (UID: \"186a15c4-0926-472b-9524-ea6f2d31f30f\") " pod="openshift-ingress/payload-processing-e2e-worker-w2-efbac3-7bbf454b5c-w9rzj"
Oct 30 20:00:32.423257 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:00:32.423220    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4p92w\" (UniqueName: \"kubernetes.io/projected/186a15c4-0926-472b-9524-ea6f2d31f30f-kube-api-access-4p92w\") pod \"payload-processing-e2e-worker-w2-efbac3-7bbf454b5c-w9rzj\" (UID: \"186a15c4-0926-472b-9524-ea6f2d31f30f\") " pod="openshift-ingress/payload-processing-e2e-worker-w2-efbac3-7bbf454b5c-w9rzj"
Oct 30 20:00:32.423442 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:00:32.423286    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/186a15c4-0926-472b-9524-ea6f2d31f30f-plugins-config-volume\") pod \"payload-processing-e2e-worker-w2-efbac3-7bbf454b5c-w9rzj\" (UID: \"186a15c4-0926-472b-9524-ea6f2d31f30f\") " pod="openshift-ingress/payload-processing-e2e-worker-w2-efbac3-7bbf454b5c-w9rzj"
Oct 30 20:00:32.423989 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:00:32.423968    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/186a15c4-0926-472b-9524-ea6f2d31f30f-plugins-config-volume\") pod \"payload-processing-e2e-worker-w2-efbac3-7bbf454b5c-w9rzj\" (UID: \"186a15c4-0926-472b-9524-ea6f2d31f30f\") " pod="openshift-ingress/payload-processing-e2e-worker-w2-efbac3-7bbf454b5c-w9rzj"
Oct 30 20:00:32.455015 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:00:32.454983    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4p92w\" (UniqueName: \"kubernetes.io/projected/186a15c4-0926-472b-9524-ea6f2d31f30f-kube-api-access-4p92w\") pod \"payload-processing-e2e-worker-w2-efbac3-7bbf454b5c-w9rzj\" (UID: \"186a15c4-0926-472b-9524-ea6f2d31f30f\") " pod="openshift-ingress/payload-processing-e2e-worker-w2-efbac3-7bbf454b5c-w9rzj"
Oct 30 20:00:32.540315 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:00:32.540281    6275 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w2-efbac3-7bbf454b5c-w9rzj"
Oct 30 20:00:32.861108 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:00:32.861073    6275 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w2-efbac3-7bbf454b5c-w9rzj"]
Oct 30 20:00:32.862638 ip-10-0-131-26 kubenswrapper[6275]: W1030 20:00:32.862608    6275 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod186a15c4_0926_472b_9524_ea6f2d31f30f.slice/crio-f5552c0d2536a28eecac8b51675213734431379edbc08c513cdc590b094e9509 WatchSource:0}: Error finding container f5552c0d2536a28eecac8b51675213734431379edbc08c513cdc590b094e9509: Status 404 returned error can't find the container with id f5552c0d2536a28eecac8b51675213734431379edbc08c513cdc590b094e9509
Oct 30 20:00:33.144972 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:00:33.144896    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w2-efbac3-7bbf454b5c-w9rzj" event={"ID":"186a15c4-0926-472b-9524-ea6f2d31f30f","Type":"ContainerStarted","Data":"f5552c0d2536a28eecac8b51675213734431379edbc08c513cdc590b094e9509"}
Oct 30 20:00:33.146479 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:00:33.146453    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w5-626870-7fd9798fc9-njdrh" event={"ID":"17234422-ae1c-4356-8250-afe91f192888","Type":"ContainerStarted","Data":"615d5ab25cfec242f4059f688cf7dcd79178dae79976dc3375ef279474bd8697"}
Oct 30 20:00:33.146616 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:00:33.146550    6275 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w5-626870-7fd9798fc9-njdrh"
Oct 30 20:00:33.180050 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:00:33.180024    6275 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w3-912f24-585f6bf47-q7hqs"]
Oct 30 20:00:33.184957 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:00:33.184934    6275 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w3-912f24-585f6bf47-q7hqs"
Oct 30 20:00:33.191259 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:00:33.191222    6275 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-worker-w5-626870-7fd9798fc9-njdrh" podStartSLOduration=1.156836854 podStartE2EDuration="3.191209417s" totalImagesPullingTime="2.034372563s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:00:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:00:33.190951529 +0000 UTC m=+743.652678392" watchObservedRunningTime="2026-10-30 20:00:33.191209417 +0000 UTC m=+743.652936279"
Oct 30 20:00:33.205114 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:00:33.205085    6275 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-worker-w3-912f24-dockercfg-pxd2g\""
Oct 30 20:00:33.205409 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:00:33.205370    6275 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-worker-w3-912f24\""
Oct 30 20:00:33.207714 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:00:33.207693    6275 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w3-912f24-585f6bf47-q7hqs"]
Oct 30 20:00:33.231126 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:00:33.231095    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6csfn\" (UniqueName: \"kubernetes.io/projected/8b04ae86-d3b8-4e51-b357-25e38742b02f-kube-api-access-6csfn\") pod \"payload-pre-processing-e2e-worker-w3-912f24-585f6bf47-q7hqs\" (UID: \"8b04ae86-d3b8-4e51-b357-25e38742b02f\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w3-912f24-585f6bf47-q7hqs"
Oct 30 20:00:33.231611 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:00:33.231583    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8b04ae86-d3b8-4e51-b357-25e38742b02f-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w3-912f24-585f6bf47-q7hqs\" (UID: \"8b04ae86-d3b8-4e51-b357-25e38742b02f\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w3-912f24-585f6bf47-q7hqs"
Oct 30 20:00:33.272197 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:00:33.272162    6275 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w3-912f24-7bd864565f-fvnth"]
Oct 30 20:00:33.275794 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:00:33.275778    6275 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w3-912f24-7bd864565f-fvnth"
Oct 30 20:00:33.299304 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:00:33.299269    6275 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w3-912f24-7bd864565f-fvnth"]
Oct 30 20:00:33.332509 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:00:33.332478    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6csfn\" (UniqueName: \"kubernetes.io/projected/8b04ae86-d3b8-4e51-b357-25e38742b02f-kube-api-access-6csfn\") pod \"payload-pre-processing-e2e-worker-w3-912f24-585f6bf47-q7hqs\" (UID: \"8b04ae86-d3b8-4e51-b357-25e38742b02f\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w3-912f24-585f6bf47-q7hqs"
Oct 30 20:00:33.332654 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:00:33.332530    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8b04ae86-d3b8-4e51-b357-25e38742b02f-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w3-912f24-585f6bf47-q7hqs\" (UID: \"8b04ae86-d3b8-4e51-b357-25e38742b02f\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w3-912f24-585f6bf47-q7hqs"
Oct 30 20:00:33.332654 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:00:33.332565    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mb2pt\" (UniqueName: \"kubernetes.io/projected/72b9ada9-738c-4c37-96f4-5f827abdf99e-kube-api-access-mb2pt\") pod \"payload-processing-e2e-worker-w3-912f24-7bd864565f-fvnth\" (UID: \"72b9ada9-738c-4c37-96f4-5f827abdf99e\") " pod="openshift-ingress/payload-processing-e2e-worker-w3-912f24-7bd864565f-fvnth"
Oct 30 20:00:33.332654 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:00:33.332630    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/72b9ada9-738c-4c37-96f4-5f827abdf99e-plugins-config-volume\") pod \"payload-processing-e2e-worker-w3-912f24-7bd864565f-fvnth\" (UID: \"72b9ada9-738c-4c37-96f4-5f827abdf99e\") " pod="openshift-ingress/payload-processing-e2e-worker-w3-912f24-7bd864565f-fvnth"
Oct 30 20:00:33.333247 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:00:33.333227    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8b04ae86-d3b8-4e51-b357-25e38742b02f-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w3-912f24-585f6bf47-q7hqs\" (UID: \"8b04ae86-d3b8-4e51-b357-25e38742b02f\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w3-912f24-585f6bf47-q7hqs"
Oct 30 20:00:33.359064 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:00:33.359026    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6csfn\" (UniqueName: \"kubernetes.io/projected/8b04ae86-d3b8-4e51-b357-25e38742b02f-kube-api-access-6csfn\") pod \"payload-pre-processing-e2e-worker-w3-912f24-585f6bf47-q7hqs\" (UID: \"8b04ae86-d3b8-4e51-b357-25e38742b02f\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w3-912f24-585f6bf47-q7hqs"
Oct 30 20:00:33.433872 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:00:33.433788    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/72b9ada9-738c-4c37-96f4-5f827abdf99e-plugins-config-volume\") pod \"payload-processing-e2e-worker-w3-912f24-7bd864565f-fvnth\" (UID: \"72b9ada9-738c-4c37-96f4-5f827abdf99e\") " pod="openshift-ingress/payload-processing-e2e-worker-w3-912f24-7bd864565f-fvnth"
Oct 30 20:00:33.433872 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:00:33.433872    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mb2pt\" (UniqueName: \"kubernetes.io/projected/72b9ada9-738c-4c37-96f4-5f827abdf99e-kube-api-access-mb2pt\") pod \"payload-processing-e2e-worker-w3-912f24-7bd864565f-fvnth\" (UID: \"72b9ada9-738c-4c37-96f4-5f827abdf99e\") " pod="openshift-ingress/payload-processing-e2e-worker-w3-912f24-7bd864565f-fvnth"
Oct 30 20:00:33.434558 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:00:33.434538    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/72b9ada9-738c-4c37-96f4-5f827abdf99e-plugins-config-volume\") pod \"payload-processing-e2e-worker-w3-912f24-7bd864565f-fvnth\" (UID: \"72b9ada9-738c-4c37-96f4-5f827abdf99e\") " pod="openshift-ingress/payload-processing-e2e-worker-w3-912f24-7bd864565f-fvnth"
Oct 30 20:00:33.459875 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:00:33.459847    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mb2pt\" (UniqueName: \"kubernetes.io/projected/72b9ada9-738c-4c37-96f4-5f827abdf99e-kube-api-access-mb2pt\") pod \"payload-processing-e2e-worker-w3-912f24-7bd864565f-fvnth\" (UID: \"72b9ada9-738c-4c37-96f4-5f827abdf99e\") " pod="openshift-ingress/payload-processing-e2e-worker-w3-912f24-7bd864565f-fvnth"
Oct 30 20:00:33.535111 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:00:33.535078    6275 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w3-912f24-585f6bf47-q7hqs"
Oct 30 20:00:33.588989 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:00:33.588956    6275 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w3-912f24-7bd864565f-fvnth"
Oct 30 20:00:33.839769 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:00:33.839741    6275 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w3-912f24-585f6bf47-q7hqs"]
Oct 30 20:00:33.840813 ip-10-0-131-26 kubenswrapper[6275]: W1030 20:00:33.840783    6275 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8b04ae86_d3b8_4e51_b357_25e38742b02f.slice/crio-2fe3a82018138e0b04c1cac1191877da88eaae01cbfb107264c81720cc2890ce WatchSource:0}: Error finding container 2fe3a82018138e0b04c1cac1191877da88eaae01cbfb107264c81720cc2890ce: Status 404 returned error can't find the container with id 2fe3a82018138e0b04c1cac1191877da88eaae01cbfb107264c81720cc2890ce
Oct 30 20:00:33.902748 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:00:33.902724    6275 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w3-912f24-7bd864565f-fvnth"]
Oct 30 20:00:33.904649 ip-10-0-131-26 kubenswrapper[6275]: W1030 20:00:33.904626    6275 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod72b9ada9_738c_4c37_96f4_5f827abdf99e.slice/crio-41284166c683bf002cb466bfa8be3728c87108436a4c764481f227336364d64d WatchSource:0}: Error finding container 41284166c683bf002cb466bfa8be3728c87108436a4c764481f227336364d64d: Status 404 returned error can't find the container with id 41284166c683bf002cb466bfa8be3728c87108436a4c764481f227336364d64d
Oct 30 20:00:34.153723 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:00:34.153595    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w2-efbac3-7bbf454b5c-w9rzj" event={"ID":"186a15c4-0926-472b-9524-ea6f2d31f30f","Type":"ContainerStarted","Data":"4a9be1bcfb637a86d2a2d2c0f855a4eacd18d605b8a13c6012498fa9b93ccb91"}
Oct 30 20:00:34.153723 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:00:34.153664    6275 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-worker-w2-efbac3-7bbf454b5c-w9rzj"
Oct 30 20:00:34.155381 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:00:34.155356    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w3-912f24-7bd864565f-fvnth" event={"ID":"72b9ada9-738c-4c37-96f4-5f827abdf99e","Type":"ContainerStarted","Data":"6fb1d1e604a32ab82798f59f6e3499dba0c13153708eae887e75b60600914e5e"}
Oct 30 20:00:34.155525 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:00:34.155401    6275 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-worker-w3-912f24-7bd864565f-fvnth"
Oct 30 20:00:34.155525 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:00:34.155442    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w3-912f24-7bd864565f-fvnth" event={"ID":"72b9ada9-738c-4c37-96f4-5f827abdf99e","Type":"ContainerStarted","Data":"41284166c683bf002cb466bfa8be3728c87108436a4c764481f227336364d64d"}
Oct 30 20:00:34.157104 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:00:34.157080    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w3-912f24-585f6bf47-q7hqs" event={"ID":"8b04ae86-d3b8-4e51-b357-25e38742b02f","Type":"ContainerStarted","Data":"b64a30d3ff021dea3b430ffac5483b0c084ee9518aeb3fe9a5d6b9d2dc7ca121"}
Oct 30 20:00:34.157210 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:00:34.157122    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w3-912f24-585f6bf47-q7hqs" event={"ID":"8b04ae86-d3b8-4e51-b357-25e38742b02f","Type":"ContainerStarted","Data":"2fe3a82018138e0b04c1cac1191877da88eaae01cbfb107264c81720cc2890ce"}
Oct 30 20:00:34.157325 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:00:34.157308    6275 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w3-912f24-585f6bf47-q7hqs"
Oct 30 20:00:34.200812 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:00:34.200772    6275 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-worker-w2-efbac3-7bbf454b5c-w9rzj" podStartSLOduration=1.899099438 podStartE2EDuration="2.200759206s" totalImagesPullingTime="301.659768ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:00:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:00:34.198765411 +0000 UTC m=+744.660492274" watchObservedRunningTime="2026-10-30 20:00:34.200759206 +0000 UTC m=+744.662486069"
Oct 30 20:00:34.252680 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:00:34.252641    6275 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-worker-w3-912f24-7bd864565f-fvnth" podStartSLOduration=1.252629128 podStartE2EDuration="1.252629128s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:00:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:00:34.250267333 +0000 UTC m=+744.711994194" watchObservedRunningTime="2026-10-30 20:00:34.252629128 +0000 UTC m=+744.714356204"
Oct 30 20:00:34.300195 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:00:34.300156    6275 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-worker-w3-912f24-585f6bf47-q7hqs" podStartSLOduration=1.300146579 podStartE2EDuration="1.300146579s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:00:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:00:34.298805745 +0000 UTC m=+744.760532608" watchObservedRunningTime="2026-10-30 20:00:34.300146579 +0000 UTC m=+744.761873441"
Oct 30 20:00:36.822283 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:00:36.822249    6275 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w1-5f10d2-67674b9455-6zbsz"]
Oct 30 20:00:36.826171 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:00:36.826155    6275 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w1-5f10d2-67674b9455-6zbsz"
Oct 30 20:00:36.848129 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:00:36.848102    6275 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w1-5f10d2-67674b9455-6zbsz"]
Oct 30 20:00:36.854928 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:00:36.854905    6275 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-worker-w1-5f10d2\""
Oct 30 20:00:36.855035 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:00:36.854942    6275 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-worker-w1-5f10d2-dockercfg-zz9v8\""
Oct 30 20:00:36.866606 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:00:36.866581    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5m5sm\" (UniqueName: \"kubernetes.io/projected/1e73518f-783a-4762-96b8-42d3f38a5cd6-kube-api-access-5m5sm\") pod \"payload-processing-e2e-worker-w1-5f10d2-67674b9455-6zbsz\" (UID: \"1e73518f-783a-4762-96b8-42d3f38a5cd6\") " pod="openshift-ingress/payload-processing-e2e-worker-w1-5f10d2-67674b9455-6zbsz"
Oct 30 20:00:36.866703 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:00:36.866633    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1e73518f-783a-4762-96b8-42d3f38a5cd6-plugins-config-volume\") pod \"payload-processing-e2e-worker-w1-5f10d2-67674b9455-6zbsz\" (UID: \"1e73518f-783a-4762-96b8-42d3f38a5cd6\") " pod="openshift-ingress/payload-processing-e2e-worker-w1-5f10d2-67674b9455-6zbsz"
Oct 30 20:00:36.967767 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:00:36.967726    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1e73518f-783a-4762-96b8-42d3f38a5cd6-plugins-config-volume\") pod \"payload-processing-e2e-worker-w1-5f10d2-67674b9455-6zbsz\" (UID: \"1e73518f-783a-4762-96b8-42d3f38a5cd6\") " pod="openshift-ingress/payload-processing-e2e-worker-w1-5f10d2-67674b9455-6zbsz"
Oct 30 20:00:36.967925 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:00:36.967872    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5m5sm\" (UniqueName: \"kubernetes.io/projected/1e73518f-783a-4762-96b8-42d3f38a5cd6-kube-api-access-5m5sm\") pod \"payload-processing-e2e-worker-w1-5f10d2-67674b9455-6zbsz\" (UID: \"1e73518f-783a-4762-96b8-42d3f38a5cd6\") " pod="openshift-ingress/payload-processing-e2e-worker-w1-5f10d2-67674b9455-6zbsz"
Oct 30 20:00:36.968501 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:00:36.968482    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1e73518f-783a-4762-96b8-42d3f38a5cd6-plugins-config-volume\") pod \"payload-processing-e2e-worker-w1-5f10d2-67674b9455-6zbsz\" (UID: \"1e73518f-783a-4762-96b8-42d3f38a5cd6\") " pod="openshift-ingress/payload-processing-e2e-worker-w1-5f10d2-67674b9455-6zbsz"
Oct 30 20:00:37.014008 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:00:37.013981    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5m5sm\" (UniqueName: \"kubernetes.io/projected/1e73518f-783a-4762-96b8-42d3f38a5cd6-kube-api-access-5m5sm\") pod \"payload-processing-e2e-worker-w1-5f10d2-67674b9455-6zbsz\" (UID: \"1e73518f-783a-4762-96b8-42d3f38a5cd6\") " pod="openshift-ingress/payload-processing-e2e-worker-w1-5f10d2-67674b9455-6zbsz"
Oct 30 20:00:37.139696 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:00:37.139600    6275 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w1-5f10d2-67674b9455-6zbsz"
Oct 30 20:00:37.456183 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:00:37.456152    6275 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w1-5f10d2-67674b9455-6zbsz"]
Oct 30 20:00:37.457187 ip-10-0-131-26 kubenswrapper[6275]: W1030 20:00:37.457159    6275 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1e73518f_783a_4762_96b8_42d3f38a5cd6.slice/crio-77acf1aca3abc5b6c840c3fe7707e44cd011c5b8c677bc8796cd62638c3742de WatchSource:0}: Error finding container 77acf1aca3abc5b6c840c3fe7707e44cd011c5b8c677bc8796cd62638c3742de: Status 404 returned error can't find the container with id 77acf1aca3abc5b6c840c3fe7707e44cd011c5b8c677bc8796cd62638c3742de
Oct 30 20:00:37.817352 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:00:37.817319    6275 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-f1f016-568d55d755-xjm26"]
Oct 30 20:00:37.820964 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:00:37.820946    6275 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-f1f016-568d55d755-xjm26"
Oct 30 20:00:37.846658 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:00:37.846631    6275 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-f1f016-568d55d755-xjm26"]
Oct 30 20:00:37.856586 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:00:37.856560    6275 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-worker-w4-f1f016\""
Oct 30 20:00:37.856703 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:00:37.856687    6275 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-worker-w4-f1f016-dockercfg-tkbvn\""
Oct 30 20:00:37.877425 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:00:37.877385    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0b8c41e3-9d0d-400b-839f-f186bcaae886-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w4-f1f016-568d55d755-xjm26\" (UID: \"0b8c41e3-9d0d-400b-839f-f186bcaae886\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-f1f016-568d55d755-xjm26"
Oct 30 20:00:37.877537 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:00:37.877458    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-smgqc\" (UniqueName: \"kubernetes.io/projected/0b8c41e3-9d0d-400b-839f-f186bcaae886-kube-api-access-smgqc\") pod \"payload-pre-processing-e2e-worker-w4-f1f016-568d55d755-xjm26\" (UID: \"0b8c41e3-9d0d-400b-839f-f186bcaae886\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-f1f016-568d55d755-xjm26"
Oct 30 20:00:37.921833 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:00:37.921799    6275 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w4-f1f016-6754476fb5-jlhbg"]
Oct 30 20:00:37.925464 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:00:37.925447    6275 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w4-f1f016-6754476fb5-jlhbg"
Oct 30 20:00:37.947113 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:00:37.947087    6275 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w4-f1f016-6754476fb5-jlhbg"]
Oct 30 20:00:37.978796 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:00:37.978771    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0b8c41e3-9d0d-400b-839f-f186bcaae886-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w4-f1f016-568d55d755-xjm26\" (UID: \"0b8c41e3-9d0d-400b-839f-f186bcaae886\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-f1f016-568d55d755-xjm26"
Oct 30 20:00:37.978917 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:00:37.978811    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9r266\" (UniqueName: \"kubernetes.io/projected/5bce3c0a-07d6-490e-9506-1600a2278a23-kube-api-access-9r266\") pod \"payload-processing-e2e-worker-w4-f1f016-6754476fb5-jlhbg\" (UID: \"5bce3c0a-07d6-490e-9506-1600a2278a23\") " pod="openshift-ingress/payload-processing-e2e-worker-w4-f1f016-6754476fb5-jlhbg"
Oct 30 20:00:37.978917 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:00:37.978835    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5bce3c0a-07d6-490e-9506-1600a2278a23-plugins-config-volume\") pod \"payload-processing-e2e-worker-w4-f1f016-6754476fb5-jlhbg\" (UID: \"5bce3c0a-07d6-490e-9506-1600a2278a23\") " pod="openshift-ingress/payload-processing-e2e-worker-w4-f1f016-6754476fb5-jlhbg"
Oct 30 20:00:37.978917 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:00:37.978857    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-smgqc\" (UniqueName: \"kubernetes.io/projected/0b8c41e3-9d0d-400b-839f-f186bcaae886-kube-api-access-smgqc\") pod \"payload-pre-processing-e2e-worker-w4-f1f016-568d55d755-xjm26\" (UID: \"0b8c41e3-9d0d-400b-839f-f186bcaae886\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-f1f016-568d55d755-xjm26"
Oct 30 20:00:37.979562 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:00:37.979545    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0b8c41e3-9d0d-400b-839f-f186bcaae886-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w4-f1f016-568d55d755-xjm26\" (UID: \"0b8c41e3-9d0d-400b-839f-f186bcaae886\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-f1f016-568d55d755-xjm26"
Oct 30 20:00:38.006649 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:00:38.006620    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-smgqc\" (UniqueName: \"kubernetes.io/projected/0b8c41e3-9d0d-400b-839f-f186bcaae886-kube-api-access-smgqc\") pod \"payload-pre-processing-e2e-worker-w4-f1f016-568d55d755-xjm26\" (UID: \"0b8c41e3-9d0d-400b-839f-f186bcaae886\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-f1f016-568d55d755-xjm26"
Oct 30 20:00:38.079961 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:00:38.079883    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9r266\" (UniqueName: \"kubernetes.io/projected/5bce3c0a-07d6-490e-9506-1600a2278a23-kube-api-access-9r266\") pod \"payload-processing-e2e-worker-w4-f1f016-6754476fb5-jlhbg\" (UID: \"5bce3c0a-07d6-490e-9506-1600a2278a23\") " pod="openshift-ingress/payload-processing-e2e-worker-w4-f1f016-6754476fb5-jlhbg"
Oct 30 20:00:38.079961 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:00:38.079932    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5bce3c0a-07d6-490e-9506-1600a2278a23-plugins-config-volume\") pod \"payload-processing-e2e-worker-w4-f1f016-6754476fb5-jlhbg\" (UID: \"5bce3c0a-07d6-490e-9506-1600a2278a23\") " pod="openshift-ingress/payload-processing-e2e-worker-w4-f1f016-6754476fb5-jlhbg"
Oct 30 20:00:38.080717 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:00:38.080693    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5bce3c0a-07d6-490e-9506-1600a2278a23-plugins-config-volume\") pod \"payload-processing-e2e-worker-w4-f1f016-6754476fb5-jlhbg\" (UID: \"5bce3c0a-07d6-490e-9506-1600a2278a23\") " pod="openshift-ingress/payload-processing-e2e-worker-w4-f1f016-6754476fb5-jlhbg"
Oct 30 20:00:38.105356 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:00:38.105330    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9r266\" (UniqueName: \"kubernetes.io/projected/5bce3c0a-07d6-490e-9506-1600a2278a23-kube-api-access-9r266\") pod \"payload-processing-e2e-worker-w4-f1f016-6754476fb5-jlhbg\" (UID: \"5bce3c0a-07d6-490e-9506-1600a2278a23\") " pod="openshift-ingress/payload-processing-e2e-worker-w4-f1f016-6754476fb5-jlhbg"
Oct 30 20:00:38.134007 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:00:38.133986    6275 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-f1f016-568d55d755-xjm26"
Oct 30 20:00:38.182229 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:00:38.182198    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w1-5f10d2-67674b9455-6zbsz" event={"ID":"1e73518f-783a-4762-96b8-42d3f38a5cd6","Type":"ContainerStarted","Data":"4f2ab27f4b4c8ab7b8d6694289ff320156aa6aa9e051f5c587d35cce33bf6b61"}
Oct 30 20:00:38.182406 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:00:38.182254    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w1-5f10d2-67674b9455-6zbsz" event={"ID":"1e73518f-783a-4762-96b8-42d3f38a5cd6","Type":"ContainerStarted","Data":"77acf1aca3abc5b6c840c3fe7707e44cd011c5b8c677bc8796cd62638c3742de"}
Oct 30 20:00:38.182406 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:00:38.182283    6275 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-worker-w1-5f10d2-67674b9455-6zbsz"
Oct 30 20:00:38.239172 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:00:38.239145    6275 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w4-f1f016-6754476fb5-jlhbg"
Oct 30 20:00:38.444896 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:00:38.444853    6275 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-worker-w1-5f10d2-67674b9455-6zbsz" podStartSLOduration=2.44483619 podStartE2EDuration="2.44483619s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:00:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:00:38.231787436 +0000 UTC m=+748.693514300" watchObservedRunningTime="2026-10-30 20:00:38.44483619 +0000 UTC m=+748.906563054"
Oct 30 20:00:38.445289 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:00:38.445270    6275 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-f1f016-568d55d755-xjm26"]
Oct 30 20:00:38.446362 ip-10-0-131-26 kubenswrapper[6275]: W1030 20:00:38.446337    6275 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0b8c41e3_9d0d_400b_839f_f186bcaae886.slice/crio-242984319cb3af299b5278bd894da9884780ff5dad226a8c5d8048bbe3f1dff0 WatchSource:0}: Error finding container 242984319cb3af299b5278bd894da9884780ff5dad226a8c5d8048bbe3f1dff0: Status 404 returned error can't find the container with id 242984319cb3af299b5278bd894da9884780ff5dad226a8c5d8048bbe3f1dff0
Oct 30 20:00:38.552513 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:00:38.552489    6275 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w4-f1f016-6754476fb5-jlhbg"]
Oct 30 20:00:38.553957 ip-10-0-131-26 kubenswrapper[6275]: W1030 20:00:38.553930    6275 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5bce3c0a_07d6_490e_9506_1600a2278a23.slice/crio-f45173fef01f3e98cdd9df6f8d71a7e32712f4a4a8c94124dd371cc3590ff1f6 WatchSource:0}: Error finding container f45173fef01f3e98cdd9df6f8d71a7e32712f4a4a8c94124dd371cc3590ff1f6: Status 404 returned error can't find the container with id f45173fef01f3e98cdd9df6f8d71a7e32712f4a4a8c94124dd371cc3590ff1f6
Oct 30 20:00:39.190742 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:00:39.190711    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w4-f1f016-6754476fb5-jlhbg" event={"ID":"5bce3c0a-07d6-490e-9506-1600a2278a23","Type":"ContainerStarted","Data":"29ffbd94cf49b45ba3ea3ea225f5581c8d67534fbf513ce978bea34d8c933e1c"}
Oct 30 20:00:39.191245 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:00:39.190768    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w4-f1f016-6754476fb5-jlhbg" event={"ID":"5bce3c0a-07d6-490e-9506-1600a2278a23","Type":"ContainerStarted","Data":"f45173fef01f3e98cdd9df6f8d71a7e32712f4a4a8c94124dd371cc3590ff1f6"}
Oct 30 20:00:39.191245 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:00:39.190917    6275 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-worker-w4-f1f016-6754476fb5-jlhbg"
Oct 30 20:00:39.192977 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:00:39.192946    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-f1f016-568d55d755-xjm26" event={"ID":"0b8c41e3-9d0d-400b-839f-f186bcaae886","Type":"ContainerStarted","Data":"77b58f04a9ced73eedeada330e45ae8399a23e6533bfff8b85ea5ca8147ef942"}
Oct 30 20:00:39.193109 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:00:39.192987    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-f1f016-568d55d755-xjm26" event={"ID":"0b8c41e3-9d0d-400b-839f-f186bcaae886","Type":"ContainerStarted","Data":"242984319cb3af299b5278bd894da9884780ff5dad226a8c5d8048bbe3f1dff0"}
Oct 30 20:00:39.193178 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:00:39.193161    6275 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-f1f016-568d55d755-xjm26"
Oct 30 20:00:39.236772 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:00:39.236724    6275 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-worker-w4-f1f016-6754476fb5-jlhbg" podStartSLOduration=2.2367114 podStartE2EDuration="2.2367114s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:00:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:00:39.234501437 +0000 UTC m=+749.696228301" watchObservedRunningTime="2026-10-30 20:00:39.2367114 +0000 UTC m=+749.698438279"
Oct 30 20:00:39.285800 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:00:39.285713    6275 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-f1f016-568d55d755-xjm26" podStartSLOduration=2.285694943 podStartE2EDuration="2.285694943s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:00:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:00:39.280827165 +0000 UTC m=+749.742554027" watchObservedRunningTime="2026-10-30 20:00:39.285694943 +0000 UTC m=+749.747421806"
Oct 30 20:00:40.397672 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:00:40.397634    6275 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w1-5f10d2-59db957d85-lhp47"]
Oct 30 20:00:40.401800 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:00:40.401778    6275 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-5f10d2-59db957d85-lhp47"
Oct 30 20:00:40.420708 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:00:40.420684    6275 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-worker-w1-5f10d2-serving-cert\""
Oct 30 20:00:40.430909 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:00:40.430883    6275 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Oct 30 20:00:40.431084 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:00:40.431056    6275 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-7wqnw\""
Oct 30 20:00:40.433407 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:00:40.433388    6275 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w1-5f10d2-59db957d85-lhp47"]
Oct 30 20:00:40.504261 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:00:40.504229    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8c28cbc6-12e2-4297-8652-fd5215a5414b-maas-api-tls\") pod \"maas-api-e2e-worker-w1-5f10d2-59db957d85-lhp47\" (UID: \"8c28cbc6-12e2-4297-8652-fd5215a5414b\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-5f10d2-59db957d85-lhp47"
Oct 30 20:00:40.504441 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:00:40.504286    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8c28cbc6-12e2-4297-8652-fd5215a5414b-openshift-service-ca\") pod \"maas-api-e2e-worker-w1-5f10d2-59db957d85-lhp47\" (UID: \"8c28cbc6-12e2-4297-8652-fd5215a5414b\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-5f10d2-59db957d85-lhp47"
Oct 30 20:00:40.504522 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:00:40.504440    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2kmqn\" (UniqueName: \"kubernetes.io/projected/8c28cbc6-12e2-4297-8652-fd5215a5414b-kube-api-access-2kmqn\") pod \"maas-api-e2e-worker-w1-5f10d2-59db957d85-lhp47\" (UID: \"8c28cbc6-12e2-4297-8652-fd5215a5414b\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-5f10d2-59db957d85-lhp47"
Oct 30 20:00:40.504522 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:00:40.504502    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8c28cbc6-12e2-4297-8652-fd5215a5414b-metrics-certs\") pod \"maas-api-e2e-worker-w1-5f10d2-59db957d85-lhp47\" (UID: \"8c28cbc6-12e2-4297-8652-fd5215a5414b\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-5f10d2-59db957d85-lhp47"
Oct 30 20:00:40.605137 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:00:40.605105    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8c28cbc6-12e2-4297-8652-fd5215a5414b-metrics-certs\") pod \"maas-api-e2e-worker-w1-5f10d2-59db957d85-lhp47\" (UID: \"8c28cbc6-12e2-4297-8652-fd5215a5414b\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-5f10d2-59db957d85-lhp47"
Oct 30 20:00:40.605287 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:00:40.605164    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8c28cbc6-12e2-4297-8652-fd5215a5414b-maas-api-tls\") pod \"maas-api-e2e-worker-w1-5f10d2-59db957d85-lhp47\" (UID: \"8c28cbc6-12e2-4297-8652-fd5215a5414b\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-5f10d2-59db957d85-lhp47"
Oct 30 20:00:40.605287 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:00:40.605217    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8c28cbc6-12e2-4297-8652-fd5215a5414b-openshift-service-ca\") pod \"maas-api-e2e-worker-w1-5f10d2-59db957d85-lhp47\" (UID: \"8c28cbc6-12e2-4297-8652-fd5215a5414b\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-5f10d2-59db957d85-lhp47"
Oct 30 20:00:40.605389 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:00:40.605284    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2kmqn\" (UniqueName: \"kubernetes.io/projected/8c28cbc6-12e2-4297-8652-fd5215a5414b-kube-api-access-2kmqn\") pod \"maas-api-e2e-worker-w1-5f10d2-59db957d85-lhp47\" (UID: \"8c28cbc6-12e2-4297-8652-fd5215a5414b\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-5f10d2-59db957d85-lhp47"
Oct 30 20:00:40.605971 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:00:40.605943    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8c28cbc6-12e2-4297-8652-fd5215a5414b-openshift-service-ca\") pod \"maas-api-e2e-worker-w1-5f10d2-59db957d85-lhp47\" (UID: \"8c28cbc6-12e2-4297-8652-fd5215a5414b\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-5f10d2-59db957d85-lhp47"
Oct 30 20:00:40.607846 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:00:40.607823    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8c28cbc6-12e2-4297-8652-fd5215a5414b-metrics-certs\") pod \"maas-api-e2e-worker-w1-5f10d2-59db957d85-lhp47\" (UID: \"8c28cbc6-12e2-4297-8652-fd5215a5414b\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-5f10d2-59db957d85-lhp47"
Oct 30 20:00:40.607909 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:00:40.607823    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8c28cbc6-12e2-4297-8652-fd5215a5414b-maas-api-tls\") pod \"maas-api-e2e-worker-w1-5f10d2-59db957d85-lhp47\" (UID: \"8c28cbc6-12e2-4297-8652-fd5215a5414b\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-5f10d2-59db957d85-lhp47"
Oct 30 20:00:40.630332 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:00:40.630302    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2kmqn\" (UniqueName: \"kubernetes.io/projected/8c28cbc6-12e2-4297-8652-fd5215a5414b-kube-api-access-2kmqn\") pod \"maas-api-e2e-worker-w1-5f10d2-59db957d85-lhp47\" (UID: \"8c28cbc6-12e2-4297-8652-fd5215a5414b\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-5f10d2-59db957d85-lhp47"
Oct 30 20:00:40.715663 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:00:40.715552    6275 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-5f10d2-59db957d85-lhp47"
Oct 30 20:00:41.021732 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:00:41.021700    6275 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w1-5f10d2-59db957d85-lhp47"]
Oct 30 20:00:41.022726 ip-10-0-131-26 kubenswrapper[6275]: W1030 20:00:41.022700    6275 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8c28cbc6_12e2_4297_8652_fd5215a5414b.slice/crio-394b132f8783844a3ac8435789c6958126b8cf46945d0c37687dd86272e432f2 WatchSource:0}: Error finding container 394b132f8783844a3ac8435789c6958126b8cf46945d0c37687dd86272e432f2: Status 404 returned error can't find the container with id 394b132f8783844a3ac8435789c6958126b8cf46945d0c37687dd86272e432f2
Oct 30 20:00:41.207472 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:00:41.207406    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-5f10d2-59db957d85-lhp47" event={"ID":"8c28cbc6-12e2-4297-8652-fd5215a5414b","Type":"ContainerStarted","Data":"394b132f8783844a3ac8435789c6958126b8cf46945d0c37687dd86272e432f2"}
Oct 30 20:00:43.221004 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:00:43.220962    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-5f10d2-59db957d85-lhp47" event={"ID":"8c28cbc6-12e2-4297-8652-fd5215a5414b","Type":"ContainerStarted","Data":"7647e6c334603691b3b7c1c0d30c329578e294cbb806b082fe1e71aa8d13d974"}
Oct 30 20:00:43.221395 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:00:43.221035    6275 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-5f10d2-59db957d85-lhp47"
Oct 30 20:00:43.267441 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:00:43.267369    6275 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-5f10d2-59db957d85-lhp47" podStartSLOduration=1.902386238 podStartE2EDuration="3.267355518s" totalImagesPullingTime="1.36496928s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:00:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:00:43.265660531 +0000 UTC m=+753.727387396" watchObservedRunningTime="2026-10-30 20:00:43.267355518 +0000 UTC m=+753.729082381"
Oct 30 20:00:44.160712 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:00:44.160674    6275 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w5-626870-7fd9798fc9-njdrh"
Oct 30 20:00:45.165489 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:00:45.165463    6275 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-worker-w3-912f24-7bd864565f-fvnth"
Oct 30 20:00:45.165879 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:00:45.165553    6275 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w3-912f24-585f6bf47-q7hqs"
Oct 30 20:00:45.165879 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:00:45.165722    6275 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-worker-w2-efbac3-7bbf454b5c-w9rzj"
Oct 30 20:00:49.196448 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:00:49.196408    6275 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-worker-w1-5f10d2-67674b9455-6zbsz"
Oct 30 20:00:49.233244 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:00:49.233220    6275 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-5f10d2-59db957d85-lhp47"
Oct 30 20:00:50.201870 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:00:50.201842    6275 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-f1f016-568d55d755-xjm26"
Oct 30 20:00:50.202342 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:00:50.201922    6275 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-worker-w4-f1f016-6754476fb5-jlhbg"
Oct 30 20:00:54.041955 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:00:54.041916    6275 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w4-f1f016-openshift-default-6c85499cc-zn5bc"]
Oct 30 20:00:54.046263 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:00:54.046243    6275 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-f1f016-openshift-default-6c85499cc-zn5bc"
Oct 30 20:00:54.077898 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:00:54.077872    6275 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-f1f016-openshift-default-6c85499cc-zn5bc"]
Oct 30 20:00:54.127775 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:00:54.127737    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/65f30ed1-2ae6-464b-8293-a36c663bde0a-workload-socket\") pod \"e2e-worker-w4-f1f016-openshift-default-6c85499cc-zn5bc\" (UID: \"65f30ed1-2ae6-464b-8293-a36c663bde0a\") " pod="openshift-ingress/e2e-worker-w4-f1f016-openshift-default-6c85499cc-zn5bc"
Oct 30 20:00:54.127943 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:00:54.127805    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/65f30ed1-2ae6-464b-8293-a36c663bde0a-istio-podinfo\") pod \"e2e-worker-w4-f1f016-openshift-default-6c85499cc-zn5bc\" (UID: \"65f30ed1-2ae6-464b-8293-a36c663bde0a\") " pod="openshift-ingress/e2e-worker-w4-f1f016-openshift-default-6c85499cc-zn5bc"
Oct 30 20:00:54.127943 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:00:54.127909    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/65f30ed1-2ae6-464b-8293-a36c663bde0a-istio-envoy\") pod \"e2e-worker-w4-f1f016-openshift-default-6c85499cc-zn5bc\" (UID: \"65f30ed1-2ae6-464b-8293-a36c663bde0a\") " pod="openshift-ingress/e2e-worker-w4-f1f016-openshift-default-6c85499cc-zn5bc"
Oct 30 20:00:54.127943 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:00:54.127939    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/65f30ed1-2ae6-464b-8293-a36c663bde0a-workload-certs\") pod \"e2e-worker-w4-f1f016-openshift-default-6c85499cc-zn5bc\" (UID: \"65f30ed1-2ae6-464b-8293-a36c663bde0a\") " pod="openshift-ingress/e2e-worker-w4-f1f016-openshift-default-6c85499cc-zn5bc"
Oct 30 20:00:54.128151 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:00:54.127970    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/65f30ed1-2ae6-464b-8293-a36c663bde0a-istio-token\") pod \"e2e-worker-w4-f1f016-openshift-default-6c85499cc-zn5bc\" (UID: \"65f30ed1-2ae6-464b-8293-a36c663bde0a\") " pod="openshift-ingress/e2e-worker-w4-f1f016-openshift-default-6c85499cc-zn5bc"
Oct 30 20:00:54.128151 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:00:54.128083    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/65f30ed1-2ae6-464b-8293-a36c663bde0a-istio-data\") pod \"e2e-worker-w4-f1f016-openshift-default-6c85499cc-zn5bc\" (UID: \"65f30ed1-2ae6-464b-8293-a36c663bde0a\") " pod="openshift-ingress/e2e-worker-w4-f1f016-openshift-default-6c85499cc-zn5bc"
Oct 30 20:00:54.128151 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:00:54.128111    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-glkk7\" (UniqueName: \"kubernetes.io/projected/65f30ed1-2ae6-464b-8293-a36c663bde0a-kube-api-access-glkk7\") pod \"e2e-worker-w4-f1f016-openshift-default-6c85499cc-zn5bc\" (UID: \"65f30ed1-2ae6-464b-8293-a36c663bde0a\") " pod="openshift-ingress/e2e-worker-w4-f1f016-openshift-default-6c85499cc-zn5bc"
Oct 30 20:00:54.128151 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:00:54.128134    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/65f30ed1-2ae6-464b-8293-a36c663bde0a-credential-socket\") pod \"e2e-worker-w4-f1f016-openshift-default-6c85499cc-zn5bc\" (UID: \"65f30ed1-2ae6-464b-8293-a36c663bde0a\") " pod="openshift-ingress/e2e-worker-w4-f1f016-openshift-default-6c85499cc-zn5bc"
Oct 30 20:00:54.128355 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:00:54.128186    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/65f30ed1-2ae6-464b-8293-a36c663bde0a-istiod-ca-cert\") pod \"e2e-worker-w4-f1f016-openshift-default-6c85499cc-zn5bc\" (UID: \"65f30ed1-2ae6-464b-8293-a36c663bde0a\") " pod="openshift-ingress/e2e-worker-w4-f1f016-openshift-default-6c85499cc-zn5bc"
Oct 30 20:00:54.154433 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:00:54.154391    6275 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w4-f1f016-openshift-default-dockercfg-pgfjl\""
Oct 30 20:00:54.228855 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:00:54.228821    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/65f30ed1-2ae6-464b-8293-a36c663bde0a-istio-data\") pod \"e2e-worker-w4-f1f016-openshift-default-6c85499cc-zn5bc\" (UID: \"65f30ed1-2ae6-464b-8293-a36c663bde0a\") " pod="openshift-ingress/e2e-worker-w4-f1f016-openshift-default-6c85499cc-zn5bc"
Oct 30 20:00:54.228855 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:00:54.228858    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-glkk7\" (UniqueName: \"kubernetes.io/projected/65f30ed1-2ae6-464b-8293-a36c663bde0a-kube-api-access-glkk7\") pod \"e2e-worker-w4-f1f016-openshift-default-6c85499cc-zn5bc\" (UID: \"65f30ed1-2ae6-464b-8293-a36c663bde0a\") " pod="openshift-ingress/e2e-worker-w4-f1f016-openshift-default-6c85499cc-zn5bc"
Oct 30 20:00:54.229030 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:00:54.228878    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/65f30ed1-2ae6-464b-8293-a36c663bde0a-credential-socket\") pod \"e2e-worker-w4-f1f016-openshift-default-6c85499cc-zn5bc\" (UID: \"65f30ed1-2ae6-464b-8293-a36c663bde0a\") " pod="openshift-ingress/e2e-worker-w4-f1f016-openshift-default-6c85499cc-zn5bc"
Oct 30 20:00:54.229030 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:00:54.229003    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/65f30ed1-2ae6-464b-8293-a36c663bde0a-istiod-ca-cert\") pod \"e2e-worker-w4-f1f016-openshift-default-6c85499cc-zn5bc\" (UID: \"65f30ed1-2ae6-464b-8293-a36c663bde0a\") " pod="openshift-ingress/e2e-worker-w4-f1f016-openshift-default-6c85499cc-zn5bc"
Oct 30 20:00:54.229126 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:00:54.229072    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/65f30ed1-2ae6-464b-8293-a36c663bde0a-workload-socket\") pod \"e2e-worker-w4-f1f016-openshift-default-6c85499cc-zn5bc\" (UID: \"65f30ed1-2ae6-464b-8293-a36c663bde0a\") " pod="openshift-ingress/e2e-worker-w4-f1f016-openshift-default-6c85499cc-zn5bc"
Oct 30 20:00:54.229126 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:00:54.229114    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/65f30ed1-2ae6-464b-8293-a36c663bde0a-istio-podinfo\") pod \"e2e-worker-w4-f1f016-openshift-default-6c85499cc-zn5bc\" (UID: \"65f30ed1-2ae6-464b-8293-a36c663bde0a\") " pod="openshift-ingress/e2e-worker-w4-f1f016-openshift-default-6c85499cc-zn5bc"
Oct 30 20:00:54.229239 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:00:54.229175    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/65f30ed1-2ae6-464b-8293-a36c663bde0a-istio-envoy\") pod \"e2e-worker-w4-f1f016-openshift-default-6c85499cc-zn5bc\" (UID: \"65f30ed1-2ae6-464b-8293-a36c663bde0a\") " pod="openshift-ingress/e2e-worker-w4-f1f016-openshift-default-6c85499cc-zn5bc"
Oct 30 20:00:54.229296 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:00:54.229275    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/65f30ed1-2ae6-464b-8293-a36c663bde0a-credential-socket\") pod \"e2e-worker-w4-f1f016-openshift-default-6c85499cc-zn5bc\" (UID: \"65f30ed1-2ae6-464b-8293-a36c663bde0a\") " pod="openshift-ingress/e2e-worker-w4-f1f016-openshift-default-6c85499cc-zn5bc"
Oct 30 20:00:54.229349 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:00:54.229317    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/65f30ed1-2ae6-464b-8293-a36c663bde0a-workload-certs\") pod \"e2e-worker-w4-f1f016-openshift-default-6c85499cc-zn5bc\" (UID: \"65f30ed1-2ae6-464b-8293-a36c663bde0a\") " pod="openshift-ingress/e2e-worker-w4-f1f016-openshift-default-6c85499cc-zn5bc"
Oct 30 20:00:54.229424 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:00:54.229341    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/65f30ed1-2ae6-464b-8293-a36c663bde0a-istio-data\") pod \"e2e-worker-w4-f1f016-openshift-default-6c85499cc-zn5bc\" (UID: \"65f30ed1-2ae6-464b-8293-a36c663bde0a\") " pod="openshift-ingress/e2e-worker-w4-f1f016-openshift-default-6c85499cc-zn5bc"
Oct 30 20:00:54.229424 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:00:54.229374    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/65f30ed1-2ae6-464b-8293-a36c663bde0a-istio-token\") pod \"e2e-worker-w4-f1f016-openshift-default-6c85499cc-zn5bc\" (UID: \"65f30ed1-2ae6-464b-8293-a36c663bde0a\") " pod="openshift-ingress/e2e-worker-w4-f1f016-openshift-default-6c85499cc-zn5bc"
Oct 30 20:00:54.229706 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:00:54.229680    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/65f30ed1-2ae6-464b-8293-a36c663bde0a-workload-socket\") pod \"e2e-worker-w4-f1f016-openshift-default-6c85499cc-zn5bc\" (UID: \"65f30ed1-2ae6-464b-8293-a36c663bde0a\") " pod="openshift-ingress/e2e-worker-w4-f1f016-openshift-default-6c85499cc-zn5bc"
Oct 30 20:00:54.229837 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:00:54.229758    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/65f30ed1-2ae6-464b-8293-a36c663bde0a-workload-certs\") pod \"e2e-worker-w4-f1f016-openshift-default-6c85499cc-zn5bc\" (UID: \"65f30ed1-2ae6-464b-8293-a36c663bde0a\") " pod="openshift-ingress/e2e-worker-w4-f1f016-openshift-default-6c85499cc-zn5bc"
Oct 30 20:00:54.229911 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:00:54.229878    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/65f30ed1-2ae6-464b-8293-a36c663bde0a-istiod-ca-cert\") pod \"e2e-worker-w4-f1f016-openshift-default-6c85499cc-zn5bc\" (UID: \"65f30ed1-2ae6-464b-8293-a36c663bde0a\") " pod="openshift-ingress/e2e-worker-w4-f1f016-openshift-default-6c85499cc-zn5bc"
Oct 30 20:00:54.231901 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:00:54.231877    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/65f30ed1-2ae6-464b-8293-a36c663bde0a-istio-podinfo\") pod \"e2e-worker-w4-f1f016-openshift-default-6c85499cc-zn5bc\" (UID: \"65f30ed1-2ae6-464b-8293-a36c663bde0a\") " pod="openshift-ingress/e2e-worker-w4-f1f016-openshift-default-6c85499cc-zn5bc"
Oct 30 20:00:54.232237 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:00:54.232214    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/65f30ed1-2ae6-464b-8293-a36c663bde0a-istio-envoy\") pod \"e2e-worker-w4-f1f016-openshift-default-6c85499cc-zn5bc\" (UID: \"65f30ed1-2ae6-464b-8293-a36c663bde0a\") " pod="openshift-ingress/e2e-worker-w4-f1f016-openshift-default-6c85499cc-zn5bc"
Oct 30 20:00:54.255003 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:00:54.254979    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/65f30ed1-2ae6-464b-8293-a36c663bde0a-istio-token\") pod \"e2e-worker-w4-f1f016-openshift-default-6c85499cc-zn5bc\" (UID: \"65f30ed1-2ae6-464b-8293-a36c663bde0a\") " pod="openshift-ingress/e2e-worker-w4-f1f016-openshift-default-6c85499cc-zn5bc"
Oct 30 20:00:54.256899 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:00:54.256876    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-glkk7\" (UniqueName: \"kubernetes.io/projected/65f30ed1-2ae6-464b-8293-a36c663bde0a-kube-api-access-glkk7\") pod \"e2e-worker-w4-f1f016-openshift-default-6c85499cc-zn5bc\" (UID: \"65f30ed1-2ae6-464b-8293-a36c663bde0a\") " pod="openshift-ingress/e2e-worker-w4-f1f016-openshift-default-6c85499cc-zn5bc"
Oct 30 20:00:54.359467 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:00:54.359391    6275 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-f1f016-openshift-default-6c85499cc-zn5bc"
Oct 30 20:00:54.684344 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:00:54.684318    6275 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-f1f016-openshift-default-6c85499cc-zn5bc"]
Oct 30 20:00:54.685738 ip-10-0-131-26 kubenswrapper[6275]: W1030 20:00:54.685713    6275 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod65f30ed1_2ae6_464b_8293_a36c663bde0a.slice/crio-3118770f8b2f99adc634465a69d92e1b3915e8c2f8d08a80e5e3e4cca95e2028 WatchSource:0}: Error finding container 3118770f8b2f99adc634465a69d92e1b3915e8c2f8d08a80e5e3e4cca95e2028: Status 404 returned error can't find the container with id 3118770f8b2f99adc634465a69d92e1b3915e8c2f8d08a80e5e3e4cca95e2028
Oct 30 20:00:54.688608 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:00:54.688569    6275 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Oct 30 20:00:54.688697 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:00:54.688654    6275 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Oct 30 20:00:54.688733 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:00:54.688698    6275 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Oct 30 20:00:55.294002 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:00:55.293962    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-f1f016-openshift-default-6c85499cc-zn5bc" event={"ID":"65f30ed1-2ae6-464b-8293-a36c663bde0a","Type":"ContainerStarted","Data":"33ba9d1afb3fe52e66d1b620393f61c331fa066ec19c9913797541da6a58d8e0"}
Oct 30 20:00:55.294496 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:00:55.294017    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-f1f016-openshift-default-6c85499cc-zn5bc" event={"ID":"65f30ed1-2ae6-464b-8293-a36c663bde0a","Type":"ContainerStarted","Data":"3118770f8b2f99adc634465a69d92e1b3915e8c2f8d08a80e5e3e4cca95e2028"}
Oct 30 20:00:55.346108 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:00:55.346041    6275 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w4-f1f016-openshift-default-6c85499cc-zn5bc" podStartSLOduration=1.346021135 podStartE2EDuration="1.346021135s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:00:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:00:55.342681196 +0000 UTC m=+765.804408087" watchObservedRunningTime="2026-10-30 20:00:55.346021135 +0000 UTC m=+765.807747999"
Oct 30 20:00:55.359670 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:00:55.359637    6275 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w4-f1f016-openshift-default-6c85499cc-zn5bc"
Oct 30 20:00:55.361355 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:00:55.361327    6275 patch_prober.go:29] interesting pod/e2e-worker-w4-f1f016-openshift-default-6c85499cc-zn5bc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused" start-of-body=
Oct 30 20:00:55.361495 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:00:55.361379    6275 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-f1f016-openshift-default-6c85499cc-zn5bc" podUID="65f30ed1-2ae6-464b-8293-a36c663bde0a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused"
Oct 30 20:00:56.255732 ip-10-0-131-26 kubenswrapper[6275]: E1030 20:00:56.255697    6275 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-fwc77" containerName="extractor"
Oct 30 20:00:56.360810 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:00:56.360770    6275 patch_prober.go:29] interesting pod/e2e-worker-w4-f1f016-openshift-default-6c85499cc-zn5bc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused" start-of-body=
Oct 30 20:00:56.361245 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:00:56.360837    6275 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-f1f016-openshift-default-6c85499cc-zn5bc" podUID="65f30ed1-2ae6-464b-8293-a36c663bde0a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused"
Oct 30 20:00:57.360704 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:00:57.360670    6275 patch_prober.go:29] interesting pod/e2e-worker-w4-f1f016-openshift-default-6c85499cc-zn5bc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused" start-of-body=
Oct 30 20:00:57.360879 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:00:57.360719    6275 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-f1f016-openshift-default-6c85499cc-zn5bc" podUID="65f30ed1-2ae6-464b-8293-a36c663bde0a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused"
Oct 30 20:00:58.360040 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:00:58.360002    6275 patch_prober.go:29] interesting pod/e2e-worker-w4-f1f016-openshift-default-6c85499cc-zn5bc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused" start-of-body=
Oct 30 20:00:58.360235 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:00:58.360052    6275 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-f1f016-openshift-default-6c85499cc-zn5bc" podUID="65f30ed1-2ae6-464b-8293-a36c663bde0a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused"
Oct 30 20:00:59.360596 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:00:59.360564    6275 patch_prober.go:29] interesting pod/e2e-worker-w4-f1f016-openshift-default-6c85499cc-zn5bc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused" start-of-body=
Oct 30 20:00:59.360988 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:00:59.360618    6275 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-f1f016-openshift-default-6c85499cc-zn5bc" podUID="65f30ed1-2ae6-464b-8293-a36c663bde0a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused"
Oct 30 20:01:00.359937 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:01:00.359899    6275 patch_prober.go:29] interesting pod/e2e-worker-w4-f1f016-openshift-default-6c85499cc-zn5bc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused" start-of-body=
Oct 30 20:01:00.360141 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:01:00.359957    6275 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-f1f016-openshift-default-6c85499cc-zn5bc" podUID="65f30ed1-2ae6-464b-8293-a36c663bde0a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused"
Oct 30 20:01:01.364159 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:01:01.364128    6275 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w4-f1f016-openshift-default-6c85499cc-zn5bc"
Oct 30 20:01:01.364589 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:01:01.364442    6275 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w4-f1f016-openshift-default-6c85499cc-zn5bc"
Oct 30 20:01:01.365170 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:01:01.365153    6275 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w4-f1f016-openshift-default-6c85499cc-zn5bc"
Oct 30 20:01:07.841374 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:01:07.841342    6275 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w3-912f24/simulator-w3-912f24-kserve-59897cf48b-sd5wj"]
Oct 30 20:01:07.849670 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:01:07.849636    6275 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w3-912f24/simulator-w3-912f24-kserve-59897cf48b-sd5wj"
Oct 30 20:01:07.866544 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:01:07.866514    6275 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w3-912f24/simulator-w3-912f24-kserve-59897cf48b-sd5wj"]
Oct 30 20:01:07.877099 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:01:07.877059    6275 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w3-912f24\"/\"simulator-w3-912f24-kserve-self-signed-certs\""
Oct 30 20:01:07.877222 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:01:07.877139    6275 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w3-912f24\"/\"default-dockercfg-hw2ql\""
Oct 30 20:01:07.880257 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:01:07.880235    6275 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w3-912f24\"/\"kube-root-ca.crt\""
Oct 30 20:01:07.880521 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:01:07.880501    6275 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w3-912f24\"/\"openshift-service-ca.crt\""
Oct 30 20:01:07.889987 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:01:07.889966    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b4de6427-0db0-42d9-8b88-6b35d9d4c314-tls-certs\") pod \"simulator-w3-912f24-kserve-59897cf48b-sd5wj\" (UID: \"b4de6427-0db0-42d9-8b88-6b35d9d4c314\") " pod="e2e-models-e2e-worker-w3-912f24/simulator-w3-912f24-kserve-59897cf48b-sd5wj"
Oct 30 20:01:07.890080 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:01:07.890015    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b4de6427-0db0-42d9-8b88-6b35d9d4c314-dshm\") pod \"simulator-w3-912f24-kserve-59897cf48b-sd5wj\" (UID: \"b4de6427-0db0-42d9-8b88-6b35d9d4c314\") " pod="e2e-models-e2e-worker-w3-912f24/simulator-w3-912f24-kserve-59897cf48b-sd5wj"
Oct 30 20:01:07.890080 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:01:07.890041    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b4de6427-0db0-42d9-8b88-6b35d9d4c314-home\") pod \"simulator-w3-912f24-kserve-59897cf48b-sd5wj\" (UID: \"b4de6427-0db0-42d9-8b88-6b35d9d4c314\") " pod="e2e-models-e2e-worker-w3-912f24/simulator-w3-912f24-kserve-59897cf48b-sd5wj"
Oct 30 20:01:07.890200 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:01:07.890183    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b4de6427-0db0-42d9-8b88-6b35d9d4c314-tmp-dir\") pod \"simulator-w3-912f24-kserve-59897cf48b-sd5wj\" (UID: \"b4de6427-0db0-42d9-8b88-6b35d9d4c314\") " pod="e2e-models-e2e-worker-w3-912f24/simulator-w3-912f24-kserve-59897cf48b-sd5wj"
Oct 30 20:01:07.890243 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:01:07.890227    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nzz9p\" (UniqueName: \"kubernetes.io/projected/b4de6427-0db0-42d9-8b88-6b35d9d4c314-kube-api-access-nzz9p\") pod \"simulator-w3-912f24-kserve-59897cf48b-sd5wj\" (UID: \"b4de6427-0db0-42d9-8b88-6b35d9d4c314\") " pod="e2e-models-e2e-worker-w3-912f24/simulator-w3-912f24-kserve-59897cf48b-sd5wj"
Oct 30 20:01:07.890276 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:01:07.890246    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b4de6427-0db0-42d9-8b88-6b35d9d4c314-model-cache\") pod \"simulator-w3-912f24-kserve-59897cf48b-sd5wj\" (UID: \"b4de6427-0db0-42d9-8b88-6b35d9d4c314\") " pod="e2e-models-e2e-worker-w3-912f24/simulator-w3-912f24-kserve-59897cf48b-sd5wj"
Oct 30 20:01:07.990983 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:01:07.990945    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b4de6427-0db0-42d9-8b88-6b35d9d4c314-tls-certs\") pod \"simulator-w3-912f24-kserve-59897cf48b-sd5wj\" (UID: \"b4de6427-0db0-42d9-8b88-6b35d9d4c314\") " pod="e2e-models-e2e-worker-w3-912f24/simulator-w3-912f24-kserve-59897cf48b-sd5wj"
Oct 30 20:01:07.991254 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:01:07.991006    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b4de6427-0db0-42d9-8b88-6b35d9d4c314-dshm\") pod \"simulator-w3-912f24-kserve-59897cf48b-sd5wj\" (UID: \"b4de6427-0db0-42d9-8b88-6b35d9d4c314\") " pod="e2e-models-e2e-worker-w3-912f24/simulator-w3-912f24-kserve-59897cf48b-sd5wj"
Oct 30 20:01:07.991254 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:01:07.991036    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b4de6427-0db0-42d9-8b88-6b35d9d4c314-home\") pod \"simulator-w3-912f24-kserve-59897cf48b-sd5wj\" (UID: \"b4de6427-0db0-42d9-8b88-6b35d9d4c314\") " pod="e2e-models-e2e-worker-w3-912f24/simulator-w3-912f24-kserve-59897cf48b-sd5wj"
Oct 30 20:01:07.991254 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:01:07.991086    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b4de6427-0db0-42d9-8b88-6b35d9d4c314-tmp-dir\") pod \"simulator-w3-912f24-kserve-59897cf48b-sd5wj\" (UID: \"b4de6427-0db0-42d9-8b88-6b35d9d4c314\") " pod="e2e-models-e2e-worker-w3-912f24/simulator-w3-912f24-kserve-59897cf48b-sd5wj"
Oct 30 20:01:07.991254 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:01:07.991136    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nzz9p\" (UniqueName: \"kubernetes.io/projected/b4de6427-0db0-42d9-8b88-6b35d9d4c314-kube-api-access-nzz9p\") pod \"simulator-w3-912f24-kserve-59897cf48b-sd5wj\" (UID: \"b4de6427-0db0-42d9-8b88-6b35d9d4c314\") " pod="e2e-models-e2e-worker-w3-912f24/simulator-w3-912f24-kserve-59897cf48b-sd5wj"
Oct 30 20:01:07.991254 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:01:07.991154    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b4de6427-0db0-42d9-8b88-6b35d9d4c314-model-cache\") pod \"simulator-w3-912f24-kserve-59897cf48b-sd5wj\" (UID: \"b4de6427-0db0-42d9-8b88-6b35d9d4c314\") " pod="e2e-models-e2e-worker-w3-912f24/simulator-w3-912f24-kserve-59897cf48b-sd5wj"
Oct 30 20:01:07.991534 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:01:07.991456    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b4de6427-0db0-42d9-8b88-6b35d9d4c314-home\") pod \"simulator-w3-912f24-kserve-59897cf48b-sd5wj\" (UID: \"b4de6427-0db0-42d9-8b88-6b35d9d4c314\") " pod="e2e-models-e2e-worker-w3-912f24/simulator-w3-912f24-kserve-59897cf48b-sd5wj"
Oct 30 20:01:07.991579 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:01:07.991537    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b4de6427-0db0-42d9-8b88-6b35d9d4c314-model-cache\") pod \"simulator-w3-912f24-kserve-59897cf48b-sd5wj\" (UID: \"b4de6427-0db0-42d9-8b88-6b35d9d4c314\") " pod="e2e-models-e2e-worker-w3-912f24/simulator-w3-912f24-kserve-59897cf48b-sd5wj"
Oct 30 20:01:07.991711 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:01:07.991687    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b4de6427-0db0-42d9-8b88-6b35d9d4c314-tmp-dir\") pod \"simulator-w3-912f24-kserve-59897cf48b-sd5wj\" (UID: \"b4de6427-0db0-42d9-8b88-6b35d9d4c314\") " pod="e2e-models-e2e-worker-w3-912f24/simulator-w3-912f24-kserve-59897cf48b-sd5wj"
Oct 30 20:01:07.993394 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:01:07.993366    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b4de6427-0db0-42d9-8b88-6b35d9d4c314-dshm\") pod \"simulator-w3-912f24-kserve-59897cf48b-sd5wj\" (UID: \"b4de6427-0db0-42d9-8b88-6b35d9d4c314\") " pod="e2e-models-e2e-worker-w3-912f24/simulator-w3-912f24-kserve-59897cf48b-sd5wj"
Oct 30 20:01:07.994160 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:01:07.994139    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b4de6427-0db0-42d9-8b88-6b35d9d4c314-tls-certs\") pod \"simulator-w3-912f24-kserve-59897cf48b-sd5wj\" (UID: \"b4de6427-0db0-42d9-8b88-6b35d9d4c314\") " pod="e2e-models-e2e-worker-w3-912f24/simulator-w3-912f24-kserve-59897cf48b-sd5wj"
Oct 30 20:01:08.019960 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:01:08.019935    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nzz9p\" (UniqueName: \"kubernetes.io/projected/b4de6427-0db0-42d9-8b88-6b35d9d4c314-kube-api-access-nzz9p\") pod \"simulator-w3-912f24-kserve-59897cf48b-sd5wj\" (UID: \"b4de6427-0db0-42d9-8b88-6b35d9d4c314\") " pod="e2e-models-e2e-worker-w3-912f24/simulator-w3-912f24-kserve-59897cf48b-sd5wj"
Oct 30 20:01:08.162981 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:01:08.162890    6275 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w3-912f24/simulator-w3-912f24-kserve-59897cf48b-sd5wj"
Oct 30 20:01:08.470616 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:01:08.470584    6275 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w3-912f24/simulator-w3-912f24-kserve-59897cf48b-sd5wj"]
Oct 30 20:01:08.471437 ip-10-0-131-26 kubenswrapper[6275]: W1030 20:01:08.471388    6275 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb4de6427_0db0_42d9_8b88_6b35d9d4c314.slice/crio-63dce0e2fafe0b1b057fe9201175d93218f62270b4ff038b596464f729101a36 WatchSource:0}: Error finding container 63dce0e2fafe0b1b057fe9201175d93218f62270b4ff038b596464f729101a36: Status 404 returned error can't find the container with id 63dce0e2fafe0b1b057fe9201175d93218f62270b4ff038b596464f729101a36
Oct 30 20:01:09.391622 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:01:09.391583    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w3-912f24/simulator-w3-912f24-kserve-59897cf48b-sd5wj" event={"ID":"b4de6427-0db0-42d9-8b88-6b35d9d4c314","Type":"ContainerStarted","Data":"63dce0e2fafe0b1b057fe9201175d93218f62270b4ff038b596464f729101a36"}
Oct 30 20:01:10.398934 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:01:10.398886    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w3-912f24/simulator-w3-912f24-kserve-59897cf48b-sd5wj" event={"ID":"b4de6427-0db0-42d9-8b88-6b35d9d4c314","Type":"ContainerStarted","Data":"ad970cd29845aa6154cbce8c2eff7b3e688e5061bd2d1e716dbc921d42d3caa2"}
Oct 30 20:01:10.445710 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:01:10.445661    6275 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w3-912f24/simulator-w3-912f24-kserve-59897cf48b-sd5wj" podStartSLOduration=2.226584952 podStartE2EDuration="3.445648441s" totalImagesPullingTime="1.219063489s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:01:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:01:10.444594295 +0000 UTC m=+780.906321161" watchObservedRunningTime="2026-10-30 20:01:10.445648441 +0000 UTC m=+780.907375303"
Oct 30 20:01:11.163821 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:01:11.163787    6275 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w3-912f24/simulator-w3-912f24-kserve-59897cf48b-sd5wj"
Oct 30 20:01:18.163850 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:01:18.163813    6275 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w3-912f24/simulator-w3-912f24-kserve-59897cf48b-sd5wj"
Oct 30 20:01:18.178476 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:01:18.178447    6275 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w3-912f24/simulator-w3-912f24-kserve-59897cf48b-sd5wj"
Oct 30 20:01:18.361011 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:01:18.360979    6275 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w4-f1f016/simulator-w4-f1f016-kserve-55db8447ff-749tw"]
Oct 30 20:01:18.367231 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:01:18.367208    6275 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-f1f016/simulator-w4-f1f016-kserve-55db8447ff-749tw"
Oct 30 20:01:18.389926 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:01:18.389903    6275 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w4-f1f016\"/\"openshift-service-ca.crt\""
Oct 30 20:01:18.390051 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:01:18.389939    6275 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w4-f1f016\"/\"kube-root-ca.crt\""
Oct 30 20:01:18.390051 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:01:18.390013    6275 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w4-f1f016\"/\"default-dockercfg-fhlm6\""
Oct 30 20:01:18.390170 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:01:18.390119    6275 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w4-f1f016\"/\"simulator-w4-f1f016-kserve-self-signed-certs\""
Oct 30 20:01:18.400707 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:01:18.400684    6275 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-f1f016/simulator-w4-f1f016-kserve-55db8447ff-749tw"]
Oct 30 20:01:18.456533 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:01:18.456456    6275 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w3-912f24/simulator-w3-912f24-kserve-59897cf48b-sd5wj"
Oct 30 20:01:18.489813 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:01:18.489782    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8f3174b6-2fdc-48c2-99be-7a966731f018-tmp-dir\") pod \"simulator-w4-f1f016-kserve-55db8447ff-749tw\" (UID: \"8f3174b6-2fdc-48c2-99be-7a966731f018\") " pod="e2e-models-e2e-worker-w4-f1f016/simulator-w4-f1f016-kserve-55db8447ff-749tw"
Oct 30 20:01:18.489963 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:01:18.489929    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7g2x8\" (UniqueName: \"kubernetes.io/projected/8f3174b6-2fdc-48c2-99be-7a966731f018-kube-api-access-7g2x8\") pod \"simulator-w4-f1f016-kserve-55db8447ff-749tw\" (UID: \"8f3174b6-2fdc-48c2-99be-7a966731f018\") " pod="e2e-models-e2e-worker-w4-f1f016/simulator-w4-f1f016-kserve-55db8447ff-749tw"
Oct 30 20:01:18.490029 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:01:18.489975    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8f3174b6-2fdc-48c2-99be-7a966731f018-tls-certs\") pod \"simulator-w4-f1f016-kserve-55db8447ff-749tw\" (UID: \"8f3174b6-2fdc-48c2-99be-7a966731f018\") " pod="e2e-models-e2e-worker-w4-f1f016/simulator-w4-f1f016-kserve-55db8447ff-749tw"
Oct 30 20:01:18.490134 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:01:18.490112    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8f3174b6-2fdc-48c2-99be-7a966731f018-model-cache\") pod \"simulator-w4-f1f016-kserve-55db8447ff-749tw\" (UID: \"8f3174b6-2fdc-48c2-99be-7a966731f018\") " pod="e2e-models-e2e-worker-w4-f1f016/simulator-w4-f1f016-kserve-55db8447ff-749tw"
Oct 30 20:01:18.490195 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:01:18.490158    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8f3174b6-2fdc-48c2-99be-7a966731f018-dshm\") pod \"simulator-w4-f1f016-kserve-55db8447ff-749tw\" (UID: \"8f3174b6-2fdc-48c2-99be-7a966731f018\") " pod="e2e-models-e2e-worker-w4-f1f016/simulator-w4-f1f016-kserve-55db8447ff-749tw"
Oct 30 20:01:18.490287 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:01:18.490265    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8f3174b6-2fdc-48c2-99be-7a966731f018-home\") pod \"simulator-w4-f1f016-kserve-55db8447ff-749tw\" (UID: \"8f3174b6-2fdc-48c2-99be-7a966731f018\") " pod="e2e-models-e2e-worker-w4-f1f016/simulator-w4-f1f016-kserve-55db8447ff-749tw"
Oct 30 20:01:18.591118 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:01:18.591083    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8f3174b6-2fdc-48c2-99be-7a966731f018-dshm\") pod \"simulator-w4-f1f016-kserve-55db8447ff-749tw\" (UID: \"8f3174b6-2fdc-48c2-99be-7a966731f018\") " pod="e2e-models-e2e-worker-w4-f1f016/simulator-w4-f1f016-kserve-55db8447ff-749tw"
Oct 30 20:01:18.591305 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:01:18.591148    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8f3174b6-2fdc-48c2-99be-7a966731f018-home\") pod \"simulator-w4-f1f016-kserve-55db8447ff-749tw\" (UID: \"8f3174b6-2fdc-48c2-99be-7a966731f018\") " pod="e2e-models-e2e-worker-w4-f1f016/simulator-w4-f1f016-kserve-55db8447ff-749tw"
Oct 30 20:01:18.591305 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:01:18.591188    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8f3174b6-2fdc-48c2-99be-7a966731f018-tmp-dir\") pod \"simulator-w4-f1f016-kserve-55db8447ff-749tw\" (UID: \"8f3174b6-2fdc-48c2-99be-7a966731f018\") " pod="e2e-models-e2e-worker-w4-f1f016/simulator-w4-f1f016-kserve-55db8447ff-749tw"
Oct 30 20:01:18.591305 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:01:18.591253    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7g2x8\" (UniqueName: \"kubernetes.io/projected/8f3174b6-2fdc-48c2-99be-7a966731f018-kube-api-access-7g2x8\") pod \"simulator-w4-f1f016-kserve-55db8447ff-749tw\" (UID: \"8f3174b6-2fdc-48c2-99be-7a966731f018\") " pod="e2e-models-e2e-worker-w4-f1f016/simulator-w4-f1f016-kserve-55db8447ff-749tw"
Oct 30 20:01:18.591305 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:01:18.591289    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8f3174b6-2fdc-48c2-99be-7a966731f018-tls-certs\") pod \"simulator-w4-f1f016-kserve-55db8447ff-749tw\" (UID: \"8f3174b6-2fdc-48c2-99be-7a966731f018\") " pod="e2e-models-e2e-worker-w4-f1f016/simulator-w4-f1f016-kserve-55db8447ff-749tw"
Oct 30 20:01:18.591545 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:01:18.591346    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8f3174b6-2fdc-48c2-99be-7a966731f018-model-cache\") pod \"simulator-w4-f1f016-kserve-55db8447ff-749tw\" (UID: \"8f3174b6-2fdc-48c2-99be-7a966731f018\") " pod="e2e-models-e2e-worker-w4-f1f016/simulator-w4-f1f016-kserve-55db8447ff-749tw"
Oct 30 20:01:18.591644 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:01:18.591623    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8f3174b6-2fdc-48c2-99be-7a966731f018-home\") pod \"simulator-w4-f1f016-kserve-55db8447ff-749tw\" (UID: \"8f3174b6-2fdc-48c2-99be-7a966731f018\") " pod="e2e-models-e2e-worker-w4-f1f016/simulator-w4-f1f016-kserve-55db8447ff-749tw"
Oct 30 20:01:18.591704 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:01:18.591688    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8f3174b6-2fdc-48c2-99be-7a966731f018-tmp-dir\") pod \"simulator-w4-f1f016-kserve-55db8447ff-749tw\" (UID: \"8f3174b6-2fdc-48c2-99be-7a966731f018\") " pod="e2e-models-e2e-worker-w4-f1f016/simulator-w4-f1f016-kserve-55db8447ff-749tw"
Oct 30 20:01:18.591879 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:01:18.591858    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8f3174b6-2fdc-48c2-99be-7a966731f018-model-cache\") pod \"simulator-w4-f1f016-kserve-55db8447ff-749tw\" (UID: \"8f3174b6-2fdc-48c2-99be-7a966731f018\") " pod="e2e-models-e2e-worker-w4-f1f016/simulator-w4-f1f016-kserve-55db8447ff-749tw"
Oct 30 20:01:18.593369 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:01:18.593344    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8f3174b6-2fdc-48c2-99be-7a966731f018-dshm\") pod \"simulator-w4-f1f016-kserve-55db8447ff-749tw\" (UID: \"8f3174b6-2fdc-48c2-99be-7a966731f018\") " pod="e2e-models-e2e-worker-w4-f1f016/simulator-w4-f1f016-kserve-55db8447ff-749tw"
Oct 30 20:01:18.593733 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:01:18.593711    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8f3174b6-2fdc-48c2-99be-7a966731f018-tls-certs\") pod \"simulator-w4-f1f016-kserve-55db8447ff-749tw\" (UID: \"8f3174b6-2fdc-48c2-99be-7a966731f018\") " pod="e2e-models-e2e-worker-w4-f1f016/simulator-w4-f1f016-kserve-55db8447ff-749tw"
Oct 30 20:01:18.619044 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:01:18.619011    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7g2x8\" (UniqueName: \"kubernetes.io/projected/8f3174b6-2fdc-48c2-99be-7a966731f018-kube-api-access-7g2x8\") pod \"simulator-w4-f1f016-kserve-55db8447ff-749tw\" (UID: \"8f3174b6-2fdc-48c2-99be-7a966731f018\") " pod="e2e-models-e2e-worker-w4-f1f016/simulator-w4-f1f016-kserve-55db8447ff-749tw"
Oct 30 20:01:18.680479 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:01:18.680440    6275 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-f1f016/simulator-w4-f1f016-kserve-55db8447ff-749tw"
Oct 30 20:01:18.986358 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:01:18.986334    6275 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-f1f016/simulator-w4-f1f016-kserve-55db8447ff-749tw"]
Oct 30 20:01:18.988162 ip-10-0-131-26 kubenswrapper[6275]: W1030 20:01:18.988130    6275 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8f3174b6_2fdc_48c2_99be_7a966731f018.slice/crio-c5c1e4726b75eda5f9006cf02a8db3cf2e5e5aeb30f799ca595b6a05e0dbdabb WatchSource:0}: Error finding container c5c1e4726b75eda5f9006cf02a8db3cf2e5e5aeb30f799ca595b6a05e0dbdabb: Status 404 returned error can't find the container with id c5c1e4726b75eda5f9006cf02a8db3cf2e5e5aeb30f799ca595b6a05e0dbdabb
Oct 30 20:01:19.452636 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:01:19.452538    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-f1f016/simulator-w4-f1f016-kserve-55db8447ff-749tw" event={"ID":"8f3174b6-2fdc-48c2-99be-7a966731f018","Type":"ContainerStarted","Data":"3c2cf123f97b0e961608d423227ed48d17216fe829d88bf5d93109e4c127f48f"}
Oct 30 20:01:19.452636 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:01:19.452578    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-f1f016/simulator-w4-f1f016-kserve-55db8447ff-749tw" event={"ID":"8f3174b6-2fdc-48c2-99be-7a966731f018","Type":"ContainerStarted","Data":"c5c1e4726b75eda5f9006cf02a8db3cf2e5e5aeb30f799ca595b6a05e0dbdabb"}
Oct 30 20:01:19.500469 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:01:19.500382    6275 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w4-f1f016/simulator-w4-f1f016-kserve-55db8447ff-749tw" podStartSLOduration=1.500364101 podStartE2EDuration="1.500364101s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:01:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:01:19.497900356 +0000 UTC m=+789.959627220" watchObservedRunningTime="2026-10-30 20:01:19.500364101 +0000 UTC m=+789.962090966"
Oct 30 20:01:19.681203 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:01:19.681170    6275 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w4-f1f016/simulator-w4-f1f016-kserve-55db8447ff-749tw"
Oct 30 20:01:26.256528 ip-10-0-131-26 kubenswrapper[6275]: E1030 20:01:26.256488    6275 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-fwc77" containerName="extractor"
Oct 30 20:01:28.488604 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:01:28.488570    6275 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w6-51dd62/simulator-w6-51dd62-kserve-d6bb4985f-65j9h"]
Oct 30 20:01:28.492556 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:01:28.492529    6275 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w6-51dd62/simulator-w6-51dd62-kserve-d6bb4985f-65j9h"
Oct 30 20:01:28.513519 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:01:28.513493    6275 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w6-51dd62/simulator-w6-51dd62-kserve-d6bb4985f-65j9h"]
Oct 30 20:01:28.524010 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:01:28.523980    6275 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w6-51dd62\"/\"simulator-w6-51dd62-kserve-self-signed-certs\""
Oct 30 20:01:28.524010 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:01:28.523991    6275 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w6-51dd62\"/\"default-dockercfg-wnz6m\""
Oct 30 20:01:28.524770 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:01:28.524749    6275 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w6-51dd62\"/\"openshift-service-ca.crt\""
Oct 30 20:01:28.524875 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:01:28.524811    6275 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w6-51dd62\"/\"kube-root-ca.crt\""
Oct 30 20:01:28.593692 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:01:28.593650    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f7e1ff07-15d6-49b5-8edc-52c9d6825ed7-tls-certs\") pod \"simulator-w6-51dd62-kserve-d6bb4985f-65j9h\" (UID: \"f7e1ff07-15d6-49b5-8edc-52c9d6825ed7\") " pod="e2e-models-e2e-worker-w6-51dd62/simulator-w6-51dd62-kserve-d6bb4985f-65j9h"
Oct 30 20:01:28.593859 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:01:28.593713    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f7e1ff07-15d6-49b5-8edc-52c9d6825ed7-home\") pod \"simulator-w6-51dd62-kserve-d6bb4985f-65j9h\" (UID: \"f7e1ff07-15d6-49b5-8edc-52c9d6825ed7\") " pod="e2e-models-e2e-worker-w6-51dd62/simulator-w6-51dd62-kserve-d6bb4985f-65j9h"
Oct 30 20:01:28.593859 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:01:28.593782    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f7e1ff07-15d6-49b5-8edc-52c9d6825ed7-tmp-dir\") pod \"simulator-w6-51dd62-kserve-d6bb4985f-65j9h\" (UID: \"f7e1ff07-15d6-49b5-8edc-52c9d6825ed7\") " pod="e2e-models-e2e-worker-w6-51dd62/simulator-w6-51dd62-kserve-d6bb4985f-65j9h"
Oct 30 20:01:28.593859 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:01:28.593823    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f7e1ff07-15d6-49b5-8edc-52c9d6825ed7-dshm\") pod \"simulator-w6-51dd62-kserve-d6bb4985f-65j9h\" (UID: \"f7e1ff07-15d6-49b5-8edc-52c9d6825ed7\") " pod="e2e-models-e2e-worker-w6-51dd62/simulator-w6-51dd62-kserve-d6bb4985f-65j9h"
Oct 30 20:01:28.593960 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:01:28.593934    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5sbb4\" (UniqueName: \"kubernetes.io/projected/f7e1ff07-15d6-49b5-8edc-52c9d6825ed7-kube-api-access-5sbb4\") pod \"simulator-w6-51dd62-kserve-d6bb4985f-65j9h\" (UID: \"f7e1ff07-15d6-49b5-8edc-52c9d6825ed7\") " pod="e2e-models-e2e-worker-w6-51dd62/simulator-w6-51dd62-kserve-d6bb4985f-65j9h"
Oct 30 20:01:28.594067 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:01:28.594051    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f7e1ff07-15d6-49b5-8edc-52c9d6825ed7-model-cache\") pod \"simulator-w6-51dd62-kserve-d6bb4985f-65j9h\" (UID: \"f7e1ff07-15d6-49b5-8edc-52c9d6825ed7\") " pod="e2e-models-e2e-worker-w6-51dd62/simulator-w6-51dd62-kserve-d6bb4985f-65j9h"
Oct 30 20:01:28.681186 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:01:28.681152    6275 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w4-f1f016/simulator-w4-f1f016-kserve-55db8447ff-749tw"
Oct 30 20:01:28.695076 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:01:28.695049    6275 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w4-f1f016/simulator-w4-f1f016-kserve-55db8447ff-749tw"
Oct 30 20:01:28.695255 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:01:28.695132    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5sbb4\" (UniqueName: \"kubernetes.io/projected/f7e1ff07-15d6-49b5-8edc-52c9d6825ed7-kube-api-access-5sbb4\") pod \"simulator-w6-51dd62-kserve-d6bb4985f-65j9h\" (UID: \"f7e1ff07-15d6-49b5-8edc-52c9d6825ed7\") " pod="e2e-models-e2e-worker-w6-51dd62/simulator-w6-51dd62-kserve-d6bb4985f-65j9h"
Oct 30 20:01:28.695255 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:01:28.695236    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f7e1ff07-15d6-49b5-8edc-52c9d6825ed7-model-cache\") pod \"simulator-w6-51dd62-kserve-d6bb4985f-65j9h\" (UID: \"f7e1ff07-15d6-49b5-8edc-52c9d6825ed7\") " pod="e2e-models-e2e-worker-w6-51dd62/simulator-w6-51dd62-kserve-d6bb4985f-65j9h"
Oct 30 20:01:28.695380 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:01:28.695275    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f7e1ff07-15d6-49b5-8edc-52c9d6825ed7-tls-certs\") pod \"simulator-w6-51dd62-kserve-d6bb4985f-65j9h\" (UID: \"f7e1ff07-15d6-49b5-8edc-52c9d6825ed7\") " pod="e2e-models-e2e-worker-w6-51dd62/simulator-w6-51dd62-kserve-d6bb4985f-65j9h"
Oct 30 20:01:28.695380 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:01:28.695327    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f7e1ff07-15d6-49b5-8edc-52c9d6825ed7-home\") pod \"simulator-w6-51dd62-kserve-d6bb4985f-65j9h\" (UID: \"f7e1ff07-15d6-49b5-8edc-52c9d6825ed7\") " pod="e2e-models-e2e-worker-w6-51dd62/simulator-w6-51dd62-kserve-d6bb4985f-65j9h"
Oct 30 20:01:28.695380 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:01:28.695363    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f7e1ff07-15d6-49b5-8edc-52c9d6825ed7-tmp-dir\") pod \"simulator-w6-51dd62-kserve-d6bb4985f-65j9h\" (UID: \"f7e1ff07-15d6-49b5-8edc-52c9d6825ed7\") " pod="e2e-models-e2e-worker-w6-51dd62/simulator-w6-51dd62-kserve-d6bb4985f-65j9h"
Oct 30 20:01:28.695558 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:01:28.695427    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f7e1ff07-15d6-49b5-8edc-52c9d6825ed7-dshm\") pod \"simulator-w6-51dd62-kserve-d6bb4985f-65j9h\" (UID: \"f7e1ff07-15d6-49b5-8edc-52c9d6825ed7\") " pod="e2e-models-e2e-worker-w6-51dd62/simulator-w6-51dd62-kserve-d6bb4985f-65j9h"
Oct 30 20:01:28.695714 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:01:28.695688    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f7e1ff07-15d6-49b5-8edc-52c9d6825ed7-model-cache\") pod \"simulator-w6-51dd62-kserve-d6bb4985f-65j9h\" (UID: \"f7e1ff07-15d6-49b5-8edc-52c9d6825ed7\") " pod="e2e-models-e2e-worker-w6-51dd62/simulator-w6-51dd62-kserve-d6bb4985f-65j9h"
Oct 30 20:01:28.695862 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:01:28.695757    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f7e1ff07-15d6-49b5-8edc-52c9d6825ed7-home\") pod \"simulator-w6-51dd62-kserve-d6bb4985f-65j9h\" (UID: \"f7e1ff07-15d6-49b5-8edc-52c9d6825ed7\") " pod="e2e-models-e2e-worker-w6-51dd62/simulator-w6-51dd62-kserve-d6bb4985f-65j9h"
Oct 30 20:01:28.696087 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:01:28.696067    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f7e1ff07-15d6-49b5-8edc-52c9d6825ed7-tmp-dir\") pod \"simulator-w6-51dd62-kserve-d6bb4985f-65j9h\" (UID: \"f7e1ff07-15d6-49b5-8edc-52c9d6825ed7\") " pod="e2e-models-e2e-worker-w6-51dd62/simulator-w6-51dd62-kserve-d6bb4985f-65j9h"
Oct 30 20:01:28.697772 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:01:28.697749    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f7e1ff07-15d6-49b5-8edc-52c9d6825ed7-dshm\") pod \"simulator-w6-51dd62-kserve-d6bb4985f-65j9h\" (UID: \"f7e1ff07-15d6-49b5-8edc-52c9d6825ed7\") " pod="e2e-models-e2e-worker-w6-51dd62/simulator-w6-51dd62-kserve-d6bb4985f-65j9h"
Oct 30 20:01:28.700999 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:01:28.700974    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f7e1ff07-15d6-49b5-8edc-52c9d6825ed7-tls-certs\") pod \"simulator-w6-51dd62-kserve-d6bb4985f-65j9h\" (UID: \"f7e1ff07-15d6-49b5-8edc-52c9d6825ed7\") " pod="e2e-models-e2e-worker-w6-51dd62/simulator-w6-51dd62-kserve-d6bb4985f-65j9h"
Oct 30 20:01:28.726551 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:01:28.726527    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5sbb4\" (UniqueName: \"kubernetes.io/projected/f7e1ff07-15d6-49b5-8edc-52c9d6825ed7-kube-api-access-5sbb4\") pod \"simulator-w6-51dd62-kserve-d6bb4985f-65j9h\" (UID: \"f7e1ff07-15d6-49b5-8edc-52c9d6825ed7\") " pod="e2e-models-e2e-worker-w6-51dd62/simulator-w6-51dd62-kserve-d6bb4985f-65j9h"
Oct 30 20:01:28.805811 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:01:28.805725    6275 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w6-51dd62/simulator-w6-51dd62-kserve-d6bb4985f-65j9h"
Oct 30 20:01:29.112139 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:01:29.112069    6275 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w6-51dd62/simulator-w6-51dd62-kserve-d6bb4985f-65j9h"]
Oct 30 20:01:29.117429 ip-10-0-131-26 kubenswrapper[6275]: W1030 20:01:29.117386    6275 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf7e1ff07_15d6_49b5_8edc_52c9d6825ed7.slice/crio-f3a02212067bec433b1e33b835256714670fd18b59b3cf43e766238e0ffe8cd5 WatchSource:0}: Error finding container f3a02212067bec433b1e33b835256714670fd18b59b3cf43e766238e0ffe8cd5: Status 404 returned error can't find the container with id f3a02212067bec433b1e33b835256714670fd18b59b3cf43e766238e0ffe8cd5
Oct 30 20:01:29.515578 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:01:29.515543    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w6-51dd62/simulator-w6-51dd62-kserve-d6bb4985f-65j9h" event={"ID":"f7e1ff07-15d6-49b5-8edc-52c9d6825ed7","Type":"ContainerStarted","Data":"c5d8ba8404b5f50c087a98387f19229313ad69d2ff0c0963d2c1474718866d55"}
Oct 30 20:01:29.515966 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:01:29.515590    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w6-51dd62/simulator-w6-51dd62-kserve-d6bb4985f-65j9h" event={"ID":"f7e1ff07-15d6-49b5-8edc-52c9d6825ed7","Type":"ContainerStarted","Data":"f3a02212067bec433b1e33b835256714670fd18b59b3cf43e766238e0ffe8cd5"}
Oct 30 20:01:29.527064 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:01:29.527032    6275 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w4-f1f016/simulator-w4-f1f016-kserve-55db8447ff-749tw"
Oct 30 20:01:29.564105 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:01:29.564046    6275 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w6-51dd62/simulator-w6-51dd62-kserve-d6bb4985f-65j9h" podStartSLOduration=1.564031563 podStartE2EDuration="1.564031563s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:01:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:01:29.561936459 +0000 UTC m=+800.023663324" watchObservedRunningTime="2026-10-30 20:01:29.564031563 +0000 UTC m=+800.025758425"
Oct 30 20:01:29.806467 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:01:29.806360    6275 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w6-51dd62/simulator-w6-51dd62-kserve-d6bb4985f-65j9h"
Oct 30 20:01:34.356220 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:01:34.356186    6275 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w5-626870/premium-w5-626870-kserve-5df7f7b5c4-vx59r"]
Oct 30 20:01:34.360514 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:01:34.360486    6275 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w5-626870/premium-w5-626870-kserve-5df7f7b5c4-vx59r"
Oct 30 20:01:34.396186 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:01:34.396158    6275 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w5-626870\"/\"kube-root-ca.crt\""
Oct 30 20:01:34.396341 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:01:34.396199    6275 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w5-626870\"/\"openshift-service-ca.crt\""
Oct 30 20:01:34.396341 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:01:34.396304    6275 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w5-626870\"/\"default-dockercfg-b6x4h\""
Oct 30 20:01:34.396461 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:01:34.396353    6275 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w5-626870\"/\"premium-w5-626870-kserve-self-signed-certs\""
Oct 30 20:01:34.404634 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:01:34.404611    6275 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w5-626870/premium-w5-626870-kserve-5df7f7b5c4-vx59r"]
Oct 30 20:01:34.451893 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:01:34.451864    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a1adddd4-3218-4a6b-a145-0290bceff76f-dshm\") pod \"premium-w5-626870-kserve-5df7f7b5c4-vx59r\" (UID: \"a1adddd4-3218-4a6b-a145-0290bceff76f\") " pod="e2e-models-e2e-worker-w5-626870/premium-w5-626870-kserve-5df7f7b5c4-vx59r"
Oct 30 20:01:34.452075 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:01:34.451913    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-whwsx\" (UniqueName: \"kubernetes.io/projected/a1adddd4-3218-4a6b-a145-0290bceff76f-kube-api-access-whwsx\") pod \"premium-w5-626870-kserve-5df7f7b5c4-vx59r\" (UID: \"a1adddd4-3218-4a6b-a145-0290bceff76f\") " pod="e2e-models-e2e-worker-w5-626870/premium-w5-626870-kserve-5df7f7b5c4-vx59r"
Oct 30 20:01:34.452075 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:01:34.451940    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a1adddd4-3218-4a6b-a145-0290bceff76f-model-cache\") pod \"premium-w5-626870-kserve-5df7f7b5c4-vx59r\" (UID: \"a1adddd4-3218-4a6b-a145-0290bceff76f\") " pod="e2e-models-e2e-worker-w5-626870/premium-w5-626870-kserve-5df7f7b5c4-vx59r"
Oct 30 20:01:34.452187 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:01:34.452105    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a1adddd4-3218-4a6b-a145-0290bceff76f-home\") pod \"premium-w5-626870-kserve-5df7f7b5c4-vx59r\" (UID: \"a1adddd4-3218-4a6b-a145-0290bceff76f\") " pod="e2e-models-e2e-worker-w5-626870/premium-w5-626870-kserve-5df7f7b5c4-vx59r"
Oct 30 20:01:34.452187 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:01:34.452152    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a1adddd4-3218-4a6b-a145-0290bceff76f-tmp-dir\") pod \"premium-w5-626870-kserve-5df7f7b5c4-vx59r\" (UID: \"a1adddd4-3218-4a6b-a145-0290bceff76f\") " pod="e2e-models-e2e-worker-w5-626870/premium-w5-626870-kserve-5df7f7b5c4-vx59r"
Oct 30 20:01:34.452187 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:01:34.452175    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a1adddd4-3218-4a6b-a145-0290bceff76f-tls-certs\") pod \"premium-w5-626870-kserve-5df7f7b5c4-vx59r\" (UID: \"a1adddd4-3218-4a6b-a145-0290bceff76f\") " pod="e2e-models-e2e-worker-w5-626870/premium-w5-626870-kserve-5df7f7b5c4-vx59r"
Oct 30 20:01:34.553668 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:01:34.553627    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a1adddd4-3218-4a6b-a145-0290bceff76f-dshm\") pod \"premium-w5-626870-kserve-5df7f7b5c4-vx59r\" (UID: \"a1adddd4-3218-4a6b-a145-0290bceff76f\") " pod="e2e-models-e2e-worker-w5-626870/premium-w5-626870-kserve-5df7f7b5c4-vx59r"
Oct 30 20:01:34.553861 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:01:34.553787    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-whwsx\" (UniqueName: \"kubernetes.io/projected/a1adddd4-3218-4a6b-a145-0290bceff76f-kube-api-access-whwsx\") pod \"premium-w5-626870-kserve-5df7f7b5c4-vx59r\" (UID: \"a1adddd4-3218-4a6b-a145-0290bceff76f\") " pod="e2e-models-e2e-worker-w5-626870/premium-w5-626870-kserve-5df7f7b5c4-vx59r"
Oct 30 20:01:34.553861 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:01:34.553826    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a1adddd4-3218-4a6b-a145-0290bceff76f-model-cache\") pod \"premium-w5-626870-kserve-5df7f7b5c4-vx59r\" (UID: \"a1adddd4-3218-4a6b-a145-0290bceff76f\") " pod="e2e-models-e2e-worker-w5-626870/premium-w5-626870-kserve-5df7f7b5c4-vx59r"
Oct 30 20:01:34.553986 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:01:34.553929    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a1adddd4-3218-4a6b-a145-0290bceff76f-home\") pod \"premium-w5-626870-kserve-5df7f7b5c4-vx59r\" (UID: \"a1adddd4-3218-4a6b-a145-0290bceff76f\") " pod="e2e-models-e2e-worker-w5-626870/premium-w5-626870-kserve-5df7f7b5c4-vx59r"
Oct 30 20:01:34.554047 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:01:34.553992    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a1adddd4-3218-4a6b-a145-0290bceff76f-tmp-dir\") pod \"premium-w5-626870-kserve-5df7f7b5c4-vx59r\" (UID: \"a1adddd4-3218-4a6b-a145-0290bceff76f\") " pod="e2e-models-e2e-worker-w5-626870/premium-w5-626870-kserve-5df7f7b5c4-vx59r"
Oct 30 20:01:34.554047 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:01:34.554019    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a1adddd4-3218-4a6b-a145-0290bceff76f-tls-certs\") pod \"premium-w5-626870-kserve-5df7f7b5c4-vx59r\" (UID: \"a1adddd4-3218-4a6b-a145-0290bceff76f\") " pod="e2e-models-e2e-worker-w5-626870/premium-w5-626870-kserve-5df7f7b5c4-vx59r"
Oct 30 20:01:34.554391 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:01:34.554368    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a1adddd4-3218-4a6b-a145-0290bceff76f-home\") pod \"premium-w5-626870-kserve-5df7f7b5c4-vx59r\" (UID: \"a1adddd4-3218-4a6b-a145-0290bceff76f\") " pod="e2e-models-e2e-worker-w5-626870/premium-w5-626870-kserve-5df7f7b5c4-vx59r"
Oct 30 20:01:34.554494 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:01:34.554404    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a1adddd4-3218-4a6b-a145-0290bceff76f-tmp-dir\") pod \"premium-w5-626870-kserve-5df7f7b5c4-vx59r\" (UID: \"a1adddd4-3218-4a6b-a145-0290bceff76f\") " pod="e2e-models-e2e-worker-w5-626870/premium-w5-626870-kserve-5df7f7b5c4-vx59r"
Oct 30 20:01:34.554661 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:01:34.554640    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a1adddd4-3218-4a6b-a145-0290bceff76f-model-cache\") pod \"premium-w5-626870-kserve-5df7f7b5c4-vx59r\" (UID: \"a1adddd4-3218-4a6b-a145-0290bceff76f\") " pod="e2e-models-e2e-worker-w5-626870/premium-w5-626870-kserve-5df7f7b5c4-vx59r"
Oct 30 20:01:34.561986 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:01:34.561957    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a1adddd4-3218-4a6b-a145-0290bceff76f-tls-certs\") pod \"premium-w5-626870-kserve-5df7f7b5c4-vx59r\" (UID: \"a1adddd4-3218-4a6b-a145-0290bceff76f\") " pod="e2e-models-e2e-worker-w5-626870/premium-w5-626870-kserve-5df7f7b5c4-vx59r"
Oct 30 20:01:34.564852 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:01:34.564826    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a1adddd4-3218-4a6b-a145-0290bceff76f-dshm\") pod \"premium-w5-626870-kserve-5df7f7b5c4-vx59r\" (UID: \"a1adddd4-3218-4a6b-a145-0290bceff76f\") " pod="e2e-models-e2e-worker-w5-626870/premium-w5-626870-kserve-5df7f7b5c4-vx59r"
Oct 30 20:01:34.579264 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:01:34.579231    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-whwsx\" (UniqueName: \"kubernetes.io/projected/a1adddd4-3218-4a6b-a145-0290bceff76f-kube-api-access-whwsx\") pod \"premium-w5-626870-kserve-5df7f7b5c4-vx59r\" (UID: \"a1adddd4-3218-4a6b-a145-0290bceff76f\") " pod="e2e-models-e2e-worker-w5-626870/premium-w5-626870-kserve-5df7f7b5c4-vx59r"
Oct 30 20:01:34.673886 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:01:34.673808    6275 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w5-626870/premium-w5-626870-kserve-5df7f7b5c4-vx59r"
Oct 30 20:01:34.975753 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:01:34.975728    6275 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w5-626870/premium-w5-626870-kserve-5df7f7b5c4-vx59r"]
Oct 30 20:01:34.977293 ip-10-0-131-26 kubenswrapper[6275]: W1030 20:01:34.977266    6275 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda1adddd4_3218_4a6b_a145_0290bceff76f.slice/crio-a5d560d12f89b7230d1f212c3dc11b72daf3a503c1fb5472277446eb0b56a553 WatchSource:0}: Error finding container a5d560d12f89b7230d1f212c3dc11b72daf3a503c1fb5472277446eb0b56a553: Status 404 returned error can't find the container with id a5d560d12f89b7230d1f212c3dc11b72daf3a503c1fb5472277446eb0b56a553
Oct 30 20:01:35.559438 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:01:35.559389    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w5-626870/premium-w5-626870-kserve-5df7f7b5c4-vx59r" event={"ID":"a1adddd4-3218-4a6b-a145-0290bceff76f","Type":"ContainerStarted","Data":"0f80c1ca2254257e0095a7129328cc8407e7dda1b5481f55b17cff1e59bf5abb"}
Oct 30 20:01:35.559835 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:01:35.559449    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w5-626870/premium-w5-626870-kserve-5df7f7b5c4-vx59r" event={"ID":"a1adddd4-3218-4a6b-a145-0290bceff76f","Type":"ContainerStarted","Data":"a5d560d12f89b7230d1f212c3dc11b72daf3a503c1fb5472277446eb0b56a553"}
Oct 30 20:01:35.605343 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:01:35.605290    6275 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w5-626870/premium-w5-626870-kserve-5df7f7b5c4-vx59r" podStartSLOduration=1.60527591 podStartE2EDuration="1.60527591s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:01:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:01:35.60391204 +0000 UTC m=+806.065638906" watchObservedRunningTime="2026-10-30 20:01:35.60527591 +0000 UTC m=+806.067002772"
Oct 30 20:01:35.674258 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:01:35.674229    6275 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w5-626870/premium-w5-626870-kserve-5df7f7b5c4-vx59r"
Oct 30 20:01:38.806651 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:01:38.806611    6275 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w6-51dd62/simulator-w6-51dd62-kserve-d6bb4985f-65j9h"
Oct 30 20:01:38.819953 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:01:38.819913    6275 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w6-51dd62/simulator-w6-51dd62-kserve-d6bb4985f-65j9h"
Oct 30 20:01:39.208933 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:01:39.208854    6275 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w4-f1f016-openshift-default-6c85499cc-697gz"]
Oct 30 20:01:39.212638 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:01:39.212620    6275 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-f1f016-openshift-default-6c85499cc-697gz"
Oct 30 20:01:39.246120 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:01:39.246089    6275 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-f1f016-openshift-default-6c85499cc-697gz"]
Oct 30 20:01:39.301673 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:01:39.301639    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d0e72a0c-3d64-4e88-af2d-246a329f6215-istio-podinfo\") pod \"e2e-worker-w4-f1f016-openshift-default-6c85499cc-697gz\" (UID: \"d0e72a0c-3d64-4e88-af2d-246a329f6215\") " pod="openshift-ingress/e2e-worker-w4-f1f016-openshift-default-6c85499cc-697gz"
Oct 30 20:01:39.301842 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:01:39.301680    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d0e72a0c-3d64-4e88-af2d-246a329f6215-istio-data\") pod \"e2e-worker-w4-f1f016-openshift-default-6c85499cc-697gz\" (UID: \"d0e72a0c-3d64-4e88-af2d-246a329f6215\") " pod="openshift-ingress/e2e-worker-w4-f1f016-openshift-default-6c85499cc-697gz"
Oct 30 20:01:39.301842 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:01:39.301702    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d0e72a0c-3d64-4e88-af2d-246a329f6215-istio-envoy\") pod \"e2e-worker-w4-f1f016-openshift-default-6c85499cc-697gz\" (UID: \"d0e72a0c-3d64-4e88-af2d-246a329f6215\") " pod="openshift-ingress/e2e-worker-w4-f1f016-openshift-default-6c85499cc-697gz"
Oct 30 20:01:39.301842 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:01:39.301822    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d0e72a0c-3d64-4e88-af2d-246a329f6215-workload-certs\") pod \"e2e-worker-w4-f1f016-openshift-default-6c85499cc-697gz\" (UID: \"d0e72a0c-3d64-4e88-af2d-246a329f6215\") " pod="openshift-ingress/e2e-worker-w4-f1f016-openshift-default-6c85499cc-697gz"
Oct 30 20:01:39.302035 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:01:39.301853    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d0e72a0c-3d64-4e88-af2d-246a329f6215-istio-token\") pod \"e2e-worker-w4-f1f016-openshift-default-6c85499cc-697gz\" (UID: \"d0e72a0c-3d64-4e88-af2d-246a329f6215\") " pod="openshift-ingress/e2e-worker-w4-f1f016-openshift-default-6c85499cc-697gz"
Oct 30 20:01:39.302035 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:01:39.301916    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d0e72a0c-3d64-4e88-af2d-246a329f6215-istiod-ca-cert\") pod \"e2e-worker-w4-f1f016-openshift-default-6c85499cc-697gz\" (UID: \"d0e72a0c-3d64-4e88-af2d-246a329f6215\") " pod="openshift-ingress/e2e-worker-w4-f1f016-openshift-default-6c85499cc-697gz"
Oct 30 20:01:39.302035 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:01:39.301969    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vjb5p\" (UniqueName: \"kubernetes.io/projected/d0e72a0c-3d64-4e88-af2d-246a329f6215-kube-api-access-vjb5p\") pod \"e2e-worker-w4-f1f016-openshift-default-6c85499cc-697gz\" (UID: \"d0e72a0c-3d64-4e88-af2d-246a329f6215\") " pod="openshift-ingress/e2e-worker-w4-f1f016-openshift-default-6c85499cc-697gz"
Oct 30 20:01:39.302035 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:01:39.302023    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d0e72a0c-3d64-4e88-af2d-246a329f6215-workload-socket\") pod \"e2e-worker-w4-f1f016-openshift-default-6c85499cc-697gz\" (UID: \"d0e72a0c-3d64-4e88-af2d-246a329f6215\") " pod="openshift-ingress/e2e-worker-w4-f1f016-openshift-default-6c85499cc-697gz"
Oct 30 20:01:39.302190 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:01:39.302040    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d0e72a0c-3d64-4e88-af2d-246a329f6215-credential-socket\") pod \"e2e-worker-w4-f1f016-openshift-default-6c85499cc-697gz\" (UID: \"d0e72a0c-3d64-4e88-af2d-246a329f6215\") " pod="openshift-ingress/e2e-worker-w4-f1f016-openshift-default-6c85499cc-697gz"
Oct 30 20:01:39.403593 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:01:39.403551    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d0e72a0c-3d64-4e88-af2d-246a329f6215-istio-podinfo\") pod \"e2e-worker-w4-f1f016-openshift-default-6c85499cc-697gz\" (UID: \"d0e72a0c-3d64-4e88-af2d-246a329f6215\") " pod="openshift-ingress/e2e-worker-w4-f1f016-openshift-default-6c85499cc-697gz"
Oct 30 20:01:39.403785 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:01:39.403605    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d0e72a0c-3d64-4e88-af2d-246a329f6215-istio-data\") pod \"e2e-worker-w4-f1f016-openshift-default-6c85499cc-697gz\" (UID: \"d0e72a0c-3d64-4e88-af2d-246a329f6215\") " pod="openshift-ingress/e2e-worker-w4-f1f016-openshift-default-6c85499cc-697gz"
Oct 30 20:01:39.403785 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:01:39.403643    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d0e72a0c-3d64-4e88-af2d-246a329f6215-istio-envoy\") pod \"e2e-worker-w4-f1f016-openshift-default-6c85499cc-697gz\" (UID: \"d0e72a0c-3d64-4e88-af2d-246a329f6215\") " pod="openshift-ingress/e2e-worker-w4-f1f016-openshift-default-6c85499cc-697gz"
Oct 30 20:01:39.403785 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:01:39.403700    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d0e72a0c-3d64-4e88-af2d-246a329f6215-workload-certs\") pod \"e2e-worker-w4-f1f016-openshift-default-6c85499cc-697gz\" (UID: \"d0e72a0c-3d64-4e88-af2d-246a329f6215\") " pod="openshift-ingress/e2e-worker-w4-f1f016-openshift-default-6c85499cc-697gz"
Oct 30 20:01:39.403785 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:01:39.403734    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d0e72a0c-3d64-4e88-af2d-246a329f6215-istio-token\") pod \"e2e-worker-w4-f1f016-openshift-default-6c85499cc-697gz\" (UID: \"d0e72a0c-3d64-4e88-af2d-246a329f6215\") " pod="openshift-ingress/e2e-worker-w4-f1f016-openshift-default-6c85499cc-697gz"
Oct 30 20:01:39.403988 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:01:39.403786    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d0e72a0c-3d64-4e88-af2d-246a329f6215-istiod-ca-cert\") pod \"e2e-worker-w4-f1f016-openshift-default-6c85499cc-697gz\" (UID: \"d0e72a0c-3d64-4e88-af2d-246a329f6215\") " pod="openshift-ingress/e2e-worker-w4-f1f016-openshift-default-6c85499cc-697gz"
Oct 30 20:01:39.403988 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:01:39.403828    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vjb5p\" (UniqueName: \"kubernetes.io/projected/d0e72a0c-3d64-4e88-af2d-246a329f6215-kube-api-access-vjb5p\") pod \"e2e-worker-w4-f1f016-openshift-default-6c85499cc-697gz\" (UID: \"d0e72a0c-3d64-4e88-af2d-246a329f6215\") " pod="openshift-ingress/e2e-worker-w4-f1f016-openshift-default-6c85499cc-697gz"
Oct 30 20:01:39.404091 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:01:39.404069    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d0e72a0c-3d64-4e88-af2d-246a329f6215-workload-socket\") pod \"e2e-worker-w4-f1f016-openshift-default-6c85499cc-697gz\" (UID: \"d0e72a0c-3d64-4e88-af2d-246a329f6215\") " pod="openshift-ingress/e2e-worker-w4-f1f016-openshift-default-6c85499cc-697gz"
Oct 30 20:01:39.404146 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:01:39.404098    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d0e72a0c-3d64-4e88-af2d-246a329f6215-credential-socket\") pod \"e2e-worker-w4-f1f016-openshift-default-6c85499cc-697gz\" (UID: \"d0e72a0c-3d64-4e88-af2d-246a329f6215\") " pod="openshift-ingress/e2e-worker-w4-f1f016-openshift-default-6c85499cc-697gz"
Oct 30 20:01:39.404215 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:01:39.404143    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d0e72a0c-3d64-4e88-af2d-246a329f6215-workload-certs\") pod \"e2e-worker-w4-f1f016-openshift-default-6c85499cc-697gz\" (UID: \"d0e72a0c-3d64-4e88-af2d-246a329f6215\") " pod="openshift-ingress/e2e-worker-w4-f1f016-openshift-default-6c85499cc-697gz"
Oct 30 20:01:39.404492 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:01:39.404466    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d0e72a0c-3d64-4e88-af2d-246a329f6215-workload-socket\") pod \"e2e-worker-w4-f1f016-openshift-default-6c85499cc-697gz\" (UID: \"d0e72a0c-3d64-4e88-af2d-246a329f6215\") " pod="openshift-ingress/e2e-worker-w4-f1f016-openshift-default-6c85499cc-697gz"
Oct 30 20:01:39.404614 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:01:39.404469    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d0e72a0c-3d64-4e88-af2d-246a329f6215-istio-data\") pod \"e2e-worker-w4-f1f016-openshift-default-6c85499cc-697gz\" (UID: \"d0e72a0c-3d64-4e88-af2d-246a329f6215\") " pod="openshift-ingress/e2e-worker-w4-f1f016-openshift-default-6c85499cc-697gz"
Oct 30 20:01:39.404614 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:01:39.404561    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d0e72a0c-3d64-4e88-af2d-246a329f6215-credential-socket\") pod \"e2e-worker-w4-f1f016-openshift-default-6c85499cc-697gz\" (UID: \"d0e72a0c-3d64-4e88-af2d-246a329f6215\") " pod="openshift-ingress/e2e-worker-w4-f1f016-openshift-default-6c85499cc-697gz"
Oct 30 20:01:39.404614 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:01:39.404559    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d0e72a0c-3d64-4e88-af2d-246a329f6215-istiod-ca-cert\") pod \"e2e-worker-w4-f1f016-openshift-default-6c85499cc-697gz\" (UID: \"d0e72a0c-3d64-4e88-af2d-246a329f6215\") " pod="openshift-ingress/e2e-worker-w4-f1f016-openshift-default-6c85499cc-697gz"
Oct 30 20:01:39.406139 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:01:39.406112    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d0e72a0c-3d64-4e88-af2d-246a329f6215-istio-envoy\") pod \"e2e-worker-w4-f1f016-openshift-default-6c85499cc-697gz\" (UID: \"d0e72a0c-3d64-4e88-af2d-246a329f6215\") " pod="openshift-ingress/e2e-worker-w4-f1f016-openshift-default-6c85499cc-697gz"
Oct 30 20:01:39.406310 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:01:39.406291    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d0e72a0c-3d64-4e88-af2d-246a329f6215-istio-podinfo\") pod \"e2e-worker-w4-f1f016-openshift-default-6c85499cc-697gz\" (UID: \"d0e72a0c-3d64-4e88-af2d-246a329f6215\") " pod="openshift-ingress/e2e-worker-w4-f1f016-openshift-default-6c85499cc-697gz"
Oct 30 20:01:39.429320 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:01:39.429293    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d0e72a0c-3d64-4e88-af2d-246a329f6215-istio-token\") pod \"e2e-worker-w4-f1f016-openshift-default-6c85499cc-697gz\" (UID: \"d0e72a0c-3d64-4e88-af2d-246a329f6215\") " pod="openshift-ingress/e2e-worker-w4-f1f016-openshift-default-6c85499cc-697gz"
Oct 30 20:01:39.429455 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:01:39.429436    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vjb5p\" (UniqueName: \"kubernetes.io/projected/d0e72a0c-3d64-4e88-af2d-246a329f6215-kube-api-access-vjb5p\") pod \"e2e-worker-w4-f1f016-openshift-default-6c85499cc-697gz\" (UID: \"d0e72a0c-3d64-4e88-af2d-246a329f6215\") " pod="openshift-ingress/e2e-worker-w4-f1f016-openshift-default-6c85499cc-697gz"
Oct 30 20:01:39.529640 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:01:39.529595    6275 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-f1f016-openshift-default-6c85499cc-697gz"
Oct 30 20:01:39.610666 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:01:39.610396    6275 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w6-51dd62/simulator-w6-51dd62-kserve-d6bb4985f-65j9h"
Oct 30 20:01:39.861470 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:01:39.861446    6275 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-f1f016-openshift-default-6c85499cc-697gz"]
Oct 30 20:01:39.861868 ip-10-0-131-26 kubenswrapper[6275]: W1030 20:01:39.861588    6275 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd0e72a0c_3d64_4e88_af2d_246a329f6215.slice/crio-f85d2c6c8a6e5854337e6d9a285493028c9a7dcb51212e881455d0a6a96aa134 WatchSource:0}: Error finding container f85d2c6c8a6e5854337e6d9a285493028c9a7dcb51212e881455d0a6a96aa134: Status 404 returned error can't find the container with id f85d2c6c8a6e5854337e6d9a285493028c9a7dcb51212e881455d0a6a96aa134
Oct 30 20:01:39.863884 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:01:39.863850    6275 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Oct 30 20:01:39.864010 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:01:39.863939    6275 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Oct 30 20:01:39.864010 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:01:39.863978    6275 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Oct 30 20:01:40.605924 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:01:40.605295    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-f1f016-openshift-default-6c85499cc-697gz" event={"ID":"d0e72a0c-3d64-4e88-af2d-246a329f6215","Type":"ContainerStarted","Data":"7281c421542ceeb45b70aec8f7bb80efdfa3c122860c4eb37fc8d63b633d5c8b"}
Oct 30 20:01:40.605924 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:01:40.605449    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-f1f016-openshift-default-6c85499cc-697gz" event={"ID":"d0e72a0c-3d64-4e88-af2d-246a329f6215","Type":"ContainerStarted","Data":"f85d2c6c8a6e5854337e6d9a285493028c9a7dcb51212e881455d0a6a96aa134"}
Oct 30 20:01:41.530639 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:01:41.530611    6275 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w4-f1f016-openshift-default-6c85499cc-697gz"
Oct 30 20:01:41.532247 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:01:41.532219    6275 patch_prober.go:29] interesting pod/e2e-worker-w4-f1f016-openshift-default-6c85499cc-697gz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused" start-of-body=
Oct 30 20:01:41.532381 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:01:41.532278    6275 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-f1f016-openshift-default-6c85499cc-697gz" podUID="d0e72a0c-3d64-4e88-af2d-246a329f6215" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused"
Oct 30 20:01:42.530949 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:01:42.530914    6275 patch_prober.go:29] interesting pod/e2e-worker-w4-f1f016-openshift-default-6c85499cc-697gz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused" start-of-body=
Oct 30 20:01:42.531347 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:01:42.530970    6275 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-f1f016-openshift-default-6c85499cc-697gz" podUID="d0e72a0c-3d64-4e88-af2d-246a329f6215" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused"
Oct 30 20:01:43.530297 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:01:43.530263    6275 patch_prober.go:29] interesting pod/e2e-worker-w4-f1f016-openshift-default-6c85499cc-697gz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused" start-of-body=
Oct 30 20:01:43.530484 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:01:43.530317    6275 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-f1f016-openshift-default-6c85499cc-697gz" podUID="d0e72a0c-3d64-4e88-af2d-246a329f6215" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused"
Oct 30 20:01:43.859265 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:01:43.859172    6275 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w4-f1f016-openshift-default-6c85499cc-697gz" podStartSLOduration=4.859156167 podStartE2EDuration="4.859156167s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:01:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:01:40.67555832 +0000 UTC m=+811.137285196" watchObservedRunningTime="2026-10-30 20:01:43.859156167 +0000 UTC m=+814.320883024"
Oct 30 20:01:43.859811 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:01:43.859791    6275 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w2-efbac3/premium-w2-efbac3-kserve-55f54cfff6-9fqbz"]
Oct 30 20:01:43.866760 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:01:43.866740    6275 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w2-efbac3/premium-w2-efbac3-kserve-55f54cfff6-9fqbz"
Oct 30 20:01:43.908697 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:01:43.908658    6275 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w2-efbac3/premium-w2-efbac3-kserve-55f54cfff6-9fqbz"]
Oct 30 20:01:43.913961 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:01:43.913933    6275 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w2-efbac3\"/\"default-dockercfg-j897c\""
Oct 30 20:01:43.914117 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:01:43.914023    6275 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w2-efbac3\"/\"kube-root-ca.crt\""
Oct 30 20:01:43.914117 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:01:43.914044    6275 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w2-efbac3\"/\"openshift-service-ca.crt\""
Oct 30 20:01:43.914288 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:01:43.914254    6275 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w2-efbac3\"/\"premium-w2-efbac3-kserve-self-signed-certs\""
Oct 30 20:01:44.061218 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:01:44.061176    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/083136dc-91fb-454f-a782-87b004e73d1b-dshm\") pod \"premium-w2-efbac3-kserve-55f54cfff6-9fqbz\" (UID: \"083136dc-91fb-454f-a782-87b004e73d1b\") " pod="e2e-models-e2e-worker-w2-efbac3/premium-w2-efbac3-kserve-55f54cfff6-9fqbz"
Oct 30 20:01:44.061439 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:01:44.061265    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6r794\" (UniqueName: \"kubernetes.io/projected/083136dc-91fb-454f-a782-87b004e73d1b-kube-api-access-6r794\") pod \"premium-w2-efbac3-kserve-55f54cfff6-9fqbz\" (UID: \"083136dc-91fb-454f-a782-87b004e73d1b\") " pod="e2e-models-e2e-worker-w2-efbac3/premium-w2-efbac3-kserve-55f54cfff6-9fqbz"
Oct 30 20:01:44.061439 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:01:44.061305    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/083136dc-91fb-454f-a782-87b004e73d1b-home\") pod \"premium-w2-efbac3-kserve-55f54cfff6-9fqbz\" (UID: \"083136dc-91fb-454f-a782-87b004e73d1b\") " pod="e2e-models-e2e-worker-w2-efbac3/premium-w2-efbac3-kserve-55f54cfff6-9fqbz"
Oct 30 20:01:44.061559 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:01:44.061496    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/083136dc-91fb-454f-a782-87b004e73d1b-tmp-dir\") pod \"premium-w2-efbac3-kserve-55f54cfff6-9fqbz\" (UID: \"083136dc-91fb-454f-a782-87b004e73d1b\") " pod="e2e-models-e2e-worker-w2-efbac3/premium-w2-efbac3-kserve-55f54cfff6-9fqbz"
Oct 30 20:01:44.061617 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:01:44.061591    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/083136dc-91fb-454f-a782-87b004e73d1b-model-cache\") pod \"premium-w2-efbac3-kserve-55f54cfff6-9fqbz\" (UID: \"083136dc-91fb-454f-a782-87b004e73d1b\") " pod="e2e-models-e2e-worker-w2-efbac3/premium-w2-efbac3-kserve-55f54cfff6-9fqbz"
Oct 30 20:01:44.061668 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:01:44.061625    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/083136dc-91fb-454f-a782-87b004e73d1b-tls-certs\") pod \"premium-w2-efbac3-kserve-55f54cfff6-9fqbz\" (UID: \"083136dc-91fb-454f-a782-87b004e73d1b\") " pod="e2e-models-e2e-worker-w2-efbac3/premium-w2-efbac3-kserve-55f54cfff6-9fqbz"
Oct 30 20:01:44.163089 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:01:44.163000    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/083136dc-91fb-454f-a782-87b004e73d1b-model-cache\") pod \"premium-w2-efbac3-kserve-55f54cfff6-9fqbz\" (UID: \"083136dc-91fb-454f-a782-87b004e73d1b\") " pod="e2e-models-e2e-worker-w2-efbac3/premium-w2-efbac3-kserve-55f54cfff6-9fqbz"
Oct 30 20:01:44.163089 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:01:44.163041    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/083136dc-91fb-454f-a782-87b004e73d1b-tls-certs\") pod \"premium-w2-efbac3-kserve-55f54cfff6-9fqbz\" (UID: \"083136dc-91fb-454f-a782-87b004e73d1b\") " pod="e2e-models-e2e-worker-w2-efbac3/premium-w2-efbac3-kserve-55f54cfff6-9fqbz"
Oct 30 20:01:44.163089 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:01:44.163088    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/083136dc-91fb-454f-a782-87b004e73d1b-dshm\") pod \"premium-w2-efbac3-kserve-55f54cfff6-9fqbz\" (UID: \"083136dc-91fb-454f-a782-87b004e73d1b\") " pod="e2e-models-e2e-worker-w2-efbac3/premium-w2-efbac3-kserve-55f54cfff6-9fqbz"
Oct 30 20:01:44.163375 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:01:44.163126    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6r794\" (UniqueName: \"kubernetes.io/projected/083136dc-91fb-454f-a782-87b004e73d1b-kube-api-access-6r794\") pod \"premium-w2-efbac3-kserve-55f54cfff6-9fqbz\" (UID: \"083136dc-91fb-454f-a782-87b004e73d1b\") " pod="e2e-models-e2e-worker-w2-efbac3/premium-w2-efbac3-kserve-55f54cfff6-9fqbz"
Oct 30 20:01:44.163375 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:01:44.163158    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/083136dc-91fb-454f-a782-87b004e73d1b-home\") pod \"premium-w2-efbac3-kserve-55f54cfff6-9fqbz\" (UID: \"083136dc-91fb-454f-a782-87b004e73d1b\") " pod="e2e-models-e2e-worker-w2-efbac3/premium-w2-efbac3-kserve-55f54cfff6-9fqbz"
Oct 30 20:01:44.163375 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:01:44.163289    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/083136dc-91fb-454f-a782-87b004e73d1b-tmp-dir\") pod \"premium-w2-efbac3-kserve-55f54cfff6-9fqbz\" (UID: \"083136dc-91fb-454f-a782-87b004e73d1b\") " pod="e2e-models-e2e-worker-w2-efbac3/premium-w2-efbac3-kserve-55f54cfff6-9fqbz"
Oct 30 20:01:44.163548 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:01:44.163480    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/083136dc-91fb-454f-a782-87b004e73d1b-model-cache\") pod \"premium-w2-efbac3-kserve-55f54cfff6-9fqbz\" (UID: \"083136dc-91fb-454f-a782-87b004e73d1b\") " pod="e2e-models-e2e-worker-w2-efbac3/premium-w2-efbac3-kserve-55f54cfff6-9fqbz"
Oct 30 20:01:44.163619 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:01:44.163545    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/083136dc-91fb-454f-a782-87b004e73d1b-home\") pod \"premium-w2-efbac3-kserve-55f54cfff6-9fqbz\" (UID: \"083136dc-91fb-454f-a782-87b004e73d1b\") " pod="e2e-models-e2e-worker-w2-efbac3/premium-w2-efbac3-kserve-55f54cfff6-9fqbz"
Oct 30 20:01:44.163673 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:01:44.163636    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/083136dc-91fb-454f-a782-87b004e73d1b-tmp-dir\") pod \"premium-w2-efbac3-kserve-55f54cfff6-9fqbz\" (UID: \"083136dc-91fb-454f-a782-87b004e73d1b\") " pod="e2e-models-e2e-worker-w2-efbac3/premium-w2-efbac3-kserve-55f54cfff6-9fqbz"
Oct 30 20:01:44.165563 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:01:44.165536    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/083136dc-91fb-454f-a782-87b004e73d1b-dshm\") pod \"premium-w2-efbac3-kserve-55f54cfff6-9fqbz\" (UID: \"083136dc-91fb-454f-a782-87b004e73d1b\") " pod="e2e-models-e2e-worker-w2-efbac3/premium-w2-efbac3-kserve-55f54cfff6-9fqbz"
Oct 30 20:01:44.165807 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:01:44.165790    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/083136dc-91fb-454f-a782-87b004e73d1b-tls-certs\") pod \"premium-w2-efbac3-kserve-55f54cfff6-9fqbz\" (UID: \"083136dc-91fb-454f-a782-87b004e73d1b\") " pod="e2e-models-e2e-worker-w2-efbac3/premium-w2-efbac3-kserve-55f54cfff6-9fqbz"
Oct 30 20:01:44.197336 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:01:44.197307    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6r794\" (UniqueName: \"kubernetes.io/projected/083136dc-91fb-454f-a782-87b004e73d1b-kube-api-access-6r794\") pod \"premium-w2-efbac3-kserve-55f54cfff6-9fqbz\" (UID: \"083136dc-91fb-454f-a782-87b004e73d1b\") " pod="e2e-models-e2e-worker-w2-efbac3/premium-w2-efbac3-kserve-55f54cfff6-9fqbz"
Oct 30 20:01:44.219166 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:01:44.219139    6275 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w2-efbac3/premium-w2-efbac3-kserve-55f54cfff6-9fqbz"
Oct 30 20:01:44.530668 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:01:44.530635    6275 patch_prober.go:29] interesting pod/e2e-worker-w4-f1f016-openshift-default-6c85499cc-697gz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused" start-of-body=
Oct 30 20:01:44.530837 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:01:44.530682    6275 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-f1f016-openshift-default-6c85499cc-697gz" podUID="d0e72a0c-3d64-4e88-af2d-246a329f6215" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused"
Oct 30 20:01:44.549832 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:01:44.549808    6275 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w2-efbac3/premium-w2-efbac3-kserve-55f54cfff6-9fqbz"]
Oct 30 20:01:44.550604 ip-10-0-131-26 kubenswrapper[6275]: W1030 20:01:44.550583    6275 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod083136dc_91fb_454f_a782_87b004e73d1b.slice/crio-e0c0a2231c04d1d32acaffe32be1e94517977a5b09959f143d9b5e2aeb9bfb1b WatchSource:0}: Error finding container e0c0a2231c04d1d32acaffe32be1e94517977a5b09959f143d9b5e2aeb9bfb1b: Status 404 returned error can't find the container with id e0c0a2231c04d1d32acaffe32be1e94517977a5b09959f143d9b5e2aeb9bfb1b
Oct 30 20:01:44.631547 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:01:44.631518    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w2-efbac3/premium-w2-efbac3-kserve-55f54cfff6-9fqbz" event={"ID":"083136dc-91fb-454f-a782-87b004e73d1b","Type":"ContainerStarted","Data":"e0c0a2231c04d1d32acaffe32be1e94517977a5b09959f143d9b5e2aeb9bfb1b"}
Oct 30 20:01:44.682613 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:01:44.680764    6275 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w5-626870/premium-w5-626870-kserve-5df7f7b5c4-vx59r"
Oct 30 20:01:44.706483 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:01:44.706453    6275 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w5-626870/premium-w5-626870-kserve-5df7f7b5c4-vx59r"
Oct 30 20:01:45.530845 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:01:45.530807    6275 patch_prober.go:29] interesting pod/e2e-worker-w4-f1f016-openshift-default-6c85499cc-697gz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused" start-of-body=
Oct 30 20:01:45.531247 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:01:45.530863    6275 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-f1f016-openshift-default-6c85499cc-697gz" podUID="d0e72a0c-3d64-4e88-af2d-246a329f6215" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused"
Oct 30 20:01:45.639116 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:01:45.639075    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w2-efbac3/premium-w2-efbac3-kserve-55f54cfff6-9fqbz" event={"ID":"083136dc-91fb-454f-a782-87b004e73d1b","Type":"ContainerStarted","Data":"14dd77b19cf39114c3725ceb98eecefdb747ddd4b7a33721f4fbb6641f0825ed"}
Oct 30 20:01:45.656659 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:01:45.656633    6275 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w5-626870/premium-w5-626870-kserve-5df7f7b5c4-vx59r"
Oct 30 20:01:45.696616 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:01:45.696567    6275 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w2-efbac3/premium-w2-efbac3-kserve-55f54cfff6-9fqbz" podStartSLOduration=2.696552816 podStartE2EDuration="2.696552816s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:01:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:01:45.692933166 +0000 UTC m=+816.154660031" watchObservedRunningTime="2026-10-30 20:01:45.696552816 +0000 UTC m=+816.158279678"
Oct 30 20:01:46.219290 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:01:46.219248    6275 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w2-efbac3/premium-w2-efbac3-kserve-55f54cfff6-9fqbz"
Oct 30 20:01:46.534130 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:01:46.534101    6275 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w4-f1f016-openshift-default-6c85499cc-697gz"
Oct 30 20:01:46.534545 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:01:46.534521    6275 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w4-f1f016-openshift-default-6c85499cc-697gz"
Oct 30 20:01:46.535203 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:01:46.535183    6275 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w4-f1f016-openshift-default-6c85499cc-697gz"
Oct 30 20:01:54.220442 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:01:54.220378    6275 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w2-efbac3/premium-w2-efbac3-kserve-55f54cfff6-9fqbz"
Oct 30 20:01:54.233027 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:01:54.232981    6275 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w2-efbac3/premium-w2-efbac3-kserve-55f54cfff6-9fqbz"
Oct 30 20:01:54.701489 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:01:54.701463    6275 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w2-efbac3/premium-w2-efbac3-kserve-55f54cfff6-9fqbz"
Oct 30 20:01:56.256047 ip-10-0-131-26 kubenswrapper[6275]: E1030 20:01:56.256010    6275 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-fwc77" containerName="extractor"
Oct 30 20:02:01.707002 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:02:01.706968    6275 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w4-f1f016/premium-w4-f1f016-kserve-55d6bd678b-w5hkc"]
Oct 30 20:02:01.710751 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:02:01.710735    6275 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-f1f016/premium-w4-f1f016-kserve-55d6bd678b-w5hkc"
Oct 30 20:02:01.742481 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:02:01.742447    6275 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w4-f1f016\"/\"premium-w4-f1f016-kserve-self-signed-certs\""
Oct 30 20:02:01.745017 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:02:01.744993    6275 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-f1f016/premium-w4-f1f016-kserve-55d6bd678b-w5hkc"]
Oct 30 20:02:01.767323 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:02:01.767298    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kwbgv\" (UniqueName: \"kubernetes.io/projected/0e543ba9-1e7a-4d0a-9361-50c98060e824-kube-api-access-kwbgv\") pod \"premium-w4-f1f016-kserve-55d6bd678b-w5hkc\" (UID: \"0e543ba9-1e7a-4d0a-9361-50c98060e824\") " pod="e2e-models-e2e-worker-w4-f1f016/premium-w4-f1f016-kserve-55d6bd678b-w5hkc"
Oct 30 20:02:01.767465 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:02:01.767354    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0e543ba9-1e7a-4d0a-9361-50c98060e824-model-cache\") pod \"premium-w4-f1f016-kserve-55d6bd678b-w5hkc\" (UID: \"0e543ba9-1e7a-4d0a-9361-50c98060e824\") " pod="e2e-models-e2e-worker-w4-f1f016/premium-w4-f1f016-kserve-55d6bd678b-w5hkc"
Oct 30 20:02:01.767465 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:02:01.767402    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0e543ba9-1e7a-4d0a-9361-50c98060e824-tmp-dir\") pod \"premium-w4-f1f016-kserve-55d6bd678b-w5hkc\" (UID: \"0e543ba9-1e7a-4d0a-9361-50c98060e824\") " pod="e2e-models-e2e-worker-w4-f1f016/premium-w4-f1f016-kserve-55d6bd678b-w5hkc"
Oct 30 20:02:01.767599 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:02:01.767575    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0e543ba9-1e7a-4d0a-9361-50c98060e824-tls-certs\") pod \"premium-w4-f1f016-kserve-55d6bd678b-w5hkc\" (UID: \"0e543ba9-1e7a-4d0a-9361-50c98060e824\") " pod="e2e-models-e2e-worker-w4-f1f016/premium-w4-f1f016-kserve-55d6bd678b-w5hkc"
Oct 30 20:02:01.767639 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:02:01.767621    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0e543ba9-1e7a-4d0a-9361-50c98060e824-home\") pod \"premium-w4-f1f016-kserve-55d6bd678b-w5hkc\" (UID: \"0e543ba9-1e7a-4d0a-9361-50c98060e824\") " pod="e2e-models-e2e-worker-w4-f1f016/premium-w4-f1f016-kserve-55d6bd678b-w5hkc"
Oct 30 20:02:01.767770 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:02:01.767751    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0e543ba9-1e7a-4d0a-9361-50c98060e824-dshm\") pod \"premium-w4-f1f016-kserve-55d6bd678b-w5hkc\" (UID: \"0e543ba9-1e7a-4d0a-9361-50c98060e824\") " pod="e2e-models-e2e-worker-w4-f1f016/premium-w4-f1f016-kserve-55d6bd678b-w5hkc"
Oct 30 20:02:01.869085 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:02:01.869048    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0e543ba9-1e7a-4d0a-9361-50c98060e824-dshm\") pod \"premium-w4-f1f016-kserve-55d6bd678b-w5hkc\" (UID: \"0e543ba9-1e7a-4d0a-9361-50c98060e824\") " pod="e2e-models-e2e-worker-w4-f1f016/premium-w4-f1f016-kserve-55d6bd678b-w5hkc"
Oct 30 20:02:01.869255 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:02:01.869113    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kwbgv\" (UniqueName: \"kubernetes.io/projected/0e543ba9-1e7a-4d0a-9361-50c98060e824-kube-api-access-kwbgv\") pod \"premium-w4-f1f016-kserve-55d6bd678b-w5hkc\" (UID: \"0e543ba9-1e7a-4d0a-9361-50c98060e824\") " pod="e2e-models-e2e-worker-w4-f1f016/premium-w4-f1f016-kserve-55d6bd678b-w5hkc"
Oct 30 20:02:01.869255 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:02:01.869158    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0e543ba9-1e7a-4d0a-9361-50c98060e824-model-cache\") pod \"premium-w4-f1f016-kserve-55d6bd678b-w5hkc\" (UID: \"0e543ba9-1e7a-4d0a-9361-50c98060e824\") " pod="e2e-models-e2e-worker-w4-f1f016/premium-w4-f1f016-kserve-55d6bd678b-w5hkc"
Oct 30 20:02:01.869255 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:02:01.869177    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0e543ba9-1e7a-4d0a-9361-50c98060e824-tmp-dir\") pod \"premium-w4-f1f016-kserve-55d6bd678b-w5hkc\" (UID: \"0e543ba9-1e7a-4d0a-9361-50c98060e824\") " pod="e2e-models-e2e-worker-w4-f1f016/premium-w4-f1f016-kserve-55d6bd678b-w5hkc"
Oct 30 20:02:01.869255 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:02:01.869215    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0e543ba9-1e7a-4d0a-9361-50c98060e824-tls-certs\") pod \"premium-w4-f1f016-kserve-55d6bd678b-w5hkc\" (UID: \"0e543ba9-1e7a-4d0a-9361-50c98060e824\") " pod="e2e-models-e2e-worker-w4-f1f016/premium-w4-f1f016-kserve-55d6bd678b-w5hkc"
Oct 30 20:02:01.869255 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:02:01.869243    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0e543ba9-1e7a-4d0a-9361-50c98060e824-home\") pod \"premium-w4-f1f016-kserve-55d6bd678b-w5hkc\" (UID: \"0e543ba9-1e7a-4d0a-9361-50c98060e824\") " pod="e2e-models-e2e-worker-w4-f1f016/premium-w4-f1f016-kserve-55d6bd678b-w5hkc"
Oct 30 20:02:01.869602 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:02:01.869572    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0e543ba9-1e7a-4d0a-9361-50c98060e824-model-cache\") pod \"premium-w4-f1f016-kserve-55d6bd678b-w5hkc\" (UID: \"0e543ba9-1e7a-4d0a-9361-50c98060e824\") " pod="e2e-models-e2e-worker-w4-f1f016/premium-w4-f1f016-kserve-55d6bd678b-w5hkc"
Oct 30 20:02:01.869833 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:02:01.869809    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0e543ba9-1e7a-4d0a-9361-50c98060e824-home\") pod \"premium-w4-f1f016-kserve-55d6bd678b-w5hkc\" (UID: \"0e543ba9-1e7a-4d0a-9361-50c98060e824\") " pod="e2e-models-e2e-worker-w4-f1f016/premium-w4-f1f016-kserve-55d6bd678b-w5hkc"
Oct 30 20:02:01.869917 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:02:01.869813    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0e543ba9-1e7a-4d0a-9361-50c98060e824-tmp-dir\") pod \"premium-w4-f1f016-kserve-55d6bd678b-w5hkc\" (UID: \"0e543ba9-1e7a-4d0a-9361-50c98060e824\") " pod="e2e-models-e2e-worker-w4-f1f016/premium-w4-f1f016-kserve-55d6bd678b-w5hkc"
Oct 30 20:02:01.871452 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:02:01.871408    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0e543ba9-1e7a-4d0a-9361-50c98060e824-dshm\") pod \"premium-w4-f1f016-kserve-55d6bd678b-w5hkc\" (UID: \"0e543ba9-1e7a-4d0a-9361-50c98060e824\") " pod="e2e-models-e2e-worker-w4-f1f016/premium-w4-f1f016-kserve-55d6bd678b-w5hkc"
Oct 30 20:02:01.871700 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:02:01.871680    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0e543ba9-1e7a-4d0a-9361-50c98060e824-tls-certs\") pod \"premium-w4-f1f016-kserve-55d6bd678b-w5hkc\" (UID: \"0e543ba9-1e7a-4d0a-9361-50c98060e824\") " pod="e2e-models-e2e-worker-w4-f1f016/premium-w4-f1f016-kserve-55d6bd678b-w5hkc"
Oct 30 20:02:01.895070 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:02:01.895043    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kwbgv\" (UniqueName: \"kubernetes.io/projected/0e543ba9-1e7a-4d0a-9361-50c98060e824-kube-api-access-kwbgv\") pod \"premium-w4-f1f016-kserve-55d6bd678b-w5hkc\" (UID: \"0e543ba9-1e7a-4d0a-9361-50c98060e824\") " pod="e2e-models-e2e-worker-w4-f1f016/premium-w4-f1f016-kserve-55d6bd678b-w5hkc"
Oct 30 20:02:02.024058 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:02:02.024022    6275 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-f1f016/premium-w4-f1f016-kserve-55d6bd678b-w5hkc"
Oct 30 20:02:02.329367 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:02:02.329341    6275 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-f1f016/premium-w4-f1f016-kserve-55d6bd678b-w5hkc"]
Oct 30 20:02:02.329557 ip-10-0-131-26 kubenswrapper[6275]: W1030 20:02:02.329534    6275 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0e543ba9_1e7a_4d0a_9361_50c98060e824.slice/crio-e225d800fcc17f3cf50989931d6b6a57a3880883f9091b774bfd17b314704698 WatchSource:0}: Error finding container e225d800fcc17f3cf50989931d6b6a57a3880883f9091b774bfd17b314704698: Status 404 returned error can't find the container with id e225d800fcc17f3cf50989931d6b6a57a3880883f9091b774bfd17b314704698
Oct 30 20:02:02.741073 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:02:02.741037    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-f1f016/premium-w4-f1f016-kserve-55d6bd678b-w5hkc" event={"ID":"0e543ba9-1e7a-4d0a-9361-50c98060e824","Type":"ContainerStarted","Data":"da18fd21350a4dca4f626fe8f7fff73059f1d032c43a29a2ac53a369793057be"}
Oct 30 20:02:02.741457 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:02:02.741083    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-f1f016/premium-w4-f1f016-kserve-55d6bd678b-w5hkc" event={"ID":"0e543ba9-1e7a-4d0a-9361-50c98060e824","Type":"ContainerStarted","Data":"e225d800fcc17f3cf50989931d6b6a57a3880883f9091b774bfd17b314704698"}
Oct 30 20:02:02.794203 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:02:02.794155    6275 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w4-f1f016/premium-w4-f1f016-kserve-55d6bd678b-w5hkc" podStartSLOduration=1.7941419939999999 podStartE2EDuration="1.794141994s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:02:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:02:02.793303499 +0000 UTC m=+833.255030362" watchObservedRunningTime="2026-10-30 20:02:02.794141994 +0000 UTC m=+833.255868857"
Oct 30 20:02:03.024342 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:02:03.024246    6275 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w4-f1f016/premium-w4-f1f016-kserve-55d6bd678b-w5hkc"
Oct 30 20:02:04.903838 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:02:04.903806    6275 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w1-5f10d2/premium-w1-5f10d2-kserve-644b846669-286m2"]
Oct 30 20:02:04.908157 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:02:04.908133    6275 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w1-5f10d2/premium-w1-5f10d2-kserve-644b846669-286m2"
Oct 30 20:02:04.929096 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:02:04.929068    6275 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w1-5f10d2/premium-w1-5f10d2-kserve-644b846669-286m2"]
Oct 30 20:02:04.938996 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:02:04.938972    6275 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w1-5f10d2\"/\"kube-root-ca.crt\""
Oct 30 20:02:04.939185 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:02:04.939166    6275 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w1-5f10d2\"/\"openshift-service-ca.crt\""
Oct 30 20:02:04.939245 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:02:04.939207    6275 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w1-5f10d2\"/\"premium-w1-5f10d2-kserve-self-signed-certs\""
Oct 30 20:02:04.939310 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:02:04.939293    6275 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w1-5f10d2\"/\"default-dockercfg-jk2qk\""
Oct 30 20:02:05.002212 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:02:05.002174    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a2ff6903-c1ab-48dd-884b-d119b8ee1ed6-tmp-dir\") pod \"premium-w1-5f10d2-kserve-644b846669-286m2\" (UID: \"a2ff6903-c1ab-48dd-884b-d119b8ee1ed6\") " pod="e2e-models-e2e-worker-w1-5f10d2/premium-w1-5f10d2-kserve-644b846669-286m2"
Oct 30 20:02:05.002400 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:02:05.002219    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a2ff6903-c1ab-48dd-884b-d119b8ee1ed6-model-cache\") pod \"premium-w1-5f10d2-kserve-644b846669-286m2\" (UID: \"a2ff6903-c1ab-48dd-884b-d119b8ee1ed6\") " pod="e2e-models-e2e-worker-w1-5f10d2/premium-w1-5f10d2-kserve-644b846669-286m2"
Oct 30 20:02:05.002400 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:02:05.002238    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a2ff6903-c1ab-48dd-884b-d119b8ee1ed6-dshm\") pod \"premium-w1-5f10d2-kserve-644b846669-286m2\" (UID: \"a2ff6903-c1ab-48dd-884b-d119b8ee1ed6\") " pod="e2e-models-e2e-worker-w1-5f10d2/premium-w1-5f10d2-kserve-644b846669-286m2"
Oct 30 20:02:05.002400 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:02:05.002317    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a2ff6903-c1ab-48dd-884b-d119b8ee1ed6-home\") pod \"premium-w1-5f10d2-kserve-644b846669-286m2\" (UID: \"a2ff6903-c1ab-48dd-884b-d119b8ee1ed6\") " pod="e2e-models-e2e-worker-w1-5f10d2/premium-w1-5f10d2-kserve-644b846669-286m2"
Oct 30 20:02:05.002400 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:02:05.002385    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vf69w\" (UniqueName: \"kubernetes.io/projected/a2ff6903-c1ab-48dd-884b-d119b8ee1ed6-kube-api-access-vf69w\") pod \"premium-w1-5f10d2-kserve-644b846669-286m2\" (UID: \"a2ff6903-c1ab-48dd-884b-d119b8ee1ed6\") " pod="e2e-models-e2e-worker-w1-5f10d2/premium-w1-5f10d2-kserve-644b846669-286m2"
Oct 30 20:02:05.002559 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:02:05.002502    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a2ff6903-c1ab-48dd-884b-d119b8ee1ed6-tls-certs\") pod \"premium-w1-5f10d2-kserve-644b846669-286m2\" (UID: \"a2ff6903-c1ab-48dd-884b-d119b8ee1ed6\") " pod="e2e-models-e2e-worker-w1-5f10d2/premium-w1-5f10d2-kserve-644b846669-286m2"
Oct 30 20:02:05.104002 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:02:05.103966    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a2ff6903-c1ab-48dd-884b-d119b8ee1ed6-tmp-dir\") pod \"premium-w1-5f10d2-kserve-644b846669-286m2\" (UID: \"a2ff6903-c1ab-48dd-884b-d119b8ee1ed6\") " pod="e2e-models-e2e-worker-w1-5f10d2/premium-w1-5f10d2-kserve-644b846669-286m2"
Oct 30 20:02:05.104214 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:02:05.104026    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a2ff6903-c1ab-48dd-884b-d119b8ee1ed6-model-cache\") pod \"premium-w1-5f10d2-kserve-644b846669-286m2\" (UID: \"a2ff6903-c1ab-48dd-884b-d119b8ee1ed6\") " pod="e2e-models-e2e-worker-w1-5f10d2/premium-w1-5f10d2-kserve-644b846669-286m2"
Oct 30 20:02:05.104214 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:02:05.104053    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a2ff6903-c1ab-48dd-884b-d119b8ee1ed6-dshm\") pod \"premium-w1-5f10d2-kserve-644b846669-286m2\" (UID: \"a2ff6903-c1ab-48dd-884b-d119b8ee1ed6\") " pod="e2e-models-e2e-worker-w1-5f10d2/premium-w1-5f10d2-kserve-644b846669-286m2"
Oct 30 20:02:05.104214 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:02:05.104088    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a2ff6903-c1ab-48dd-884b-d119b8ee1ed6-home\") pod \"premium-w1-5f10d2-kserve-644b846669-286m2\" (UID: \"a2ff6903-c1ab-48dd-884b-d119b8ee1ed6\") " pod="e2e-models-e2e-worker-w1-5f10d2/premium-w1-5f10d2-kserve-644b846669-286m2"
Oct 30 20:02:05.104214 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:02:05.104118    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vf69w\" (UniqueName: \"kubernetes.io/projected/a2ff6903-c1ab-48dd-884b-d119b8ee1ed6-kube-api-access-vf69w\") pod \"premium-w1-5f10d2-kserve-644b846669-286m2\" (UID: \"a2ff6903-c1ab-48dd-884b-d119b8ee1ed6\") " pod="e2e-models-e2e-worker-w1-5f10d2/premium-w1-5f10d2-kserve-644b846669-286m2"
Oct 30 20:02:05.104468 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:02:05.104228    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a2ff6903-c1ab-48dd-884b-d119b8ee1ed6-tls-certs\") pod \"premium-w1-5f10d2-kserve-644b846669-286m2\" (UID: \"a2ff6903-c1ab-48dd-884b-d119b8ee1ed6\") " pod="e2e-models-e2e-worker-w1-5f10d2/premium-w1-5f10d2-kserve-644b846669-286m2"
Oct 30 20:02:05.107153 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:02:05.105338    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a2ff6903-c1ab-48dd-884b-d119b8ee1ed6-tmp-dir\") pod \"premium-w1-5f10d2-kserve-644b846669-286m2\" (UID: \"a2ff6903-c1ab-48dd-884b-d119b8ee1ed6\") " pod="e2e-models-e2e-worker-w1-5f10d2/premium-w1-5f10d2-kserve-644b846669-286m2"
Oct 30 20:02:05.107153 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:02:05.105669    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a2ff6903-c1ab-48dd-884b-d119b8ee1ed6-home\") pod \"premium-w1-5f10d2-kserve-644b846669-286m2\" (UID: \"a2ff6903-c1ab-48dd-884b-d119b8ee1ed6\") " pod="e2e-models-e2e-worker-w1-5f10d2/premium-w1-5f10d2-kserve-644b846669-286m2"
Oct 30 20:02:05.107153 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:02:05.106209    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a2ff6903-c1ab-48dd-884b-d119b8ee1ed6-model-cache\") pod \"premium-w1-5f10d2-kserve-644b846669-286m2\" (UID: \"a2ff6903-c1ab-48dd-884b-d119b8ee1ed6\") " pod="e2e-models-e2e-worker-w1-5f10d2/premium-w1-5f10d2-kserve-644b846669-286m2"
Oct 30 20:02:05.107918 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:02:05.107891    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a2ff6903-c1ab-48dd-884b-d119b8ee1ed6-dshm\") pod \"premium-w1-5f10d2-kserve-644b846669-286m2\" (UID: \"a2ff6903-c1ab-48dd-884b-d119b8ee1ed6\") " pod="e2e-models-e2e-worker-w1-5f10d2/premium-w1-5f10d2-kserve-644b846669-286m2"
Oct 30 20:02:05.108661 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:02:05.108642    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a2ff6903-c1ab-48dd-884b-d119b8ee1ed6-tls-certs\") pod \"premium-w1-5f10d2-kserve-644b846669-286m2\" (UID: \"a2ff6903-c1ab-48dd-884b-d119b8ee1ed6\") " pod="e2e-models-e2e-worker-w1-5f10d2/premium-w1-5f10d2-kserve-644b846669-286m2"
Oct 30 20:02:05.131895 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:02:05.131866    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vf69w\" (UniqueName: \"kubernetes.io/projected/a2ff6903-c1ab-48dd-884b-d119b8ee1ed6-kube-api-access-vf69w\") pod \"premium-w1-5f10d2-kserve-644b846669-286m2\" (UID: \"a2ff6903-c1ab-48dd-884b-d119b8ee1ed6\") " pod="e2e-models-e2e-worker-w1-5f10d2/premium-w1-5f10d2-kserve-644b846669-286m2"
Oct 30 20:02:05.222605 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:02:05.222533    6275 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w1-5f10d2/premium-w1-5f10d2-kserve-644b846669-286m2"
Oct 30 20:02:05.533246 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:02:05.533216    6275 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w1-5f10d2/premium-w1-5f10d2-kserve-644b846669-286m2"]
Oct 30 20:02:05.535579 ip-10-0-131-26 kubenswrapper[6275]: W1030 20:02:05.535549    6275 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda2ff6903_c1ab_48dd_884b_d119b8ee1ed6.slice/crio-dd707d261494810086dedb9d33edc06022bbd992077935224c91ddff4da87678 WatchSource:0}: Error finding container dd707d261494810086dedb9d33edc06022bbd992077935224c91ddff4da87678: Status 404 returned error can't find the container with id dd707d261494810086dedb9d33edc06022bbd992077935224c91ddff4da87678
Oct 30 20:02:05.760194 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:02:05.760158    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w1-5f10d2/premium-w1-5f10d2-kserve-644b846669-286m2" event={"ID":"a2ff6903-c1ab-48dd-884b-d119b8ee1ed6","Type":"ContainerStarted","Data":"05d58ef408538bca17176972c12e6eac1b20eaf3948d0cc83d56a0201d6d3680"}
Oct 30 20:02:05.760194 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:02:05.760198    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w1-5f10d2/premium-w1-5f10d2-kserve-644b846669-286m2" event={"ID":"a2ff6903-c1ab-48dd-884b-d119b8ee1ed6","Type":"ContainerStarted","Data":"dd707d261494810086dedb9d33edc06022bbd992077935224c91ddff4da87678"}
Oct 30 20:02:05.810879 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:02:05.810784    6275 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w1-5f10d2/premium-w1-5f10d2-kserve-644b846669-286m2" podStartSLOduration=1.810769832 podStartE2EDuration="1.810769832s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:02:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:02:05.807913287 +0000 UTC m=+836.269640149" watchObservedRunningTime="2026-10-30 20:02:05.810769832 +0000 UTC m=+836.272496695"
Oct 30 20:02:06.223138 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:02:06.223061    6275 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w1-5f10d2/premium-w1-5f10d2-kserve-644b846669-286m2"
Oct 30 20:02:12.024340 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:02:12.024306    6275 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w4-f1f016/premium-w4-f1f016-kserve-55d6bd678b-w5hkc"
Oct 30 20:02:12.037331 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:02:12.037304    6275 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w4-f1f016/premium-w4-f1f016-kserve-55d6bd678b-w5hkc"
Oct 30 20:02:12.815907 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:02:12.815876    6275 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w4-f1f016/premium-w4-f1f016-kserve-55d6bd678b-w5hkc"
Oct 30 20:02:15.223264 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:02:15.223226    6275 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w1-5f10d2/premium-w1-5f10d2-kserve-644b846669-286m2"
Oct 30 20:02:15.241666 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:02:15.241364    6275 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w1-5f10d2/premium-w1-5f10d2-kserve-644b846669-286m2"
Oct 30 20:02:15.841775 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:02:15.841745    6275 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w1-5f10d2/premium-w1-5f10d2-kserve-644b846669-286m2"
Oct 30 20:02:24.365261 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:02:24.365227    6275 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w4-f1f016-openshift-default-6c85499cc-7s68h"]
Oct 30 20:02:24.369316 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:02:24.369295    6275 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-f1f016-openshift-default-6c85499cc-7s68h"
Oct 30 20:02:24.398184 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:02:24.398154    6275 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-f1f016-openshift-default-6c85499cc-7s68h"]
Oct 30 20:02:24.424068 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:02:24.424039    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e32412d9-4dc9-4ef9-af01-8adeace37d59-istio-data\") pod \"e2e-worker-w4-f1f016-openshift-default-6c85499cc-7s68h\" (UID: \"e32412d9-4dc9-4ef9-af01-8adeace37d59\") " pod="openshift-ingress/e2e-worker-w4-f1f016-openshift-default-6c85499cc-7s68h"
Oct 30 20:02:24.424242 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:02:24.424095    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e32412d9-4dc9-4ef9-af01-8adeace37d59-credential-socket\") pod \"e2e-worker-w4-f1f016-openshift-default-6c85499cc-7s68h\" (UID: \"e32412d9-4dc9-4ef9-af01-8adeace37d59\") " pod="openshift-ingress/e2e-worker-w4-f1f016-openshift-default-6c85499cc-7s68h"
Oct 30 20:02:24.424296 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:02:24.424274    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e32412d9-4dc9-4ef9-af01-8adeace37d59-istio-podinfo\") pod \"e2e-worker-w4-f1f016-openshift-default-6c85499cc-7s68h\" (UID: \"e32412d9-4dc9-4ef9-af01-8adeace37d59\") " pod="openshift-ingress/e2e-worker-w4-f1f016-openshift-default-6c85499cc-7s68h"
Oct 30 20:02:24.424333 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:02:24.424322    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e32412d9-4dc9-4ef9-af01-8adeace37d59-workload-certs\") pod \"e2e-worker-w4-f1f016-openshift-default-6c85499cc-7s68h\" (UID: \"e32412d9-4dc9-4ef9-af01-8adeace37d59\") " pod="openshift-ingress/e2e-worker-w4-f1f016-openshift-default-6c85499cc-7s68h"
Oct 30 20:02:24.424461 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:02:24.424439    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e32412d9-4dc9-4ef9-af01-8adeace37d59-workload-socket\") pod \"e2e-worker-w4-f1f016-openshift-default-6c85499cc-7s68h\" (UID: \"e32412d9-4dc9-4ef9-af01-8adeace37d59\") " pod="openshift-ingress/e2e-worker-w4-f1f016-openshift-default-6c85499cc-7s68h"
Oct 30 20:02:24.424537 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:02:24.424515    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e32412d9-4dc9-4ef9-af01-8adeace37d59-istio-envoy\") pod \"e2e-worker-w4-f1f016-openshift-default-6c85499cc-7s68h\" (UID: \"e32412d9-4dc9-4ef9-af01-8adeace37d59\") " pod="openshift-ingress/e2e-worker-w4-f1f016-openshift-default-6c85499cc-7s68h"
Oct 30 20:02:24.424593 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:02:24.424554    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e32412d9-4dc9-4ef9-af01-8adeace37d59-istio-token\") pod \"e2e-worker-w4-f1f016-openshift-default-6c85499cc-7s68h\" (UID: \"e32412d9-4dc9-4ef9-af01-8adeace37d59\") " pod="openshift-ingress/e2e-worker-w4-f1f016-openshift-default-6c85499cc-7s68h"
Oct 30 20:02:24.424647 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:02:24.424589    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wxs7d\" (UniqueName: \"kubernetes.io/projected/e32412d9-4dc9-4ef9-af01-8adeace37d59-kube-api-access-wxs7d\") pod \"e2e-worker-w4-f1f016-openshift-default-6c85499cc-7s68h\" (UID: \"e32412d9-4dc9-4ef9-af01-8adeace37d59\") " pod="openshift-ingress/e2e-worker-w4-f1f016-openshift-default-6c85499cc-7s68h"
Oct 30 20:02:24.424722 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:02:24.424708    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e32412d9-4dc9-4ef9-af01-8adeace37d59-istiod-ca-cert\") pod \"e2e-worker-w4-f1f016-openshift-default-6c85499cc-7s68h\" (UID: \"e32412d9-4dc9-4ef9-af01-8adeace37d59\") " pod="openshift-ingress/e2e-worker-w4-f1f016-openshift-default-6c85499cc-7s68h"
Oct 30 20:02:24.526134 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:02:24.526102    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e32412d9-4dc9-4ef9-af01-8adeace37d59-istiod-ca-cert\") pod \"e2e-worker-w4-f1f016-openshift-default-6c85499cc-7s68h\" (UID: \"e32412d9-4dc9-4ef9-af01-8adeace37d59\") " pod="openshift-ingress/e2e-worker-w4-f1f016-openshift-default-6c85499cc-7s68h"
Oct 30 20:02:24.526335 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:02:24.526149    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e32412d9-4dc9-4ef9-af01-8adeace37d59-istio-data\") pod \"e2e-worker-w4-f1f016-openshift-default-6c85499cc-7s68h\" (UID: \"e32412d9-4dc9-4ef9-af01-8adeace37d59\") " pod="openshift-ingress/e2e-worker-w4-f1f016-openshift-default-6c85499cc-7s68h"
Oct 30 20:02:24.526335 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:02:24.526176    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e32412d9-4dc9-4ef9-af01-8adeace37d59-credential-socket\") pod \"e2e-worker-w4-f1f016-openshift-default-6c85499cc-7s68h\" (UID: \"e32412d9-4dc9-4ef9-af01-8adeace37d59\") " pod="openshift-ingress/e2e-worker-w4-f1f016-openshift-default-6c85499cc-7s68h"
Oct 30 20:02:24.526335 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:02:24.526206    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e32412d9-4dc9-4ef9-af01-8adeace37d59-istio-podinfo\") pod \"e2e-worker-w4-f1f016-openshift-default-6c85499cc-7s68h\" (UID: \"e32412d9-4dc9-4ef9-af01-8adeace37d59\") " pod="openshift-ingress/e2e-worker-w4-f1f016-openshift-default-6c85499cc-7s68h"
Oct 30 20:02:24.526335 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:02:24.526226    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e32412d9-4dc9-4ef9-af01-8adeace37d59-workload-certs\") pod \"e2e-worker-w4-f1f016-openshift-default-6c85499cc-7s68h\" (UID: \"e32412d9-4dc9-4ef9-af01-8adeace37d59\") " pod="openshift-ingress/e2e-worker-w4-f1f016-openshift-default-6c85499cc-7s68h"
Oct 30 20:02:24.526593 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:02:24.526401    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e32412d9-4dc9-4ef9-af01-8adeace37d59-workload-socket\") pod \"e2e-worker-w4-f1f016-openshift-default-6c85499cc-7s68h\" (UID: \"e32412d9-4dc9-4ef9-af01-8adeace37d59\") " pod="openshift-ingress/e2e-worker-w4-f1f016-openshift-default-6c85499cc-7s68h"
Oct 30 20:02:24.526593 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:02:24.526509    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e32412d9-4dc9-4ef9-af01-8adeace37d59-istio-envoy\") pod \"e2e-worker-w4-f1f016-openshift-default-6c85499cc-7s68h\" (UID: \"e32412d9-4dc9-4ef9-af01-8adeace37d59\") " pod="openshift-ingress/e2e-worker-w4-f1f016-openshift-default-6c85499cc-7s68h"
Oct 30 20:02:24.526593 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:02:24.526545    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e32412d9-4dc9-4ef9-af01-8adeace37d59-istio-token\") pod \"e2e-worker-w4-f1f016-openshift-default-6c85499cc-7s68h\" (UID: \"e32412d9-4dc9-4ef9-af01-8adeace37d59\") " pod="openshift-ingress/e2e-worker-w4-f1f016-openshift-default-6c85499cc-7s68h"
Oct 30 20:02:24.526593 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:02:24.526580    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wxs7d\" (UniqueName: \"kubernetes.io/projected/e32412d9-4dc9-4ef9-af01-8adeace37d59-kube-api-access-wxs7d\") pod \"e2e-worker-w4-f1f016-openshift-default-6c85499cc-7s68h\" (UID: \"e32412d9-4dc9-4ef9-af01-8adeace37d59\") " pod="openshift-ingress/e2e-worker-w4-f1f016-openshift-default-6c85499cc-7s68h"
Oct 30 20:02:24.526803 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:02:24.526696    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e32412d9-4dc9-4ef9-af01-8adeace37d59-workload-certs\") pod \"e2e-worker-w4-f1f016-openshift-default-6c85499cc-7s68h\" (UID: \"e32412d9-4dc9-4ef9-af01-8adeace37d59\") " pod="openshift-ingress/e2e-worker-w4-f1f016-openshift-default-6c85499cc-7s68h"
Oct 30 20:02:24.526910 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:02:24.526885    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e32412d9-4dc9-4ef9-af01-8adeace37d59-istio-data\") pod \"e2e-worker-w4-f1f016-openshift-default-6c85499cc-7s68h\" (UID: \"e32412d9-4dc9-4ef9-af01-8adeace37d59\") " pod="openshift-ingress/e2e-worker-w4-f1f016-openshift-default-6c85499cc-7s68h"
Oct 30 20:02:24.527014 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:02:24.526986    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e32412d9-4dc9-4ef9-af01-8adeace37d59-workload-socket\") pod \"e2e-worker-w4-f1f016-openshift-default-6c85499cc-7s68h\" (UID: \"e32412d9-4dc9-4ef9-af01-8adeace37d59\") " pod="openshift-ingress/e2e-worker-w4-f1f016-openshift-default-6c85499cc-7s68h"
Oct 30 20:02:24.527134 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:02:24.527037    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e32412d9-4dc9-4ef9-af01-8adeace37d59-istiod-ca-cert\") pod \"e2e-worker-w4-f1f016-openshift-default-6c85499cc-7s68h\" (UID: \"e32412d9-4dc9-4ef9-af01-8adeace37d59\") " pod="openshift-ingress/e2e-worker-w4-f1f016-openshift-default-6c85499cc-7s68h"
Oct 30 20:02:24.527185 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:02:24.527155    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e32412d9-4dc9-4ef9-af01-8adeace37d59-credential-socket\") pod \"e2e-worker-w4-f1f016-openshift-default-6c85499cc-7s68h\" (UID: \"e32412d9-4dc9-4ef9-af01-8adeace37d59\") " pod="openshift-ingress/e2e-worker-w4-f1f016-openshift-default-6c85499cc-7s68h"
Oct 30 20:02:24.528896 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:02:24.528863    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e32412d9-4dc9-4ef9-af01-8adeace37d59-istio-envoy\") pod \"e2e-worker-w4-f1f016-openshift-default-6c85499cc-7s68h\" (UID: \"e32412d9-4dc9-4ef9-af01-8adeace37d59\") " pod="openshift-ingress/e2e-worker-w4-f1f016-openshift-default-6c85499cc-7s68h"
Oct 30 20:02:24.529052 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:02:24.529034    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e32412d9-4dc9-4ef9-af01-8adeace37d59-istio-podinfo\") pod \"e2e-worker-w4-f1f016-openshift-default-6c85499cc-7s68h\" (UID: \"e32412d9-4dc9-4ef9-af01-8adeace37d59\") " pod="openshift-ingress/e2e-worker-w4-f1f016-openshift-default-6c85499cc-7s68h"
Oct 30 20:02:24.554580 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:02:24.554553    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e32412d9-4dc9-4ef9-af01-8adeace37d59-istio-token\") pod \"e2e-worker-w4-f1f016-openshift-default-6c85499cc-7s68h\" (UID: \"e32412d9-4dc9-4ef9-af01-8adeace37d59\") " pod="openshift-ingress/e2e-worker-w4-f1f016-openshift-default-6c85499cc-7s68h"
Oct 30 20:02:24.558543 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:02:24.558521    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wxs7d\" (UniqueName: \"kubernetes.io/projected/e32412d9-4dc9-4ef9-af01-8adeace37d59-kube-api-access-wxs7d\") pod \"e2e-worker-w4-f1f016-openshift-default-6c85499cc-7s68h\" (UID: \"e32412d9-4dc9-4ef9-af01-8adeace37d59\") " pod="openshift-ingress/e2e-worker-w4-f1f016-openshift-default-6c85499cc-7s68h"
Oct 30 20:02:24.685516 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:02:24.685409    6275 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-f1f016-openshift-default-6c85499cc-7s68h"
Oct 30 20:02:24.748836 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:02:24.748799    6275 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w0-62f4a1-openshift-default-7fc84fbccc-xwj24"]
Oct 30 20:02:24.759702 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:02:24.759139    6275 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-62f4a1-openshift-default-7fc84fbccc-xwj24"
Oct 30 20:02:24.779263 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:02:24.778316    6275 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w0-62f4a1-openshift-default-dockercfg-hg55k\""
Oct 30 20:02:24.779750 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:02:24.779726    6275 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-62f4a1-openshift-default-7fc84fbccc-xwj24"]
Oct 30 20:02:24.829049 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:02:24.829019    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/943aa671-36e0-4eac-aa11-807858253698-workload-socket\") pod \"e2e-worker-w0-62f4a1-openshift-default-7fc84fbccc-xwj24\" (UID: \"943aa671-36e0-4eac-aa11-807858253698\") " pod="openshift-ingress/e2e-worker-w0-62f4a1-openshift-default-7fc84fbccc-xwj24"
Oct 30 20:02:24.829208 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:02:24.829092    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/943aa671-36e0-4eac-aa11-807858253698-credential-socket\") pod \"e2e-worker-w0-62f4a1-openshift-default-7fc84fbccc-xwj24\" (UID: \"943aa671-36e0-4eac-aa11-807858253698\") " pod="openshift-ingress/e2e-worker-w0-62f4a1-openshift-default-7fc84fbccc-xwj24"
Oct 30 20:02:24.829208 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:02:24.829136    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/943aa671-36e0-4eac-aa11-807858253698-istio-envoy\") pod \"e2e-worker-w0-62f4a1-openshift-default-7fc84fbccc-xwj24\" (UID: \"943aa671-36e0-4eac-aa11-807858253698\") " pod="openshift-ingress/e2e-worker-w0-62f4a1-openshift-default-7fc84fbccc-xwj24"
Oct 30 20:02:24.829302 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:02:24.829207    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/943aa671-36e0-4eac-aa11-807858253698-istiod-ca-cert\") pod \"e2e-worker-w0-62f4a1-openshift-default-7fc84fbccc-xwj24\" (UID: \"943aa671-36e0-4eac-aa11-807858253698\") " pod="openshift-ingress/e2e-worker-w0-62f4a1-openshift-default-7fc84fbccc-xwj24"
Oct 30 20:02:24.829302 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:02:24.829231    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/943aa671-36e0-4eac-aa11-807858253698-istio-podinfo\") pod \"e2e-worker-w0-62f4a1-openshift-default-7fc84fbccc-xwj24\" (UID: \"943aa671-36e0-4eac-aa11-807858253698\") " pod="openshift-ingress/e2e-worker-w0-62f4a1-openshift-default-7fc84fbccc-xwj24"
Oct 30 20:02:24.829302 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:02:24.829281    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/943aa671-36e0-4eac-aa11-807858253698-workload-certs\") pod \"e2e-worker-w0-62f4a1-openshift-default-7fc84fbccc-xwj24\" (UID: \"943aa671-36e0-4eac-aa11-807858253698\") " pod="openshift-ingress/e2e-worker-w0-62f4a1-openshift-default-7fc84fbccc-xwj24"
Oct 30 20:02:24.829438 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:02:24.829324    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/943aa671-36e0-4eac-aa11-807858253698-istio-data\") pod \"e2e-worker-w0-62f4a1-openshift-default-7fc84fbccc-xwj24\" (UID: \"943aa671-36e0-4eac-aa11-807858253698\") " pod="openshift-ingress/e2e-worker-w0-62f4a1-openshift-default-7fc84fbccc-xwj24"
Oct 30 20:02:24.829438 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:02:24.829351    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/943aa671-36e0-4eac-aa11-807858253698-istio-token\") pod \"e2e-worker-w0-62f4a1-openshift-default-7fc84fbccc-xwj24\" (UID: \"943aa671-36e0-4eac-aa11-807858253698\") " pod="openshift-ingress/e2e-worker-w0-62f4a1-openshift-default-7fc84fbccc-xwj24"
Oct 30 20:02:24.829438 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:02:24.829370    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sp2zn\" (UniqueName: \"kubernetes.io/projected/943aa671-36e0-4eac-aa11-807858253698-kube-api-access-sp2zn\") pod \"e2e-worker-w0-62f4a1-openshift-default-7fc84fbccc-xwj24\" (UID: \"943aa671-36e0-4eac-aa11-807858253698\") " pod="openshift-ingress/e2e-worker-w0-62f4a1-openshift-default-7fc84fbccc-xwj24"
Oct 30 20:02:24.931192 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:02:24.931159    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/943aa671-36e0-4eac-aa11-807858253698-credential-socket\") pod \"e2e-worker-w0-62f4a1-openshift-default-7fc84fbccc-xwj24\" (UID: \"943aa671-36e0-4eac-aa11-807858253698\") " pod="openshift-ingress/e2e-worker-w0-62f4a1-openshift-default-7fc84fbccc-xwj24"
Oct 30 20:02:24.931192 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:02:24.931194    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/943aa671-36e0-4eac-aa11-807858253698-istio-envoy\") pod \"e2e-worker-w0-62f4a1-openshift-default-7fc84fbccc-xwj24\" (UID: \"943aa671-36e0-4eac-aa11-807858253698\") " pod="openshift-ingress/e2e-worker-w0-62f4a1-openshift-default-7fc84fbccc-xwj24"
Oct 30 20:02:24.931528 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:02:24.931229    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/943aa671-36e0-4eac-aa11-807858253698-istiod-ca-cert\") pod \"e2e-worker-w0-62f4a1-openshift-default-7fc84fbccc-xwj24\" (UID: \"943aa671-36e0-4eac-aa11-807858253698\") " pod="openshift-ingress/e2e-worker-w0-62f4a1-openshift-default-7fc84fbccc-xwj24"
Oct 30 20:02:24.931528 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:02:24.931263    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/943aa671-36e0-4eac-aa11-807858253698-istio-podinfo\") pod \"e2e-worker-w0-62f4a1-openshift-default-7fc84fbccc-xwj24\" (UID: \"943aa671-36e0-4eac-aa11-807858253698\") " pod="openshift-ingress/e2e-worker-w0-62f4a1-openshift-default-7fc84fbccc-xwj24"
Oct 30 20:02:24.931528 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:02:24.931294    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/943aa671-36e0-4eac-aa11-807858253698-workload-certs\") pod \"e2e-worker-w0-62f4a1-openshift-default-7fc84fbccc-xwj24\" (UID: \"943aa671-36e0-4eac-aa11-807858253698\") " pod="openshift-ingress/e2e-worker-w0-62f4a1-openshift-default-7fc84fbccc-xwj24"
Oct 30 20:02:24.931528 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:02:24.931493    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/943aa671-36e0-4eac-aa11-807858253698-istio-data\") pod \"e2e-worker-w0-62f4a1-openshift-default-7fc84fbccc-xwj24\" (UID: \"943aa671-36e0-4eac-aa11-807858253698\") " pod="openshift-ingress/e2e-worker-w0-62f4a1-openshift-default-7fc84fbccc-xwj24"
Oct 30 20:02:24.931818 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:02:24.931534    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/943aa671-36e0-4eac-aa11-807858253698-istio-token\") pod \"e2e-worker-w0-62f4a1-openshift-default-7fc84fbccc-xwj24\" (UID: \"943aa671-36e0-4eac-aa11-807858253698\") " pod="openshift-ingress/e2e-worker-w0-62f4a1-openshift-default-7fc84fbccc-xwj24"
Oct 30 20:02:24.931818 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:02:24.931565    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sp2zn\" (UniqueName: \"kubernetes.io/projected/943aa671-36e0-4eac-aa11-807858253698-kube-api-access-sp2zn\") pod \"e2e-worker-w0-62f4a1-openshift-default-7fc84fbccc-xwj24\" (UID: \"943aa671-36e0-4eac-aa11-807858253698\") " pod="openshift-ingress/e2e-worker-w0-62f4a1-openshift-default-7fc84fbccc-xwj24"
Oct 30 20:02:24.931818 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:02:24.931666    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/943aa671-36e0-4eac-aa11-807858253698-workload-socket\") pod \"e2e-worker-w0-62f4a1-openshift-default-7fc84fbccc-xwj24\" (UID: \"943aa671-36e0-4eac-aa11-807858253698\") " pod="openshift-ingress/e2e-worker-w0-62f4a1-openshift-default-7fc84fbccc-xwj24"
Oct 30 20:02:24.931818 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:02:24.931798    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/943aa671-36e0-4eac-aa11-807858253698-credential-socket\") pod \"e2e-worker-w0-62f4a1-openshift-default-7fc84fbccc-xwj24\" (UID: \"943aa671-36e0-4eac-aa11-807858253698\") " pod="openshift-ingress/e2e-worker-w0-62f4a1-openshift-default-7fc84fbccc-xwj24"
Oct 30 20:02:24.932023 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:02:24.931842    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/943aa671-36e0-4eac-aa11-807858253698-istio-data\") pod \"e2e-worker-w0-62f4a1-openshift-default-7fc84fbccc-xwj24\" (UID: \"943aa671-36e0-4eac-aa11-807858253698\") " pod="openshift-ingress/e2e-worker-w0-62f4a1-openshift-default-7fc84fbccc-xwj24"
Oct 30 20:02:24.932077 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:02:24.932034    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/943aa671-36e0-4eac-aa11-807858253698-workload-certs\") pod \"e2e-worker-w0-62f4a1-openshift-default-7fc84fbccc-xwj24\" (UID: \"943aa671-36e0-4eac-aa11-807858253698\") " pod="openshift-ingress/e2e-worker-w0-62f4a1-openshift-default-7fc84fbccc-xwj24"
Oct 30 20:02:24.932077 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:02:24.932057    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/943aa671-36e0-4eac-aa11-807858253698-workload-socket\") pod \"e2e-worker-w0-62f4a1-openshift-default-7fc84fbccc-xwj24\" (UID: \"943aa671-36e0-4eac-aa11-807858253698\") " pod="openshift-ingress/e2e-worker-w0-62f4a1-openshift-default-7fc84fbccc-xwj24"
Oct 30 20:02:24.932183 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:02:24.932127    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/943aa671-36e0-4eac-aa11-807858253698-istiod-ca-cert\") pod \"e2e-worker-w0-62f4a1-openshift-default-7fc84fbccc-xwj24\" (UID: \"943aa671-36e0-4eac-aa11-807858253698\") " pod="openshift-ingress/e2e-worker-w0-62f4a1-openshift-default-7fc84fbccc-xwj24"
Oct 30 20:02:24.933736 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:02:24.933715    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/943aa671-36e0-4eac-aa11-807858253698-istio-envoy\") pod \"e2e-worker-w0-62f4a1-openshift-default-7fc84fbccc-xwj24\" (UID: \"943aa671-36e0-4eac-aa11-807858253698\") " pod="openshift-ingress/e2e-worker-w0-62f4a1-openshift-default-7fc84fbccc-xwj24"
Oct 30 20:02:24.933966 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:02:24.933946    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/943aa671-36e0-4eac-aa11-807858253698-istio-podinfo\") pod \"e2e-worker-w0-62f4a1-openshift-default-7fc84fbccc-xwj24\" (UID: \"943aa671-36e0-4eac-aa11-807858253698\") " pod="openshift-ingress/e2e-worker-w0-62f4a1-openshift-default-7fc84fbccc-xwj24"
Oct 30 20:02:24.958759 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:02:24.958708    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sp2zn\" (UniqueName: \"kubernetes.io/projected/943aa671-36e0-4eac-aa11-807858253698-kube-api-access-sp2zn\") pod \"e2e-worker-w0-62f4a1-openshift-default-7fc84fbccc-xwj24\" (UID: \"943aa671-36e0-4eac-aa11-807858253698\") " pod="openshift-ingress/e2e-worker-w0-62f4a1-openshift-default-7fc84fbccc-xwj24"
Oct 30 20:02:24.958759 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:02:24.958735    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/943aa671-36e0-4eac-aa11-807858253698-istio-token\") pod \"e2e-worker-w0-62f4a1-openshift-default-7fc84fbccc-xwj24\" (UID: \"943aa671-36e0-4eac-aa11-807858253698\") " pod="openshift-ingress/e2e-worker-w0-62f4a1-openshift-default-7fc84fbccc-xwj24"
Oct 30 20:02:25.012082 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:02:25.012055    6275 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-f1f016-openshift-default-6c85499cc-7s68h"]
Oct 30 20:02:25.012503 ip-10-0-131-26 kubenswrapper[6275]: W1030 20:02:25.012477    6275 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode32412d9_4dc9_4ef9_af01_8adeace37d59.slice/crio-1d302c0c890e29c4cc7162193541cbb520ac4dd80b021f7f1f7b556020afa9b1 WatchSource:0}: Error finding container 1d302c0c890e29c4cc7162193541cbb520ac4dd80b021f7f1f7b556020afa9b1: Status 404 returned error can't find the container with id 1d302c0c890e29c4cc7162193541cbb520ac4dd80b021f7f1f7b556020afa9b1
Oct 30 20:02:25.014923 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:02:25.014888    6275 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Oct 30 20:02:25.014996 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:02:25.014955    6275 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Oct 30 20:02:25.014996 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:02:25.014983    6275 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Oct 30 20:02:25.081016 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:02:25.080993    6275 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-62f4a1-openshift-default-7fc84fbccc-xwj24"
Oct 30 20:02:25.414862 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:02:25.413772    6275 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-62f4a1-openshift-default-7fc84fbccc-xwj24"]
Oct 30 20:02:25.416007 ip-10-0-131-26 kubenswrapper[6275]: W1030 20:02:25.415978    6275 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod943aa671_36e0_4eac_aa11_807858253698.slice/crio-c4f7daf1eb112aef13d4ed57ced80efab87f18b4f93ebd8ecfac1a6b81ded160 WatchSource:0}: Error finding container c4f7daf1eb112aef13d4ed57ced80efab87f18b4f93ebd8ecfac1a6b81ded160: Status 404 returned error can't find the container with id c4f7daf1eb112aef13d4ed57ced80efab87f18b4f93ebd8ecfac1a6b81ded160
Oct 30 20:02:25.419025 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:02:25.418987    6275 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Oct 30 20:02:25.419117 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:02:25.419065    6275 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Oct 30 20:02:25.419185 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:02:25.419112    6275 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Oct 30 20:02:25.898574 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:02:25.896382    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-f1f016-openshift-default-6c85499cc-7s68h" event={"ID":"e32412d9-4dc9-4ef9-af01-8adeace37d59","Type":"ContainerStarted","Data":"3e2700b73e6208967d178bac1a4f5b1e8a32d28b1fb789d99d062ac49d8ae7ec"}
Oct 30 20:02:25.898574 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:02:25.896513    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-f1f016-openshift-default-6c85499cc-7s68h" event={"ID":"e32412d9-4dc9-4ef9-af01-8adeace37d59","Type":"ContainerStarted","Data":"1d302c0c890e29c4cc7162193541cbb520ac4dd80b021f7f1f7b556020afa9b1"}
Oct 30 20:02:25.899536 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:02:25.899507    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-62f4a1-openshift-default-7fc84fbccc-xwj24" event={"ID":"943aa671-36e0-4eac-aa11-807858253698","Type":"ContainerStarted","Data":"9bd76bf6ce477ec797390390994793f4ca0b9509fb530fba3ebdd3cc3387aa30"}
Oct 30 20:02:25.899647 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:02:25.899559    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-62f4a1-openshift-default-7fc84fbccc-xwj24" event={"ID":"943aa671-36e0-4eac-aa11-807858253698","Type":"ContainerStarted","Data":"c4f7daf1eb112aef13d4ed57ced80efab87f18b4f93ebd8ecfac1a6b81ded160"}
Oct 30 20:02:25.956923 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:02:25.956870    6275 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w4-f1f016-openshift-default-6c85499cc-7s68h" podStartSLOduration=1.956854738 podStartE2EDuration="1.956854738s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:02:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:02:25.953498525 +0000 UTC m=+856.415225388" watchObservedRunningTime="2026-10-30 20:02:25.956854738 +0000 UTC m=+856.418581600"
Oct 30 20:02:26.048670 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:02:26.048619    6275 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w0-62f4a1-openshift-default-7fc84fbccc-xwj24" podStartSLOduration=2.048603482 podStartE2EDuration="2.048603482s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:02:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:02:26.045834644 +0000 UTC m=+856.507561519" watchObservedRunningTime="2026-10-30 20:02:26.048603482 +0000 UTC m=+856.510330344"
Oct 30 20:02:26.093742 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:02:26.089837    6275 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w0-62f4a1-openshift-default-7fc84fbccc-xwj24"
Oct 30 20:02:26.099663 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:02:26.099544    6275 patch_prober.go:29] interesting pod/e2e-worker-w0-62f4a1-openshift-default-7fc84fbccc-xwj24 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused" start-of-body=
Oct 30 20:02:26.099663 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:02:26.099606    6275 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-62f4a1-openshift-default-7fc84fbccc-xwj24" podUID="943aa671-36e0-4eac-aa11-807858253698" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused"
Oct 30 20:02:26.256394 ip-10-0-131-26 kubenswrapper[6275]: E1030 20:02:26.256354    6275 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-fwc77" containerName="extractor"
Oct 30 20:02:26.687590 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:02:26.685732    6275 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w4-f1f016-openshift-default-6c85499cc-7s68h"
Oct 30 20:02:26.689851 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:02:26.689819    6275 patch_prober.go:29] interesting pod/e2e-worker-w4-f1f016-openshift-default-6c85499cc-7s68h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused" start-of-body=
Oct 30 20:02:26.690073 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:02:26.690038    6275 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-f1f016-openshift-default-6c85499cc-7s68h" podUID="e32412d9-4dc9-4ef9-af01-8adeace37d59" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused"
Oct 30 20:02:27.085440 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:02:27.084771    6275 patch_prober.go:29] interesting pod/e2e-worker-w0-62f4a1-openshift-default-7fc84fbccc-xwj24 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused" start-of-body=
Oct 30 20:02:27.085440 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:02:27.084832    6275 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-62f4a1-openshift-default-7fc84fbccc-xwj24" podUID="943aa671-36e0-4eac-aa11-807858253698" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused"
Oct 30 20:02:27.686027 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:02:27.685981    6275 patch_prober.go:29] interesting pod/e2e-worker-w4-f1f016-openshift-default-6c85499cc-7s68h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused" start-of-body=
Oct 30 20:02:27.686353 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:02:27.686308    6275 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-f1f016-openshift-default-6c85499cc-7s68h" podUID="e32412d9-4dc9-4ef9-af01-8adeace37d59" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused"
Oct 30 20:02:28.082439 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:02:28.081871    6275 patch_prober.go:29] interesting pod/e2e-worker-w0-62f4a1-openshift-default-7fc84fbccc-xwj24 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused" start-of-body=
Oct 30 20:02:28.082439 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:02:28.081946    6275 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-62f4a1-openshift-default-7fc84fbccc-xwj24" podUID="943aa671-36e0-4eac-aa11-807858253698" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused"
Oct 30 20:02:28.690441 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:02:28.687022    6275 patch_prober.go:29] interesting pod/e2e-worker-w4-f1f016-openshift-default-6c85499cc-7s68h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused" start-of-body=
Oct 30 20:02:28.690441 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:02:28.687082    6275 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-f1f016-openshift-default-6c85499cc-7s68h" podUID="e32412d9-4dc9-4ef9-af01-8adeace37d59" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused"
Oct 30 20:02:29.083894 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:02:29.083847    6275 patch_prober.go:29] interesting pod/e2e-worker-w0-62f4a1-openshift-default-7fc84fbccc-xwj24 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused" start-of-body=
Oct 30 20:02:29.084515 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:02:29.084475    6275 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-62f4a1-openshift-default-7fc84fbccc-xwj24" podUID="943aa671-36e0-4eac-aa11-807858253698" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused"
Oct 30 20:02:29.699440 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:02:29.694512    6275 patch_prober.go:29] interesting pod/e2e-worker-w4-f1f016-openshift-default-6c85499cc-7s68h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused" start-of-body=
Oct 30 20:02:29.699440 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:02:29.694588    6275 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-f1f016-openshift-default-6c85499cc-7s68h" podUID="e32412d9-4dc9-4ef9-af01-8adeace37d59" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused"
Oct 30 20:02:30.113437 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:02:30.096823    6275 patch_prober.go:29] interesting pod/e2e-worker-w0-62f4a1-openshift-default-7fc84fbccc-xwj24 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused" start-of-body=
Oct 30 20:02:30.113437 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:02:30.096887    6275 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-62f4a1-openshift-default-7fc84fbccc-xwj24" podUID="943aa671-36e0-4eac-aa11-807858253698" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused"
Oct 30 20:02:30.689439 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:02:30.688796    6275 patch_prober.go:29] interesting pod/e2e-worker-w4-f1f016-openshift-default-6c85499cc-7s68h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused" start-of-body=
Oct 30 20:02:30.689439 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:02:30.688859    6275 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-f1f016-openshift-default-6c85499cc-7s68h" podUID="e32412d9-4dc9-4ef9-af01-8adeace37d59" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused"
Oct 30 20:02:31.084251 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:02:31.083786    6275 patch_prober.go:29] interesting pod/e2e-worker-w0-62f4a1-openshift-default-7fc84fbccc-xwj24 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused" start-of-body=
Oct 30 20:02:31.084251 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:02:31.083861    6275 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-62f4a1-openshift-default-7fc84fbccc-xwj24" podUID="943aa671-36e0-4eac-aa11-807858253698" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused"
Oct 30 20:02:31.993079 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:02:31.993033    6275 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w4-f1f016-openshift-default-6c85499cc-7s68h"
Oct 30 20:02:31.993821 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:02:31.993791    6275 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w4-f1f016-openshift-default-6c85499cc-7s68h"
Oct 30 20:02:31.996495 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:02:31.996469    6275 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w4-f1f016-openshift-default-6c85499cc-7s68h"
Oct 30 20:02:32.081553 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:02:32.081516    6275 patch_prober.go:29] interesting pod/e2e-worker-w0-62f4a1-openshift-default-7fc84fbccc-xwj24 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused" start-of-body=
Oct 30 20:02:32.081742 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:02:32.081566    6275 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-62f4a1-openshift-default-7fc84fbccc-xwj24" podUID="943aa671-36e0-4eac-aa11-807858253698" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused"
Oct 30 20:02:33.086162 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:02:33.086131    6275 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w0-62f4a1-openshift-default-7fc84fbccc-xwj24"
Oct 30 20:02:33.086547 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:02:33.086521    6275 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w0-62f4a1-openshift-default-7fc84fbccc-xwj24"
Oct 30 20:02:33.087137 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:02:33.087116    6275 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w0-62f4a1-openshift-default-7fc84fbccc-xwj24"
Oct 30 20:02:33.342212 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:02:33.342136    6275 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-42d7cdd3-rznq7"]
Oct 30 20:02:33.346426 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:02:33.346393    6275 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-42d7cdd3-rznq7"
Oct 30 20:02:33.364485 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:02:33.364458    6275 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\""
Oct 30 20:02:33.364628 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:02:33.364547    6275 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-scs2w\""
Oct 30 20:02:33.366633 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:02:33.366610    6275 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-42d7cdd3-rznq7"]
Oct 30 20:02:33.469927 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:02:33.469890    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d62jb\" (UniqueName: \"kubernetes.io/projected/33637d8a-827f-4aa1-8920-88dba99cb546-kube-api-access-d62jb\") pod \"maas-api-revoke-sub-42d7cdd3-rznq7\" (UID: \"33637d8a-827f-4aa1-8920-88dba99cb546\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-42d7cdd3-rznq7"
Oct 30 20:02:33.470091 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:02:33.470004    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/33637d8a-827f-4aa1-8920-88dba99cb546-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-42d7cdd3-rznq7\" (UID: \"33637d8a-827f-4aa1-8920-88dba99cb546\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-42d7cdd3-rznq7"
Oct 30 20:02:33.470091 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:02:33.470064    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/33637d8a-827f-4aa1-8920-88dba99cb546-maas-api-xks-ca\") pod \"maas-api-revoke-sub-42d7cdd3-rznq7\" (UID: \"33637d8a-827f-4aa1-8920-88dba99cb546\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-42d7cdd3-rznq7"
Oct 30 20:02:33.571197 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:02:33.571162    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d62jb\" (UniqueName: \"kubernetes.io/projected/33637d8a-827f-4aa1-8920-88dba99cb546-kube-api-access-d62jb\") pod \"maas-api-revoke-sub-42d7cdd3-rznq7\" (UID: \"33637d8a-827f-4aa1-8920-88dba99cb546\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-42d7cdd3-rznq7"
Oct 30 20:02:33.571388 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:02:33.571217    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/33637d8a-827f-4aa1-8920-88dba99cb546-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-42d7cdd3-rznq7\" (UID: \"33637d8a-827f-4aa1-8920-88dba99cb546\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-42d7cdd3-rznq7"
Oct 30 20:02:33.571388 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:02:33.571253    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/33637d8a-827f-4aa1-8920-88dba99cb546-maas-api-xks-ca\") pod \"maas-api-revoke-sub-42d7cdd3-rznq7\" (UID: \"33637d8a-827f-4aa1-8920-88dba99cb546\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-42d7cdd3-rznq7"
Oct 30 20:02:33.572012 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:02:33.571983    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/33637d8a-827f-4aa1-8920-88dba99cb546-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-42d7cdd3-rznq7\" (UID: \"33637d8a-827f-4aa1-8920-88dba99cb546\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-42d7cdd3-rznq7"
Oct 30 20:02:33.573675 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:02:33.573653    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/33637d8a-827f-4aa1-8920-88dba99cb546-maas-api-xks-ca\") pod \"maas-api-revoke-sub-42d7cdd3-rznq7\" (UID: \"33637d8a-827f-4aa1-8920-88dba99cb546\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-42d7cdd3-rznq7"
Oct 30 20:02:33.597009 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:02:33.596959    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d62jb\" (UniqueName: \"kubernetes.io/projected/33637d8a-827f-4aa1-8920-88dba99cb546-kube-api-access-d62jb\") pod \"maas-api-revoke-sub-42d7cdd3-rznq7\" (UID: \"33637d8a-827f-4aa1-8920-88dba99cb546\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-42d7cdd3-rznq7"
Oct 30 20:02:33.661718 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:02:33.661696    6275 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-42d7cdd3-rznq7"
Oct 30 20:02:33.976559 ip-10-0-131-26 kubenswrapper[6275]: W1030 20:02:33.976530    6275 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod33637d8a_827f_4aa1_8920_88dba99cb546.slice/crio-344b0c6476373742d17dd9516b6dd9e21c79c04332c824efabb3c582303123e7 WatchSource:0}: Error finding container 344b0c6476373742d17dd9516b6dd9e21c79c04332c824efabb3c582303123e7: Status 404 returned error can't find the container with id 344b0c6476373742d17dd9516b6dd9e21c79c04332c824efabb3c582303123e7
Oct 30 20:02:33.976920 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:02:33.976899    6275 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-42d7cdd3-rznq7"]
Oct 30 20:02:35.027438 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:02:35.026470    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-42d7cdd3-rznq7" event={"ID":"33637d8a-827f-4aa1-8920-88dba99cb546","Type":"ContainerStarted","Data":"344b0c6476373742d17dd9516b6dd9e21c79c04332c824efabb3c582303123e7"}
Oct 30 20:02:37.042638 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:02:37.042604    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-42d7cdd3-rznq7" event={"ID":"33637d8a-827f-4aa1-8920-88dba99cb546","Type":"ContainerStarted","Data":"33662fc27dc5bb65c7357ae7c20ce21878404aa91f6d106390a4608942c84ec4"}
Oct 30 20:02:37.086399 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:02:37.086330    6275 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-sub-42d7cdd3-rznq7" podStartSLOduration=1.493741596 podStartE2EDuration="4.086315473s" totalImagesPullingTime="2.592573877s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:02:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:02:37.086118407 +0000 UTC m=+867.547845284" watchObservedRunningTime="2026-10-30 20:02:37.086315473 +0000 UTC m=+867.548042339"
Oct 30 20:02:38.049552 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:02:38.049511    6275 generic.go:356] "Generic (PLEG): container finished" podID="33637d8a-827f-4aa1-8920-88dba99cb546" containerID="33662fc27dc5bb65c7357ae7c20ce21878404aa91f6d106390a4608942c84ec4" exitCode=0
Oct 30 20:02:38.049552 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:02:38.049552    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-42d7cdd3-rznq7" event={"ID":"33637d8a-827f-4aa1-8920-88dba99cb546","Type":"ContainerDied","Data":"33662fc27dc5bb65c7357ae7c20ce21878404aa91f6d106390a4608942c84ec4"}
Oct 30 20:02:39.190477 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:02:39.190453    6275 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-42d7cdd3-rznq7"
Oct 30 20:02:39.277492 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:02:39.277459    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/33637d8a-827f-4aa1-8920-88dba99cb546-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/33637d8a-827f-4aa1-8920-88dba99cb546-maas-api-xks-ca\") pod \"33637d8a-827f-4aa1-8920-88dba99cb546\" (UID: \"33637d8a-827f-4aa1-8920-88dba99cb546\") "
Oct 30 20:02:39.277634 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:02:39.277513    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/33637d8a-827f-4aa1-8920-88dba99cb546-kube-api-access-d62jb\" (UniqueName: \"kubernetes.io/projected/33637d8a-827f-4aa1-8920-88dba99cb546-kube-api-access-d62jb\") pod \"33637d8a-827f-4aa1-8920-88dba99cb546\" (UID: \"33637d8a-827f-4aa1-8920-88dba99cb546\") "
Oct 30 20:02:39.277634 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:02:39.277558    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/33637d8a-827f-4aa1-8920-88dba99cb546-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/33637d8a-827f-4aa1-8920-88dba99cb546-maas-api-openshift-ca\") pod \"33637d8a-827f-4aa1-8920-88dba99cb546\" (UID: \"33637d8a-827f-4aa1-8920-88dba99cb546\") "
Oct 30 20:02:39.277984 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:02:39.277955    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/33637d8a-827f-4aa1-8920-88dba99cb546-maas-api-openshift-ca" pod "33637d8a-827f-4aa1-8920-88dba99cb546" (UID: "33637d8a-827f-4aa1-8920-88dba99cb546"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:02:39.279841 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:02:39.279815    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/33637d8a-827f-4aa1-8920-88dba99cb546-maas-api-xks-ca" pod "33637d8a-827f-4aa1-8920-88dba99cb546" (UID: "33637d8a-827f-4aa1-8920-88dba99cb546"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 20:02:39.279841 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:02:39.279821    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/33637d8a-827f-4aa1-8920-88dba99cb546-kube-api-access-d62jb" pod "33637d8a-827f-4aa1-8920-88dba99cb546" (UID: "33637d8a-827f-4aa1-8920-88dba99cb546"). InnerVolumeSpecName "kube-api-access-d62jb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:02:39.378763 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:02:39.378675    6275 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/33637d8a-827f-4aa1-8920-88dba99cb546-maas-api-xks-ca\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:02:39.378763 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:02:39.378705    6275 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d62jb\" (UniqueName: \"kubernetes.io/projected/33637d8a-827f-4aa1-8920-88dba99cb546-kube-api-access-d62jb\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:02:39.378763 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:02:39.378718    6275 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/33637d8a-827f-4aa1-8920-88dba99cb546-maas-api-openshift-ca\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:02:40.064396 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:02:40.064361    6275 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-42d7cdd3-rznq7"
Oct 30 20:02:40.064396 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:02:40.064381    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-42d7cdd3-rznq7" event={"ID":"33637d8a-827f-4aa1-8920-88dba99cb546","Type":"ContainerDied","Data":"344b0c6476373742d17dd9516b6dd9e21c79c04332c824efabb3c582303123e7"}
Oct 30 20:02:40.064630 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:02:40.064480    6275 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="344b0c6476373742d17dd9516b6dd9e21c79c04332c824efabb3c582303123e7"
Oct 30 20:02:45.096219 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:02:45.096187    6275 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-91bd96a0-nvrh5"]
Oct 30 20:02:45.096790 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:02:45.096773    6275 cpu_manager.go:414] "containerMap: removing container" podUID="33637d8a-827f-4aa1-8920-88dba99cb546" containerName="revoke-keys"
Oct 30 20:02:45.096844 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:02:45.096790    6275 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="33637d8a-827f-4aa1-8920-88dba99cb546" containerName="revoke-keys"
Oct 30 20:02:45.097434 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:02:45.097394    6275 memory_manager.go:365] "RemoveStaleState removing state" podUID="33637d8a-827f-4aa1-8920-88dba99cb546" containerName="revoke-keys"
Oct 30 20:02:45.105820 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:02:45.105788    6275 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-91bd96a0-nvrh5"
Oct 30 20:02:45.121004 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:02:45.120975    6275 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-91bd96a0-nvrh5"]
Oct 30 20:02:45.130124 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:02:45.130102    6275 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\""
Oct 30 20:02:45.130124 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:02:45.130105    6275 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-scs2w\""
Oct 30 20:02:45.241651 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:02:45.241625    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/2bfb097e-80f9-4b22-9b57-420533197d3e-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-91bd96a0-nvrh5\" (UID: \"2bfb097e-80f9-4b22-9b57-420533197d3e\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-91bd96a0-nvrh5"
Oct 30 20:02:45.241808 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:02:45.241676    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lfqh6\" (UniqueName: \"kubernetes.io/projected/2bfb097e-80f9-4b22-9b57-420533197d3e-kube-api-access-lfqh6\") pod \"maas-api-revoke-sub-91bd96a0-nvrh5\" (UID: \"2bfb097e-80f9-4b22-9b57-420533197d3e\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-91bd96a0-nvrh5"
Oct 30 20:02:45.241855 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:02:45.241803    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/2bfb097e-80f9-4b22-9b57-420533197d3e-maas-api-xks-ca\") pod \"maas-api-revoke-sub-91bd96a0-nvrh5\" (UID: \"2bfb097e-80f9-4b22-9b57-420533197d3e\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-91bd96a0-nvrh5"
Oct 30 20:02:45.342517 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:02:45.342478    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/2bfb097e-80f9-4b22-9b57-420533197d3e-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-91bd96a0-nvrh5\" (UID: \"2bfb097e-80f9-4b22-9b57-420533197d3e\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-91bd96a0-nvrh5"
Oct 30 20:02:45.342708 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:02:45.342546    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lfqh6\" (UniqueName: \"kubernetes.io/projected/2bfb097e-80f9-4b22-9b57-420533197d3e-kube-api-access-lfqh6\") pod \"maas-api-revoke-sub-91bd96a0-nvrh5\" (UID: \"2bfb097e-80f9-4b22-9b57-420533197d3e\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-91bd96a0-nvrh5"
Oct 30 20:02:45.342708 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:02:45.342628    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/2bfb097e-80f9-4b22-9b57-420533197d3e-maas-api-xks-ca\") pod \"maas-api-revoke-sub-91bd96a0-nvrh5\" (UID: \"2bfb097e-80f9-4b22-9b57-420533197d3e\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-91bd96a0-nvrh5"
Oct 30 20:02:45.343183 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:02:45.343154    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/2bfb097e-80f9-4b22-9b57-420533197d3e-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-91bd96a0-nvrh5\" (UID: \"2bfb097e-80f9-4b22-9b57-420533197d3e\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-91bd96a0-nvrh5"
Oct 30 20:02:45.344845 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:02:45.344818    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/2bfb097e-80f9-4b22-9b57-420533197d3e-maas-api-xks-ca\") pod \"maas-api-revoke-sub-91bd96a0-nvrh5\" (UID: \"2bfb097e-80f9-4b22-9b57-420533197d3e\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-91bd96a0-nvrh5"
Oct 30 20:02:45.368513 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:02:45.368460    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lfqh6\" (UniqueName: \"kubernetes.io/projected/2bfb097e-80f9-4b22-9b57-420533197d3e-kube-api-access-lfqh6\") pod \"maas-api-revoke-sub-91bd96a0-nvrh5\" (UID: \"2bfb097e-80f9-4b22-9b57-420533197d3e\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-91bd96a0-nvrh5"
Oct 30 20:02:45.422613 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:02:45.422581    6275 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-91bd96a0-nvrh5"
Oct 30 20:02:45.730883 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:02:45.730854    6275 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-91bd96a0-nvrh5"]
Oct 30 20:02:45.731435 ip-10-0-131-26 kubenswrapper[6275]: W1030 20:02:45.731390    6275 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2bfb097e_80f9_4b22_9b57_420533197d3e.slice/crio-26b1aae3900e95c0886d2105bb2a111532957f24cc44a5b713e8801cb902fdac WatchSource:0}: Error finding container 26b1aae3900e95c0886d2105bb2a111532957f24cc44a5b713e8801cb902fdac: Status 404 returned error can't find the container with id 26b1aae3900e95c0886d2105bb2a111532957f24cc44a5b713e8801cb902fdac
Oct 30 20:02:46.116029 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:02:46.115992    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-91bd96a0-nvrh5" event={"ID":"2bfb097e-80f9-4b22-9b57-420533197d3e","Type":"ContainerStarted","Data":"f5dd9096c7d76229c4e3873090d5b4eebc2520219628c5d54b7ed3663bce31e7"}
Oct 30 20:02:46.116534 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:02:46.116062    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-91bd96a0-nvrh5" event={"ID":"2bfb097e-80f9-4b22-9b57-420533197d3e","Type":"ContainerStarted","Data":"26b1aae3900e95c0886d2105bb2a111532957f24cc44a5b713e8801cb902fdac"}
Oct 30 20:02:46.160976 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:02:46.160921    6275 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-sub-91bd96a0-nvrh5" podStartSLOduration=1.160908833 podStartE2EDuration="1.160908833s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:02:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:02:46.159658751 +0000 UTC m=+876.621385616" watchObservedRunningTime="2026-10-30 20:02:46.160908833 +0000 UTC m=+876.622635696"
Oct 30 20:02:47.124221 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:02:47.124186    6275 generic.go:356] "Generic (PLEG): container finished" podID="2bfb097e-80f9-4b22-9b57-420533197d3e" containerID="f5dd9096c7d76229c4e3873090d5b4eebc2520219628c5d54b7ed3663bce31e7" exitCode=0
Oct 30 20:02:47.124663 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:02:47.124260    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-91bd96a0-nvrh5" event={"ID":"2bfb097e-80f9-4b22-9b57-420533197d3e","Type":"ContainerDied","Data":"f5dd9096c7d76229c4e3873090d5b4eebc2520219628c5d54b7ed3663bce31e7"}
Oct 30 20:02:48.278697 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:02:48.278672    6275 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-91bd96a0-nvrh5"
Oct 30 20:02:48.376399 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:02:48.376357    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/2bfb097e-80f9-4b22-9b57-420533197d3e-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/2bfb097e-80f9-4b22-9b57-420533197d3e-maas-api-xks-ca\") pod \"2bfb097e-80f9-4b22-9b57-420533197d3e\" (UID: \"2bfb097e-80f9-4b22-9b57-420533197d3e\") "
Oct 30 20:02:48.376605 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:02:48.376537    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/2bfb097e-80f9-4b22-9b57-420533197d3e-kube-api-access-lfqh6\" (UniqueName: \"kubernetes.io/projected/2bfb097e-80f9-4b22-9b57-420533197d3e-kube-api-access-lfqh6\") pod \"2bfb097e-80f9-4b22-9b57-420533197d3e\" (UID: \"2bfb097e-80f9-4b22-9b57-420533197d3e\") "
Oct 30 20:02:48.376605 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:02:48.376587    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/2bfb097e-80f9-4b22-9b57-420533197d3e-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/2bfb097e-80f9-4b22-9b57-420533197d3e-maas-api-openshift-ca\") pod \"2bfb097e-80f9-4b22-9b57-420533197d3e\" (UID: \"2bfb097e-80f9-4b22-9b57-420533197d3e\") "
Oct 30 20:02:48.377159 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:02:48.377114    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2bfb097e-80f9-4b22-9b57-420533197d3e-maas-api-openshift-ca" pod "2bfb097e-80f9-4b22-9b57-420533197d3e" (UID: "2bfb097e-80f9-4b22-9b57-420533197d3e"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:02:48.378955 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:02:48.378932    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2bfb097e-80f9-4b22-9b57-420533197d3e-maas-api-xks-ca" pod "2bfb097e-80f9-4b22-9b57-420533197d3e" (UID: "2bfb097e-80f9-4b22-9b57-420533197d3e"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 20:02:48.379477 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:02:48.379452    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2bfb097e-80f9-4b22-9b57-420533197d3e-kube-api-access-lfqh6" pod "2bfb097e-80f9-4b22-9b57-420533197d3e" (UID: "2bfb097e-80f9-4b22-9b57-420533197d3e"). InnerVolumeSpecName "kube-api-access-lfqh6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:02:48.478103 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:02:48.478068    6275 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lfqh6\" (UniqueName: \"kubernetes.io/projected/2bfb097e-80f9-4b22-9b57-420533197d3e-kube-api-access-lfqh6\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:02:48.478103 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:02:48.478098    6275 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/2bfb097e-80f9-4b22-9b57-420533197d3e-maas-api-openshift-ca\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:02:48.478103 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:02:48.478109    6275 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/2bfb097e-80f9-4b22-9b57-420533197d3e-maas-api-xks-ca\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:02:49.106478 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:02:49.106443    6275 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-6a61c2b0-vfmpd"]
Oct 30 20:02:49.106967 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:02:49.106954    6275 cpu_manager.go:414] "containerMap: removing container" podUID="2bfb097e-80f9-4b22-9b57-420533197d3e" containerName="revoke-keys"
Oct 30 20:02:49.107011 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:02:49.106968    6275 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="2bfb097e-80f9-4b22-9b57-420533197d3e" containerName="revoke-keys"
Oct 30 20:02:49.107079 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:02:49.107068    6275 memory_manager.go:365] "RemoveStaleState removing state" podUID="2bfb097e-80f9-4b22-9b57-420533197d3e" containerName="revoke-keys"
Oct 30 20:02:49.110515 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:02:49.110496    6275 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-6a61c2b0-vfmpd"
Oct 30 20:02:49.131909 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:02:49.131882    6275 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-6a61c2b0-vfmpd"]
Oct 30 20:02:49.138843 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:02:49.138819    6275 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-91bd96a0-nvrh5"
Oct 30 20:02:49.138843 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:02:49.138832    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-91bd96a0-nvrh5" event={"ID":"2bfb097e-80f9-4b22-9b57-420533197d3e","Type":"ContainerDied","Data":"26b1aae3900e95c0886d2105bb2a111532957f24cc44a5b713e8801cb902fdac"}
Oct 30 20:02:49.139070 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:02:49.138880    6275 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="26b1aae3900e95c0886d2105bb2a111532957f24cc44a5b713e8801cb902fdac"
Oct 30 20:02:49.186312 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:02:49.186286    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/96008440-649e-42fe-ac7a-9746bc327f0d-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-6a61c2b0-vfmpd\" (UID: \"96008440-649e-42fe-ac7a-9746bc327f0d\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-6a61c2b0-vfmpd"
Oct 30 20:02:49.186445 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:02:49.186320    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rt5kr\" (UniqueName: \"kubernetes.io/projected/96008440-649e-42fe-ac7a-9746bc327f0d-kube-api-access-rt5kr\") pod \"maas-api-revoke-sub-6a61c2b0-vfmpd\" (UID: \"96008440-649e-42fe-ac7a-9746bc327f0d\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-6a61c2b0-vfmpd"
Oct 30 20:02:49.186445 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:02:49.186394    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/96008440-649e-42fe-ac7a-9746bc327f0d-maas-api-xks-ca\") pod \"maas-api-revoke-sub-6a61c2b0-vfmpd\" (UID: \"96008440-649e-42fe-ac7a-9746bc327f0d\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-6a61c2b0-vfmpd"
Oct 30 20:02:49.287698 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:02:49.287660    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/96008440-649e-42fe-ac7a-9746bc327f0d-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-6a61c2b0-vfmpd\" (UID: \"96008440-649e-42fe-ac7a-9746bc327f0d\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-6a61c2b0-vfmpd"
Oct 30 20:02:49.288152 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:02:49.287718    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rt5kr\" (UniqueName: \"kubernetes.io/projected/96008440-649e-42fe-ac7a-9746bc327f0d-kube-api-access-rt5kr\") pod \"maas-api-revoke-sub-6a61c2b0-vfmpd\" (UID: \"96008440-649e-42fe-ac7a-9746bc327f0d\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-6a61c2b0-vfmpd"
Oct 30 20:02:49.288152 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:02:49.287803    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/96008440-649e-42fe-ac7a-9746bc327f0d-maas-api-xks-ca\") pod \"maas-api-revoke-sub-6a61c2b0-vfmpd\" (UID: \"96008440-649e-42fe-ac7a-9746bc327f0d\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-6a61c2b0-vfmpd"
Oct 30 20:02:49.288619 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:02:49.288574    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/96008440-649e-42fe-ac7a-9746bc327f0d-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-6a61c2b0-vfmpd\" (UID: \"96008440-649e-42fe-ac7a-9746bc327f0d\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-6a61c2b0-vfmpd"
Oct 30 20:02:49.290466 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:02:49.290444    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/96008440-649e-42fe-ac7a-9746bc327f0d-maas-api-xks-ca\") pod \"maas-api-revoke-sub-6a61c2b0-vfmpd\" (UID: \"96008440-649e-42fe-ac7a-9746bc327f0d\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-6a61c2b0-vfmpd"
Oct 30 20:02:49.312454 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:02:49.312433    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rt5kr\" (UniqueName: \"kubernetes.io/projected/96008440-649e-42fe-ac7a-9746bc327f0d-kube-api-access-rt5kr\") pod \"maas-api-revoke-sub-6a61c2b0-vfmpd\" (UID: \"96008440-649e-42fe-ac7a-9746bc327f0d\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-6a61c2b0-vfmpd"
Oct 30 20:02:49.424781 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:02:49.424707    6275 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-6a61c2b0-vfmpd"
Oct 30 20:02:49.728921 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:02:49.728891    6275 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-6a61c2b0-vfmpd"]
Oct 30 20:02:49.729368 ip-10-0-131-26 kubenswrapper[6275]: W1030 20:02:49.729338    6275 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod96008440_649e_42fe_ac7a_9746bc327f0d.slice/crio-c665c922c20c42236f81d483e1fa1faff383208caf7a238f7bdcd16347fe46e3 WatchSource:0}: Error finding container c665c922c20c42236f81d483e1fa1faff383208caf7a238f7bdcd16347fe46e3: Status 404 returned error can't find the container with id c665c922c20c42236f81d483e1fa1faff383208caf7a238f7bdcd16347fe46e3
Oct 30 20:02:50.146235 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:02:50.146204    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-6a61c2b0-vfmpd" event={"ID":"96008440-649e-42fe-ac7a-9746bc327f0d","Type":"ContainerStarted","Data":"9f79166d8ef4adb09cc287afd675ad768518add6f17583a4990f230a7fce8a00"}
Oct 30 20:02:50.146444 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:02:50.146255    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-6a61c2b0-vfmpd" event={"ID":"96008440-649e-42fe-ac7a-9746bc327f0d","Type":"ContainerStarted","Data":"c665c922c20c42236f81d483e1fa1faff383208caf7a238f7bdcd16347fe46e3"}
Oct 30 20:02:50.204117 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:02:50.204071    6275 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-sub-6a61c2b0-vfmpd" podStartSLOduration=1.20405914 podStartE2EDuration="1.20405914s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:02:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:02:50.200877171 +0000 UTC m=+880.662604033" watchObservedRunningTime="2026-10-30 20:02:50.20405914 +0000 UTC m=+880.665786002"
Oct 30 20:02:51.154064 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:02:51.154029    6275 generic.go:356] "Generic (PLEG): container finished" podID="96008440-649e-42fe-ac7a-9746bc327f0d" containerID="9f79166d8ef4adb09cc287afd675ad768518add6f17583a4990f230a7fce8a00" exitCode=0
Oct 30 20:02:51.154591 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:02:51.154117    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-6a61c2b0-vfmpd" event={"ID":"96008440-649e-42fe-ac7a-9746bc327f0d","Type":"ContainerDied","Data":"9f79166d8ef4adb09cc287afd675ad768518add6f17583a4990f230a7fce8a00"}
Oct 30 20:02:52.302933 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:02:52.302903    6275 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-6a61c2b0-vfmpd"
Oct 30 20:02:52.422548 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:02:52.422469    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/96008440-649e-42fe-ac7a-9746bc327f0d-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/96008440-649e-42fe-ac7a-9746bc327f0d-maas-api-openshift-ca\") pod \"96008440-649e-42fe-ac7a-9746bc327f0d\" (UID: \"96008440-649e-42fe-ac7a-9746bc327f0d\") "
Oct 30 20:02:52.422694 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:02:52.422551    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/96008440-649e-42fe-ac7a-9746bc327f0d-kube-api-access-rt5kr\" (UniqueName: \"kubernetes.io/projected/96008440-649e-42fe-ac7a-9746bc327f0d-kube-api-access-rt5kr\") pod \"96008440-649e-42fe-ac7a-9746bc327f0d\" (UID: \"96008440-649e-42fe-ac7a-9746bc327f0d\") "
Oct 30 20:02:52.422694 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:02:52.422600    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/96008440-649e-42fe-ac7a-9746bc327f0d-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/96008440-649e-42fe-ac7a-9746bc327f0d-maas-api-xks-ca\") pod \"96008440-649e-42fe-ac7a-9746bc327f0d\" (UID: \"96008440-649e-42fe-ac7a-9746bc327f0d\") "
Oct 30 20:02:52.422878 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:02:52.422852    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/96008440-649e-42fe-ac7a-9746bc327f0d-maas-api-openshift-ca" pod "96008440-649e-42fe-ac7a-9746bc327f0d" (UID: "96008440-649e-42fe-ac7a-9746bc327f0d"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:02:52.423055 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:02:52.423032    6275 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/96008440-649e-42fe-ac7a-9746bc327f0d-maas-api-openshift-ca\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:02:52.424633 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:02:52.424607    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/96008440-649e-42fe-ac7a-9746bc327f0d-maas-api-xks-ca" pod "96008440-649e-42fe-ac7a-9746bc327f0d" (UID: "96008440-649e-42fe-ac7a-9746bc327f0d"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 20:02:52.424724 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:02:52.424699    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/96008440-649e-42fe-ac7a-9746bc327f0d-kube-api-access-rt5kr" pod "96008440-649e-42fe-ac7a-9746bc327f0d" (UID: "96008440-649e-42fe-ac7a-9746bc327f0d"). InnerVolumeSpecName "kube-api-access-rt5kr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:02:52.523793 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:02:52.523761    6275 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rt5kr\" (UniqueName: \"kubernetes.io/projected/96008440-649e-42fe-ac7a-9746bc327f0d-kube-api-access-rt5kr\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:02:52.523793 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:02:52.523788    6275 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/96008440-649e-42fe-ac7a-9746bc327f0d-maas-api-xks-ca\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:02:53.173551 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:02:53.173518    6275 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-6a61c2b0-vfmpd"
Oct 30 20:02:53.173770 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:02:53.173545    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-6a61c2b0-vfmpd" event={"ID":"96008440-649e-42fe-ac7a-9746bc327f0d","Type":"ContainerDied","Data":"c665c922c20c42236f81d483e1fa1faff383208caf7a238f7bdcd16347fe46e3"}
Oct 30 20:02:53.173770 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:02:53.173608    6275 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c665c922c20c42236f81d483e1fa1faff383208caf7a238f7bdcd16347fe46e3"
Oct 30 20:02:54.699815 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:02:54.699781    6275 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w2-efbac3-openshift-default-844cb4689c-485mw"]
Oct 30 20:02:54.701159 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:02:54.701132    6275 cpu_manager.go:414] "containerMap: removing container" podUID="96008440-649e-42fe-ac7a-9746bc327f0d" containerName="revoke-keys"
Oct 30 20:02:54.701319 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:02:54.701304    6275 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="96008440-649e-42fe-ac7a-9746bc327f0d" containerName="revoke-keys"
Oct 30 20:02:54.701603 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:02:54.701583    6275 memory_manager.go:365] "RemoveStaleState removing state" podUID="96008440-649e-42fe-ac7a-9746bc327f0d" containerName="revoke-keys"
Oct 30 20:02:54.712434 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:02:54.708734    6275 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-efbac3-openshift-default-844cb4689c-485mw"
Oct 30 20:02:54.736654 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:02:54.736630    6275 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w2-efbac3-openshift-default-844cb4689c-485mw"]
Oct 30 20:02:54.745659 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:02:54.745640    6275 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w2-efbac3-openshift-default-dockercfg-wbss2\""
Oct 30 20:02:54.869169 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:02:54.869118    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/58046c91-9885-452a-ae30-01edbceb6312-istio-data\") pod \"e2e-worker-w2-efbac3-openshift-default-844cb4689c-485mw\" (UID: \"58046c91-9885-452a-ae30-01edbceb6312\") " pod="openshift-ingress/e2e-worker-w2-efbac3-openshift-default-844cb4689c-485mw"
Oct 30 20:02:54.869347 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:02:54.869184    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/58046c91-9885-452a-ae30-01edbceb6312-istio-envoy\") pod \"e2e-worker-w2-efbac3-openshift-default-844cb4689c-485mw\" (UID: \"58046c91-9885-452a-ae30-01edbceb6312\") " pod="openshift-ingress/e2e-worker-w2-efbac3-openshift-default-844cb4689c-485mw"
Oct 30 20:02:54.869347 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:02:54.869232    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/58046c91-9885-452a-ae30-01edbceb6312-istio-token\") pod \"e2e-worker-w2-efbac3-openshift-default-844cb4689c-485mw\" (UID: \"58046c91-9885-452a-ae30-01edbceb6312\") " pod="openshift-ingress/e2e-worker-w2-efbac3-openshift-default-844cb4689c-485mw"
Oct 30 20:02:54.869347 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:02:54.869306    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/58046c91-9885-452a-ae30-01edbceb6312-istio-podinfo\") pod \"e2e-worker-w2-efbac3-openshift-default-844cb4689c-485mw\" (UID: \"58046c91-9885-452a-ae30-01edbceb6312\") " pod="openshift-ingress/e2e-worker-w2-efbac3-openshift-default-844cb4689c-485mw"
Oct 30 20:02:54.869347 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:02:54.869336    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5tlzt\" (UniqueName: \"kubernetes.io/projected/58046c91-9885-452a-ae30-01edbceb6312-kube-api-access-5tlzt\") pod \"e2e-worker-w2-efbac3-openshift-default-844cb4689c-485mw\" (UID: \"58046c91-9885-452a-ae30-01edbceb6312\") " pod="openshift-ingress/e2e-worker-w2-efbac3-openshift-default-844cb4689c-485mw"
Oct 30 20:02:54.869672 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:02:54.869392    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/58046c91-9885-452a-ae30-01edbceb6312-istiod-ca-cert\") pod \"e2e-worker-w2-efbac3-openshift-default-844cb4689c-485mw\" (UID: \"58046c91-9885-452a-ae30-01edbceb6312\") " pod="openshift-ingress/e2e-worker-w2-efbac3-openshift-default-844cb4689c-485mw"
Oct 30 20:02:54.869672 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:02:54.869440    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/58046c91-9885-452a-ae30-01edbceb6312-workload-socket\") pod \"e2e-worker-w2-efbac3-openshift-default-844cb4689c-485mw\" (UID: \"58046c91-9885-452a-ae30-01edbceb6312\") " pod="openshift-ingress/e2e-worker-w2-efbac3-openshift-default-844cb4689c-485mw"
Oct 30 20:02:54.869672 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:02:54.869517    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/58046c91-9885-452a-ae30-01edbceb6312-workload-certs\") pod \"e2e-worker-w2-efbac3-openshift-default-844cb4689c-485mw\" (UID: \"58046c91-9885-452a-ae30-01edbceb6312\") " pod="openshift-ingress/e2e-worker-w2-efbac3-openshift-default-844cb4689c-485mw"
Oct 30 20:02:54.869672 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:02:54.869566    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/58046c91-9885-452a-ae30-01edbceb6312-credential-socket\") pod \"e2e-worker-w2-efbac3-openshift-default-844cb4689c-485mw\" (UID: \"58046c91-9885-452a-ae30-01edbceb6312\") " pod="openshift-ingress/e2e-worker-w2-efbac3-openshift-default-844cb4689c-485mw"
Oct 30 20:02:54.971121 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:02:54.971030    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/58046c91-9885-452a-ae30-01edbceb6312-istiod-ca-cert\") pod \"e2e-worker-w2-efbac3-openshift-default-844cb4689c-485mw\" (UID: \"58046c91-9885-452a-ae30-01edbceb6312\") " pod="openshift-ingress/e2e-worker-w2-efbac3-openshift-default-844cb4689c-485mw"
Oct 30 20:02:54.971381 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:02:54.971354    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/58046c91-9885-452a-ae30-01edbceb6312-workload-socket\") pod \"e2e-worker-w2-efbac3-openshift-default-844cb4689c-485mw\" (UID: \"58046c91-9885-452a-ae30-01edbceb6312\") " pod="openshift-ingress/e2e-worker-w2-efbac3-openshift-default-844cb4689c-485mw"
Oct 30 20:02:54.971611 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:02:54.971590    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/58046c91-9885-452a-ae30-01edbceb6312-workload-certs\") pod \"e2e-worker-w2-efbac3-openshift-default-844cb4689c-485mw\" (UID: \"58046c91-9885-452a-ae30-01edbceb6312\") " pod="openshift-ingress/e2e-worker-w2-efbac3-openshift-default-844cb4689c-485mw"
Oct 30 20:02:54.971769 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:02:54.971753    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/58046c91-9885-452a-ae30-01edbceb6312-credential-socket\") pod \"e2e-worker-w2-efbac3-openshift-default-844cb4689c-485mw\" (UID: \"58046c91-9885-452a-ae30-01edbceb6312\") " pod="openshift-ingress/e2e-worker-w2-efbac3-openshift-default-844cb4689c-485mw"
Oct 30 20:02:54.971900 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:02:54.971885    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/58046c91-9885-452a-ae30-01edbceb6312-istio-data\") pod \"e2e-worker-w2-efbac3-openshift-default-844cb4689c-485mw\" (UID: \"58046c91-9885-452a-ae30-01edbceb6312\") " pod="openshift-ingress/e2e-worker-w2-efbac3-openshift-default-844cb4689c-485mw"
Oct 30 20:02:54.972024 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:02:54.972007    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/58046c91-9885-452a-ae30-01edbceb6312-istio-envoy\") pod \"e2e-worker-w2-efbac3-openshift-default-844cb4689c-485mw\" (UID: \"58046c91-9885-452a-ae30-01edbceb6312\") " pod="openshift-ingress/e2e-worker-w2-efbac3-openshift-default-844cb4689c-485mw"
Oct 30 20:02:54.972149 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:02:54.972134    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/58046c91-9885-452a-ae30-01edbceb6312-istio-token\") pod \"e2e-worker-w2-efbac3-openshift-default-844cb4689c-485mw\" (UID: \"58046c91-9885-452a-ae30-01edbceb6312\") " pod="openshift-ingress/e2e-worker-w2-efbac3-openshift-default-844cb4689c-485mw"
Oct 30 20:02:54.972343 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:02:54.972323    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/58046c91-9885-452a-ae30-01edbceb6312-istio-podinfo\") pod \"e2e-worker-w2-efbac3-openshift-default-844cb4689c-485mw\" (UID: \"58046c91-9885-452a-ae30-01edbceb6312\") " pod="openshift-ingress/e2e-worker-w2-efbac3-openshift-default-844cb4689c-485mw"
Oct 30 20:02:54.972498 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:02:54.972477    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5tlzt\" (UniqueName: \"kubernetes.io/projected/58046c91-9885-452a-ae30-01edbceb6312-kube-api-access-5tlzt\") pod \"e2e-worker-w2-efbac3-openshift-default-844cb4689c-485mw\" (UID: \"58046c91-9885-452a-ae30-01edbceb6312\") " pod="openshift-ingress/e2e-worker-w2-efbac3-openshift-default-844cb4689c-485mw"
Oct 30 20:02:54.972937 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:02:54.971813    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/58046c91-9885-452a-ae30-01edbceb6312-workload-socket\") pod \"e2e-worker-w2-efbac3-openshift-default-844cb4689c-485mw\" (UID: \"58046c91-9885-452a-ae30-01edbceb6312\") " pod="openshift-ingress/e2e-worker-w2-efbac3-openshift-default-844cb4689c-485mw"
Oct 30 20:02:54.973329 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:02:54.972137    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/58046c91-9885-452a-ae30-01edbceb6312-workload-certs\") pod \"e2e-worker-w2-efbac3-openshift-default-844cb4689c-485mw\" (UID: \"58046c91-9885-452a-ae30-01edbceb6312\") " pod="openshift-ingress/e2e-worker-w2-efbac3-openshift-default-844cb4689c-485mw"
Oct 30 20:02:54.973495 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:02:54.973327    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/58046c91-9885-452a-ae30-01edbceb6312-credential-socket\") pod \"e2e-worker-w2-efbac3-openshift-default-844cb4689c-485mw\" (UID: \"58046c91-9885-452a-ae30-01edbceb6312\") " pod="openshift-ingress/e2e-worker-w2-efbac3-openshift-default-844cb4689c-485mw"
Oct 30 20:02:54.973694 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:02:54.973671    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/58046c91-9885-452a-ae30-01edbceb6312-istio-data\") pod \"e2e-worker-w2-efbac3-openshift-default-844cb4689c-485mw\" (UID: \"58046c91-9885-452a-ae30-01edbceb6312\") " pod="openshift-ingress/e2e-worker-w2-efbac3-openshift-default-844cb4689c-485mw"
Oct 30 20:02:54.974217 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:02:54.974194    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/58046c91-9885-452a-ae30-01edbceb6312-istiod-ca-cert\") pod \"e2e-worker-w2-efbac3-openshift-default-844cb4689c-485mw\" (UID: \"58046c91-9885-452a-ae30-01edbceb6312\") " pod="openshift-ingress/e2e-worker-w2-efbac3-openshift-default-844cb4689c-485mw"
Oct 30 20:02:54.978139 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:02:54.978116    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/58046c91-9885-452a-ae30-01edbceb6312-istio-envoy\") pod \"e2e-worker-w2-efbac3-openshift-default-844cb4689c-485mw\" (UID: \"58046c91-9885-452a-ae30-01edbceb6312\") " pod="openshift-ingress/e2e-worker-w2-efbac3-openshift-default-844cb4689c-485mw"
Oct 30 20:02:55.001843 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:02:55.000841    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/58046c91-9885-452a-ae30-01edbceb6312-istio-podinfo\") pod \"e2e-worker-w2-efbac3-openshift-default-844cb4689c-485mw\" (UID: \"58046c91-9885-452a-ae30-01edbceb6312\") " pod="openshift-ingress/e2e-worker-w2-efbac3-openshift-default-844cb4689c-485mw"
Oct 30 20:02:55.004856 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:02:55.004836    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/58046c91-9885-452a-ae30-01edbceb6312-istio-token\") pod \"e2e-worker-w2-efbac3-openshift-default-844cb4689c-485mw\" (UID: \"58046c91-9885-452a-ae30-01edbceb6312\") " pod="openshift-ingress/e2e-worker-w2-efbac3-openshift-default-844cb4689c-485mw"
Oct 30 20:02:55.006867 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:02:55.006827    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5tlzt\" (UniqueName: \"kubernetes.io/projected/58046c91-9885-452a-ae30-01edbceb6312-kube-api-access-5tlzt\") pod \"e2e-worker-w2-efbac3-openshift-default-844cb4689c-485mw\" (UID: \"58046c91-9885-452a-ae30-01edbceb6312\") " pod="openshift-ingress/e2e-worker-w2-efbac3-openshift-default-844cb4689c-485mw"
Oct 30 20:02:55.033062 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:02:55.032855    6275 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-efbac3-openshift-default-844cb4689c-485mw"
Oct 30 20:02:55.391064 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:02:55.391022    6275 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Oct 30 20:02:55.391221 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:02:55.391111    6275 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Oct 30 20:02:55.391221 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:02:55.391157    6275 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Oct 30 20:02:55.397691 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:02:55.396998    6275 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w2-efbac3-openshift-default-844cb4689c-485mw"]
Oct 30 20:02:56.223196 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:02:56.223164    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-efbac3-openshift-default-844cb4689c-485mw" event={"ID":"58046c91-9885-452a-ae30-01edbceb6312","Type":"ContainerStarted","Data":"02d8654d81376fb4ef91998858749adfbae09cdc9039a874891a2b74931acd4c"}
Oct 30 20:02:56.223587 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:02:56.223217    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-efbac3-openshift-default-844cb4689c-485mw" event={"ID":"58046c91-9885-452a-ae30-01edbceb6312","Type":"ContainerStarted","Data":"1e8a84a27ce4b49afd653d20956a24b4c5fe430530ba511d10fe93a307461d28"}
Oct 30 20:02:56.254808 ip-10-0-131-26 kubenswrapper[6275]: E1030 20:02:56.254777    6275 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-fwc77" containerName="extractor"
Oct 30 20:02:56.295074 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:02:56.294999    6275 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w2-efbac3-openshift-default-844cb4689c-485mw" podStartSLOduration=2.294978288 podStartE2EDuration="2.294978288s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:02:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:02:56.292847346 +0000 UTC m=+886.754574215" watchObservedRunningTime="2026-10-30 20:02:56.294978288 +0000 UTC m=+886.756705153"
Oct 30 20:02:57.033386 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:02:57.033350    6275 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w2-efbac3-openshift-default-844cb4689c-485mw"
Oct 30 20:02:57.034602 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:02:57.034575    6275 patch_prober.go:29] interesting pod/e2e-worker-w2-efbac3-openshift-default-844cb4689c-485mw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused" start-of-body=
Oct 30 20:02:57.034706 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:02:57.034637    6275 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-efbac3-openshift-default-844cb4689c-485mw" podUID="58046c91-9885-452a-ae30-01edbceb6312" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused"
Oct 30 20:02:58.034550 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:02:58.034517    6275 patch_prober.go:29] interesting pod/e2e-worker-w2-efbac3-openshift-default-844cb4689c-485mw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused" start-of-body=
Oct 30 20:02:58.034950 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:02:58.034568    6275 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-efbac3-openshift-default-844cb4689c-485mw" podUID="58046c91-9885-452a-ae30-01edbceb6312" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused"
Oct 30 20:02:59.033963 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:02:59.033925    6275 patch_prober.go:29] interesting pod/e2e-worker-w2-efbac3-openshift-default-844cb4689c-485mw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused" start-of-body=
Oct 30 20:02:59.034136 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:02:59.033983    6275 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-efbac3-openshift-default-844cb4689c-485mw" podUID="58046c91-9885-452a-ae30-01edbceb6312" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused"
Oct 30 20:03:00.033557 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:03:00.033524    6275 patch_prober.go:29] interesting pod/e2e-worker-w2-efbac3-openshift-default-844cb4689c-485mw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused" start-of-body=
Oct 30 20:03:00.034051 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:03:00.034020    6275 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-efbac3-openshift-default-844cb4689c-485mw" podUID="58046c91-9885-452a-ae30-01edbceb6312" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused"
Oct 30 20:03:00.060870 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:03:00.060845    6275 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-0de909cb-94q4p"]
Oct 30 20:03:00.064903 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:03:00.064885    6275 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-0de909cb-94q4p"
Oct 30 20:03:00.099935 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:03:00.097293    6275 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-0de909cb-94q4p"]
Oct 30 20:03:00.101569 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:03:00.101544    6275 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\""
Oct 30 20:03:00.101686 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:03:00.101595    6275 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-scs2w\""
Oct 30 20:03:00.163218 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:03:00.163178    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/86aa5049-8a13-4895-b56c-9823cbec69c6-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-0de909cb-94q4p\" (UID: \"86aa5049-8a13-4895-b56c-9823cbec69c6\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-0de909cb-94q4p"
Oct 30 20:03:00.163359 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:03:00.163260    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s7shr\" (UniqueName: \"kubernetes.io/projected/86aa5049-8a13-4895-b56c-9823cbec69c6-kube-api-access-s7shr\") pod \"maas-api-revoke-sub-0de909cb-94q4p\" (UID: \"86aa5049-8a13-4895-b56c-9823cbec69c6\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-0de909cb-94q4p"
Oct 30 20:03:00.163359 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:03:00.163322    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/86aa5049-8a13-4895-b56c-9823cbec69c6-maas-api-xks-ca\") pod \"maas-api-revoke-sub-0de909cb-94q4p\" (UID: \"86aa5049-8a13-4895-b56c-9823cbec69c6\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-0de909cb-94q4p"
Oct 30 20:03:00.264671 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:03:00.264623    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/86aa5049-8a13-4895-b56c-9823cbec69c6-maas-api-xks-ca\") pod \"maas-api-revoke-sub-0de909cb-94q4p\" (UID: \"86aa5049-8a13-4895-b56c-9823cbec69c6\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-0de909cb-94q4p"
Oct 30 20:03:00.264882 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:03:00.264715    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/86aa5049-8a13-4895-b56c-9823cbec69c6-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-0de909cb-94q4p\" (UID: \"86aa5049-8a13-4895-b56c-9823cbec69c6\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-0de909cb-94q4p"
Oct 30 20:03:00.264882 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:03:00.264772    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s7shr\" (UniqueName: \"kubernetes.io/projected/86aa5049-8a13-4895-b56c-9823cbec69c6-kube-api-access-s7shr\") pod \"maas-api-revoke-sub-0de909cb-94q4p\" (UID: \"86aa5049-8a13-4895-b56c-9823cbec69c6\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-0de909cb-94q4p"
Oct 30 20:03:00.265387 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:03:00.265363    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/86aa5049-8a13-4895-b56c-9823cbec69c6-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-0de909cb-94q4p\" (UID: \"86aa5049-8a13-4895-b56c-9823cbec69c6\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-0de909cb-94q4p"
Oct 30 20:03:00.266983 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:03:00.266961    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/86aa5049-8a13-4895-b56c-9823cbec69c6-maas-api-xks-ca\") pod \"maas-api-revoke-sub-0de909cb-94q4p\" (UID: \"86aa5049-8a13-4895-b56c-9823cbec69c6\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-0de909cb-94q4p"
Oct 30 20:03:00.301773 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:03:00.301697    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s7shr\" (UniqueName: \"kubernetes.io/projected/86aa5049-8a13-4895-b56c-9823cbec69c6-kube-api-access-s7shr\") pod \"maas-api-revoke-sub-0de909cb-94q4p\" (UID: \"86aa5049-8a13-4895-b56c-9823cbec69c6\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-0de909cb-94q4p"
Oct 30 20:03:00.412745 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:03:00.412709    6275 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-0de909cb-94q4p"
Oct 30 20:03:00.736263 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:03:00.736227    6275 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-0de909cb-94q4p"]
Oct 30 20:03:00.737285 ip-10-0-131-26 kubenswrapper[6275]: W1030 20:03:00.737260    6275 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod86aa5049_8a13_4895_b56c_9823cbec69c6.slice/crio-8fa3b26705047dabf427d178cdfa87fe4b51d8953c1ce5f2fbc823731abed6c5 WatchSource:0}: Error finding container 8fa3b26705047dabf427d178cdfa87fe4b51d8953c1ce5f2fbc823731abed6c5: Status 404 returned error can't find the container with id 8fa3b26705047dabf427d178cdfa87fe4b51d8953c1ce5f2fbc823731abed6c5
Oct 30 20:03:01.034938 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:03:01.034907    6275 patch_prober.go:29] interesting pod/e2e-worker-w2-efbac3-openshift-default-844cb4689c-485mw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused" start-of-body=
Oct 30 20:03:01.035281 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:03:01.034957    6275 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-efbac3-openshift-default-844cb4689c-485mw" podUID="58046c91-9885-452a-ae30-01edbceb6312" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused"
Oct 30 20:03:01.253501 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:03:01.253470    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-0de909cb-94q4p" event={"ID":"86aa5049-8a13-4895-b56c-9823cbec69c6","Type":"ContainerStarted","Data":"810f4ae687e7c30a6a77e6856326abf3f4c897783400a635f3dc1280d6817200"}
Oct 30 20:03:01.253619 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:03:01.253524    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-0de909cb-94q4p" event={"ID":"86aa5049-8a13-4895-b56c-9823cbec69c6","Type":"ContainerStarted","Data":"8fa3b26705047dabf427d178cdfa87fe4b51d8953c1ce5f2fbc823731abed6c5"}
Oct 30 20:03:01.314201 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:03:01.314112    6275 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-sub-0de909cb-94q4p" podStartSLOduration=1.314098858 podStartE2EDuration="1.314098858s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:03:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:03:01.313302076 +0000 UTC m=+891.775028941" watchObservedRunningTime="2026-10-30 20:03:01.314098858 +0000 UTC m=+891.775825722"
Oct 30 20:03:02.033655 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:03:02.033615    6275 patch_prober.go:29] interesting pod/e2e-worker-w2-efbac3-openshift-default-844cb4689c-485mw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused" start-of-body=
Oct 30 20:03:02.033831 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:03:02.033692    6275 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-efbac3-openshift-default-844cb4689c-485mw" podUID="58046c91-9885-452a-ae30-01edbceb6312" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused"
Oct 30 20:03:02.262976 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:03:02.262936    6275 generic.go:356] "Generic (PLEG): container finished" podID="86aa5049-8a13-4895-b56c-9823cbec69c6" containerID="810f4ae687e7c30a6a77e6856326abf3f4c897783400a635f3dc1280d6817200" exitCode=0
Oct 30 20:03:02.263379 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:03:02.263027    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-0de909cb-94q4p" event={"ID":"86aa5049-8a13-4895-b56c-9823cbec69c6","Type":"ContainerDied","Data":"810f4ae687e7c30a6a77e6856326abf3f4c897783400a635f3dc1280d6817200"}
Oct 30 20:03:03.038824 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:03:03.038796    6275 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w2-efbac3-openshift-default-844cb4689c-485mw"
Oct 30 20:03:03.039082 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:03:03.039062    6275 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w2-efbac3-openshift-default-844cb4689c-485mw"
Oct 30 20:03:03.039838 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:03:03.039819    6275 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w2-efbac3-openshift-default-844cb4689c-485mw"
Oct 30 20:03:03.399705 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:03:03.399681    6275 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-0de909cb-94q4p"
Oct 30 20:03:03.524298 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:03:03.524266    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/86aa5049-8a13-4895-b56c-9823cbec69c6-kube-api-access-s7shr\" (UniqueName: \"kubernetes.io/projected/86aa5049-8a13-4895-b56c-9823cbec69c6-kube-api-access-s7shr\") pod \"86aa5049-8a13-4895-b56c-9823cbec69c6\" (UID: \"86aa5049-8a13-4895-b56c-9823cbec69c6\") "
Oct 30 20:03:03.524455 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:03:03.524405    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/86aa5049-8a13-4895-b56c-9823cbec69c6-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/86aa5049-8a13-4895-b56c-9823cbec69c6-maas-api-xks-ca\") pod \"86aa5049-8a13-4895-b56c-9823cbec69c6\" (UID: \"86aa5049-8a13-4895-b56c-9823cbec69c6\") "
Oct 30 20:03:03.524523 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:03:03.524510    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/86aa5049-8a13-4895-b56c-9823cbec69c6-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/86aa5049-8a13-4895-b56c-9823cbec69c6-maas-api-openshift-ca\") pod \"86aa5049-8a13-4895-b56c-9823cbec69c6\" (UID: \"86aa5049-8a13-4895-b56c-9823cbec69c6\") "
Oct 30 20:03:03.524835 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:03:03.524814    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/86aa5049-8a13-4895-b56c-9823cbec69c6-maas-api-openshift-ca" pod "86aa5049-8a13-4895-b56c-9823cbec69c6" (UID: "86aa5049-8a13-4895-b56c-9823cbec69c6"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:03:03.526339 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:03:03.526312    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/86aa5049-8a13-4895-b56c-9823cbec69c6-kube-api-access-s7shr" pod "86aa5049-8a13-4895-b56c-9823cbec69c6" (UID: "86aa5049-8a13-4895-b56c-9823cbec69c6"). InnerVolumeSpecName "kube-api-access-s7shr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:03:03.526339 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:03:03.526311    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/86aa5049-8a13-4895-b56c-9823cbec69c6-maas-api-xks-ca" pod "86aa5049-8a13-4895-b56c-9823cbec69c6" (UID: "86aa5049-8a13-4895-b56c-9823cbec69c6"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 20:03:03.625810 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:03:03.625734    6275 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/86aa5049-8a13-4895-b56c-9823cbec69c6-maas-api-xks-ca\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:03:03.625810 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:03:03.625763    6275 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/86aa5049-8a13-4895-b56c-9823cbec69c6-maas-api-openshift-ca\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:03:03.625810 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:03:03.625777    6275 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s7shr\" (UniqueName: \"kubernetes.io/projected/86aa5049-8a13-4895-b56c-9823cbec69c6-kube-api-access-s7shr\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:03:04.276685 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:03:04.276643    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-0de909cb-94q4p" event={"ID":"86aa5049-8a13-4895-b56c-9823cbec69c6","Type":"ContainerDied","Data":"8fa3b26705047dabf427d178cdfa87fe4b51d8953c1ce5f2fbc823731abed6c5"}
Oct 30 20:03:04.276685 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:03:04.276679    6275 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-0de909cb-94q4p"
Oct 30 20:03:04.276938 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:03:04.276729    6275 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8fa3b26705047dabf427d178cdfa87fe4b51d8953c1ce5f2fbc823731abed6c5"
Oct 30 20:03:05.464048 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:03:05.464015    6275 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w1-5f10d2/distinct-w1-5f10d2-kserve-5bf49798b8-l2j84"]
Oct 30 20:03:05.464796 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:03:05.464772    6275 cpu_manager.go:414] "containerMap: removing container" podUID="86aa5049-8a13-4895-b56c-9823cbec69c6" containerName="revoke-keys"
Oct 30 20:03:05.464796 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:03:05.464794    6275 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="86aa5049-8a13-4895-b56c-9823cbec69c6" containerName="revoke-keys"
Oct 30 20:03:05.464959 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:03:05.464887    6275 memory_manager.go:365] "RemoveStaleState removing state" podUID="86aa5049-8a13-4895-b56c-9823cbec69c6" containerName="revoke-keys"
Oct 30 20:03:05.467936 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:03:05.467912    6275 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w1-5f10d2/distinct-w1-5f10d2-kserve-5bf49798b8-l2j84"
Oct 30 20:03:05.481556 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:03:05.481533    6275 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w1-5f10d2/distinct-w1-5f10d2-kserve-5bf49798b8-l2j84"]
Oct 30 20:03:05.491189 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:03:05.491166    6275 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w1-5f10d2\"/\"distinct-w1-5f10d2-kserve-self-signed-certs\""
Oct 30 20:03:05.543655 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:03:05.543617    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dbzx2\" (UniqueName: \"kubernetes.io/projected/9e831c5d-2019-4015-ac57-2b4b1b90b9b3-kube-api-access-dbzx2\") pod \"distinct-w1-5f10d2-kserve-5bf49798b8-l2j84\" (UID: \"9e831c5d-2019-4015-ac57-2b4b1b90b9b3\") " pod="e2e-models-e2e-worker-w1-5f10d2/distinct-w1-5f10d2-kserve-5bf49798b8-l2j84"
Oct 30 20:03:05.543817 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:03:05.543749    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9e831c5d-2019-4015-ac57-2b4b1b90b9b3-tmp-dir\") pod \"distinct-w1-5f10d2-kserve-5bf49798b8-l2j84\" (UID: \"9e831c5d-2019-4015-ac57-2b4b1b90b9b3\") " pod="e2e-models-e2e-worker-w1-5f10d2/distinct-w1-5f10d2-kserve-5bf49798b8-l2j84"
Oct 30 20:03:05.543817 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:03:05.543775    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9e831c5d-2019-4015-ac57-2b4b1b90b9b3-dshm\") pod \"distinct-w1-5f10d2-kserve-5bf49798b8-l2j84\" (UID: \"9e831c5d-2019-4015-ac57-2b4b1b90b9b3\") " pod="e2e-models-e2e-worker-w1-5f10d2/distinct-w1-5f10d2-kserve-5bf49798b8-l2j84"
Oct 30 20:03:05.543938 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:03:05.543830    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9e831c5d-2019-4015-ac57-2b4b1b90b9b3-model-cache\") pod \"distinct-w1-5f10d2-kserve-5bf49798b8-l2j84\" (UID: \"9e831c5d-2019-4015-ac57-2b4b1b90b9b3\") " pod="e2e-models-e2e-worker-w1-5f10d2/distinct-w1-5f10d2-kserve-5bf49798b8-l2j84"
Oct 30 20:03:05.543991 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:03:05.543940    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9e831c5d-2019-4015-ac57-2b4b1b90b9b3-tls-certs\") pod \"distinct-w1-5f10d2-kserve-5bf49798b8-l2j84\" (UID: \"9e831c5d-2019-4015-ac57-2b4b1b90b9b3\") " pod="e2e-models-e2e-worker-w1-5f10d2/distinct-w1-5f10d2-kserve-5bf49798b8-l2j84"
Oct 30 20:03:05.543991 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:03:05.543958    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9e831c5d-2019-4015-ac57-2b4b1b90b9b3-home\") pod \"distinct-w1-5f10d2-kserve-5bf49798b8-l2j84\" (UID: \"9e831c5d-2019-4015-ac57-2b4b1b90b9b3\") " pod="e2e-models-e2e-worker-w1-5f10d2/distinct-w1-5f10d2-kserve-5bf49798b8-l2j84"
Oct 30 20:03:05.644916 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:03:05.644860    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dbzx2\" (UniqueName: \"kubernetes.io/projected/9e831c5d-2019-4015-ac57-2b4b1b90b9b3-kube-api-access-dbzx2\") pod \"distinct-w1-5f10d2-kserve-5bf49798b8-l2j84\" (UID: \"9e831c5d-2019-4015-ac57-2b4b1b90b9b3\") " pod="e2e-models-e2e-worker-w1-5f10d2/distinct-w1-5f10d2-kserve-5bf49798b8-l2j84"
Oct 30 20:03:05.645060 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:03:05.644997    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9e831c5d-2019-4015-ac57-2b4b1b90b9b3-tmp-dir\") pod \"distinct-w1-5f10d2-kserve-5bf49798b8-l2j84\" (UID: \"9e831c5d-2019-4015-ac57-2b4b1b90b9b3\") " pod="e2e-models-e2e-worker-w1-5f10d2/distinct-w1-5f10d2-kserve-5bf49798b8-l2j84"
Oct 30 20:03:05.645060 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:03:05.645028    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9e831c5d-2019-4015-ac57-2b4b1b90b9b3-dshm\") pod \"distinct-w1-5f10d2-kserve-5bf49798b8-l2j84\" (UID: \"9e831c5d-2019-4015-ac57-2b4b1b90b9b3\") " pod="e2e-models-e2e-worker-w1-5f10d2/distinct-w1-5f10d2-kserve-5bf49798b8-l2j84"
Oct 30 20:03:05.645147 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:03:05.645068    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9e831c5d-2019-4015-ac57-2b4b1b90b9b3-model-cache\") pod \"distinct-w1-5f10d2-kserve-5bf49798b8-l2j84\" (UID: \"9e831c5d-2019-4015-ac57-2b4b1b90b9b3\") " pod="e2e-models-e2e-worker-w1-5f10d2/distinct-w1-5f10d2-kserve-5bf49798b8-l2j84"
Oct 30 20:03:05.645186 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:03:05.645157    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9e831c5d-2019-4015-ac57-2b4b1b90b9b3-tls-certs\") pod \"distinct-w1-5f10d2-kserve-5bf49798b8-l2j84\" (UID: \"9e831c5d-2019-4015-ac57-2b4b1b90b9b3\") " pod="e2e-models-e2e-worker-w1-5f10d2/distinct-w1-5f10d2-kserve-5bf49798b8-l2j84"
Oct 30 20:03:05.645216 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:03:05.645180    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9e831c5d-2019-4015-ac57-2b4b1b90b9b3-home\") pod \"distinct-w1-5f10d2-kserve-5bf49798b8-l2j84\" (UID: \"9e831c5d-2019-4015-ac57-2b4b1b90b9b3\") " pod="e2e-models-e2e-worker-w1-5f10d2/distinct-w1-5f10d2-kserve-5bf49798b8-l2j84"
Oct 30 20:03:05.645998 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:03:05.645551    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9e831c5d-2019-4015-ac57-2b4b1b90b9b3-tmp-dir\") pod \"distinct-w1-5f10d2-kserve-5bf49798b8-l2j84\" (UID: \"9e831c5d-2019-4015-ac57-2b4b1b90b9b3\") " pod="e2e-models-e2e-worker-w1-5f10d2/distinct-w1-5f10d2-kserve-5bf49798b8-l2j84"
Oct 30 20:03:05.645998 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:03:05.645621    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9e831c5d-2019-4015-ac57-2b4b1b90b9b3-home\") pod \"distinct-w1-5f10d2-kserve-5bf49798b8-l2j84\" (UID: \"9e831c5d-2019-4015-ac57-2b4b1b90b9b3\") " pod="e2e-models-e2e-worker-w1-5f10d2/distinct-w1-5f10d2-kserve-5bf49798b8-l2j84"
Oct 30 20:03:05.645998 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:03:05.645744    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9e831c5d-2019-4015-ac57-2b4b1b90b9b3-model-cache\") pod \"distinct-w1-5f10d2-kserve-5bf49798b8-l2j84\" (UID: \"9e831c5d-2019-4015-ac57-2b4b1b90b9b3\") " pod="e2e-models-e2e-worker-w1-5f10d2/distinct-w1-5f10d2-kserve-5bf49798b8-l2j84"
Oct 30 20:03:05.648779 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:03:05.648725    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9e831c5d-2019-4015-ac57-2b4b1b90b9b3-dshm\") pod \"distinct-w1-5f10d2-kserve-5bf49798b8-l2j84\" (UID: \"9e831c5d-2019-4015-ac57-2b4b1b90b9b3\") " pod="e2e-models-e2e-worker-w1-5f10d2/distinct-w1-5f10d2-kserve-5bf49798b8-l2j84"
Oct 30 20:03:05.649134 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:03:05.649072    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9e831c5d-2019-4015-ac57-2b4b1b90b9b3-tls-certs\") pod \"distinct-w1-5f10d2-kserve-5bf49798b8-l2j84\" (UID: \"9e831c5d-2019-4015-ac57-2b4b1b90b9b3\") " pod="e2e-models-e2e-worker-w1-5f10d2/distinct-w1-5f10d2-kserve-5bf49798b8-l2j84"
Oct 30 20:03:05.672822 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:03:05.672125    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dbzx2\" (UniqueName: \"kubernetes.io/projected/9e831c5d-2019-4015-ac57-2b4b1b90b9b3-kube-api-access-dbzx2\") pod \"distinct-w1-5f10d2-kserve-5bf49798b8-l2j84\" (UID: \"9e831c5d-2019-4015-ac57-2b4b1b90b9b3\") " pod="e2e-models-e2e-worker-w1-5f10d2/distinct-w1-5f10d2-kserve-5bf49798b8-l2j84"
Oct 30 20:03:05.784164 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:03:05.784134    6275 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w1-5f10d2/distinct-w1-5f10d2-kserve-5bf49798b8-l2j84"
Oct 30 20:03:06.095299 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:03:06.095268    6275 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w1-5f10d2/distinct-w1-5f10d2-kserve-5bf49798b8-l2j84"]
Oct 30 20:03:06.096109 ip-10-0-131-26 kubenswrapper[6275]: W1030 20:03:06.096069    6275 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9e831c5d_2019_4015_ac57_2b4b1b90b9b3.slice/crio-a21d2db5c56411674f6474169efe24fefecfd967d224e720596f0dbd93546952 WatchSource:0}: Error finding container a21d2db5c56411674f6474169efe24fefecfd967d224e720596f0dbd93546952: Status 404 returned error can't find the container with id a21d2db5c56411674f6474169efe24fefecfd967d224e720596f0dbd93546952
Oct 30 20:03:06.290550 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:03:06.290517    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w1-5f10d2/distinct-w1-5f10d2-kserve-5bf49798b8-l2j84" event={"ID":"9e831c5d-2019-4015-ac57-2b4b1b90b9b3","Type":"ContainerStarted","Data":"82b69e481aab6a4f38d0e16e3208f839e4c07a7d2f1fc2762ed1340dbe22c826"}
Oct 30 20:03:06.290705 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:03:06.290561    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w1-5f10d2/distinct-w1-5f10d2-kserve-5bf49798b8-l2j84" event={"ID":"9e831c5d-2019-4015-ac57-2b4b1b90b9b3","Type":"ContainerStarted","Data":"a21d2db5c56411674f6474169efe24fefecfd967d224e720596f0dbd93546952"}
Oct 30 20:03:06.336430 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:03:06.336370    6275 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w1-5f10d2/distinct-w1-5f10d2-kserve-5bf49798b8-l2j84" podStartSLOduration=1.336356636 podStartE2EDuration="1.336356636s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:03:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:03:06.335335886 +0000 UTC m=+896.797062750" watchObservedRunningTime="2026-10-30 20:03:06.336356636 +0000 UTC m=+896.798083498"
Oct 30 20:03:06.784936 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:03:06.784905    6275 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w1-5f10d2/distinct-w1-5f10d2-kserve-5bf49798b8-l2j84"
Oct 30 20:03:09.656438 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:03:09.642470    6275 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w5-626870-openshift-default-7cd649d59c-zchw8"]
Oct 30 20:03:09.929479 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:03:09.928546    6275 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-626870-openshift-default-7cd649d59c-zchw8"
Oct 30 20:03:09.964967 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:03:09.964936    6275 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w5-626870-openshift-default-dockercfg-8x78h\""
Oct 30 20:03:10.029647 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:03:10.029617    6275 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w5-626870-openshift-default-7cd649d59c-zchw8"]
Oct 30 20:03:10.101631 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:03:10.101599    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5aec32f5-a318-4b0c-9c2f-2af7f36b8fd4-istio-data\") pod \"e2e-worker-w5-626870-openshift-default-7cd649d59c-zchw8\" (UID: \"5aec32f5-a318-4b0c-9c2f-2af7f36b8fd4\") " pod="openshift-ingress/e2e-worker-w5-626870-openshift-default-7cd649d59c-zchw8"
Oct 30 20:03:10.102633 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:03:10.102604    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5aec32f5-a318-4b0c-9c2f-2af7f36b8fd4-istio-envoy\") pod \"e2e-worker-w5-626870-openshift-default-7cd649d59c-zchw8\" (UID: \"5aec32f5-a318-4b0c-9c2f-2af7f36b8fd4\") " pod="openshift-ingress/e2e-worker-w5-626870-openshift-default-7cd649d59c-zchw8"
Oct 30 20:03:10.102910 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:03:10.102889    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5aec32f5-a318-4b0c-9c2f-2af7f36b8fd4-workload-socket\") pod \"e2e-worker-w5-626870-openshift-default-7cd649d59c-zchw8\" (UID: \"5aec32f5-a318-4b0c-9c2f-2af7f36b8fd4\") " pod="openshift-ingress/e2e-worker-w5-626870-openshift-default-7cd649d59c-zchw8"
Oct 30 20:03:10.103783 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:03:10.103763    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5aec32f5-a318-4b0c-9c2f-2af7f36b8fd4-workload-certs\") pod \"e2e-worker-w5-626870-openshift-default-7cd649d59c-zchw8\" (UID: \"5aec32f5-a318-4b0c-9c2f-2af7f36b8fd4\") " pod="openshift-ingress/e2e-worker-w5-626870-openshift-default-7cd649d59c-zchw8"
Oct 30 20:03:10.103943 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:03:10.103925    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5aec32f5-a318-4b0c-9c2f-2af7f36b8fd4-credential-socket\") pod \"e2e-worker-w5-626870-openshift-default-7cd649d59c-zchw8\" (UID: \"5aec32f5-a318-4b0c-9c2f-2af7f36b8fd4\") " pod="openshift-ingress/e2e-worker-w5-626870-openshift-default-7cd649d59c-zchw8"
Oct 30 20:03:10.108612 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:03:10.105798    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5aec32f5-a318-4b0c-9c2f-2af7f36b8fd4-istio-token\") pod \"e2e-worker-w5-626870-openshift-default-7cd649d59c-zchw8\" (UID: \"5aec32f5-a318-4b0c-9c2f-2af7f36b8fd4\") " pod="openshift-ingress/e2e-worker-w5-626870-openshift-default-7cd649d59c-zchw8"
Oct 30 20:03:10.108810 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:03:10.108792    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5aec32f5-a318-4b0c-9c2f-2af7f36b8fd4-istio-podinfo\") pod \"e2e-worker-w5-626870-openshift-default-7cd649d59c-zchw8\" (UID: \"5aec32f5-a318-4b0c-9c2f-2af7f36b8fd4\") " pod="openshift-ingress/e2e-worker-w5-626870-openshift-default-7cd649d59c-zchw8"
Oct 30 20:03:10.111594 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:03:10.111573    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nvbp9\" (UniqueName: \"kubernetes.io/projected/5aec32f5-a318-4b0c-9c2f-2af7f36b8fd4-kube-api-access-nvbp9\") pod \"e2e-worker-w5-626870-openshift-default-7cd649d59c-zchw8\" (UID: \"5aec32f5-a318-4b0c-9c2f-2af7f36b8fd4\") " pod="openshift-ingress/e2e-worker-w5-626870-openshift-default-7cd649d59c-zchw8"
Oct 30 20:03:10.111805 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:03:10.111786    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5aec32f5-a318-4b0c-9c2f-2af7f36b8fd4-istiod-ca-cert\") pod \"e2e-worker-w5-626870-openshift-default-7cd649d59c-zchw8\" (UID: \"5aec32f5-a318-4b0c-9c2f-2af7f36b8fd4\") " pod="openshift-ingress/e2e-worker-w5-626870-openshift-default-7cd649d59c-zchw8"
Oct 30 20:03:10.207751 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:03:10.207666    6275 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-bl2ds"]
Oct 30 20:03:10.216152 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:03:10.212686    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5aec32f5-a318-4b0c-9c2f-2af7f36b8fd4-workload-socket\") pod \"e2e-worker-w5-626870-openshift-default-7cd649d59c-zchw8\" (UID: \"5aec32f5-a318-4b0c-9c2f-2af7f36b8fd4\") " pod="openshift-ingress/e2e-worker-w5-626870-openshift-default-7cd649d59c-zchw8"
Oct 30 20:03:10.216152 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:03:10.212740    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5aec32f5-a318-4b0c-9c2f-2af7f36b8fd4-workload-certs\") pod \"e2e-worker-w5-626870-openshift-default-7cd649d59c-zchw8\" (UID: \"5aec32f5-a318-4b0c-9c2f-2af7f36b8fd4\") " pod="openshift-ingress/e2e-worker-w5-626870-openshift-default-7cd649d59c-zchw8"
Oct 30 20:03:10.216152 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:03:10.212826    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5aec32f5-a318-4b0c-9c2f-2af7f36b8fd4-credential-socket\") pod \"e2e-worker-w5-626870-openshift-default-7cd649d59c-zchw8\" (UID: \"5aec32f5-a318-4b0c-9c2f-2af7f36b8fd4\") " pod="openshift-ingress/e2e-worker-w5-626870-openshift-default-7cd649d59c-zchw8"
Oct 30 20:03:10.216152 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:03:10.212854    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5aec32f5-a318-4b0c-9c2f-2af7f36b8fd4-istio-token\") pod \"e2e-worker-w5-626870-openshift-default-7cd649d59c-zchw8\" (UID: \"5aec32f5-a318-4b0c-9c2f-2af7f36b8fd4\") " pod="openshift-ingress/e2e-worker-w5-626870-openshift-default-7cd649d59c-zchw8"
Oct 30 20:03:10.216152 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:03:10.212881    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5aec32f5-a318-4b0c-9c2f-2af7f36b8fd4-istio-podinfo\") pod \"e2e-worker-w5-626870-openshift-default-7cd649d59c-zchw8\" (UID: \"5aec32f5-a318-4b0c-9c2f-2af7f36b8fd4\") " pod="openshift-ingress/e2e-worker-w5-626870-openshift-default-7cd649d59c-zchw8"
Oct 30 20:03:10.216152 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:03:10.212953    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nvbp9\" (UniqueName: \"kubernetes.io/projected/5aec32f5-a318-4b0c-9c2f-2af7f36b8fd4-kube-api-access-nvbp9\") pod \"e2e-worker-w5-626870-openshift-default-7cd649d59c-zchw8\" (UID: \"5aec32f5-a318-4b0c-9c2f-2af7f36b8fd4\") " pod="openshift-ingress/e2e-worker-w5-626870-openshift-default-7cd649d59c-zchw8"
Oct 30 20:03:10.216152 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:03:10.212984    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5aec32f5-a318-4b0c-9c2f-2af7f36b8fd4-istiod-ca-cert\") pod \"e2e-worker-w5-626870-openshift-default-7cd649d59c-zchw8\" (UID: \"5aec32f5-a318-4b0c-9c2f-2af7f36b8fd4\") " pod="openshift-ingress/e2e-worker-w5-626870-openshift-default-7cd649d59c-zchw8"
Oct 30 20:03:10.216152 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:03:10.213086    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5aec32f5-a318-4b0c-9c2f-2af7f36b8fd4-istio-data\") pod \"e2e-worker-w5-626870-openshift-default-7cd649d59c-zchw8\" (UID: \"5aec32f5-a318-4b0c-9c2f-2af7f36b8fd4\") " pod="openshift-ingress/e2e-worker-w5-626870-openshift-default-7cd649d59c-zchw8"
Oct 30 20:03:10.216152 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:03:10.213121    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5aec32f5-a318-4b0c-9c2f-2af7f36b8fd4-istio-envoy\") pod \"e2e-worker-w5-626870-openshift-default-7cd649d59c-zchw8\" (UID: \"5aec32f5-a318-4b0c-9c2f-2af7f36b8fd4\") " pod="openshift-ingress/e2e-worker-w5-626870-openshift-default-7cd649d59c-zchw8"
Oct 30 20:03:10.216152 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:03:10.213882    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5aec32f5-a318-4b0c-9c2f-2af7f36b8fd4-workload-socket\") pod \"e2e-worker-w5-626870-openshift-default-7cd649d59c-zchw8\" (UID: \"5aec32f5-a318-4b0c-9c2f-2af7f36b8fd4\") " pod="openshift-ingress/e2e-worker-w5-626870-openshift-default-7cd649d59c-zchw8"
Oct 30 20:03:10.216152 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:03:10.214140    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5aec32f5-a318-4b0c-9c2f-2af7f36b8fd4-workload-certs\") pod \"e2e-worker-w5-626870-openshift-default-7cd649d59c-zchw8\" (UID: \"5aec32f5-a318-4b0c-9c2f-2af7f36b8fd4\") " pod="openshift-ingress/e2e-worker-w5-626870-openshift-default-7cd649d59c-zchw8"
Oct 30 20:03:10.216152 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:03:10.215264    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5aec32f5-a318-4b0c-9c2f-2af7f36b8fd4-credential-socket\") pod \"e2e-worker-w5-626870-openshift-default-7cd649d59c-zchw8\" (UID: \"5aec32f5-a318-4b0c-9c2f-2af7f36b8fd4\") " pod="openshift-ingress/e2e-worker-w5-626870-openshift-default-7cd649d59c-zchw8"
Oct 30 20:03:10.219235 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:03:10.219212    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5aec32f5-a318-4b0c-9c2f-2af7f36b8fd4-istio-data\") pod \"e2e-worker-w5-626870-openshift-default-7cd649d59c-zchw8\" (UID: \"5aec32f5-a318-4b0c-9c2f-2af7f36b8fd4\") " pod="openshift-ingress/e2e-worker-w5-626870-openshift-default-7cd649d59c-zchw8"
Oct 30 20:03:10.221822 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:03:10.221797    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5aec32f5-a318-4b0c-9c2f-2af7f36b8fd4-istiod-ca-cert\") pod \"e2e-worker-w5-626870-openshift-default-7cd649d59c-zchw8\" (UID: \"5aec32f5-a318-4b0c-9c2f-2af7f36b8fd4\") " pod="openshift-ingress/e2e-worker-w5-626870-openshift-default-7cd649d59c-zchw8"
Oct 30 20:03:10.297450 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:03:10.283252    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5aec32f5-a318-4b0c-9c2f-2af7f36b8fd4-istio-token\") pod \"e2e-worker-w5-626870-openshift-default-7cd649d59c-zchw8\" (UID: \"5aec32f5-a318-4b0c-9c2f-2af7f36b8fd4\") " pod="openshift-ingress/e2e-worker-w5-626870-openshift-default-7cd649d59c-zchw8"
Oct 30 20:03:10.297450 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:03:10.283563    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5aec32f5-a318-4b0c-9c2f-2af7f36b8fd4-istio-envoy\") pod \"e2e-worker-w5-626870-openshift-default-7cd649d59c-zchw8\" (UID: \"5aec32f5-a318-4b0c-9c2f-2af7f36b8fd4\") " pod="openshift-ingress/e2e-worker-w5-626870-openshift-default-7cd649d59c-zchw8"
Oct 30 20:03:10.297450 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:03:10.285923    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nvbp9\" (UniqueName: \"kubernetes.io/projected/5aec32f5-a318-4b0c-9c2f-2af7f36b8fd4-kube-api-access-nvbp9\") pod \"e2e-worker-w5-626870-openshift-default-7cd649d59c-zchw8\" (UID: \"5aec32f5-a318-4b0c-9c2f-2af7f36b8fd4\") " pod="openshift-ingress/e2e-worker-w5-626870-openshift-default-7cd649d59c-zchw8"
Oct 30 20:03:10.336715 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:03:10.327937    6275 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-bl2ds"]
Oct 30 20:03:10.336715 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:03:10.328067    6275 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-bl2ds"
Oct 30 20:03:10.336715 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:03:10.328173    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5aec32f5-a318-4b0c-9c2f-2af7f36b8fd4-istio-podinfo\") pod \"e2e-worker-w5-626870-openshift-default-7cd649d59c-zchw8\" (UID: \"5aec32f5-a318-4b0c-9c2f-2af7f36b8fd4\") " pod="openshift-ingress/e2e-worker-w5-626870-openshift-default-7cd649d59c-zchw8"
Oct 30 20:03:10.429946 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:03:10.429898    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/23c6b368-9921-4b40-8d73-91f6be15fd07-workload-certs\") pod \"maas-default-gateway-openshift-default-7f5667f86c-bl2ds\" (UID: \"23c6b368-9921-4b40-8d73-91f6be15fd07\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-bl2ds"
Oct 30 20:03:10.430132 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:03:10.429982    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/23c6b368-9921-4b40-8d73-91f6be15fd07-workload-socket\") pod \"maas-default-gateway-openshift-default-7f5667f86c-bl2ds\" (UID: \"23c6b368-9921-4b40-8d73-91f6be15fd07\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-bl2ds"
Oct 30 20:03:10.430132 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:03:10.430051    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/23c6b368-9921-4b40-8d73-91f6be15fd07-istio-token\") pod \"maas-default-gateway-openshift-default-7f5667f86c-bl2ds\" (UID: \"23c6b368-9921-4b40-8d73-91f6be15fd07\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-bl2ds"
Oct 30 20:03:10.430132 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:03:10.430094    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nh5nl\" (UniqueName: \"kubernetes.io/projected/23c6b368-9921-4b40-8d73-91f6be15fd07-kube-api-access-nh5nl\") pod \"maas-default-gateway-openshift-default-7f5667f86c-bl2ds\" (UID: \"23c6b368-9921-4b40-8d73-91f6be15fd07\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-bl2ds"
Oct 30 20:03:10.430132 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:03:10.430124    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/23c6b368-9921-4b40-8d73-91f6be15fd07-istio-podinfo\") pod \"maas-default-gateway-openshift-default-7f5667f86c-bl2ds\" (UID: \"23c6b368-9921-4b40-8d73-91f6be15fd07\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-bl2ds"
Oct 30 20:03:10.430338 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:03:10.430249    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/23c6b368-9921-4b40-8d73-91f6be15fd07-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-7f5667f86c-bl2ds\" (UID: \"23c6b368-9921-4b40-8d73-91f6be15fd07\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-bl2ds"
Oct 30 20:03:10.430338 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:03:10.430310    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/23c6b368-9921-4b40-8d73-91f6be15fd07-istio-data\") pod \"maas-default-gateway-openshift-default-7f5667f86c-bl2ds\" (UID: \"23c6b368-9921-4b40-8d73-91f6be15fd07\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-bl2ds"
Oct 30 20:03:10.430489 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:03:10.430362    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/23c6b368-9921-4b40-8d73-91f6be15fd07-credential-socket\") pod \"maas-default-gateway-openshift-default-7f5667f86c-bl2ds\" (UID: \"23c6b368-9921-4b40-8d73-91f6be15fd07\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-bl2ds"
Oct 30 20:03:10.430489 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:03:10.430393    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/23c6b368-9921-4b40-8d73-91f6be15fd07-istio-envoy\") pod \"maas-default-gateway-openshift-default-7f5667f86c-bl2ds\" (UID: \"23c6b368-9921-4b40-8d73-91f6be15fd07\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-bl2ds"
Oct 30 20:03:10.532057 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:03:10.532011    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/23c6b368-9921-4b40-8d73-91f6be15fd07-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-7f5667f86c-bl2ds\" (UID: \"23c6b368-9921-4b40-8d73-91f6be15fd07\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-bl2ds"
Oct 30 20:03:10.532205 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:03:10.532089    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/23c6b368-9921-4b40-8d73-91f6be15fd07-istio-data\") pod \"maas-default-gateway-openshift-default-7f5667f86c-bl2ds\" (UID: \"23c6b368-9921-4b40-8d73-91f6be15fd07\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-bl2ds"
Oct 30 20:03:10.532205 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:03:10.532134    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/23c6b368-9921-4b40-8d73-91f6be15fd07-credential-socket\") pod \"maas-default-gateway-openshift-default-7f5667f86c-bl2ds\" (UID: \"23c6b368-9921-4b40-8d73-91f6be15fd07\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-bl2ds"
Oct 30 20:03:10.532205 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:03:10.532165    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/23c6b368-9921-4b40-8d73-91f6be15fd07-istio-envoy\") pod \"maas-default-gateway-openshift-default-7f5667f86c-bl2ds\" (UID: \"23c6b368-9921-4b40-8d73-91f6be15fd07\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-bl2ds"
Oct 30 20:03:10.532398 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:03:10.532227    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/23c6b368-9921-4b40-8d73-91f6be15fd07-workload-certs\") pod \"maas-default-gateway-openshift-default-7f5667f86c-bl2ds\" (UID: \"23c6b368-9921-4b40-8d73-91f6be15fd07\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-bl2ds"
Oct 30 20:03:10.532398 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:03:10.532278    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/23c6b368-9921-4b40-8d73-91f6be15fd07-workload-socket\") pod \"maas-default-gateway-openshift-default-7f5667f86c-bl2ds\" (UID: \"23c6b368-9921-4b40-8d73-91f6be15fd07\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-bl2ds"
Oct 30 20:03:10.532398 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:03:10.532310    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/23c6b368-9921-4b40-8d73-91f6be15fd07-istio-token\") pod \"maas-default-gateway-openshift-default-7f5667f86c-bl2ds\" (UID: \"23c6b368-9921-4b40-8d73-91f6be15fd07\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-bl2ds"
Oct 30 20:03:10.532398 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:03:10.532343    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nh5nl\" (UniqueName: \"kubernetes.io/projected/23c6b368-9921-4b40-8d73-91f6be15fd07-kube-api-access-nh5nl\") pod \"maas-default-gateway-openshift-default-7f5667f86c-bl2ds\" (UID: \"23c6b368-9921-4b40-8d73-91f6be15fd07\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-bl2ds"
Oct 30 20:03:10.532398 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:03:10.532372    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/23c6b368-9921-4b40-8d73-91f6be15fd07-istio-podinfo\") pod \"maas-default-gateway-openshift-default-7f5667f86c-bl2ds\" (UID: \"23c6b368-9921-4b40-8d73-91f6be15fd07\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-bl2ds"
Oct 30 20:03:10.532682 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:03:10.532538    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/23c6b368-9921-4b40-8d73-91f6be15fd07-istio-data\") pod \"maas-default-gateway-openshift-default-7f5667f86c-bl2ds\" (UID: \"23c6b368-9921-4b40-8d73-91f6be15fd07\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-bl2ds"
Oct 30 20:03:10.532820 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:03:10.532799    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/23c6b368-9921-4b40-8d73-91f6be15fd07-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-7f5667f86c-bl2ds\" (UID: \"23c6b368-9921-4b40-8d73-91f6be15fd07\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-bl2ds"
Oct 30 20:03:10.532887 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:03:10.532818    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/23c6b368-9921-4b40-8d73-91f6be15fd07-workload-socket\") pod \"maas-default-gateway-openshift-default-7f5667f86c-bl2ds\" (UID: \"23c6b368-9921-4b40-8d73-91f6be15fd07\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-bl2ds"
Oct 30 20:03:10.533120 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:03:10.533095    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/23c6b368-9921-4b40-8d73-91f6be15fd07-workload-certs\") pod \"maas-default-gateway-openshift-default-7f5667f86c-bl2ds\" (UID: \"23c6b368-9921-4b40-8d73-91f6be15fd07\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-bl2ds"
Oct 30 20:03:10.533778 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:03:10.533740    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/23c6b368-9921-4b40-8d73-91f6be15fd07-credential-socket\") pod \"maas-default-gateway-openshift-default-7f5667f86c-bl2ds\" (UID: \"23c6b368-9921-4b40-8d73-91f6be15fd07\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-bl2ds"
Oct 30 20:03:10.534841 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:03:10.534813    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/23c6b368-9921-4b40-8d73-91f6be15fd07-istio-envoy\") pod \"maas-default-gateway-openshift-default-7f5667f86c-bl2ds\" (UID: \"23c6b368-9921-4b40-8d73-91f6be15fd07\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-bl2ds"
Oct 30 20:03:10.535188 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:03:10.535169    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/23c6b368-9921-4b40-8d73-91f6be15fd07-istio-podinfo\") pod \"maas-default-gateway-openshift-default-7f5667f86c-bl2ds\" (UID: \"23c6b368-9921-4b40-8d73-91f6be15fd07\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-bl2ds"
Oct 30 20:03:10.558275 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:03:10.558246    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/23c6b368-9921-4b40-8d73-91f6be15fd07-istio-token\") pod \"maas-default-gateway-openshift-default-7f5667f86c-bl2ds\" (UID: \"23c6b368-9921-4b40-8d73-91f6be15fd07\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-bl2ds"
Oct 30 20:03:10.558347 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:03:10.558306    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nh5nl\" (UniqueName: \"kubernetes.io/projected/23c6b368-9921-4b40-8d73-91f6be15fd07-kube-api-access-nh5nl\") pod \"maas-default-gateway-openshift-default-7f5667f86c-bl2ds\" (UID: \"23c6b368-9921-4b40-8d73-91f6be15fd07\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-bl2ds"
Oct 30 20:03:10.602194 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:03:10.602168    6275 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-626870-openshift-default-7cd649d59c-zchw8"
Oct 30 20:03:10.683917 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:03:10.683862    6275 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-bl2ds"
Oct 30 20:03:10.941774 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:03:10.941745    6275 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w5-626870-openshift-default-7cd649d59c-zchw8"]
Oct 30 20:03:10.942025 ip-10-0-131-26 kubenswrapper[6275]: W1030 20:03:10.942004    6275 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5aec32f5_a318_4b0c_9c2f_2af7f36b8fd4.slice/crio-a72eee906c1fa02ec1cd33a2e45031eb0ba415de87d6737885bc470d477a83cb WatchSource:0}: Error finding container a72eee906c1fa02ec1cd33a2e45031eb0ba415de87d6737885bc470d477a83cb: Status 404 returned error can't find the container with id a72eee906c1fa02ec1cd33a2e45031eb0ba415de87d6737885bc470d477a83cb
Oct 30 20:03:10.944399 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:03:10.944366    6275 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Oct 30 20:03:10.944509 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:03:10.944443    6275 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Oct 30 20:03:10.944509 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:03:10.944471    6275 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Oct 30 20:03:11.038061 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:03:11.037997    6275 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-bl2ds"]
Oct 30 20:03:11.038795 ip-10-0-131-26 kubenswrapper[6275]: W1030 20:03:11.038767    6275 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod23c6b368_9921_4b40_8d73_91f6be15fd07.slice/crio-20ff74c6c83afc1dd0707260a97461dfe786832c812355c6d4c109cfa4a64eda WatchSource:0}: Error finding container 20ff74c6c83afc1dd0707260a97461dfe786832c812355c6d4c109cfa4a64eda: Status 404 returned error can't find the container with id 20ff74c6c83afc1dd0707260a97461dfe786832c812355c6d4c109cfa4a64eda
Oct 30 20:03:11.041037 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:03:11.041006    6275 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Oct 30 20:03:11.041116 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:03:11.041068    6275 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Oct 30 20:03:11.041116 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:03:11.041097    6275 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Oct 30 20:03:11.387022 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:03:11.386936    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-626870-openshift-default-7cd649d59c-zchw8" event={"ID":"5aec32f5-a318-4b0c-9c2f-2af7f36b8fd4","Type":"ContainerStarted","Data":"f79a5b92da7715f36409d00672164dd25ee74a9f37ca8852a4f9e37e39c5ee4f"}
Oct 30 20:03:11.387263 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:03:11.387228    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-626870-openshift-default-7cd649d59c-zchw8" event={"ID":"5aec32f5-a318-4b0c-9c2f-2af7f36b8fd4","Type":"ContainerStarted","Data":"a72eee906c1fa02ec1cd33a2e45031eb0ba415de87d6737885bc470d477a83cb"}
Oct 30 20:03:11.389464 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:03:11.389441    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-bl2ds" event={"ID":"23c6b368-9921-4b40-8d73-91f6be15fd07","Type":"ContainerStarted","Data":"4890d940856bca8a9ab7d1c98b984586201484e9e34e56973ddd9828d49dde4d"}
Oct 30 20:03:11.389569 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:03:11.389479    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-bl2ds" event={"ID":"23c6b368-9921-4b40-8d73-91f6be15fd07","Type":"ContainerStarted","Data":"20ff74c6c83afc1dd0707260a97461dfe786832c812355c6d4c109cfa4a64eda"}
Oct 30 20:03:11.550444 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:03:11.550370    6275 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w5-626870-openshift-default-7cd649d59c-zchw8" podStartSLOduration=2.550351468 podStartE2EDuration="2.550351468s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:03:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:03:11.546695806 +0000 UTC m=+902.008422695" watchObservedRunningTime="2026-10-30 20:03:11.550351468 +0000 UTC m=+902.012078331"
Oct 30 20:03:11.608478 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:03:11.606006    6275 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w5-626870-openshift-default-7cd649d59c-zchw8"
Oct 30 20:03:11.689493 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:03:11.688854    6275 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-bl2ds"
Oct 30 20:03:12.606443 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:03:12.605587    6275 patch_prober.go:29] interesting pod/e2e-worker-w5-626870-openshift-default-7cd649d59c-zchw8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.70:15021/healthz/ready\": dial tcp 10.134.0.70:15021: connect: connection refused" start-of-body=
Oct 30 20:03:12.606443 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:03:12.605648    6275 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-626870-openshift-default-7cd649d59c-zchw8" podUID="5aec32f5-a318-4b0c-9c2f-2af7f36b8fd4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.70:15021/healthz/ready\": dial tcp 10.134.0.70:15021: connect: connection refused"
Oct 30 20:03:12.692441 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:03:12.692197    6275 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-7f5667f86c-bl2ds container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.71:15021/healthz/ready\": dial tcp 10.134.0.71:15021: connect: connection refused" start-of-body=
Oct 30 20:03:12.692441 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:03:12.692271    6275 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-bl2ds" podUID="23c6b368-9921-4b40-8d73-91f6be15fd07" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.71:15021/healthz/ready\": dial tcp 10.134.0.71:15021: connect: connection refused"
Oct 30 20:03:13.605811 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:03:13.605761    6275 patch_prober.go:29] interesting pod/e2e-worker-w5-626870-openshift-default-7cd649d59c-zchw8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.70:15021/healthz/ready\": dial tcp 10.134.0.70:15021: connect: connection refused" start-of-body=
Oct 30 20:03:13.606118 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:03:13.606076    6275 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-626870-openshift-default-7cd649d59c-zchw8" podUID="5aec32f5-a318-4b0c-9c2f-2af7f36b8fd4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.70:15021/healthz/ready\": dial tcp 10.134.0.70:15021: connect: connection refused"
Oct 30 20:03:13.690562 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:03:13.690529    6275 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-7f5667f86c-bl2ds container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.71:15021/healthz/ready\": dial tcp 10.134.0.71:15021: connect: connection refused" start-of-body=
Oct 30 20:03:13.690797 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:03:13.690774    6275 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-bl2ds" podUID="23c6b368-9921-4b40-8d73-91f6be15fd07" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.71:15021/healthz/ready\": dial tcp 10.134.0.71:15021: connect: connection refused"
Oct 30 20:03:14.616437 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:03:14.614337    6275 patch_prober.go:29] interesting pod/e2e-worker-w5-626870-openshift-default-7cd649d59c-zchw8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.70:15021/healthz/ready\": dial tcp 10.134.0.70:15021: connect: connection refused" start-of-body=
Oct 30 20:03:14.616437 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:03:14.614406    6275 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-626870-openshift-default-7cd649d59c-zchw8" podUID="5aec32f5-a318-4b0c-9c2f-2af7f36b8fd4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.70:15021/healthz/ready\": dial tcp 10.134.0.70:15021: connect: connection refused"
Oct 30 20:03:14.706654 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:03:14.706619    6275 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-7f5667f86c-bl2ds container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.71:15021/healthz/ready\": dial tcp 10.134.0.71:15021: connect: connection refused" start-of-body=
Oct 30 20:03:14.706900 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:03:14.706873    6275 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-bl2ds" podUID="23c6b368-9921-4b40-8d73-91f6be15fd07" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.71:15021/healthz/ready\": dial tcp 10.134.0.71:15021: connect: connection refused"
Oct 30 20:03:15.607437 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:03:15.606878    6275 patch_prober.go:29] interesting pod/e2e-worker-w5-626870-openshift-default-7cd649d59c-zchw8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.70:15021/healthz/ready\": dial tcp 10.134.0.70:15021: connect: connection refused" start-of-body=
Oct 30 20:03:15.607437 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:03:15.606949    6275 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-626870-openshift-default-7cd649d59c-zchw8" podUID="5aec32f5-a318-4b0c-9c2f-2af7f36b8fd4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.70:15021/healthz/ready\": dial tcp 10.134.0.70:15021: connect: connection refused"
Oct 30 20:03:15.691437 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:03:15.690774    6275 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-7f5667f86c-bl2ds container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.71:15021/healthz/ready\": dial tcp 10.134.0.71:15021: connect: connection refused" start-of-body=
Oct 30 20:03:15.691437 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:03:15.690833    6275 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-bl2ds" podUID="23c6b368-9921-4b40-8d73-91f6be15fd07" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.71:15021/healthz/ready\": dial tcp 10.134.0.71:15021: connect: connection refused"
Oct 30 20:03:15.788438 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:03:15.787481    6275 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w1-5f10d2/distinct-w1-5f10d2-kserve-5bf49798b8-l2j84"
Oct 30 20:03:15.830382 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:03:15.830352    6275 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w1-5f10d2/distinct-w1-5f10d2-kserve-5bf49798b8-l2j84"
Oct 30 20:03:15.895487 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:03:15.890586    6275 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-bl2ds" podStartSLOduration=5.890565626 podStartE2EDuration="5.890565626s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:03:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:03:11.715760583 +0000 UTC m=+902.177487447" watchObservedRunningTime="2026-10-30 20:03:15.890565626 +0000 UTC m=+906.352292490"
Oct 30 20:03:16.459572 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:03:16.459545    6275 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w1-5f10d2/distinct-w1-5f10d2-kserve-5bf49798b8-l2j84"
Oct 30 20:03:16.615440 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:03:16.614888    6275 patch_prober.go:29] interesting pod/e2e-worker-w5-626870-openshift-default-7cd649d59c-zchw8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.70:15021/healthz/ready\": dial tcp 10.134.0.70:15021: connect: connection refused" start-of-body=
Oct 30 20:03:16.615440 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:03:16.614947    6275 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-626870-openshift-default-7cd649d59c-zchw8" podUID="5aec32f5-a318-4b0c-9c2f-2af7f36b8fd4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.70:15021/healthz/ready\": dial tcp 10.134.0.70:15021: connect: connection refused"
Oct 30 20:03:16.687441 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:03:16.685950    6275 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-7f5667f86c-bl2ds container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.71:15021/healthz/ready\": dial tcp 10.134.0.71:15021: connect: connection refused" start-of-body=
Oct 30 20:03:16.687441 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:03:16.686006    6275 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-bl2ds" podUID="23c6b368-9921-4b40-8d73-91f6be15fd07" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.71:15021/healthz/ready\": dial tcp 10.134.0.71:15021: connect: connection refused"
Oct 30 20:03:17.602994 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:03:17.602957    6275 patch_prober.go:29] interesting pod/e2e-worker-w5-626870-openshift-default-7cd649d59c-zchw8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.70:15021/healthz/ready\": dial tcp 10.134.0.70:15021: connect: connection refused" start-of-body=
Oct 30 20:03:17.603471 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:03:17.603023    6275 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-626870-openshift-default-7cd649d59c-zchw8" podUID="5aec32f5-a318-4b0c-9c2f-2af7f36b8fd4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.70:15021/healthz/ready\": dial tcp 10.134.0.70:15021: connect: connection refused"
Oct 30 20:03:17.685694 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:03:17.685651    6275 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-7f5667f86c-bl2ds container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.71:15021/healthz/ready\": dial tcp 10.134.0.71:15021: connect: connection refused" start-of-body=
Oct 30 20:03:17.685886 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:03:17.685732    6275 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-bl2ds" podUID="23c6b368-9921-4b40-8d73-91f6be15fd07" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.71:15021/healthz/ready\": dial tcp 10.134.0.71:15021: connect: connection refused"
Oct 30 20:03:18.607674 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:03:18.607645    6275 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w5-626870-openshift-default-7cd649d59c-zchw8"
Oct 30 20:03:18.608156 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:03:18.608139    6275 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w5-626870-openshift-default-7cd649d59c-zchw8"
Oct 30 20:03:18.608801 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:03:18.608779    6275 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w5-626870-openshift-default-7cd649d59c-zchw8"
Oct 30 20:03:18.685403 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:03:18.685360    6275 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-7f5667f86c-bl2ds container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.71:15021/healthz/ready\": dial tcp 10.134.0.71:15021: connect: connection refused" start-of-body=
Oct 30 20:03:18.685588 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:03:18.685450    6275 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-bl2ds" podUID="23c6b368-9921-4b40-8d73-91f6be15fd07" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.71:15021/healthz/ready\": dial tcp 10.134.0.71:15021: connect: connection refused"
Oct 30 20:03:19.733489 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:03:19.733455    6275 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-bl2ds"
Oct 30 20:03:19.733961 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:03:19.733843    6275 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-bl2ds"
Oct 30 20:03:19.734798 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:03:19.734776    6275 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-bl2ds"
Oct 30 20:03:25.294184 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:03:25.294105    6275 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w3-912f24-openshift-default-5f56ff5f6c-w5dh9"]
Oct 30 20:03:25.299578 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:03:25.299557    6275 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-912f24-openshift-default-5f56ff5f6c-w5dh9"
Oct 30 20:03:25.317043 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:03:25.317022    6275 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w3-912f24-openshift-default-dockercfg-pzcfl\""
Oct 30 20:03:25.331566 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:03:25.331541    6275 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w3-912f24-openshift-default-5f56ff5f6c-w5dh9"]
Oct 30 20:03:25.356606 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:03:25.356581    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d499ec6a-7c42-4ba2-b4c6-19c6fe1caa99-workload-socket\") pod \"e2e-worker-w3-912f24-openshift-default-5f56ff5f6c-w5dh9\" (UID: \"d499ec6a-7c42-4ba2-b4c6-19c6fe1caa99\") " pod="openshift-ingress/e2e-worker-w3-912f24-openshift-default-5f56ff5f6c-w5dh9"
Oct 30 20:03:25.356728 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:03:25.356615    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d499ec6a-7c42-4ba2-b4c6-19c6fe1caa99-credential-socket\") pod \"e2e-worker-w3-912f24-openshift-default-5f56ff5f6c-w5dh9\" (UID: \"d499ec6a-7c42-4ba2-b4c6-19c6fe1caa99\") " pod="openshift-ingress/e2e-worker-w3-912f24-openshift-default-5f56ff5f6c-w5dh9"
Oct 30 20:03:25.356728 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:03:25.356639    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d499ec6a-7c42-4ba2-b4c6-19c6fe1caa99-istiod-ca-cert\") pod \"e2e-worker-w3-912f24-openshift-default-5f56ff5f6c-w5dh9\" (UID: \"d499ec6a-7c42-4ba2-b4c6-19c6fe1caa99\") " pod="openshift-ingress/e2e-worker-w3-912f24-openshift-default-5f56ff5f6c-w5dh9"
Oct 30 20:03:25.356812 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:03:25.356727    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d499ec6a-7c42-4ba2-b4c6-19c6fe1caa99-workload-certs\") pod \"e2e-worker-w3-912f24-openshift-default-5f56ff5f6c-w5dh9\" (UID: \"d499ec6a-7c42-4ba2-b4c6-19c6fe1caa99\") " pod="openshift-ingress/e2e-worker-w3-912f24-openshift-default-5f56ff5f6c-w5dh9"
Oct 30 20:03:25.356812 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:03:25.356792    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d499ec6a-7c42-4ba2-b4c6-19c6fe1caa99-istio-token\") pod \"e2e-worker-w3-912f24-openshift-default-5f56ff5f6c-w5dh9\" (UID: \"d499ec6a-7c42-4ba2-b4c6-19c6fe1caa99\") " pod="openshift-ingress/e2e-worker-w3-912f24-openshift-default-5f56ff5f6c-w5dh9"
Oct 30 20:03:25.357230 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:03:25.356826    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nrlrp\" (UniqueName: \"kubernetes.io/projected/d499ec6a-7c42-4ba2-b4c6-19c6fe1caa99-kube-api-access-nrlrp\") pod \"e2e-worker-w3-912f24-openshift-default-5f56ff5f6c-w5dh9\" (UID: \"d499ec6a-7c42-4ba2-b4c6-19c6fe1caa99\") " pod="openshift-ingress/e2e-worker-w3-912f24-openshift-default-5f56ff5f6c-w5dh9"
Oct 30 20:03:25.357230 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:03:25.356952    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d499ec6a-7c42-4ba2-b4c6-19c6fe1caa99-istio-envoy\") pod \"e2e-worker-w3-912f24-openshift-default-5f56ff5f6c-w5dh9\" (UID: \"d499ec6a-7c42-4ba2-b4c6-19c6fe1caa99\") " pod="openshift-ingress/e2e-worker-w3-912f24-openshift-default-5f56ff5f6c-w5dh9"
Oct 30 20:03:25.357230 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:03:25.357063    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d499ec6a-7c42-4ba2-b4c6-19c6fe1caa99-istio-data\") pod \"e2e-worker-w3-912f24-openshift-default-5f56ff5f6c-w5dh9\" (UID: \"d499ec6a-7c42-4ba2-b4c6-19c6fe1caa99\") " pod="openshift-ingress/e2e-worker-w3-912f24-openshift-default-5f56ff5f6c-w5dh9"
Oct 30 20:03:25.357230 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:03:25.357104    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d499ec6a-7c42-4ba2-b4c6-19c6fe1caa99-istio-podinfo\") pod \"e2e-worker-w3-912f24-openshift-default-5f56ff5f6c-w5dh9\" (UID: \"d499ec6a-7c42-4ba2-b4c6-19c6fe1caa99\") " pod="openshift-ingress/e2e-worker-w3-912f24-openshift-default-5f56ff5f6c-w5dh9"
Oct 30 20:03:25.457881 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:03:25.457855    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d499ec6a-7c42-4ba2-b4c6-19c6fe1caa99-istio-token\") pod \"e2e-worker-w3-912f24-openshift-default-5f56ff5f6c-w5dh9\" (UID: \"d499ec6a-7c42-4ba2-b4c6-19c6fe1caa99\") " pod="openshift-ingress/e2e-worker-w3-912f24-openshift-default-5f56ff5f6c-w5dh9"
Oct 30 20:03:25.458000 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:03:25.457899    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nrlrp\" (UniqueName: \"kubernetes.io/projected/d499ec6a-7c42-4ba2-b4c6-19c6fe1caa99-kube-api-access-nrlrp\") pod \"e2e-worker-w3-912f24-openshift-default-5f56ff5f6c-w5dh9\" (UID: \"d499ec6a-7c42-4ba2-b4c6-19c6fe1caa99\") " pod="openshift-ingress/e2e-worker-w3-912f24-openshift-default-5f56ff5f6c-w5dh9"
Oct 30 20:03:25.458000 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:03:25.457957    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d499ec6a-7c42-4ba2-b4c6-19c6fe1caa99-istio-envoy\") pod \"e2e-worker-w3-912f24-openshift-default-5f56ff5f6c-w5dh9\" (UID: \"d499ec6a-7c42-4ba2-b4c6-19c6fe1caa99\") " pod="openshift-ingress/e2e-worker-w3-912f24-openshift-default-5f56ff5f6c-w5dh9"
Oct 30 20:03:25.458091 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:03:25.458016    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d499ec6a-7c42-4ba2-b4c6-19c6fe1caa99-istio-data\") pod \"e2e-worker-w3-912f24-openshift-default-5f56ff5f6c-w5dh9\" (UID: \"d499ec6a-7c42-4ba2-b4c6-19c6fe1caa99\") " pod="openshift-ingress/e2e-worker-w3-912f24-openshift-default-5f56ff5f6c-w5dh9"
Oct 30 20:03:25.458091 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:03:25.458045    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d499ec6a-7c42-4ba2-b4c6-19c6fe1caa99-istio-podinfo\") pod \"e2e-worker-w3-912f24-openshift-default-5f56ff5f6c-w5dh9\" (UID: \"d499ec6a-7c42-4ba2-b4c6-19c6fe1caa99\") " pod="openshift-ingress/e2e-worker-w3-912f24-openshift-default-5f56ff5f6c-w5dh9"
Oct 30 20:03:25.458207 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:03:25.458129    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d499ec6a-7c42-4ba2-b4c6-19c6fe1caa99-workload-socket\") pod \"e2e-worker-w3-912f24-openshift-default-5f56ff5f6c-w5dh9\" (UID: \"d499ec6a-7c42-4ba2-b4c6-19c6fe1caa99\") " pod="openshift-ingress/e2e-worker-w3-912f24-openshift-default-5f56ff5f6c-w5dh9"
Oct 30 20:03:25.458207 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:03:25.458161    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d499ec6a-7c42-4ba2-b4c6-19c6fe1caa99-credential-socket\") pod \"e2e-worker-w3-912f24-openshift-default-5f56ff5f6c-w5dh9\" (UID: \"d499ec6a-7c42-4ba2-b4c6-19c6fe1caa99\") " pod="openshift-ingress/e2e-worker-w3-912f24-openshift-default-5f56ff5f6c-w5dh9"
Oct 30 20:03:25.458207 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:03:25.458195    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d499ec6a-7c42-4ba2-b4c6-19c6fe1caa99-istiod-ca-cert\") pod \"e2e-worker-w3-912f24-openshift-default-5f56ff5f6c-w5dh9\" (UID: \"d499ec6a-7c42-4ba2-b4c6-19c6fe1caa99\") " pod="openshift-ingress/e2e-worker-w3-912f24-openshift-default-5f56ff5f6c-w5dh9"
Oct 30 20:03:25.458372 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:03:25.458231    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d499ec6a-7c42-4ba2-b4c6-19c6fe1caa99-workload-certs\") pod \"e2e-worker-w3-912f24-openshift-default-5f56ff5f6c-w5dh9\" (UID: \"d499ec6a-7c42-4ba2-b4c6-19c6fe1caa99\") " pod="openshift-ingress/e2e-worker-w3-912f24-openshift-default-5f56ff5f6c-w5dh9"
Oct 30 20:03:25.459046 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:03:25.459020    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d499ec6a-7c42-4ba2-b4c6-19c6fe1caa99-istiod-ca-cert\") pod \"e2e-worker-w3-912f24-openshift-default-5f56ff5f6c-w5dh9\" (UID: \"d499ec6a-7c42-4ba2-b4c6-19c6fe1caa99\") " pod="openshift-ingress/e2e-worker-w3-912f24-openshift-default-5f56ff5f6c-w5dh9"
Oct 30 20:03:25.459261 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:03:25.459233    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d499ec6a-7c42-4ba2-b4c6-19c6fe1caa99-workload-socket\") pod \"e2e-worker-w3-912f24-openshift-default-5f56ff5f6c-w5dh9\" (UID: \"d499ec6a-7c42-4ba2-b4c6-19c6fe1caa99\") " pod="openshift-ingress/e2e-worker-w3-912f24-openshift-default-5f56ff5f6c-w5dh9"
Oct 30 20:03:25.459527 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:03:25.459495    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d499ec6a-7c42-4ba2-b4c6-19c6fe1caa99-istio-data\") pod \"e2e-worker-w3-912f24-openshift-default-5f56ff5f6c-w5dh9\" (UID: \"d499ec6a-7c42-4ba2-b4c6-19c6fe1caa99\") " pod="openshift-ingress/e2e-worker-w3-912f24-openshift-default-5f56ff5f6c-w5dh9"
Oct 30 20:03:25.460295 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:03:25.459664    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d499ec6a-7c42-4ba2-b4c6-19c6fe1caa99-credential-socket\") pod \"e2e-worker-w3-912f24-openshift-default-5f56ff5f6c-w5dh9\" (UID: \"d499ec6a-7c42-4ba2-b4c6-19c6fe1caa99\") " pod="openshift-ingress/e2e-worker-w3-912f24-openshift-default-5f56ff5f6c-w5dh9"
Oct 30 20:03:25.460295 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:03:25.459839    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d499ec6a-7c42-4ba2-b4c6-19c6fe1caa99-workload-certs\") pod \"e2e-worker-w3-912f24-openshift-default-5f56ff5f6c-w5dh9\" (UID: \"d499ec6a-7c42-4ba2-b4c6-19c6fe1caa99\") " pod="openshift-ingress/e2e-worker-w3-912f24-openshift-default-5f56ff5f6c-w5dh9"
Oct 30 20:03:25.460811 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:03:25.460766    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d499ec6a-7c42-4ba2-b4c6-19c6fe1caa99-istio-envoy\") pod \"e2e-worker-w3-912f24-openshift-default-5f56ff5f6c-w5dh9\" (UID: \"d499ec6a-7c42-4ba2-b4c6-19c6fe1caa99\") " pod="openshift-ingress/e2e-worker-w3-912f24-openshift-default-5f56ff5f6c-w5dh9"
Oct 30 20:03:25.461303 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:03:25.461282    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d499ec6a-7c42-4ba2-b4c6-19c6fe1caa99-istio-podinfo\") pod \"e2e-worker-w3-912f24-openshift-default-5f56ff5f6c-w5dh9\" (UID: \"d499ec6a-7c42-4ba2-b4c6-19c6fe1caa99\") " pod="openshift-ingress/e2e-worker-w3-912f24-openshift-default-5f56ff5f6c-w5dh9"
Oct 30 20:03:25.483582 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:03:25.483563    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nrlrp\" (UniqueName: \"kubernetes.io/projected/d499ec6a-7c42-4ba2-b4c6-19c6fe1caa99-kube-api-access-nrlrp\") pod \"e2e-worker-w3-912f24-openshift-default-5f56ff5f6c-w5dh9\" (UID: \"d499ec6a-7c42-4ba2-b4c6-19c6fe1caa99\") " pod="openshift-ingress/e2e-worker-w3-912f24-openshift-default-5f56ff5f6c-w5dh9"
Oct 30 20:03:25.483752 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:03:25.483732    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d499ec6a-7c42-4ba2-b4c6-19c6fe1caa99-istio-token\") pod \"e2e-worker-w3-912f24-openshift-default-5f56ff5f6c-w5dh9\" (UID: \"d499ec6a-7c42-4ba2-b4c6-19c6fe1caa99\") " pod="openshift-ingress/e2e-worker-w3-912f24-openshift-default-5f56ff5f6c-w5dh9"
Oct 30 20:03:25.614063 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:03:25.613993    6275 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-912f24-openshift-default-5f56ff5f6c-w5dh9"
Oct 30 20:03:25.942996 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:03:25.942968    6275 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w3-912f24-openshift-default-5f56ff5f6c-w5dh9"]
Oct 30 20:03:25.943241 ip-10-0-131-26 kubenswrapper[6275]: W1030 20:03:25.943219    6275 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd499ec6a_7c42_4ba2_b4c6_19c6fe1caa99.slice/crio-e87b10da156d499218db59914b8d9b91ec96b65036322b1fe0eaff71ebff4397 WatchSource:0}: Error finding container e87b10da156d499218db59914b8d9b91ec96b65036322b1fe0eaff71ebff4397: Status 404 returned error can't find the container with id e87b10da156d499218db59914b8d9b91ec96b65036322b1fe0eaff71ebff4397
Oct 30 20:03:25.946009 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:03:25.945979    6275 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Oct 30 20:03:25.946088 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:03:25.946042    6275 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Oct 30 20:03:25.946088 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:03:25.946074    6275 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Oct 30 20:03:26.260516 ip-10-0-131-26 kubenswrapper[6275]: E1030 20:03:26.260477    6275 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-fwc77" containerName="extractor"
Oct 30 20:03:26.521559 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:03:26.521464    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-912f24-openshift-default-5f56ff5f6c-w5dh9" event={"ID":"d499ec6a-7c42-4ba2-b4c6-19c6fe1caa99","Type":"ContainerStarted","Data":"3dcc11efdf9b09a50116a56af3f886d34ca66a8c4800f9c2ee602fda7ed1c898"}
Oct 30 20:03:26.521559 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:03:26.521522    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-912f24-openshift-default-5f56ff5f6c-w5dh9" event={"ID":"d499ec6a-7c42-4ba2-b4c6-19c6fe1caa99","Type":"ContainerStarted","Data":"e87b10da156d499218db59914b8d9b91ec96b65036322b1fe0eaff71ebff4397"}
Oct 30 20:03:26.585283 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:03:26.585224    6275 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w3-912f24-openshift-default-5f56ff5f6c-w5dh9" podStartSLOduration=1.585204268 podStartE2EDuration="1.585204268s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:03:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:03:26.58328111 +0000 UTC m=+917.045007977" watchObservedRunningTime="2026-10-30 20:03:26.585204268 +0000 UTC m=+917.046931134"
Oct 30 20:03:26.615831 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:03:26.615795    6275 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w3-912f24-openshift-default-5f56ff5f6c-w5dh9"
Oct 30 20:03:27.616156 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:03:27.616123    6275 patch_prober.go:29] interesting pod/e2e-worker-w3-912f24-openshift-default-5f56ff5f6c-w5dh9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.72:15021/healthz/ready\": dial tcp 10.134.0.72:15021: connect: connection refused" start-of-body=
Oct 30 20:03:27.616654 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:03:27.616169    6275 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-912f24-openshift-default-5f56ff5f6c-w5dh9" podUID="d499ec6a-7c42-4ba2-b4c6-19c6fe1caa99" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.72:15021/healthz/ready\": dial tcp 10.134.0.72:15021: connect: connection refused"
Oct 30 20:03:28.615124 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:03:28.615095    6275 patch_prober.go:29] interesting pod/e2e-worker-w3-912f24-openshift-default-5f56ff5f6c-w5dh9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.72:15021/healthz/ready\": dial tcp 10.134.0.72:15021: connect: connection refused" start-of-body=
Oct 30 20:03:28.615357 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:03:28.615336    6275 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-912f24-openshift-default-5f56ff5f6c-w5dh9" podUID="d499ec6a-7c42-4ba2-b4c6-19c6fe1caa99" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.72:15021/healthz/ready\": dial tcp 10.134.0.72:15021: connect: connection refused"
Oct 30 20:03:29.614859 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:03:29.614821    6275 patch_prober.go:29] interesting pod/e2e-worker-w3-912f24-openshift-default-5f56ff5f6c-w5dh9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.72:15021/healthz/ready\": dial tcp 10.134.0.72:15021: connect: connection refused" start-of-body=
Oct 30 20:03:29.615407 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:03:29.615375    6275 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-912f24-openshift-default-5f56ff5f6c-w5dh9" podUID="d499ec6a-7c42-4ba2-b4c6-19c6fe1caa99" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.72:15021/healthz/ready\": dial tcp 10.134.0.72:15021: connect: connection refused"
Oct 30 20:03:30.614775 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:03:30.614745    6275 patch_prober.go:29] interesting pod/e2e-worker-w3-912f24-openshift-default-5f56ff5f6c-w5dh9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.72:15021/healthz/ready\": dial tcp 10.134.0.72:15021: connect: connection refused" start-of-body=
Oct 30 20:03:30.614954 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:03:30.614804    6275 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-912f24-openshift-default-5f56ff5f6c-w5dh9" podUID="d499ec6a-7c42-4ba2-b4c6-19c6fe1caa99" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.72:15021/healthz/ready\": dial tcp 10.134.0.72:15021: connect: connection refused"
Oct 30 20:03:31.614278 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:03:31.614241    6275 patch_prober.go:29] interesting pod/e2e-worker-w3-912f24-openshift-default-5f56ff5f6c-w5dh9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.72:15021/healthz/ready\": dial tcp 10.134.0.72:15021: connect: connection refused" start-of-body=
Oct 30 20:03:31.614496 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:03:31.614292    6275 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-912f24-openshift-default-5f56ff5f6c-w5dh9" podUID="d499ec6a-7c42-4ba2-b4c6-19c6fe1caa99" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.72:15021/healthz/ready\": dial tcp 10.134.0.72:15021: connect: connection refused"
Oct 30 20:03:32.807215 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:03:32.807175    6275 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w3-912f24-openshift-default-5f56ff5f6c-w5dh9"
Oct 30 20:03:32.810437 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:03:32.808248    6275 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w3-912f24-openshift-default-5f56ff5f6c-w5dh9"
Oct 30 20:03:32.810437 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:03:32.809618    6275 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w3-912f24-openshift-default-5f56ff5f6c-w5dh9"
Oct 30 20:03:55.529900 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:03:55.529863    6275 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w6-51dd62-openshift-default-7954bd8797-qhldt"]
Oct 30 20:03:55.535218 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:03:55.535197    6275 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-51dd62-openshift-default-7954bd8797-qhldt"
Oct 30 20:03:55.556063 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:03:55.556031    6275 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w6-51dd62-openshift-default-dockercfg-678jt\""
Oct 30 20:03:55.569963 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:03:55.569937    6275 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w6-51dd62-openshift-default-7954bd8797-qhldt"]
Oct 30 20:03:55.643090 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:03:55.643056    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8d508b96-1463-414f-85be-ba11cc47d5c7-credential-socket\") pod \"e2e-worker-w6-51dd62-openshift-default-7954bd8797-qhldt\" (UID: \"8d508b96-1463-414f-85be-ba11cc47d5c7\") " pod="openshift-ingress/e2e-worker-w6-51dd62-openshift-default-7954bd8797-qhldt"
Oct 30 20:03:55.643276 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:03:55.643212    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8d508b96-1463-414f-85be-ba11cc47d5c7-istio-podinfo\") pod \"e2e-worker-w6-51dd62-openshift-default-7954bd8797-qhldt\" (UID: \"8d508b96-1463-414f-85be-ba11cc47d5c7\") " pod="openshift-ingress/e2e-worker-w6-51dd62-openshift-default-7954bd8797-qhldt"
Oct 30 20:03:55.643356 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:03:55.643308    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8d508b96-1463-414f-85be-ba11cc47d5c7-istiod-ca-cert\") pod \"e2e-worker-w6-51dd62-openshift-default-7954bd8797-qhldt\" (UID: \"8d508b96-1463-414f-85be-ba11cc47d5c7\") " pod="openshift-ingress/e2e-worker-w6-51dd62-openshift-default-7954bd8797-qhldt"
Oct 30 20:03:55.643429 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:03:55.643382    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8d508b96-1463-414f-85be-ba11cc47d5c7-workload-socket\") pod \"e2e-worker-w6-51dd62-openshift-default-7954bd8797-qhldt\" (UID: \"8d508b96-1463-414f-85be-ba11cc47d5c7\") " pod="openshift-ingress/e2e-worker-w6-51dd62-openshift-default-7954bd8797-qhldt"
Oct 30 20:03:55.643526 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:03:55.643510    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8d508b96-1463-414f-85be-ba11cc47d5c7-workload-certs\") pod \"e2e-worker-w6-51dd62-openshift-default-7954bd8797-qhldt\" (UID: \"8d508b96-1463-414f-85be-ba11cc47d5c7\") " pod="openshift-ingress/e2e-worker-w6-51dd62-openshift-default-7954bd8797-qhldt"
Oct 30 20:03:55.643769 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:03:55.643589    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8d508b96-1463-414f-85be-ba11cc47d5c7-istio-envoy\") pod \"e2e-worker-w6-51dd62-openshift-default-7954bd8797-qhldt\" (UID: \"8d508b96-1463-414f-85be-ba11cc47d5c7\") " pod="openshift-ingress/e2e-worker-w6-51dd62-openshift-default-7954bd8797-qhldt"
Oct 30 20:03:55.643769 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:03:55.643673    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8d508b96-1463-414f-85be-ba11cc47d5c7-istio-token\") pod \"e2e-worker-w6-51dd62-openshift-default-7954bd8797-qhldt\" (UID: \"8d508b96-1463-414f-85be-ba11cc47d5c7\") " pod="openshift-ingress/e2e-worker-w6-51dd62-openshift-default-7954bd8797-qhldt"
Oct 30 20:03:55.643769 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:03:55.643704    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8d508b96-1463-414f-85be-ba11cc47d5c7-istio-data\") pod \"e2e-worker-w6-51dd62-openshift-default-7954bd8797-qhldt\" (UID: \"8d508b96-1463-414f-85be-ba11cc47d5c7\") " pod="openshift-ingress/e2e-worker-w6-51dd62-openshift-default-7954bd8797-qhldt"
Oct 30 20:03:55.643985 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:03:55.643850    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-44m44\" (UniqueName: \"kubernetes.io/projected/8d508b96-1463-414f-85be-ba11cc47d5c7-kube-api-access-44m44\") pod \"e2e-worker-w6-51dd62-openshift-default-7954bd8797-qhldt\" (UID: \"8d508b96-1463-414f-85be-ba11cc47d5c7\") " pod="openshift-ingress/e2e-worker-w6-51dd62-openshift-default-7954bd8797-qhldt"
Oct 30 20:03:55.745376 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:03:55.745342    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8d508b96-1463-414f-85be-ba11cc47d5c7-istio-podinfo\") pod \"e2e-worker-w6-51dd62-openshift-default-7954bd8797-qhldt\" (UID: \"8d508b96-1463-414f-85be-ba11cc47d5c7\") " pod="openshift-ingress/e2e-worker-w6-51dd62-openshift-default-7954bd8797-qhldt"
Oct 30 20:03:55.745376 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:03:55.745381    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8d508b96-1463-414f-85be-ba11cc47d5c7-istiod-ca-cert\") pod \"e2e-worker-w6-51dd62-openshift-default-7954bd8797-qhldt\" (UID: \"8d508b96-1463-414f-85be-ba11cc47d5c7\") " pod="openshift-ingress/e2e-worker-w6-51dd62-openshift-default-7954bd8797-qhldt"
Oct 30 20:03:55.745635 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:03:55.745407    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8d508b96-1463-414f-85be-ba11cc47d5c7-workload-socket\") pod \"e2e-worker-w6-51dd62-openshift-default-7954bd8797-qhldt\" (UID: \"8d508b96-1463-414f-85be-ba11cc47d5c7\") " pod="openshift-ingress/e2e-worker-w6-51dd62-openshift-default-7954bd8797-qhldt"
Oct 30 20:03:55.745635 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:03:55.745462    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8d508b96-1463-414f-85be-ba11cc47d5c7-workload-certs\") pod \"e2e-worker-w6-51dd62-openshift-default-7954bd8797-qhldt\" (UID: \"8d508b96-1463-414f-85be-ba11cc47d5c7\") " pod="openshift-ingress/e2e-worker-w6-51dd62-openshift-default-7954bd8797-qhldt"
Oct 30 20:03:55.745635 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:03:55.745489    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8d508b96-1463-414f-85be-ba11cc47d5c7-istio-envoy\") pod \"e2e-worker-w6-51dd62-openshift-default-7954bd8797-qhldt\" (UID: \"8d508b96-1463-414f-85be-ba11cc47d5c7\") " pod="openshift-ingress/e2e-worker-w6-51dd62-openshift-default-7954bd8797-qhldt"
Oct 30 20:03:55.745635 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:03:55.745549    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8d508b96-1463-414f-85be-ba11cc47d5c7-istio-token\") pod \"e2e-worker-w6-51dd62-openshift-default-7954bd8797-qhldt\" (UID: \"8d508b96-1463-414f-85be-ba11cc47d5c7\") " pod="openshift-ingress/e2e-worker-w6-51dd62-openshift-default-7954bd8797-qhldt"
Oct 30 20:03:55.745635 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:03:55.745569    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8d508b96-1463-414f-85be-ba11cc47d5c7-istio-data\") pod \"e2e-worker-w6-51dd62-openshift-default-7954bd8797-qhldt\" (UID: \"8d508b96-1463-414f-85be-ba11cc47d5c7\") " pod="openshift-ingress/e2e-worker-w6-51dd62-openshift-default-7954bd8797-qhldt"
Oct 30 20:03:55.745635 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:03:55.745627    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-44m44\" (UniqueName: \"kubernetes.io/projected/8d508b96-1463-414f-85be-ba11cc47d5c7-kube-api-access-44m44\") pod \"e2e-worker-w6-51dd62-openshift-default-7954bd8797-qhldt\" (UID: \"8d508b96-1463-414f-85be-ba11cc47d5c7\") " pod="openshift-ingress/e2e-worker-w6-51dd62-openshift-default-7954bd8797-qhldt"
Oct 30 20:03:55.745919 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:03:55.745665    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8d508b96-1463-414f-85be-ba11cc47d5c7-credential-socket\") pod \"e2e-worker-w6-51dd62-openshift-default-7954bd8797-qhldt\" (UID: \"8d508b96-1463-414f-85be-ba11cc47d5c7\") " pod="openshift-ingress/e2e-worker-w6-51dd62-openshift-default-7954bd8797-qhldt"
Oct 30 20:03:55.746016 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:03:55.745992    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8d508b96-1463-414f-85be-ba11cc47d5c7-workload-socket\") pod \"e2e-worker-w6-51dd62-openshift-default-7954bd8797-qhldt\" (UID: \"8d508b96-1463-414f-85be-ba11cc47d5c7\") " pod="openshift-ingress/e2e-worker-w6-51dd62-openshift-default-7954bd8797-qhldt"
Oct 30 20:03:55.746215 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:03:55.746190    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8d508b96-1463-414f-85be-ba11cc47d5c7-istiod-ca-cert\") pod \"e2e-worker-w6-51dd62-openshift-default-7954bd8797-qhldt\" (UID: \"8d508b96-1463-414f-85be-ba11cc47d5c7\") " pod="openshift-ingress/e2e-worker-w6-51dd62-openshift-default-7954bd8797-qhldt"
Oct 30 20:03:55.746296 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:03:55.746208    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8d508b96-1463-414f-85be-ba11cc47d5c7-workload-certs\") pod \"e2e-worker-w6-51dd62-openshift-default-7954bd8797-qhldt\" (UID: \"8d508b96-1463-414f-85be-ba11cc47d5c7\") " pod="openshift-ingress/e2e-worker-w6-51dd62-openshift-default-7954bd8797-qhldt"
Oct 30 20:03:55.746296 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:03:55.746237    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8d508b96-1463-414f-85be-ba11cc47d5c7-istio-data\") pod \"e2e-worker-w6-51dd62-openshift-default-7954bd8797-qhldt\" (UID: \"8d508b96-1463-414f-85be-ba11cc47d5c7\") " pod="openshift-ingress/e2e-worker-w6-51dd62-openshift-default-7954bd8797-qhldt"
Oct 30 20:03:55.746296 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:03:55.746261    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8d508b96-1463-414f-85be-ba11cc47d5c7-credential-socket\") pod \"e2e-worker-w6-51dd62-openshift-default-7954bd8797-qhldt\" (UID: \"8d508b96-1463-414f-85be-ba11cc47d5c7\") " pod="openshift-ingress/e2e-worker-w6-51dd62-openshift-default-7954bd8797-qhldt"
Oct 30 20:03:55.747810 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:03:55.747784    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8d508b96-1463-414f-85be-ba11cc47d5c7-istio-envoy\") pod \"e2e-worker-w6-51dd62-openshift-default-7954bd8797-qhldt\" (UID: \"8d508b96-1463-414f-85be-ba11cc47d5c7\") " pod="openshift-ingress/e2e-worker-w6-51dd62-openshift-default-7954bd8797-qhldt"
Oct 30 20:03:55.748285 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:03:55.748255    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8d508b96-1463-414f-85be-ba11cc47d5c7-istio-podinfo\") pod \"e2e-worker-w6-51dd62-openshift-default-7954bd8797-qhldt\" (UID: \"8d508b96-1463-414f-85be-ba11cc47d5c7\") " pod="openshift-ingress/e2e-worker-w6-51dd62-openshift-default-7954bd8797-qhldt"
Oct 30 20:03:55.771371 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:03:55.771333    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8d508b96-1463-414f-85be-ba11cc47d5c7-istio-token\") pod \"e2e-worker-w6-51dd62-openshift-default-7954bd8797-qhldt\" (UID: \"8d508b96-1463-414f-85be-ba11cc47d5c7\") " pod="openshift-ingress/e2e-worker-w6-51dd62-openshift-default-7954bd8797-qhldt"
Oct 30 20:03:55.771487 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:03:55.771403    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-44m44\" (UniqueName: \"kubernetes.io/projected/8d508b96-1463-414f-85be-ba11cc47d5c7-kube-api-access-44m44\") pod \"e2e-worker-w6-51dd62-openshift-default-7954bd8797-qhldt\" (UID: \"8d508b96-1463-414f-85be-ba11cc47d5c7\") " pod="openshift-ingress/e2e-worker-w6-51dd62-openshift-default-7954bd8797-qhldt"
Oct 30 20:03:55.849943 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:03:55.849869    6275 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-51dd62-openshift-default-7954bd8797-qhldt"
Oct 30 20:03:56.174360 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:03:56.174328    6275 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w6-51dd62-openshift-default-7954bd8797-qhldt"]
Oct 30 20:03:56.175565 ip-10-0-131-26 kubenswrapper[6275]: W1030 20:03:56.175536    6275 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8d508b96_1463_414f_85be_ba11cc47d5c7.slice/crio-65f6525d6276bfc3154a8f2baeea221fb18c21967141f71a6795b1ab3cc561aa WatchSource:0}: Error finding container 65f6525d6276bfc3154a8f2baeea221fb18c21967141f71a6795b1ab3cc561aa: Status 404 returned error can't find the container with id 65f6525d6276bfc3154a8f2baeea221fb18c21967141f71a6795b1ab3cc561aa
Oct 30 20:03:56.178387 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:03:56.178356    6275 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Oct 30 20:03:56.178476 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:03:56.178459    6275 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Oct 30 20:03:56.178535 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:03:56.178521    6275 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Oct 30 20:03:56.259198 ip-10-0-131-26 kubenswrapper[6275]: E1030 20:03:56.259158    6275 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-fwc77" containerName="extractor"
Oct 30 20:03:56.728982 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:03:56.728946    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-51dd62-openshift-default-7954bd8797-qhldt" event={"ID":"8d508b96-1463-414f-85be-ba11cc47d5c7","Type":"ContainerStarted","Data":"1d885bea05b22e520a55cf09b8bd49f18705b09c2a1ff5c4864bf202c97cc579"}
Oct 30 20:03:56.729518 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:03:56.728997    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-51dd62-openshift-default-7954bd8797-qhldt" event={"ID":"8d508b96-1463-414f-85be-ba11cc47d5c7","Type":"ContainerStarted","Data":"65f6525d6276bfc3154a8f2baeea221fb18c21967141f71a6795b1ab3cc561aa"}
Oct 30 20:03:56.793437 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:03:56.793298    6275 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w6-51dd62-openshift-default-7954bd8797-qhldt" podStartSLOduration=1.793276053 podStartE2EDuration="1.793276053s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:03:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:03:56.791293633 +0000 UTC m=+947.253020503" watchObservedRunningTime="2026-10-30 20:03:56.793276053 +0000 UTC m=+947.255002918"
Oct 30 20:03:56.850998 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:03:56.850966    6275 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w6-51dd62-openshift-default-7954bd8797-qhldt"
Oct 30 20:03:57.852054 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:03:57.852023    6275 patch_prober.go:29] interesting pod/e2e-worker-w6-51dd62-openshift-default-7954bd8797-qhldt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.73:15021/healthz/ready\": dial tcp 10.134.0.73:15021: connect: connection refused" start-of-body=
Oct 30 20:03:57.852451 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:03:57.852080    6275 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-51dd62-openshift-default-7954bd8797-qhldt" podUID="8d508b96-1463-414f-85be-ba11cc47d5c7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.73:15021/healthz/ready\": dial tcp 10.134.0.73:15021: connect: connection refused"
Oct 30 20:03:58.850987 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:03:58.850949    6275 patch_prober.go:29] interesting pod/e2e-worker-w6-51dd62-openshift-default-7954bd8797-qhldt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.73:15021/healthz/ready\": dial tcp 10.134.0.73:15021: connect: connection refused" start-of-body=
Oct 30 20:03:58.851168 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:03:58.851001    6275 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-51dd62-openshift-default-7954bd8797-qhldt" podUID="8d508b96-1463-414f-85be-ba11cc47d5c7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.73:15021/healthz/ready\": dial tcp 10.134.0.73:15021: connect: connection refused"
Oct 30 20:03:59.850265 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:03:59.850220    6275 patch_prober.go:29] interesting pod/e2e-worker-w6-51dd62-openshift-default-7954bd8797-qhldt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.73:15021/healthz/ready\": dial tcp 10.134.0.73:15021: connect: connection refused" start-of-body=
Oct 30 20:03:59.850791 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:03:59.850288    6275 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-51dd62-openshift-default-7954bd8797-qhldt" podUID="8d508b96-1463-414f-85be-ba11cc47d5c7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.73:15021/healthz/ready\": dial tcp 10.134.0.73:15021: connect: connection refused"
Oct 30 20:04:00.850745 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:04:00.850714    6275 patch_prober.go:29] interesting pod/e2e-worker-w6-51dd62-openshift-default-7954bd8797-qhldt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.73:15021/healthz/ready\": dial tcp 10.134.0.73:15021: connect: connection refused" start-of-body=
Oct 30 20:04:00.851155 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:04:00.850792    6275 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-51dd62-openshift-default-7954bd8797-qhldt" podUID="8d508b96-1463-414f-85be-ba11cc47d5c7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.73:15021/healthz/ready\": dial tcp 10.134.0.73:15021: connect: connection refused"
Oct 30 20:04:01.850234 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:04:01.850202    6275 patch_prober.go:29] interesting pod/e2e-worker-w6-51dd62-openshift-default-7954bd8797-qhldt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.73:15021/healthz/ready\": dial tcp 10.134.0.73:15021: connect: connection refused" start-of-body=
Oct 30 20:04:01.850468 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:04:01.850406    6275 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-51dd62-openshift-default-7954bd8797-qhldt" podUID="8d508b96-1463-414f-85be-ba11cc47d5c7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.73:15021/healthz/ready\": dial tcp 10.134.0.73:15021: connect: connection refused"
Oct 30 20:04:02.914946 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:04:02.914904    6275 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w6-51dd62-openshift-default-7954bd8797-qhldt"
Oct 30 20:04:02.915866 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:04:02.915845    6275 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w6-51dd62-openshift-default-7954bd8797-qhldt"
Oct 30 20:04:02.916627 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:04:02.916602    6275 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w6-51dd62-openshift-default-7954bd8797-qhldt"
Oct 30 20:04:21.487916 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:04:21.487876    6275 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w3-912f24/distinct-2-w3-912f24-kserve-566865fdcc-ptx4l"]
Oct 30 20:04:21.492809 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:04:21.492779    6275 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w3-912f24/distinct-2-w3-912f24-kserve-566865fdcc-ptx4l"
Oct 30 20:04:21.514738 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:04:21.514709    6275 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w3-912f24/distinct-2-w3-912f24-kserve-566865fdcc-ptx4l"]
Oct 30 20:04:21.524218 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:04:21.524190    6275 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w3-912f24\"/\"distinct-2-w3-912f24-kserve-self-signed-certs\""
Oct 30 20:04:21.584062 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:04:21.584025    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fcea214a-04a7-4bdd-9695-852f657edfe5-dshm\") pod \"distinct-2-w3-912f24-kserve-566865fdcc-ptx4l\" (UID: \"fcea214a-04a7-4bdd-9695-852f657edfe5\") " pod="e2e-models-e2e-worker-w3-912f24/distinct-2-w3-912f24-kserve-566865fdcc-ptx4l"
Oct 30 20:04:21.584327 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:04:21.584303    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2lksd\" (UniqueName: \"kubernetes.io/projected/fcea214a-04a7-4bdd-9695-852f657edfe5-kube-api-access-2lksd\") pod \"distinct-2-w3-912f24-kserve-566865fdcc-ptx4l\" (UID: \"fcea214a-04a7-4bdd-9695-852f657edfe5\") " pod="e2e-models-e2e-worker-w3-912f24/distinct-2-w3-912f24-kserve-566865fdcc-ptx4l"
Oct 30 20:04:21.584439 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:04:21.584374    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fcea214a-04a7-4bdd-9695-852f657edfe5-home\") pod \"distinct-2-w3-912f24-kserve-566865fdcc-ptx4l\" (UID: \"fcea214a-04a7-4bdd-9695-852f657edfe5\") " pod="e2e-models-e2e-worker-w3-912f24/distinct-2-w3-912f24-kserve-566865fdcc-ptx4l"
Oct 30 20:04:21.584508 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:04:21.584480    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fcea214a-04a7-4bdd-9695-852f657edfe5-model-cache\") pod \"distinct-2-w3-912f24-kserve-566865fdcc-ptx4l\" (UID: \"fcea214a-04a7-4bdd-9695-852f657edfe5\") " pod="e2e-models-e2e-worker-w3-912f24/distinct-2-w3-912f24-kserve-566865fdcc-ptx4l"
Oct 30 20:04:21.584612 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:04:21.584585    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fcea214a-04a7-4bdd-9695-852f657edfe5-tls-certs\") pod \"distinct-2-w3-912f24-kserve-566865fdcc-ptx4l\" (UID: \"fcea214a-04a7-4bdd-9695-852f657edfe5\") " pod="e2e-models-e2e-worker-w3-912f24/distinct-2-w3-912f24-kserve-566865fdcc-ptx4l"
Oct 30 20:04:21.584679 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:04:21.584665    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fcea214a-04a7-4bdd-9695-852f657edfe5-tmp-dir\") pod \"distinct-2-w3-912f24-kserve-566865fdcc-ptx4l\" (UID: \"fcea214a-04a7-4bdd-9695-852f657edfe5\") " pod="e2e-models-e2e-worker-w3-912f24/distinct-2-w3-912f24-kserve-566865fdcc-ptx4l"
Oct 30 20:04:21.692180 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:04:21.692139    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fcea214a-04a7-4bdd-9695-852f657edfe5-tmp-dir\") pod \"distinct-2-w3-912f24-kserve-566865fdcc-ptx4l\" (UID: \"fcea214a-04a7-4bdd-9695-852f657edfe5\") " pod="e2e-models-e2e-worker-w3-912f24/distinct-2-w3-912f24-kserve-566865fdcc-ptx4l"
Oct 30 20:04:21.692585 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:04:21.692560    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fcea214a-04a7-4bdd-9695-852f657edfe5-dshm\") pod \"distinct-2-w3-912f24-kserve-566865fdcc-ptx4l\" (UID: \"fcea214a-04a7-4bdd-9695-852f657edfe5\") " pod="e2e-models-e2e-worker-w3-912f24/distinct-2-w3-912f24-kserve-566865fdcc-ptx4l"
Oct 30 20:04:21.692766 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:04:21.692747    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2lksd\" (UniqueName: \"kubernetes.io/projected/fcea214a-04a7-4bdd-9695-852f657edfe5-kube-api-access-2lksd\") pod \"distinct-2-w3-912f24-kserve-566865fdcc-ptx4l\" (UID: \"fcea214a-04a7-4bdd-9695-852f657edfe5\") " pod="e2e-models-e2e-worker-w3-912f24/distinct-2-w3-912f24-kserve-566865fdcc-ptx4l"
Oct 30 20:04:21.692913 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:04:21.692898    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fcea214a-04a7-4bdd-9695-852f657edfe5-home\") pod \"distinct-2-w3-912f24-kserve-566865fdcc-ptx4l\" (UID: \"fcea214a-04a7-4bdd-9695-852f657edfe5\") " pod="e2e-models-e2e-worker-w3-912f24/distinct-2-w3-912f24-kserve-566865fdcc-ptx4l"
Oct 30 20:04:21.693008 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:04:21.692994    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fcea214a-04a7-4bdd-9695-852f657edfe5-model-cache\") pod \"distinct-2-w3-912f24-kserve-566865fdcc-ptx4l\" (UID: \"fcea214a-04a7-4bdd-9695-852f657edfe5\") " pod="e2e-models-e2e-worker-w3-912f24/distinct-2-w3-912f24-kserve-566865fdcc-ptx4l"
Oct 30 20:04:21.693153 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:04:21.693140    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fcea214a-04a7-4bdd-9695-852f657edfe5-tls-certs\") pod \"distinct-2-w3-912f24-kserve-566865fdcc-ptx4l\" (UID: \"fcea214a-04a7-4bdd-9695-852f657edfe5\") " pod="e2e-models-e2e-worker-w3-912f24/distinct-2-w3-912f24-kserve-566865fdcc-ptx4l"
Oct 30 20:04:21.694041 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:04:21.692602    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fcea214a-04a7-4bdd-9695-852f657edfe5-tmp-dir\") pod \"distinct-2-w3-912f24-kserve-566865fdcc-ptx4l\" (UID: \"fcea214a-04a7-4bdd-9695-852f657edfe5\") " pod="e2e-models-e2e-worker-w3-912f24/distinct-2-w3-912f24-kserve-566865fdcc-ptx4l"
Oct 30 20:04:21.694456 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:04:21.694437    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fcea214a-04a7-4bdd-9695-852f657edfe5-home\") pod \"distinct-2-w3-912f24-kserve-566865fdcc-ptx4l\" (UID: \"fcea214a-04a7-4bdd-9695-852f657edfe5\") " pod="e2e-models-e2e-worker-w3-912f24/distinct-2-w3-912f24-kserve-566865fdcc-ptx4l"
Oct 30 20:04:21.694839 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:04:21.694821    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fcea214a-04a7-4bdd-9695-852f657edfe5-model-cache\") pod \"distinct-2-w3-912f24-kserve-566865fdcc-ptx4l\" (UID: \"fcea214a-04a7-4bdd-9695-852f657edfe5\") " pod="e2e-models-e2e-worker-w3-912f24/distinct-2-w3-912f24-kserve-566865fdcc-ptx4l"
Oct 30 20:04:21.718216 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:04:21.718178    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fcea214a-04a7-4bdd-9695-852f657edfe5-dshm\") pod \"distinct-2-w3-912f24-kserve-566865fdcc-ptx4l\" (UID: \"fcea214a-04a7-4bdd-9695-852f657edfe5\") " pod="e2e-models-e2e-worker-w3-912f24/distinct-2-w3-912f24-kserve-566865fdcc-ptx4l"
Oct 30 20:04:21.719549 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:04:21.719525    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fcea214a-04a7-4bdd-9695-852f657edfe5-tls-certs\") pod \"distinct-2-w3-912f24-kserve-566865fdcc-ptx4l\" (UID: \"fcea214a-04a7-4bdd-9695-852f657edfe5\") " pod="e2e-models-e2e-worker-w3-912f24/distinct-2-w3-912f24-kserve-566865fdcc-ptx4l"
Oct 30 20:04:21.725978 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:04:21.725952    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2lksd\" (UniqueName: \"kubernetes.io/projected/fcea214a-04a7-4bdd-9695-852f657edfe5-kube-api-access-2lksd\") pod \"distinct-2-w3-912f24-kserve-566865fdcc-ptx4l\" (UID: \"fcea214a-04a7-4bdd-9695-852f657edfe5\") " pod="e2e-models-e2e-worker-w3-912f24/distinct-2-w3-912f24-kserve-566865fdcc-ptx4l"
Oct 30 20:04:21.805246 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:04:21.805161    6275 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w3-912f24/distinct-2-w3-912f24-kserve-566865fdcc-ptx4l"
Oct 30 20:04:22.125893 ip-10-0-131-26 kubenswrapper[6275]: W1030 20:04:22.125861    6275 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfcea214a_04a7_4bdd_9695_852f657edfe5.slice/crio-9d924050bcf01c6f05a160ccd82fdd08a227c8319d9440db1d548e4842a9e4e5 WatchSource:0}: Error finding container 9d924050bcf01c6f05a160ccd82fdd08a227c8319d9440db1d548e4842a9e4e5: Status 404 returned error can't find the container with id 9d924050bcf01c6f05a160ccd82fdd08a227c8319d9440db1d548e4842a9e4e5
Oct 30 20:04:22.126181 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:04:22.126152    6275 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w3-912f24/distinct-2-w3-912f24-kserve-566865fdcc-ptx4l"]
Oct 30 20:04:22.910332 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:04:22.910294    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w3-912f24/distinct-2-w3-912f24-kserve-566865fdcc-ptx4l" event={"ID":"fcea214a-04a7-4bdd-9695-852f657edfe5","Type":"ContainerStarted","Data":"f6e6a9170aa512c632afd32db42cb9fe52bf40990ec0631d9cc23f47d3dfd857"}
Oct 30 20:04:22.910829 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:04:22.910345    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w3-912f24/distinct-2-w3-912f24-kserve-566865fdcc-ptx4l" event={"ID":"fcea214a-04a7-4bdd-9695-852f657edfe5","Type":"ContainerStarted","Data":"9d924050bcf01c6f05a160ccd82fdd08a227c8319d9440db1d548e4842a9e4e5"}
Oct 30 20:04:22.962252 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:04:22.962199    6275 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w3-912f24/distinct-2-w3-912f24-kserve-566865fdcc-ptx4l" podStartSLOduration=1.962184185 podStartE2EDuration="1.962184185s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:04:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:04:22.959729256 +0000 UTC m=+973.421456118" watchObservedRunningTime="2026-10-30 20:04:22.962184185 +0000 UTC m=+973.423911056"
Oct 30 20:04:23.805978 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:04:23.805945    6275 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w3-912f24/distinct-2-w3-912f24-kserve-566865fdcc-ptx4l"
Oct 30 20:04:24.482670 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:04:24.482636    6275 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-375e5a55-t88c4"]
Oct 30 20:04:24.487201 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:04:24.487178    6275 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-375e5a55-t88c4"
Oct 30 20:04:24.505475 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:04:24.505448    6275 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\""
Oct 30 20:04:24.508259 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:04:24.508234    6275 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-375e5a55-t88c4"]
Oct 30 20:04:24.517186 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:04:24.517164    6275 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-scs2w\""
Oct 30 20:04:24.625875 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:04:24.625832    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/aa5c03b3-8071-45e5-aa3a-f3be239f9985-maas-api-xks-ca\") pod \"maas-api-revoke-sub-375e5a55-t88c4\" (UID: \"aa5c03b3-8071-45e5-aa3a-f3be239f9985\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-375e5a55-t88c4"
Oct 30 20:04:24.626272 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:04:24.626245    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m79mq\" (UniqueName: \"kubernetes.io/projected/aa5c03b3-8071-45e5-aa3a-f3be239f9985-kube-api-access-m79mq\") pod \"maas-api-revoke-sub-375e5a55-t88c4\" (UID: \"aa5c03b3-8071-45e5-aa3a-f3be239f9985\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-375e5a55-t88c4"
Oct 30 20:04:24.626387 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:04:24.626305    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/aa5c03b3-8071-45e5-aa3a-f3be239f9985-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-375e5a55-t88c4\" (UID: \"aa5c03b3-8071-45e5-aa3a-f3be239f9985\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-375e5a55-t88c4"
Oct 30 20:04:24.727864 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:04:24.727833    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m79mq\" (UniqueName: \"kubernetes.io/projected/aa5c03b3-8071-45e5-aa3a-f3be239f9985-kube-api-access-m79mq\") pod \"maas-api-revoke-sub-375e5a55-t88c4\" (UID: \"aa5c03b3-8071-45e5-aa3a-f3be239f9985\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-375e5a55-t88c4"
Oct 30 20:04:24.728025 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:04:24.727877    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/aa5c03b3-8071-45e5-aa3a-f3be239f9985-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-375e5a55-t88c4\" (UID: \"aa5c03b3-8071-45e5-aa3a-f3be239f9985\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-375e5a55-t88c4"
Oct 30 20:04:24.728025 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:04:24.727930    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/aa5c03b3-8071-45e5-aa3a-f3be239f9985-maas-api-xks-ca\") pod \"maas-api-revoke-sub-375e5a55-t88c4\" (UID: \"aa5c03b3-8071-45e5-aa3a-f3be239f9985\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-375e5a55-t88c4"
Oct 30 20:04:24.728726 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:04:24.728699    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/aa5c03b3-8071-45e5-aa3a-f3be239f9985-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-375e5a55-t88c4\" (UID: \"aa5c03b3-8071-45e5-aa3a-f3be239f9985\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-375e5a55-t88c4"
Oct 30 20:04:24.730451 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:04:24.730429    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/aa5c03b3-8071-45e5-aa3a-f3be239f9985-maas-api-xks-ca\") pod \"maas-api-revoke-sub-375e5a55-t88c4\" (UID: \"aa5c03b3-8071-45e5-aa3a-f3be239f9985\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-375e5a55-t88c4"
Oct 30 20:04:24.754592 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:04:24.754564    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m79mq\" (UniqueName: \"kubernetes.io/projected/aa5c03b3-8071-45e5-aa3a-f3be239f9985-kube-api-access-m79mq\") pod \"maas-api-revoke-sub-375e5a55-t88c4\" (UID: \"aa5c03b3-8071-45e5-aa3a-f3be239f9985\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-375e5a55-t88c4"
Oct 30 20:04:24.801495 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:04:24.801465    6275 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-375e5a55-t88c4"
Oct 30 20:04:25.122463 ip-10-0-131-26 kubenswrapper[6275]: W1030 20:04:25.122431    6275 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa5c03b3_8071_45e5_aa3a_f3be239f9985.slice/crio-242a9edfbf1189c8e650b3e5f92119d0be146981fe15a5fd848f86b9c98d30da WatchSource:0}: Error finding container 242a9edfbf1189c8e650b3e5f92119d0be146981fe15a5fd848f86b9c98d30da: Status 404 returned error can't find the container with id 242a9edfbf1189c8e650b3e5f92119d0be146981fe15a5fd848f86b9c98d30da
Oct 30 20:04:25.122582 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:04:25.122482    6275 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-375e5a55-t88c4"]
Oct 30 20:04:25.230667 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:04:25.230634    6275 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w0-62f4a1-openshift-default-7fc84fbccc-52l47"]
Oct 30 20:04:25.236098 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:04:25.236079    6275 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-62f4a1-openshift-default-7fc84fbccc-52l47"
Oct 30 20:04:25.266248 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:04:25.266217    6275 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-62f4a1-openshift-default-7fc84fbccc-52l47"]
Oct 30 20:04:25.335191 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:04:25.335161    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e3f64fa4-b2e2-4ab4-9da5-76bbfac9116d-workload-certs\") pod \"e2e-worker-w0-62f4a1-openshift-default-7fc84fbccc-52l47\" (UID: \"e3f64fa4-b2e2-4ab4-9da5-76bbfac9116d\") " pod="openshift-ingress/e2e-worker-w0-62f4a1-openshift-default-7fc84fbccc-52l47"
Oct 30 20:04:25.335379 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:04:25.335295    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7qr64\" (UniqueName: \"kubernetes.io/projected/e3f64fa4-b2e2-4ab4-9da5-76bbfac9116d-kube-api-access-7qr64\") pod \"e2e-worker-w0-62f4a1-openshift-default-7fc84fbccc-52l47\" (UID: \"e3f64fa4-b2e2-4ab4-9da5-76bbfac9116d\") " pod="openshift-ingress/e2e-worker-w0-62f4a1-openshift-default-7fc84fbccc-52l47"
Oct 30 20:04:25.335379 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:04:25.335364    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e3f64fa4-b2e2-4ab4-9da5-76bbfac9116d-istiod-ca-cert\") pod \"e2e-worker-w0-62f4a1-openshift-default-7fc84fbccc-52l47\" (UID: \"e3f64fa4-b2e2-4ab4-9da5-76bbfac9116d\") " pod="openshift-ingress/e2e-worker-w0-62f4a1-openshift-default-7fc84fbccc-52l47"
Oct 30 20:04:25.335522 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:04:25.335402    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e3f64fa4-b2e2-4ab4-9da5-76bbfac9116d-istio-data\") pod \"e2e-worker-w0-62f4a1-openshift-default-7fc84fbccc-52l47\" (UID: \"e3f64fa4-b2e2-4ab4-9da5-76bbfac9116d\") " pod="openshift-ingress/e2e-worker-w0-62f4a1-openshift-default-7fc84fbccc-52l47"
Oct 30 20:04:25.335522 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:04:25.335433    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e3f64fa4-b2e2-4ab4-9da5-76bbfac9116d-istio-envoy\") pod \"e2e-worker-w0-62f4a1-openshift-default-7fc84fbccc-52l47\" (UID: \"e3f64fa4-b2e2-4ab4-9da5-76bbfac9116d\") " pod="openshift-ingress/e2e-worker-w0-62f4a1-openshift-default-7fc84fbccc-52l47"
Oct 30 20:04:25.335589 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:04:25.335541    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e3f64fa4-b2e2-4ab4-9da5-76bbfac9116d-istio-podinfo\") pod \"e2e-worker-w0-62f4a1-openshift-default-7fc84fbccc-52l47\" (UID: \"e3f64fa4-b2e2-4ab4-9da5-76bbfac9116d\") " pod="openshift-ingress/e2e-worker-w0-62f4a1-openshift-default-7fc84fbccc-52l47"
Oct 30 20:04:25.335629 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:04:25.335593    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e3f64fa4-b2e2-4ab4-9da5-76bbfac9116d-credential-socket\") pod \"e2e-worker-w0-62f4a1-openshift-default-7fc84fbccc-52l47\" (UID: \"e3f64fa4-b2e2-4ab4-9da5-76bbfac9116d\") " pod="openshift-ingress/e2e-worker-w0-62f4a1-openshift-default-7fc84fbccc-52l47"
Oct 30 20:04:25.335664 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:04:25.335654    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e3f64fa4-b2e2-4ab4-9da5-76bbfac9116d-workload-socket\") pod \"e2e-worker-w0-62f4a1-openshift-default-7fc84fbccc-52l47\" (UID: \"e3f64fa4-b2e2-4ab4-9da5-76bbfac9116d\") " pod="openshift-ingress/e2e-worker-w0-62f4a1-openshift-default-7fc84fbccc-52l47"
Oct 30 20:04:25.335713 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:04:25.335669    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e3f64fa4-b2e2-4ab4-9da5-76bbfac9116d-istio-token\") pod \"e2e-worker-w0-62f4a1-openshift-default-7fc84fbccc-52l47\" (UID: \"e3f64fa4-b2e2-4ab4-9da5-76bbfac9116d\") " pod="openshift-ingress/e2e-worker-w0-62f4a1-openshift-default-7fc84fbccc-52l47"
Oct 30 20:04:25.397856 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:04:25.397829    6275 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w1-5f10d2-openshift-default-6c6777d6f5-8zmm9"]
Oct 30 20:04:25.401872 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:04:25.401856    6275 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-5f10d2-openshift-default-6c6777d6f5-8zmm9"
Oct 30 20:04:25.421131 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:04:25.421110    6275 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w1-5f10d2-openshift-default-dockercfg-mbtgp\""
Oct 30 20:04:25.429346 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:04:25.429319    6275 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w1-5f10d2-openshift-default-6c6777d6f5-8zmm9"]
Oct 30 20:04:25.436550 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:04:25.436522    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7qr64\" (UniqueName: \"kubernetes.io/projected/e3f64fa4-b2e2-4ab4-9da5-76bbfac9116d-kube-api-access-7qr64\") pod \"e2e-worker-w0-62f4a1-openshift-default-7fc84fbccc-52l47\" (UID: \"e3f64fa4-b2e2-4ab4-9da5-76bbfac9116d\") " pod="openshift-ingress/e2e-worker-w0-62f4a1-openshift-default-7fc84fbccc-52l47"
Oct 30 20:04:25.436663 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:04:25.436591    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e3f64fa4-b2e2-4ab4-9da5-76bbfac9116d-istiod-ca-cert\") pod \"e2e-worker-w0-62f4a1-openshift-default-7fc84fbccc-52l47\" (UID: \"e3f64fa4-b2e2-4ab4-9da5-76bbfac9116d\") " pod="openshift-ingress/e2e-worker-w0-62f4a1-openshift-default-7fc84fbccc-52l47"
Oct 30 20:04:25.436663 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:04:25.436635    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e3f64fa4-b2e2-4ab4-9da5-76bbfac9116d-istio-data\") pod \"e2e-worker-w0-62f4a1-openshift-default-7fc84fbccc-52l47\" (UID: \"e3f64fa4-b2e2-4ab4-9da5-76bbfac9116d\") " pod="openshift-ingress/e2e-worker-w0-62f4a1-openshift-default-7fc84fbccc-52l47"
Oct 30 20:04:25.436820 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:04:25.436664    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e3f64fa4-b2e2-4ab4-9da5-76bbfac9116d-istio-envoy\") pod \"e2e-worker-w0-62f4a1-openshift-default-7fc84fbccc-52l47\" (UID: \"e3f64fa4-b2e2-4ab4-9da5-76bbfac9116d\") " pod="openshift-ingress/e2e-worker-w0-62f4a1-openshift-default-7fc84fbccc-52l47"
Oct 30 20:04:25.436820 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:04:25.436710    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e3f64fa4-b2e2-4ab4-9da5-76bbfac9116d-istio-podinfo\") pod \"e2e-worker-w0-62f4a1-openshift-default-7fc84fbccc-52l47\" (UID: \"e3f64fa4-b2e2-4ab4-9da5-76bbfac9116d\") " pod="openshift-ingress/e2e-worker-w0-62f4a1-openshift-default-7fc84fbccc-52l47"
Oct 30 20:04:25.436820 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:04:25.436765    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e3f64fa4-b2e2-4ab4-9da5-76bbfac9116d-credential-socket\") pod \"e2e-worker-w0-62f4a1-openshift-default-7fc84fbccc-52l47\" (UID: \"e3f64fa4-b2e2-4ab4-9da5-76bbfac9116d\") " pod="openshift-ingress/e2e-worker-w0-62f4a1-openshift-default-7fc84fbccc-52l47"
Oct 30 20:04:25.436982 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:04:25.436825    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e3f64fa4-b2e2-4ab4-9da5-76bbfac9116d-workload-socket\") pod \"e2e-worker-w0-62f4a1-openshift-default-7fc84fbccc-52l47\" (UID: \"e3f64fa4-b2e2-4ab4-9da5-76bbfac9116d\") " pod="openshift-ingress/e2e-worker-w0-62f4a1-openshift-default-7fc84fbccc-52l47"
Oct 30 20:04:25.436982 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:04:25.436851    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e3f64fa4-b2e2-4ab4-9da5-76bbfac9116d-istio-token\") pod \"e2e-worker-w0-62f4a1-openshift-default-7fc84fbccc-52l47\" (UID: \"e3f64fa4-b2e2-4ab4-9da5-76bbfac9116d\") " pod="openshift-ingress/e2e-worker-w0-62f4a1-openshift-default-7fc84fbccc-52l47"
Oct 30 20:04:25.436982 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:04:25.436910    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e3f64fa4-b2e2-4ab4-9da5-76bbfac9116d-workload-certs\") pod \"e2e-worker-w0-62f4a1-openshift-default-7fc84fbccc-52l47\" (UID: \"e3f64fa4-b2e2-4ab4-9da5-76bbfac9116d\") " pod="openshift-ingress/e2e-worker-w0-62f4a1-openshift-default-7fc84fbccc-52l47"
Oct 30 20:04:25.437308 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:04:25.437281    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e3f64fa4-b2e2-4ab4-9da5-76bbfac9116d-workload-certs\") pod \"e2e-worker-w0-62f4a1-openshift-default-7fc84fbccc-52l47\" (UID: \"e3f64fa4-b2e2-4ab4-9da5-76bbfac9116d\") " pod="openshift-ingress/e2e-worker-w0-62f4a1-openshift-default-7fc84fbccc-52l47"
Oct 30 20:04:25.437557 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:04:25.437531    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e3f64fa4-b2e2-4ab4-9da5-76bbfac9116d-istio-data\") pod \"e2e-worker-w0-62f4a1-openshift-default-7fc84fbccc-52l47\" (UID: \"e3f64fa4-b2e2-4ab4-9da5-76bbfac9116d\") " pod="openshift-ingress/e2e-worker-w0-62f4a1-openshift-default-7fc84fbccc-52l47"
Oct 30 20:04:25.437734 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:04:25.437709    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e3f64fa4-b2e2-4ab4-9da5-76bbfac9116d-credential-socket\") pod \"e2e-worker-w0-62f4a1-openshift-default-7fc84fbccc-52l47\" (UID: \"e3f64fa4-b2e2-4ab4-9da5-76bbfac9116d\") " pod="openshift-ingress/e2e-worker-w0-62f4a1-openshift-default-7fc84fbccc-52l47"
Oct 30 20:04:25.437839 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:04:25.437713    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e3f64fa4-b2e2-4ab4-9da5-76bbfac9116d-workload-socket\") pod \"e2e-worker-w0-62f4a1-openshift-default-7fc84fbccc-52l47\" (UID: \"e3f64fa4-b2e2-4ab4-9da5-76bbfac9116d\") " pod="openshift-ingress/e2e-worker-w0-62f4a1-openshift-default-7fc84fbccc-52l47"
Oct 30 20:04:25.438387 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:04:25.438367    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e3f64fa4-b2e2-4ab4-9da5-76bbfac9116d-istiod-ca-cert\") pod \"e2e-worker-w0-62f4a1-openshift-default-7fc84fbccc-52l47\" (UID: \"e3f64fa4-b2e2-4ab4-9da5-76bbfac9116d\") " pod="openshift-ingress/e2e-worker-w0-62f4a1-openshift-default-7fc84fbccc-52l47"
Oct 30 20:04:25.439998 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:04:25.439981    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e3f64fa4-b2e2-4ab4-9da5-76bbfac9116d-istio-envoy\") pod \"e2e-worker-w0-62f4a1-openshift-default-7fc84fbccc-52l47\" (UID: \"e3f64fa4-b2e2-4ab4-9da5-76bbfac9116d\") " pod="openshift-ingress/e2e-worker-w0-62f4a1-openshift-default-7fc84fbccc-52l47"
Oct 30 20:04:25.440206 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:04:25.440178    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e3f64fa4-b2e2-4ab4-9da5-76bbfac9116d-istio-podinfo\") pod \"e2e-worker-w0-62f4a1-openshift-default-7fc84fbccc-52l47\" (UID: \"e3f64fa4-b2e2-4ab4-9da5-76bbfac9116d\") " pod="openshift-ingress/e2e-worker-w0-62f4a1-openshift-default-7fc84fbccc-52l47"
Oct 30 20:04:25.464501 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:04:25.464472    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7qr64\" (UniqueName: \"kubernetes.io/projected/e3f64fa4-b2e2-4ab4-9da5-76bbfac9116d-kube-api-access-7qr64\") pod \"e2e-worker-w0-62f4a1-openshift-default-7fc84fbccc-52l47\" (UID: \"e3f64fa4-b2e2-4ab4-9da5-76bbfac9116d\") " pod="openshift-ingress/e2e-worker-w0-62f4a1-openshift-default-7fc84fbccc-52l47"
Oct 30 20:04:25.464809 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:04:25.464792    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e3f64fa4-b2e2-4ab4-9da5-76bbfac9116d-istio-token\") pod \"e2e-worker-w0-62f4a1-openshift-default-7fc84fbccc-52l47\" (UID: \"e3f64fa4-b2e2-4ab4-9da5-76bbfac9116d\") " pod="openshift-ingress/e2e-worker-w0-62f4a1-openshift-default-7fc84fbccc-52l47"
Oct 30 20:04:25.538576 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:04:25.538545    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/91d406fb-17e3-47cf-bb3c-0a088ea0968e-workload-socket\") pod \"e2e-worker-w1-5f10d2-openshift-default-6c6777d6f5-8zmm9\" (UID: \"91d406fb-17e3-47cf-bb3c-0a088ea0968e\") " pod="openshift-ingress/e2e-worker-w1-5f10d2-openshift-default-6c6777d6f5-8zmm9"
Oct 30 20:04:25.538576 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:04:25.538585    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/91d406fb-17e3-47cf-bb3c-0a088ea0968e-workload-certs\") pod \"e2e-worker-w1-5f10d2-openshift-default-6c6777d6f5-8zmm9\" (UID: \"91d406fb-17e3-47cf-bb3c-0a088ea0968e\") " pod="openshift-ingress/e2e-worker-w1-5f10d2-openshift-default-6c6777d6f5-8zmm9"
Oct 30 20:04:25.538994 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:04:25.538672    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/91d406fb-17e3-47cf-bb3c-0a088ea0968e-istio-data\") pod \"e2e-worker-w1-5f10d2-openshift-default-6c6777d6f5-8zmm9\" (UID: \"91d406fb-17e3-47cf-bb3c-0a088ea0968e\") " pod="openshift-ingress/e2e-worker-w1-5f10d2-openshift-default-6c6777d6f5-8zmm9"
Oct 30 20:04:25.538994 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:04:25.538696    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hwkkb\" (UniqueName: \"kubernetes.io/projected/91d406fb-17e3-47cf-bb3c-0a088ea0968e-kube-api-access-hwkkb\") pod \"e2e-worker-w1-5f10d2-openshift-default-6c6777d6f5-8zmm9\" (UID: \"91d406fb-17e3-47cf-bb3c-0a088ea0968e\") " pod="openshift-ingress/e2e-worker-w1-5f10d2-openshift-default-6c6777d6f5-8zmm9"
Oct 30 20:04:25.538994 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:04:25.538720    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/91d406fb-17e3-47cf-bb3c-0a088ea0968e-istio-envoy\") pod \"e2e-worker-w1-5f10d2-openshift-default-6c6777d6f5-8zmm9\" (UID: \"91d406fb-17e3-47cf-bb3c-0a088ea0968e\") " pod="openshift-ingress/e2e-worker-w1-5f10d2-openshift-default-6c6777d6f5-8zmm9"
Oct 30 20:04:25.538994 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:04:25.538782    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/91d406fb-17e3-47cf-bb3c-0a088ea0968e-istio-token\") pod \"e2e-worker-w1-5f10d2-openshift-default-6c6777d6f5-8zmm9\" (UID: \"91d406fb-17e3-47cf-bb3c-0a088ea0968e\") " pod="openshift-ingress/e2e-worker-w1-5f10d2-openshift-default-6c6777d6f5-8zmm9"
Oct 30 20:04:25.538994 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:04:25.538889    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/91d406fb-17e3-47cf-bb3c-0a088ea0968e-credential-socket\") pod \"e2e-worker-w1-5f10d2-openshift-default-6c6777d6f5-8zmm9\" (UID: \"91d406fb-17e3-47cf-bb3c-0a088ea0968e\") " pod="openshift-ingress/e2e-worker-w1-5f10d2-openshift-default-6c6777d6f5-8zmm9"
Oct 30 20:04:25.538994 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:04:25.538911    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/91d406fb-17e3-47cf-bb3c-0a088ea0968e-istio-podinfo\") pod \"e2e-worker-w1-5f10d2-openshift-default-6c6777d6f5-8zmm9\" (UID: \"91d406fb-17e3-47cf-bb3c-0a088ea0968e\") " pod="openshift-ingress/e2e-worker-w1-5f10d2-openshift-default-6c6777d6f5-8zmm9"
Oct 30 20:04:25.539189 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:04:25.539049    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/91d406fb-17e3-47cf-bb3c-0a088ea0968e-istiod-ca-cert\") pod \"e2e-worker-w1-5f10d2-openshift-default-6c6777d6f5-8zmm9\" (UID: \"91d406fb-17e3-47cf-bb3c-0a088ea0968e\") " pod="openshift-ingress/e2e-worker-w1-5f10d2-openshift-default-6c6777d6f5-8zmm9"
Oct 30 20:04:25.551285 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:04:25.551258    6275 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-62f4a1-openshift-default-7fc84fbccc-52l47"
Oct 30 20:04:25.640507 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:04:25.640429    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/91d406fb-17e3-47cf-bb3c-0a088ea0968e-istio-data\") pod \"e2e-worker-w1-5f10d2-openshift-default-6c6777d6f5-8zmm9\" (UID: \"91d406fb-17e3-47cf-bb3c-0a088ea0968e\") " pod="openshift-ingress/e2e-worker-w1-5f10d2-openshift-default-6c6777d6f5-8zmm9"
Oct 30 20:04:25.640507 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:04:25.640481    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hwkkb\" (UniqueName: \"kubernetes.io/projected/91d406fb-17e3-47cf-bb3c-0a088ea0968e-kube-api-access-hwkkb\") pod \"e2e-worker-w1-5f10d2-openshift-default-6c6777d6f5-8zmm9\" (UID: \"91d406fb-17e3-47cf-bb3c-0a088ea0968e\") " pod="openshift-ingress/e2e-worker-w1-5f10d2-openshift-default-6c6777d6f5-8zmm9"
Oct 30 20:04:25.640722 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:04:25.640517    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/91d406fb-17e3-47cf-bb3c-0a088ea0968e-istio-envoy\") pod \"e2e-worker-w1-5f10d2-openshift-default-6c6777d6f5-8zmm9\" (UID: \"91d406fb-17e3-47cf-bb3c-0a088ea0968e\") " pod="openshift-ingress/e2e-worker-w1-5f10d2-openshift-default-6c6777d6f5-8zmm9"
Oct 30 20:04:25.640722 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:04:25.640556    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/91d406fb-17e3-47cf-bb3c-0a088ea0968e-istio-token\") pod \"e2e-worker-w1-5f10d2-openshift-default-6c6777d6f5-8zmm9\" (UID: \"91d406fb-17e3-47cf-bb3c-0a088ea0968e\") " pod="openshift-ingress/e2e-worker-w1-5f10d2-openshift-default-6c6777d6f5-8zmm9"
Oct 30 20:04:25.640722 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:04:25.640619    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/91d406fb-17e3-47cf-bb3c-0a088ea0968e-credential-socket\") pod \"e2e-worker-w1-5f10d2-openshift-default-6c6777d6f5-8zmm9\" (UID: \"91d406fb-17e3-47cf-bb3c-0a088ea0968e\") " pod="openshift-ingress/e2e-worker-w1-5f10d2-openshift-default-6c6777d6f5-8zmm9"
Oct 30 20:04:25.640722 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:04:25.640646    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/91d406fb-17e3-47cf-bb3c-0a088ea0968e-istio-podinfo\") pod \"e2e-worker-w1-5f10d2-openshift-default-6c6777d6f5-8zmm9\" (UID: \"91d406fb-17e3-47cf-bb3c-0a088ea0968e\") " pod="openshift-ingress/e2e-worker-w1-5f10d2-openshift-default-6c6777d6f5-8zmm9"
Oct 30 20:04:25.640917 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:04:25.640786    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/91d406fb-17e3-47cf-bb3c-0a088ea0968e-istiod-ca-cert\") pod \"e2e-worker-w1-5f10d2-openshift-default-6c6777d6f5-8zmm9\" (UID: \"91d406fb-17e3-47cf-bb3c-0a088ea0968e\") " pod="openshift-ingress/e2e-worker-w1-5f10d2-openshift-default-6c6777d6f5-8zmm9"
Oct 30 20:04:25.640981 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:04:25.640952    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/91d406fb-17e3-47cf-bb3c-0a088ea0968e-istio-data\") pod \"e2e-worker-w1-5f10d2-openshift-default-6c6777d6f5-8zmm9\" (UID: \"91d406fb-17e3-47cf-bb3c-0a088ea0968e\") " pod="openshift-ingress/e2e-worker-w1-5f10d2-openshift-default-6c6777d6f5-8zmm9"
Oct 30 20:04:25.641470 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:04:25.641399    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/91d406fb-17e3-47cf-bb3c-0a088ea0968e-credential-socket\") pod \"e2e-worker-w1-5f10d2-openshift-default-6c6777d6f5-8zmm9\" (UID: \"91d406fb-17e3-47cf-bb3c-0a088ea0968e\") " pod="openshift-ingress/e2e-worker-w1-5f10d2-openshift-default-6c6777d6f5-8zmm9"
Oct 30 20:04:25.643338 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:04:25.643314    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/91d406fb-17e3-47cf-bb3c-0a088ea0968e-istio-envoy\") pod \"e2e-worker-w1-5f10d2-openshift-default-6c6777d6f5-8zmm9\" (UID: \"91d406fb-17e3-47cf-bb3c-0a088ea0968e\") " pod="openshift-ingress/e2e-worker-w1-5f10d2-openshift-default-6c6777d6f5-8zmm9"
Oct 30 20:04:25.645589 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:04:25.645562    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/91d406fb-17e3-47cf-bb3c-0a088ea0968e-workload-socket\") pod \"e2e-worker-w1-5f10d2-openshift-default-6c6777d6f5-8zmm9\" (UID: \"91d406fb-17e3-47cf-bb3c-0a088ea0968e\") " pod="openshift-ingress/e2e-worker-w1-5f10d2-openshift-default-6c6777d6f5-8zmm9"
Oct 30 20:04:25.646348 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:04:25.645614    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/91d406fb-17e3-47cf-bb3c-0a088ea0968e-workload-certs\") pod \"e2e-worker-w1-5f10d2-openshift-default-6c6777d6f5-8zmm9\" (UID: \"91d406fb-17e3-47cf-bb3c-0a088ea0968e\") " pod="openshift-ingress/e2e-worker-w1-5f10d2-openshift-default-6c6777d6f5-8zmm9"
Oct 30 20:04:25.646348 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:04:25.645993    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/91d406fb-17e3-47cf-bb3c-0a088ea0968e-workload-socket\") pod \"e2e-worker-w1-5f10d2-openshift-default-6c6777d6f5-8zmm9\" (UID: \"91d406fb-17e3-47cf-bb3c-0a088ea0968e\") " pod="openshift-ingress/e2e-worker-w1-5f10d2-openshift-default-6c6777d6f5-8zmm9"
Oct 30 20:04:25.646348 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:04:25.646012    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/91d406fb-17e3-47cf-bb3c-0a088ea0968e-workload-certs\") pod \"e2e-worker-w1-5f10d2-openshift-default-6c6777d6f5-8zmm9\" (UID: \"91d406fb-17e3-47cf-bb3c-0a088ea0968e\") " pod="openshift-ingress/e2e-worker-w1-5f10d2-openshift-default-6c6777d6f5-8zmm9"
Oct 30 20:04:25.646348 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:04:25.646240    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/91d406fb-17e3-47cf-bb3c-0a088ea0968e-istiod-ca-cert\") pod \"e2e-worker-w1-5f10d2-openshift-default-6c6777d6f5-8zmm9\" (UID: \"91d406fb-17e3-47cf-bb3c-0a088ea0968e\") " pod="openshift-ingress/e2e-worker-w1-5f10d2-openshift-default-6c6777d6f5-8zmm9"
Oct 30 20:04:25.648235 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:04:25.648215    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/91d406fb-17e3-47cf-bb3c-0a088ea0968e-istio-podinfo\") pod \"e2e-worker-w1-5f10d2-openshift-default-6c6777d6f5-8zmm9\" (UID: \"91d406fb-17e3-47cf-bb3c-0a088ea0968e\") " pod="openshift-ingress/e2e-worker-w1-5f10d2-openshift-default-6c6777d6f5-8zmm9"
Oct 30 20:04:25.673616 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:04:25.673587    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/91d406fb-17e3-47cf-bb3c-0a088ea0968e-istio-token\") pod \"e2e-worker-w1-5f10d2-openshift-default-6c6777d6f5-8zmm9\" (UID: \"91d406fb-17e3-47cf-bb3c-0a088ea0968e\") " pod="openshift-ingress/e2e-worker-w1-5f10d2-openshift-default-6c6777d6f5-8zmm9"
Oct 30 20:04:25.673878 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:04:25.673857    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hwkkb\" (UniqueName: \"kubernetes.io/projected/91d406fb-17e3-47cf-bb3c-0a088ea0968e-kube-api-access-hwkkb\") pod \"e2e-worker-w1-5f10d2-openshift-default-6c6777d6f5-8zmm9\" (UID: \"91d406fb-17e3-47cf-bb3c-0a088ea0968e\") " pod="openshift-ingress/e2e-worker-w1-5f10d2-openshift-default-6c6777d6f5-8zmm9"
Oct 30 20:04:25.715577 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:04:25.715552    6275 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-5f10d2-openshift-default-6c6777d6f5-8zmm9"
Oct 30 20:04:25.879353 ip-10-0-131-26 kubenswrapper[6275]: W1030 20:04:25.879322    6275 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode3f64fa4_b2e2_4ab4_9da5_76bbfac9116d.slice/crio-85848d6f69702baa778000bb08917457d6a045e229d9744ea172434de79f3881 WatchSource:0}: Error finding container 85848d6f69702baa778000bb08917457d6a045e229d9744ea172434de79f3881: Status 404 returned error can't find the container with id 85848d6f69702baa778000bb08917457d6a045e229d9744ea172434de79f3881
Oct 30 20:04:25.879684 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:04:25.879652    6275 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-62f4a1-openshift-default-7fc84fbccc-52l47"]
Oct 30 20:04:25.882236 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:04:25.882172    6275 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Oct 30 20:04:25.882321 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:04:25.882270    6275 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Oct 30 20:04:25.882321 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:04:25.882298    6275 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Oct 30 20:04:25.933558 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:04:25.933512    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-375e5a55-t88c4" event={"ID":"aa5c03b3-8071-45e5-aa3a-f3be239f9985","Type":"ContainerStarted","Data":"b37d0ef399e5a48573054aaadb877ec27adf74071af97ee8e64b3b907912ee4e"}
Oct 30 20:04:25.933698 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:04:25.933580    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-375e5a55-t88c4" event={"ID":"aa5c03b3-8071-45e5-aa3a-f3be239f9985","Type":"ContainerStarted","Data":"242a9edfbf1189c8e650b3e5f92119d0be146981fe15a5fd848f86b9c98d30da"}
Oct 30 20:04:25.934980 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:04:25.934955    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-62f4a1-openshift-default-7fc84fbccc-52l47" event={"ID":"e3f64fa4-b2e2-4ab4-9da5-76bbfac9116d","Type":"ContainerStarted","Data":"85848d6f69702baa778000bb08917457d6a045e229d9744ea172434de79f3881"}
Oct 30 20:04:26.017621 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:04:26.017564    6275 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-sub-375e5a55-t88c4" podStartSLOduration=2.017548874 podStartE2EDuration="2.017548874s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:04:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:04:26.01462328 +0000 UTC m=+976.476350144" watchObservedRunningTime="2026-10-30 20:04:26.017548874 +0000 UTC m=+976.479275737"
Oct 30 20:04:26.059238 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:04:26.059189    6275 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Oct 30 20:04:26.059515 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:04:26.059478    6275 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Oct 30 20:04:26.059653 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:04:26.059590    6275 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Oct 30 20:04:26.060148 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:04:26.059315    6275 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w1-5f10d2-openshift-default-6c6777d6f5-8zmm9"]
Oct 30 20:04:26.269102 ip-10-0-131-26 kubenswrapper[6275]: E1030 20:04:26.269062    6275 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-fwc77" containerName="extractor"
Oct 30 20:04:26.950807 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:04:26.950774    6275 generic.go:356] "Generic (PLEG): container finished" podID="aa5c03b3-8071-45e5-aa3a-f3be239f9985" containerID="b37d0ef399e5a48573054aaadb877ec27adf74071af97ee8e64b3b907912ee4e" exitCode=0
Oct 30 20:04:26.951395 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:04:26.950846    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-375e5a55-t88c4" event={"ID":"aa5c03b3-8071-45e5-aa3a-f3be239f9985","Type":"ContainerDied","Data":"b37d0ef399e5a48573054aaadb877ec27adf74071af97ee8e64b3b907912ee4e"}
Oct 30 20:04:26.953739 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:04:26.953715    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-62f4a1-openshift-default-7fc84fbccc-52l47" event={"ID":"e3f64fa4-b2e2-4ab4-9da5-76bbfac9116d","Type":"ContainerStarted","Data":"eca7fa7d549a1e9d0c85a897ab438f5c3e7f4e44aa7009891ef536d76d8eb603"}
Oct 30 20:04:26.955316 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:04:26.955292    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-5f10d2-openshift-default-6c6777d6f5-8zmm9" event={"ID":"91d406fb-17e3-47cf-bb3c-0a088ea0968e","Type":"ContainerStarted","Data":"d601d2994c106837cf09d70d0dddc461217a7c2b93e13b33c7c3c87810e4689f"}
Oct 30 20:04:26.955408 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:04:26.955340    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-5f10d2-openshift-default-6c6777d6f5-8zmm9" event={"ID":"91d406fb-17e3-47cf-bb3c-0a088ea0968e","Type":"ContainerStarted","Data":"c9b96a9caf7ba555114e0fc99c6fd1e28b7c88c7fe732aa0a2be3461c9034d76"}
Oct 30 20:04:27.058324 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:04:27.058268    6275 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w0-62f4a1-openshift-default-7fc84fbccc-52l47" podStartSLOduration=2.058251917 podStartE2EDuration="2.058251917s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:04:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:04:27.05608702 +0000 UTC m=+977.517813884" watchObservedRunningTime="2026-10-30 20:04:27.058251917 +0000 UTC m=+977.519978780"
Oct 30 20:04:27.130849 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:04:27.130789    6275 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w1-5f10d2-openshift-default-6c6777d6f5-8zmm9" podStartSLOduration=2.130769742 podStartE2EDuration="2.130769742s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:04:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:04:27.113902981 +0000 UTC m=+977.575629849" watchObservedRunningTime="2026-10-30 20:04:27.130769742 +0000 UTC m=+977.592496604"
Oct 30 20:04:27.552277 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:04:27.552240    6275 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w0-62f4a1-openshift-default-7fc84fbccc-52l47"
Oct 30 20:04:27.553669 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:04:27.553647    6275 patch_prober.go:29] interesting pod/e2e-worker-w0-62f4a1-openshift-default-7fc84fbccc-52l47 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.76:15021/healthz/ready\": dial tcp 10.134.0.76:15021: connect: connection refused" start-of-body=
Oct 30 20:04:27.553729 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:04:27.553697    6275 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-62f4a1-openshift-default-7fc84fbccc-52l47" podUID="e3f64fa4-b2e2-4ab4-9da5-76bbfac9116d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.76:15021/healthz/ready\": dial tcp 10.134.0.76:15021: connect: connection refused"
Oct 30 20:04:27.719534 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:04:27.719498    6275 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w1-5f10d2-openshift-default-6c6777d6f5-8zmm9"
Oct 30 20:04:27.719911 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:04:27.719886    6275 patch_prober.go:29] interesting pod/e2e-worker-w1-5f10d2-openshift-default-6c6777d6f5-8zmm9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.77:15021/healthz/ready\": dial tcp 10.134.0.77:15021: connect: connection refused" start-of-body=
Oct 30 20:04:27.720091 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:04:27.720063    6275 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-5f10d2-openshift-default-6c6777d6f5-8zmm9" podUID="91d406fb-17e3-47cf-bb3c-0a088ea0968e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.77:15021/healthz/ready\": dial tcp 10.134.0.77:15021: connect: connection refused"
Oct 30 20:04:28.319439 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:04:28.309663    6275 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-375e5a55-t88c4"
Oct 30 20:04:28.345918 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:04:28.345890    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/aa5c03b3-8071-45e5-aa3a-f3be239f9985-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/aa5c03b3-8071-45e5-aa3a-f3be239f9985-maas-api-xks-ca\") pod \"aa5c03b3-8071-45e5-aa3a-f3be239f9985\" (UID: \"aa5c03b3-8071-45e5-aa3a-f3be239f9985\") "
Oct 30 20:04:28.346179 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:04:28.346163    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/aa5c03b3-8071-45e5-aa3a-f3be239f9985-kube-api-access-m79mq\" (UniqueName: \"kubernetes.io/projected/aa5c03b3-8071-45e5-aa3a-f3be239f9985-kube-api-access-m79mq\") pod \"aa5c03b3-8071-45e5-aa3a-f3be239f9985\" (UID: \"aa5c03b3-8071-45e5-aa3a-f3be239f9985\") "
Oct 30 20:04:28.346281 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:04:28.346272    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/aa5c03b3-8071-45e5-aa3a-f3be239f9985-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/aa5c03b3-8071-45e5-aa3a-f3be239f9985-maas-api-openshift-ca\") pod \"aa5c03b3-8071-45e5-aa3a-f3be239f9985\" (UID: \"aa5c03b3-8071-45e5-aa3a-f3be239f9985\") "
Oct 30 20:04:28.347032 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:04:28.347008    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/aa5c03b3-8071-45e5-aa3a-f3be239f9985-maas-api-openshift-ca" pod "aa5c03b3-8071-45e5-aa3a-f3be239f9985" (UID: "aa5c03b3-8071-45e5-aa3a-f3be239f9985"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:04:28.348776 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:04:28.348758    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/aa5c03b3-8071-45e5-aa3a-f3be239f9985-maas-api-xks-ca" pod "aa5c03b3-8071-45e5-aa3a-f3be239f9985" (UID: "aa5c03b3-8071-45e5-aa3a-f3be239f9985"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 20:04:28.348872 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:04:28.348848    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aa5c03b3-8071-45e5-aa3a-f3be239f9985-kube-api-access-m79mq" pod "aa5c03b3-8071-45e5-aa3a-f3be239f9985" (UID: "aa5c03b3-8071-45e5-aa3a-f3be239f9985"). InnerVolumeSpecName "kube-api-access-m79mq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:04:28.448168 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:04:28.448131    6275 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/aa5c03b3-8071-45e5-aa3a-f3be239f9985-maas-api-xks-ca\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:04:28.448168 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:04:28.448170    6275 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m79mq\" (UniqueName: \"kubernetes.io/projected/aa5c03b3-8071-45e5-aa3a-f3be239f9985-kube-api-access-m79mq\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:04:28.448465 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:04:28.448185    6275 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/aa5c03b3-8071-45e5-aa3a-f3be239f9985-maas-api-openshift-ca\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:04:28.551852 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:04:28.551766    6275 patch_prober.go:29] interesting pod/e2e-worker-w0-62f4a1-openshift-default-7fc84fbccc-52l47 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.76:15021/healthz/ready\": dial tcp 10.134.0.76:15021: connect: connection refused" start-of-body=
Oct 30 20:04:28.551852 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:04:28.551815    6275 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-62f4a1-openshift-default-7fc84fbccc-52l47" podUID="e3f64fa4-b2e2-4ab4-9da5-76bbfac9116d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.76:15021/healthz/ready\": dial tcp 10.134.0.76:15021: connect: connection refused"
Oct 30 20:04:28.717801 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:04:28.717763    6275 patch_prober.go:29] interesting pod/e2e-worker-w1-5f10d2-openshift-default-6c6777d6f5-8zmm9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.77:15021/healthz/ready\": dial tcp 10.134.0.77:15021: connect: connection refused" start-of-body=
Oct 30 20:04:28.718973 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:04:28.718942    6275 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-5f10d2-openshift-default-6c6777d6f5-8zmm9" podUID="91d406fb-17e3-47cf-bb3c-0a088ea0968e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.77:15021/healthz/ready\": dial tcp 10.134.0.77:15021: connect: connection refused"
Oct 30 20:04:28.988899 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:04:28.988874    6275 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-375e5a55-t88c4"
Oct 30 20:04:28.998438 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:04:28.989200    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-375e5a55-t88c4" event={"ID":"aa5c03b3-8071-45e5-aa3a-f3be239f9985","Type":"ContainerDied","Data":"242a9edfbf1189c8e650b3e5f92119d0be146981fe15a5fd848f86b9c98d30da"}
Oct 30 20:04:28.998438 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:04:28.991627    6275 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="242a9edfbf1189c8e650b3e5f92119d0be146981fe15a5fd848f86b9c98d30da"
Oct 30 20:04:29.552571 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:04:29.552532    6275 patch_prober.go:29] interesting pod/e2e-worker-w0-62f4a1-openshift-default-7fc84fbccc-52l47 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.76:15021/healthz/ready\": dial tcp 10.134.0.76:15021: connect: connection refused" start-of-body=
Oct 30 20:04:29.552965 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:04:29.552595    6275 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-62f4a1-openshift-default-7fc84fbccc-52l47" podUID="e3f64fa4-b2e2-4ab4-9da5-76bbfac9116d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.76:15021/healthz/ready\": dial tcp 10.134.0.76:15021: connect: connection refused"
Oct 30 20:04:29.717866 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:04:29.717828    6275 patch_prober.go:29] interesting pod/e2e-worker-w1-5f10d2-openshift-default-6c6777d6f5-8zmm9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.77:15021/healthz/ready\": dial tcp 10.134.0.77:15021: connect: connection refused" start-of-body=
Oct 30 20:04:29.718134 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:04:29.718107    6275 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-5f10d2-openshift-default-6c6777d6f5-8zmm9" podUID="91d406fb-17e3-47cf-bb3c-0a088ea0968e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.77:15021/healthz/ready\": dial tcp 10.134.0.77:15021: connect: connection refused"
Oct 30 20:04:30.552431 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:04:30.552387    6275 patch_prober.go:29] interesting pod/e2e-worker-w0-62f4a1-openshift-default-7fc84fbccc-52l47 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.76:15021/healthz/ready\": dial tcp 10.134.0.76:15021: connect: connection refused" start-of-body=
Oct 30 20:04:30.552602 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:04:30.552473    6275 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-62f4a1-openshift-default-7fc84fbccc-52l47" podUID="e3f64fa4-b2e2-4ab4-9da5-76bbfac9116d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.76:15021/healthz/ready\": dial tcp 10.134.0.76:15021: connect: connection refused"
Oct 30 20:04:30.724562 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:04:30.723346    6275 patch_prober.go:29] interesting pod/e2e-worker-w1-5f10d2-openshift-default-6c6777d6f5-8zmm9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.77:15021/healthz/ready\": dial tcp 10.134.0.77:15021: connect: connection refused" start-of-body=
Oct 30 20:04:30.724562 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:04:30.723432    6275 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-5f10d2-openshift-default-6c6777d6f5-8zmm9" podUID="91d406fb-17e3-47cf-bb3c-0a088ea0968e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.77:15021/healthz/ready\": dial tcp 10.134.0.77:15021: connect: connection refused"
Oct 30 20:04:31.552488 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:04:31.552450    6275 patch_prober.go:29] interesting pod/e2e-worker-w0-62f4a1-openshift-default-7fc84fbccc-52l47 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.76:15021/healthz/ready\": dial tcp 10.134.0.76:15021: connect: connection refused" start-of-body=
Oct 30 20:04:31.552639 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:04:31.552503    6275 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-62f4a1-openshift-default-7fc84fbccc-52l47" podUID="e3f64fa4-b2e2-4ab4-9da5-76bbfac9116d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.76:15021/healthz/ready\": dial tcp 10.134.0.76:15021: connect: connection refused"
Oct 30 20:04:31.719267 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:04:31.718781    6275 patch_prober.go:29] interesting pod/e2e-worker-w1-5f10d2-openshift-default-6c6777d6f5-8zmm9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.77:15021/healthz/ready\": dial tcp 10.134.0.77:15021: connect: connection refused" start-of-body=
Oct 30 20:04:31.719267 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:04:31.718866    6275 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-5f10d2-openshift-default-6c6777d6f5-8zmm9" podUID="91d406fb-17e3-47cf-bb3c-0a088ea0968e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.77:15021/healthz/ready\": dial tcp 10.134.0.77:15021: connect: connection refused"
Oct 30 20:04:31.818740 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:04:31.817588    6275 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w3-912f24/distinct-2-w3-912f24-kserve-566865fdcc-ptx4l"
Oct 30 20:04:31.835638 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:04:31.835610    6275 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w3-912f24/distinct-2-w3-912f24-kserve-566865fdcc-ptx4l"
Oct 30 20:04:32.054556 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:04:32.054528    6275 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w3-912f24/distinct-2-w3-912f24-kserve-566865fdcc-ptx4l"
Oct 30 20:04:32.551650 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:04:32.551614    6275 patch_prober.go:29] interesting pod/e2e-worker-w0-62f4a1-openshift-default-7fc84fbccc-52l47 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.76:15021/healthz/ready\": dial tcp 10.134.0.76:15021: connect: connection refused" start-of-body=
Oct 30 20:04:32.551852 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:04:32.551694    6275 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-62f4a1-openshift-default-7fc84fbccc-52l47" podUID="e3f64fa4-b2e2-4ab4-9da5-76bbfac9116d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.76:15021/healthz/ready\": dial tcp 10.134.0.76:15021: connect: connection refused"
Oct 30 20:04:32.716235 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:04:32.716199    6275 patch_prober.go:29] interesting pod/e2e-worker-w1-5f10d2-openshift-default-6c6777d6f5-8zmm9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.77:15021/healthz/ready\": dial tcp 10.134.0.77:15021: connect: connection refused" start-of-body=
Oct 30 20:04:32.716729 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:04:32.716259    6275 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-5f10d2-openshift-default-6c6777d6f5-8zmm9" podUID="91d406fb-17e3-47cf-bb3c-0a088ea0968e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.77:15021/healthz/ready\": dial tcp 10.134.0.77:15021: connect: connection refused"
Oct 30 20:04:33.631926 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:04:33.631876    6275 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w0-62f4a1-openshift-default-7fc84fbccc-52l47"
Oct 30 20:04:33.632653 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:04:33.632627    6275 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w0-62f4a1-openshift-default-7fc84fbccc-52l47"
Oct 30 20:04:33.634863 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:04:33.634840    6275 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w0-62f4a1-openshift-default-7fc84fbccc-52l47"
Oct 30 20:04:33.737083 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:04:33.737047    6275 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w1-5f10d2-openshift-default-6c6777d6f5-8zmm9"
Oct 30 20:04:33.737518 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:04:33.737438    6275 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w1-5f10d2-openshift-default-6c6777d6f5-8zmm9"
Oct 30 20:04:33.739612 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:04:33.739591    6275 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w1-5f10d2-openshift-default-6c6777d6f5-8zmm9"
Oct 30 20:04:36.423937 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:04:36.423902    6275 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-ffba6574-67lrj"]
Oct 30 20:04:36.424548 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:04:36.424533    6275 cpu_manager.go:414] "containerMap: removing container" podUID="aa5c03b3-8071-45e5-aa3a-f3be239f9985" containerName="revoke-keys"
Oct 30 20:04:36.424594 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:04:36.424549    6275 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="aa5c03b3-8071-45e5-aa3a-f3be239f9985" containerName="revoke-keys"
Oct 30 20:04:36.424670 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:04:36.424660    6275 memory_manager.go:365] "RemoveStaleState removing state" podUID="aa5c03b3-8071-45e5-aa3a-f3be239f9985" containerName="revoke-keys"
Oct 30 20:04:36.428523 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:04:36.428498    6275 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-ffba6574-67lrj"
Oct 30 20:04:36.446101 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:04:36.446072    6275 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\""
Oct 30 20:04:36.450383 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:04:36.450360    6275 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-ffba6574-67lrj"]
Oct 30 20:04:36.459040 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:04:36.459005    6275 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-scs2w\""
Oct 30 20:04:36.501769 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:04:36.501733    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/922c18e5-36a6-4665-abf1-4873e6479202-maas-api-xks-ca\") pod \"maas-api-revoke-sub-ffba6574-67lrj\" (UID: \"922c18e5-36a6-4665-abf1-4873e6479202\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-ffba6574-67lrj"
Oct 30 20:04:36.501769 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:04:36.501771    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p7fpg\" (UniqueName: \"kubernetes.io/projected/922c18e5-36a6-4665-abf1-4873e6479202-kube-api-access-p7fpg\") pod \"maas-api-revoke-sub-ffba6574-67lrj\" (UID: \"922c18e5-36a6-4665-abf1-4873e6479202\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-ffba6574-67lrj"
Oct 30 20:04:36.502043 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:04:36.502027    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/922c18e5-36a6-4665-abf1-4873e6479202-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-ffba6574-67lrj\" (UID: \"922c18e5-36a6-4665-abf1-4873e6479202\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-ffba6574-67lrj"
Oct 30 20:04:36.602878 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:04:36.602844    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/922c18e5-36a6-4665-abf1-4873e6479202-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-ffba6574-67lrj\" (UID: \"922c18e5-36a6-4665-abf1-4873e6479202\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-ffba6574-67lrj"
Oct 30 20:04:36.603045 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:04:36.602923    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/922c18e5-36a6-4665-abf1-4873e6479202-maas-api-xks-ca\") pod \"maas-api-revoke-sub-ffba6574-67lrj\" (UID: \"922c18e5-36a6-4665-abf1-4873e6479202\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-ffba6574-67lrj"
Oct 30 20:04:36.603045 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:04:36.602944    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p7fpg\" (UniqueName: \"kubernetes.io/projected/922c18e5-36a6-4665-abf1-4873e6479202-kube-api-access-p7fpg\") pod \"maas-api-revoke-sub-ffba6574-67lrj\" (UID: \"922c18e5-36a6-4665-abf1-4873e6479202\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-ffba6574-67lrj"
Oct 30 20:04:36.603604 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:04:36.603582    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/922c18e5-36a6-4665-abf1-4873e6479202-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-ffba6574-67lrj\" (UID: \"922c18e5-36a6-4665-abf1-4873e6479202\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-ffba6574-67lrj"
Oct 30 20:04:36.605281 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:04:36.605257    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/922c18e5-36a6-4665-abf1-4873e6479202-maas-api-xks-ca\") pod \"maas-api-revoke-sub-ffba6574-67lrj\" (UID: \"922c18e5-36a6-4665-abf1-4873e6479202\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-ffba6574-67lrj"
Oct 30 20:04:36.629437 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:04:36.629393    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p7fpg\" (UniqueName: \"kubernetes.io/projected/922c18e5-36a6-4665-abf1-4873e6479202-kube-api-access-p7fpg\") pod \"maas-api-revoke-sub-ffba6574-67lrj\" (UID: \"922c18e5-36a6-4665-abf1-4873e6479202\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-ffba6574-67lrj"
Oct 30 20:04:36.742895 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:04:36.742868    6275 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-ffba6574-67lrj"
Oct 30 20:04:37.061775 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:04:37.061737    6275 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-ffba6574-67lrj"]
Oct 30 20:04:37.069312 ip-10-0-131-26 kubenswrapper[6275]: W1030 20:04:37.069278    6275 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod922c18e5_36a6_4665_abf1_4873e6479202.slice/crio-f4c9b07c440e7f8cd30d091d46994bca72aaac6426e2e67cc7a3c2385cc6b3e5 WatchSource:0}: Error finding container f4c9b07c440e7f8cd30d091d46994bca72aaac6426e2e67cc7a3c2385cc6b3e5: Status 404 returned error can't find the container with id f4c9b07c440e7f8cd30d091d46994bca72aaac6426e2e67cc7a3c2385cc6b3e5
Oct 30 20:04:37.085876 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:04:37.085849    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-ffba6574-67lrj" event={"ID":"922c18e5-36a6-4665-abf1-4873e6479202","Type":"ContainerStarted","Data":"f4c9b07c440e7f8cd30d091d46994bca72aaac6426e2e67cc7a3c2385cc6b3e5"}
Oct 30 20:04:37.940798 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:04:37.940765    6275 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-4508ea12-42d67"]
Oct 30 20:04:37.945209 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:04:37.945184    6275 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-4508ea12-42d67"
Oct 30 20:04:37.966361 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:04:37.966336    6275 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-4508ea12-42d67"]
Oct 30 20:04:38.019921 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:04:38.019889    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/2e0ddfd8-905a-453c-85cb-64e3902fc535-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-4508ea12-42d67\" (UID: \"2e0ddfd8-905a-453c-85cb-64e3902fc535\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-4508ea12-42d67"
Oct 30 20:04:38.020079 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:04:38.020056    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-txtwz\" (UniqueName: \"kubernetes.io/projected/2e0ddfd8-905a-453c-85cb-64e3902fc535-kube-api-access-txtwz\") pod \"maas-api-revoke-sub-4508ea12-42d67\" (UID: \"2e0ddfd8-905a-453c-85cb-64e3902fc535\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-4508ea12-42d67"
Oct 30 20:04:38.020121 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:04:38.020105    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/2e0ddfd8-905a-453c-85cb-64e3902fc535-maas-api-xks-ca\") pod \"maas-api-revoke-sub-4508ea12-42d67\" (UID: \"2e0ddfd8-905a-453c-85cb-64e3902fc535\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-4508ea12-42d67"
Oct 30 20:04:38.093749 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:04:38.093717    6275 generic.go:356] "Generic (PLEG): container finished" podID="922c18e5-36a6-4665-abf1-4873e6479202" containerID="06c3d98df953f5effa394353fe86f952af5b52a033052e15693c11753b50b0a2" exitCode=0
Oct 30 20:04:38.093905 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:04:38.093807    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-ffba6574-67lrj" event={"ID":"922c18e5-36a6-4665-abf1-4873e6479202","Type":"ContainerDied","Data":"06c3d98df953f5effa394353fe86f952af5b52a033052e15693c11753b50b0a2"}
Oct 30 20:04:38.121289 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:04:38.121259    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-txtwz\" (UniqueName: \"kubernetes.io/projected/2e0ddfd8-905a-453c-85cb-64e3902fc535-kube-api-access-txtwz\") pod \"maas-api-revoke-sub-4508ea12-42d67\" (UID: \"2e0ddfd8-905a-453c-85cb-64e3902fc535\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-4508ea12-42d67"
Oct 30 20:04:38.121448 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:04:38.121303    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/2e0ddfd8-905a-453c-85cb-64e3902fc535-maas-api-xks-ca\") pod \"maas-api-revoke-sub-4508ea12-42d67\" (UID: \"2e0ddfd8-905a-453c-85cb-64e3902fc535\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-4508ea12-42d67"
Oct 30 20:04:38.121523 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:04:38.121446    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/2e0ddfd8-905a-453c-85cb-64e3902fc535-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-4508ea12-42d67\" (UID: \"2e0ddfd8-905a-453c-85cb-64e3902fc535\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-4508ea12-42d67"
Oct 30 20:04:38.122063 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:04:38.122039    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/2e0ddfd8-905a-453c-85cb-64e3902fc535-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-4508ea12-42d67\" (UID: \"2e0ddfd8-905a-453c-85cb-64e3902fc535\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-4508ea12-42d67"
Oct 30 20:04:38.123654 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:04:38.123635    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/2e0ddfd8-905a-453c-85cb-64e3902fc535-maas-api-xks-ca\") pod \"maas-api-revoke-sub-4508ea12-42d67\" (UID: \"2e0ddfd8-905a-453c-85cb-64e3902fc535\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-4508ea12-42d67"
Oct 30 20:04:38.147551 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:04:38.147522    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-txtwz\" (UniqueName: \"kubernetes.io/projected/2e0ddfd8-905a-453c-85cb-64e3902fc535-kube-api-access-txtwz\") pod \"maas-api-revoke-sub-4508ea12-42d67\" (UID: \"2e0ddfd8-905a-453c-85cb-64e3902fc535\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-4508ea12-42d67"
Oct 30 20:04:38.260994 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:04:38.260963    6275 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-4508ea12-42d67"
Oct 30 20:04:38.572191 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:04:38.572128    6275 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-4508ea12-42d67"]
Oct 30 20:04:38.573554 ip-10-0-131-26 kubenswrapper[6275]: W1030 20:04:38.573524    6275 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2e0ddfd8_905a_453c_85cb_64e3902fc535.slice/crio-7ee46a3677a51abbbcfa4140873c1343ad7895217dd96bd40ac70e1a30284207 WatchSource:0}: Error finding container 7ee46a3677a51abbbcfa4140873c1343ad7895217dd96bd40ac70e1a30284207: Status 404 returned error can't find the container with id 7ee46a3677a51abbbcfa4140873c1343ad7895217dd96bd40ac70e1a30284207
Oct 30 20:04:39.101499 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:04:39.101462    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-4508ea12-42d67" event={"ID":"2e0ddfd8-905a-453c-85cb-64e3902fc535","Type":"ContainerStarted","Data":"43f04bf65176fd917842acc23b132b4c14b6c0253eb6f2e5e6ff6ae6f06e5086"}
Oct 30 20:04:39.101947 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:04:39.101516    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-4508ea12-42d67" event={"ID":"2e0ddfd8-905a-453c-85cb-64e3902fc535","Type":"ContainerStarted","Data":"7ee46a3677a51abbbcfa4140873c1343ad7895217dd96bd40ac70e1a30284207"}
Oct 30 20:04:39.170461 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:04:39.170367    6275 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-sub-4508ea12-42d67" podStartSLOduration=2.170350837 podStartE2EDuration="2.170350837s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:04:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:04:39.166962231 +0000 UTC m=+989.628689095" watchObservedRunningTime="2026-10-30 20:04:39.170350837 +0000 UTC m=+989.632077700"
Oct 30 20:04:39.252497 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:04:39.252473    6275 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-ffba6574-67lrj"
Oct 30 20:04:39.336237 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:04:39.336203    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/922c18e5-36a6-4665-abf1-4873e6479202-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/922c18e5-36a6-4665-abf1-4873e6479202-maas-api-xks-ca\") pod \"922c18e5-36a6-4665-abf1-4873e6479202\" (UID: \"922c18e5-36a6-4665-abf1-4873e6479202\") "
Oct 30 20:04:39.336453 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:04:39.336431    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/922c18e5-36a6-4665-abf1-4873e6479202-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/922c18e5-36a6-4665-abf1-4873e6479202-maas-api-openshift-ca\") pod \"922c18e5-36a6-4665-abf1-4873e6479202\" (UID: \"922c18e5-36a6-4665-abf1-4873e6479202\") "
Oct 30 20:04:39.336588 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:04:39.336566    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/922c18e5-36a6-4665-abf1-4873e6479202-kube-api-access-p7fpg\" (UniqueName: \"kubernetes.io/projected/922c18e5-36a6-4665-abf1-4873e6479202-kube-api-access-p7fpg\") pod \"922c18e5-36a6-4665-abf1-4873e6479202\" (UID: \"922c18e5-36a6-4665-abf1-4873e6479202\") "
Oct 30 20:04:39.336764 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:04:39.336739    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/922c18e5-36a6-4665-abf1-4873e6479202-maas-api-openshift-ca" pod "922c18e5-36a6-4665-abf1-4873e6479202" (UID: "922c18e5-36a6-4665-abf1-4873e6479202"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:04:39.337097 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:04:39.337079    6275 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/922c18e5-36a6-4665-abf1-4873e6479202-maas-api-openshift-ca\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:04:39.338472 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:04:39.338442    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/922c18e5-36a6-4665-abf1-4873e6479202-maas-api-xks-ca" pod "922c18e5-36a6-4665-abf1-4873e6479202" (UID: "922c18e5-36a6-4665-abf1-4873e6479202"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 20:04:39.338637 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:04:39.338616    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/922c18e5-36a6-4665-abf1-4873e6479202-kube-api-access-p7fpg" pod "922c18e5-36a6-4665-abf1-4873e6479202" (UID: "922c18e5-36a6-4665-abf1-4873e6479202"). InnerVolumeSpecName "kube-api-access-p7fpg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:04:39.438727 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:04:39.438658    6275 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p7fpg\" (UniqueName: \"kubernetes.io/projected/922c18e5-36a6-4665-abf1-4873e6479202-kube-api-access-p7fpg\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:04:39.438727 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:04:39.438688    6275 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/922c18e5-36a6-4665-abf1-4873e6479202-maas-api-xks-ca\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:04:40.108761 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:04:40.108731    6275 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-ffba6574-67lrj"
Oct 30 20:04:40.109157 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:04:40.108773    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-ffba6574-67lrj" event={"ID":"922c18e5-36a6-4665-abf1-4873e6479202","Type":"ContainerDied","Data":"f4c9b07c440e7f8cd30d091d46994bca72aaac6426e2e67cc7a3c2385cc6b3e5"}
Oct 30 20:04:40.109157 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:04:40.108858    6275 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f4c9b07c440e7f8cd30d091d46994bca72aaac6426e2e67cc7a3c2385cc6b3e5"
Oct 30 20:04:40.110399 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:04:40.110375    6275 generic.go:356] "Generic (PLEG): container finished" podID="2e0ddfd8-905a-453c-85cb-64e3902fc535" containerID="43f04bf65176fd917842acc23b132b4c14b6c0253eb6f2e5e6ff6ae6f06e5086" exitCode=0
Oct 30 20:04:40.110540 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:04:40.110405    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-4508ea12-42d67" event={"ID":"2e0ddfd8-905a-453c-85cb-64e3902fc535","Type":"ContainerDied","Data":"43f04bf65176fd917842acc23b132b4c14b6c0253eb6f2e5e6ff6ae6f06e5086"}
Oct 30 20:04:41.261925 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:04:41.261894    6275 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-4508ea12-42d67"
Oct 30 20:04:41.358591 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:04:41.358560    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/2e0ddfd8-905a-453c-85cb-64e3902fc535-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/2e0ddfd8-905a-453c-85cb-64e3902fc535-maas-api-openshift-ca\") pod \"2e0ddfd8-905a-453c-85cb-64e3902fc535\" (UID: \"2e0ddfd8-905a-453c-85cb-64e3902fc535\") "
Oct 30 20:04:41.358736 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:04:41.358602    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/2e0ddfd8-905a-453c-85cb-64e3902fc535-kube-api-access-txtwz\" (UniqueName: \"kubernetes.io/projected/2e0ddfd8-905a-453c-85cb-64e3902fc535-kube-api-access-txtwz\") pod \"2e0ddfd8-905a-453c-85cb-64e3902fc535\" (UID: \"2e0ddfd8-905a-453c-85cb-64e3902fc535\") "
Oct 30 20:04:41.358736 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:04:41.358714    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/2e0ddfd8-905a-453c-85cb-64e3902fc535-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/2e0ddfd8-905a-453c-85cb-64e3902fc535-maas-api-xks-ca\") pod \"2e0ddfd8-905a-453c-85cb-64e3902fc535\" (UID: \"2e0ddfd8-905a-453c-85cb-64e3902fc535\") "
Oct 30 20:04:41.359000 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:04:41.358963    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2e0ddfd8-905a-453c-85cb-64e3902fc535-maas-api-openshift-ca" pod "2e0ddfd8-905a-453c-85cb-64e3902fc535" (UID: "2e0ddfd8-905a-453c-85cb-64e3902fc535"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:04:41.359126 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:04:41.359104    6275 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/2e0ddfd8-905a-453c-85cb-64e3902fc535-maas-api-openshift-ca\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:04:41.360875 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:04:41.360855    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2e0ddfd8-905a-453c-85cb-64e3902fc535-maas-api-xks-ca" pod "2e0ddfd8-905a-453c-85cb-64e3902fc535" (UID: "2e0ddfd8-905a-453c-85cb-64e3902fc535"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 20:04:41.361115 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:04:41.361092    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2e0ddfd8-905a-453c-85cb-64e3902fc535-kube-api-access-txtwz" pod "2e0ddfd8-905a-453c-85cb-64e3902fc535" (UID: "2e0ddfd8-905a-453c-85cb-64e3902fc535"). InnerVolumeSpecName "kube-api-access-txtwz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:04:41.459895 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:04:41.459842    6275 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-txtwz\" (UniqueName: \"kubernetes.io/projected/2e0ddfd8-905a-453c-85cb-64e3902fc535-kube-api-access-txtwz\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:04:41.459895 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:04:41.459885    6275 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/2e0ddfd8-905a-453c-85cb-64e3902fc535-maas-api-xks-ca\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:04:42.125368 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:04:42.125333    6275 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-4508ea12-42d67"
Oct 30 20:04:42.125368 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:04:42.125359    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-4508ea12-42d67" event={"ID":"2e0ddfd8-905a-453c-85cb-64e3902fc535","Type":"ContainerDied","Data":"7ee46a3677a51abbbcfa4140873c1343ad7895217dd96bd40ac70e1a30284207"}
Oct 30 20:04:42.125692 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:04:42.125407    6275 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7ee46a3677a51abbbcfa4140873c1343ad7895217dd96bd40ac70e1a30284207"
Oct 30 20:04:49.492542 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:04:49.484522    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-5f10d2/distinct-w1-5f10d2-kserve-5bf49798b8-l2j84" podUID="9e831c5d-2019-4015-ac57-2b4b1b90b9b3" containerName="main" probeResult="failure" output="Get \"https://10.134.0.69:8000/ready\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:04:49.500534 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:04:49.500494    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-912f24/simulator-w3-912f24-kserve-59897cf48b-sd5wj" podUID="b4de6427-0db0-42d9-8b88-6b35d9d4c314" containerName="main" probeResult="failure" output="Get \"https://10.134.0.54:8000/ready\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:04:49.527401 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:04:49.525904    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-f1f016/simulator-w4-f1f016-kserve-55db8447ff-749tw" podUID="8f3174b6-2fdc-48c2-99be-7a966731f018" containerName="main" probeResult="failure" output="Get \"https://10.134.0.55:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:04:49.642438 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:04:49.641582    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-51dd62/simulator-w6-51dd62-kserve-d6bb4985f-65j9h" podUID="f7e1ff07-15d6-49b5-8edc-52c9d6825ed7" containerName="main" probeResult="failure" output="Get \"https://10.134.0.56:8000/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:04:49.735387 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:04:49.701740    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-efbac3/premium-w2-efbac3-kserve-55f54cfff6-9fqbz" podUID="083136dc-91fb-454f-a782-87b004e73d1b" containerName="main" probeResult="failure" output="Get \"https://10.134.0.59:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:04:49.806016 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:04:49.805915    6275 patch_prober.go:29] interesting pod/e2e-worker-w5-626870-openshift-default-7cd649d59c-zchw8 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.70:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 20:04:49.806273 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:04:49.806239    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w5-626870-openshift-default-7cd649d59c-zchw8" podUID="5aec32f5-a318-4b0c-9c2f-2af7f36b8fd4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.70:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:04:51.884778 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:04:51.884712    6275 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-9c0ed893-272hm"]
Oct 30 20:04:51.885429 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:04:51.885396    6275 cpu_manager.go:414] "containerMap: removing container" podUID="922c18e5-36a6-4665-abf1-4873e6479202" containerName="revoke-keys"
Oct 30 20:04:51.885429 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:04:51.885430    6275 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="922c18e5-36a6-4665-abf1-4873e6479202" containerName="revoke-keys"
Oct 30 20:04:51.885604 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:04:51.885462    6275 cpu_manager.go:414] "containerMap: removing container" podUID="2e0ddfd8-905a-453c-85cb-64e3902fc535" containerName="revoke-keys"
Oct 30 20:04:51.885604 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:04:51.885469    6275 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="2e0ddfd8-905a-453c-85cb-64e3902fc535" containerName="revoke-keys"
Oct 30 20:04:51.885705 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:04:51.885686    6275 memory_manager.go:365] "RemoveStaleState removing state" podUID="922c18e5-36a6-4665-abf1-4873e6479202" containerName="revoke-keys"
Oct 30 20:04:51.885757 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:04:51.885705    6275 memory_manager.go:365] "RemoveStaleState removing state" podUID="2e0ddfd8-905a-453c-85cb-64e3902fc535" containerName="revoke-keys"
Oct 30 20:04:51.891474 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:04:51.891409    6275 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-9c0ed893-272hm"
Oct 30 20:04:51.913010 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:04:51.912941    6275 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-9c0ed893-272hm"]
Oct 30 20:04:51.916698 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:04:51.916669    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kzt2f\" (UniqueName: \"kubernetes.io/projected/06c43bdd-ba3d-4400-bcef-38aa8900fab9-kube-api-access-kzt2f\") pod \"maas-api-revoke-sub-9c0ed893-272hm\" (UID: \"06c43bdd-ba3d-4400-bcef-38aa8900fab9\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-9c0ed893-272hm"
Oct 30 20:04:51.916864 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:04:51.916713    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/06c43bdd-ba3d-4400-bcef-38aa8900fab9-maas-api-xks-ca\") pod \"maas-api-revoke-sub-9c0ed893-272hm\" (UID: \"06c43bdd-ba3d-4400-bcef-38aa8900fab9\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-9c0ed893-272hm"
Oct 30 20:04:51.916864 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:04:51.916800    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/06c43bdd-ba3d-4400-bcef-38aa8900fab9-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-9c0ed893-272hm\" (UID: \"06c43bdd-ba3d-4400-bcef-38aa8900fab9\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-9c0ed893-272hm"
Oct 30 20:04:51.961524 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:04:51.961487    6275 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\""
Oct 30 20:04:51.961755 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:04:51.961524    6275 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-scs2w\""
Oct 30 20:04:52.018266 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:04:52.018229    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kzt2f\" (UniqueName: \"kubernetes.io/projected/06c43bdd-ba3d-4400-bcef-38aa8900fab9-kube-api-access-kzt2f\") pod \"maas-api-revoke-sub-9c0ed893-272hm\" (UID: \"06c43bdd-ba3d-4400-bcef-38aa8900fab9\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-9c0ed893-272hm"
Oct 30 20:04:52.018266 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:04:52.018268    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/06c43bdd-ba3d-4400-bcef-38aa8900fab9-maas-api-xks-ca\") pod \"maas-api-revoke-sub-9c0ed893-272hm\" (UID: \"06c43bdd-ba3d-4400-bcef-38aa8900fab9\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-9c0ed893-272hm"
Oct 30 20:04:52.018541 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:04:52.018384    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/06c43bdd-ba3d-4400-bcef-38aa8900fab9-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-9c0ed893-272hm\" (UID: \"06c43bdd-ba3d-4400-bcef-38aa8900fab9\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-9c0ed893-272hm"
Oct 30 20:04:52.019105 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:04:52.019080    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/06c43bdd-ba3d-4400-bcef-38aa8900fab9-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-9c0ed893-272hm\" (UID: \"06c43bdd-ba3d-4400-bcef-38aa8900fab9\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-9c0ed893-272hm"
Oct 30 20:04:52.020642 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:04:52.020619    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/06c43bdd-ba3d-4400-bcef-38aa8900fab9-maas-api-xks-ca\") pod \"maas-api-revoke-sub-9c0ed893-272hm\" (UID: \"06c43bdd-ba3d-4400-bcef-38aa8900fab9\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-9c0ed893-272hm"
Oct 30 20:04:52.044123 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:04:52.044089    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kzt2f\" (UniqueName: \"kubernetes.io/projected/06c43bdd-ba3d-4400-bcef-38aa8900fab9-kube-api-access-kzt2f\") pod \"maas-api-revoke-sub-9c0ed893-272hm\" (UID: \"06c43bdd-ba3d-4400-bcef-38aa8900fab9\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-9c0ed893-272hm"
Oct 30 20:04:52.216657 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:04:52.216557    6275 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-9c0ed893-272hm"
Oct 30 20:04:52.526381 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:04:52.526342    6275 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-9c0ed893-272hm"]
Oct 30 20:04:52.527430 ip-10-0-131-26 kubenswrapper[6275]: W1030 20:04:52.527387    6275 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod06c43bdd_ba3d_4400_bcef_38aa8900fab9.slice/crio-4e384ef881132f419343c20f1f72d6dcce014ce287e524e0d3578d7e687444c8 WatchSource:0}: Error finding container 4e384ef881132f419343c20f1f72d6dcce014ce287e524e0d3578d7e687444c8: Status 404 returned error can't find the container with id 4e384ef881132f419343c20f1f72d6dcce014ce287e524e0d3578d7e687444c8
Oct 30 20:04:53.355387 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:04:53.355345    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-9c0ed893-272hm" event={"ID":"06c43bdd-ba3d-4400-bcef-38aa8900fab9","Type":"ContainerStarted","Data":"10744d2f8c53962545b4195f9dd6314d5c578544b4f7b673ed4af9239536b641"}
Oct 30 20:04:53.355797 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:04:53.355406    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-9c0ed893-272hm" event={"ID":"06c43bdd-ba3d-4400-bcef-38aa8900fab9","Type":"ContainerStarted","Data":"4e384ef881132f419343c20f1f72d6dcce014ce287e524e0d3578d7e687444c8"}
Oct 30 20:04:53.401978 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:04:53.401929    6275 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-sub-9c0ed893-272hm" podStartSLOduration=2.401915067 podStartE2EDuration="2.401915067s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:04:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:04:53.398756574 +0000 UTC m=+1003.860483439" watchObservedRunningTime="2026-10-30 20:04:53.401915067 +0000 UTC m=+1003.863641930"
Oct 30 20:04:54.364489 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:04:54.364450    6275 generic.go:356] "Generic (PLEG): container finished" podID="06c43bdd-ba3d-4400-bcef-38aa8900fab9" containerID="10744d2f8c53962545b4195f9dd6314d5c578544b4f7b673ed4af9239536b641" exitCode=0
Oct 30 20:04:54.365079 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:04:54.364498    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-9c0ed893-272hm" event={"ID":"06c43bdd-ba3d-4400-bcef-38aa8900fab9","Type":"ContainerDied","Data":"10744d2f8c53962545b4195f9dd6314d5c578544b4f7b673ed4af9239536b641"}
Oct 30 20:04:55.537265 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:04:55.537240    6275 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-9c0ed893-272hm"
Oct 30 20:04:55.578437 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:04:55.577340    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/06c43bdd-ba3d-4400-bcef-38aa8900fab9-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/06c43bdd-ba3d-4400-bcef-38aa8900fab9-maas-api-openshift-ca\") pod \"06c43bdd-ba3d-4400-bcef-38aa8900fab9\" (UID: \"06c43bdd-ba3d-4400-bcef-38aa8900fab9\") "
Oct 30 20:04:55.578437 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:04:55.577502    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/06c43bdd-ba3d-4400-bcef-38aa8900fab9-kube-api-access-kzt2f\" (UniqueName: \"kubernetes.io/projected/06c43bdd-ba3d-4400-bcef-38aa8900fab9-kube-api-access-kzt2f\") pod \"06c43bdd-ba3d-4400-bcef-38aa8900fab9\" (UID: \"06c43bdd-ba3d-4400-bcef-38aa8900fab9\") "
Oct 30 20:04:55.578437 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:04:55.577535    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/06c43bdd-ba3d-4400-bcef-38aa8900fab9-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/06c43bdd-ba3d-4400-bcef-38aa8900fab9-maas-api-xks-ca\") pod \"06c43bdd-ba3d-4400-bcef-38aa8900fab9\" (UID: \"06c43bdd-ba3d-4400-bcef-38aa8900fab9\") "
Oct 30 20:04:55.578796 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:04:55.578703    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/06c43bdd-ba3d-4400-bcef-38aa8900fab9-maas-api-openshift-ca" pod "06c43bdd-ba3d-4400-bcef-38aa8900fab9" (UID: "06c43bdd-ba3d-4400-bcef-38aa8900fab9"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:04:55.581168 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:04:55.581140    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/06c43bdd-ba3d-4400-bcef-38aa8900fab9-maas-api-xks-ca" pod "06c43bdd-ba3d-4400-bcef-38aa8900fab9" (UID: "06c43bdd-ba3d-4400-bcef-38aa8900fab9"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 20:04:55.583033 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:04:55.583009    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/06c43bdd-ba3d-4400-bcef-38aa8900fab9-kube-api-access-kzt2f" pod "06c43bdd-ba3d-4400-bcef-38aa8900fab9" (UID: "06c43bdd-ba3d-4400-bcef-38aa8900fab9"). InnerVolumeSpecName "kube-api-access-kzt2f". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:04:55.614708 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:04:55.614659    6275 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w3-912f24-openshift-default-5f56ff5f6c-r7hx2"]
Oct 30 20:04:55.615536 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:04:55.615515    6275 cpu_manager.go:414] "containerMap: removing container" podUID="06c43bdd-ba3d-4400-bcef-38aa8900fab9" containerName="revoke-keys"
Oct 30 20:04:55.615536 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:04:55.615535    6275 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="06c43bdd-ba3d-4400-bcef-38aa8900fab9" containerName="revoke-keys"
Oct 30 20:04:55.615681 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:04:55.615667    6275 memory_manager.go:365] "RemoveStaleState removing state" podUID="06c43bdd-ba3d-4400-bcef-38aa8900fab9" containerName="revoke-keys"
Oct 30 20:04:55.619327 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:04:55.619305    6275 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-912f24-openshift-default-5f56ff5f6c-r7hx2"
Oct 30 20:04:55.673456 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:04:55.673365    6275 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w3-912f24-openshift-default-5f56ff5f6c-r7hx2"]
Oct 30 20:04:55.678956 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:04:55.678921    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/88b5def9-2eb1-476e-a3ba-8f5b5ac6c32f-credential-socket\") pod \"e2e-worker-w3-912f24-openshift-default-5f56ff5f6c-r7hx2\" (UID: \"88b5def9-2eb1-476e-a3ba-8f5b5ac6c32f\") " pod="openshift-ingress/e2e-worker-w3-912f24-openshift-default-5f56ff5f6c-r7hx2"
Oct 30 20:04:55.679081 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:04:55.678981    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/88b5def9-2eb1-476e-a3ba-8f5b5ac6c32f-workload-socket\") pod \"e2e-worker-w3-912f24-openshift-default-5f56ff5f6c-r7hx2\" (UID: \"88b5def9-2eb1-476e-a3ba-8f5b5ac6c32f\") " pod="openshift-ingress/e2e-worker-w3-912f24-openshift-default-5f56ff5f6c-r7hx2"
Oct 30 20:04:55.679123 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:04:55.679072    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/88b5def9-2eb1-476e-a3ba-8f5b5ac6c32f-istiod-ca-cert\") pod \"e2e-worker-w3-912f24-openshift-default-5f56ff5f6c-r7hx2\" (UID: \"88b5def9-2eb1-476e-a3ba-8f5b5ac6c32f\") " pod="openshift-ingress/e2e-worker-w3-912f24-openshift-default-5f56ff5f6c-r7hx2"
Oct 30 20:04:55.679186 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:04:55.679167    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/88b5def9-2eb1-476e-a3ba-8f5b5ac6c32f-istio-envoy\") pod \"e2e-worker-w3-912f24-openshift-default-5f56ff5f6c-r7hx2\" (UID: \"88b5def9-2eb1-476e-a3ba-8f5b5ac6c32f\") " pod="openshift-ingress/e2e-worker-w3-912f24-openshift-default-5f56ff5f6c-r7hx2"
Oct 30 20:04:55.679273 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:04:55.679254    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/88b5def9-2eb1-476e-a3ba-8f5b5ac6c32f-istio-data\") pod \"e2e-worker-w3-912f24-openshift-default-5f56ff5f6c-r7hx2\" (UID: \"88b5def9-2eb1-476e-a3ba-8f5b5ac6c32f\") " pod="openshift-ingress/e2e-worker-w3-912f24-openshift-default-5f56ff5f6c-r7hx2"
Oct 30 20:04:55.679331 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:04:55.679316    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/88b5def9-2eb1-476e-a3ba-8f5b5ac6c32f-istio-token\") pod \"e2e-worker-w3-912f24-openshift-default-5f56ff5f6c-r7hx2\" (UID: \"88b5def9-2eb1-476e-a3ba-8f5b5ac6c32f\") " pod="openshift-ingress/e2e-worker-w3-912f24-openshift-default-5f56ff5f6c-r7hx2"
Oct 30 20:04:55.679437 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:04:55.679404    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/88b5def9-2eb1-476e-a3ba-8f5b5ac6c32f-istio-podinfo\") pod \"e2e-worker-w3-912f24-openshift-default-5f56ff5f6c-r7hx2\" (UID: \"88b5def9-2eb1-476e-a3ba-8f5b5ac6c32f\") " pod="openshift-ingress/e2e-worker-w3-912f24-openshift-default-5f56ff5f6c-r7hx2"
Oct 30 20:04:55.679525 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:04:55.679499    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bjbpm\" (UniqueName: \"kubernetes.io/projected/88b5def9-2eb1-476e-a3ba-8f5b5ac6c32f-kube-api-access-bjbpm\") pod \"e2e-worker-w3-912f24-openshift-default-5f56ff5f6c-r7hx2\" (UID: \"88b5def9-2eb1-476e-a3ba-8f5b5ac6c32f\") " pod="openshift-ingress/e2e-worker-w3-912f24-openshift-default-5f56ff5f6c-r7hx2"
Oct 30 20:04:55.679700 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:04:55.679682    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/88b5def9-2eb1-476e-a3ba-8f5b5ac6c32f-workload-certs\") pod \"e2e-worker-w3-912f24-openshift-default-5f56ff5f6c-r7hx2\" (UID: \"88b5def9-2eb1-476e-a3ba-8f5b5ac6c32f\") " pod="openshift-ingress/e2e-worker-w3-912f24-openshift-default-5f56ff5f6c-r7hx2"
Oct 30 20:04:55.679801 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:04:55.679786    6275 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/06c43bdd-ba3d-4400-bcef-38aa8900fab9-maas-api-openshift-ca\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:04:55.679853 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:04:55.679808    6275 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kzt2f\" (UniqueName: \"kubernetes.io/projected/06c43bdd-ba3d-4400-bcef-38aa8900fab9-kube-api-access-kzt2f\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:04:55.679853 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:04:55.679825    6275 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/06c43bdd-ba3d-4400-bcef-38aa8900fab9-maas-api-xks-ca\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:04:55.780595 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:04:55.780560    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/88b5def9-2eb1-476e-a3ba-8f5b5ac6c32f-istio-data\") pod \"e2e-worker-w3-912f24-openshift-default-5f56ff5f6c-r7hx2\" (UID: \"88b5def9-2eb1-476e-a3ba-8f5b5ac6c32f\") " pod="openshift-ingress/e2e-worker-w3-912f24-openshift-default-5f56ff5f6c-r7hx2"
Oct 30 20:04:55.780790 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:04:55.780609    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/88b5def9-2eb1-476e-a3ba-8f5b5ac6c32f-istio-token\") pod \"e2e-worker-w3-912f24-openshift-default-5f56ff5f6c-r7hx2\" (UID: \"88b5def9-2eb1-476e-a3ba-8f5b5ac6c32f\") " pod="openshift-ingress/e2e-worker-w3-912f24-openshift-default-5f56ff5f6c-r7hx2"
Oct 30 20:04:55.780790 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:04:55.780646    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/88b5def9-2eb1-476e-a3ba-8f5b5ac6c32f-istio-podinfo\") pod \"e2e-worker-w3-912f24-openshift-default-5f56ff5f6c-r7hx2\" (UID: \"88b5def9-2eb1-476e-a3ba-8f5b5ac6c32f\") " pod="openshift-ingress/e2e-worker-w3-912f24-openshift-default-5f56ff5f6c-r7hx2"
Oct 30 20:04:55.780790 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:04:55.780675    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bjbpm\" (UniqueName: \"kubernetes.io/projected/88b5def9-2eb1-476e-a3ba-8f5b5ac6c32f-kube-api-access-bjbpm\") pod \"e2e-worker-w3-912f24-openshift-default-5f56ff5f6c-r7hx2\" (UID: \"88b5def9-2eb1-476e-a3ba-8f5b5ac6c32f\") " pod="openshift-ingress/e2e-worker-w3-912f24-openshift-default-5f56ff5f6c-r7hx2"
Oct 30 20:04:55.780970 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:04:55.780799    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/88b5def9-2eb1-476e-a3ba-8f5b5ac6c32f-workload-certs\") pod \"e2e-worker-w3-912f24-openshift-default-5f56ff5f6c-r7hx2\" (UID: \"88b5def9-2eb1-476e-a3ba-8f5b5ac6c32f\") " pod="openshift-ingress/e2e-worker-w3-912f24-openshift-default-5f56ff5f6c-r7hx2"
Oct 30 20:04:55.780970 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:04:55.780847    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/88b5def9-2eb1-476e-a3ba-8f5b5ac6c32f-credential-socket\") pod \"e2e-worker-w3-912f24-openshift-default-5f56ff5f6c-r7hx2\" (UID: \"88b5def9-2eb1-476e-a3ba-8f5b5ac6c32f\") " pod="openshift-ingress/e2e-worker-w3-912f24-openshift-default-5f56ff5f6c-r7hx2"
Oct 30 20:04:55.780970 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:04:55.780881    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/88b5def9-2eb1-476e-a3ba-8f5b5ac6c32f-workload-socket\") pod \"e2e-worker-w3-912f24-openshift-default-5f56ff5f6c-r7hx2\" (UID: \"88b5def9-2eb1-476e-a3ba-8f5b5ac6c32f\") " pod="openshift-ingress/e2e-worker-w3-912f24-openshift-default-5f56ff5f6c-r7hx2"
Oct 30 20:04:55.780970 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:04:55.780935    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/88b5def9-2eb1-476e-a3ba-8f5b5ac6c32f-istiod-ca-cert\") pod \"e2e-worker-w3-912f24-openshift-default-5f56ff5f6c-r7hx2\" (UID: \"88b5def9-2eb1-476e-a3ba-8f5b5ac6c32f\") " pod="openshift-ingress/e2e-worker-w3-912f24-openshift-default-5f56ff5f6c-r7hx2"
Oct 30 20:04:55.781169 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:04:55.780965    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/88b5def9-2eb1-476e-a3ba-8f5b5ac6c32f-istio-data\") pod \"e2e-worker-w3-912f24-openshift-default-5f56ff5f6c-r7hx2\" (UID: \"88b5def9-2eb1-476e-a3ba-8f5b5ac6c32f\") " pod="openshift-ingress/e2e-worker-w3-912f24-openshift-default-5f56ff5f6c-r7hx2"
Oct 30 20:04:55.781169 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:04:55.780992    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/88b5def9-2eb1-476e-a3ba-8f5b5ac6c32f-istio-envoy\") pod \"e2e-worker-w3-912f24-openshift-default-5f56ff5f6c-r7hx2\" (UID: \"88b5def9-2eb1-476e-a3ba-8f5b5ac6c32f\") " pod="openshift-ingress/e2e-worker-w3-912f24-openshift-default-5f56ff5f6c-r7hx2"
Oct 30 20:04:55.781169 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:04:55.781138    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/88b5def9-2eb1-476e-a3ba-8f5b5ac6c32f-workload-certs\") pod \"e2e-worker-w3-912f24-openshift-default-5f56ff5f6c-r7hx2\" (UID: \"88b5def9-2eb1-476e-a3ba-8f5b5ac6c32f\") " pod="openshift-ingress/e2e-worker-w3-912f24-openshift-default-5f56ff5f6c-r7hx2"
Oct 30 20:04:55.781298 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:04:55.781202    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/88b5def9-2eb1-476e-a3ba-8f5b5ac6c32f-credential-socket\") pod \"e2e-worker-w3-912f24-openshift-default-5f56ff5f6c-r7hx2\" (UID: \"88b5def9-2eb1-476e-a3ba-8f5b5ac6c32f\") " pod="openshift-ingress/e2e-worker-w3-912f24-openshift-default-5f56ff5f6c-r7hx2"
Oct 30 20:04:55.781298 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:04:55.781244    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/88b5def9-2eb1-476e-a3ba-8f5b5ac6c32f-workload-socket\") pod \"e2e-worker-w3-912f24-openshift-default-5f56ff5f6c-r7hx2\" (UID: \"88b5def9-2eb1-476e-a3ba-8f5b5ac6c32f\") " pod="openshift-ingress/e2e-worker-w3-912f24-openshift-default-5f56ff5f6c-r7hx2"
Oct 30 20:04:55.781597 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:04:55.781574    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/88b5def9-2eb1-476e-a3ba-8f5b5ac6c32f-istiod-ca-cert\") pod \"e2e-worker-w3-912f24-openshift-default-5f56ff5f6c-r7hx2\" (UID: \"88b5def9-2eb1-476e-a3ba-8f5b5ac6c32f\") " pod="openshift-ingress/e2e-worker-w3-912f24-openshift-default-5f56ff5f6c-r7hx2"
Oct 30 20:04:55.783195 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:04:55.783174    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/88b5def9-2eb1-476e-a3ba-8f5b5ac6c32f-istio-envoy\") pod \"e2e-worker-w3-912f24-openshift-default-5f56ff5f6c-r7hx2\" (UID: \"88b5def9-2eb1-476e-a3ba-8f5b5ac6c32f\") " pod="openshift-ingress/e2e-worker-w3-912f24-openshift-default-5f56ff5f6c-r7hx2"
Oct 30 20:04:55.783309 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:04:55.783273    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/88b5def9-2eb1-476e-a3ba-8f5b5ac6c32f-istio-podinfo\") pod \"e2e-worker-w3-912f24-openshift-default-5f56ff5f6c-r7hx2\" (UID: \"88b5def9-2eb1-476e-a3ba-8f5b5ac6c32f\") " pod="openshift-ingress/e2e-worker-w3-912f24-openshift-default-5f56ff5f6c-r7hx2"
Oct 30 20:04:55.806783 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:04:55.806752    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/88b5def9-2eb1-476e-a3ba-8f5b5ac6c32f-istio-token\") pod \"e2e-worker-w3-912f24-openshift-default-5f56ff5f6c-r7hx2\" (UID: \"88b5def9-2eb1-476e-a3ba-8f5b5ac6c32f\") " pod="openshift-ingress/e2e-worker-w3-912f24-openshift-default-5f56ff5f6c-r7hx2"
Oct 30 20:04:55.807168 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:04:55.807150    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bjbpm\" (UniqueName: \"kubernetes.io/projected/88b5def9-2eb1-476e-a3ba-8f5b5ac6c32f-kube-api-access-bjbpm\") pod \"e2e-worker-w3-912f24-openshift-default-5f56ff5f6c-r7hx2\" (UID: \"88b5def9-2eb1-476e-a3ba-8f5b5ac6c32f\") " pod="openshift-ingress/e2e-worker-w3-912f24-openshift-default-5f56ff5f6c-r7hx2"
Oct 30 20:04:55.966492 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:04:55.966378    6275 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-912f24-openshift-default-5f56ff5f6c-r7hx2"
Oct 30 20:04:56.257128 ip-10-0-131-26 kubenswrapper[6275]: E1030 20:04:56.257091    6275 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-fwc77" containerName="extractor"
Oct 30 20:04:56.292798 ip-10-0-131-26 kubenswrapper[6275]: W1030 20:04:56.292762    6275 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod88b5def9_2eb1_476e_a3ba_8f5b5ac6c32f.slice/crio-d6e3f1165f3f76315172f1baf997db4b3c24b57514a42990ce55ac395ddfbcdd WatchSource:0}: Error finding container d6e3f1165f3f76315172f1baf997db4b3c24b57514a42990ce55ac395ddfbcdd: Status 404 returned error can't find the container with id d6e3f1165f3f76315172f1baf997db4b3c24b57514a42990ce55ac395ddfbcdd
Oct 30 20:04:56.292937 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:04:56.292917    6275 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w3-912f24-openshift-default-5f56ff5f6c-r7hx2"]
Oct 30 20:04:56.295108 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:04:56.295070    6275 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Oct 30 20:04:56.295212 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:04:56.295147    6275 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Oct 30 20:04:56.295212 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:04:56.295190    6275 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Oct 30 20:04:56.396388 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:04:56.395765    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-912f24-openshift-default-5f56ff5f6c-r7hx2" event={"ID":"88b5def9-2eb1-476e-a3ba-8f5b5ac6c32f","Type":"ContainerStarted","Data":"5c918d4a452b1a9f10e29341541dbb47115deed9914cd1bad4bea9e631a25646"}
Oct 30 20:04:56.396388 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:04:56.395830    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-912f24-openshift-default-5f56ff5f6c-r7hx2" event={"ID":"88b5def9-2eb1-476e-a3ba-8f5b5ac6c32f","Type":"ContainerStarted","Data":"d6e3f1165f3f76315172f1baf997db4b3c24b57514a42990ce55ac395ddfbcdd"}
Oct 30 20:04:56.397405 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:04:56.397371    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-9c0ed893-272hm" event={"ID":"06c43bdd-ba3d-4400-bcef-38aa8900fab9","Type":"ContainerDied","Data":"4e384ef881132f419343c20f1f72d6dcce014ce287e524e0d3578d7e687444c8"}
Oct 30 20:04:56.397537 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:04:56.397436    6275 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4e384ef881132f419343c20f1f72d6dcce014ce287e524e0d3578d7e687444c8"
Oct 30 20:04:56.397537 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:04:56.397496    6275 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-9c0ed893-272hm"
Oct 30 20:04:56.445905 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:04:56.445848    6275 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w3-912f24-openshift-default-5f56ff5f6c-r7hx2" podStartSLOduration=1.44582926 podStartE2EDuration="1.44582926s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:04:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:04:56.444194658 +0000 UTC m=+1006.905921522" watchObservedRunningTime="2026-10-30 20:04:56.44582926 +0000 UTC m=+1006.907556124"
Oct 30 20:04:56.966978 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:04:56.966946    6275 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w3-912f24-openshift-default-5f56ff5f6c-r7hx2"
Oct 30 20:04:57.981467 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:04:57.976562    6275 patch_prober.go:29] interesting pod/e2e-worker-w3-912f24-openshift-default-5f56ff5f6c-r7hx2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.81:15021/healthz/ready\": dial tcp 10.134.0.81:15021: connect: connection refused" start-of-body=
Oct 30 20:04:57.981467 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:04:57.976655    6275 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-912f24-openshift-default-5f56ff5f6c-r7hx2" podUID="88b5def9-2eb1-476e-a3ba-8f5b5ac6c32f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.81:15021/healthz/ready\": dial tcp 10.134.0.81:15021: connect: connection refused"
Oct 30 20:04:58.967535 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:04:58.967499    6275 patch_prober.go:29] interesting pod/e2e-worker-w3-912f24-openshift-default-5f56ff5f6c-r7hx2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.81:15021/healthz/ready\": dial tcp 10.134.0.81:15021: connect: connection refused" start-of-body=
Oct 30 20:04:58.967828 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:04:58.967799    6275 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-912f24-openshift-default-5f56ff5f6c-r7hx2" podUID="88b5def9-2eb1-476e-a3ba-8f5b5ac6c32f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.81:15021/healthz/ready\": dial tcp 10.134.0.81:15021: connect: connection refused"
Oct 30 20:04:59.967444 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:04:59.967384    6275 patch_prober.go:29] interesting pod/e2e-worker-w3-912f24-openshift-default-5f56ff5f6c-r7hx2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.81:15021/healthz/ready\": dial tcp 10.134.0.81:15021: connect: connection refused" start-of-body=
Oct 30 20:04:59.967988 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:04:59.967483    6275 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-912f24-openshift-default-5f56ff5f6c-r7hx2" podUID="88b5def9-2eb1-476e-a3ba-8f5b5ac6c32f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.81:15021/healthz/ready\": dial tcp 10.134.0.81:15021: connect: connection refused"
Oct 30 20:05:00.972438 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:00.971518    6275 patch_prober.go:29] interesting pod/e2e-worker-w3-912f24-openshift-default-5f56ff5f6c-r7hx2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.81:15021/healthz/ready\": dial tcp 10.134.0.81:15021: connect: connection refused" start-of-body=
Oct 30 20:05:00.972438 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:00.971586    6275 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-912f24-openshift-default-5f56ff5f6c-r7hx2" podUID="88b5def9-2eb1-476e-a3ba-8f5b5ac6c32f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.81:15021/healthz/ready\": dial tcp 10.134.0.81:15021: connect: connection refused"
Oct 30 20:05:01.967277 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:01.967240    6275 patch_prober.go:29] interesting pod/e2e-worker-w3-912f24-openshift-default-5f56ff5f6c-r7hx2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.81:15021/healthz/ready\": dial tcp 10.134.0.81:15021: connect: connection refused" start-of-body=
Oct 30 20:05:01.967451 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:01.967298    6275 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-912f24-openshift-default-5f56ff5f6c-r7hx2" podUID="88b5def9-2eb1-476e-a3ba-8f5b5ac6c32f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.81:15021/healthz/ready\": dial tcp 10.134.0.81:15021: connect: connection refused"
Oct 30 20:05:02.392461 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:02.392425    6275 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-ef633838-985mx"]
Oct 30 20:05:02.397850 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:02.397832    6275 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-ef633838-985mx"
Oct 30 20:05:02.417307 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:02.417281    6275 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-ef633838-985mx"]
Oct 30 20:05:02.426066 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:02.426021    6275 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\""
Oct 30 20:05:02.426200 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:02.426103    6275 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-scs2w\""
Oct 30 20:05:02.496691 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:02.496658    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/3512c823-6e15-4af0-a335-94ea4301f98d-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-ef633838-985mx\" (UID: \"3512c823-6e15-4af0-a335-94ea4301f98d\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-ef633838-985mx"
Oct 30 20:05:02.496844 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:02.496720    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/3512c823-6e15-4af0-a335-94ea4301f98d-maas-api-xks-ca\") pod \"maas-api-revoke-sub-ef633838-985mx\" (UID: \"3512c823-6e15-4af0-a335-94ea4301f98d\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-ef633838-985mx"
Oct 30 20:05:02.496844 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:02.496833    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cw9dh\" (UniqueName: \"kubernetes.io/projected/3512c823-6e15-4af0-a335-94ea4301f98d-kube-api-access-cw9dh\") pod \"maas-api-revoke-sub-ef633838-985mx\" (UID: \"3512c823-6e15-4af0-a335-94ea4301f98d\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-ef633838-985mx"
Oct 30 20:05:02.598022 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:02.597986    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/3512c823-6e15-4af0-a335-94ea4301f98d-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-ef633838-985mx\" (UID: \"3512c823-6e15-4af0-a335-94ea4301f98d\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-ef633838-985mx"
Oct 30 20:05:02.598189 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:02.598041    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/3512c823-6e15-4af0-a335-94ea4301f98d-maas-api-xks-ca\") pod \"maas-api-revoke-sub-ef633838-985mx\" (UID: \"3512c823-6e15-4af0-a335-94ea4301f98d\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-ef633838-985mx"
Oct 30 20:05:02.598189 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:02.598110    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cw9dh\" (UniqueName: \"kubernetes.io/projected/3512c823-6e15-4af0-a335-94ea4301f98d-kube-api-access-cw9dh\") pod \"maas-api-revoke-sub-ef633838-985mx\" (UID: \"3512c823-6e15-4af0-a335-94ea4301f98d\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-ef633838-985mx"
Oct 30 20:05:02.598683 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:02.598659    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/3512c823-6e15-4af0-a335-94ea4301f98d-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-ef633838-985mx\" (UID: \"3512c823-6e15-4af0-a335-94ea4301f98d\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-ef633838-985mx"
Oct 30 20:05:02.600883 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:02.600863    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/3512c823-6e15-4af0-a335-94ea4301f98d-maas-api-xks-ca\") pod \"maas-api-revoke-sub-ef633838-985mx\" (UID: \"3512c823-6e15-4af0-a335-94ea4301f98d\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-ef633838-985mx"
Oct 30 20:05:02.624409 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:02.624383    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cw9dh\" (UniqueName: \"kubernetes.io/projected/3512c823-6e15-4af0-a335-94ea4301f98d-kube-api-access-cw9dh\") pod \"maas-api-revoke-sub-ef633838-985mx\" (UID: \"3512c823-6e15-4af0-a335-94ea4301f98d\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-ef633838-985mx"
Oct 30 20:05:02.712631 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:02.712558    6275 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-ef633838-985mx"
Oct 30 20:05:02.967241 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:02.967147    6275 patch_prober.go:29] interesting pod/e2e-worker-w3-912f24-openshift-default-5f56ff5f6c-r7hx2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.81:15021/healthz/ready\": dial tcp 10.134.0.81:15021: connect: connection refused" start-of-body=
Oct 30 20:05:02.967241 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:02.967201    6275 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-912f24-openshift-default-5f56ff5f6c-r7hx2" podUID="88b5def9-2eb1-476e-a3ba-8f5b5ac6c32f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.81:15021/healthz/ready\": dial tcp 10.134.0.81:15021: connect: connection refused"
Oct 30 20:05:03.021335 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:03.021311    6275 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-ef633838-985mx"]
Oct 30 20:05:03.023867 ip-10-0-131-26 kubenswrapper[6275]: W1030 20:05:03.023837    6275 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3512c823_6e15_4af0_a335_94ea4301f98d.slice/crio-ffcfeaae09d99dee14a51478413371c271e9425c0b0d4c57e10f8a63d140a52e WatchSource:0}: Error finding container ffcfeaae09d99dee14a51478413371c271e9425c0b0d4c57e10f8a63d140a52e: Status 404 returned error can't find the container with id ffcfeaae09d99dee14a51478413371c271e9425c0b0d4c57e10f8a63d140a52e
Oct 30 20:05:03.503233 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:03.503185    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-ef633838-985mx" event={"ID":"3512c823-6e15-4af0-a335-94ea4301f98d","Type":"ContainerStarted","Data":"5aff5e524b4212f56c176044fa6ac07478337806110f0d239ae2da3acca592e2"}
Oct 30 20:05:03.503807 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:03.503296    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-ef633838-985mx" event={"ID":"3512c823-6e15-4af0-a335-94ea4301f98d","Type":"ContainerStarted","Data":"ffcfeaae09d99dee14a51478413371c271e9425c0b0d4c57e10f8a63d140a52e"}
Oct 30 20:05:03.556000 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:03.555884    6275 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-sub-ef633838-985mx" podStartSLOduration=1.555869076 podStartE2EDuration="1.555869076s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:05:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:05:03.551090494 +0000 UTC m=+1014.012817361" watchObservedRunningTime="2026-10-30 20:05:03.555869076 +0000 UTC m=+1014.017595938"
Oct 30 20:05:03.971315 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:03.971239    6275 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w3-912f24-openshift-default-5f56ff5f6c-r7hx2"
Oct 30 20:05:03.971727 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:03.971710    6275 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w3-912f24-openshift-default-5f56ff5f6c-r7hx2"
Oct 30 20:05:03.972406 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:03.972387    6275 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w3-912f24-openshift-default-5f56ff5f6c-r7hx2"
Oct 30 20:05:04.518675 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:04.518636    6275 generic.go:356] "Generic (PLEG): container finished" podID="3512c823-6e15-4af0-a335-94ea4301f98d" containerID="5aff5e524b4212f56c176044fa6ac07478337806110f0d239ae2da3acca592e2" exitCode=0
Oct 30 20:05:04.519076 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:04.518714    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-ef633838-985mx" event={"ID":"3512c823-6e15-4af0-a335-94ea4301f98d","Type":"ContainerDied","Data":"5aff5e524b4212f56c176044fa6ac07478337806110f0d239ae2da3acca592e2"}
Oct 30 20:05:05.677677 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:05.677648    6275 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-ef633838-985mx"
Oct 30 20:05:05.840034 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:05.839926    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/3512c823-6e15-4af0-a335-94ea4301f98d-kube-api-access-cw9dh\" (UniqueName: \"kubernetes.io/projected/3512c823-6e15-4af0-a335-94ea4301f98d-kube-api-access-cw9dh\") pod \"3512c823-6e15-4af0-a335-94ea4301f98d\" (UID: \"3512c823-6e15-4af0-a335-94ea4301f98d\") "
Oct 30 20:05:05.840034 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:05.839997    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/3512c823-6e15-4af0-a335-94ea4301f98d-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/3512c823-6e15-4af0-a335-94ea4301f98d-maas-api-openshift-ca\") pod \"3512c823-6e15-4af0-a335-94ea4301f98d\" (UID: \"3512c823-6e15-4af0-a335-94ea4301f98d\") "
Oct 30 20:05:05.840240 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:05.840071    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/3512c823-6e15-4af0-a335-94ea4301f98d-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/3512c823-6e15-4af0-a335-94ea4301f98d-maas-api-xks-ca\") pod \"3512c823-6e15-4af0-a335-94ea4301f98d\" (UID: \"3512c823-6e15-4af0-a335-94ea4301f98d\") "
Oct 30 20:05:05.840386 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:05.840359    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3512c823-6e15-4af0-a335-94ea4301f98d-maas-api-openshift-ca" pod "3512c823-6e15-4af0-a335-94ea4301f98d" (UID: "3512c823-6e15-4af0-a335-94ea4301f98d"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:05:05.840600 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:05.840584    6275 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/3512c823-6e15-4af0-a335-94ea4301f98d-maas-api-openshift-ca\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:05:05.842171 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:05.842144    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3512c823-6e15-4af0-a335-94ea4301f98d-maas-api-xks-ca" pod "3512c823-6e15-4af0-a335-94ea4301f98d" (UID: "3512c823-6e15-4af0-a335-94ea4301f98d"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 20:05:05.842255 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:05.842204    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3512c823-6e15-4af0-a335-94ea4301f98d-kube-api-access-cw9dh" pod "3512c823-6e15-4af0-a335-94ea4301f98d" (UID: "3512c823-6e15-4af0-a335-94ea4301f98d"). InnerVolumeSpecName "kube-api-access-cw9dh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:05:05.942275 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:05.942236    6275 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cw9dh\" (UniqueName: \"kubernetes.io/projected/3512c823-6e15-4af0-a335-94ea4301f98d-kube-api-access-cw9dh\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:05:05.942275 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:05.942267    6275 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/3512c823-6e15-4af0-a335-94ea4301f98d-maas-api-xks-ca\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:05:06.534370 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:06.534341    6275 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-ef633838-985mx"
Oct 30 20:05:06.534589 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:06.534382    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-ef633838-985mx" event={"ID":"3512c823-6e15-4af0-a335-94ea4301f98d","Type":"ContainerDied","Data":"ffcfeaae09d99dee14a51478413371c271e9425c0b0d4c57e10f8a63d140a52e"}
Oct 30 20:05:06.534589 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:06.534457    6275 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ffcfeaae09d99dee14a51478413371c271e9425c0b0d4c57e10f8a63d140a52e"
Oct 30 20:05:09.454440 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:09.453039    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-912f24/simulator-w3-912f24-kserve-59897cf48b-sd5wj" podUID="b4de6427-0db0-42d9-8b88-6b35d9d4c314" containerName="main" probeResult="failure" output="Get \"https://10.134.0.54:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:05:09.610477 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:09.602852    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-51dd62/simulator-w6-51dd62-kserve-d6bb4985f-65j9h" podUID="f7e1ff07-15d6-49b5-8edc-52c9d6825ed7" containerName="main" probeResult="failure" output="Get \"https://10.134.0.56:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:05:09.652437 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:09.644550    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-626870/premium-w5-626870-kserve-5df7f7b5c4-vx59r" podUID="a1adddd4-3218-4a6b-a145-0290bceff76f" containerName="main" probeResult="failure" output="Get \"https://10.134.0.57:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:05:09.709504 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:09.685734    6275 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w4-f1f016/simulator-w4-f1f016-kserve-55db8447ff-749tw" podUID="8f3174b6-2fdc-48c2-99be-7a966731f018" containerName="main" probeResult="failure" output="Get \"https://10.134.0.55:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:05:09.710272 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:09.694819    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-efbac3/premium-w2-efbac3-kserve-55f54cfff6-9fqbz" podUID="083136dc-91fb-454f-a782-87b004e73d1b" containerName="main" probeResult="failure" output="Get \"https://10.134.0.59:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:05:09.836708 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:09.832353    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-5f10d2/premium-w1-5f10d2-kserve-644b846669-286m2" podUID="a2ff6903-c1ab-48dd-884b-d119b8ee1ed6" containerName="main" probeResult="failure" output="Get \"https://10.134.0.61:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:05:09.863557 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:09.863515    6275 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w6-51dd62/simulator-w6-51dd62-kserve-d6bb4985f-65j9h" podUID="f7e1ff07-15d6-49b5-8edc-52c9d6825ed7" containerName="main" probeResult="failure" output="Get \"https://10.134.0.56:8000/health\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:05:10.057440 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:10.055818    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-912f24/distinct-2-w3-912f24-kserve-566865fdcc-ptx4l" podUID="fcea214a-04a7-4bdd-9695-852f657edfe5" containerName="main" probeResult="failure" output="Get \"https://10.134.0.74:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:05:10.103899 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:10.103699    6275 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w5-626870-openshift-default-7cd649d59c-74vj7"]
Oct 30 20:05:10.105625 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:10.105598    6275 cpu_manager.go:414] "containerMap: removing container" podUID="3512c823-6e15-4af0-a335-94ea4301f98d" containerName="revoke-keys"
Oct 30 20:05:10.105923 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:10.105904    6275 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="3512c823-6e15-4af0-a335-94ea4301f98d" containerName="revoke-keys"
Oct 30 20:05:10.106568 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:10.106550    6275 memory_manager.go:365] "RemoveStaleState removing state" podUID="3512c823-6e15-4af0-a335-94ea4301f98d" containerName="revoke-keys"
Oct 30 20:05:10.114076 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:10.114057    6275 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-626870-openshift-default-7cd649d59c-74vj7"
Oct 30 20:05:10.116739 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:10.116627    6275 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w5-626870-openshift-default-7cd649d59c-74vj7"]
Oct 30 20:05:10.259371 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:10.259324    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f35ca7ba-e2b8-4e65-bc7b-0051dea979e8-istio-podinfo\") pod \"e2e-worker-w5-626870-openshift-default-7cd649d59c-74vj7\" (UID: \"f35ca7ba-e2b8-4e65-bc7b-0051dea979e8\") " pod="openshift-ingress/e2e-worker-w5-626870-openshift-default-7cd649d59c-74vj7"
Oct 30 20:05:10.259781 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:10.259745    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f35ca7ba-e2b8-4e65-bc7b-0051dea979e8-istio-data\") pod \"e2e-worker-w5-626870-openshift-default-7cd649d59c-74vj7\" (UID: \"f35ca7ba-e2b8-4e65-bc7b-0051dea979e8\") " pod="openshift-ingress/e2e-worker-w5-626870-openshift-default-7cd649d59c-74vj7"
Oct 30 20:05:10.260025 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:10.260006    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f35ca7ba-e2b8-4e65-bc7b-0051dea979e8-workload-socket\") pod \"e2e-worker-w5-626870-openshift-default-7cd649d59c-74vj7\" (UID: \"f35ca7ba-e2b8-4e65-bc7b-0051dea979e8\") " pod="openshift-ingress/e2e-worker-w5-626870-openshift-default-7cd649d59c-74vj7"
Oct 30 20:05:10.260196 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:10.260177    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f35ca7ba-e2b8-4e65-bc7b-0051dea979e8-istiod-ca-cert\") pod \"e2e-worker-w5-626870-openshift-default-7cd649d59c-74vj7\" (UID: \"f35ca7ba-e2b8-4e65-bc7b-0051dea979e8\") " pod="openshift-ingress/e2e-worker-w5-626870-openshift-default-7cd649d59c-74vj7"
Oct 30 20:05:10.260405 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:10.260388    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-825jx\" (UniqueName: \"kubernetes.io/projected/f35ca7ba-e2b8-4e65-bc7b-0051dea979e8-kube-api-access-825jx\") pod \"e2e-worker-w5-626870-openshift-default-7cd649d59c-74vj7\" (UID: \"f35ca7ba-e2b8-4e65-bc7b-0051dea979e8\") " pod="openshift-ingress/e2e-worker-w5-626870-openshift-default-7cd649d59c-74vj7"
Oct 30 20:05:10.260641 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:10.260625    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f35ca7ba-e2b8-4e65-bc7b-0051dea979e8-istio-token\") pod \"e2e-worker-w5-626870-openshift-default-7cd649d59c-74vj7\" (UID: \"f35ca7ba-e2b8-4e65-bc7b-0051dea979e8\") " pod="openshift-ingress/e2e-worker-w5-626870-openshift-default-7cd649d59c-74vj7"
Oct 30 20:05:10.260785 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:10.260770    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f35ca7ba-e2b8-4e65-bc7b-0051dea979e8-credential-socket\") pod \"e2e-worker-w5-626870-openshift-default-7cd649d59c-74vj7\" (UID: \"f35ca7ba-e2b8-4e65-bc7b-0051dea979e8\") " pod="openshift-ingress/e2e-worker-w5-626870-openshift-default-7cd649d59c-74vj7"
Oct 30 20:05:10.260966 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:10.260937    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f35ca7ba-e2b8-4e65-bc7b-0051dea979e8-istio-envoy\") pod \"e2e-worker-w5-626870-openshift-default-7cd649d59c-74vj7\" (UID: \"f35ca7ba-e2b8-4e65-bc7b-0051dea979e8\") " pod="openshift-ingress/e2e-worker-w5-626870-openshift-default-7cd649d59c-74vj7"
Oct 30 20:05:10.261167 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:10.261149    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f35ca7ba-e2b8-4e65-bc7b-0051dea979e8-workload-certs\") pod \"e2e-worker-w5-626870-openshift-default-7cd649d59c-74vj7\" (UID: \"f35ca7ba-e2b8-4e65-bc7b-0051dea979e8\") " pod="openshift-ingress/e2e-worker-w5-626870-openshift-default-7cd649d59c-74vj7"
Oct 30 20:05:10.367009 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:10.366910    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f35ca7ba-e2b8-4e65-bc7b-0051dea979e8-istio-data\") pod \"e2e-worker-w5-626870-openshift-default-7cd649d59c-74vj7\" (UID: \"f35ca7ba-e2b8-4e65-bc7b-0051dea979e8\") " pod="openshift-ingress/e2e-worker-w5-626870-openshift-default-7cd649d59c-74vj7"
Oct 30 20:05:10.367180 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:10.367034    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f35ca7ba-e2b8-4e65-bc7b-0051dea979e8-workload-socket\") pod \"e2e-worker-w5-626870-openshift-default-7cd649d59c-74vj7\" (UID: \"f35ca7ba-e2b8-4e65-bc7b-0051dea979e8\") " pod="openshift-ingress/e2e-worker-w5-626870-openshift-default-7cd649d59c-74vj7"
Oct 30 20:05:10.367180 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:10.367069    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f35ca7ba-e2b8-4e65-bc7b-0051dea979e8-istiod-ca-cert\") pod \"e2e-worker-w5-626870-openshift-default-7cd649d59c-74vj7\" (UID: \"f35ca7ba-e2b8-4e65-bc7b-0051dea979e8\") " pod="openshift-ingress/e2e-worker-w5-626870-openshift-default-7cd649d59c-74vj7"
Oct 30 20:05:10.367180 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:10.367110    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-825jx\" (UniqueName: \"kubernetes.io/projected/f35ca7ba-e2b8-4e65-bc7b-0051dea979e8-kube-api-access-825jx\") pod \"e2e-worker-w5-626870-openshift-default-7cd649d59c-74vj7\" (UID: \"f35ca7ba-e2b8-4e65-bc7b-0051dea979e8\") " pod="openshift-ingress/e2e-worker-w5-626870-openshift-default-7cd649d59c-74vj7"
Oct 30 20:05:10.367353 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:10.367202    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f35ca7ba-e2b8-4e65-bc7b-0051dea979e8-istio-token\") pod \"e2e-worker-w5-626870-openshift-default-7cd649d59c-74vj7\" (UID: \"f35ca7ba-e2b8-4e65-bc7b-0051dea979e8\") " pod="openshift-ingress/e2e-worker-w5-626870-openshift-default-7cd649d59c-74vj7"
Oct 30 20:05:10.367353 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:10.367251    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f35ca7ba-e2b8-4e65-bc7b-0051dea979e8-credential-socket\") pod \"e2e-worker-w5-626870-openshift-default-7cd649d59c-74vj7\" (UID: \"f35ca7ba-e2b8-4e65-bc7b-0051dea979e8\") " pod="openshift-ingress/e2e-worker-w5-626870-openshift-default-7cd649d59c-74vj7"
Oct 30 20:05:10.367353 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:10.367312    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f35ca7ba-e2b8-4e65-bc7b-0051dea979e8-istio-envoy\") pod \"e2e-worker-w5-626870-openshift-default-7cd649d59c-74vj7\" (UID: \"f35ca7ba-e2b8-4e65-bc7b-0051dea979e8\") " pod="openshift-ingress/e2e-worker-w5-626870-openshift-default-7cd649d59c-74vj7"
Oct 30 20:05:10.368813 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:10.367395    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f35ca7ba-e2b8-4e65-bc7b-0051dea979e8-workload-certs\") pod \"e2e-worker-w5-626870-openshift-default-7cd649d59c-74vj7\" (UID: \"f35ca7ba-e2b8-4e65-bc7b-0051dea979e8\") " pod="openshift-ingress/e2e-worker-w5-626870-openshift-default-7cd649d59c-74vj7"
Oct 30 20:05:10.368813 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:10.367485    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f35ca7ba-e2b8-4e65-bc7b-0051dea979e8-istio-podinfo\") pod \"e2e-worker-w5-626870-openshift-default-7cd649d59c-74vj7\" (UID: \"f35ca7ba-e2b8-4e65-bc7b-0051dea979e8\") " pod="openshift-ingress/e2e-worker-w5-626870-openshift-default-7cd649d59c-74vj7"
Oct 30 20:05:10.368813 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:10.368656    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f35ca7ba-e2b8-4e65-bc7b-0051dea979e8-workload-socket\") pod \"e2e-worker-w5-626870-openshift-default-7cd649d59c-74vj7\" (UID: \"f35ca7ba-e2b8-4e65-bc7b-0051dea979e8\") " pod="openshift-ingress/e2e-worker-w5-626870-openshift-default-7cd649d59c-74vj7"
Oct 30 20:05:10.376149 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:10.369037    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f35ca7ba-e2b8-4e65-bc7b-0051dea979e8-credential-socket\") pod \"e2e-worker-w5-626870-openshift-default-7cd649d59c-74vj7\" (UID: \"f35ca7ba-e2b8-4e65-bc7b-0051dea979e8\") " pod="openshift-ingress/e2e-worker-w5-626870-openshift-default-7cd649d59c-74vj7"
Oct 30 20:05:10.376149 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:10.369081    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f35ca7ba-e2b8-4e65-bc7b-0051dea979e8-istiod-ca-cert\") pod \"e2e-worker-w5-626870-openshift-default-7cd649d59c-74vj7\" (UID: \"f35ca7ba-e2b8-4e65-bc7b-0051dea979e8\") " pod="openshift-ingress/e2e-worker-w5-626870-openshift-default-7cd649d59c-74vj7"
Oct 30 20:05:10.376149 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:10.369219    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f35ca7ba-e2b8-4e65-bc7b-0051dea979e8-istio-data\") pod \"e2e-worker-w5-626870-openshift-default-7cd649d59c-74vj7\" (UID: \"f35ca7ba-e2b8-4e65-bc7b-0051dea979e8\") " pod="openshift-ingress/e2e-worker-w5-626870-openshift-default-7cd649d59c-74vj7"
Oct 30 20:05:10.376149 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:10.369555    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f35ca7ba-e2b8-4e65-bc7b-0051dea979e8-workload-certs\") pod \"e2e-worker-w5-626870-openshift-default-7cd649d59c-74vj7\" (UID: \"f35ca7ba-e2b8-4e65-bc7b-0051dea979e8\") " pod="openshift-ingress/e2e-worker-w5-626870-openshift-default-7cd649d59c-74vj7"
Oct 30 20:05:10.379940 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:10.379908    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f35ca7ba-e2b8-4e65-bc7b-0051dea979e8-istio-podinfo\") pod \"e2e-worker-w5-626870-openshift-default-7cd649d59c-74vj7\" (UID: \"f35ca7ba-e2b8-4e65-bc7b-0051dea979e8\") " pod="openshift-ingress/e2e-worker-w5-626870-openshift-default-7cd649d59c-74vj7"
Oct 30 20:05:10.382356 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:10.382333    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f35ca7ba-e2b8-4e65-bc7b-0051dea979e8-istio-envoy\") pod \"e2e-worker-w5-626870-openshift-default-7cd649d59c-74vj7\" (UID: \"f35ca7ba-e2b8-4e65-bc7b-0051dea979e8\") " pod="openshift-ingress/e2e-worker-w5-626870-openshift-default-7cd649d59c-74vj7"
Oct 30 20:05:10.389315 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:10.389290    6275 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w0-62f4a1-openshift-default-7fc84fbccc-7qzmg"]
Oct 30 20:05:10.395444 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:10.394801    6275 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-62f4a1-openshift-default-7fc84fbccc-7qzmg"
Oct 30 20:05:10.403489 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:10.403461    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-825jx\" (UniqueName: \"kubernetes.io/projected/f35ca7ba-e2b8-4e65-bc7b-0051dea979e8-kube-api-access-825jx\") pod \"e2e-worker-w5-626870-openshift-default-7cd649d59c-74vj7\" (UID: \"f35ca7ba-e2b8-4e65-bc7b-0051dea979e8\") " pod="openshift-ingress/e2e-worker-w5-626870-openshift-default-7cd649d59c-74vj7"
Oct 30 20:05:10.403591 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:10.403472    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f35ca7ba-e2b8-4e65-bc7b-0051dea979e8-istio-token\") pod \"e2e-worker-w5-626870-openshift-default-7cd649d59c-74vj7\" (UID: \"f35ca7ba-e2b8-4e65-bc7b-0051dea979e8\") " pod="openshift-ingress/e2e-worker-w5-626870-openshift-default-7cd649d59c-74vj7"
Oct 30 20:05:10.425645 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:10.425614    6275 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-62f4a1-openshift-default-7fc84fbccc-7qzmg"]
Oct 30 20:05:10.461955 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:10.461919    6275 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-626870-openshift-default-7cd649d59c-74vj7"
Oct 30 20:05:10.563786 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:10.563753    6275 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w1-5f10d2-openshift-default-6c6777d6f5-8zmvq"]
Oct 30 20:05:10.571752 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:10.571719    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/555e958d-9abd-41f1-b08a-0db0b32fe79f-credential-socket\") pod \"e2e-worker-w0-62f4a1-openshift-default-7fc84fbccc-7qzmg\" (UID: \"555e958d-9abd-41f1-b08a-0db0b32fe79f\") " pod="openshift-ingress/e2e-worker-w0-62f4a1-openshift-default-7fc84fbccc-7qzmg"
Oct 30 20:05:10.571964 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:10.571792    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/555e958d-9abd-41f1-b08a-0db0b32fe79f-istio-envoy\") pod \"e2e-worker-w0-62f4a1-openshift-default-7fc84fbccc-7qzmg\" (UID: \"555e958d-9abd-41f1-b08a-0db0b32fe79f\") " pod="openshift-ingress/e2e-worker-w0-62f4a1-openshift-default-7fc84fbccc-7qzmg"
Oct 30 20:05:10.571964 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:10.571811    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/555e958d-9abd-41f1-b08a-0db0b32fe79f-istio-token\") pod \"e2e-worker-w0-62f4a1-openshift-default-7fc84fbccc-7qzmg\" (UID: \"555e958d-9abd-41f1-b08a-0db0b32fe79f\") " pod="openshift-ingress/e2e-worker-w0-62f4a1-openshift-default-7fc84fbccc-7qzmg"
Oct 30 20:05:10.571964 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:10.571879    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/555e958d-9abd-41f1-b08a-0db0b32fe79f-workload-certs\") pod \"e2e-worker-w0-62f4a1-openshift-default-7fc84fbccc-7qzmg\" (UID: \"555e958d-9abd-41f1-b08a-0db0b32fe79f\") " pod="openshift-ingress/e2e-worker-w0-62f4a1-openshift-default-7fc84fbccc-7qzmg"
Oct 30 20:05:10.571964 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:10.571937    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-99c2d\" (UniqueName: \"kubernetes.io/projected/555e958d-9abd-41f1-b08a-0db0b32fe79f-kube-api-access-99c2d\") pod \"e2e-worker-w0-62f4a1-openshift-default-7fc84fbccc-7qzmg\" (UID: \"555e958d-9abd-41f1-b08a-0db0b32fe79f\") " pod="openshift-ingress/e2e-worker-w0-62f4a1-openshift-default-7fc84fbccc-7qzmg"
Oct 30 20:05:10.571964 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:10.571958    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/555e958d-9abd-41f1-b08a-0db0b32fe79f-istio-data\") pod \"e2e-worker-w0-62f4a1-openshift-default-7fc84fbccc-7qzmg\" (UID: \"555e958d-9abd-41f1-b08a-0db0b32fe79f\") " pod="openshift-ingress/e2e-worker-w0-62f4a1-openshift-default-7fc84fbccc-7qzmg"
Oct 30 20:05:10.572470 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:10.571976    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/555e958d-9abd-41f1-b08a-0db0b32fe79f-workload-socket\") pod \"e2e-worker-w0-62f4a1-openshift-default-7fc84fbccc-7qzmg\" (UID: \"555e958d-9abd-41f1-b08a-0db0b32fe79f\") " pod="openshift-ingress/e2e-worker-w0-62f4a1-openshift-default-7fc84fbccc-7qzmg"
Oct 30 20:05:10.572470 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:10.572018    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/555e958d-9abd-41f1-b08a-0db0b32fe79f-istiod-ca-cert\") pod \"e2e-worker-w0-62f4a1-openshift-default-7fc84fbccc-7qzmg\" (UID: \"555e958d-9abd-41f1-b08a-0db0b32fe79f\") " pod="openshift-ingress/e2e-worker-w0-62f4a1-openshift-default-7fc84fbccc-7qzmg"
Oct 30 20:05:10.572470 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:10.572050    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/555e958d-9abd-41f1-b08a-0db0b32fe79f-istio-podinfo\") pod \"e2e-worker-w0-62f4a1-openshift-default-7fc84fbccc-7qzmg\" (UID: \"555e958d-9abd-41f1-b08a-0db0b32fe79f\") " pod="openshift-ingress/e2e-worker-w0-62f4a1-openshift-default-7fc84fbccc-7qzmg"
Oct 30 20:05:10.576105 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:10.576080    6275 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-5f10d2-openshift-default-6c6777d6f5-8zmvq"
Oct 30 20:05:10.594744 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:10.594715    6275 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w1-5f10d2-openshift-default-6c6777d6f5-8zmvq"]
Oct 30 20:05:10.673103 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:10.673012    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/555e958d-9abd-41f1-b08a-0db0b32fe79f-istio-envoy\") pod \"e2e-worker-w0-62f4a1-openshift-default-7fc84fbccc-7qzmg\" (UID: \"555e958d-9abd-41f1-b08a-0db0b32fe79f\") " pod="openshift-ingress/e2e-worker-w0-62f4a1-openshift-default-7fc84fbccc-7qzmg"
Oct 30 20:05:10.673103 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:10.673046    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/555e958d-9abd-41f1-b08a-0db0b32fe79f-istio-token\") pod \"e2e-worker-w0-62f4a1-openshift-default-7fc84fbccc-7qzmg\" (UID: \"555e958d-9abd-41f1-b08a-0db0b32fe79f\") " pod="openshift-ingress/e2e-worker-w0-62f4a1-openshift-default-7fc84fbccc-7qzmg"
Oct 30 20:05:10.673103 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:10.673087    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0e4973a9-ead0-4c5f-813c-fa012dc3fade-istio-envoy\") pod \"e2e-worker-w1-5f10d2-openshift-default-6c6777d6f5-8zmvq\" (UID: \"0e4973a9-ead0-4c5f-813c-fa012dc3fade\") " pod="openshift-ingress/e2e-worker-w1-5f10d2-openshift-default-6c6777d6f5-8zmvq"
Oct 30 20:05:10.673396 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:10.673148    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0e4973a9-ead0-4c5f-813c-fa012dc3fade-istio-data\") pod \"e2e-worker-w1-5f10d2-openshift-default-6c6777d6f5-8zmvq\" (UID: \"0e4973a9-ead0-4c5f-813c-fa012dc3fade\") " pod="openshift-ingress/e2e-worker-w1-5f10d2-openshift-default-6c6777d6f5-8zmvq"
Oct 30 20:05:10.673396 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:10.673183    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/555e958d-9abd-41f1-b08a-0db0b32fe79f-workload-certs\") pod \"e2e-worker-w0-62f4a1-openshift-default-7fc84fbccc-7qzmg\" (UID: \"555e958d-9abd-41f1-b08a-0db0b32fe79f\") " pod="openshift-ingress/e2e-worker-w0-62f4a1-openshift-default-7fc84fbccc-7qzmg"
Oct 30 20:05:10.673396 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:10.673347    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-99c2d\" (UniqueName: \"kubernetes.io/projected/555e958d-9abd-41f1-b08a-0db0b32fe79f-kube-api-access-99c2d\") pod \"e2e-worker-w0-62f4a1-openshift-default-7fc84fbccc-7qzmg\" (UID: \"555e958d-9abd-41f1-b08a-0db0b32fe79f\") " pod="openshift-ingress/e2e-worker-w0-62f4a1-openshift-default-7fc84fbccc-7qzmg"
Oct 30 20:05:10.673396 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:10.673384    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0e4973a9-ead0-4c5f-813c-fa012dc3fade-istio-podinfo\") pod \"e2e-worker-w1-5f10d2-openshift-default-6c6777d6f5-8zmvq\" (UID: \"0e4973a9-ead0-4c5f-813c-fa012dc3fade\") " pod="openshift-ingress/e2e-worker-w1-5f10d2-openshift-default-6c6777d6f5-8zmvq"
Oct 30 20:05:10.673396 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:10.673402    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0e4973a9-ead0-4c5f-813c-fa012dc3fade-istio-token\") pod \"e2e-worker-w1-5f10d2-openshift-default-6c6777d6f5-8zmvq\" (UID: \"0e4973a9-ead0-4c5f-813c-fa012dc3fade\") " pod="openshift-ingress/e2e-worker-w1-5f10d2-openshift-default-6c6777d6f5-8zmvq"
Oct 30 20:05:10.673669 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:10.673472    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/555e958d-9abd-41f1-b08a-0db0b32fe79f-istio-data\") pod \"e2e-worker-w0-62f4a1-openshift-default-7fc84fbccc-7qzmg\" (UID: \"555e958d-9abd-41f1-b08a-0db0b32fe79f\") " pod="openshift-ingress/e2e-worker-w0-62f4a1-openshift-default-7fc84fbccc-7qzmg"
Oct 30 20:05:10.673669 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:10.673498    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0e4973a9-ead0-4c5f-813c-fa012dc3fade-credential-socket\") pod \"e2e-worker-w1-5f10d2-openshift-default-6c6777d6f5-8zmvq\" (UID: \"0e4973a9-ead0-4c5f-813c-fa012dc3fade\") " pod="openshift-ingress/e2e-worker-w1-5f10d2-openshift-default-6c6777d6f5-8zmvq"
Oct 30 20:05:10.673669 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:10.673524    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/555e958d-9abd-41f1-b08a-0db0b32fe79f-workload-socket\") pod \"e2e-worker-w0-62f4a1-openshift-default-7fc84fbccc-7qzmg\" (UID: \"555e958d-9abd-41f1-b08a-0db0b32fe79f\") " pod="openshift-ingress/e2e-worker-w0-62f4a1-openshift-default-7fc84fbccc-7qzmg"
Oct 30 20:05:10.673669 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:10.673587    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/555e958d-9abd-41f1-b08a-0db0b32fe79f-workload-certs\") pod \"e2e-worker-w0-62f4a1-openshift-default-7fc84fbccc-7qzmg\" (UID: \"555e958d-9abd-41f1-b08a-0db0b32fe79f\") " pod="openshift-ingress/e2e-worker-w0-62f4a1-openshift-default-7fc84fbccc-7qzmg"
Oct 30 20:05:10.673669 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:10.673575    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0e4973a9-ead0-4c5f-813c-fa012dc3fade-workload-socket\") pod \"e2e-worker-w1-5f10d2-openshift-default-6c6777d6f5-8zmvq\" (UID: \"0e4973a9-ead0-4c5f-813c-fa012dc3fade\") " pod="openshift-ingress/e2e-worker-w1-5f10d2-openshift-default-6c6777d6f5-8zmvq"
Oct 30 20:05:10.673669 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:10.673632    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/555e958d-9abd-41f1-b08a-0db0b32fe79f-istiod-ca-cert\") pod \"e2e-worker-w0-62f4a1-openshift-default-7fc84fbccc-7qzmg\" (UID: \"555e958d-9abd-41f1-b08a-0db0b32fe79f\") " pod="openshift-ingress/e2e-worker-w0-62f4a1-openshift-default-7fc84fbccc-7qzmg"
Oct 30 20:05:10.673669 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:10.673667    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0e4973a9-ead0-4c5f-813c-fa012dc3fade-istiod-ca-cert\") pod \"e2e-worker-w1-5f10d2-openshift-default-6c6777d6f5-8zmvq\" (UID: \"0e4973a9-ead0-4c5f-813c-fa012dc3fade\") " pod="openshift-ingress/e2e-worker-w1-5f10d2-openshift-default-6c6777d6f5-8zmvq"
Oct 30 20:05:10.673995 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:10.673708    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/555e958d-9abd-41f1-b08a-0db0b32fe79f-istio-podinfo\") pod \"e2e-worker-w0-62f4a1-openshift-default-7fc84fbccc-7qzmg\" (UID: \"555e958d-9abd-41f1-b08a-0db0b32fe79f\") " pod="openshift-ingress/e2e-worker-w0-62f4a1-openshift-default-7fc84fbccc-7qzmg"
Oct 30 20:05:10.673995 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:10.673731    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0e4973a9-ead0-4c5f-813c-fa012dc3fade-workload-certs\") pod \"e2e-worker-w1-5f10d2-openshift-default-6c6777d6f5-8zmvq\" (UID: \"0e4973a9-ead0-4c5f-813c-fa012dc3fade\") " pod="openshift-ingress/e2e-worker-w1-5f10d2-openshift-default-6c6777d6f5-8zmvq"
Oct 30 20:05:10.673995 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:10.673762    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/555e958d-9abd-41f1-b08a-0db0b32fe79f-istio-data\") pod \"e2e-worker-w0-62f4a1-openshift-default-7fc84fbccc-7qzmg\" (UID: \"555e958d-9abd-41f1-b08a-0db0b32fe79f\") " pod="openshift-ingress/e2e-worker-w0-62f4a1-openshift-default-7fc84fbccc-7qzmg"
Oct 30 20:05:10.673995 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:10.673769    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v692p\" (UniqueName: \"kubernetes.io/projected/0e4973a9-ead0-4c5f-813c-fa012dc3fade-kube-api-access-v692p\") pod \"e2e-worker-w1-5f10d2-openshift-default-6c6777d6f5-8zmvq\" (UID: \"0e4973a9-ead0-4c5f-813c-fa012dc3fade\") " pod="openshift-ingress/e2e-worker-w1-5f10d2-openshift-default-6c6777d6f5-8zmvq"
Oct 30 20:05:10.673995 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:10.673905    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/555e958d-9abd-41f1-b08a-0db0b32fe79f-workload-socket\") pod \"e2e-worker-w0-62f4a1-openshift-default-7fc84fbccc-7qzmg\" (UID: \"555e958d-9abd-41f1-b08a-0db0b32fe79f\") " pod="openshift-ingress/e2e-worker-w0-62f4a1-openshift-default-7fc84fbccc-7qzmg"
Oct 30 20:05:10.673995 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:10.673941    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/555e958d-9abd-41f1-b08a-0db0b32fe79f-credential-socket\") pod \"e2e-worker-w0-62f4a1-openshift-default-7fc84fbccc-7qzmg\" (UID: \"555e958d-9abd-41f1-b08a-0db0b32fe79f\") " pod="openshift-ingress/e2e-worker-w0-62f4a1-openshift-default-7fc84fbccc-7qzmg"
Oct 30 20:05:10.674249 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:10.674228    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/555e958d-9abd-41f1-b08a-0db0b32fe79f-credential-socket\") pod \"e2e-worker-w0-62f4a1-openshift-default-7fc84fbccc-7qzmg\" (UID: \"555e958d-9abd-41f1-b08a-0db0b32fe79f\") " pod="openshift-ingress/e2e-worker-w0-62f4a1-openshift-default-7fc84fbccc-7qzmg"
Oct 30 20:05:10.674318 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:10.674299    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/555e958d-9abd-41f1-b08a-0db0b32fe79f-istiod-ca-cert\") pod \"e2e-worker-w0-62f4a1-openshift-default-7fc84fbccc-7qzmg\" (UID: \"555e958d-9abd-41f1-b08a-0db0b32fe79f\") " pod="openshift-ingress/e2e-worker-w0-62f4a1-openshift-default-7fc84fbccc-7qzmg"
Oct 30 20:05:10.675494 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:10.675480    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/555e958d-9abd-41f1-b08a-0db0b32fe79f-istio-envoy\") pod \"e2e-worker-w0-62f4a1-openshift-default-7fc84fbccc-7qzmg\" (UID: \"555e958d-9abd-41f1-b08a-0db0b32fe79f\") " pod="openshift-ingress/e2e-worker-w0-62f4a1-openshift-default-7fc84fbccc-7qzmg"
Oct 30 20:05:10.675928 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:10.675908    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/555e958d-9abd-41f1-b08a-0db0b32fe79f-istio-podinfo\") pod \"e2e-worker-w0-62f4a1-openshift-default-7fc84fbccc-7qzmg\" (UID: \"555e958d-9abd-41f1-b08a-0db0b32fe79f\") " pod="openshift-ingress/e2e-worker-w0-62f4a1-openshift-default-7fc84fbccc-7qzmg"
Oct 30 20:05:10.698174 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:10.698147    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/555e958d-9abd-41f1-b08a-0db0b32fe79f-istio-token\") pod \"e2e-worker-w0-62f4a1-openshift-default-7fc84fbccc-7qzmg\" (UID: \"555e958d-9abd-41f1-b08a-0db0b32fe79f\") " pod="openshift-ingress/e2e-worker-w0-62f4a1-openshift-default-7fc84fbccc-7qzmg"
Oct 30 20:05:10.698611 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:10.698594    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-99c2d\" (UniqueName: \"kubernetes.io/projected/555e958d-9abd-41f1-b08a-0db0b32fe79f-kube-api-access-99c2d\") pod \"e2e-worker-w0-62f4a1-openshift-default-7fc84fbccc-7qzmg\" (UID: \"555e958d-9abd-41f1-b08a-0db0b32fe79f\") " pod="openshift-ingress/e2e-worker-w0-62f4a1-openshift-default-7fc84fbccc-7qzmg"
Oct 30 20:05:10.742451 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:10.742390    6275 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-62f4a1-openshift-default-7fc84fbccc-7qzmg"
Oct 30 20:05:10.775665 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:10.775618    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0e4973a9-ead0-4c5f-813c-fa012dc3fade-istio-envoy\") pod \"e2e-worker-w1-5f10d2-openshift-default-6c6777d6f5-8zmvq\" (UID: \"0e4973a9-ead0-4c5f-813c-fa012dc3fade\") " pod="openshift-ingress/e2e-worker-w1-5f10d2-openshift-default-6c6777d6f5-8zmvq"
Oct 30 20:05:10.775834 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:10.775699    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0e4973a9-ead0-4c5f-813c-fa012dc3fade-istio-data\") pod \"e2e-worker-w1-5f10d2-openshift-default-6c6777d6f5-8zmvq\" (UID: \"0e4973a9-ead0-4c5f-813c-fa012dc3fade\") " pod="openshift-ingress/e2e-worker-w1-5f10d2-openshift-default-6c6777d6f5-8zmvq"
Oct 30 20:05:10.775834 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:10.775817    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0e4973a9-ead0-4c5f-813c-fa012dc3fade-istio-podinfo\") pod \"e2e-worker-w1-5f10d2-openshift-default-6c6777d6f5-8zmvq\" (UID: \"0e4973a9-ead0-4c5f-813c-fa012dc3fade\") " pod="openshift-ingress/e2e-worker-w1-5f10d2-openshift-default-6c6777d6f5-8zmvq"
Oct 30 20:05:10.776093 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:10.775842    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0e4973a9-ead0-4c5f-813c-fa012dc3fade-istio-token\") pod \"e2e-worker-w1-5f10d2-openshift-default-6c6777d6f5-8zmvq\" (UID: \"0e4973a9-ead0-4c5f-813c-fa012dc3fade\") " pod="openshift-ingress/e2e-worker-w1-5f10d2-openshift-default-6c6777d6f5-8zmvq"
Oct 30 20:05:10.776093 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:10.775873    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0e4973a9-ead0-4c5f-813c-fa012dc3fade-credential-socket\") pod \"e2e-worker-w1-5f10d2-openshift-default-6c6777d6f5-8zmvq\" (UID: \"0e4973a9-ead0-4c5f-813c-fa012dc3fade\") " pod="openshift-ingress/e2e-worker-w1-5f10d2-openshift-default-6c6777d6f5-8zmvq"
Oct 30 20:05:10.776093 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:10.775935    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0e4973a9-ead0-4c5f-813c-fa012dc3fade-workload-socket\") pod \"e2e-worker-w1-5f10d2-openshift-default-6c6777d6f5-8zmvq\" (UID: \"0e4973a9-ead0-4c5f-813c-fa012dc3fade\") " pod="openshift-ingress/e2e-worker-w1-5f10d2-openshift-default-6c6777d6f5-8zmvq"
Oct 30 20:05:10.776093 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:10.775988    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0e4973a9-ead0-4c5f-813c-fa012dc3fade-istiod-ca-cert\") pod \"e2e-worker-w1-5f10d2-openshift-default-6c6777d6f5-8zmvq\" (UID: \"0e4973a9-ead0-4c5f-813c-fa012dc3fade\") " pod="openshift-ingress/e2e-worker-w1-5f10d2-openshift-default-6c6777d6f5-8zmvq"
Oct 30 20:05:10.776093 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:10.776046    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0e4973a9-ead0-4c5f-813c-fa012dc3fade-workload-certs\") pod \"e2e-worker-w1-5f10d2-openshift-default-6c6777d6f5-8zmvq\" (UID: \"0e4973a9-ead0-4c5f-813c-fa012dc3fade\") " pod="openshift-ingress/e2e-worker-w1-5f10d2-openshift-default-6c6777d6f5-8zmvq"
Oct 30 20:05:10.776093 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:10.776071    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v692p\" (UniqueName: \"kubernetes.io/projected/0e4973a9-ead0-4c5f-813c-fa012dc3fade-kube-api-access-v692p\") pod \"e2e-worker-w1-5f10d2-openshift-default-6c6777d6f5-8zmvq\" (UID: \"0e4973a9-ead0-4c5f-813c-fa012dc3fade\") " pod="openshift-ingress/e2e-worker-w1-5f10d2-openshift-default-6c6777d6f5-8zmvq"
Oct 30 20:05:10.776396 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:10.776186    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0e4973a9-ead0-4c5f-813c-fa012dc3fade-istio-data\") pod \"e2e-worker-w1-5f10d2-openshift-default-6c6777d6f5-8zmvq\" (UID: \"0e4973a9-ead0-4c5f-813c-fa012dc3fade\") " pod="openshift-ingress/e2e-worker-w1-5f10d2-openshift-default-6c6777d6f5-8zmvq"
Oct 30 20:05:10.777697 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:10.776554    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0e4973a9-ead0-4c5f-813c-fa012dc3fade-credential-socket\") pod \"e2e-worker-w1-5f10d2-openshift-default-6c6777d6f5-8zmvq\" (UID: \"0e4973a9-ead0-4c5f-813c-fa012dc3fade\") " pod="openshift-ingress/e2e-worker-w1-5f10d2-openshift-default-6c6777d6f5-8zmvq"
Oct 30 20:05:10.777697 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:10.776883    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0e4973a9-ead0-4c5f-813c-fa012dc3fade-istiod-ca-cert\") pod \"e2e-worker-w1-5f10d2-openshift-default-6c6777d6f5-8zmvq\" (UID: \"0e4973a9-ead0-4c5f-813c-fa012dc3fade\") " pod="openshift-ingress/e2e-worker-w1-5f10d2-openshift-default-6c6777d6f5-8zmvq"
Oct 30 20:05:10.777697 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:10.777250    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0e4973a9-ead0-4c5f-813c-fa012dc3fade-workload-certs\") pod \"e2e-worker-w1-5f10d2-openshift-default-6c6777d6f5-8zmvq\" (UID: \"0e4973a9-ead0-4c5f-813c-fa012dc3fade\") " pod="openshift-ingress/e2e-worker-w1-5f10d2-openshift-default-6c6777d6f5-8zmvq"
Oct 30 20:05:10.778542 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:10.778384    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0e4973a9-ead0-4c5f-813c-fa012dc3fade-workload-socket\") pod \"e2e-worker-w1-5f10d2-openshift-default-6c6777d6f5-8zmvq\" (UID: \"0e4973a9-ead0-4c5f-813c-fa012dc3fade\") " pod="openshift-ingress/e2e-worker-w1-5f10d2-openshift-default-6c6777d6f5-8zmvq"
Oct 30 20:05:10.780553 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:10.780080    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0e4973a9-ead0-4c5f-813c-fa012dc3fade-istio-envoy\") pod \"e2e-worker-w1-5f10d2-openshift-default-6c6777d6f5-8zmvq\" (UID: \"0e4973a9-ead0-4c5f-813c-fa012dc3fade\") " pod="openshift-ingress/e2e-worker-w1-5f10d2-openshift-default-6c6777d6f5-8zmvq"
Oct 30 20:05:10.781954 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:10.781931    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0e4973a9-ead0-4c5f-813c-fa012dc3fade-istio-podinfo\") pod \"e2e-worker-w1-5f10d2-openshift-default-6c6777d6f5-8zmvq\" (UID: \"0e4973a9-ead0-4c5f-813c-fa012dc3fade\") " pod="openshift-ingress/e2e-worker-w1-5f10d2-openshift-default-6c6777d6f5-8zmvq"
Oct 30 20:05:10.813892 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:10.810107    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v692p\" (UniqueName: \"kubernetes.io/projected/0e4973a9-ead0-4c5f-813c-fa012dc3fade-kube-api-access-v692p\") pod \"e2e-worker-w1-5f10d2-openshift-default-6c6777d6f5-8zmvq\" (UID: \"0e4973a9-ead0-4c5f-813c-fa012dc3fade\") " pod="openshift-ingress/e2e-worker-w1-5f10d2-openshift-default-6c6777d6f5-8zmvq"
Oct 30 20:05:10.813892 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:10.811300    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0e4973a9-ead0-4c5f-813c-fa012dc3fade-istio-token\") pod \"e2e-worker-w1-5f10d2-openshift-default-6c6777d6f5-8zmvq\" (UID: \"0e4973a9-ead0-4c5f-813c-fa012dc3fade\") " pod="openshift-ingress/e2e-worker-w1-5f10d2-openshift-default-6c6777d6f5-8zmvq"
Oct 30 20:05:10.815306 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:10.815271    6275 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w5-626870-openshift-default-7cd649d59c-74vj7"]
Oct 30 20:05:10.820658 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:10.820304    6275 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Oct 30 20:05:10.820658 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:10.820367    6275 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Oct 30 20:05:10.820658 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:10.820400    6275 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Oct 30 20:05:10.911541 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:10.911515    6275 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-5f10d2-openshift-default-6c6777d6f5-8zmvq"
Oct 30 20:05:11.065230 ip-10-0-131-26 kubenswrapper[6275]: W1030 20:05:11.065196    6275 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod555e958d_9abd_41f1_b08a_0db0b32fe79f.slice/crio-c0789902196f44e1b0efbf5c4245d1929814c996b7d5a26e54229ced68295476 WatchSource:0}: Error finding container c0789902196f44e1b0efbf5c4245d1929814c996b7d5a26e54229ced68295476: Status 404 returned error can't find the container with id c0789902196f44e1b0efbf5c4245d1929814c996b7d5a26e54229ced68295476
Oct 30 20:05:11.066848 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:11.066820    6275 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-62f4a1-openshift-default-7fc84fbccc-7qzmg"]
Oct 30 20:05:11.075613 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:11.075573    6275 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Oct 30 20:05:11.075849 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:11.075820    6275 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Oct 30 20:05:11.075941 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:11.075876    6275 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Oct 30 20:05:11.319066 ip-10-0-131-26 kubenswrapper[6275]: W1030 20:05:11.319025    6275 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0e4973a9_ead0_4c5f_813c_fa012dc3fade.slice/crio-f7676242fb02351874295703bb203c54b5a82662fa3a455dac355d9964e9a2e8 WatchSource:0}: Error finding container f7676242fb02351874295703bb203c54b5a82662fa3a455dac355d9964e9a2e8: Status 404 returned error can't find the container with id f7676242fb02351874295703bb203c54b5a82662fa3a455dac355d9964e9a2e8
Oct 30 20:05:11.322725 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:11.322682    6275 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Oct 30 20:05:11.322819 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:11.322761    6275 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Oct 30 20:05:11.322819 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:11.322793    6275 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Oct 30 20:05:11.340085 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:11.340046    6275 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w1-5f10d2-openshift-default-6c6777d6f5-8zmvq"]
Oct 30 20:05:11.636734 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:11.636643    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-626870-openshift-default-7cd649d59c-74vj7" event={"ID":"f35ca7ba-e2b8-4e65-bc7b-0051dea979e8","Type":"ContainerStarted","Data":"b2d672f4c4c542f8c81c1e59ae15e9f5e636e262235126b188ec1756c38c8a48"}
Oct 30 20:05:11.636734 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:11.636723    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-626870-openshift-default-7cd649d59c-74vj7" event={"ID":"f35ca7ba-e2b8-4e65-bc7b-0051dea979e8","Type":"ContainerStarted","Data":"69ea63f0e8eee487950928ef080d20e8cf257a91da902d77301aff3946365cc2"}
Oct 30 20:05:11.639455 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:11.639393    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-62f4a1-openshift-default-7fc84fbccc-7qzmg" event={"ID":"555e958d-9abd-41f1-b08a-0db0b32fe79f","Type":"ContainerStarted","Data":"6380e096c69463037b49fbf888cf7ab5016054777548b93e6d47ad6fa445d0fd"}
Oct 30 20:05:11.639562 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:11.639470    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-62f4a1-openshift-default-7fc84fbccc-7qzmg" event={"ID":"555e958d-9abd-41f1-b08a-0db0b32fe79f","Type":"ContainerStarted","Data":"c0789902196f44e1b0efbf5c4245d1929814c996b7d5a26e54229ced68295476"}
Oct 30 20:05:11.642720 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:11.642695    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-5f10d2-openshift-default-6c6777d6f5-8zmvq" event={"ID":"0e4973a9-ead0-4c5f-813c-fa012dc3fade","Type":"ContainerStarted","Data":"0c82a67a9f21ab5792001461eeb80d2a5c07b16638b0e39f4cc59a89cdeaf38e"}
Oct 30 20:05:11.642901 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:11.642884    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-5f10d2-openshift-default-6c6777d6f5-8zmvq" event={"ID":"0e4973a9-ead0-4c5f-813c-fa012dc3fade","Type":"ContainerStarted","Data":"f7676242fb02351874295703bb203c54b5a82662fa3a455dac355d9964e9a2e8"}
Oct 30 20:05:11.709694 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:11.709641    6275 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w5-626870-openshift-default-7cd649d59c-74vj7" podStartSLOduration=2.709625226 podStartE2EDuration="2.709625226s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:05:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:05:11.7077741 +0000 UTC m=+1022.169500966" watchObservedRunningTime="2026-10-30 20:05:11.709625226 +0000 UTC m=+1022.171352088"
Oct 30 20:05:11.742806 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:11.742777    6275 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w0-62f4a1-openshift-default-7fc84fbccc-7qzmg"
Oct 30 20:05:11.758669 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:11.758617    6275 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w0-62f4a1-openshift-default-7fc84fbccc-7qzmg" podStartSLOduration=1.758603277 podStartE2EDuration="1.758603277s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:05:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:05:11.757383857 +0000 UTC m=+1022.219110719" watchObservedRunningTime="2026-10-30 20:05:11.758603277 +0000 UTC m=+1022.220330139"
Oct 30 20:05:11.814321 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:11.814257    6275 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w1-5f10d2-openshift-default-6c6777d6f5-8zmvq" podStartSLOduration=1.814236309 podStartE2EDuration="1.814236309s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:05:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:05:11.80686094 +0000 UTC m=+1022.268587812" watchObservedRunningTime="2026-10-30 20:05:11.814236309 +0000 UTC m=+1022.275963173"
Oct 30 20:05:11.911709 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:11.911618    6275 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w1-5f10d2-openshift-default-6c6777d6f5-8zmvq"
Oct 30 20:05:12.462201 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:12.462164    6275 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w5-626870-openshift-default-7cd649d59c-74vj7"
Oct 30 20:05:12.463537 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:12.463511    6275 patch_prober.go:29] interesting pod/e2e-worker-w5-626870-openshift-default-7cd649d59c-74vj7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.83:15021/healthz/ready\": dial tcp 10.134.0.83:15021: connect: connection refused" start-of-body=
Oct 30 20:05:12.463657 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:12.463553    6275 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-626870-openshift-default-7cd649d59c-74vj7" podUID="f35ca7ba-e2b8-4e65-bc7b-0051dea979e8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.83:15021/healthz/ready\": dial tcp 10.134.0.83:15021: connect: connection refused"
Oct 30 20:05:12.750656 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:12.750600    6275 patch_prober.go:29] interesting pod/e2e-worker-w0-62f4a1-openshift-default-7fc84fbccc-7qzmg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.84:15021/healthz/ready\": dial tcp 10.134.0.84:15021: connect: connection refused" start-of-body=
Oct 30 20:05:12.751296 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:12.751238    6275 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-62f4a1-openshift-default-7fc84fbccc-7qzmg" podUID="555e958d-9abd-41f1-b08a-0db0b32fe79f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.84:15021/healthz/ready\": dial tcp 10.134.0.84:15021: connect: connection refused"
Oct 30 20:05:12.915439 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:12.914751    6275 patch_prober.go:29] interesting pod/e2e-worker-w1-5f10d2-openshift-default-6c6777d6f5-8zmvq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.85:15021/healthz/ready\": dial tcp 10.134.0.85:15021: connect: connection refused" start-of-body=
Oct 30 20:05:12.915439 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:12.914832    6275 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-5f10d2-openshift-default-6c6777d6f5-8zmvq" podUID="0e4973a9-ead0-4c5f-813c-fa012dc3fade" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.85:15021/healthz/ready\": dial tcp 10.134.0.85:15021: connect: connection refused"
Oct 30 20:05:13.462459 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:13.462403    6275 patch_prober.go:29] interesting pod/e2e-worker-w5-626870-openshift-default-7cd649d59c-74vj7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.83:15021/healthz/ready\": dial tcp 10.134.0.83:15021: connect: connection refused" start-of-body=
Oct 30 20:05:13.462680 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:13.462475    6275 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-626870-openshift-default-7cd649d59c-74vj7" podUID="f35ca7ba-e2b8-4e65-bc7b-0051dea979e8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.83:15021/healthz/ready\": dial tcp 10.134.0.83:15021: connect: connection refused"
Oct 30 20:05:13.743321 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:13.743286    6275 patch_prober.go:29] interesting pod/e2e-worker-w0-62f4a1-openshift-default-7fc84fbccc-7qzmg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.84:15021/healthz/ready\": dial tcp 10.134.0.84:15021: connect: connection refused" start-of-body=
Oct 30 20:05:13.743623 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:13.743589    6275 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-62f4a1-openshift-default-7fc84fbccc-7qzmg" podUID="555e958d-9abd-41f1-b08a-0db0b32fe79f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.84:15021/healthz/ready\": dial tcp 10.134.0.84:15021: connect: connection refused"
Oct 30 20:05:13.921888 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:13.921840    6275 patch_prober.go:29] interesting pod/e2e-worker-w1-5f10d2-openshift-default-6c6777d6f5-8zmvq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.85:15021/healthz/ready\": dial tcp 10.134.0.85:15021: connect: connection refused" start-of-body=
Oct 30 20:05:13.922469 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:13.921912    6275 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-5f10d2-openshift-default-6c6777d6f5-8zmvq" podUID="0e4973a9-ead0-4c5f-813c-fa012dc3fade" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.85:15021/healthz/ready\": dial tcp 10.134.0.85:15021: connect: connection refused"
Oct 30 20:05:14.462579 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:14.462540    6275 patch_prober.go:29] interesting pod/e2e-worker-w5-626870-openshift-default-7cd649d59c-74vj7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.83:15021/healthz/ready\": dial tcp 10.134.0.83:15021: connect: connection refused" start-of-body=
Oct 30 20:05:14.462736 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:14.462590    6275 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-626870-openshift-default-7cd649d59c-74vj7" podUID="f35ca7ba-e2b8-4e65-bc7b-0051dea979e8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.83:15021/healthz/ready\": dial tcp 10.134.0.83:15021: connect: connection refused"
Oct 30 20:05:14.757619 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:14.750801    6275 patch_prober.go:29] interesting pod/e2e-worker-w0-62f4a1-openshift-default-7fc84fbccc-7qzmg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.84:15021/healthz/ready\": dial tcp 10.134.0.84:15021: connect: connection refused" start-of-body=
Oct 30 20:05:14.757619 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:14.750869    6275 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-62f4a1-openshift-default-7fc84fbccc-7qzmg" podUID="555e958d-9abd-41f1-b08a-0db0b32fe79f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.84:15021/healthz/ready\": dial tcp 10.134.0.84:15021: connect: connection refused"
Oct 30 20:05:14.927869 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:14.927831    6275 patch_prober.go:29] interesting pod/e2e-worker-w1-5f10d2-openshift-default-6c6777d6f5-8zmvq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.85:15021/healthz/ready\": dial tcp 10.134.0.85:15021: connect: connection refused" start-of-body=
Oct 30 20:05:14.928427 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:14.928376    6275 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-5f10d2-openshift-default-6c6777d6f5-8zmvq" podUID="0e4973a9-ead0-4c5f-813c-fa012dc3fade" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.85:15021/healthz/ready\": dial tcp 10.134.0.85:15021: connect: connection refused"
Oct 30 20:05:15.471728 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:15.468230    6275 patch_prober.go:29] interesting pod/e2e-worker-w5-626870-openshift-default-7cd649d59c-74vj7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.83:15021/healthz/ready\": dial tcp 10.134.0.83:15021: connect: connection refused" start-of-body=
Oct 30 20:05:15.471728 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:15.468301    6275 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-626870-openshift-default-7cd649d59c-74vj7" podUID="f35ca7ba-e2b8-4e65-bc7b-0051dea979e8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.83:15021/healthz/ready\": dial tcp 10.134.0.83:15021: connect: connection refused"
Oct 30 20:05:15.746247 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:15.745744    6275 patch_prober.go:29] interesting pod/e2e-worker-w0-62f4a1-openshift-default-7fc84fbccc-7qzmg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.84:15021/healthz/ready\": dial tcp 10.134.0.84:15021: connect: connection refused" start-of-body=
Oct 30 20:05:15.746247 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:15.745807    6275 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-62f4a1-openshift-default-7fc84fbccc-7qzmg" podUID="555e958d-9abd-41f1-b08a-0db0b32fe79f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.84:15021/healthz/ready\": dial tcp 10.134.0.84:15021: connect: connection refused"
Oct 30 20:05:15.918438 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:15.917849    6275 patch_prober.go:29] interesting pod/e2e-worker-w1-5f10d2-openshift-default-6c6777d6f5-8zmvq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.85:15021/healthz/ready\": dial tcp 10.134.0.85:15021: connect: connection refused" start-of-body=
Oct 30 20:05:15.918438 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:15.917917    6275 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-5f10d2-openshift-default-6c6777d6f5-8zmvq" podUID="0e4973a9-ead0-4c5f-813c-fa012dc3fade" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.85:15021/healthz/ready\": dial tcp 10.134.0.85:15021: connect: connection refused"
Oct 30 20:05:16.463053 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:16.462992    6275 patch_prober.go:29] interesting pod/e2e-worker-w5-626870-openshift-default-7cd649d59c-74vj7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.83:15021/healthz/ready\": dial tcp 10.134.0.83:15021: connect: connection refused" start-of-body=
Oct 30 20:05:16.463526 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:16.463078    6275 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-626870-openshift-default-7cd649d59c-74vj7" podUID="f35ca7ba-e2b8-4e65-bc7b-0051dea979e8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.83:15021/healthz/ready\": dial tcp 10.134.0.83:15021: connect: connection refused"
Oct 30 20:05:16.743548 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:16.743508    6275 patch_prober.go:29] interesting pod/e2e-worker-w0-62f4a1-openshift-default-7fc84fbccc-7qzmg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.84:15021/healthz/ready\": dial tcp 10.134.0.84:15021: connect: connection refused" start-of-body=
Oct 30 20:05:16.743846 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:16.743816    6275 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-62f4a1-openshift-default-7fc84fbccc-7qzmg" podUID="555e958d-9abd-41f1-b08a-0db0b32fe79f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.84:15021/healthz/ready\": dial tcp 10.134.0.84:15021: connect: connection refused"
Oct 30 20:05:16.949443 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:16.938044    6275 patch_prober.go:29] interesting pod/e2e-worker-w1-5f10d2-openshift-default-6c6777d6f5-8zmvq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.85:15021/healthz/ready\": dial tcp 10.134.0.85:15021: connect: connection refused" start-of-body=
Oct 30 20:05:16.949443 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:16.938106    6275 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-5f10d2-openshift-default-6c6777d6f5-8zmvq" podUID="0e4973a9-ead0-4c5f-813c-fa012dc3fade" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.85:15021/healthz/ready\": dial tcp 10.134.0.85:15021: connect: connection refused"
Oct 30 20:05:17.463027 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:17.462984    6275 patch_prober.go:29] interesting pod/e2e-worker-w5-626870-openshift-default-7cd649d59c-74vj7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.83:15021/healthz/ready\": dial tcp 10.134.0.83:15021: connect: connection refused" start-of-body=
Oct 30 20:05:17.463211 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:17.463053    6275 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-626870-openshift-default-7cd649d59c-74vj7" podUID="f35ca7ba-e2b8-4e65-bc7b-0051dea979e8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.83:15021/healthz/ready\": dial tcp 10.134.0.83:15021: connect: connection refused"
Oct 30 20:05:17.742989 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:17.742961    6275 patch_prober.go:29] interesting pod/e2e-worker-w0-62f4a1-openshift-default-7fc84fbccc-7qzmg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.84:15021/healthz/ready\": dial tcp 10.134.0.84:15021: connect: connection refused" start-of-body=
Oct 30 20:05:17.743231 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:17.743195    6275 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-62f4a1-openshift-default-7fc84fbccc-7qzmg" podUID="555e958d-9abd-41f1-b08a-0db0b32fe79f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.84:15021/healthz/ready\": dial tcp 10.134.0.84:15021: connect: connection refused"
Oct 30 20:05:17.912752 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:17.912705    6275 patch_prober.go:29] interesting pod/e2e-worker-w1-5f10d2-openshift-default-6c6777d6f5-8zmvq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.85:15021/healthz/ready\": dial tcp 10.134.0.85:15021: connect: connection refused" start-of-body=
Oct 30 20:05:17.912963 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:17.912773    6275 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-5f10d2-openshift-default-6c6777d6f5-8zmvq" podUID="0e4973a9-ead0-4c5f-813c-fa012dc3fade" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.85:15021/healthz/ready\": dial tcp 10.134.0.85:15021: connect: connection refused"
Oct 30 20:05:18.465441 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:18.463640    6275 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w4-f1f016/distinct-w4-f1f016-kserve-79fbfbdbf7-hswb7"]
Oct 30 20:05:18.469769 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:18.469744    6275 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-f1f016/distinct-w4-f1f016-kserve-79fbfbdbf7-hswb7"
Oct 30 20:05:18.501520 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:18.495565    6275 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-f1f016/distinct-w4-f1f016-kserve-79fbfbdbf7-hswb7"]
Oct 30 20:05:18.501520 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:18.499359    6275 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w4-f1f016\"/\"distinct-w4-f1f016-kserve-self-signed-certs\""
Oct 30 20:05:18.542149 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:18.540920    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7b6639ea-72b0-49fb-b7fa-9443c1ddff6d-model-cache\") pod \"distinct-w4-f1f016-kserve-79fbfbdbf7-hswb7\" (UID: \"7b6639ea-72b0-49fb-b7fa-9443c1ddff6d\") " pod="e2e-models-e2e-worker-w4-f1f016/distinct-w4-f1f016-kserve-79fbfbdbf7-hswb7"
Oct 30 20:05:18.542149 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:18.540985    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7b6639ea-72b0-49fb-b7fa-9443c1ddff6d-home\") pod \"distinct-w4-f1f016-kserve-79fbfbdbf7-hswb7\" (UID: \"7b6639ea-72b0-49fb-b7fa-9443c1ddff6d\") " pod="e2e-models-e2e-worker-w4-f1f016/distinct-w4-f1f016-kserve-79fbfbdbf7-hswb7"
Oct 30 20:05:18.542149 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:18.541028    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7b6639ea-72b0-49fb-b7fa-9443c1ddff6d-tmp-dir\") pod \"distinct-w4-f1f016-kserve-79fbfbdbf7-hswb7\" (UID: \"7b6639ea-72b0-49fb-b7fa-9443c1ddff6d\") " pod="e2e-models-e2e-worker-w4-f1f016/distinct-w4-f1f016-kserve-79fbfbdbf7-hswb7"
Oct 30 20:05:18.542149 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:18.541051    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pnskr\" (UniqueName: \"kubernetes.io/projected/7b6639ea-72b0-49fb-b7fa-9443c1ddff6d-kube-api-access-pnskr\") pod \"distinct-w4-f1f016-kserve-79fbfbdbf7-hswb7\" (UID: \"7b6639ea-72b0-49fb-b7fa-9443c1ddff6d\") " pod="e2e-models-e2e-worker-w4-f1f016/distinct-w4-f1f016-kserve-79fbfbdbf7-hswb7"
Oct 30 20:05:18.542149 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:18.541330    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7b6639ea-72b0-49fb-b7fa-9443c1ddff6d-tls-certs\") pod \"distinct-w4-f1f016-kserve-79fbfbdbf7-hswb7\" (UID: \"7b6639ea-72b0-49fb-b7fa-9443c1ddff6d\") " pod="e2e-models-e2e-worker-w4-f1f016/distinct-w4-f1f016-kserve-79fbfbdbf7-hswb7"
Oct 30 20:05:18.542149 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:18.541374    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7b6639ea-72b0-49fb-b7fa-9443c1ddff6d-dshm\") pod \"distinct-w4-f1f016-kserve-79fbfbdbf7-hswb7\" (UID: \"7b6639ea-72b0-49fb-b7fa-9443c1ddff6d\") " pod="e2e-models-e2e-worker-w4-f1f016/distinct-w4-f1f016-kserve-79fbfbdbf7-hswb7"
Oct 30 20:05:18.562933 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:18.559330    6275 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w5-626870-openshift-default-7cd649d59c-74vj7"
Oct 30 20:05:18.562933 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:18.560603    6275 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w5-626870-openshift-default-7cd649d59c-74vj7"
Oct 30 20:05:18.562933 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:18.561812    6275 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w5-626870-openshift-default-7cd649d59c-74vj7"
Oct 30 20:05:18.642819 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:18.642779    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7b6639ea-72b0-49fb-b7fa-9443c1ddff6d-tls-certs\") pod \"distinct-w4-f1f016-kserve-79fbfbdbf7-hswb7\" (UID: \"7b6639ea-72b0-49fb-b7fa-9443c1ddff6d\") " pod="e2e-models-e2e-worker-w4-f1f016/distinct-w4-f1f016-kserve-79fbfbdbf7-hswb7"
Oct 30 20:05:18.642819 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:18.642824    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7b6639ea-72b0-49fb-b7fa-9443c1ddff6d-dshm\") pod \"distinct-w4-f1f016-kserve-79fbfbdbf7-hswb7\" (UID: \"7b6639ea-72b0-49fb-b7fa-9443c1ddff6d\") " pod="e2e-models-e2e-worker-w4-f1f016/distinct-w4-f1f016-kserve-79fbfbdbf7-hswb7"
Oct 30 20:05:18.643072 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:18.642911    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7b6639ea-72b0-49fb-b7fa-9443c1ddff6d-model-cache\") pod \"distinct-w4-f1f016-kserve-79fbfbdbf7-hswb7\" (UID: \"7b6639ea-72b0-49fb-b7fa-9443c1ddff6d\") " pod="e2e-models-e2e-worker-w4-f1f016/distinct-w4-f1f016-kserve-79fbfbdbf7-hswb7"
Oct 30 20:05:18.643072 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:18.642941    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7b6639ea-72b0-49fb-b7fa-9443c1ddff6d-home\") pod \"distinct-w4-f1f016-kserve-79fbfbdbf7-hswb7\" (UID: \"7b6639ea-72b0-49fb-b7fa-9443c1ddff6d\") " pod="e2e-models-e2e-worker-w4-f1f016/distinct-w4-f1f016-kserve-79fbfbdbf7-hswb7"
Oct 30 20:05:18.643072 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:18.642973    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7b6639ea-72b0-49fb-b7fa-9443c1ddff6d-tmp-dir\") pod \"distinct-w4-f1f016-kserve-79fbfbdbf7-hswb7\" (UID: \"7b6639ea-72b0-49fb-b7fa-9443c1ddff6d\") " pod="e2e-models-e2e-worker-w4-f1f016/distinct-w4-f1f016-kserve-79fbfbdbf7-hswb7"
Oct 30 20:05:18.643072 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:18.642988    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pnskr\" (UniqueName: \"kubernetes.io/projected/7b6639ea-72b0-49fb-b7fa-9443c1ddff6d-kube-api-access-pnskr\") pod \"distinct-w4-f1f016-kserve-79fbfbdbf7-hswb7\" (UID: \"7b6639ea-72b0-49fb-b7fa-9443c1ddff6d\") " pod="e2e-models-e2e-worker-w4-f1f016/distinct-w4-f1f016-kserve-79fbfbdbf7-hswb7"
Oct 30 20:05:18.644575 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:18.644550    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7b6639ea-72b0-49fb-b7fa-9443c1ddff6d-tmp-dir\") pod \"distinct-w4-f1f016-kserve-79fbfbdbf7-hswb7\" (UID: \"7b6639ea-72b0-49fb-b7fa-9443c1ddff6d\") " pod="e2e-models-e2e-worker-w4-f1f016/distinct-w4-f1f016-kserve-79fbfbdbf7-hswb7"
Oct 30 20:05:18.645057 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:18.645028    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7b6639ea-72b0-49fb-b7fa-9443c1ddff6d-home\") pod \"distinct-w4-f1f016-kserve-79fbfbdbf7-hswb7\" (UID: \"7b6639ea-72b0-49fb-b7fa-9443c1ddff6d\") " pod="e2e-models-e2e-worker-w4-f1f016/distinct-w4-f1f016-kserve-79fbfbdbf7-hswb7"
Oct 30 20:05:18.645203 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:18.645183    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7b6639ea-72b0-49fb-b7fa-9443c1ddff6d-model-cache\") pod \"distinct-w4-f1f016-kserve-79fbfbdbf7-hswb7\" (UID: \"7b6639ea-72b0-49fb-b7fa-9443c1ddff6d\") " pod="e2e-models-e2e-worker-w4-f1f016/distinct-w4-f1f016-kserve-79fbfbdbf7-hswb7"
Oct 30 20:05:18.647713 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:18.647690    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7b6639ea-72b0-49fb-b7fa-9443c1ddff6d-tls-certs\") pod \"distinct-w4-f1f016-kserve-79fbfbdbf7-hswb7\" (UID: \"7b6639ea-72b0-49fb-b7fa-9443c1ddff6d\") " pod="e2e-models-e2e-worker-w4-f1f016/distinct-w4-f1f016-kserve-79fbfbdbf7-hswb7"
Oct 30 20:05:18.648846 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:18.648825    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7b6639ea-72b0-49fb-b7fa-9443c1ddff6d-dshm\") pod \"distinct-w4-f1f016-kserve-79fbfbdbf7-hswb7\" (UID: \"7b6639ea-72b0-49fb-b7fa-9443c1ddff6d\") " pod="e2e-models-e2e-worker-w4-f1f016/distinct-w4-f1f016-kserve-79fbfbdbf7-hswb7"
Oct 30 20:05:18.672435 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:18.670976    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pnskr\" (UniqueName: \"kubernetes.io/projected/7b6639ea-72b0-49fb-b7fa-9443c1ddff6d-kube-api-access-pnskr\") pod \"distinct-w4-f1f016-kserve-79fbfbdbf7-hswb7\" (UID: \"7b6639ea-72b0-49fb-b7fa-9443c1ddff6d\") " pod="e2e-models-e2e-worker-w4-f1f016/distinct-w4-f1f016-kserve-79fbfbdbf7-hswb7"
Oct 30 20:05:18.765023 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:18.764991    6275 patch_prober.go:29] interesting pod/e2e-worker-w0-62f4a1-openshift-default-7fc84fbccc-7qzmg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.84:15021/healthz/ready\": dial tcp 10.134.0.84:15021: connect: connection refused" start-of-body=
Oct 30 20:05:18.765306 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:18.765277    6275 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-62f4a1-openshift-default-7fc84fbccc-7qzmg" podUID="555e958d-9abd-41f1-b08a-0db0b32fe79f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.84:15021/healthz/ready\": dial tcp 10.134.0.84:15021: connect: connection refused"
Oct 30 20:05:18.808908 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:18.808396    6275 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-f1f016/distinct-w4-f1f016-kserve-79fbfbdbf7-hswb7"
Oct 30 20:05:18.912188 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:18.912155    6275 patch_prober.go:29] interesting pod/e2e-worker-w1-5f10d2-openshift-default-6c6777d6f5-8zmvq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.85:15021/healthz/ready\": dial tcp 10.134.0.85:15021: connect: connection refused" start-of-body=
Oct 30 20:05:18.912830 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:18.912404    6275 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-5f10d2-openshift-default-6c6777d6f5-8zmvq" podUID="0e4973a9-ead0-4c5f-813c-fa012dc3fade" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.85:15021/healthz/ready\": dial tcp 10.134.0.85:15021: connect: connection refused"
Oct 30 20:05:19.265483 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:19.265447    6275 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-f1f016/distinct-w4-f1f016-kserve-79fbfbdbf7-hswb7"]
Oct 30 20:05:19.746924 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:19.746895    6275 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w0-62f4a1-openshift-default-7fc84fbccc-7qzmg"
Oct 30 20:05:19.747305 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:19.747192    6275 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w0-62f4a1-openshift-default-7fc84fbccc-7qzmg"
Oct 30 20:05:19.747940 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:19.747921    6275 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w0-62f4a1-openshift-default-7fc84fbccc-7qzmg"
Oct 30 20:05:19.823610 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:19.823574    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-f1f016/distinct-w4-f1f016-kserve-79fbfbdbf7-hswb7" event={"ID":"7b6639ea-72b0-49fb-b7fa-9443c1ddff6d","Type":"ContainerStarted","Data":"71e3b30b0a4e9db23c724f202ba676ddc248495f9cb9629afcc0ba3d6b23aa50"}
Oct 30 20:05:19.823610 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:19.823612    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-f1f016/distinct-w4-f1f016-kserve-79fbfbdbf7-hswb7" event={"ID":"7b6639ea-72b0-49fb-b7fa-9443c1ddff6d","Type":"ContainerStarted","Data":"d2a638de4595f4573d145cea701727572b8c7cc503d470c5ee75949e9f2a9605"}
Oct 30 20:05:19.892443 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:19.892364    6275 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w4-f1f016/distinct-w4-f1f016-kserve-79fbfbdbf7-hswb7" podStartSLOduration=1.892343891 podStartE2EDuration="1.892343891s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:05:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:05:19.886983533 +0000 UTC m=+1030.348710396" watchObservedRunningTime="2026-10-30 20:05:19.892343891 +0000 UTC m=+1030.354070755"
Oct 30 20:05:19.917117 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:19.917086    6275 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w1-5f10d2-openshift-default-6c6777d6f5-8zmvq"
Oct 30 20:05:19.917536 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:19.917525    6275 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w1-5f10d2-openshift-default-6c6777d6f5-8zmvq"
Oct 30 20:05:19.918215 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:19.918197    6275 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w1-5f10d2-openshift-default-6c6777d6f5-8zmvq"
Oct 30 20:05:20.813649 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:20.813164    6275 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w4-f1f016/distinct-w4-f1f016-kserve-79fbfbdbf7-hswb7"
Oct 30 20:05:24.375873 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:24.375833    6275 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-ee93db57-hqf8x"]
Oct 30 20:05:24.380164 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:24.380146    6275 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-ee93db57-hqf8x"
Oct 30 20:05:24.408219 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:24.408154    6275 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-ee93db57-hqf8x"]
Oct 30 20:05:24.411542 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:24.411519    6275 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\""
Oct 30 20:05:24.412605 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:24.412585    6275 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-scs2w\""
Oct 30 20:05:24.433602 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:24.433575    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/c4ef2033-aec7-4a1d-adf4-b54c670655b0-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-ee93db57-hqf8x\" (UID: \"c4ef2033-aec7-4a1d-adf4-b54c670655b0\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-ee93db57-hqf8x"
Oct 30 20:05:24.433723 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:24.433627    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vdjmj\" (UniqueName: \"kubernetes.io/projected/c4ef2033-aec7-4a1d-adf4-b54c670655b0-kube-api-access-vdjmj\") pod \"maas-api-revoke-sub-ee93db57-hqf8x\" (UID: \"c4ef2033-aec7-4a1d-adf4-b54c670655b0\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-ee93db57-hqf8x"
Oct 30 20:05:24.433831 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:24.433807    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/c4ef2033-aec7-4a1d-adf4-b54c670655b0-maas-api-xks-ca\") pod \"maas-api-revoke-sub-ee93db57-hqf8x\" (UID: \"c4ef2033-aec7-4a1d-adf4-b54c670655b0\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-ee93db57-hqf8x"
Oct 30 20:05:24.535727 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:24.535694    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/c4ef2033-aec7-4a1d-adf4-b54c670655b0-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-ee93db57-hqf8x\" (UID: \"c4ef2033-aec7-4a1d-adf4-b54c670655b0\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-ee93db57-hqf8x"
Oct 30 20:05:24.535861 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:24.535750    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vdjmj\" (UniqueName: \"kubernetes.io/projected/c4ef2033-aec7-4a1d-adf4-b54c670655b0-kube-api-access-vdjmj\") pod \"maas-api-revoke-sub-ee93db57-hqf8x\" (UID: \"c4ef2033-aec7-4a1d-adf4-b54c670655b0\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-ee93db57-hqf8x"
Oct 30 20:05:24.535861 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:24.535816    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/c4ef2033-aec7-4a1d-adf4-b54c670655b0-maas-api-xks-ca\") pod \"maas-api-revoke-sub-ee93db57-hqf8x\" (UID: \"c4ef2033-aec7-4a1d-adf4-b54c670655b0\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-ee93db57-hqf8x"
Oct 30 20:05:24.536551 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:24.536524    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/c4ef2033-aec7-4a1d-adf4-b54c670655b0-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-ee93db57-hqf8x\" (UID: \"c4ef2033-aec7-4a1d-adf4-b54c670655b0\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-ee93db57-hqf8x"
Oct 30 20:05:24.538462 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:24.538436    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/c4ef2033-aec7-4a1d-adf4-b54c670655b0-maas-api-xks-ca\") pod \"maas-api-revoke-sub-ee93db57-hqf8x\" (UID: \"c4ef2033-aec7-4a1d-adf4-b54c670655b0\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-ee93db57-hqf8x"
Oct 30 20:05:24.562804 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:24.562779    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vdjmj\" (UniqueName: \"kubernetes.io/projected/c4ef2033-aec7-4a1d-adf4-b54c670655b0-kube-api-access-vdjmj\") pod \"maas-api-revoke-sub-ee93db57-hqf8x\" (UID: \"c4ef2033-aec7-4a1d-adf4-b54c670655b0\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-ee93db57-hqf8x"
Oct 30 20:05:24.695902 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:24.695837    6275 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-ee93db57-hqf8x"
Oct 30 20:05:25.013327 ip-10-0-131-26 kubenswrapper[6275]: W1030 20:05:25.013296    6275 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc4ef2033_aec7_4a1d_adf4_b54c670655b0.slice/crio-a1f3caffdfca2e3d4391f1997ab021e5e679a070f1dfa6ab666910aa52cde357 WatchSource:0}: Error finding container a1f3caffdfca2e3d4391f1997ab021e5e679a070f1dfa6ab666910aa52cde357: Status 404 returned error can't find the container with id a1f3caffdfca2e3d4391f1997ab021e5e679a070f1dfa6ab666910aa52cde357
Oct 30 20:05:25.013894 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:25.013874    6275 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-ee93db57-hqf8x"]
Oct 30 20:05:25.641557 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:25.641469    6275 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w1-5f10d2-openshift-default-6c6777d6f5-dj7jb"]
Oct 30 20:05:25.646637 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:25.646615    6275 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-5f10d2-openshift-default-6c6777d6f5-dj7jb"
Oct 30 20:05:25.678844 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:25.677747    6275 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w1-5f10d2-openshift-default-6c6777d6f5-dj7jb"]
Oct 30 20:05:25.750756 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:25.750721    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d41d4ace-e4ec-4c16-abdb-c1dcdecc40e0-istio-envoy\") pod \"e2e-worker-w1-5f10d2-openshift-default-6c6777d6f5-dj7jb\" (UID: \"d41d4ace-e4ec-4c16-abdb-c1dcdecc40e0\") " pod="openshift-ingress/e2e-worker-w1-5f10d2-openshift-default-6c6777d6f5-dj7jb"
Oct 30 20:05:25.750925 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:25.750880    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d41d4ace-e4ec-4c16-abdb-c1dcdecc40e0-workload-certs\") pod \"e2e-worker-w1-5f10d2-openshift-default-6c6777d6f5-dj7jb\" (UID: \"d41d4ace-e4ec-4c16-abdb-c1dcdecc40e0\") " pod="openshift-ingress/e2e-worker-w1-5f10d2-openshift-default-6c6777d6f5-dj7jb"
Oct 30 20:05:25.750925 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:25.750914    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d41d4ace-e4ec-4c16-abdb-c1dcdecc40e0-istio-podinfo\") pod \"e2e-worker-w1-5f10d2-openshift-default-6c6777d6f5-dj7jb\" (UID: \"d41d4ace-e4ec-4c16-abdb-c1dcdecc40e0\") " pod="openshift-ingress/e2e-worker-w1-5f10d2-openshift-default-6c6777d6f5-dj7jb"
Oct 30 20:05:25.751019 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:25.750997    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d41d4ace-e4ec-4c16-abdb-c1dcdecc40e0-credential-socket\") pod \"e2e-worker-w1-5f10d2-openshift-default-6c6777d6f5-dj7jb\" (UID: \"d41d4ace-e4ec-4c16-abdb-c1dcdecc40e0\") " pod="openshift-ingress/e2e-worker-w1-5f10d2-openshift-default-6c6777d6f5-dj7jb"
Oct 30 20:05:25.751096 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:25.751084    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d41d4ace-e4ec-4c16-abdb-c1dcdecc40e0-istio-data\") pod \"e2e-worker-w1-5f10d2-openshift-default-6c6777d6f5-dj7jb\" (UID: \"d41d4ace-e4ec-4c16-abdb-c1dcdecc40e0\") " pod="openshift-ingress/e2e-worker-w1-5f10d2-openshift-default-6c6777d6f5-dj7jb"
Oct 30 20:05:25.751131 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:25.751113    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d41d4ace-e4ec-4c16-abdb-c1dcdecc40e0-istio-token\") pod \"e2e-worker-w1-5f10d2-openshift-default-6c6777d6f5-dj7jb\" (UID: \"d41d4ace-e4ec-4c16-abdb-c1dcdecc40e0\") " pod="openshift-ingress/e2e-worker-w1-5f10d2-openshift-default-6c6777d6f5-dj7jb"
Oct 30 20:05:25.751200 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:25.751189    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d41d4ace-e4ec-4c16-abdb-c1dcdecc40e0-workload-socket\") pod \"e2e-worker-w1-5f10d2-openshift-default-6c6777d6f5-dj7jb\" (UID: \"d41d4ace-e4ec-4c16-abdb-c1dcdecc40e0\") " pod="openshift-ingress/e2e-worker-w1-5f10d2-openshift-default-6c6777d6f5-dj7jb"
Oct 30 20:05:25.751236 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:25.751213    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fbbtd\" (UniqueName: \"kubernetes.io/projected/d41d4ace-e4ec-4c16-abdb-c1dcdecc40e0-kube-api-access-fbbtd\") pod \"e2e-worker-w1-5f10d2-openshift-default-6c6777d6f5-dj7jb\" (UID: \"d41d4ace-e4ec-4c16-abdb-c1dcdecc40e0\") " pod="openshift-ingress/e2e-worker-w1-5f10d2-openshift-default-6c6777d6f5-dj7jb"
Oct 30 20:05:25.751272 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:25.751253    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d41d4ace-e4ec-4c16-abdb-c1dcdecc40e0-istiod-ca-cert\") pod \"e2e-worker-w1-5f10d2-openshift-default-6c6777d6f5-dj7jb\" (UID: \"d41d4ace-e4ec-4c16-abdb-c1dcdecc40e0\") " pod="openshift-ingress/e2e-worker-w1-5f10d2-openshift-default-6c6777d6f5-dj7jb"
Oct 30 20:05:25.852229 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:25.852191    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d41d4ace-e4ec-4c16-abdb-c1dcdecc40e0-istio-podinfo\") pod \"e2e-worker-w1-5f10d2-openshift-default-6c6777d6f5-dj7jb\" (UID: \"d41d4ace-e4ec-4c16-abdb-c1dcdecc40e0\") " pod="openshift-ingress/e2e-worker-w1-5f10d2-openshift-default-6c6777d6f5-dj7jb"
Oct 30 20:05:25.852457 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:25.852245    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d41d4ace-e4ec-4c16-abdb-c1dcdecc40e0-credential-socket\") pod \"e2e-worker-w1-5f10d2-openshift-default-6c6777d6f5-dj7jb\" (UID: \"d41d4ace-e4ec-4c16-abdb-c1dcdecc40e0\") " pod="openshift-ingress/e2e-worker-w1-5f10d2-openshift-default-6c6777d6f5-dj7jb"
Oct 30 20:05:25.852457 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:25.852299    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d41d4ace-e4ec-4c16-abdb-c1dcdecc40e0-istio-data\") pod \"e2e-worker-w1-5f10d2-openshift-default-6c6777d6f5-dj7jb\" (UID: \"d41d4ace-e4ec-4c16-abdb-c1dcdecc40e0\") " pod="openshift-ingress/e2e-worker-w1-5f10d2-openshift-default-6c6777d6f5-dj7jb"
Oct 30 20:05:25.852457 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:25.852323    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d41d4ace-e4ec-4c16-abdb-c1dcdecc40e0-istio-token\") pod \"e2e-worker-w1-5f10d2-openshift-default-6c6777d6f5-dj7jb\" (UID: \"d41d4ace-e4ec-4c16-abdb-c1dcdecc40e0\") " pod="openshift-ingress/e2e-worker-w1-5f10d2-openshift-default-6c6777d6f5-dj7jb"
Oct 30 20:05:25.852457 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:25.852388    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d41d4ace-e4ec-4c16-abdb-c1dcdecc40e0-workload-socket\") pod \"e2e-worker-w1-5f10d2-openshift-default-6c6777d6f5-dj7jb\" (UID: \"d41d4ace-e4ec-4c16-abdb-c1dcdecc40e0\") " pod="openshift-ingress/e2e-worker-w1-5f10d2-openshift-default-6c6777d6f5-dj7jb"
Oct 30 20:05:25.852457 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:25.852427    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fbbtd\" (UniqueName: \"kubernetes.io/projected/d41d4ace-e4ec-4c16-abdb-c1dcdecc40e0-kube-api-access-fbbtd\") pod \"e2e-worker-w1-5f10d2-openshift-default-6c6777d6f5-dj7jb\" (UID: \"d41d4ace-e4ec-4c16-abdb-c1dcdecc40e0\") " pod="openshift-ingress/e2e-worker-w1-5f10d2-openshift-default-6c6777d6f5-dj7jb"
Oct 30 20:05:25.852755 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:25.852486    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d41d4ace-e4ec-4c16-abdb-c1dcdecc40e0-istiod-ca-cert\") pod \"e2e-worker-w1-5f10d2-openshift-default-6c6777d6f5-dj7jb\" (UID: \"d41d4ace-e4ec-4c16-abdb-c1dcdecc40e0\") " pod="openshift-ingress/e2e-worker-w1-5f10d2-openshift-default-6c6777d6f5-dj7jb"
Oct 30 20:05:25.852755 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:25.852528    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d41d4ace-e4ec-4c16-abdb-c1dcdecc40e0-istio-envoy\") pod \"e2e-worker-w1-5f10d2-openshift-default-6c6777d6f5-dj7jb\" (UID: \"d41d4ace-e4ec-4c16-abdb-c1dcdecc40e0\") " pod="openshift-ingress/e2e-worker-w1-5f10d2-openshift-default-6c6777d6f5-dj7jb"
Oct 30 20:05:25.852755 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:25.852649    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d41d4ace-e4ec-4c16-abdb-c1dcdecc40e0-workload-certs\") pod \"e2e-worker-w1-5f10d2-openshift-default-6c6777d6f5-dj7jb\" (UID: \"d41d4ace-e4ec-4c16-abdb-c1dcdecc40e0\") " pod="openshift-ingress/e2e-worker-w1-5f10d2-openshift-default-6c6777d6f5-dj7jb"
Oct 30 20:05:25.852872 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:25.852849    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d41d4ace-e4ec-4c16-abdb-c1dcdecc40e0-workload-socket\") pod \"e2e-worker-w1-5f10d2-openshift-default-6c6777d6f5-dj7jb\" (UID: \"d41d4ace-e4ec-4c16-abdb-c1dcdecc40e0\") " pod="openshift-ingress/e2e-worker-w1-5f10d2-openshift-default-6c6777d6f5-dj7jb"
Oct 30 20:05:25.853069 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:25.853045    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d41d4ace-e4ec-4c16-abdb-c1dcdecc40e0-istio-data\") pod \"e2e-worker-w1-5f10d2-openshift-default-6c6777d6f5-dj7jb\" (UID: \"d41d4ace-e4ec-4c16-abdb-c1dcdecc40e0\") " pod="openshift-ingress/e2e-worker-w1-5f10d2-openshift-default-6c6777d6f5-dj7jb"
Oct 30 20:05:25.853291 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:25.853273    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d41d4ace-e4ec-4c16-abdb-c1dcdecc40e0-workload-certs\") pod \"e2e-worker-w1-5f10d2-openshift-default-6c6777d6f5-dj7jb\" (UID: \"d41d4ace-e4ec-4c16-abdb-c1dcdecc40e0\") " pod="openshift-ingress/e2e-worker-w1-5f10d2-openshift-default-6c6777d6f5-dj7jb"
Oct 30 20:05:25.853454 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:25.853397    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d41d4ace-e4ec-4c16-abdb-c1dcdecc40e0-istiod-ca-cert\") pod \"e2e-worker-w1-5f10d2-openshift-default-6c6777d6f5-dj7jb\" (UID: \"d41d4ace-e4ec-4c16-abdb-c1dcdecc40e0\") " pod="openshift-ingress/e2e-worker-w1-5f10d2-openshift-default-6c6777d6f5-dj7jb"
Oct 30 20:05:25.853812 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:25.853783    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d41d4ace-e4ec-4c16-abdb-c1dcdecc40e0-credential-socket\") pod \"e2e-worker-w1-5f10d2-openshift-default-6c6777d6f5-dj7jb\" (UID: \"d41d4ace-e4ec-4c16-abdb-c1dcdecc40e0\") " pod="openshift-ingress/e2e-worker-w1-5f10d2-openshift-default-6c6777d6f5-dj7jb"
Oct 30 20:05:25.854883 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:25.854856    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d41d4ace-e4ec-4c16-abdb-c1dcdecc40e0-istio-envoy\") pod \"e2e-worker-w1-5f10d2-openshift-default-6c6777d6f5-dj7jb\" (UID: \"d41d4ace-e4ec-4c16-abdb-c1dcdecc40e0\") " pod="openshift-ingress/e2e-worker-w1-5f10d2-openshift-default-6c6777d6f5-dj7jb"
Oct 30 20:05:25.855025 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:25.855009    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d41d4ace-e4ec-4c16-abdb-c1dcdecc40e0-istio-podinfo\") pod \"e2e-worker-w1-5f10d2-openshift-default-6c6777d6f5-dj7jb\" (UID: \"d41d4ace-e4ec-4c16-abdb-c1dcdecc40e0\") " pod="openshift-ingress/e2e-worker-w1-5f10d2-openshift-default-6c6777d6f5-dj7jb"
Oct 30 20:05:25.855072 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:25.855042    6275 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w6-51dd62-openshift-default-7954bd8797-jjfwb"]
Oct 30 20:05:25.860440 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:25.860423    6275 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-51dd62-openshift-default-7954bd8797-jjfwb"
Oct 30 20:05:25.873201 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:25.873174    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-ee93db57-hqf8x" event={"ID":"c4ef2033-aec7-4a1d-adf4-b54c670655b0","Type":"ContainerStarted","Data":"d989f5d11bc6d0d36019494128c9297505051dbe54dd89b845550a9605ca7352"}
Oct 30 20:05:25.873319 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:25.873220    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-ee93db57-hqf8x" event={"ID":"c4ef2033-aec7-4a1d-adf4-b54c670655b0","Type":"ContainerStarted","Data":"a1f3caffdfca2e3d4391f1997ab021e5e679a070f1dfa6ab666910aa52cde357"}
Oct 30 20:05:25.885650 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:25.885611    6275 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w6-51dd62-openshift-default-7954bd8797-jjfwb"]
Oct 30 20:05:25.887963 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:25.887939    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d41d4ace-e4ec-4c16-abdb-c1dcdecc40e0-istio-token\") pod \"e2e-worker-w1-5f10d2-openshift-default-6c6777d6f5-dj7jb\" (UID: \"d41d4ace-e4ec-4c16-abdb-c1dcdecc40e0\") " pod="openshift-ingress/e2e-worker-w1-5f10d2-openshift-default-6c6777d6f5-dj7jb"
Oct 30 20:05:25.888117 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:25.888097    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fbbtd\" (UniqueName: \"kubernetes.io/projected/d41d4ace-e4ec-4c16-abdb-c1dcdecc40e0-kube-api-access-fbbtd\") pod \"e2e-worker-w1-5f10d2-openshift-default-6c6777d6f5-dj7jb\" (UID: \"d41d4ace-e4ec-4c16-abdb-c1dcdecc40e0\") " pod="openshift-ingress/e2e-worker-w1-5f10d2-openshift-default-6c6777d6f5-dj7jb"
Oct 30 20:05:25.953787 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:25.953756    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g4sdd\" (UniqueName: \"kubernetes.io/projected/e06b5b8f-8e8e-4568-9f30-1997b0bd259e-kube-api-access-g4sdd\") pod \"e2e-worker-w6-51dd62-openshift-default-7954bd8797-jjfwb\" (UID: \"e06b5b8f-8e8e-4568-9f30-1997b0bd259e\") " pod="openshift-ingress/e2e-worker-w6-51dd62-openshift-default-7954bd8797-jjfwb"
Oct 30 20:05:25.953986 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:25.953948    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e06b5b8f-8e8e-4568-9f30-1997b0bd259e-workload-socket\") pod \"e2e-worker-w6-51dd62-openshift-default-7954bd8797-jjfwb\" (UID: \"e06b5b8f-8e8e-4568-9f30-1997b0bd259e\") " pod="openshift-ingress/e2e-worker-w6-51dd62-openshift-default-7954bd8797-jjfwb"
Oct 30 20:05:25.954110 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:25.954061    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e06b5b8f-8e8e-4568-9f30-1997b0bd259e-istio-data\") pod \"e2e-worker-w6-51dd62-openshift-default-7954bd8797-jjfwb\" (UID: \"e06b5b8f-8e8e-4568-9f30-1997b0bd259e\") " pod="openshift-ingress/e2e-worker-w6-51dd62-openshift-default-7954bd8797-jjfwb"
Oct 30 20:05:25.954158 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:25.954145    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e06b5b8f-8e8e-4568-9f30-1997b0bd259e-credential-socket\") pod \"e2e-worker-w6-51dd62-openshift-default-7954bd8797-jjfwb\" (UID: \"e06b5b8f-8e8e-4568-9f30-1997b0bd259e\") " pod="openshift-ingress/e2e-worker-w6-51dd62-openshift-default-7954bd8797-jjfwb"
Oct 30 20:05:25.954194 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:25.954162    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e06b5b8f-8e8e-4568-9f30-1997b0bd259e-istio-token\") pod \"e2e-worker-w6-51dd62-openshift-default-7954bd8797-jjfwb\" (UID: \"e06b5b8f-8e8e-4568-9f30-1997b0bd259e\") " pod="openshift-ingress/e2e-worker-w6-51dd62-openshift-default-7954bd8797-jjfwb"
Oct 30 20:05:25.954194 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:25.954180    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e06b5b8f-8e8e-4568-9f30-1997b0bd259e-istio-envoy\") pod \"e2e-worker-w6-51dd62-openshift-default-7954bd8797-jjfwb\" (UID: \"e06b5b8f-8e8e-4568-9f30-1997b0bd259e\") " pod="openshift-ingress/e2e-worker-w6-51dd62-openshift-default-7954bd8797-jjfwb"
Oct 30 20:05:25.954263 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:25.954247    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e06b5b8f-8e8e-4568-9f30-1997b0bd259e-istio-podinfo\") pod \"e2e-worker-w6-51dd62-openshift-default-7954bd8797-jjfwb\" (UID: \"e06b5b8f-8e8e-4568-9f30-1997b0bd259e\") " pod="openshift-ingress/e2e-worker-w6-51dd62-openshift-default-7954bd8797-jjfwb"
Oct 30 20:05:25.954312 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:25.954294    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e06b5b8f-8e8e-4568-9f30-1997b0bd259e-workload-certs\") pod \"e2e-worker-w6-51dd62-openshift-default-7954bd8797-jjfwb\" (UID: \"e06b5b8f-8e8e-4568-9f30-1997b0bd259e\") " pod="openshift-ingress/e2e-worker-w6-51dd62-openshift-default-7954bd8797-jjfwb"
Oct 30 20:05:25.954374 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:25.954354    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e06b5b8f-8e8e-4568-9f30-1997b0bd259e-istiod-ca-cert\") pod \"e2e-worker-w6-51dd62-openshift-default-7954bd8797-jjfwb\" (UID: \"e06b5b8f-8e8e-4568-9f30-1997b0bd259e\") " pod="openshift-ingress/e2e-worker-w6-51dd62-openshift-default-7954bd8797-jjfwb"
Oct 30 20:05:25.967270 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:25.967228    6275 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-sub-ee93db57-hqf8x" podStartSLOduration=1.967216919 podStartE2EDuration="1.967216919s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:05:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:05:25.963002406 +0000 UTC m=+1036.424729271" watchObservedRunningTime="2026-10-30 20:05:25.967216919 +0000 UTC m=+1036.428943782"
Oct 30 20:05:25.982068 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:25.982042    6275 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-5f10d2-openshift-default-6c6777d6f5-dj7jb"
Oct 30 20:05:26.056687 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:26.056653    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g4sdd\" (UniqueName: \"kubernetes.io/projected/e06b5b8f-8e8e-4568-9f30-1997b0bd259e-kube-api-access-g4sdd\") pod \"e2e-worker-w6-51dd62-openshift-default-7954bd8797-jjfwb\" (UID: \"e06b5b8f-8e8e-4568-9f30-1997b0bd259e\") " pod="openshift-ingress/e2e-worker-w6-51dd62-openshift-default-7954bd8797-jjfwb"
Oct 30 20:05:26.056798 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:26.056765    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e06b5b8f-8e8e-4568-9f30-1997b0bd259e-workload-socket\") pod \"e2e-worker-w6-51dd62-openshift-default-7954bd8797-jjfwb\" (UID: \"e06b5b8f-8e8e-4568-9f30-1997b0bd259e\") " pod="openshift-ingress/e2e-worker-w6-51dd62-openshift-default-7954bd8797-jjfwb"
Oct 30 20:05:26.056848 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:26.056812    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e06b5b8f-8e8e-4568-9f30-1997b0bd259e-istio-data\") pod \"e2e-worker-w6-51dd62-openshift-default-7954bd8797-jjfwb\" (UID: \"e06b5b8f-8e8e-4568-9f30-1997b0bd259e\") " pod="openshift-ingress/e2e-worker-w6-51dd62-openshift-default-7954bd8797-jjfwb"
Oct 30 20:05:26.056946 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:26.056915    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e06b5b8f-8e8e-4568-9f30-1997b0bd259e-credential-socket\") pod \"e2e-worker-w6-51dd62-openshift-default-7954bd8797-jjfwb\" (UID: \"e06b5b8f-8e8e-4568-9f30-1997b0bd259e\") " pod="openshift-ingress/e2e-worker-w6-51dd62-openshift-default-7954bd8797-jjfwb"
Oct 30 20:05:26.057008 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:26.056958    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e06b5b8f-8e8e-4568-9f30-1997b0bd259e-istio-token\") pod \"e2e-worker-w6-51dd62-openshift-default-7954bd8797-jjfwb\" (UID: \"e06b5b8f-8e8e-4568-9f30-1997b0bd259e\") " pod="openshift-ingress/e2e-worker-w6-51dd62-openshift-default-7954bd8797-jjfwb"
Oct 30 20:05:26.057008 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:26.056986    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e06b5b8f-8e8e-4568-9f30-1997b0bd259e-istio-envoy\") pod \"e2e-worker-w6-51dd62-openshift-default-7954bd8797-jjfwb\" (UID: \"e06b5b8f-8e8e-4568-9f30-1997b0bd259e\") " pod="openshift-ingress/e2e-worker-w6-51dd62-openshift-default-7954bd8797-jjfwb"
Oct 30 20:05:26.057100 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:26.057031    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e06b5b8f-8e8e-4568-9f30-1997b0bd259e-istio-podinfo\") pod \"e2e-worker-w6-51dd62-openshift-default-7954bd8797-jjfwb\" (UID: \"e06b5b8f-8e8e-4568-9f30-1997b0bd259e\") " pod="openshift-ingress/e2e-worker-w6-51dd62-openshift-default-7954bd8797-jjfwb"
Oct 30 20:05:26.057100 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:26.057070    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e06b5b8f-8e8e-4568-9f30-1997b0bd259e-workload-certs\") pod \"e2e-worker-w6-51dd62-openshift-default-7954bd8797-jjfwb\" (UID: \"e06b5b8f-8e8e-4568-9f30-1997b0bd259e\") " pod="openshift-ingress/e2e-worker-w6-51dd62-openshift-default-7954bd8797-jjfwb"
Oct 30 20:05:26.057195 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:26.057124    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e06b5b8f-8e8e-4568-9f30-1997b0bd259e-istiod-ca-cert\") pod \"e2e-worker-w6-51dd62-openshift-default-7954bd8797-jjfwb\" (UID: \"e06b5b8f-8e8e-4568-9f30-1997b0bd259e\") " pod="openshift-ingress/e2e-worker-w6-51dd62-openshift-default-7954bd8797-jjfwb"
Oct 30 20:05:26.057622 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:26.057594    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e06b5b8f-8e8e-4568-9f30-1997b0bd259e-credential-socket\") pod \"e2e-worker-w6-51dd62-openshift-default-7954bd8797-jjfwb\" (UID: \"e06b5b8f-8e8e-4568-9f30-1997b0bd259e\") " pod="openshift-ingress/e2e-worker-w6-51dd62-openshift-default-7954bd8797-jjfwb"
Oct 30 20:05:26.058186 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:26.058157    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e06b5b8f-8e8e-4568-9f30-1997b0bd259e-workload-socket\") pod \"e2e-worker-w6-51dd62-openshift-default-7954bd8797-jjfwb\" (UID: \"e06b5b8f-8e8e-4568-9f30-1997b0bd259e\") " pod="openshift-ingress/e2e-worker-w6-51dd62-openshift-default-7954bd8797-jjfwb"
Oct 30 20:05:26.058509 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:26.058441    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e06b5b8f-8e8e-4568-9f30-1997b0bd259e-istio-data\") pod \"e2e-worker-w6-51dd62-openshift-default-7954bd8797-jjfwb\" (UID: \"e06b5b8f-8e8e-4568-9f30-1997b0bd259e\") " pod="openshift-ingress/e2e-worker-w6-51dd62-openshift-default-7954bd8797-jjfwb"
Oct 30 20:05:26.058657 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:26.058633    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e06b5b8f-8e8e-4568-9f30-1997b0bd259e-workload-certs\") pod \"e2e-worker-w6-51dd62-openshift-default-7954bd8797-jjfwb\" (UID: \"e06b5b8f-8e8e-4568-9f30-1997b0bd259e\") " pod="openshift-ingress/e2e-worker-w6-51dd62-openshift-default-7954bd8797-jjfwb"
Oct 30 20:05:26.059827 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:26.059803    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e06b5b8f-8e8e-4568-9f30-1997b0bd259e-istio-envoy\") pod \"e2e-worker-w6-51dd62-openshift-default-7954bd8797-jjfwb\" (UID: \"e06b5b8f-8e8e-4568-9f30-1997b0bd259e\") " pod="openshift-ingress/e2e-worker-w6-51dd62-openshift-default-7954bd8797-jjfwb"
Oct 30 20:05:26.061987 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:26.061963    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e06b5b8f-8e8e-4568-9f30-1997b0bd259e-istiod-ca-cert\") pod \"e2e-worker-w6-51dd62-openshift-default-7954bd8797-jjfwb\" (UID: \"e06b5b8f-8e8e-4568-9f30-1997b0bd259e\") " pod="openshift-ingress/e2e-worker-w6-51dd62-openshift-default-7954bd8797-jjfwb"
Oct 30 20:05:26.063489 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:26.063463    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e06b5b8f-8e8e-4568-9f30-1997b0bd259e-istio-podinfo\") pod \"e2e-worker-w6-51dd62-openshift-default-7954bd8797-jjfwb\" (UID: \"e06b5b8f-8e8e-4568-9f30-1997b0bd259e\") " pod="openshift-ingress/e2e-worker-w6-51dd62-openshift-default-7954bd8797-jjfwb"
Oct 30 20:05:26.083718 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:26.083692    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g4sdd\" (UniqueName: \"kubernetes.io/projected/e06b5b8f-8e8e-4568-9f30-1997b0bd259e-kube-api-access-g4sdd\") pod \"e2e-worker-w6-51dd62-openshift-default-7954bd8797-jjfwb\" (UID: \"e06b5b8f-8e8e-4568-9f30-1997b0bd259e\") " pod="openshift-ingress/e2e-worker-w6-51dd62-openshift-default-7954bd8797-jjfwb"
Oct 30 20:05:26.084139 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:26.084115    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e06b5b8f-8e8e-4568-9f30-1997b0bd259e-istio-token\") pod \"e2e-worker-w6-51dd62-openshift-default-7954bd8797-jjfwb\" (UID: \"e06b5b8f-8e8e-4568-9f30-1997b0bd259e\") " pod="openshift-ingress/e2e-worker-w6-51dd62-openshift-default-7954bd8797-jjfwb"
Oct 30 20:05:26.224966 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:26.224888    6275 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-51dd62-openshift-default-7954bd8797-jjfwb"
Oct 30 20:05:26.257545 ip-10-0-131-26 kubenswrapper[6275]: E1030 20:05:26.257507    6275 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-fwc77" containerName="extractor"
Oct 30 20:05:26.313157 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:26.313125    6275 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w1-5f10d2-openshift-default-6c6777d6f5-dj7jb"]
Oct 30 20:05:26.314384 ip-10-0-131-26 kubenswrapper[6275]: W1030 20:05:26.314355    6275 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd41d4ace_e4ec_4c16_abdb_c1dcdecc40e0.slice/crio-194e1c93a3d83ff21a562efa5eca93fb04d72d375defbae41c8bd705ad278297 WatchSource:0}: Error finding container 194e1c93a3d83ff21a562efa5eca93fb04d72d375defbae41c8bd705ad278297: Status 404 returned error can't find the container with id 194e1c93a3d83ff21a562efa5eca93fb04d72d375defbae41c8bd705ad278297
Oct 30 20:05:26.317379 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:26.317340    6275 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Oct 30 20:05:26.317502 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:26.317469    6275 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Oct 30 20:05:26.317547 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:26.317514    6275 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Oct 30 20:05:26.547131 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:26.547102    6275 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w6-51dd62-openshift-default-7954bd8797-jjfwb"]
Oct 30 20:05:26.548793 ip-10-0-131-26 kubenswrapper[6275]: W1030 20:05:26.548758    6275 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode06b5b8f_8e8e_4568_9f30_1997b0bd259e.slice/crio-00729e8a10671b695dd2785d822942dcabb6eea16cde9af83be32e962f70a18c WatchSource:0}: Error finding container 00729e8a10671b695dd2785d822942dcabb6eea16cde9af83be32e962f70a18c: Status 404 returned error can't find the container with id 00729e8a10671b695dd2785d822942dcabb6eea16cde9af83be32e962f70a18c
Oct 30 20:05:26.552022 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:26.551981    6275 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Oct 30 20:05:26.552124 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:26.552071    6275 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Oct 30 20:05:26.552186 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:26.552118    6275 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Oct 30 20:05:26.884010 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:26.883919    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-5f10d2-openshift-default-6c6777d6f5-dj7jb" event={"ID":"d41d4ace-e4ec-4c16-abdb-c1dcdecc40e0","Type":"ContainerStarted","Data":"33abf82c2490167788c4a794c719a4e4aff8a68c802e5c8b0fe4e6982cc56463"}
Oct 30 20:05:26.884010 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:26.883987    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-5f10d2-openshift-default-6c6777d6f5-dj7jb" event={"ID":"d41d4ace-e4ec-4c16-abdb-c1dcdecc40e0","Type":"ContainerStarted","Data":"194e1c93a3d83ff21a562efa5eca93fb04d72d375defbae41c8bd705ad278297"}
Oct 30 20:05:26.885799 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:26.885727    6275 generic.go:356] "Generic (PLEG): container finished" podID="c4ef2033-aec7-4a1d-adf4-b54c670655b0" containerID="d989f5d11bc6d0d36019494128c9297505051dbe54dd89b845550a9605ca7352" exitCode=0
Oct 30 20:05:26.885799 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:26.885759    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-ee93db57-hqf8x" event={"ID":"c4ef2033-aec7-4a1d-adf4-b54c670655b0","Type":"ContainerDied","Data":"d989f5d11bc6d0d36019494128c9297505051dbe54dd89b845550a9605ca7352"}
Oct 30 20:05:26.887728 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:26.887691    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-51dd62-openshift-default-7954bd8797-jjfwb" event={"ID":"e06b5b8f-8e8e-4568-9f30-1997b0bd259e","Type":"ContainerStarted","Data":"5c204f70a2983d1f175a0fbf744e39120e84e9a0858c191b18404710dd449610"}
Oct 30 20:05:26.887834 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:26.887740    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-51dd62-openshift-default-7954bd8797-jjfwb" event={"ID":"e06b5b8f-8e8e-4568-9f30-1997b0bd259e","Type":"ContainerStarted","Data":"00729e8a10671b695dd2785d822942dcabb6eea16cde9af83be32e962f70a18c"}
Oct 30 20:05:26.936941 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:26.936894    6275 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w1-5f10d2-openshift-default-6c6777d6f5-dj7jb" podStartSLOduration=1.93688098 podStartE2EDuration="1.93688098s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:05:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:05:26.935244298 +0000 UTC m=+1037.396971160" watchObservedRunningTime="2026-10-30 20:05:26.93688098 +0000 UTC m=+1037.398607843"
Oct 30 20:05:26.959426 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:26.959379    6275 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w5-626870/distinct-2-w5-626870-kserve-98bfb9b98-xz6xj"]
Oct 30 20:05:26.964864 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:26.964832    6275 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w5-626870/distinct-2-w5-626870-kserve-98bfb9b98-xz6xj"
Oct 30 20:05:26.982592 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:26.982563    6275 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w1-5f10d2-openshift-default-6c6777d6f5-dj7jb"
Oct 30 20:05:26.985635 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:26.985607    6275 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w5-626870\"/\"distinct-2-w5-626870-kserve-self-signed-certs\""
Oct 30 20:05:26.989086 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:26.989060    6275 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w5-626870/distinct-2-w5-626870-kserve-98bfb9b98-xz6xj"]
Oct 30 20:05:27.036425 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:27.036363    6275 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w6-51dd62-openshift-default-7954bd8797-jjfwb" podStartSLOduration=2.036348771 podStartE2EDuration="2.036348771s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:05:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:05:27.031842393 +0000 UTC m=+1037.493569259" watchObservedRunningTime="2026-10-30 20:05:27.036348771 +0000 UTC m=+1037.498075627"
Oct 30 20:05:27.118750 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:27.118711    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8r5vf\" (UniqueName: \"kubernetes.io/projected/7d49f1ad-8805-4090-8e72-7d828fa73f36-kube-api-access-8r5vf\") pod \"distinct-2-w5-626870-kserve-98bfb9b98-xz6xj\" (UID: \"7d49f1ad-8805-4090-8e72-7d828fa73f36\") " pod="e2e-models-e2e-worker-w5-626870/distinct-2-w5-626870-kserve-98bfb9b98-xz6xj"
Oct 30 20:05:27.118950 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:27.118869    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7d49f1ad-8805-4090-8e72-7d828fa73f36-model-cache\") pod \"distinct-2-w5-626870-kserve-98bfb9b98-xz6xj\" (UID: \"7d49f1ad-8805-4090-8e72-7d828fa73f36\") " pod="e2e-models-e2e-worker-w5-626870/distinct-2-w5-626870-kserve-98bfb9b98-xz6xj"
Oct 30 20:05:27.118950 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:27.118900    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7d49f1ad-8805-4090-8e72-7d828fa73f36-tmp-dir\") pod \"distinct-2-w5-626870-kserve-98bfb9b98-xz6xj\" (UID: \"7d49f1ad-8805-4090-8e72-7d828fa73f36\") " pod="e2e-models-e2e-worker-w5-626870/distinct-2-w5-626870-kserve-98bfb9b98-xz6xj"
Oct 30 20:05:27.118950 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:27.118946    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7d49f1ad-8805-4090-8e72-7d828fa73f36-tls-certs\") pod \"distinct-2-w5-626870-kserve-98bfb9b98-xz6xj\" (UID: \"7d49f1ad-8805-4090-8e72-7d828fa73f36\") " pod="e2e-models-e2e-worker-w5-626870/distinct-2-w5-626870-kserve-98bfb9b98-xz6xj"
Oct 30 20:05:27.119129 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:27.119054    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7d49f1ad-8805-4090-8e72-7d828fa73f36-dshm\") pod \"distinct-2-w5-626870-kserve-98bfb9b98-xz6xj\" (UID: \"7d49f1ad-8805-4090-8e72-7d828fa73f36\") " pod="e2e-models-e2e-worker-w5-626870/distinct-2-w5-626870-kserve-98bfb9b98-xz6xj"
Oct 30 20:05:27.119129 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:27.119074    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7d49f1ad-8805-4090-8e72-7d828fa73f36-home\") pod \"distinct-2-w5-626870-kserve-98bfb9b98-xz6xj\" (UID: \"7d49f1ad-8805-4090-8e72-7d828fa73f36\") " pod="e2e-models-e2e-worker-w5-626870/distinct-2-w5-626870-kserve-98bfb9b98-xz6xj"
Oct 30 20:05:27.225902 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:27.225773    6275 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w6-51dd62-openshift-default-7954bd8797-jjfwb"
Oct 30 20:05:27.227928 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:27.226946    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7d49f1ad-8805-4090-8e72-7d828fa73f36-dshm\") pod \"distinct-2-w5-626870-kserve-98bfb9b98-xz6xj\" (UID: \"7d49f1ad-8805-4090-8e72-7d828fa73f36\") " pod="e2e-models-e2e-worker-w5-626870/distinct-2-w5-626870-kserve-98bfb9b98-xz6xj"
Oct 30 20:05:27.227928 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:27.226995    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7d49f1ad-8805-4090-8e72-7d828fa73f36-home\") pod \"distinct-2-w5-626870-kserve-98bfb9b98-xz6xj\" (UID: \"7d49f1ad-8805-4090-8e72-7d828fa73f36\") " pod="e2e-models-e2e-worker-w5-626870/distinct-2-w5-626870-kserve-98bfb9b98-xz6xj"
Oct 30 20:05:27.227928 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:27.227032    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8r5vf\" (UniqueName: \"kubernetes.io/projected/7d49f1ad-8805-4090-8e72-7d828fa73f36-kube-api-access-8r5vf\") pod \"distinct-2-w5-626870-kserve-98bfb9b98-xz6xj\" (UID: \"7d49f1ad-8805-4090-8e72-7d828fa73f36\") " pod="e2e-models-e2e-worker-w5-626870/distinct-2-w5-626870-kserve-98bfb9b98-xz6xj"
Oct 30 20:05:27.227928 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:27.227171    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7d49f1ad-8805-4090-8e72-7d828fa73f36-model-cache\") pod \"distinct-2-w5-626870-kserve-98bfb9b98-xz6xj\" (UID: \"7d49f1ad-8805-4090-8e72-7d828fa73f36\") " pod="e2e-models-e2e-worker-w5-626870/distinct-2-w5-626870-kserve-98bfb9b98-xz6xj"
Oct 30 20:05:27.227928 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:27.227209    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7d49f1ad-8805-4090-8e72-7d828fa73f36-tmp-dir\") pod \"distinct-2-w5-626870-kserve-98bfb9b98-xz6xj\" (UID: \"7d49f1ad-8805-4090-8e72-7d828fa73f36\") " pod="e2e-models-e2e-worker-w5-626870/distinct-2-w5-626870-kserve-98bfb9b98-xz6xj"
Oct 30 20:05:27.227928 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:27.227280    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7d49f1ad-8805-4090-8e72-7d828fa73f36-tls-certs\") pod \"distinct-2-w5-626870-kserve-98bfb9b98-xz6xj\" (UID: \"7d49f1ad-8805-4090-8e72-7d828fa73f36\") " pod="e2e-models-e2e-worker-w5-626870/distinct-2-w5-626870-kserve-98bfb9b98-xz6xj"
Oct 30 20:05:27.229279 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:27.229252    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7d49f1ad-8805-4090-8e72-7d828fa73f36-model-cache\") pod \"distinct-2-w5-626870-kserve-98bfb9b98-xz6xj\" (UID: \"7d49f1ad-8805-4090-8e72-7d828fa73f36\") " pod="e2e-models-e2e-worker-w5-626870/distinct-2-w5-626870-kserve-98bfb9b98-xz6xj"
Oct 30 20:05:27.229712 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:27.229687    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7d49f1ad-8805-4090-8e72-7d828fa73f36-tmp-dir\") pod \"distinct-2-w5-626870-kserve-98bfb9b98-xz6xj\" (UID: \"7d49f1ad-8805-4090-8e72-7d828fa73f36\") " pod="e2e-models-e2e-worker-w5-626870/distinct-2-w5-626870-kserve-98bfb9b98-xz6xj"
Oct 30 20:05:27.230112 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:27.230092    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7d49f1ad-8805-4090-8e72-7d828fa73f36-home\") pod \"distinct-2-w5-626870-kserve-98bfb9b98-xz6xj\" (UID: \"7d49f1ad-8805-4090-8e72-7d828fa73f36\") " pod="e2e-models-e2e-worker-w5-626870/distinct-2-w5-626870-kserve-98bfb9b98-xz6xj"
Oct 30 20:05:27.230978 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:27.230954    6275 patch_prober.go:29] interesting pod/e2e-worker-w6-51dd62-openshift-default-7954bd8797-jjfwb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.89:15021/healthz/ready\": dial tcp 10.134.0.89:15021: connect: connection refused" start-of-body=
Oct 30 20:05:27.231138 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:27.231114    6275 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-51dd62-openshift-default-7954bd8797-jjfwb" podUID="e06b5b8f-8e8e-4568-9f30-1997b0bd259e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.89:15021/healthz/ready\": dial tcp 10.134.0.89:15021: connect: connection refused"
Oct 30 20:05:27.265938 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:27.264778    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7d49f1ad-8805-4090-8e72-7d828fa73f36-dshm\") pod \"distinct-2-w5-626870-kserve-98bfb9b98-xz6xj\" (UID: \"7d49f1ad-8805-4090-8e72-7d828fa73f36\") " pod="e2e-models-e2e-worker-w5-626870/distinct-2-w5-626870-kserve-98bfb9b98-xz6xj"
Oct 30 20:05:27.279563 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:27.279525    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8r5vf\" (UniqueName: \"kubernetes.io/projected/7d49f1ad-8805-4090-8e72-7d828fa73f36-kube-api-access-8r5vf\") pod \"distinct-2-w5-626870-kserve-98bfb9b98-xz6xj\" (UID: \"7d49f1ad-8805-4090-8e72-7d828fa73f36\") " pod="e2e-models-e2e-worker-w5-626870/distinct-2-w5-626870-kserve-98bfb9b98-xz6xj"
Oct 30 20:05:27.299545 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:27.297205    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7d49f1ad-8805-4090-8e72-7d828fa73f36-tls-certs\") pod \"distinct-2-w5-626870-kserve-98bfb9b98-xz6xj\" (UID: \"7d49f1ad-8805-4090-8e72-7d828fa73f36\") " pod="e2e-models-e2e-worker-w5-626870/distinct-2-w5-626870-kserve-98bfb9b98-xz6xj"
Oct 30 20:05:27.603446 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:27.595478    6275 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w5-626870/distinct-2-w5-626870-kserve-98bfb9b98-xz6xj"
Oct 30 20:05:28.013932 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:28.013576    6275 patch_prober.go:29] interesting pod/e2e-worker-w1-5f10d2-openshift-default-6c6777d6f5-dj7jb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.88:15021/healthz/ready\": dial tcp 10.134.0.88:15021: connect: connection refused" start-of-body=
Oct 30 20:05:28.013932 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:28.013641    6275 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-5f10d2-openshift-default-6c6777d6f5-dj7jb" podUID="d41d4ace-e4ec-4c16-abdb-c1dcdecc40e0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.88:15021/healthz/ready\": dial tcp 10.134.0.88:15021: connect: connection refused"
Oct 30 20:05:28.042708 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:28.040945    6275 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w5-626870/distinct-2-w5-626870-kserve-98bfb9b98-xz6xj"]
Oct 30 20:05:28.226507 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:28.226473    6275 patch_prober.go:29] interesting pod/e2e-worker-w6-51dd62-openshift-default-7954bd8797-jjfwb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.89:15021/healthz/ready\": dial tcp 10.134.0.89:15021: connect: connection refused" start-of-body=
Oct 30 20:05:28.226616 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:28.226579    6275 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-51dd62-openshift-default-7954bd8797-jjfwb" podUID="e06b5b8f-8e8e-4568-9f30-1997b0bd259e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.89:15021/healthz/ready\": dial tcp 10.134.0.89:15021: connect: connection refused"
Oct 30 20:05:28.233223 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:28.233203    6275 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-ee93db57-hqf8x"
Oct 30 20:05:28.365311 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:28.365280    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/c4ef2033-aec7-4a1d-adf4-b54c670655b0-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/c4ef2033-aec7-4a1d-adf4-b54c670655b0-maas-api-openshift-ca\") pod \"c4ef2033-aec7-4a1d-adf4-b54c670655b0\" (UID: \"c4ef2033-aec7-4a1d-adf4-b54c670655b0\") "
Oct 30 20:05:28.365470 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:28.365459    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/c4ef2033-aec7-4a1d-adf4-b54c670655b0-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/c4ef2033-aec7-4a1d-adf4-b54c670655b0-maas-api-xks-ca\") pod \"c4ef2033-aec7-4a1d-adf4-b54c670655b0\" (UID: \"c4ef2033-aec7-4a1d-adf4-b54c670655b0\") "
Oct 30 20:05:28.365597 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:28.365579    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/c4ef2033-aec7-4a1d-adf4-b54c670655b0-kube-api-access-vdjmj\" (UniqueName: \"kubernetes.io/projected/c4ef2033-aec7-4a1d-adf4-b54c670655b0-kube-api-access-vdjmj\") pod \"c4ef2033-aec7-4a1d-adf4-b54c670655b0\" (UID: \"c4ef2033-aec7-4a1d-adf4-b54c670655b0\") "
Oct 30 20:05:28.365928 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:28.365901    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c4ef2033-aec7-4a1d-adf4-b54c670655b0-maas-api-openshift-ca" pod "c4ef2033-aec7-4a1d-adf4-b54c670655b0" (UID: "c4ef2033-aec7-4a1d-adf4-b54c670655b0"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:05:28.366161 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:28.366145    6275 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/c4ef2033-aec7-4a1d-adf4-b54c670655b0-maas-api-openshift-ca\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:05:28.376441 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:28.367397    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c4ef2033-aec7-4a1d-adf4-b54c670655b0-maas-api-xks-ca" pod "c4ef2033-aec7-4a1d-adf4-b54c670655b0" (UID: "c4ef2033-aec7-4a1d-adf4-b54c670655b0"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 20:05:28.398437 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:28.379573    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c4ef2033-aec7-4a1d-adf4-b54c670655b0-kube-api-access-vdjmj" pod "c4ef2033-aec7-4a1d-adf4-b54c670655b0" (UID: "c4ef2033-aec7-4a1d-adf4-b54c670655b0"). InnerVolumeSpecName "kube-api-access-vdjmj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:05:28.467001 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:28.466969    6275 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/c4ef2033-aec7-4a1d-adf4-b54c670655b0-maas-api-xks-ca\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:05:28.467001 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:28.466998    6275 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vdjmj\" (UniqueName: \"kubernetes.io/projected/c4ef2033-aec7-4a1d-adf4-b54c670655b0-kube-api-access-vdjmj\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:05:28.820512 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:28.819968    6275 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w4-f1f016/distinct-w4-f1f016-kserve-79fbfbdbf7-hswb7"
Oct 30 20:05:28.838163 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:28.838139    6275 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w4-f1f016/distinct-w4-f1f016-kserve-79fbfbdbf7-hswb7"
Oct 30 20:05:28.942879 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:28.942839    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w5-626870/distinct-2-w5-626870-kserve-98bfb9b98-xz6xj" event={"ID":"7d49f1ad-8805-4090-8e72-7d828fa73f36","Type":"ContainerStarted","Data":"22a924bb9db00bd2defbd1d7fa4ffe3ed03412c3a6c334c32c8b7583982d06f3"}
Oct 30 20:05:28.942879 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:28.942889    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w5-626870/distinct-2-w5-626870-kserve-98bfb9b98-xz6xj" event={"ID":"7d49f1ad-8805-4090-8e72-7d828fa73f36","Type":"ContainerStarted","Data":"942b8fa946f313cf256de5290513f44d35a90be2dece60f100d62323ed581b93"}
Oct 30 20:05:28.944177 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:28.944148    6275 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-ee93db57-hqf8x"
Oct 30 20:05:28.945247 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:28.944355    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-ee93db57-hqf8x" event={"ID":"c4ef2033-aec7-4a1d-adf4-b54c670655b0","Type":"ContainerDied","Data":"a1f3caffdfca2e3d4391f1997ab021e5e679a070f1dfa6ab666910aa52cde357"}
Oct 30 20:05:28.945247 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:28.944394    6275 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a1f3caffdfca2e3d4391f1997ab021e5e679a070f1dfa6ab666910aa52cde357"
Oct 30 20:05:28.956512 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:28.956490    6275 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w4-f1f016/distinct-w4-f1f016-kserve-79fbfbdbf7-hswb7"
Oct 30 20:05:28.992437 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:28.991816    6275 patch_prober.go:29] interesting pod/e2e-worker-w1-5f10d2-openshift-default-6c6777d6f5-dj7jb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.88:15021/healthz/ready\": dial tcp 10.134.0.88:15021: connect: connection refused" start-of-body=
Oct 30 20:05:28.992437 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:28.991889    6275 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-5f10d2-openshift-default-6c6777d6f5-dj7jb" podUID="d41d4ace-e4ec-4c16-abdb-c1dcdecc40e0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.88:15021/healthz/ready\": dial tcp 10.134.0.88:15021: connect: connection refused"
Oct 30 20:05:29.013438 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:28.997317    6275 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w5-626870/distinct-2-w5-626870-kserve-98bfb9b98-xz6xj" podStartSLOduration=2.997301117 podStartE2EDuration="2.997301117s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:05:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:05:28.994964969 +0000 UTC m=+1039.456691837" watchObservedRunningTime="2026-10-30 20:05:28.997301117 +0000 UTC m=+1039.459027981"
Oct 30 20:05:29.234737 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:29.234703    6275 patch_prober.go:29] interesting pod/e2e-worker-w6-51dd62-openshift-default-7954bd8797-jjfwb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.89:15021/healthz/ready\": dial tcp 10.134.0.89:15021: connect: connection refused" start-of-body=
Oct 30 20:05:29.235269 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:29.235235    6275 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-51dd62-openshift-default-7954bd8797-jjfwb" podUID="e06b5b8f-8e8e-4568-9f30-1997b0bd259e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.89:15021/healthz/ready\": dial tcp 10.134.0.89:15021: connect: connection refused"
Oct 30 20:05:29.617498 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:29.611429    6275 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w5-626870/distinct-2-w5-626870-kserve-98bfb9b98-xz6xj"
Oct 30 20:05:29.991492 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:29.982503    6275 patch_prober.go:29] interesting pod/e2e-worker-w1-5f10d2-openshift-default-6c6777d6f5-dj7jb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.88:15021/healthz/ready\": dial tcp 10.134.0.88:15021: connect: connection refused" start-of-body=
Oct 30 20:05:29.991492 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:29.982568    6275 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-5f10d2-openshift-default-6c6777d6f5-dj7jb" podUID="d41d4ace-e4ec-4c16-abdb-c1dcdecc40e0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.88:15021/healthz/ready\": dial tcp 10.134.0.88:15021: connect: connection refused"
Oct 30 20:05:30.225248 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:30.225214    6275 patch_prober.go:29] interesting pod/e2e-worker-w6-51dd62-openshift-default-7954bd8797-jjfwb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.89:15021/healthz/ready\": dial tcp 10.134.0.89:15021: connect: connection refused" start-of-body=
Oct 30 20:05:30.225459 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:30.225279    6275 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-51dd62-openshift-default-7954bd8797-jjfwb" podUID="e06b5b8f-8e8e-4568-9f30-1997b0bd259e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.89:15021/healthz/ready\": dial tcp 10.134.0.89:15021: connect: connection refused"
Oct 30 20:05:30.992839 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:30.992798    6275 patch_prober.go:29] interesting pod/e2e-worker-w1-5f10d2-openshift-default-6c6777d6f5-dj7jb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.88:15021/healthz/ready\": dial tcp 10.134.0.88:15021: connect: connection refused" start-of-body=
Oct 30 20:05:30.993482 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:30.993445    6275 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-5f10d2-openshift-default-6c6777d6f5-dj7jb" podUID="d41d4ace-e4ec-4c16-abdb-c1dcdecc40e0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.88:15021/healthz/ready\": dial tcp 10.134.0.88:15021: connect: connection refused"
Oct 30 20:05:31.225677 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:31.225634    6275 patch_prober.go:29] interesting pod/e2e-worker-w6-51dd62-openshift-default-7954bd8797-jjfwb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.89:15021/healthz/ready\": dial tcp 10.134.0.89:15021: connect: connection refused" start-of-body=
Oct 30 20:05:31.225857 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:31.225704    6275 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-51dd62-openshift-default-7954bd8797-jjfwb" podUID="e06b5b8f-8e8e-4568-9f30-1997b0bd259e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.89:15021/healthz/ready\": dial tcp 10.134.0.89:15021: connect: connection refused"
Oct 30 20:05:31.990921 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:31.990874    6275 patch_prober.go:29] interesting pod/e2e-worker-w1-5f10d2-openshift-default-6c6777d6f5-dj7jb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.88:15021/healthz/ready\": dial tcp 10.134.0.88:15021: connect: connection refused" start-of-body=
Oct 30 20:05:31.991240 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:31.991209    6275 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-5f10d2-openshift-default-6c6777d6f5-dj7jb" podUID="d41d4ace-e4ec-4c16-abdb-c1dcdecc40e0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.88:15021/healthz/ready\": dial tcp 10.134.0.88:15021: connect: connection refused"
Oct 30 20:05:32.227586 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:32.227545    6275 patch_prober.go:29] interesting pod/e2e-worker-w6-51dd62-openshift-default-7954bd8797-jjfwb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.89:15021/healthz/ready\": dial tcp 10.134.0.89:15021: connect: connection refused" start-of-body=
Oct 30 20:05:32.228231 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:32.228181    6275 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-51dd62-openshift-default-7954bd8797-jjfwb" podUID="e06b5b8f-8e8e-4568-9f30-1997b0bd259e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.89:15021/healthz/ready\": dial tcp 10.134.0.89:15021: connect: connection refused"
Oct 30 20:05:32.985440 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:32.984782    6275 patch_prober.go:29] interesting pod/e2e-worker-w1-5f10d2-openshift-default-6c6777d6f5-dj7jb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.88:15021/healthz/ready\": dial tcp 10.134.0.88:15021: connect: connection refused" start-of-body=
Oct 30 20:05:32.985440 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:32.984853    6275 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-5f10d2-openshift-default-6c6777d6f5-dj7jb" podUID="d41d4ace-e4ec-4c16-abdb-c1dcdecc40e0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.88:15021/healthz/ready\": dial tcp 10.134.0.88:15021: connect: connection refused"
Oct 30 20:05:33.226441 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:33.226004    6275 patch_prober.go:29] interesting pod/e2e-worker-w6-51dd62-openshift-default-7954bd8797-jjfwb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.89:15021/healthz/ready\": dial tcp 10.134.0.89:15021: connect: connection refused" start-of-body=
Oct 30 20:05:33.226441 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:33.226075    6275 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-51dd62-openshift-default-7954bd8797-jjfwb" podUID="e06b5b8f-8e8e-4568-9f30-1997b0bd259e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.89:15021/healthz/ready\": dial tcp 10.134.0.89:15021: connect: connection refused"
Oct 30 20:05:33.456498 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:33.455565    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-5f10d2/distinct-w1-5f10d2-kserve-5bf49798b8-l2j84" podUID="9e831c5d-2019-4015-ac57-2b4b1b90b9b3" containerName="main" probeResult="failure" output="Get \"https://10.134.0.69:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:05:33.456992 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:33.456876    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-912f24/simulator-w3-912f24-kserve-59897cf48b-sd5wj" podUID="b4de6427-0db0-42d9-8b88-6b35d9d4c314" containerName="main" probeResult="failure" output="Get \"https://10.134.0.54:8000/ready\": context deadline exceeded"
Oct 30 20:05:33.520439 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:33.520056    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-f1f016/simulator-w4-f1f016-kserve-55db8447ff-749tw" podUID="8f3174b6-2fdc-48c2-99be-7a966731f018" containerName="main" probeResult="failure" output="Get \"https://10.134.0.55:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:05:33.596438 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:33.595512    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-51dd62/simulator-w6-51dd62-kserve-d6bb4985f-65j9h" podUID="f7e1ff07-15d6-49b5-8edc-52c9d6825ed7" containerName="main" probeResult="failure" output="Get \"https://10.134.0.56:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:05:33.641206 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:33.639650    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-626870/premium-w5-626870-kserve-5df7f7b5c4-vx59r" podUID="a1adddd4-3218-4a6b-a145-0290bceff76f" containerName="main" probeResult="failure" output="Get \"https://10.134.0.57:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:05:33.715496 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:33.715136    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-efbac3/premium-w2-efbac3-kserve-55f54cfff6-9fqbz" podUID="083136dc-91fb-454f-a782-87b004e73d1b" containerName="main" probeResult="failure" output="Get \"https://10.134.0.59:8000/ready\": context deadline exceeded"
Oct 30 20:05:33.817440 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:33.817292    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-f1f016/premium-w4-f1f016-kserve-55d6bd678b-w5hkc" podUID="0e543ba9-1e7a-4d0a-9361-50c98060e824" containerName="main" probeResult="failure" output="Get \"https://10.134.0.60:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:05:33.843441 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:33.838489    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-5f10d2/premium-w1-5f10d2-kserve-644b846669-286m2" podUID="a2ff6903-c1ab-48dd-884b-d119b8ee1ed6" containerName="main" probeResult="failure" output="Get \"https://10.134.0.61:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:05:33.953443 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:33.950740    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-f1f016/distinct-w4-f1f016-kserve-79fbfbdbf7-hswb7" podUID="7b6639ea-72b0-49fb-b7fa-9443c1ddff6d" containerName="main" probeResult="failure" output="Get \"https://10.134.0.86:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:05:33.983497 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:33.982348    6275 patch_prober.go:29] interesting pod/e2e-worker-w1-5f10d2-openshift-default-6c6777d6f5-dj7jb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.88:15021/healthz/ready\": dial tcp 10.134.0.88:15021: connect: connection refused" start-of-body=
Oct 30 20:05:33.987437 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:33.986511    6275 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-5f10d2-openshift-default-6c6777d6f5-dj7jb" podUID="d41d4ace-e4ec-4c16-abdb-c1dcdecc40e0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.88:15021/healthz/ready\": dial tcp 10.134.0.88:15021: connect: connection refused"
Oct 30 20:05:34.048440 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:34.047500    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-912f24/distinct-2-w3-912f24-kserve-566865fdcc-ptx4l" podUID="fcea214a-04a7-4bdd-9695-852f657edfe5" containerName="main" probeResult="failure" output="Get \"https://10.134.0.74:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:05:34.133440 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:34.132524    6275 patch_prober.go:29] interesting pod/e2e-worker-w0-62f4a1-openshift-default-7fc84fbccc-xwj24 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.63:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 20:05:34.133440 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:34.132591    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w0-62f4a1-openshift-default-7fc84fbccc-xwj24" podUID="943aa671-36e0-4eac-aa11-807858253698" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.63:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:05:34.230439 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:34.227842    6275 patch_prober.go:29] interesting pod/e2e-worker-w6-51dd62-openshift-default-7954bd8797-jjfwb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.89:15021/healthz/ready\": dial tcp 10.134.0.89:15021: connect: connection refused" start-of-body=
Oct 30 20:05:34.230439 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:34.227921    6275 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-51dd62-openshift-default-7954bd8797-jjfwb" podUID="e06b5b8f-8e8e-4568-9f30-1997b0bd259e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.89:15021/healthz/ready\": dial tcp 10.134.0.89:15021: connect: connection refused"
Oct 30 20:05:34.474450 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:34.473733    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-912f24/simulator-w3-912f24-kserve-59897cf48b-sd5wj" podUID="b4de6427-0db0-42d9-8b88-6b35d9d4c314" containerName="main" probeResult="failure" output="Get \"https://10.134.0.54:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:05:34.474937 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:34.474566    6275 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w3-912f24/simulator-w3-912f24-kserve-59897cf48b-sd5wj"
Oct 30 20:05:34.507440 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:34.489095    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-5f10d2/distinct-w1-5f10d2-kserve-5bf49798b8-l2j84" podUID="9e831c5d-2019-4015-ac57-2b4b1b90b9b3" containerName="main" probeResult="failure" output="Get \"https://10.134.0.69:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:05:34.507440 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:34.489527    6275 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w1-5f10d2/distinct-w1-5f10d2-kserve-5bf49798b8-l2j84"
Oct 30 20:05:34.523439 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:34.522800    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-f1f016/simulator-w4-f1f016-kserve-55db8447ff-749tw" podUID="8f3174b6-2fdc-48c2-99be-7a966731f018" containerName="main" probeResult="failure" output="Get \"https://10.134.0.55:8000/ready\": context deadline exceeded"
Oct 30 20:05:34.523631 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:34.523588    6275 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w4-f1f016/simulator-w4-f1f016-kserve-55db8447ff-749tw"
Oct 30 20:05:34.645441 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:34.644861    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-626870/premium-w5-626870-kserve-5df7f7b5c4-vx59r" podUID="a1adddd4-3218-4a6b-a145-0290bceff76f" containerName="main" probeResult="failure" output="Get \"https://10.134.0.57:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:05:34.670439 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:34.666182    6275 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w5-626870/premium-w5-626870-kserve-5df7f7b5c4-vx59r"
Oct 30 20:05:34.682718 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:34.682503    6275 patch_prober.go:29] interesting pod/e2e-worker-w0-62f4a1-openshift-default-7fc84fbccc-52l47 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.76:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 20:05:34.682718 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:34.682563    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w0-62f4a1-openshift-default-7fc84fbccc-52l47" podUID="e3f64fa4-b2e2-4ab4-9da5-76bbfac9116d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.76:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:05:34.768443 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:34.746496    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-efbac3/premium-w2-efbac3-kserve-55f54cfff6-9fqbz" podUID="083136dc-91fb-454f-a782-87b004e73d1b" containerName="main" probeResult="failure" output="Get \"https://10.134.0.59:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:05:34.768443 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:34.746917    6275 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w2-efbac3/premium-w2-efbac3-kserve-55f54cfff6-9fqbz"
Oct 30 20:05:34.882175 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:34.817468    6275 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w4-f1f016/simulator-w4-f1f016-kserve-55db8447ff-749tw"
Oct 30 20:05:34.882175 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:34.818194    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-f1f016/premium-w4-f1f016-kserve-55d6bd678b-w5hkc" podUID="0e543ba9-1e7a-4d0a-9361-50c98060e824" containerName="main" probeResult="failure" output="Get \"https://10.134.0.60:8000/ready\": context deadline exceeded"
Oct 30 20:05:34.882175 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:34.818762    6275 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w4-f1f016/premium-w4-f1f016-kserve-55d6bd678b-w5hkc"
Oct 30 20:05:34.894442 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:34.892653    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-5f10d2/premium-w1-5f10d2-kserve-644b846669-286m2" podUID="a2ff6903-c1ab-48dd-884b-d119b8ee1ed6" containerName="main" probeResult="failure" output="Get \"https://10.134.0.61:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:05:34.894442 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:34.893044    6275 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w1-5f10d2/premium-w1-5f10d2-kserve-644b846669-286m2"
Oct 30 20:05:35.062854 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:34.998483    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-f1f016/distinct-w4-f1f016-kserve-79fbfbdbf7-hswb7" podUID="7b6639ea-72b0-49fb-b7fa-9443c1ddff6d" containerName="main" probeResult="failure" output="Get \"https://10.134.0.86:8000/ready\": context deadline exceeded"
Oct 30 20:05:35.062854 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:34.998888    6275 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w4-f1f016/distinct-w4-f1f016-kserve-79fbfbdbf7-hswb7"
Oct 30 20:05:35.062854 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:35.001573    6275 patch_prober.go:29] interesting pod/e2e-worker-w1-5f10d2-openshift-default-6c6777d6f5-dj7jb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.88:15021/healthz/ready\": dial tcp 10.134.0.88:15021: connect: connection refused" start-of-body=
Oct 30 20:05:35.062854 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:35.001616    6275 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-5f10d2-openshift-default-6c6777d6f5-dj7jb" podUID="d41d4ace-e4ec-4c16-abdb-c1dcdecc40e0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.88:15021/healthz/ready\": dial tcp 10.134.0.88:15021: connect: connection refused"
Oct 30 20:05:35.062854 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:35.049930    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-912f24/distinct-2-w3-912f24-kserve-566865fdcc-ptx4l" podUID="fcea214a-04a7-4bdd-9695-852f657edfe5" containerName="main" probeResult="failure" output="Get \"https://10.134.0.74:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:05:35.062854 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:35.050336    6275 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w3-912f24/distinct-2-w3-912f24-kserve-566865fdcc-ptx4l"
Oct 30 20:05:35.476510 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:35.449347    6275 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w2-efbac3/premium-w2-efbac3-kserve-55f54cfff6-9fqbz" podUID="083136dc-91fb-454f-a782-87b004e73d1b" containerName="main" probeResult="failure" output="Get \"https://10.134.0.59:8000/health\": context deadline exceeded"
Oct 30 20:05:35.535149 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:35.535029    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-5f10d2/distinct-w1-5f10d2-kserve-5bf49798b8-l2j84" podUID="9e831c5d-2019-4015-ac57-2b4b1b90b9b3" containerName="main" probeResult="failure" output="Get \"https://10.134.0.69:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:05:35.703457 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:35.672398    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-912f24/simulator-w3-912f24-kserve-59897cf48b-sd5wj" podUID="b4de6427-0db0-42d9-8b88-6b35d9d4c314" containerName="main" probeResult="failure" output="Get \"https://10.134.0.54:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:05:35.703457 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:35.677242    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-626870/premium-w5-626870-kserve-5df7f7b5c4-vx59r" podUID="a1adddd4-3218-4a6b-a145-0290bceff76f" containerName="main" probeResult="failure" output="Get \"https://10.134.0.57:8000/ready\": context deadline exceeded"
Oct 30 20:05:35.884701 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:35.824254    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-51dd62/simulator-w6-51dd62-kserve-d6bb4985f-65j9h" podUID="f7e1ff07-15d6-49b5-8edc-52c9d6825ed7" containerName="main" probeResult="failure" output="Get \"https://10.134.0.56:8000/ready\": context deadline exceeded"
Oct 30 20:05:36.071467 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:35.918292    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-5f10d2/premium-w1-5f10d2-kserve-644b846669-286m2" podUID="a2ff6903-c1ab-48dd-884b-d119b8ee1ed6" containerName="main" probeResult="failure" output="Get \"https://10.134.0.61:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:05:36.071467 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:36.047707    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-f1f016/premium-w4-f1f016-kserve-55d6bd678b-w5hkc" podUID="0e543ba9-1e7a-4d0a-9361-50c98060e824" containerName="main" probeResult="failure" output="Get \"https://10.134.0.60:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:05:36.071467 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:36.027862    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-f1f016/distinct-w4-f1f016-kserve-79fbfbdbf7-hswb7" podUID="7b6639ea-72b0-49fb-b7fa-9443c1ddff6d" containerName="main" probeResult="failure" output="Get \"https://10.134.0.86:8000/ready\": context deadline exceeded"
Oct 30 20:05:36.083018 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:36.073875    6275 patch_prober.go:29] interesting pod/e2e-worker-w0-62f4a1-openshift-default-7fc84fbccc-7qzmg container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.84:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 20:05:36.083018 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:36.073955    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w0-62f4a1-openshift-default-7fc84fbccc-7qzmg" podUID="555e958d-9abd-41f1-b08a-0db0b32fe79f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.84:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:05:36.092602 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:36.092495    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-efbac3/premium-w2-efbac3-kserve-55f54cfff6-9fqbz" podUID="083136dc-91fb-454f-a782-87b004e73d1b" containerName="main" probeResult="failure" output="Get \"https://10.134.0.59:8000/ready\": context deadline exceeded"
Oct 30 20:05:36.116661 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:36.116556    6275 patch_prober.go:29] interesting pod/e2e-worker-w6-51dd62-openshift-default-7954bd8797-jjfwb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.89:15021/healthz/ready\": dial tcp 10.134.0.89:15021: connect: connection refused" start-of-body=
Oct 30 20:05:36.360434 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:36.359622    6275 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w1-5f10d2/premium-w1-5f10d2-kserve-644b846669-286m2" podUID="a2ff6903-c1ab-48dd-884b-d119b8ee1ed6" containerName="main" probeResult="failure" output="Get \"https://10.134.0.61:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:05:36.371448 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:36.368992    6275 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-51dd62-openshift-default-7954bd8797-jjfwb" podUID="e06b5b8f-8e8e-4568-9f30-1997b0bd259e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.89:15021/healthz/ready\": dial tcp 10.134.0.89:15021: connect: connection refused"
Oct 30 20:05:36.383438 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:36.379560    6275 patch_prober.go:29] interesting pod/e2e-worker-w1-5f10d2-openshift-default-6c6777d6f5-8zmvq container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.85:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 20:05:36.383438 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:36.379644    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w1-5f10d2-openshift-default-6c6777d6f5-8zmvq" podUID="0e4973a9-ead0-4c5f-813c-fa012dc3fade" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.85:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:05:36.407380 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:36.400383    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-f1f016/simulator-w4-f1f016-kserve-55db8447ff-749tw" podUID="8f3174b6-2fdc-48c2-99be-7a966731f018" containerName="main" probeResult="failure" output="Get \"https://10.134.0.55:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:05:36.431439 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:36.414436    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-912f24/distinct-2-w3-912f24-kserve-566865fdcc-ptx4l" podUID="fcea214a-04a7-4bdd-9695-852f657edfe5" containerName="main" probeResult="failure" output="Get \"https://10.134.0.74:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:05:36.431439 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:36.414735    6275 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w5-626870/premium-w5-626870-kserve-5df7f7b5c4-vx59r" podUID="a1adddd4-3218-4a6b-a145-0290bceff76f" containerName="main" probeResult="failure" output="Get \"https://10.134.0.57:8000/health\": context deadline exceeded"
Oct 30 20:05:36.535468 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:36.461717    6275 patch_prober.go:29] interesting pod/e2e-worker-w1-5f10d2-openshift-default-6c6777d6f5-dj7jb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.88:15021/healthz/ready\": dial tcp 10.134.0.88:15021: connect: connection refused" start-of-body=
Oct 30 20:05:36.535468 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:36.461783    6275 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-5f10d2-openshift-default-6c6777d6f5-dj7jb" podUID="d41d4ace-e4ec-4c16-abdb-c1dcdecc40e0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.88:15021/healthz/ready\": dial tcp 10.134.0.88:15021: connect: connection refused"
Oct 30 20:05:36.632432 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:36.547499    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-5f10d2/distinct-w1-5f10d2-kserve-5bf49798b8-l2j84" podUID="9e831c5d-2019-4015-ac57-2b4b1b90b9b3" containerName="main" probeResult="failure" output="Get \"https://10.134.0.69:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:05:36.672816 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:36.672767    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-912f24/simulator-w3-912f24-kserve-59897cf48b-sd5wj" podUID="b4de6427-0db0-42d9-8b88-6b35d9d4c314" containerName="main" probeResult="failure" output="Get \"https://10.134.0.54:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:05:36.692438 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:36.680784    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-626870/premium-w5-626870-kserve-5df7f7b5c4-vx59r" podUID="a1adddd4-3218-4a6b-a145-0290bceff76f" containerName="main" probeResult="failure" output="Get \"https://10.134.0.57:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:05:36.857701 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:36.857599    6275 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w1-5f10d2/distinct-w1-5f10d2-kserve-5bf49798b8-l2j84" podUID="9e831c5d-2019-4015-ac57-2b4b1b90b9b3" containerName="main" probeResult="failure" output="Get \"https://10.134.0.69:8000/health\": context deadline exceeded"
Oct 30 20:05:37.031566 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:37.031520    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-51dd62/simulator-w6-51dd62-kserve-d6bb4985f-65j9h" podUID="f7e1ff07-15d6-49b5-8edc-52c9d6825ed7" containerName="main" probeResult="failure" output="Get \"https://10.134.0.56:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:05:37.032311 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:37.032288    6275 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w6-51dd62/simulator-w6-51dd62-kserve-d6bb4985f-65j9h"
Oct 30 20:05:37.033388 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:37.033354    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-5f10d2/premium-w1-5f10d2-kserve-644b846669-286m2" podUID="a2ff6903-c1ab-48dd-884b-d119b8ee1ed6" containerName="main" probeResult="failure" output="Get \"https://10.134.0.61:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:05:37.056836 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:37.055537    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-f1f016/premium-w4-f1f016-kserve-55d6bd678b-w5hkc" podUID="0e543ba9-1e7a-4d0a-9361-50c98060e824" containerName="main" probeResult="failure" output="Get \"https://10.134.0.60:8000/ready\": context deadline exceeded"
Oct 30 20:05:37.058800 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:37.058760    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-f1f016/distinct-w4-f1f016-kserve-79fbfbdbf7-hswb7" podUID="7b6639ea-72b0-49fb-b7fa-9443c1ddff6d" containerName="main" probeResult="failure" output="Get \"https://10.134.0.86:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:05:37.115204 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:37.115165    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-efbac3/premium-w2-efbac3-kserve-55f54cfff6-9fqbz" podUID="083136dc-91fb-454f-a782-87b004e73d1b" containerName="main" probeResult="failure" output="Get \"https://10.134.0.59:8000/ready\": context deadline exceeded"
Oct 30 20:05:37.431523 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:37.401965    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-f1f016/simulator-w4-f1f016-kserve-55db8447ff-749tw" podUID="8f3174b6-2fdc-48c2-99be-7a966731f018" containerName="main" probeResult="failure" output="Get \"https://10.134.0.55:8000/ready\": context deadline exceeded"
Oct 30 20:05:37.442443 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:37.415506    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-912f24/distinct-2-w3-912f24-kserve-566865fdcc-ptx4l" podUID="fcea214a-04a7-4bdd-9695-852f657edfe5" containerName="main" probeResult="failure" output="Get \"https://10.134.0.74:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:05:37.442443 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:37.433107    6275 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w4-f1f016/simulator-w4-f1f016-kserve-55db8447ff-749tw"
Oct 30 20:05:37.480547 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:37.480510    6275 patch_prober.go:29] interesting pod/e2e-worker-w6-51dd62-openshift-default-7954bd8797-jjfwb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.89:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 20:05:37.480801 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:37.480773    6275 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-51dd62-openshift-default-7954bd8797-jjfwb" podUID="e06b5b8f-8e8e-4568-9f30-1997b0bd259e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.89:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:05:37.589799 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:37.589754    6275 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w3-912f24/distinct-2-w3-912f24-kserve-566865fdcc-ptx4l"
Oct 30 20:05:37.641435 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:37.635511    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-5f10d2/distinct-w1-5f10d2-kserve-5bf49798b8-l2j84" podUID="9e831c5d-2019-4015-ac57-2b4b1b90b9b3" containerName="main" probeResult="failure" output="Get \"https://10.134.0.69:8000/ready\": context deadline exceeded"
Oct 30 20:05:37.693682 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:37.650001    6275 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w4-f1f016/simulator-w4-f1f016-kserve-55db8447ff-749tw"
Oct 30 20:05:37.693682 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:37.658303    6275 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w5-626870/distinct-2-w5-626870-kserve-98bfb9b98-xz6xj"
Oct 30 20:05:37.693682 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:37.679726    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-912f24/simulator-w3-912f24-kserve-59897cf48b-sd5wj" podUID="b4de6427-0db0-42d9-8b88-6b35d9d4c314" containerName="main" probeResult="failure" output="Get \"https://10.134.0.54:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:05:37.693682 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:37.685885    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-626870/premium-w5-626870-kserve-5df7f7b5c4-vx59r" podUID="a1adddd4-3218-4a6b-a145-0290bceff76f" containerName="main" probeResult="failure" output="Get \"https://10.134.0.57:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:05:37.928672 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:37.928567    6275 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w5-626870/distinct-2-w5-626870-kserve-98bfb9b98-xz6xj"
Oct 30 20:05:37.928672 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:37.928634    6275 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w6-51dd62-openshift-default-7954bd8797-jjfwb"
Oct 30 20:05:37.928923 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:37.928686    6275 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w1-5f10d2/distinct-w1-5f10d2-kserve-5bf49798b8-l2j84"
Oct 30 20:05:37.928923 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:37.928717    6275 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w3-912f24/simulator-w3-912f24-kserve-59897cf48b-sd5wj"
Oct 30 20:05:37.928923 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:37.928746    6275 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w4-f1f016/premium-w4-f1f016-kserve-55d6bd678b-w5hkc"
Oct 30 20:05:37.928923 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:37.928776    6275 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w2-efbac3/premium-w2-efbac3-kserve-55f54cfff6-9fqbz"
Oct 30 20:05:37.928923 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:37.928838    6275 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w4-f1f016/distinct-w4-f1f016-kserve-79fbfbdbf7-hswb7"
Oct 30 20:05:37.933257 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:37.933226    6275 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w6-51dd62-openshift-default-7954bd8797-jjfwb"
Oct 30 20:05:37.933388 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:37.933300    6275 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w1-5f10d2/premium-w1-5f10d2-kserve-644b846669-286m2"
Oct 30 20:05:37.941710 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:37.941684    6275 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w6-51dd62-openshift-default-7954bd8797-jjfwb"
Oct 30 20:05:37.942484 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:37.942276    6275 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w6-51dd62/simulator-w6-51dd62-kserve-d6bb4985f-65j9h"
Oct 30 20:05:37.955979 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:37.955897    6275 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w5-626870/premium-w5-626870-kserve-5df7f7b5c4-vx59r"
Oct 30 20:05:37.971894 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:37.971869    6275 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-1533e373-c74cs"]
Oct 30 20:05:37.972599 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:37.972580    6275 cpu_manager.go:414] "containerMap: removing container" podUID="c4ef2033-aec7-4a1d-adf4-b54c670655b0" containerName="revoke-keys"
Oct 30 20:05:37.972599 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:37.972600    6275 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="c4ef2033-aec7-4a1d-adf4-b54c670655b0" containerName="revoke-keys"
Oct 30 20:05:37.972763 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:37.972749    6275 memory_manager.go:365] "RemoveStaleState removing state" podUID="c4ef2033-aec7-4a1d-adf4-b54c670655b0" containerName="revoke-keys"
Oct 30 20:05:37.977922 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:37.977827    6275 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-1533e373-c74cs"
Oct 30 20:05:37.981375 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:37.981302    6275 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w1-5f10d2-openshift-default-6c6777d6f5-dj7jb"
Oct 30 20:05:37.981870 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:37.981845    6275 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w1-5f10d2-openshift-default-6c6777d6f5-dj7jb"
Oct 30 20:05:37.986076 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:37.986051    6275 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w1-5f10d2-openshift-default-6c6777d6f5-dj7jb"
Oct 30 20:05:38.008460 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:37.997874    6275 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-scs2w\""
Oct 30 20:05:38.008460 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:37.997948    6275 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\""
Oct 30 20:05:38.008460 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:37.998308    6275 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-1533e373-c74cs"]
Oct 30 20:05:38.068555 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:38.068043    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/17c0f963-82fe-4691-8950-ba4f9c5cf039-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-1533e373-c74cs\" (UID: \"17c0f963-82fe-4691-8950-ba4f9c5cf039\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-1533e373-c74cs"
Oct 30 20:05:38.068555 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:38.068146    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/17c0f963-82fe-4691-8950-ba4f9c5cf039-maas-api-xks-ca\") pod \"maas-api-revoke-sub-1533e373-c74cs\" (UID: \"17c0f963-82fe-4691-8950-ba4f9c5cf039\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-1533e373-c74cs"
Oct 30 20:05:38.068555 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:38.068224    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c7l2n\" (UniqueName: \"kubernetes.io/projected/17c0f963-82fe-4691-8950-ba4f9c5cf039-kube-api-access-c7l2n\") pod \"maas-api-revoke-sub-1533e373-c74cs\" (UID: \"17c0f963-82fe-4691-8950-ba4f9c5cf039\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-1533e373-c74cs"
Oct 30 20:05:38.180234 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:38.170394    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/17c0f963-82fe-4691-8950-ba4f9c5cf039-maas-api-xks-ca\") pod \"maas-api-revoke-sub-1533e373-c74cs\" (UID: \"17c0f963-82fe-4691-8950-ba4f9c5cf039\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-1533e373-c74cs"
Oct 30 20:05:38.180234 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:38.170496    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c7l2n\" (UniqueName: \"kubernetes.io/projected/17c0f963-82fe-4691-8950-ba4f9c5cf039-kube-api-access-c7l2n\") pod \"maas-api-revoke-sub-1533e373-c74cs\" (UID: \"17c0f963-82fe-4691-8950-ba4f9c5cf039\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-1533e373-c74cs"
Oct 30 20:05:38.180234 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:38.170737    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/17c0f963-82fe-4691-8950-ba4f9c5cf039-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-1533e373-c74cs\" (UID: \"17c0f963-82fe-4691-8950-ba4f9c5cf039\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-1533e373-c74cs"
Oct 30 20:05:38.180234 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:38.171756    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/17c0f963-82fe-4691-8950-ba4f9c5cf039-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-1533e373-c74cs\" (UID: \"17c0f963-82fe-4691-8950-ba4f9c5cf039\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-1533e373-c74cs"
Oct 30 20:05:38.181159 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:38.181061    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/17c0f963-82fe-4691-8950-ba4f9c5cf039-maas-api-xks-ca\") pod \"maas-api-revoke-sub-1533e373-c74cs\" (UID: \"17c0f963-82fe-4691-8950-ba4f9c5cf039\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-1533e373-c74cs"
Oct 30 20:05:38.197768 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:38.197738    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c7l2n\" (UniqueName: \"kubernetes.io/projected/17c0f963-82fe-4691-8950-ba4f9c5cf039-kube-api-access-c7l2n\") pod \"maas-api-revoke-sub-1533e373-c74cs\" (UID: \"17c0f963-82fe-4691-8950-ba4f9c5cf039\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-1533e373-c74cs"
Oct 30 20:05:38.303325 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:38.303289    6275 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-1533e373-c74cs"
Oct 30 20:05:38.613441 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:38.613337    6275 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w5-626870/distinct-2-w5-626870-kserve-98bfb9b98-xz6xj"
Oct 30 20:05:38.646241 ip-10-0-131-26 kubenswrapper[6275]: W1030 20:05:38.646208    6275 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod17c0f963_82fe_4691_8950_ba4f9c5cf039.slice/crio-14d4c73cd766ead5c1d389e5cb534eb56b484651e5ba78d85ed1c64ea5b20f51 WatchSource:0}: Error finding container 14d4c73cd766ead5c1d389e5cb534eb56b484651e5ba78d85ed1c64ea5b20f51: Status 404 returned error can't find the container with id 14d4c73cd766ead5c1d389e5cb534eb56b484651e5ba78d85ed1c64ea5b20f51
Oct 30 20:05:38.648403 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:38.648374    6275 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-1533e373-c74cs"]
Oct 30 20:05:38.896242 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:38.896206    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-1533e373-c74cs" event={"ID":"17c0f963-82fe-4691-8950-ba4f9c5cf039","Type":"ContainerStarted","Data":"14d4c73cd766ead5c1d389e5cb534eb56b484651e5ba78d85ed1c64ea5b20f51"}
Oct 30 20:05:39.905177 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:39.905140    6275 generic.go:356] "Generic (PLEG): container finished" podID="17c0f963-82fe-4691-8950-ba4f9c5cf039" containerID="db8545b14c445024bf7ec13e75956b562f80641333a7fb011fafe28eb7afa41c" exitCode=0
Oct 30 20:05:39.905677 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:39.905231    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-1533e373-c74cs" event={"ID":"17c0f963-82fe-4691-8950-ba4f9c5cf039","Type":"ContainerDied","Data":"db8545b14c445024bf7ec13e75956b562f80641333a7fb011fafe28eb7afa41c"}
Oct 30 20:05:41.119457 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:41.117919    6275 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-1533e373-c74cs"
Oct 30 20:05:41.219111 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:41.219025    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/17c0f963-82fe-4691-8950-ba4f9c5cf039-kube-api-access-c7l2n\" (UniqueName: \"kubernetes.io/projected/17c0f963-82fe-4691-8950-ba4f9c5cf039-kube-api-access-c7l2n\") pod \"17c0f963-82fe-4691-8950-ba4f9c5cf039\" (UID: \"17c0f963-82fe-4691-8950-ba4f9c5cf039\") "
Oct 30 20:05:41.219297 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:41.219251    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/17c0f963-82fe-4691-8950-ba4f9c5cf039-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/17c0f963-82fe-4691-8950-ba4f9c5cf039-maas-api-openshift-ca\") pod \"17c0f963-82fe-4691-8950-ba4f9c5cf039\" (UID: \"17c0f963-82fe-4691-8950-ba4f9c5cf039\") "
Oct 30 20:05:41.219363 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:41.219306    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/17c0f963-82fe-4691-8950-ba4f9c5cf039-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/17c0f963-82fe-4691-8950-ba4f9c5cf039-maas-api-xks-ca\") pod \"17c0f963-82fe-4691-8950-ba4f9c5cf039\" (UID: \"17c0f963-82fe-4691-8950-ba4f9c5cf039\") "
Oct 30 20:05:41.219706 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:41.219675    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/17c0f963-82fe-4691-8950-ba4f9c5cf039-maas-api-openshift-ca" pod "17c0f963-82fe-4691-8950-ba4f9c5cf039" (UID: "17c0f963-82fe-4691-8950-ba4f9c5cf039"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:05:41.220077 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:41.220052    6275 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/17c0f963-82fe-4691-8950-ba4f9c5cf039-maas-api-openshift-ca\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:05:41.221687 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:41.221653    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/17c0f963-82fe-4691-8950-ba4f9c5cf039-maas-api-xks-ca" pod "17c0f963-82fe-4691-8950-ba4f9c5cf039" (UID: "17c0f963-82fe-4691-8950-ba4f9c5cf039"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 20:05:41.221793 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:41.221720    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/17c0f963-82fe-4691-8950-ba4f9c5cf039-kube-api-access-c7l2n" pod "17c0f963-82fe-4691-8950-ba4f9c5cf039" (UID: "17c0f963-82fe-4691-8950-ba4f9c5cf039"). InnerVolumeSpecName "kube-api-access-c7l2n". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:05:41.321379 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:41.321336    6275 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c7l2n\" (UniqueName: \"kubernetes.io/projected/17c0f963-82fe-4691-8950-ba4f9c5cf039-kube-api-access-c7l2n\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:05:41.321379 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:41.321380    6275 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/17c0f963-82fe-4691-8950-ba4f9c5cf039-maas-api-xks-ca\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:05:41.923002 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:41.922915    6275 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-1533e373-c74cs"
Oct 30 20:05:41.923002 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:41.922941    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-1533e373-c74cs" event={"ID":"17c0f963-82fe-4691-8950-ba4f9c5cf039","Type":"ContainerDied","Data":"14d4c73cd766ead5c1d389e5cb534eb56b484651e5ba78d85ed1c64ea5b20f51"}
Oct 30 20:05:41.923002 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:41.922991    6275 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="14d4c73cd766ead5c1d389e5cb534eb56b484651e5ba78d85ed1c64ea5b20f51"
Oct 30 20:05:51.685798 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:51.685749    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-912f24/simulator-w3-912f24-kserve-59897cf48b-sd5wj" podUID="b4de6427-0db0-42d9-8b88-6b35d9d4c314" containerName="main" probeResult="failure" output="Get \"https://10.134.0.54:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:05:51.717557 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:51.717509    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-626870/premium-w5-626870-kserve-5df7f7b5c4-vx59r" podUID="a1adddd4-3218-4a6b-a145-0290bceff76f" containerName="main" probeResult="failure" output="Get \"https://10.134.0.57:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:05:51.735475 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:51.718058    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-5f10d2/distinct-w1-5f10d2-kserve-5bf49798b8-l2j84" podUID="9e831c5d-2019-4015-ac57-2b4b1b90b9b3" containerName="main" probeResult="failure" output="Get \"https://10.134.0.69:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:05:51.830437 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:51.830351    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-f1f016/simulator-w4-f1f016-kserve-55db8447ff-749tw" podUID="8f3174b6-2fdc-48c2-99be-7a966731f018" containerName="main" probeResult="failure" output="Get \"https://10.134.0.55:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:05:52.053438 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:52.048791    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-5f10d2/premium-w1-5f10d2-kserve-644b846669-286m2" podUID="a2ff6903-c1ab-48dd-884b-d119b8ee1ed6" containerName="main" probeResult="failure" output="Get \"https://10.134.0.61:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:05:52.074438 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:52.067376    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-f1f016/distinct-w4-f1f016-kserve-79fbfbdbf7-hswb7" podUID="7b6639ea-72b0-49fb-b7fa-9443c1ddff6d" containerName="main" probeResult="failure" output="Get \"https://10.134.0.86:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:05:52.112436 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:52.111507    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-efbac3/premium-w2-efbac3-kserve-55f54cfff6-9fqbz" podUID="083136dc-91fb-454f-a782-87b004e73d1b" containerName="main" probeResult="failure" output="Get \"https://10.134.0.59:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:05:52.423499 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:52.420500    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-912f24/distinct-2-w3-912f24-kserve-566865fdcc-ptx4l" podUID="fcea214a-04a7-4bdd-9695-852f657edfe5" containerName="main" probeResult="failure" output="Get \"https://10.134.0.74:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:05:52.606593 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:52.606541    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-626870/distinct-2-w5-626870-kserve-98bfb9b98-xz6xj" podUID="7d49f1ad-8805-4090-8e72-7d828fa73f36" containerName="main" probeResult="failure" output="Get \"https://10.134.0.90:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:05:52.711547 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:52.689588    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-912f24/simulator-w3-912f24-kserve-59897cf48b-sd5wj" podUID="b4de6427-0db0-42d9-8b88-6b35d9d4c314" containerName="main" probeResult="failure" output="Get \"https://10.134.0.54:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:05:52.711547 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:52.690276    6275 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w3-912f24/simulator-w3-912f24-kserve-59897cf48b-sd5wj"
Oct 30 20:05:52.786440 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:52.783205    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-626870/premium-w5-626870-kserve-5df7f7b5c4-vx59r" podUID="a1adddd4-3218-4a6b-a145-0290bceff76f" containerName="main" probeResult="failure" output="Get \"https://10.134.0.57:8000/ready\": context deadline exceeded"
Oct 30 20:05:52.834437 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:52.790508    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-5f10d2/distinct-w1-5f10d2-kserve-5bf49798b8-l2j84" podUID="9e831c5d-2019-4015-ac57-2b4b1b90b9b3" containerName="main" probeResult="failure" output="Get \"https://10.134.0.69:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:05:52.834437 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:52.798474    6275 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w5-626870/premium-w5-626870-kserve-5df7f7b5c4-vx59r"
Oct 30 20:05:52.834437 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:52.798533    6275 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w1-5f10d2/distinct-w1-5f10d2-kserve-5bf49798b8-l2j84"
Oct 30 20:05:52.899463 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:52.874530    6275 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w3-912f24/distinct-2-w3-912f24-kserve-566865fdcc-ptx4l" podUID="fcea214a-04a7-4bdd-9695-852f657edfe5" containerName="main" probeResult="failure" output="Get \"https://10.134.0.74:8000/health\": context deadline exceeded"
Oct 30 20:05:52.899463 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:52.874668    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-f1f016/simulator-w4-f1f016-kserve-55db8447ff-749tw" podUID="8f3174b6-2fdc-48c2-99be-7a966731f018" containerName="main" probeResult="failure" output="Get \"https://10.134.0.55:8000/ready\": context deadline exceeded"
Oct 30 20:05:52.899463 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:52.889614    6275 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w4-f1f016/simulator-w4-f1f016-kserve-55db8447ff-749tw"
Oct 30 20:05:52.899463 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:52.890539    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-f1f016/premium-w4-f1f016-kserve-55d6bd678b-w5hkc" podUID="0e543ba9-1e7a-4d0a-9361-50c98060e824" containerName="main" probeResult="failure" output="Get \"https://10.134.0.60:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:05:52.980496 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:52.979939    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-51dd62/simulator-w6-51dd62-kserve-d6bb4985f-65j9h" podUID="f7e1ff07-15d6-49b5-8edc-52c9d6825ed7" containerName="main" probeResult="failure" output="Get \"https://10.134.0.56:8000/ready\": context deadline exceeded"
Oct 30 20:05:53.037124 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:53.037080    6275 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w4-f1f016/premium-w4-f1f016-kserve-55d6bd678b-w5hkc" podUID="0e543ba9-1e7a-4d0a-9361-50c98060e824" containerName="main" probeResult="failure" output="Get \"https://10.134.0.60:8000/health\": context deadline exceeded"
Oct 30 20:05:53.069580 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:53.069530    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-f1f016/distinct-w4-f1f016-kserve-79fbfbdbf7-hswb7" podUID="7b6639ea-72b0-49fb-b7fa-9443c1ddff6d" containerName="main" probeResult="failure" output="Get \"https://10.134.0.86:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:05:53.070291 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:53.070267    6275 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w4-f1f016/distinct-w4-f1f016-kserve-79fbfbdbf7-hswb7"
Oct 30 20:05:53.133439 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:53.081508    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-5f10d2/premium-w1-5f10d2-kserve-644b846669-286m2" podUID="a2ff6903-c1ab-48dd-884b-d119b8ee1ed6" containerName="main" probeResult="failure" output="Get \"https://10.134.0.61:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:05:53.133439 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:53.111795    6275 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w1-5f10d2/premium-w1-5f10d2-kserve-644b846669-286m2"
Oct 30 20:05:53.206833 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:53.205539    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-efbac3/premium-w2-efbac3-kserve-55f54cfff6-9fqbz" podUID="083136dc-91fb-454f-a782-87b004e73d1b" containerName="main" probeResult="failure" output="Get \"https://10.134.0.59:8000/ready\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:05:53.206833 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:53.205961    6275 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w2-efbac3/premium-w2-efbac3-kserve-55f54cfff6-9fqbz"
Oct 30 20:05:53.253500 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:53.228589    6275 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w4-f1f016/simulator-w4-f1f016-kserve-55db8447ff-749tw"
Oct 30 20:05:53.441439 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:53.440488    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-912f24/distinct-2-w3-912f24-kserve-566865fdcc-ptx4l" podUID="fcea214a-04a7-4bdd-9695-852f657edfe5" containerName="main" probeResult="failure" output="Get \"https://10.134.0.74:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:05:53.441439 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:53.440874    6275 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w3-912f24/distinct-2-w3-912f24-kserve-566865fdcc-ptx4l"
Oct 30 20:05:53.633222 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:53.633109    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-626870/distinct-2-w5-626870-kserve-98bfb9b98-xz6xj" podUID="7d49f1ad-8805-4090-8e72-7d828fa73f36" containerName="main" probeResult="failure" output="Get \"https://10.134.0.90:8000/ready\": context deadline exceeded"
Oct 30 20:05:53.669437 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:53.641736    6275 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w5-626870/distinct-2-w5-626870-kserve-98bfb9b98-xz6xj"
Oct 30 20:05:53.723667 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:53.723611    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-912f24/simulator-w3-912f24-kserve-59897cf48b-sd5wj" podUID="b4de6427-0db0-42d9-8b88-6b35d9d4c314" containerName="main" probeResult="failure" output="Get \"https://10.134.0.54:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:05:53.829635 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:53.829597    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-5f10d2/distinct-w1-5f10d2-kserve-5bf49798b8-l2j84" podUID="9e831c5d-2019-4015-ac57-2b4b1b90b9b3" containerName="main" probeResult="failure" output="Get \"https://10.134.0.69:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:05:53.843305 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:53.843256    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-626870/premium-w5-626870-kserve-5df7f7b5c4-vx59r" podUID="a1adddd4-3218-4a6b-a145-0290bceff76f" containerName="main" probeResult="failure" output="Get \"https://10.134.0.57:8000/ready\": context deadline exceeded"
Oct 30 20:05:53.917698 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:53.917577    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-f1f016/premium-w4-f1f016-kserve-55d6bd678b-w5hkc" podUID="0e543ba9-1e7a-4d0a-9361-50c98060e824" containerName="main" probeResult="failure" output="Get \"https://10.134.0.60:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:05:54.008455 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:53.993591    6275 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w4-f1f016/premium-w4-f1f016-kserve-55d6bd678b-w5hkc"
Oct 30 20:05:54.260498 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:54.046106    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-51dd62/simulator-w6-51dd62-kserve-d6bb4985f-65j9h" podUID="f7e1ff07-15d6-49b5-8edc-52c9d6825ed7" containerName="main" probeResult="failure" output="Get \"https://10.134.0.56:8000/ready\": context deadline exceeded"
Oct 30 20:05:54.266784 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:54.262027    6275 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w6-51dd62/simulator-w6-51dd62-kserve-d6bb4985f-65j9h"
Oct 30 20:05:54.266784 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:54.117888    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-f1f016/distinct-w4-f1f016-kserve-79fbfbdbf7-hswb7" podUID="7b6639ea-72b0-49fb-b7fa-9443c1ddff6d" containerName="main" probeResult="failure" output="Get \"https://10.134.0.86:8000/ready\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:05:54.270435 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:54.118909    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-5f10d2/premium-w1-5f10d2-kserve-644b846669-286m2" podUID="a2ff6903-c1ab-48dd-884b-d119b8ee1ed6" containerName="main" probeResult="failure" output="Get \"https://10.134.0.61:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:05:54.270435 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:54.212670    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-efbac3/premium-w2-efbac3-kserve-55f54cfff6-9fqbz" podUID="083136dc-91fb-454f-a782-87b004e73d1b" containerName="main" probeResult="failure" output="Get \"https://10.134.0.59:8000/ready\": context deadline exceeded"
Oct 30 20:05:54.270435 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:54.232059    6275 patch_prober.go:29] interesting pod/e2e-worker-w1-5f10d2-openshift-default-6c6777d6f5-dj7jb container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.88:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 20:05:54.270435 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:54.268965    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w1-5f10d2-openshift-default-6c6777d6f5-dj7jb" podUID="d41d4ace-e4ec-4c16-abdb-c1dcdecc40e0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.88:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:05:54.270435 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:54.232139    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-f1f016/simulator-w4-f1f016-kserve-55db8447ff-749tw" podUID="8f3174b6-2fdc-48c2-99be-7a966731f018" containerName="main" probeResult="failure" output="Get \"https://10.134.0.55:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:05:54.646507 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:54.621664    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-912f24/distinct-2-w3-912f24-kserve-566865fdcc-ptx4l" podUID="fcea214a-04a7-4bdd-9695-852f657edfe5" containerName="main" probeResult="failure" output="Get \"https://10.134.0.74:8000/ready\": context deadline exceeded"
Oct 30 20:05:54.675438 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:54.645392    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-626870/distinct-2-w5-626870-kserve-98bfb9b98-xz6xj" podUID="7d49f1ad-8805-4090-8e72-7d828fa73f36" containerName="main" probeResult="failure" output="Get \"https://10.134.0.90:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:05:54.903497 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:54.834187    6275 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w5-626870/distinct-2-w5-626870-kserve-98bfb9b98-xz6xj"
Oct 30 20:05:54.996435 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:54.990199    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-626870/premium-w5-626870-kserve-5df7f7b5c4-vx59r" podUID="a1adddd4-3218-4a6b-a145-0290bceff76f" containerName="main" probeResult="failure" output="Get \"https://10.134.0.57:8000/ready\": context deadline exceeded"
Oct 30 20:05:55.248251 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:55.235485    6275 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w2-efbac3/premium-w2-efbac3-kserve-55f54cfff6-9fqbz" podUID="083136dc-91fb-454f-a782-87b004e73d1b" containerName="main" probeResult="failure" output="Get \"https://10.134.0.59:8000/health\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:05:55.290093 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:55.269297    6275 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w6-51dd62/simulator-w6-51dd62-kserve-d6bb4985f-65j9h"
Oct 30 20:05:55.290093 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:55.269373    6275 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w3-912f24/simulator-w3-912f24-kserve-59897cf48b-sd5wj"
Oct 30 20:05:55.290093 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:55.274668    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-f1f016/premium-w4-f1f016-kserve-55d6bd678b-w5hkc" podUID="0e543ba9-1e7a-4d0a-9361-50c98060e824" containerName="main" probeResult="failure" output="Get \"https://10.134.0.60:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:05:55.312066 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:55.310527    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-5f10d2/distinct-w1-5f10d2-kserve-5bf49798b8-l2j84" podUID="9e831c5d-2019-4015-ac57-2b4b1b90b9b3" containerName="main" probeResult="failure" output="Get \"https://10.134.0.69:8000/ready\": context deadline exceeded"
Oct 30 20:05:55.316625 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:55.316577    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-5f10d2/premium-w1-5f10d2-kserve-644b846669-286m2" podUID="a2ff6903-c1ab-48dd-884b-d119b8ee1ed6" containerName="main" probeResult="failure" output="Get \"https://10.134.0.61:8000/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:05:55.342436 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:55.327906    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-efbac3/premium-w2-efbac3-kserve-55f54cfff6-9fqbz" podUID="083136dc-91fb-454f-a782-87b004e73d1b" containerName="main" probeResult="failure" output="Get \"https://10.134.0.59:8000/ready\": context deadline exceeded"
Oct 30 20:05:55.342762 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:55.334705    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-f1f016/simulator-w4-f1f016-kserve-55db8447ff-749tw" podUID="8f3174b6-2fdc-48c2-99be-7a966731f018" containerName="main" probeResult="failure" output="Get \"https://10.134.0.55:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:05:55.345519 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:55.345492    6275 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w4-f1f016/simulator-w4-f1f016-kserve-55db8447ff-749tw"
Oct 30 20:05:55.421154 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:55.420817    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-f1f016/distinct-w4-f1f016-kserve-79fbfbdbf7-hswb7" podUID="7b6639ea-72b0-49fb-b7fa-9443c1ddff6d" containerName="main" probeResult="failure" output="Get \"https://10.134.0.86:8000/ready\": context deadline exceeded"
Oct 30 20:05:55.453404 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:55.453365    6275 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w5-626870/premium-w5-626870-kserve-5df7f7b5c4-vx59r"
Oct 30 20:05:55.453680 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:55.453661    6275 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w4-f1f016/premium-w4-f1f016-kserve-55d6bd678b-w5hkc"
Oct 30 20:05:55.464122 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:55.459226    6275 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w3-912f24/distinct-2-w3-912f24-kserve-566865fdcc-ptx4l"
Oct 30 20:05:55.487434 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:55.473160    6275 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w1-5f10d2/distinct-w1-5f10d2-kserve-5bf49798b8-l2j84"
Oct 30 20:05:55.487434 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:55.473207    6275 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w1-5f10d2/premium-w1-5f10d2-kserve-644b846669-286m2"
Oct 30 20:05:55.502354 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:55.502286    6275 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w4-f1f016/simulator-w4-f1f016-kserve-55db8447ff-749tw"
Oct 30 20:05:55.502583 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:55.502566    6275 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w2-efbac3/premium-w2-efbac3-kserve-55f54cfff6-9fqbz"
Oct 30 20:05:55.515024 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:05:55.512643    6275 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w4-f1f016/distinct-w4-f1f016-kserve-79fbfbdbf7-hswb7"
Oct 30 20:05:56.263162 ip-10-0-131-26 kubenswrapper[6275]: E1030 20:05:56.263125    6275 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-fwc77" containerName="extractor"
Oct 30 20:06:02.690842 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:02.690811    6275 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-bd10c754-fl2s9"]
Oct 30 20:06:02.691460 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:02.691442    6275 cpu_manager.go:414] "containerMap: removing container" podUID="17c0f963-82fe-4691-8950-ba4f9c5cf039" containerName="revoke-keys"
Oct 30 20:06:02.691460 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:02.691459    6275 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="17c0f963-82fe-4691-8950-ba4f9c5cf039" containerName="revoke-keys"
Oct 30 20:06:02.691587 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:02.691576    6275 memory_manager.go:365] "RemoveStaleState removing state" podUID="17c0f963-82fe-4691-8950-ba4f9c5cf039" containerName="revoke-keys"
Oct 30 20:06:02.695344 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:02.695330    6275 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-bd10c754-fl2s9"
Oct 30 20:06:02.716336 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:02.716309    6275 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-bd10c754-fl2s9"]
Oct 30 20:06:02.724466 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:02.724403    6275 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\""
Oct 30 20:06:02.724594 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:02.724509    6275 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-scs2w\""
Oct 30 20:06:02.828794 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:02.828763    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/a6f740eb-f44f-4992-b923-3a4e08ce0ffc-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-bd10c754-fl2s9\" (UID: \"a6f740eb-f44f-4992-b923-3a4e08ce0ffc\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-bd10c754-fl2s9"
Oct 30 20:06:02.828984 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:02.828967    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/a6f740eb-f44f-4992-b923-3a4e08ce0ffc-maas-api-xks-ca\") pod \"maas-api-revoke-sub-bd10c754-fl2s9\" (UID: \"a6f740eb-f44f-4992-b923-3a4e08ce0ffc\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-bd10c754-fl2s9"
Oct 30 20:06:02.829036 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:02.829016    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gl8p7\" (UniqueName: \"kubernetes.io/projected/a6f740eb-f44f-4992-b923-3a4e08ce0ffc-kube-api-access-gl8p7\") pod \"maas-api-revoke-sub-bd10c754-fl2s9\" (UID: \"a6f740eb-f44f-4992-b923-3a4e08ce0ffc\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-bd10c754-fl2s9"
Oct 30 20:06:02.930008 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:02.929976    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/a6f740eb-f44f-4992-b923-3a4e08ce0ffc-maas-api-xks-ca\") pod \"maas-api-revoke-sub-bd10c754-fl2s9\" (UID: \"a6f740eb-f44f-4992-b923-3a4e08ce0ffc\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-bd10c754-fl2s9"
Oct 30 20:06:02.930139 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:02.930020    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gl8p7\" (UniqueName: \"kubernetes.io/projected/a6f740eb-f44f-4992-b923-3a4e08ce0ffc-kube-api-access-gl8p7\") pod \"maas-api-revoke-sub-bd10c754-fl2s9\" (UID: \"a6f740eb-f44f-4992-b923-3a4e08ce0ffc\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-bd10c754-fl2s9"
Oct 30 20:06:02.930139 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:02.930086    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/a6f740eb-f44f-4992-b923-3a4e08ce0ffc-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-bd10c754-fl2s9\" (UID: \"a6f740eb-f44f-4992-b923-3a4e08ce0ffc\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-bd10c754-fl2s9"
Oct 30 20:06:02.930789 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:02.930769    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/a6f740eb-f44f-4992-b923-3a4e08ce0ffc-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-bd10c754-fl2s9\" (UID: \"a6f740eb-f44f-4992-b923-3a4e08ce0ffc\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-bd10c754-fl2s9"
Oct 30 20:06:02.932323 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:02.932300    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/a6f740eb-f44f-4992-b923-3a4e08ce0ffc-maas-api-xks-ca\") pod \"maas-api-revoke-sub-bd10c754-fl2s9\" (UID: \"a6f740eb-f44f-4992-b923-3a4e08ce0ffc\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-bd10c754-fl2s9"
Oct 30 20:06:02.963926 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:02.963871    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gl8p7\" (UniqueName: \"kubernetes.io/projected/a6f740eb-f44f-4992-b923-3a4e08ce0ffc-kube-api-access-gl8p7\") pod \"maas-api-revoke-sub-bd10c754-fl2s9\" (UID: \"a6f740eb-f44f-4992-b923-3a4e08ce0ffc\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-bd10c754-fl2s9"
Oct 30 20:06:03.008892 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:03.008860    6275 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-bd10c754-fl2s9"
Oct 30 20:06:03.323083 ip-10-0-131-26 kubenswrapper[6275]: W1030 20:06:03.323056    6275 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda6f740eb_f44f_4992_b923_3a4e08ce0ffc.slice/crio-a296f9e02b4133e58eba6fd6fe67bcbab5eff87fffcc4104bec8390f6f09a81e WatchSource:0}: Error finding container a296f9e02b4133e58eba6fd6fe67bcbab5eff87fffcc4104bec8390f6f09a81e: Status 404 returned error can't find the container with id a296f9e02b4133e58eba6fd6fe67bcbab5eff87fffcc4104bec8390f6f09a81e
Oct 30 20:06:03.324096 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:03.324070    6275 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-bd10c754-fl2s9"]
Oct 30 20:06:04.324949 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:04.324916    6275 generic.go:356] "Generic (PLEG): container finished" podID="a6f740eb-f44f-4992-b923-3a4e08ce0ffc" containerID="02b7c3a38a90534a68c257a39467a9151e3021f2cb613b38ae23ffa1cf1d11e1" exitCode=0
Oct 30 20:06:04.325346 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:04.325012    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-bd10c754-fl2s9" event={"ID":"a6f740eb-f44f-4992-b923-3a4e08ce0ffc","Type":"ContainerDied","Data":"02b7c3a38a90534a68c257a39467a9151e3021f2cb613b38ae23ffa1cf1d11e1"}
Oct 30 20:06:04.325346 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:04.325066    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-bd10c754-fl2s9" event={"ID":"a6f740eb-f44f-4992-b923-3a4e08ce0ffc","Type":"ContainerStarted","Data":"a296f9e02b4133e58eba6fd6fe67bcbab5eff87fffcc4104bec8390f6f09a81e"}
Oct 30 20:06:05.507470 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:05.507444    6275 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-bd10c754-fl2s9"
Oct 30 20:06:05.665908 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:05.665825    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/a6f740eb-f44f-4992-b923-3a4e08ce0ffc-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/a6f740eb-f44f-4992-b923-3a4e08ce0ffc-maas-api-openshift-ca\") pod \"a6f740eb-f44f-4992-b923-3a4e08ce0ffc\" (UID: \"a6f740eb-f44f-4992-b923-3a4e08ce0ffc\") "
Oct 30 20:06:05.665908 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:05.665878    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/a6f740eb-f44f-4992-b923-3a4e08ce0ffc-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/a6f740eb-f44f-4992-b923-3a4e08ce0ffc-maas-api-xks-ca\") pod \"a6f740eb-f44f-4992-b923-3a4e08ce0ffc\" (UID: \"a6f740eb-f44f-4992-b923-3a4e08ce0ffc\") "
Oct 30 20:06:05.666102 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:05.665922    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/a6f740eb-f44f-4992-b923-3a4e08ce0ffc-kube-api-access-gl8p7\" (UniqueName: \"kubernetes.io/projected/a6f740eb-f44f-4992-b923-3a4e08ce0ffc-kube-api-access-gl8p7\") pod \"a6f740eb-f44f-4992-b923-3a4e08ce0ffc\" (UID: \"a6f740eb-f44f-4992-b923-3a4e08ce0ffc\") "
Oct 30 20:06:05.666176 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:05.666155    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a6f740eb-f44f-4992-b923-3a4e08ce0ffc-maas-api-openshift-ca" pod "a6f740eb-f44f-4992-b923-3a4e08ce0ffc" (UID: "a6f740eb-f44f-4992-b923-3a4e08ce0ffc"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:06:05.666577 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:05.666551    6275 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/a6f740eb-f44f-4992-b923-3a4e08ce0ffc-maas-api-openshift-ca\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:06:05.668132 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:05.668110    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a6f740eb-f44f-4992-b923-3a4e08ce0ffc-kube-api-access-gl8p7" pod "a6f740eb-f44f-4992-b923-3a4e08ce0ffc" (UID: "a6f740eb-f44f-4992-b923-3a4e08ce0ffc"). InnerVolumeSpecName "kube-api-access-gl8p7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:06:05.668239 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:05.668135    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a6f740eb-f44f-4992-b923-3a4e08ce0ffc-maas-api-xks-ca" pod "a6f740eb-f44f-4992-b923-3a4e08ce0ffc" (UID: "a6f740eb-f44f-4992-b923-3a4e08ce0ffc"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 20:06:05.767979 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:05.767945    6275 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/a6f740eb-f44f-4992-b923-3a4e08ce0ffc-maas-api-xks-ca\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:06:05.767979 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:05.767982    6275 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gl8p7\" (UniqueName: \"kubernetes.io/projected/a6f740eb-f44f-4992-b923-3a4e08ce0ffc-kube-api-access-gl8p7\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:06:06.341996 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:06.341966    6275 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-bd10c754-fl2s9"
Oct 30 20:06:06.341996 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:06.341974    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-bd10c754-fl2s9" event={"ID":"a6f740eb-f44f-4992-b923-3a4e08ce0ffc","Type":"ContainerDied","Data":"a296f9e02b4133e58eba6fd6fe67bcbab5eff87fffcc4104bec8390f6f09a81e"}
Oct 30 20:06:06.342192 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:06.342017    6275 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a296f9e02b4133e58eba6fd6fe67bcbab5eff87fffcc4104bec8390f6f09a81e"
Oct 30 20:06:06.745615 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:06.745584    6275 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-fb73b5a9-97xhd"]
Oct 30 20:06:06.746230 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:06.746214    6275 cpu_manager.go:414] "containerMap: removing container" podUID="a6f740eb-f44f-4992-b923-3a4e08ce0ffc" containerName="revoke-keys"
Oct 30 20:06:06.746230 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:06.746229    6275 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="a6f740eb-f44f-4992-b923-3a4e08ce0ffc" containerName="revoke-keys"
Oct 30 20:06:06.746361 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:06.746352    6275 memory_manager.go:365] "RemoveStaleState removing state" podUID="a6f740eb-f44f-4992-b923-3a4e08ce0ffc" containerName="revoke-keys"
Oct 30 20:06:06.752653 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:06.751293    6275 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-fb73b5a9-97xhd"
Oct 30 20:06:06.769317 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:06.769295    6275 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\""
Oct 30 20:06:06.770510 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:06.770487    6275 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-fb73b5a9-97xhd"]
Oct 30 20:06:06.777706 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:06.777681    6275 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-scs2w\""
Oct 30 20:06:06.883908 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:06.883876    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/396012b6-77a0-48cf-ae34-1fb7aa45f214-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-fb73b5a9-97xhd\" (UID: \"396012b6-77a0-48cf-ae34-1fb7aa45f214\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-fb73b5a9-97xhd"
Oct 30 20:06:06.884065 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:06.884042    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7c2gh\" (UniqueName: \"kubernetes.io/projected/396012b6-77a0-48cf-ae34-1fb7aa45f214-kube-api-access-7c2gh\") pod \"maas-api-revoke-sub-fb73b5a9-97xhd\" (UID: \"396012b6-77a0-48cf-ae34-1fb7aa45f214\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-fb73b5a9-97xhd"
Oct 30 20:06:06.884116 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:06.884101    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/396012b6-77a0-48cf-ae34-1fb7aa45f214-maas-api-xks-ca\") pod \"maas-api-revoke-sub-fb73b5a9-97xhd\" (UID: \"396012b6-77a0-48cf-ae34-1fb7aa45f214\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-fb73b5a9-97xhd"
Oct 30 20:06:06.985409 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:06.985372    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7c2gh\" (UniqueName: \"kubernetes.io/projected/396012b6-77a0-48cf-ae34-1fb7aa45f214-kube-api-access-7c2gh\") pod \"maas-api-revoke-sub-fb73b5a9-97xhd\" (UID: \"396012b6-77a0-48cf-ae34-1fb7aa45f214\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-fb73b5a9-97xhd"
Oct 30 20:06:06.985595 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:06.985457    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/396012b6-77a0-48cf-ae34-1fb7aa45f214-maas-api-xks-ca\") pod \"maas-api-revoke-sub-fb73b5a9-97xhd\" (UID: \"396012b6-77a0-48cf-ae34-1fb7aa45f214\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-fb73b5a9-97xhd"
Oct 30 20:06:06.985665 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:06.985642    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/396012b6-77a0-48cf-ae34-1fb7aa45f214-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-fb73b5a9-97xhd\" (UID: \"396012b6-77a0-48cf-ae34-1fb7aa45f214\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-fb73b5a9-97xhd"
Oct 30 20:06:06.986403 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:06.986374    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/396012b6-77a0-48cf-ae34-1fb7aa45f214-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-fb73b5a9-97xhd\" (UID: \"396012b6-77a0-48cf-ae34-1fb7aa45f214\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-fb73b5a9-97xhd"
Oct 30 20:06:06.987891 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:06.987867    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/396012b6-77a0-48cf-ae34-1fb7aa45f214-maas-api-xks-ca\") pod \"maas-api-revoke-sub-fb73b5a9-97xhd\" (UID: \"396012b6-77a0-48cf-ae34-1fb7aa45f214\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-fb73b5a9-97xhd"
Oct 30 20:06:07.010795 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:07.010746    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7c2gh\" (UniqueName: \"kubernetes.io/projected/396012b6-77a0-48cf-ae34-1fb7aa45f214-kube-api-access-7c2gh\") pod \"maas-api-revoke-sub-fb73b5a9-97xhd\" (UID: \"396012b6-77a0-48cf-ae34-1fb7aa45f214\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-fb73b5a9-97xhd"
Oct 30 20:06:07.073029 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:07.072999    6275 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-fb73b5a9-97xhd"
Oct 30 20:06:07.388450 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:07.388408    6275 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-fb73b5a9-97xhd"]
Oct 30 20:06:07.389910 ip-10-0-131-26 kubenswrapper[6275]: W1030 20:06:07.389880    6275 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod396012b6_77a0_48cf_ae34_1fb7aa45f214.slice/crio-b1933e7e7c6e9a636d83bc73bed32fe358e7f46c5206515f668c35a01641ea65 WatchSource:0}: Error finding container b1933e7e7c6e9a636d83bc73bed32fe358e7f46c5206515f668c35a01641ea65: Status 404 returned error can't find the container with id b1933e7e7c6e9a636d83bc73bed32fe358e7f46c5206515f668c35a01641ea65
Oct 30 20:06:08.358737 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:08.358705    6275 generic.go:356] "Generic (PLEG): container finished" podID="396012b6-77a0-48cf-ae34-1fb7aa45f214" containerID="5819a342726608d4281edc073e212c131a161c9f7717a58aceac370b1a5665a7" exitCode=0
Oct 30 20:06:08.359065 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:08.358793    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-fb73b5a9-97xhd" event={"ID":"396012b6-77a0-48cf-ae34-1fb7aa45f214","Type":"ContainerDied","Data":"5819a342726608d4281edc073e212c131a161c9f7717a58aceac370b1a5665a7"}
Oct 30 20:06:08.359065 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:08.358846    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-fb73b5a9-97xhd" event={"ID":"396012b6-77a0-48cf-ae34-1fb7aa45f214","Type":"ContainerStarted","Data":"b1933e7e7c6e9a636d83bc73bed32fe358e7f46c5206515f668c35a01641ea65"}
Oct 30 20:06:09.526109 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:09.526087    6275 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-fb73b5a9-97xhd"
Oct 30 20:06:09.624102 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:09.624035    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/396012b6-77a0-48cf-ae34-1fb7aa45f214-kube-api-access-7c2gh\" (UniqueName: \"kubernetes.io/projected/396012b6-77a0-48cf-ae34-1fb7aa45f214-kube-api-access-7c2gh\") pod \"396012b6-77a0-48cf-ae34-1fb7aa45f214\" (UID: \"396012b6-77a0-48cf-ae34-1fb7aa45f214\") "
Oct 30 20:06:09.624102 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:09.624090    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/396012b6-77a0-48cf-ae34-1fb7aa45f214-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/396012b6-77a0-48cf-ae34-1fb7aa45f214-maas-api-xks-ca\") pod \"396012b6-77a0-48cf-ae34-1fb7aa45f214\" (UID: \"396012b6-77a0-48cf-ae34-1fb7aa45f214\") "
Oct 30 20:06:09.624282 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:09.624220    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/396012b6-77a0-48cf-ae34-1fb7aa45f214-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/396012b6-77a0-48cf-ae34-1fb7aa45f214-maas-api-openshift-ca\") pod \"396012b6-77a0-48cf-ae34-1fb7aa45f214\" (UID: \"396012b6-77a0-48cf-ae34-1fb7aa45f214\") "
Oct 30 20:06:09.626291 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:09.625005    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/396012b6-77a0-48cf-ae34-1fb7aa45f214-maas-api-openshift-ca" pod "396012b6-77a0-48cf-ae34-1fb7aa45f214" (UID: "396012b6-77a0-48cf-ae34-1fb7aa45f214"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:06:09.626291 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:09.625671    6275 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/396012b6-77a0-48cf-ae34-1fb7aa45f214-maas-api-openshift-ca\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:06:09.627134 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:09.627100    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/396012b6-77a0-48cf-ae34-1fb7aa45f214-maas-api-xks-ca" pod "396012b6-77a0-48cf-ae34-1fb7aa45f214" (UID: "396012b6-77a0-48cf-ae34-1fb7aa45f214"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 20:06:09.627231 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:09.627187    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/396012b6-77a0-48cf-ae34-1fb7aa45f214-kube-api-access-7c2gh" pod "396012b6-77a0-48cf-ae34-1fb7aa45f214" (UID: "396012b6-77a0-48cf-ae34-1fb7aa45f214"). InnerVolumeSpecName "kube-api-access-7c2gh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:06:09.726984 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:09.726956    6275 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7c2gh\" (UniqueName: \"kubernetes.io/projected/396012b6-77a0-48cf-ae34-1fb7aa45f214-kube-api-access-7c2gh\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:06:09.727096 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:09.726987    6275 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/396012b6-77a0-48cf-ae34-1fb7aa45f214-maas-api-xks-ca\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:06:10.276049 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:10.276015    6275 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w5-626870-openshift-default-7cd649d59c-8m57h"]
Oct 30 20:06:10.276998 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:10.276966    6275 cpu_manager.go:414] "containerMap: removing container" podUID="396012b6-77a0-48cf-ae34-1fb7aa45f214" containerName="revoke-keys"
Oct 30 20:06:10.276998 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:10.276990    6275 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="396012b6-77a0-48cf-ae34-1fb7aa45f214" containerName="revoke-keys"
Oct 30 20:06:10.277189 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:10.277177    6275 memory_manager.go:365] "RemoveStaleState removing state" podUID="396012b6-77a0-48cf-ae34-1fb7aa45f214" containerName="revoke-keys"
Oct 30 20:06:10.282021 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:10.281998    6275 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-626870-openshift-default-7cd649d59c-8m57h"
Oct 30 20:06:10.312278 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:10.312243    6275 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w5-626870-openshift-default-7cd649d59c-8m57h"]
Oct 30 20:06:10.376183 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:10.376158    6275 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-fb73b5a9-97xhd"
Oct 30 20:06:10.376183 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:10.376167    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-fb73b5a9-97xhd" event={"ID":"396012b6-77a0-48cf-ae34-1fb7aa45f214","Type":"ContainerDied","Data":"b1933e7e7c6e9a636d83bc73bed32fe358e7f46c5206515f668c35a01641ea65"}
Oct 30 20:06:10.376387 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:10.376208    6275 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b1933e7e7c6e9a636d83bc73bed32fe358e7f46c5206515f668c35a01641ea65"
Oct 30 20:06:10.414597 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:10.414572    6275 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w2-efbac3-openshift-default-844cb4689c-vwdfb"]
Oct 30 20:06:10.418696 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:10.418683    6275 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-efbac3-openshift-default-844cb4689c-vwdfb"
Oct 30 20:06:10.436485 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:10.436457    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8c41c1e8-30e2-416d-a07e-cb0177f33ff6-credential-socket\") pod \"e2e-worker-w5-626870-openshift-default-7cd649d59c-8m57h\" (UID: \"8c41c1e8-30e2-416d-a07e-cb0177f33ff6\") " pod="openshift-ingress/e2e-worker-w5-626870-openshift-default-7cd649d59c-8m57h"
Oct 30 20:06:10.436585 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:10.436501    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8c41c1e8-30e2-416d-a07e-cb0177f33ff6-istio-token\") pod \"e2e-worker-w5-626870-openshift-default-7cd649d59c-8m57h\" (UID: \"8c41c1e8-30e2-416d-a07e-cb0177f33ff6\") " pod="openshift-ingress/e2e-worker-w5-626870-openshift-default-7cd649d59c-8m57h"
Oct 30 20:06:10.436585 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:10.436536    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8c41c1e8-30e2-416d-a07e-cb0177f33ff6-workload-socket\") pod \"e2e-worker-w5-626870-openshift-default-7cd649d59c-8m57h\" (UID: \"8c41c1e8-30e2-416d-a07e-cb0177f33ff6\") " pod="openshift-ingress/e2e-worker-w5-626870-openshift-default-7cd649d59c-8m57h"
Oct 30 20:06:10.436692 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:10.436667    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8c41c1e8-30e2-416d-a07e-cb0177f33ff6-istio-data\") pod \"e2e-worker-w5-626870-openshift-default-7cd649d59c-8m57h\" (UID: \"8c41c1e8-30e2-416d-a07e-cb0177f33ff6\") " pod="openshift-ingress/e2e-worker-w5-626870-openshift-default-7cd649d59c-8m57h"
Oct 30 20:06:10.436783 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:10.436753    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8c41c1e8-30e2-416d-a07e-cb0177f33ff6-istio-podinfo\") pod \"e2e-worker-w5-626870-openshift-default-7cd649d59c-8m57h\" (UID: \"8c41c1e8-30e2-416d-a07e-cb0177f33ff6\") " pod="openshift-ingress/e2e-worker-w5-626870-openshift-default-7cd649d59c-8m57h"
Oct 30 20:06:10.436901 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:10.436824    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zw7v7\" (UniqueName: \"kubernetes.io/projected/8c41c1e8-30e2-416d-a07e-cb0177f33ff6-kube-api-access-zw7v7\") pod \"e2e-worker-w5-626870-openshift-default-7cd649d59c-8m57h\" (UID: \"8c41c1e8-30e2-416d-a07e-cb0177f33ff6\") " pod="openshift-ingress/e2e-worker-w5-626870-openshift-default-7cd649d59c-8m57h"
Oct 30 20:06:10.436961 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:10.436894    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8c41c1e8-30e2-416d-a07e-cb0177f33ff6-istio-envoy\") pod \"e2e-worker-w5-626870-openshift-default-7cd649d59c-8m57h\" (UID: \"8c41c1e8-30e2-416d-a07e-cb0177f33ff6\") " pod="openshift-ingress/e2e-worker-w5-626870-openshift-default-7cd649d59c-8m57h"
Oct 30 20:06:10.436961 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:10.436935    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8c41c1e8-30e2-416d-a07e-cb0177f33ff6-istiod-ca-cert\") pod \"e2e-worker-w5-626870-openshift-default-7cd649d59c-8m57h\" (UID: \"8c41c1e8-30e2-416d-a07e-cb0177f33ff6\") " pod="openshift-ingress/e2e-worker-w5-626870-openshift-default-7cd649d59c-8m57h"
Oct 30 20:06:10.437089 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:10.437074    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8c41c1e8-30e2-416d-a07e-cb0177f33ff6-workload-certs\") pod \"e2e-worker-w5-626870-openshift-default-7cd649d59c-8m57h\" (UID: \"8c41c1e8-30e2-416d-a07e-cb0177f33ff6\") " pod="openshift-ingress/e2e-worker-w5-626870-openshift-default-7cd649d59c-8m57h"
Oct 30 20:06:10.452531 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:10.452504    6275 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w2-efbac3-openshift-default-844cb4689c-vwdfb"]
Oct 30 20:06:10.538912 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:10.538839    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8c41c1e8-30e2-416d-a07e-cb0177f33ff6-credential-socket\") pod \"e2e-worker-w5-626870-openshift-default-7cd649d59c-8m57h\" (UID: \"8c41c1e8-30e2-416d-a07e-cb0177f33ff6\") " pod="openshift-ingress/e2e-worker-w5-626870-openshift-default-7cd649d59c-8m57h"
Oct 30 20:06:10.538912 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:10.538875    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8c41c1e8-30e2-416d-a07e-cb0177f33ff6-istio-token\") pod \"e2e-worker-w5-626870-openshift-default-7cd649d59c-8m57h\" (UID: \"8c41c1e8-30e2-416d-a07e-cb0177f33ff6\") " pod="openshift-ingress/e2e-worker-w5-626870-openshift-default-7cd649d59c-8m57h"
Oct 30 20:06:10.538912 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:10.538894    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8c41c1e8-30e2-416d-a07e-cb0177f33ff6-workload-socket\") pod \"e2e-worker-w5-626870-openshift-default-7cd649d59c-8m57h\" (UID: \"8c41c1e8-30e2-416d-a07e-cb0177f33ff6\") " pod="openshift-ingress/e2e-worker-w5-626870-openshift-default-7cd649d59c-8m57h"
Oct 30 20:06:10.539491 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:10.538933    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nmskm\" (UniqueName: \"kubernetes.io/projected/04fcd0d1-5d59-485a-aba6-1e9fa4ba2144-kube-api-access-nmskm\") pod \"e2e-worker-w2-efbac3-openshift-default-844cb4689c-vwdfb\" (UID: \"04fcd0d1-5d59-485a-aba6-1e9fa4ba2144\") " pod="openshift-ingress/e2e-worker-w2-efbac3-openshift-default-844cb4689c-vwdfb"
Oct 30 20:06:10.539491 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:10.538962    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8c41c1e8-30e2-416d-a07e-cb0177f33ff6-istio-data\") pod \"e2e-worker-w5-626870-openshift-default-7cd649d59c-8m57h\" (UID: \"8c41c1e8-30e2-416d-a07e-cb0177f33ff6\") " pod="openshift-ingress/e2e-worker-w5-626870-openshift-default-7cd649d59c-8m57h"
Oct 30 20:06:10.539491 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:10.539158    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/04fcd0d1-5d59-485a-aba6-1e9fa4ba2144-istio-envoy\") pod \"e2e-worker-w2-efbac3-openshift-default-844cb4689c-vwdfb\" (UID: \"04fcd0d1-5d59-485a-aba6-1e9fa4ba2144\") " pod="openshift-ingress/e2e-worker-w2-efbac3-openshift-default-844cb4689c-vwdfb"
Oct 30 20:06:10.539491 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:10.539224    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8c41c1e8-30e2-416d-a07e-cb0177f33ff6-istio-podinfo\") pod \"e2e-worker-w5-626870-openshift-default-7cd649d59c-8m57h\" (UID: \"8c41c1e8-30e2-416d-a07e-cb0177f33ff6\") " pod="openshift-ingress/e2e-worker-w5-626870-openshift-default-7cd649d59c-8m57h"
Oct 30 20:06:10.539491 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:10.539258    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zw7v7\" (UniqueName: \"kubernetes.io/projected/8c41c1e8-30e2-416d-a07e-cb0177f33ff6-kube-api-access-zw7v7\") pod \"e2e-worker-w5-626870-openshift-default-7cd649d59c-8m57h\" (UID: \"8c41c1e8-30e2-416d-a07e-cb0177f33ff6\") " pod="openshift-ingress/e2e-worker-w5-626870-openshift-default-7cd649d59c-8m57h"
Oct 30 20:06:10.539491 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:10.539286    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/04fcd0d1-5d59-485a-aba6-1e9fa4ba2144-istio-token\") pod \"e2e-worker-w2-efbac3-openshift-default-844cb4689c-vwdfb\" (UID: \"04fcd0d1-5d59-485a-aba6-1e9fa4ba2144\") " pod="openshift-ingress/e2e-worker-w2-efbac3-openshift-default-844cb4689c-vwdfb"
Oct 30 20:06:10.539491 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:10.539294    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8c41c1e8-30e2-416d-a07e-cb0177f33ff6-credential-socket\") pod \"e2e-worker-w5-626870-openshift-default-7cd649d59c-8m57h\" (UID: \"8c41c1e8-30e2-416d-a07e-cb0177f33ff6\") " pod="openshift-ingress/e2e-worker-w5-626870-openshift-default-7cd649d59c-8m57h"
Oct 30 20:06:10.539491 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:10.539321    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8c41c1e8-30e2-416d-a07e-cb0177f33ff6-workload-socket\") pod \"e2e-worker-w5-626870-openshift-default-7cd649d59c-8m57h\" (UID: \"8c41c1e8-30e2-416d-a07e-cb0177f33ff6\") " pod="openshift-ingress/e2e-worker-w5-626870-openshift-default-7cd649d59c-8m57h"
Oct 30 20:06:10.539491 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:10.539349    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8c41c1e8-30e2-416d-a07e-cb0177f33ff6-istio-data\") pod \"e2e-worker-w5-626870-openshift-default-7cd649d59c-8m57h\" (UID: \"8c41c1e8-30e2-416d-a07e-cb0177f33ff6\") " pod="openshift-ingress/e2e-worker-w5-626870-openshift-default-7cd649d59c-8m57h"
Oct 30 20:06:10.539491 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:10.539384    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8c41c1e8-30e2-416d-a07e-cb0177f33ff6-istio-envoy\") pod \"e2e-worker-w5-626870-openshift-default-7cd649d59c-8m57h\" (UID: \"8c41c1e8-30e2-416d-a07e-cb0177f33ff6\") " pod="openshift-ingress/e2e-worker-w5-626870-openshift-default-7cd649d59c-8m57h"
Oct 30 20:06:10.539491 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:10.539430    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/04fcd0d1-5d59-485a-aba6-1e9fa4ba2144-istiod-ca-cert\") pod \"e2e-worker-w2-efbac3-openshift-default-844cb4689c-vwdfb\" (UID: \"04fcd0d1-5d59-485a-aba6-1e9fa4ba2144\") " pod="openshift-ingress/e2e-worker-w2-efbac3-openshift-default-844cb4689c-vwdfb"
Oct 30 20:06:10.539491 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:10.539468    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8c41c1e8-30e2-416d-a07e-cb0177f33ff6-istiod-ca-cert\") pod \"e2e-worker-w5-626870-openshift-default-7cd649d59c-8m57h\" (UID: \"8c41c1e8-30e2-416d-a07e-cb0177f33ff6\") " pod="openshift-ingress/e2e-worker-w5-626870-openshift-default-7cd649d59c-8m57h"
Oct 30 20:06:10.539979 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:10.539571    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/04fcd0d1-5d59-485a-aba6-1e9fa4ba2144-workload-certs\") pod \"e2e-worker-w2-efbac3-openshift-default-844cb4689c-vwdfb\" (UID: \"04fcd0d1-5d59-485a-aba6-1e9fa4ba2144\") " pod="openshift-ingress/e2e-worker-w2-efbac3-openshift-default-844cb4689c-vwdfb"
Oct 30 20:06:10.539979 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:10.539596    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/04fcd0d1-5d59-485a-aba6-1e9fa4ba2144-istio-podinfo\") pod \"e2e-worker-w2-efbac3-openshift-default-844cb4689c-vwdfb\" (UID: \"04fcd0d1-5d59-485a-aba6-1e9fa4ba2144\") " pod="openshift-ingress/e2e-worker-w2-efbac3-openshift-default-844cb4689c-vwdfb"
Oct 30 20:06:10.539979 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:10.539618    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/04fcd0d1-5d59-485a-aba6-1e9fa4ba2144-credential-socket\") pod \"e2e-worker-w2-efbac3-openshift-default-844cb4689c-vwdfb\" (UID: \"04fcd0d1-5d59-485a-aba6-1e9fa4ba2144\") " pod="openshift-ingress/e2e-worker-w2-efbac3-openshift-default-844cb4689c-vwdfb"
Oct 30 20:06:10.539979 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:10.539695    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/04fcd0d1-5d59-485a-aba6-1e9fa4ba2144-workload-socket\") pod \"e2e-worker-w2-efbac3-openshift-default-844cb4689c-vwdfb\" (UID: \"04fcd0d1-5d59-485a-aba6-1e9fa4ba2144\") " pod="openshift-ingress/e2e-worker-w2-efbac3-openshift-default-844cb4689c-vwdfb"
Oct 30 20:06:10.539979 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:10.539713    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/04fcd0d1-5d59-485a-aba6-1e9fa4ba2144-istio-data\") pod \"e2e-worker-w2-efbac3-openshift-default-844cb4689c-vwdfb\" (UID: \"04fcd0d1-5d59-485a-aba6-1e9fa4ba2144\") " pod="openshift-ingress/e2e-worker-w2-efbac3-openshift-default-844cb4689c-vwdfb"
Oct 30 20:06:10.539979 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:10.539827    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8c41c1e8-30e2-416d-a07e-cb0177f33ff6-workload-certs\") pod \"e2e-worker-w5-626870-openshift-default-7cd649d59c-8m57h\" (UID: \"8c41c1e8-30e2-416d-a07e-cb0177f33ff6\") " pod="openshift-ingress/e2e-worker-w5-626870-openshift-default-7cd649d59c-8m57h"
Oct 30 20:06:10.540251 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:10.540138    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8c41c1e8-30e2-416d-a07e-cb0177f33ff6-workload-certs\") pod \"e2e-worker-w5-626870-openshift-default-7cd649d59c-8m57h\" (UID: \"8c41c1e8-30e2-416d-a07e-cb0177f33ff6\") " pod="openshift-ingress/e2e-worker-w5-626870-openshift-default-7cd649d59c-8m57h"
Oct 30 20:06:10.540251 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:10.540208    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8c41c1e8-30e2-416d-a07e-cb0177f33ff6-istiod-ca-cert\") pod \"e2e-worker-w5-626870-openshift-default-7cd649d59c-8m57h\" (UID: \"8c41c1e8-30e2-416d-a07e-cb0177f33ff6\") " pod="openshift-ingress/e2e-worker-w5-626870-openshift-default-7cd649d59c-8m57h"
Oct 30 20:06:10.541389 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:10.541370    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8c41c1e8-30e2-416d-a07e-cb0177f33ff6-istio-envoy\") pod \"e2e-worker-w5-626870-openshift-default-7cd649d59c-8m57h\" (UID: \"8c41c1e8-30e2-416d-a07e-cb0177f33ff6\") " pod="openshift-ingress/e2e-worker-w5-626870-openshift-default-7cd649d59c-8m57h"
Oct 30 20:06:10.541661 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:10.541644    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8c41c1e8-30e2-416d-a07e-cb0177f33ff6-istio-podinfo\") pod \"e2e-worker-w5-626870-openshift-default-7cd649d59c-8m57h\" (UID: \"8c41c1e8-30e2-416d-a07e-cb0177f33ff6\") " pod="openshift-ingress/e2e-worker-w5-626870-openshift-default-7cd649d59c-8m57h"
Oct 30 20:06:10.567246 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:10.567220    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zw7v7\" (UniqueName: \"kubernetes.io/projected/8c41c1e8-30e2-416d-a07e-cb0177f33ff6-kube-api-access-zw7v7\") pod \"e2e-worker-w5-626870-openshift-default-7cd649d59c-8m57h\" (UID: \"8c41c1e8-30e2-416d-a07e-cb0177f33ff6\") " pod="openshift-ingress/e2e-worker-w5-626870-openshift-default-7cd649d59c-8m57h"
Oct 30 20:06:10.568486 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:10.568466    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8c41c1e8-30e2-416d-a07e-cb0177f33ff6-istio-token\") pod \"e2e-worker-w5-626870-openshift-default-7cd649d59c-8m57h\" (UID: \"8c41c1e8-30e2-416d-a07e-cb0177f33ff6\") " pod="openshift-ingress/e2e-worker-w5-626870-openshift-default-7cd649d59c-8m57h"
Oct 30 20:06:10.601407 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:10.601384    6275 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-626870-openshift-default-7cd649d59c-8m57h"
Oct 30 20:06:10.640827 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:10.640794    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/04fcd0d1-5d59-485a-aba6-1e9fa4ba2144-workload-socket\") pod \"e2e-worker-w2-efbac3-openshift-default-844cb4689c-vwdfb\" (UID: \"04fcd0d1-5d59-485a-aba6-1e9fa4ba2144\") " pod="openshift-ingress/e2e-worker-w2-efbac3-openshift-default-844cb4689c-vwdfb"
Oct 30 20:06:10.640945 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:10.640833    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/04fcd0d1-5d59-485a-aba6-1e9fa4ba2144-istio-data\") pod \"e2e-worker-w2-efbac3-openshift-default-844cb4689c-vwdfb\" (UID: \"04fcd0d1-5d59-485a-aba6-1e9fa4ba2144\") " pod="openshift-ingress/e2e-worker-w2-efbac3-openshift-default-844cb4689c-vwdfb"
Oct 30 20:06:10.641036 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:10.641019    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nmskm\" (UniqueName: \"kubernetes.io/projected/04fcd0d1-5d59-485a-aba6-1e9fa4ba2144-kube-api-access-nmskm\") pod \"e2e-worker-w2-efbac3-openshift-default-844cb4689c-vwdfb\" (UID: \"04fcd0d1-5d59-485a-aba6-1e9fa4ba2144\") " pod="openshift-ingress/e2e-worker-w2-efbac3-openshift-default-844cb4689c-vwdfb"
Oct 30 20:06:10.641134 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:10.641115    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/04fcd0d1-5d59-485a-aba6-1e9fa4ba2144-istio-envoy\") pod \"e2e-worker-w2-efbac3-openshift-default-844cb4689c-vwdfb\" (UID: \"04fcd0d1-5d59-485a-aba6-1e9fa4ba2144\") " pod="openshift-ingress/e2e-worker-w2-efbac3-openshift-default-844cb4689c-vwdfb"
Oct 30 20:06:10.641210 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:10.641194    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/04fcd0d1-5d59-485a-aba6-1e9fa4ba2144-istio-token\") pod \"e2e-worker-w2-efbac3-openshift-default-844cb4689c-vwdfb\" (UID: \"04fcd0d1-5d59-485a-aba6-1e9fa4ba2144\") " pod="openshift-ingress/e2e-worker-w2-efbac3-openshift-default-844cb4689c-vwdfb"
Oct 30 20:06:10.641269 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:10.641228    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/04fcd0d1-5d59-485a-aba6-1e9fa4ba2144-workload-socket\") pod \"e2e-worker-w2-efbac3-openshift-default-844cb4689c-vwdfb\" (UID: \"04fcd0d1-5d59-485a-aba6-1e9fa4ba2144\") " pod="openshift-ingress/e2e-worker-w2-efbac3-openshift-default-844cb4689c-vwdfb"
Oct 30 20:06:10.641269 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:10.641259    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/04fcd0d1-5d59-485a-aba6-1e9fa4ba2144-istiod-ca-cert\") pod \"e2e-worker-w2-efbac3-openshift-default-844cb4689c-vwdfb\" (UID: \"04fcd0d1-5d59-485a-aba6-1e9fa4ba2144\") " pod="openshift-ingress/e2e-worker-w2-efbac3-openshift-default-844cb4689c-vwdfb"
Oct 30 20:06:10.641377 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:10.641256    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/04fcd0d1-5d59-485a-aba6-1e9fa4ba2144-istio-data\") pod \"e2e-worker-w2-efbac3-openshift-default-844cb4689c-vwdfb\" (UID: \"04fcd0d1-5d59-485a-aba6-1e9fa4ba2144\") " pod="openshift-ingress/e2e-worker-w2-efbac3-openshift-default-844cb4689c-vwdfb"
Oct 30 20:06:10.641467 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:10.641337    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/04fcd0d1-5d59-485a-aba6-1e9fa4ba2144-workload-certs\") pod \"e2e-worker-w2-efbac3-openshift-default-844cb4689c-vwdfb\" (UID: \"04fcd0d1-5d59-485a-aba6-1e9fa4ba2144\") " pod="openshift-ingress/e2e-worker-w2-efbac3-openshift-default-844cb4689c-vwdfb"
Oct 30 20:06:10.641467 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:10.641428    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/04fcd0d1-5d59-485a-aba6-1e9fa4ba2144-istio-podinfo\") pod \"e2e-worker-w2-efbac3-openshift-default-844cb4689c-vwdfb\" (UID: \"04fcd0d1-5d59-485a-aba6-1e9fa4ba2144\") " pod="openshift-ingress/e2e-worker-w2-efbac3-openshift-default-844cb4689c-vwdfb"
Oct 30 20:06:10.641467 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:10.641458    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/04fcd0d1-5d59-485a-aba6-1e9fa4ba2144-credential-socket\") pod \"e2e-worker-w2-efbac3-openshift-default-844cb4689c-vwdfb\" (UID: \"04fcd0d1-5d59-485a-aba6-1e9fa4ba2144\") " pod="openshift-ingress/e2e-worker-w2-efbac3-openshift-default-844cb4689c-vwdfb"
Oct 30 20:06:10.641703 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:10.641678    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/04fcd0d1-5d59-485a-aba6-1e9fa4ba2144-workload-certs\") pod \"e2e-worker-w2-efbac3-openshift-default-844cb4689c-vwdfb\" (UID: \"04fcd0d1-5d59-485a-aba6-1e9fa4ba2144\") " pod="openshift-ingress/e2e-worker-w2-efbac3-openshift-default-844cb4689c-vwdfb"
Oct 30 20:06:10.641822 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:10.641784    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/04fcd0d1-5d59-485a-aba6-1e9fa4ba2144-credential-socket\") pod \"e2e-worker-w2-efbac3-openshift-default-844cb4689c-vwdfb\" (UID: \"04fcd0d1-5d59-485a-aba6-1e9fa4ba2144\") " pod="openshift-ingress/e2e-worker-w2-efbac3-openshift-default-844cb4689c-vwdfb"
Oct 30 20:06:10.642000 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:10.641958    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/04fcd0d1-5d59-485a-aba6-1e9fa4ba2144-istiod-ca-cert\") pod \"e2e-worker-w2-efbac3-openshift-default-844cb4689c-vwdfb\" (UID: \"04fcd0d1-5d59-485a-aba6-1e9fa4ba2144\") " pod="openshift-ingress/e2e-worker-w2-efbac3-openshift-default-844cb4689c-vwdfb"
Oct 30 20:06:10.643318 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:10.643290    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/04fcd0d1-5d59-485a-aba6-1e9fa4ba2144-istio-envoy\") pod \"e2e-worker-w2-efbac3-openshift-default-844cb4689c-vwdfb\" (UID: \"04fcd0d1-5d59-485a-aba6-1e9fa4ba2144\") " pod="openshift-ingress/e2e-worker-w2-efbac3-openshift-default-844cb4689c-vwdfb"
Oct 30 20:06:10.643667 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:10.643650    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/04fcd0d1-5d59-485a-aba6-1e9fa4ba2144-istio-podinfo\") pod \"e2e-worker-w2-efbac3-openshift-default-844cb4689c-vwdfb\" (UID: \"04fcd0d1-5d59-485a-aba6-1e9fa4ba2144\") " pod="openshift-ingress/e2e-worker-w2-efbac3-openshift-default-844cb4689c-vwdfb"
Oct 30 20:06:10.671309 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:10.667746    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/04fcd0d1-5d59-485a-aba6-1e9fa4ba2144-istio-token\") pod \"e2e-worker-w2-efbac3-openshift-default-844cb4689c-vwdfb\" (UID: \"04fcd0d1-5d59-485a-aba6-1e9fa4ba2144\") " pod="openshift-ingress/e2e-worker-w2-efbac3-openshift-default-844cb4689c-vwdfb"
Oct 30 20:06:10.671309 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:10.671243    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nmskm\" (UniqueName: \"kubernetes.io/projected/04fcd0d1-5d59-485a-aba6-1e9fa4ba2144-kube-api-access-nmskm\") pod \"e2e-worker-w2-efbac3-openshift-default-844cb4689c-vwdfb\" (UID: \"04fcd0d1-5d59-485a-aba6-1e9fa4ba2144\") " pod="openshift-ingress/e2e-worker-w2-efbac3-openshift-default-844cb4689c-vwdfb"
Oct 30 20:06:10.733263 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:10.733232    6275 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-efbac3-openshift-default-844cb4689c-vwdfb"
Oct 30 20:06:10.925834 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:10.925790    6275 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w3-912f24-openshift-default-5f56ff5f6c-sth92"]
Oct 30 20:06:10.931372 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:10.931348    6275 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-912f24-openshift-default-5f56ff5f6c-sth92"
Oct 30 20:06:10.951116 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:10.951098    6275 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w5-626870-openshift-default-7cd649d59c-8m57h"]
Oct 30 20:06:10.954056 ip-10-0-131-26 kubenswrapper[6275]: W1030 20:06:10.954024    6275 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8c41c1e8_30e2_416d_a07e_cb0177f33ff6.slice/crio-10989ffe3bfec8ab10590ee2f600c2129693b114b5a3dcd6d646fbbb4cfc94e5 WatchSource:0}: Error finding container 10989ffe3bfec8ab10590ee2f600c2129693b114b5a3dcd6d646fbbb4cfc94e5: Status 404 returned error can't find the container with id 10989ffe3bfec8ab10590ee2f600c2129693b114b5a3dcd6d646fbbb4cfc94e5
Oct 30 20:06:10.956451 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:10.956409    6275 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Oct 30 20:06:10.956522 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:10.956482    6275 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Oct 30 20:06:10.956522 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:10.956510    6275 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Oct 30 20:06:10.974046 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:10.974023    6275 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w3-912f24-openshift-default-5f56ff5f6c-sth92"]
Oct 30 20:06:11.047674 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:11.047606    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5tsjx\" (UniqueName: \"kubernetes.io/projected/8a7d6f48-c37d-4f85-82e1-46b8b330b366-kube-api-access-5tsjx\") pod \"e2e-worker-w3-912f24-openshift-default-5f56ff5f6c-sth92\" (UID: \"8a7d6f48-c37d-4f85-82e1-46b8b330b366\") " pod="openshift-ingress/e2e-worker-w3-912f24-openshift-default-5f56ff5f6c-sth92"
Oct 30 20:06:11.047674 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:11.047658    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8a7d6f48-c37d-4f85-82e1-46b8b330b366-istiod-ca-cert\") pod \"e2e-worker-w3-912f24-openshift-default-5f56ff5f6c-sth92\" (UID: \"8a7d6f48-c37d-4f85-82e1-46b8b330b366\") " pod="openshift-ingress/e2e-worker-w3-912f24-openshift-default-5f56ff5f6c-sth92"
Oct 30 20:06:11.047815 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:11.047754    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8a7d6f48-c37d-4f85-82e1-46b8b330b366-istio-envoy\") pod \"e2e-worker-w3-912f24-openshift-default-5f56ff5f6c-sth92\" (UID: \"8a7d6f48-c37d-4f85-82e1-46b8b330b366\") " pod="openshift-ingress/e2e-worker-w3-912f24-openshift-default-5f56ff5f6c-sth92"
Oct 30 20:06:11.047815 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:11.047804    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8a7d6f48-c37d-4f85-82e1-46b8b330b366-istio-token\") pod \"e2e-worker-w3-912f24-openshift-default-5f56ff5f6c-sth92\" (UID: \"8a7d6f48-c37d-4f85-82e1-46b8b330b366\") " pod="openshift-ingress/e2e-worker-w3-912f24-openshift-default-5f56ff5f6c-sth92"
Oct 30 20:06:11.047887 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:11.047826    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8a7d6f48-c37d-4f85-82e1-46b8b330b366-credential-socket\") pod \"e2e-worker-w3-912f24-openshift-default-5f56ff5f6c-sth92\" (UID: \"8a7d6f48-c37d-4f85-82e1-46b8b330b366\") " pod="openshift-ingress/e2e-worker-w3-912f24-openshift-default-5f56ff5f6c-sth92"
Oct 30 20:06:11.048136 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:11.048107    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8a7d6f48-c37d-4f85-82e1-46b8b330b366-workload-socket\") pod \"e2e-worker-w3-912f24-openshift-default-5f56ff5f6c-sth92\" (UID: \"8a7d6f48-c37d-4f85-82e1-46b8b330b366\") " pod="openshift-ingress/e2e-worker-w3-912f24-openshift-default-5f56ff5f6c-sth92"
Oct 30 20:06:11.048251 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:11.048225    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8a7d6f48-c37d-4f85-82e1-46b8b330b366-workload-certs\") pod \"e2e-worker-w3-912f24-openshift-default-5f56ff5f6c-sth92\" (UID: \"8a7d6f48-c37d-4f85-82e1-46b8b330b366\") " pod="openshift-ingress/e2e-worker-w3-912f24-openshift-default-5f56ff5f6c-sth92"
Oct 30 20:06:11.048387 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:11.048319    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8a7d6f48-c37d-4f85-82e1-46b8b330b366-istio-data\") pod \"e2e-worker-w3-912f24-openshift-default-5f56ff5f6c-sth92\" (UID: \"8a7d6f48-c37d-4f85-82e1-46b8b330b366\") " pod="openshift-ingress/e2e-worker-w3-912f24-openshift-default-5f56ff5f6c-sth92"
Oct 30 20:06:11.048485 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:11.048439    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8a7d6f48-c37d-4f85-82e1-46b8b330b366-istio-podinfo\") pod \"e2e-worker-w3-912f24-openshift-default-5f56ff5f6c-sth92\" (UID: \"8a7d6f48-c37d-4f85-82e1-46b8b330b366\") " pod="openshift-ingress/e2e-worker-w3-912f24-openshift-default-5f56ff5f6c-sth92"
Oct 30 20:06:11.056828 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:11.056688    6275 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w2-efbac3-openshift-default-844cb4689c-vwdfb"]
Oct 30 20:06:11.058655 ip-10-0-131-26 kubenswrapper[6275]: W1030 20:06:11.058617    6275 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod04fcd0d1_5d59_485a_aba6_1e9fa4ba2144.slice/crio-e980bed991a64166f89093f2ba4dc7c6b363f1e5508ae95a4973e0e5f3962eee WatchSource:0}: Error finding container e980bed991a64166f89093f2ba4dc7c6b363f1e5508ae95a4973e0e5f3962eee: Status 404 returned error can't find the container with id e980bed991a64166f89093f2ba4dc7c6b363f1e5508ae95a4973e0e5f3962eee
Oct 30 20:06:11.060894 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:11.060857    6275 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Oct 30 20:06:11.061000 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:11.060934    6275 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Oct 30 20:06:11.061000 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:11.060978    6275 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Oct 30 20:06:11.150032 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:11.150006    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8a7d6f48-c37d-4f85-82e1-46b8b330b366-workload-socket\") pod \"e2e-worker-w3-912f24-openshift-default-5f56ff5f6c-sth92\" (UID: \"8a7d6f48-c37d-4f85-82e1-46b8b330b366\") " pod="openshift-ingress/e2e-worker-w3-912f24-openshift-default-5f56ff5f6c-sth92"
Oct 30 20:06:11.150183 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:11.150105    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8a7d6f48-c37d-4f85-82e1-46b8b330b366-workload-certs\") pod \"e2e-worker-w3-912f24-openshift-default-5f56ff5f6c-sth92\" (UID: \"8a7d6f48-c37d-4f85-82e1-46b8b330b366\") " pod="openshift-ingress/e2e-worker-w3-912f24-openshift-default-5f56ff5f6c-sth92"
Oct 30 20:06:11.150183 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:11.150175    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8a7d6f48-c37d-4f85-82e1-46b8b330b366-istio-data\") pod \"e2e-worker-w3-912f24-openshift-default-5f56ff5f6c-sth92\" (UID: \"8a7d6f48-c37d-4f85-82e1-46b8b330b366\") " pod="openshift-ingress/e2e-worker-w3-912f24-openshift-default-5f56ff5f6c-sth92"
Oct 30 20:06:11.150301 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:11.150257    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8a7d6f48-c37d-4f85-82e1-46b8b330b366-istio-podinfo\") pod \"e2e-worker-w3-912f24-openshift-default-5f56ff5f6c-sth92\" (UID: \"8a7d6f48-c37d-4f85-82e1-46b8b330b366\") " pod="openshift-ingress/e2e-worker-w3-912f24-openshift-default-5f56ff5f6c-sth92"
Oct 30 20:06:11.150356 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:11.150308    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5tsjx\" (UniqueName: \"kubernetes.io/projected/8a7d6f48-c37d-4f85-82e1-46b8b330b366-kube-api-access-5tsjx\") pod \"e2e-worker-w3-912f24-openshift-default-5f56ff5f6c-sth92\" (UID: \"8a7d6f48-c37d-4f85-82e1-46b8b330b366\") " pod="openshift-ingress/e2e-worker-w3-912f24-openshift-default-5f56ff5f6c-sth92"
Oct 30 20:06:11.150406 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:11.150351    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8a7d6f48-c37d-4f85-82e1-46b8b330b366-istiod-ca-cert\") pod \"e2e-worker-w3-912f24-openshift-default-5f56ff5f6c-sth92\" (UID: \"8a7d6f48-c37d-4f85-82e1-46b8b330b366\") " pod="openshift-ingress/e2e-worker-w3-912f24-openshift-default-5f56ff5f6c-sth92"
Oct 30 20:06:11.150406 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:11.150390    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8a7d6f48-c37d-4f85-82e1-46b8b330b366-workload-socket\") pod \"e2e-worker-w3-912f24-openshift-default-5f56ff5f6c-sth92\" (UID: \"8a7d6f48-c37d-4f85-82e1-46b8b330b366\") " pod="openshift-ingress/e2e-worker-w3-912f24-openshift-default-5f56ff5f6c-sth92"
Oct 30 20:06:11.150529 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:11.150394    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8a7d6f48-c37d-4f85-82e1-46b8b330b366-istio-envoy\") pod \"e2e-worker-w3-912f24-openshift-default-5f56ff5f6c-sth92\" (UID: \"8a7d6f48-c37d-4f85-82e1-46b8b330b366\") " pod="openshift-ingress/e2e-worker-w3-912f24-openshift-default-5f56ff5f6c-sth92"
Oct 30 20:06:11.150529 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:11.150512    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8a7d6f48-c37d-4f85-82e1-46b8b330b366-istio-token\") pod \"e2e-worker-w3-912f24-openshift-default-5f56ff5f6c-sth92\" (UID: \"8a7d6f48-c37d-4f85-82e1-46b8b330b366\") " pod="openshift-ingress/e2e-worker-w3-912f24-openshift-default-5f56ff5f6c-sth92"
Oct 30 20:06:11.150617 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:11.150541    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8a7d6f48-c37d-4f85-82e1-46b8b330b366-credential-socket\") pod \"e2e-worker-w3-912f24-openshift-default-5f56ff5f6c-sth92\" (UID: \"8a7d6f48-c37d-4f85-82e1-46b8b330b366\") " pod="openshift-ingress/e2e-worker-w3-912f24-openshift-default-5f56ff5f6c-sth92"
Oct 30 20:06:11.150827 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:11.150804    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8a7d6f48-c37d-4f85-82e1-46b8b330b366-workload-certs\") pod \"e2e-worker-w3-912f24-openshift-default-5f56ff5f6c-sth92\" (UID: \"8a7d6f48-c37d-4f85-82e1-46b8b330b366\") " pod="openshift-ingress/e2e-worker-w3-912f24-openshift-default-5f56ff5f6c-sth92"
Oct 30 20:06:11.150975 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:11.150946    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8a7d6f48-c37d-4f85-82e1-46b8b330b366-credential-socket\") pod \"e2e-worker-w3-912f24-openshift-default-5f56ff5f6c-sth92\" (UID: \"8a7d6f48-c37d-4f85-82e1-46b8b330b366\") " pod="openshift-ingress/e2e-worker-w3-912f24-openshift-default-5f56ff5f6c-sth92"
Oct 30 20:06:11.151106 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:11.151071    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8a7d6f48-c37d-4f85-82e1-46b8b330b366-istio-data\") pod \"e2e-worker-w3-912f24-openshift-default-5f56ff5f6c-sth92\" (UID: \"8a7d6f48-c37d-4f85-82e1-46b8b330b366\") " pod="openshift-ingress/e2e-worker-w3-912f24-openshift-default-5f56ff5f6c-sth92"
Oct 30 20:06:11.152080 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:11.151753    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8a7d6f48-c37d-4f85-82e1-46b8b330b366-istiod-ca-cert\") pod \"e2e-worker-w3-912f24-openshift-default-5f56ff5f6c-sth92\" (UID: \"8a7d6f48-c37d-4f85-82e1-46b8b330b366\") " pod="openshift-ingress/e2e-worker-w3-912f24-openshift-default-5f56ff5f6c-sth92"
Oct 30 20:06:11.154131 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:11.154109    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8a7d6f48-c37d-4f85-82e1-46b8b330b366-istio-envoy\") pod \"e2e-worker-w3-912f24-openshift-default-5f56ff5f6c-sth92\" (UID: \"8a7d6f48-c37d-4f85-82e1-46b8b330b366\") " pod="openshift-ingress/e2e-worker-w3-912f24-openshift-default-5f56ff5f6c-sth92"
Oct 30 20:06:11.154207 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:11.154181    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8a7d6f48-c37d-4f85-82e1-46b8b330b366-istio-podinfo\") pod \"e2e-worker-w3-912f24-openshift-default-5f56ff5f6c-sth92\" (UID: \"8a7d6f48-c37d-4f85-82e1-46b8b330b366\") " pod="openshift-ingress/e2e-worker-w3-912f24-openshift-default-5f56ff5f6c-sth92"
Oct 30 20:06:11.176811 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:11.176787    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5tsjx\" (UniqueName: \"kubernetes.io/projected/8a7d6f48-c37d-4f85-82e1-46b8b330b366-kube-api-access-5tsjx\") pod \"e2e-worker-w3-912f24-openshift-default-5f56ff5f6c-sth92\" (UID: \"8a7d6f48-c37d-4f85-82e1-46b8b330b366\") " pod="openshift-ingress/e2e-worker-w3-912f24-openshift-default-5f56ff5f6c-sth92"
Oct 30 20:06:11.177275 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:11.177242    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8a7d6f48-c37d-4f85-82e1-46b8b330b366-istio-token\") pod \"e2e-worker-w3-912f24-openshift-default-5f56ff5f6c-sth92\" (UID: \"8a7d6f48-c37d-4f85-82e1-46b8b330b366\") " pod="openshift-ingress/e2e-worker-w3-912f24-openshift-default-5f56ff5f6c-sth92"
Oct 30 20:06:11.247831 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:11.247489    6275 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-912f24-openshift-default-5f56ff5f6c-sth92"
Oct 30 20:06:11.410997 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:11.409612    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-626870-openshift-default-7cd649d59c-8m57h" event={"ID":"8c41c1e8-30e2-416d-a07e-cb0177f33ff6","Type":"ContainerStarted","Data":"443795b6bb8c0729620eaa585eb2a7e5d7c07ad6ba02cc7ec7b66e2705faf32b"}
Oct 30 20:06:11.410997 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:11.409691    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-626870-openshift-default-7cd649d59c-8m57h" event={"ID":"8c41c1e8-30e2-416d-a07e-cb0177f33ff6","Type":"ContainerStarted","Data":"10989ffe3bfec8ab10590ee2f600c2129693b114b5a3dcd6d646fbbb4cfc94e5"}
Oct 30 20:06:11.411843 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:11.411820    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-efbac3-openshift-default-844cb4689c-vwdfb" event={"ID":"04fcd0d1-5d59-485a-aba6-1e9fa4ba2144","Type":"ContainerStarted","Data":"dca3a547339a4c2fbdd2497c2834a0dd5bbc0b8bedc414e395b0cc0150026d8d"}
Oct 30 20:06:11.411974 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:11.411963    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-efbac3-openshift-default-844cb4689c-vwdfb" event={"ID":"04fcd0d1-5d59-485a-aba6-1e9fa4ba2144","Type":"ContainerStarted","Data":"e980bed991a64166f89093f2ba4dc7c6b363f1e5508ae95a4973e0e5f3962eee"}
Oct 30 20:06:11.477781 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:11.477713    6275 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w5-626870-openshift-default-7cd649d59c-8m57h" podStartSLOduration=1.477694094 podStartE2EDuration="1.477694094s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:06:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:06:11.467485326 +0000 UTC m=+1081.929212191" watchObservedRunningTime="2026-10-30 20:06:11.477694094 +0000 UTC m=+1081.939420958"
Oct 30 20:06:11.530931 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:11.530882    6275 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w2-efbac3-openshift-default-844cb4689c-vwdfb" podStartSLOduration=1.530867835 podStartE2EDuration="1.530867835s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:06:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:06:11.524447105 +0000 UTC m=+1081.986173969" watchObservedRunningTime="2026-10-30 20:06:11.530867835 +0000 UTC m=+1081.992594767"
Oct 30 20:06:11.601943 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:11.601876    6275 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w5-626870-openshift-default-7cd649d59c-8m57h"
Oct 30 20:06:11.614988 ip-10-0-131-26 kubenswrapper[6275]: W1030 20:06:11.614957    6275 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a7d6f48_c37d_4f85_82e1_46b8b330b366.slice/crio-c56d6042c356a4c24bf18f6125cd446afc48b1ba73f149fcab4f47ff4d2490f9 WatchSource:0}: Error finding container c56d6042c356a4c24bf18f6125cd446afc48b1ba73f149fcab4f47ff4d2490f9: Status 404 returned error can't find the container with id c56d6042c356a4c24bf18f6125cd446afc48b1ba73f149fcab4f47ff4d2490f9
Oct 30 20:06:11.615315 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:11.615294    6275 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w3-912f24-openshift-default-5f56ff5f6c-sth92"]
Oct 30 20:06:11.618299 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:11.618261    6275 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Oct 30 20:06:11.618394 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:11.618377    6275 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Oct 30 20:06:11.618463 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:11.618447    6275 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Oct 30 20:06:11.734460 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:11.734394    6275 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w2-efbac3-openshift-default-844cb4689c-vwdfb"
Oct 30 20:06:12.432924 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:12.432888    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-912f24-openshift-default-5f56ff5f6c-sth92" event={"ID":"8a7d6f48-c37d-4f85-82e1-46b8b330b366","Type":"ContainerStarted","Data":"2b9f21f1056f1c31d49cdf332613ebabf786eb908ba2bdc51c2c96cba9a9cca5"}
Oct 30 20:06:12.433075 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:12.432946    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-912f24-openshift-default-5f56ff5f6c-sth92" event={"ID":"8a7d6f48-c37d-4f85-82e1-46b8b330b366","Type":"ContainerStarted","Data":"c56d6042c356a4c24bf18f6125cd446afc48b1ba73f149fcab4f47ff4d2490f9"}
Oct 30 20:06:12.523727 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:12.523660    6275 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w3-912f24-openshift-default-5f56ff5f6c-sth92" podStartSLOduration=2.523639266 podStartE2EDuration="2.523639266s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:06:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:06:12.494937187 +0000 UTC m=+1082.956664051" watchObservedRunningTime="2026-10-30 20:06:12.523639266 +0000 UTC m=+1082.985366133"
Oct 30 20:06:12.625438 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:12.620346    6275 patch_prober.go:29] interesting pod/e2e-worker-w5-626870-openshift-default-7cd649d59c-8m57h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.94:15021/healthz/ready\": dial tcp 10.134.0.94:15021: connect: connection refused" start-of-body=
Oct 30 20:06:12.625438 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:12.620447    6275 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-626870-openshift-default-7cd649d59c-8m57h" podUID="8c41c1e8-30e2-416d-a07e-cb0177f33ff6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.94:15021/healthz/ready\": dial tcp 10.134.0.94:15021: connect: connection refused"
Oct 30 20:06:12.746440 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:12.742700    6275 patch_prober.go:29] interesting pod/e2e-worker-w2-efbac3-openshift-default-844cb4689c-vwdfb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.95:15021/healthz/ready\": dial tcp 10.134.0.95:15021: connect: connection refused" start-of-body=
Oct 30 20:06:12.746440 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:12.742762    6275 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-efbac3-openshift-default-844cb4689c-vwdfb" podUID="04fcd0d1-5d59-485a-aba6-1e9fa4ba2144" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.95:15021/healthz/ready\": dial tcp 10.134.0.95:15021: connect: connection refused"
Oct 30 20:06:13.249697 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:13.249659    6275 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w3-912f24-openshift-default-5f56ff5f6c-sth92"
Oct 30 20:06:13.252027 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:13.251995    6275 patch_prober.go:29] interesting pod/e2e-worker-w3-912f24-openshift-default-5f56ff5f6c-sth92 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.96:15021/healthz/ready\": dial tcp 10.134.0.96:15021: connect: connection refused" start-of-body=
Oct 30 20:06:13.252258 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:13.252233    6275 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-912f24-openshift-default-5f56ff5f6c-sth92" podUID="8a7d6f48-c37d-4f85-82e1-46b8b330b366" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.96:15021/healthz/ready\": dial tcp 10.134.0.96:15021: connect: connection refused"
Oct 30 20:06:13.606448 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:13.605927    6275 patch_prober.go:29] interesting pod/e2e-worker-w5-626870-openshift-default-7cd649d59c-8m57h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.94:15021/healthz/ready\": dial tcp 10.134.0.94:15021: connect: connection refused" start-of-body=
Oct 30 20:06:13.606448 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:13.605987    6275 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-626870-openshift-default-7cd649d59c-8m57h" podUID="8c41c1e8-30e2-416d-a07e-cb0177f33ff6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.94:15021/healthz/ready\": dial tcp 10.134.0.94:15021: connect: connection refused"
Oct 30 20:06:13.741438 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:13.734839    6275 patch_prober.go:29] interesting pod/e2e-worker-w2-efbac3-openshift-default-844cb4689c-vwdfb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.95:15021/healthz/ready\": dial tcp 10.134.0.95:15021: connect: connection refused" start-of-body=
Oct 30 20:06:13.741438 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:13.734911    6275 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-efbac3-openshift-default-844cb4689c-vwdfb" podUID="04fcd0d1-5d59-485a-aba6-1e9fa4ba2144" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.95:15021/healthz/ready\": dial tcp 10.134.0.95:15021: connect: connection refused"
Oct 30 20:06:14.248991 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:14.248944    6275 patch_prober.go:29] interesting pod/e2e-worker-w3-912f24-openshift-default-5f56ff5f6c-sth92 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.96:15021/healthz/ready\": dial tcp 10.134.0.96:15021: connect: connection refused" start-of-body=
Oct 30 20:06:14.249186 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:14.249013    6275 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-912f24-openshift-default-5f56ff5f6c-sth92" podUID="8a7d6f48-c37d-4f85-82e1-46b8b330b366" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.96:15021/healthz/ready\": dial tcp 10.134.0.96:15021: connect: connection refused"
Oct 30 20:06:14.611495 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:14.604785    6275 patch_prober.go:29] interesting pod/e2e-worker-w5-626870-openshift-default-7cd649d59c-8m57h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.94:15021/healthz/ready\": dial tcp 10.134.0.94:15021: connect: connection refused" start-of-body=
Oct 30 20:06:14.611495 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:14.604849    6275 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-626870-openshift-default-7cd649d59c-8m57h" podUID="8c41c1e8-30e2-416d-a07e-cb0177f33ff6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.94:15021/healthz/ready\": dial tcp 10.134.0.94:15021: connect: connection refused"
Oct 30 20:06:14.737440 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:14.737172    6275 patch_prober.go:29] interesting pod/e2e-worker-w2-efbac3-openshift-default-844cb4689c-vwdfb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.95:15021/healthz/ready\": dial tcp 10.134.0.95:15021: connect: connection refused" start-of-body=
Oct 30 20:06:14.737440 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:14.737243    6275 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-efbac3-openshift-default-844cb4689c-vwdfb" podUID="04fcd0d1-5d59-485a-aba6-1e9fa4ba2144" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.95:15021/healthz/ready\": dial tcp 10.134.0.95:15021: connect: connection refused"
Oct 30 20:06:15.323473 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:15.250027    6275 patch_prober.go:29] interesting pod/e2e-worker-w3-912f24-openshift-default-5f56ff5f6c-sth92 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.96:15021/healthz/ready\": dial tcp 10.134.0.96:15021: connect: connection refused" start-of-body=
Oct 30 20:06:15.323473 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:15.250091    6275 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-912f24-openshift-default-5f56ff5f6c-sth92" podUID="8a7d6f48-c37d-4f85-82e1-46b8b330b366" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.96:15021/healthz/ready\": dial tcp 10.134.0.96:15021: connect: connection refused"
Oct 30 20:06:15.602950 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:15.602860    6275 patch_prober.go:29] interesting pod/e2e-worker-w5-626870-openshift-default-7cd649d59c-8m57h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.94:15021/healthz/ready\": dial tcp 10.134.0.94:15021: connect: connection refused" start-of-body=
Oct 30 20:06:15.603249 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:15.603219    6275 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-626870-openshift-default-7cd649d59c-8m57h" podUID="8c41c1e8-30e2-416d-a07e-cb0177f33ff6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.94:15021/healthz/ready\": dial tcp 10.134.0.94:15021: connect: connection refused"
Oct 30 20:06:15.905492 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:15.902027    6275 patch_prober.go:29] interesting pod/e2e-worker-w2-efbac3-openshift-default-844cb4689c-vwdfb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.95:15021/healthz/ready\": dial tcp 10.134.0.95:15021: connect: connection refused" start-of-body=
Oct 30 20:06:15.905492 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:15.902084    6275 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-efbac3-openshift-default-844cb4689c-vwdfb" podUID="04fcd0d1-5d59-485a-aba6-1e9fa4ba2144" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.95:15021/healthz/ready\": dial tcp 10.134.0.95:15021: connect: connection refused"
Oct 30 20:06:16.243494 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:16.211742    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-51dd62/simulator-w6-51dd62-kserve-d6bb4985f-65j9h" podUID="f7e1ff07-15d6-49b5-8edc-52c9d6825ed7" containerName="main" probeResult="failure" output="Get \"https://10.134.0.56:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:06:16.307645 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:16.274845    6275 patch_prober.go:29] interesting pod/e2e-worker-w3-912f24-openshift-default-5f56ff5f6c-sth92 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.96:15021/healthz/ready\": dial tcp 10.134.0.96:15021: connect: connection refused" start-of-body=
Oct 30 20:06:16.307964 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:16.307914    6275 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-912f24-openshift-default-5f56ff5f6c-sth92" podUID="8a7d6f48-c37d-4f85-82e1-46b8b330b366" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.96:15021/healthz/ready\": dial tcp 10.134.0.96:15021: connect: connection refused"
Oct 30 20:06:16.316605 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:16.274896    6275 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w1-5f10d2/premium-w1-5f10d2-kserve-644b846669-286m2" podUID="a2ff6903-c1ab-48dd-884b-d119b8ee1ed6" containerName="main" probeResult="failure" output="Get \"https://10.134.0.61:8000/health\": context deadline exceeded"
Oct 30 20:06:16.372476 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:16.307589    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-efbac3/premium-w2-efbac3-kserve-55f54cfff6-9fqbz" podUID="083136dc-91fb-454f-a782-87b004e73d1b" containerName="main" probeResult="failure" output="Get \"https://10.134.0.59:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:06:16.496488 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:16.470949    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-626870/premium-w5-626870-kserve-5df7f7b5c4-vx59r" podUID="a1adddd4-3218-4a6b-a145-0290bceff76f" containerName="main" probeResult="failure" output="Get \"https://10.134.0.57:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:06:16.496488 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:16.471216    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-f1f016/premium-w4-f1f016-kserve-55d6bd678b-w5hkc" podUID="0e543ba9-1e7a-4d0a-9361-50c98060e824" containerName="main" probeResult="failure" output="Get \"https://10.134.0.60:8000/ready\": context deadline exceeded"
Oct 30 20:06:16.535491 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:16.532943    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-5f10d2/premium-w1-5f10d2-kserve-644b846669-286m2" podUID="a2ff6903-c1ab-48dd-884b-d119b8ee1ed6" containerName="main" probeResult="failure" output="Get \"https://10.134.0.61:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:06:16.535491 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:16.534501    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-f1f016/simulator-w4-f1f016-kserve-55db8447ff-749tw" podUID="8f3174b6-2fdc-48c2-99be-7a966731f018" containerName="main" probeResult="failure" output="Get \"https://10.134.0.55:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:06:16.557453 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:16.557393    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-5f10d2/distinct-w1-5f10d2-kserve-5bf49798b8-l2j84" podUID="9e831c5d-2019-4015-ac57-2b4b1b90b9b3" containerName="main" probeResult="failure" output="Get \"https://10.134.0.69:8000/ready\": context deadline exceeded"
Oct 30 20:06:16.616436 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:16.616180    6275 patch_prober.go:29] interesting pod/e2e-worker-w5-626870-openshift-default-7cd649d59c-8m57h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.94:15021/healthz/ready\": dial tcp 10.134.0.94:15021: connect: connection refused" start-of-body=
Oct 30 20:06:16.616436 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:16.616251    6275 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-626870-openshift-default-7cd649d59c-8m57h" podUID="8c41c1e8-30e2-416d-a07e-cb0177f33ff6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.94:15021/healthz/ready\": dial tcp 10.134.0.94:15021: connect: connection refused"
Oct 30 20:06:16.671441 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:16.670332    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-912f24/distinct-2-w3-912f24-kserve-566865fdcc-ptx4l" podUID="fcea214a-04a7-4bdd-9695-852f657edfe5" containerName="main" probeResult="failure" output="Get \"https://10.134.0.74:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:06:16.681438 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:16.671643    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-626870/distinct-2-w5-626870-kserve-98bfb9b98-xz6xj" podUID="7d49f1ad-8805-4090-8e72-7d828fa73f36" containerName="main" probeResult="failure" output="Get \"https://10.134.0.90:8000/ready\": context deadline exceeded"
Oct 30 20:06:16.755365 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:16.755168    6275 patch_prober.go:29] interesting pod/e2e-worker-w2-efbac3-openshift-default-844cb4689c-vwdfb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.95:15021/healthz/ready\": dial tcp 10.134.0.95:15021: connect: connection refused" start-of-body=
Oct 30 20:06:16.755365 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:16.755225    6275 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-efbac3-openshift-default-844cb4689c-vwdfb" podUID="04fcd0d1-5d59-485a-aba6-1e9fa4ba2144" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.95:15021/healthz/ready\": dial tcp 10.134.0.95:15021: connect: connection refused"
Oct 30 20:06:16.940441 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:16.916186    6275 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w1-5f10d2/distinct-w1-5f10d2-kserve-5bf49798b8-l2j84" podUID="9e831c5d-2019-4015-ac57-2b4b1b90b9b3" containerName="main" probeResult="failure" output="Get \"https://10.134.0.69:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:06:16.940757 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:16.926021    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-912f24/simulator-w3-912f24-kserve-59897cf48b-sd5wj" podUID="b4de6427-0db0-42d9-8b88-6b35d9d4c314" containerName="main" probeResult="failure" output="Get \"https://10.134.0.54:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:06:17.300439 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:17.298603    6275 patch_prober.go:29] interesting pod/e2e-worker-w3-912f24-openshift-default-5f56ff5f6c-sth92 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.96:15021/healthz/ready\": dial tcp 10.134.0.96:15021: connect: connection refused" start-of-body=
Oct 30 20:06:17.300439 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:17.298676    6275 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-912f24-openshift-default-5f56ff5f6c-sth92" podUID="8a7d6f48-c37d-4f85-82e1-46b8b330b366" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.96:15021/healthz/ready\": dial tcp 10.134.0.96:15021: connect: connection refused"
Oct 30 20:06:17.325438 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:17.322910    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-51dd62/simulator-w6-51dd62-kserve-d6bb4985f-65j9h" podUID="f7e1ff07-15d6-49b5-8edc-52c9d6825ed7" containerName="main" probeResult="failure" output="Get \"https://10.134.0.56:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:06:17.325438 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:17.323801    6275 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w6-51dd62/simulator-w6-51dd62-kserve-d6bb4985f-65j9h"
Oct 30 20:06:17.435503 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:17.406291    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-efbac3/premium-w2-efbac3-kserve-55f54cfff6-9fqbz" podUID="083136dc-91fb-454f-a782-87b004e73d1b" containerName="main" probeResult="failure" output="Get \"https://10.134.0.59:8000/ready\": context deadline exceeded"
Oct 30 20:06:17.526753 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:17.526718    6275 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w2-efbac3/premium-w2-efbac3-kserve-55f54cfff6-9fqbz"
Oct 30 20:06:17.556527 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:17.538591    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-626870/premium-w5-626870-kserve-5df7f7b5c4-vx59r" podUID="a1adddd4-3218-4a6b-a145-0290bceff76f" containerName="main" probeResult="failure" output="Get \"https://10.134.0.57:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:06:17.556527 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:17.539011    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-f1f016/premium-w4-f1f016-kserve-55d6bd678b-w5hkc" podUID="0e543ba9-1e7a-4d0a-9361-50c98060e824" containerName="main" probeResult="failure" output="Get \"https://10.134.0.60:8000/ready\": context deadline exceeded"
Oct 30 20:06:17.556527 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:17.554787    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-f1f016/simulator-w4-f1f016-kserve-55db8447ff-749tw" podUID="8f3174b6-2fdc-48c2-99be-7a966731f018" containerName="main" probeResult="failure" output="Get \"https://10.134.0.55:8000/ready\": context deadline exceeded"
Oct 30 20:06:17.556996 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:17.556957    6275 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w5-626870/premium-w5-626870-kserve-5df7f7b5c4-vx59r"
Oct 30 20:06:17.557079 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:17.557054    6275 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w4-f1f016/premium-w4-f1f016-kserve-55d6bd678b-w5hkc"
Oct 30 20:06:17.557137 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:17.557112    6275 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w4-f1f016/simulator-w4-f1f016-kserve-55db8447ff-749tw"
Oct 30 20:06:17.558021 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:17.557990    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-5f10d2/distinct-w1-5f10d2-kserve-5bf49798b8-l2j84" podUID="9e831c5d-2019-4015-ac57-2b4b1b90b9b3" containerName="main" probeResult="failure" output="Get \"https://10.134.0.69:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:06:17.584153 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:17.584113    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-f1f016/distinct-w4-f1f016-kserve-79fbfbdbf7-hswb7" podUID="7b6639ea-72b0-49fb-b7fa-9443c1ddff6d" containerName="main" probeResult="failure" output="Get \"https://10.134.0.86:8000/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:06:17.613039 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:17.613007    6275 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w1-5f10d2/distinct-w1-5f10d2-kserve-5bf49798b8-l2j84"
Oct 30 20:06:17.743856 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:17.743811    6275 patch_prober.go:29] interesting pod/e2e-worker-w5-626870-openshift-default-7cd649d59c-8m57h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.94:15021/healthz/ready\": dial tcp 10.134.0.94:15021: connect: connection refused" start-of-body=
Oct 30 20:06:17.744183 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:17.744148    6275 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-626870-openshift-default-7cd649d59c-8m57h" podUID="8c41c1e8-30e2-416d-a07e-cb0177f33ff6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.94:15021/healthz/ready\": dial tcp 10.134.0.94:15021: connect: connection refused"
Oct 30 20:06:17.744402 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:17.683577    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-912f24/distinct-2-w3-912f24-kserve-566865fdcc-ptx4l" podUID="fcea214a-04a7-4bdd-9695-852f657edfe5" containerName="main" probeResult="failure" output="Get \"https://10.134.0.74:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:06:17.775165 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:17.775130    6275 patch_prober.go:29] interesting pod/e2e-worker-w2-efbac3-openshift-default-844cb4689c-vwdfb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.95:15021/healthz/ready\": dial tcp 10.134.0.95:15021: connect: connection refused" start-of-body=
Oct 30 20:06:17.790584 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:17.790541    6275 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-efbac3-openshift-default-844cb4689c-vwdfb" podUID="04fcd0d1-5d59-485a-aba6-1e9fa4ba2144" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.95:15021/healthz/ready\": dial tcp 10.134.0.95:15021: connect: connection refused"
Oct 30 20:06:17.837190 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:17.683511    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-626870/distinct-2-w5-626870-kserve-98bfb9b98-xz6xj" podUID="7d49f1ad-8805-4090-8e72-7d828fa73f36" containerName="main" probeResult="failure" output="Get \"https://10.134.0.90:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:06:18.340989 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:18.340953    6275 patch_prober.go:29] interesting pod/e2e-worker-w3-912f24-openshift-default-5f56ff5f6c-sth92 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.96:15021/healthz/ready\": dial tcp 10.134.0.96:15021: connect: connection refused" start-of-body=
Oct 30 20:06:18.341269 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:18.341235    6275 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-912f24-openshift-default-5f56ff5f6c-sth92" podUID="8a7d6f48-c37d-4f85-82e1-46b8b330b366" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.96:15021/healthz/ready\": dial tcp 10.134.0.96:15021: connect: connection refused"
Oct 30 20:06:18.519441 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:18.490319    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-efbac3/premium-w2-efbac3-kserve-55f54cfff6-9fqbz" podUID="083136dc-91fb-454f-a782-87b004e73d1b" containerName="main" probeResult="failure" output="Get \"https://10.134.0.59:8000/ready\": context deadline exceeded"
Oct 30 20:06:18.553637 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:18.553590    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-626870/premium-w5-626870-kserve-5df7f7b5c4-vx59r" podUID="a1adddd4-3218-4a6b-a145-0290bceff76f" containerName="main" probeResult="failure" output="Get \"https://10.134.0.57:8000/ready\": context deadline exceeded"
Oct 30 20:06:18.554219 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:18.554187    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-f1f016/premium-w4-f1f016-kserve-55d6bd678b-w5hkc" podUID="0e543ba9-1e7a-4d0a-9361-50c98060e824" containerName="main" probeResult="failure" output="Get \"https://10.134.0.60:8000/ready\": context deadline exceeded"
Oct 30 20:06:18.554666 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:18.554640    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-5f10d2/premium-w1-5f10d2-kserve-644b846669-286m2" podUID="a2ff6903-c1ab-48dd-884b-d119b8ee1ed6" containerName="main" probeResult="failure" output="Get \"https://10.134.0.61:8000/ready\": context deadline exceeded"
Oct 30 20:06:18.563431 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:18.563380    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-51dd62/simulator-w6-51dd62-kserve-d6bb4985f-65j9h" podUID="f7e1ff07-15d6-49b5-8edc-52c9d6825ed7" containerName="main" probeResult="failure" output="Get \"https://10.134.0.56:8000/ready\": context deadline exceeded"
Oct 30 20:06:18.838443 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:18.742961    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-5f10d2/distinct-w1-5f10d2-kserve-5bf49798b8-l2j84" podUID="9e831c5d-2019-4015-ac57-2b4b1b90b9b3" containerName="main" probeResult="failure" output="Get \"https://10.134.0.69:8000/ready\": context deadline exceeded"
Oct 30 20:06:18.838443 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:18.743523    6275 patch_prober.go:29] interesting pod/e2e-worker-w5-626870-openshift-default-7cd649d59c-8m57h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.94:15021/healthz/ready\": dial tcp 10.134.0.94:15021: connect: connection refused" start-of-body=
Oct 30 20:06:18.838443 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:18.743568    6275 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-626870-openshift-default-7cd649d59c-8m57h" podUID="8c41c1e8-30e2-416d-a07e-cb0177f33ff6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.94:15021/healthz/ready\": dial tcp 10.134.0.94:15021: connect: connection refused"
Oct 30 20:06:18.838443 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:18.824727    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-f1f016/simulator-w4-f1f016-kserve-55db8447ff-749tw" podUID="8f3174b6-2fdc-48c2-99be-7a966731f018" containerName="main" probeResult="failure" output="Get \"https://10.134.0.55:8000/ready\": context deadline exceeded"
Oct 30 20:06:18.838443 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:18.825012    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-f1f016/distinct-w4-f1f016-kserve-79fbfbdbf7-hswb7" podUID="7b6639ea-72b0-49fb-b7fa-9443c1ddff6d" containerName="main" probeResult="failure" output="Get \"https://10.134.0.86:8000/ready\": context deadline exceeded"
Oct 30 20:06:18.935567 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:18.862609    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-912f24/simulator-w3-912f24-kserve-59897cf48b-sd5wj" podUID="b4de6427-0db0-42d9-8b88-6b35d9d4c314" containerName="main" probeResult="failure" output="Get \"https://10.134.0.54:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:06:18.935567 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:18.863561    6275 patch_prober.go:29] interesting pod/e2e-worker-w2-efbac3-openshift-default-844cb4689c-vwdfb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.95:15021/healthz/ready\": dial tcp 10.134.0.95:15021: connect: connection refused" start-of-body=
Oct 30 20:06:18.935567 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:18.863605    6275 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-efbac3-openshift-default-844cb4689c-vwdfb" podUID="04fcd0d1-5d59-485a-aba6-1e9fa4ba2144" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.95:15021/healthz/ready\": dial tcp 10.134.0.95:15021: connect: connection refused"
Oct 30 20:06:18.935567 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:18.864039    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-912f24/distinct-2-w3-912f24-kserve-566865fdcc-ptx4l" podUID="fcea214a-04a7-4bdd-9695-852f657edfe5" containerName="main" probeResult="failure" output="Get \"https://10.134.0.74:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:06:18.935567 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:18.890561    6275 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w5-626870/distinct-2-w5-626870-kserve-98bfb9b98-xz6xj" podUID="7d49f1ad-8805-4090-8e72-7d828fa73f36" containerName="main" probeResult="failure" output="Get \"https://10.134.0.90:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:06:18.936118 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:18.936077    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-626870/distinct-2-w5-626870-kserve-98bfb9b98-xz6xj" podUID="7d49f1ad-8805-4090-8e72-7d828fa73f36" containerName="main" probeResult="failure" output="Get \"https://10.134.0.90:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:06:19.113771 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:19.113687    6275 patch_prober.go:29] interesting pod/e2e-worker-w3-912f24-openshift-default-5f56ff5f6c-w5dh9 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.72:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 20:06:19.141542 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:19.141498    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w3-912f24-openshift-default-5f56ff5f6c-w5dh9" podUID="d499ec6a-7c42-4ba2-b4c6-19c6fe1caa99" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.72:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:06:19.167832 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:19.167707    6275 patch_prober.go:29] interesting pod/e2e-worker-w0-62f4a1-openshift-default-7fc84fbccc-xwj24 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.63:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 20:06:19.167832 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:19.167765    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w0-62f4a1-openshift-default-7fc84fbccc-xwj24" podUID="943aa671-36e0-4eac-aa11-807858253698" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.63:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:06:19.271561 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:19.271519    6275 patch_prober.go:29] interesting pod/e2e-worker-w3-912f24-openshift-default-5f56ff5f6c-sth92 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.96:15021/healthz/ready\": dial tcp 10.134.0.96:15021: connect: connection refused" start-of-body=
Oct 30 20:06:19.271807 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:19.271779    6275 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-912f24-openshift-default-5f56ff5f6c-sth92" podUID="8a7d6f48-c37d-4f85-82e1-46b8b330b366" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.96:15021/healthz/ready\": dial tcp 10.134.0.96:15021: connect: connection refused"
Oct 30 20:06:19.289439 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:19.277371    6275 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w3-912f24/simulator-w3-912f24-kserve-59897cf48b-sd5wj" podUID="b4de6427-0db0-42d9-8b88-6b35d9d4c314" containerName="main" probeResult="failure" output="Get \"https://10.134.0.54:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:06:19.295442 ip-10-0-131-26 kubenswrapper[6275]: E1030 20:06:19.294876    6275 kubelet.go:2711] "Housekeeping took longer than expected" err="housekeeping took too long" expected="1s" actual="1.611s"
Oct 30 20:06:19.295442 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:19.294963    6275 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w3-912f24/distinct-2-w3-912f24-kserve-566865fdcc-ptx4l"
Oct 30 20:06:19.295442 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:19.295132    6275 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w5-626870/distinct-2-w5-626870-kserve-98bfb9b98-xz6xj"
Oct 30 20:06:19.295442 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:19.295175    6275 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w4-f1f016/distinct-w4-f1f016-kserve-79fbfbdbf7-hswb7"
Oct 30 20:06:19.466329 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:19.466238    6275 prober.go:122] "Probe failed" probeType="Liveness" pod="cert-manager/cert-manager-webhook-5dbbbf75cc-vfqhv" podUID="ae2b0dcf-ee6f-447a-bf93-08e3deac5c41" containerName="cert-manager-webhook" probeResult="failure" output="Get \"http://10.134.0.17:6080/livez\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:06:19.498440 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:19.491458    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-efbac3/premium-w2-efbac3-kserve-55f54cfff6-9fqbz" podUID="083136dc-91fb-454f-a782-87b004e73d1b" containerName="main" probeResult="failure" output="Get \"https://10.134.0.59:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:06:19.588528 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:19.555245    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-f1f016/premium-w4-f1f016-kserve-55d6bd678b-w5hkc" podUID="0e543ba9-1e7a-4d0a-9361-50c98060e824" containerName="main" probeResult="failure" output="Get \"https://10.134.0.60:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:06:19.588528 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:19.572637    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-51dd62/simulator-w6-51dd62-kserve-d6bb4985f-65j9h" podUID="f7e1ff07-15d6-49b5-8edc-52c9d6825ed7" containerName="main" probeResult="failure" output="Get \"https://10.134.0.56:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:06:19.588528 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:19.583661    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-5f10d2/premium-w1-5f10d2-kserve-644b846669-286m2" podUID="a2ff6903-c1ab-48dd-884b-d119b8ee1ed6" containerName="main" probeResult="failure" output="Get \"https://10.134.0.61:8000/ready\": context deadline exceeded"
Oct 30 20:06:19.588528 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:19.557491    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-626870/premium-w5-626870-kserve-5df7f7b5c4-vx59r" podUID="a1adddd4-3218-4a6b-a145-0290bceff76f" containerName="main" probeResult="failure" output="Get \"https://10.134.0.57:8000/ready\": context deadline exceeded"
Oct 30 20:06:19.588528 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:19.584953    6275 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w1-5f10d2/premium-w1-5f10d2-kserve-644b846669-286m2"
Oct 30 20:06:19.613439 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:19.608806    6275 patch_prober.go:29] interesting pod/e2e-worker-w5-626870-openshift-default-7cd649d59c-74vj7 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.83:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 20:06:19.613439 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:19.608994    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w5-626870-openshift-default-7cd649d59c-74vj7" podUID="f35ca7ba-e2b8-4e65-bc7b-0051dea979e8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.83:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:06:19.653439 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:19.644393    6275 patch_prober.go:29] interesting pod/e2e-worker-w5-626870-openshift-default-7cd649d59c-8m57h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.94:15021/healthz/ready\": dial tcp 10.134.0.94:15021: connect: connection refused" start-of-body=
Oct 30 20:06:19.653439 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:19.644469    6275 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-626870-openshift-default-7cd649d59c-8m57h" podUID="8c41c1e8-30e2-416d-a07e-cb0177f33ff6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.94:15021/healthz/ready\": dial tcp 10.134.0.94:15021: connect: connection refused"
Oct 30 20:06:19.800439 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:19.771575    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-5f10d2/distinct-w1-5f10d2-kserve-5bf49798b8-l2j84" podUID="9e831c5d-2019-4015-ac57-2b4b1b90b9b3" containerName="main" probeResult="failure" output="Get \"https://10.134.0.69:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:06:19.848447 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:19.823506    6275 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w4-f1f016/distinct-w4-f1f016-kserve-79fbfbdbf7-hswb7" podUID="7b6639ea-72b0-49fb-b7fa-9443c1ddff6d" containerName="main" probeResult="failure" output="Get \"https://10.134.0.86:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:06:19.848447 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:19.832328    6275 patch_prober.go:29] interesting pod/e2e-worker-w1-5f10d2-openshift-default-6c6777d6f5-8zmm9 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.77:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 20:06:19.848447 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:19.832384    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w1-5f10d2-openshift-default-6c6777d6f5-8zmm9" podUID="91d406fb-17e3-47cf-bb3c-0a088ea0968e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.77:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:06:19.848447 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:19.833113    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-f1f016/simulator-w4-f1f016-kserve-55db8447ff-749tw" podUID="8f3174b6-2fdc-48c2-99be-7a966731f018" containerName="main" probeResult="failure" output="Get \"https://10.134.0.55:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:06:19.848447 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:19.834026    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-f1f016/distinct-w4-f1f016-kserve-79fbfbdbf7-hswb7" podUID="7b6639ea-72b0-49fb-b7fa-9443c1ddff6d" containerName="main" probeResult="failure" output="Get \"https://10.134.0.86:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:06:19.853434 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:19.850301    6275 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w4-f1f016/simulator-w4-f1f016-kserve-55db8447ff-749tw" podUID="8f3174b6-2fdc-48c2-99be-7a966731f018" containerName="main" probeResult="failure" output="Get \"https://10.134.0.55:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:06:19.894656 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:19.862490    6275 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w6-51dd62/simulator-w6-51dd62-kserve-d6bb4985f-65j9h" podUID="f7e1ff07-15d6-49b5-8edc-52c9d6825ed7" containerName="main" probeResult="failure" output="Get \"https://10.134.0.56:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:06:19.894656 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:19.872609    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-912f24/distinct-2-w3-912f24-kserve-566865fdcc-ptx4l" podUID="fcea214a-04a7-4bdd-9695-852f657edfe5" containerName="main" probeResult="failure" output="Get \"https://10.134.0.74:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:06:19.894656 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:19.873764    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-912f24/simulator-w3-912f24-kserve-59897cf48b-sd5wj" podUID="b4de6427-0db0-42d9-8b88-6b35d9d4c314" containerName="main" probeResult="failure" output="Get \"https://10.134.0.54:8000/ready\": context deadline exceeded"
Oct 30 20:06:19.894656 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:19.876884    6275 patch_prober.go:29] interesting pod/e2e-worker-w5-626870-openshift-default-7cd649d59c-zchw8 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.70:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 20:06:19.894656 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:19.876925    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w5-626870-openshift-default-7cd649d59c-zchw8" podUID="5aec32f5-a318-4b0c-9c2f-2af7f36b8fd4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.70:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:06:19.911592 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:19.911557    6275 patch_prober.go:29] interesting pod/e2e-worker-w2-efbac3-openshift-default-844cb4689c-vwdfb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.95:15021/healthz/ready\": dial tcp 10.134.0.95:15021: connect: connection refused" start-of-body=
Oct 30 20:06:19.983519 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:19.983478    6275 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-efbac3-openshift-default-844cb4689c-vwdfb" podUID="04fcd0d1-5d59-485a-aba6-1e9fa4ba2144" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.95:15021/healthz/ready\": dial tcp 10.134.0.95:15021: connect: connection refused"
Oct 30 20:06:19.987898 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:19.922980    6275 patch_prober.go:29] interesting pod/e2e-worker-w0-62f4a1-openshift-default-7fc84fbccc-52l47 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.76:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 20:06:19.988103 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:19.988078    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w0-62f4a1-openshift-default-7fc84fbccc-52l47" podUID="e3f64fa4-b2e2-4ab4-9da5-76bbfac9116d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.76:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:06:19.988201 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:19.985589    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-626870/distinct-2-w5-626870-kserve-98bfb9b98-xz6xj" podUID="7d49f1ad-8805-4090-8e72-7d828fa73f36" containerName="main" probeResult="failure" output="Get \"https://10.134.0.90:8000/ready\": context deadline exceeded"
Oct 30 20:06:20.065488 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:20.064048    6275 patch_prober.go:29] interesting pod/e2e-worker-w3-912f24-openshift-default-5f56ff5f6c-r7hx2 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.81:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 20:06:20.065488 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:20.064127    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w3-912f24-openshift-default-5f56ff5f6c-r7hx2" podUID="88b5def9-2eb1-476e-a3ba-8f5b5ac6c32f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.81:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:06:20.193521 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:20.193477    6275 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w3-912f24/simulator-w3-912f24-kserve-59897cf48b-sd5wj"
Oct 30 20:06:20.274886 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:20.274831    6275 patch_prober.go:29] interesting pod/e2e-worker-w3-912f24-openshift-default-5f56ff5f6c-sth92 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.96:15021/healthz/ready\": dial tcp 10.134.0.96:15021: connect: connection refused" start-of-body=
Oct 30 20:06:20.275474 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:20.275404    6275 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-912f24-openshift-default-5f56ff5f6c-sth92" podUID="8a7d6f48-c37d-4f85-82e1-46b8b330b366" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.96:15021/healthz/ready\": dial tcp 10.134.0.96:15021: connect: connection refused"
Oct 30 20:06:20.493573 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:20.493495    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-efbac3/premium-w2-efbac3-kserve-55f54cfff6-9fqbz" podUID="083136dc-91fb-454f-a782-87b004e73d1b" containerName="main" probeResult="failure" output="Get \"https://10.134.0.59:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:06:20.597233 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:20.594568    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-626870/premium-w5-626870-kserve-5df7f7b5c4-vx59r" podUID="a1adddd4-3218-4a6b-a145-0290bceff76f" containerName="main" probeResult="failure" output="Get \"https://10.134.0.57:8000/ready\": context deadline exceeded"
Oct 30 20:06:20.597233 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:20.594917    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-f1f016/premium-w4-f1f016-kserve-55d6bd678b-w5hkc" podUID="0e543ba9-1e7a-4d0a-9361-50c98060e824" containerName="main" probeResult="failure" output="Get \"https://10.134.0.60:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:06:20.597233 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:20.595181    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-51dd62/simulator-w6-51dd62-kserve-d6bb4985f-65j9h" podUID="f7e1ff07-15d6-49b5-8edc-52c9d6825ed7" containerName="main" probeResult="failure" output="Get \"https://10.134.0.56:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:06:20.597233 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:20.595462    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-5f10d2/premium-w1-5f10d2-kserve-644b846669-286m2" podUID="a2ff6903-c1ab-48dd-884b-d119b8ee1ed6" containerName="main" probeResult="failure" output="Get \"https://10.134.0.61:8000/ready\": context deadline exceeded"
Oct 30 20:06:20.622756 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:20.604629    6275 patch_prober.go:29] interesting pod/e2e-worker-w5-626870-openshift-default-7cd649d59c-8m57h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.94:15021/healthz/ready\": dial tcp 10.134.0.94:15021: connect: connection refused" start-of-body=
Oct 30 20:06:20.623081 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:20.623046    6275 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-626870-openshift-default-7cd649d59c-8m57h" podUID="8c41c1e8-30e2-416d-a07e-cb0177f33ff6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.94:15021/healthz/ready\": dial tcp 10.134.0.94:15021: connect: connection refused"
Oct 30 20:06:20.735341 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:20.734825    6275 patch_prober.go:29] interesting pod/e2e-worker-w2-efbac3-openshift-default-844cb4689c-vwdfb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.95:15021/healthz/ready\": dial tcp 10.134.0.95:15021: connect: connection refused" start-of-body=
Oct 30 20:06:20.735341 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:20.734886    6275 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-efbac3-openshift-default-844cb4689c-vwdfb" podUID="04fcd0d1-5d59-485a-aba6-1e9fa4ba2144" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.95:15021/healthz/ready\": dial tcp 10.134.0.95:15021: connect: connection refused"
Oct 30 20:06:20.787495 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:20.783439    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-5f10d2/distinct-w1-5f10d2-kserve-5bf49798b8-l2j84" podUID="9e831c5d-2019-4015-ac57-2b4b1b90b9b3" containerName="main" probeResult="failure" output="Get \"https://10.134.0.69:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:06:20.865642 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:20.865588    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-f1f016/distinct-w4-f1f016-kserve-79fbfbdbf7-hswb7" podUID="7b6639ea-72b0-49fb-b7fa-9443c1ddff6d" containerName="main" probeResult="failure" output="Get \"https://10.134.0.86:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:06:20.866300 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:20.866253    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-f1f016/simulator-w4-f1f016-kserve-55db8447ff-749tw" podUID="8f3174b6-2fdc-48c2-99be-7a966731f018" containerName="main" probeResult="failure" output="Get \"https://10.134.0.55:8000/ready\": context deadline exceeded"
Oct 30 20:06:20.873613 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:20.873578    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-912f24/distinct-2-w3-912f24-kserve-566865fdcc-ptx4l" podUID="fcea214a-04a7-4bdd-9695-852f657edfe5" containerName="main" probeResult="failure" output="Get \"https://10.134.0.74:8000/ready\": context deadline exceeded"
Oct 30 20:06:20.877586 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:20.873980    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-912f24/simulator-w3-912f24-kserve-59897cf48b-sd5wj" podUID="b4de6427-0db0-42d9-8b88-6b35d9d4c314" containerName="main" probeResult="failure" output="Get \"https://10.134.0.54:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:06:20.997590 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:20.997499    6275 patch_prober.go:29] interesting pod/e2e-worker-w1-5f10d2-openshift-default-6c6777d6f5-8zmvq container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.85:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 20:06:21.012437 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:20.997815    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w1-5f10d2-openshift-default-6c6777d6f5-8zmvq" podUID="0e4973a9-ead0-4c5f-813c-fa012dc3fade" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.85:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:06:21.187324 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:21.187218    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-626870/distinct-2-w5-626870-kserve-98bfb9b98-xz6xj" podUID="7d49f1ad-8805-4090-8e72-7d828fa73f36" containerName="main" probeResult="failure" output="Get \"https://10.134.0.90:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:06:21.248243 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:21.248207    6275 patch_prober.go:29] interesting pod/e2e-worker-w3-912f24-openshift-default-5f56ff5f6c-sth92 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.96:15021/healthz/ready\": dial tcp 10.134.0.96:15021: connect: connection refused" start-of-body=
Oct 30 20:06:21.262175 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:21.262135    6275 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-912f24-openshift-default-5f56ff5f6c-sth92" podUID="8a7d6f48-c37d-4f85-82e1-46b8b330b366" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.96:15021/healthz/ready\": dial tcp 10.134.0.96:15021: connect: connection refused"
Oct 30 20:06:21.432353 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:21.432319    6275 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w1-5f10d2/premium-w1-5f10d2-kserve-644b846669-286m2"
Oct 30 20:06:21.650440 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:21.640966    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-626870/premium-w5-626870-kserve-5df7f7b5c4-vx59r" podUID="a1adddd4-3218-4a6b-a145-0290bceff76f" containerName="main" probeResult="failure" output="Get \"https://10.134.0.57:8000/ready\": context deadline exceeded"
Oct 30 20:06:21.670438 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:21.653532    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-f1f016/premium-w4-f1f016-kserve-55d6bd678b-w5hkc" podUID="0e543ba9-1e7a-4d0a-9361-50c98060e824" containerName="main" probeResult="failure" output="Get \"https://10.134.0.60:8000/ready\": context deadline exceeded"
Oct 30 20:06:21.743934 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:21.670898    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-efbac3/premium-w2-efbac3-kserve-55f54cfff6-9fqbz" podUID="083136dc-91fb-454f-a782-87b004e73d1b" containerName="main" probeResult="failure" output="Get \"https://10.134.0.59:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:06:21.747662 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:21.685103    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-51dd62/simulator-w6-51dd62-kserve-d6bb4985f-65j9h" podUID="f7e1ff07-15d6-49b5-8edc-52c9d6825ed7" containerName="main" probeResult="failure" output="Get \"https://10.134.0.56:8000/ready\": context deadline exceeded"
Oct 30 20:06:21.749683 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:21.749657    6275 patch_prober.go:29] interesting pod/e2e-worker-w5-626870-openshift-default-7cd649d59c-8m57h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.94:15021/healthz/ready\": dial tcp 10.134.0.94:15021: connect: connection refused" start-of-body=
Oct 30 20:06:21.749870 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:21.749846    6275 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-626870-openshift-default-7cd649d59c-8m57h" podUID="8c41c1e8-30e2-416d-a07e-cb0177f33ff6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.94:15021/healthz/ready\": dial tcp 10.134.0.94:15021: connect: connection refused"
Oct 30 20:06:21.760863 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:21.760837    6275 patch_prober.go:29] interesting pod/e2e-worker-w2-efbac3-openshift-default-844cb4689c-vwdfb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.95:15021/healthz/ready\": dial tcp 10.134.0.95:15021: connect: connection refused" start-of-body=
Oct 30 20:06:21.761043 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:21.761019    6275 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-efbac3-openshift-default-844cb4689c-vwdfb" podUID="04fcd0d1-5d59-485a-aba6-1e9fa4ba2144" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.95:15021/healthz/ready\": dial tcp 10.134.0.95:15021: connect: connection refused"
Oct 30 20:06:21.806138 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:21.806092    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-5f10d2/distinct-w1-5f10d2-kserve-5bf49798b8-l2j84" podUID="9e831c5d-2019-4015-ac57-2b4b1b90b9b3" containerName="main" probeResult="failure" output="Get \"https://10.134.0.69:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:06:21.880285 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:21.867379    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-f1f016/simulator-w4-f1f016-kserve-55db8447ff-749tw" podUID="8f3174b6-2fdc-48c2-99be-7a966731f018" containerName="main" probeResult="failure" output="Get \"https://10.134.0.55:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:06:21.880619 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:21.870568    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-f1f016/distinct-w4-f1f016-kserve-79fbfbdbf7-hswb7" podUID="7b6639ea-72b0-49fb-b7fa-9443c1ddff6d" containerName="main" probeResult="failure" output="Get \"https://10.134.0.86:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:06:21.881064 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:21.879613    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-912f24/distinct-2-w3-912f24-kserve-566865fdcc-ptx4l" podUID="fcea214a-04a7-4bdd-9695-852f657edfe5" containerName="main" probeResult="failure" output="Get \"https://10.134.0.74:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:06:21.881479 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:21.879693    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-912f24/simulator-w3-912f24-kserve-59897cf48b-sd5wj" podUID="b4de6427-0db0-42d9-8b88-6b35d9d4c314" containerName="main" probeResult="failure" output="Get \"https://10.134.0.54:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:06:22.217649 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:22.217602    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-626870/distinct-2-w5-626870-kserve-98bfb9b98-xz6xj" podUID="7d49f1ad-8805-4090-8e72-7d828fa73f36" containerName="main" probeResult="failure" output="Get \"https://10.134.0.90:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:06:22.261278 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:22.261242    6275 patch_prober.go:29] interesting pod/e2e-worker-w3-912f24-openshift-default-5f56ff5f6c-sth92 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.96:15021/healthz/ready\": dial tcp 10.134.0.96:15021: connect: connection refused" start-of-body=
Oct 30 20:06:22.362228 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:22.362187    6275 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-912f24-openshift-default-5f56ff5f6c-sth92" podUID="8a7d6f48-c37d-4f85-82e1-46b8b330b366" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.96:15021/healthz/ready\": dial tcp 10.134.0.96:15021: connect: connection refused"
Oct 30 20:06:22.561614 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:22.561120    6275 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w3-912f24/distinct-2-w3-912f24-kserve-566865fdcc-ptx4l"
Oct 30 20:06:22.564598 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:22.564285    6275 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w4-f1f016/distinct-w4-f1f016-kserve-79fbfbdbf7-hswb7"
Oct 30 20:06:22.581438 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:22.580637    6275 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w4-f1f016/simulator-w4-f1f016-kserve-55db8447ff-749tw"
Oct 30 20:06:22.605616 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:22.605585    6275 patch_prober.go:29] interesting pod/e2e-worker-w5-626870-openshift-default-7cd649d59c-8m57h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.94:15021/healthz/ready\": dial tcp 10.134.0.94:15021: connect: connection refused" start-of-body=
Oct 30 20:06:22.605833 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:22.605809    6275 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-626870-openshift-default-7cd649d59c-8m57h" podUID="8c41c1e8-30e2-416d-a07e-cb0177f33ff6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.94:15021/healthz/ready\": dial tcp 10.134.0.94:15021: connect: connection refused"
Oct 30 20:06:22.652933 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:22.652905    6275 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w3-912f24/simulator-w3-912f24-kserve-59897cf48b-sd5wj"
Oct 30 20:06:22.654551 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:22.654522    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-626870/premium-w5-626870-kserve-5df7f7b5c4-vx59r" podUID="a1adddd4-3218-4a6b-a145-0290bceff76f" containerName="main" probeResult="failure" output="Get \"https://10.134.0.57:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:06:22.722915 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:22.722885    6275 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w1-5f10d2/distinct-w1-5f10d2-kserve-5bf49798b8-l2j84"
Oct 30 20:06:22.727218 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:22.727196    6275 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w5-626870/premium-w5-626870-kserve-5df7f7b5c4-vx59r"
Oct 30 20:06:22.753486 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:22.753446    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-51dd62/simulator-w6-51dd62-kserve-d6bb4985f-65j9h" podUID="f7e1ff07-15d6-49b5-8edc-52c9d6825ed7" containerName="main" probeResult="failure" output="Get \"https://10.134.0.56:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:06:22.754073 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:22.753763    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-efbac3/premium-w2-efbac3-kserve-55f54cfff6-9fqbz" podUID="083136dc-91fb-454f-a782-87b004e73d1b" containerName="main" probeResult="failure" output="Get \"https://10.134.0.59:8000/ready\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:06:22.754409 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:22.753794    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-f1f016/premium-w4-f1f016-kserve-55d6bd678b-w5hkc" podUID="0e543ba9-1e7a-4d0a-9361-50c98060e824" containerName="main" probeResult="failure" output="Get \"https://10.134.0.60:8000/ready\": context deadline exceeded"
Oct 30 20:06:22.840214 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:22.830853    6275 patch_prober.go:29] interesting pod/e2e-worker-w2-efbac3-openshift-default-844cb4689c-vwdfb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.95:15021/healthz/ready\": dial tcp 10.134.0.95:15021: connect: connection refused" start-of-body=
Oct 30 20:06:22.840214 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:22.830909    6275 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-efbac3-openshift-default-844cb4689c-vwdfb" podUID="04fcd0d1-5d59-485a-aba6-1e9fa4ba2144" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.95:15021/healthz/ready\": dial tcp 10.134.0.95:15021: connect: connection refused"
Oct 30 20:06:22.865474 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:22.856337    6275 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w5-626870/distinct-2-w5-626870-kserve-98bfb9b98-xz6xj"
Oct 30 20:06:22.865474 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:22.857228    6275 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w6-51dd62/simulator-w6-51dd62-kserve-d6bb4985f-65j9h"
Oct 30 20:06:22.865474 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:22.861960    6275 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w4-f1f016/premium-w4-f1f016-kserve-55d6bd678b-w5hkc"
Oct 30 20:06:22.866495 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:22.865950    6275 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w2-efbac3/premium-w2-efbac3-kserve-55f54cfff6-9fqbz"
Oct 30 20:06:23.249772 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:23.249346    6275 patch_prober.go:29] interesting pod/e2e-worker-w3-912f24-openshift-default-5f56ff5f6c-sth92 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.96:15021/healthz/ready\": dial tcp 10.134.0.96:15021: connect: connection refused" start-of-body=
Oct 30 20:06:23.249772 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:23.249406    6275 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-912f24-openshift-default-5f56ff5f6c-sth92" podUID="8a7d6f48-c37d-4f85-82e1-46b8b330b366" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.96:15021/healthz/ready\": dial tcp 10.134.0.96:15021: connect: connection refused"
Oct 30 20:06:23.378231 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:23.378197    6275 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-c16272d2-4k2d6"]
Oct 30 20:06:23.384195 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:23.384172    6275 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-c16272d2-4k2d6"
Oct 30 20:06:23.415078 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:23.415019    6275 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\""
Oct 30 20:06:23.415258 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:23.415151    6275 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-scs2w\""
Oct 30 20:06:23.416884 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:23.416861    6275 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-c16272d2-4k2d6"]
Oct 30 20:06:23.476936 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:23.476906    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/28444cd2-19ee-4c34-bb96-69c8d22feb2a-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-c16272d2-4k2d6\" (UID: \"28444cd2-19ee-4c34-bb96-69c8d22feb2a\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-c16272d2-4k2d6"
Oct 30 20:06:23.477194 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:23.477172    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/28444cd2-19ee-4c34-bb96-69c8d22feb2a-maas-api-xks-ca\") pod \"maas-api-revoke-sub-c16272d2-4k2d6\" (UID: \"28444cd2-19ee-4c34-bb96-69c8d22feb2a\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-c16272d2-4k2d6"
Oct 30 20:06:23.477263 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:23.477219    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jdjp9\" (UniqueName: \"kubernetes.io/projected/28444cd2-19ee-4c34-bb96-69c8d22feb2a-kube-api-access-jdjp9\") pod \"maas-api-revoke-sub-c16272d2-4k2d6\" (UID: \"28444cd2-19ee-4c34-bb96-69c8d22feb2a\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-c16272d2-4k2d6"
Oct 30 20:06:23.578913 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:23.578529    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/28444cd2-19ee-4c34-bb96-69c8d22feb2a-maas-api-xks-ca\") pod \"maas-api-revoke-sub-c16272d2-4k2d6\" (UID: \"28444cd2-19ee-4c34-bb96-69c8d22feb2a\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-c16272d2-4k2d6"
Oct 30 20:06:23.578913 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:23.578604    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jdjp9\" (UniqueName: \"kubernetes.io/projected/28444cd2-19ee-4c34-bb96-69c8d22feb2a-kube-api-access-jdjp9\") pod \"maas-api-revoke-sub-c16272d2-4k2d6\" (UID: \"28444cd2-19ee-4c34-bb96-69c8d22feb2a\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-c16272d2-4k2d6"
Oct 30 20:06:23.578913 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:23.578743    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/28444cd2-19ee-4c34-bb96-69c8d22feb2a-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-c16272d2-4k2d6\" (UID: \"28444cd2-19ee-4c34-bb96-69c8d22feb2a\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-c16272d2-4k2d6"
Oct 30 20:06:23.582435 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:23.579912    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/28444cd2-19ee-4c34-bb96-69c8d22feb2a-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-c16272d2-4k2d6\" (UID: \"28444cd2-19ee-4c34-bb96-69c8d22feb2a\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-c16272d2-4k2d6"
Oct 30 20:06:23.586432 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:23.585220    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/28444cd2-19ee-4c34-bb96-69c8d22feb2a-maas-api-xks-ca\") pod \"maas-api-revoke-sub-c16272d2-4k2d6\" (UID: \"28444cd2-19ee-4c34-bb96-69c8d22feb2a\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-c16272d2-4k2d6"
Oct 30 20:06:23.602607 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:23.601859    6275 patch_prober.go:29] interesting pod/e2e-worker-w5-626870-openshift-default-7cd649d59c-8m57h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.94:15021/healthz/ready\": dial tcp 10.134.0.94:15021: connect: connection refused" start-of-body=
Oct 30 20:06:23.602607 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:23.601925    6275 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-626870-openshift-default-7cd649d59c-8m57h" podUID="8c41c1e8-30e2-416d-a07e-cb0177f33ff6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.94:15021/healthz/ready\": dial tcp 10.134.0.94:15021: connect: connection refused"
Oct 30 20:06:23.606800 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:23.606752    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jdjp9\" (UniqueName: \"kubernetes.io/projected/28444cd2-19ee-4c34-bb96-69c8d22feb2a-kube-api-access-jdjp9\") pod \"maas-api-revoke-sub-c16272d2-4k2d6\" (UID: \"28444cd2-19ee-4c34-bb96-69c8d22feb2a\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-c16272d2-4k2d6"
Oct 30 20:06:23.719034 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:23.718307    6275 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-c16272d2-4k2d6"
Oct 30 20:06:24.049306 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:24.048353    6275 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w2-efbac3-openshift-default-844cb4689c-vwdfb"
Oct 30 20:06:24.049306 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:24.049219    6275 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w2-efbac3-openshift-default-844cb4689c-vwdfb"
Oct 30 20:06:24.050593 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:24.050544    6275 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w2-efbac3-openshift-default-844cb4689c-vwdfb"
Oct 30 20:06:24.098471 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:24.098182    6275 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-c16272d2-4k2d6"]
Oct 30 20:06:24.249299 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:24.249260    6275 patch_prober.go:29] interesting pod/e2e-worker-w3-912f24-openshift-default-5f56ff5f6c-sth92 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.96:15021/healthz/ready\": dial tcp 10.134.0.96:15021: connect: connection refused" start-of-body=
Oct 30 20:06:24.249512 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:24.249320    6275 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-912f24-openshift-default-5f56ff5f6c-sth92" podUID="8a7d6f48-c37d-4f85-82e1-46b8b330b366" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.96:15021/healthz/ready\": dial tcp 10.134.0.96:15021: connect: connection refused"
Oct 30 20:06:24.362492 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:24.362368    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-c16272d2-4k2d6" event={"ID":"28444cd2-19ee-4c34-bb96-69c8d22feb2a","Type":"ContainerStarted","Data":"326fcbf19df8356d9a87599233025aa9751cbb525b6062f629cd3f10f6d68ffe"}
Oct 30 20:06:25.375831 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:25.375733    6275 generic.go:356] "Generic (PLEG): container finished" podID="28444cd2-19ee-4c34-bb96-69c8d22feb2a" containerID="3c6feefcb98409d46dde5e2d50a81960b73bae9da01e3d3d62a33578f0e483e8" exitCode=0
Oct 30 20:06:25.376516 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:25.376487    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-c16272d2-4k2d6" event={"ID":"28444cd2-19ee-4c34-bb96-69c8d22feb2a","Type":"ContainerDied","Data":"3c6feefcb98409d46dde5e2d50a81960b73bae9da01e3d3d62a33578f0e483e8"}
Oct 30 20:06:25.609438 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:25.601934    6275 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w5-626870-openshift-default-7cd649d59c-8m57h"
Oct 30 20:06:25.642585 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:25.642508    6275 patch_prober.go:29] interesting pod/e2e-worker-w5-626870-openshift-default-7cd649d59c-8m57h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.94:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 20:06:25.642585 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:25.642555    6275 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-626870-openshift-default-7cd649d59c-8m57h" podUID="8c41c1e8-30e2-416d-a07e-cb0177f33ff6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.94:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:06:25.944848 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:25.944768    6275 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w5-626870-openshift-default-7cd649d59c-8m57h"
Oct 30 20:06:26.248361 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:26.248325    6275 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w3-912f24-openshift-default-5f56ff5f6c-sth92"
Oct 30 20:06:26.257345 ip-10-0-131-26 kubenswrapper[6275]: E1030 20:06:26.257318    6275 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-fwc77" containerName="extractor"
Oct 30 20:06:26.288585 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:26.288550    6275 patch_prober.go:29] interesting pod/e2e-worker-w3-912f24-openshift-default-5f56ff5f6c-sth92 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.96:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 20:06:26.288718 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:26.288608    6275 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-912f24-openshift-default-5f56ff5f6c-sth92" podUID="8a7d6f48-c37d-4f85-82e1-46b8b330b366" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.96:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:06:26.373167 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:26.373131    6275 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-a475348d-4lhjg"]
Oct 30 20:06:26.377860 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:26.377832    6275 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-a475348d-4lhjg"
Oct 30 20:06:26.379521 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:26.379493    6275 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w3-912f24-openshift-default-5f56ff5f6c-sth92"
Oct 30 20:06:26.389127 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:26.389094    6275 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w5-626870-openshift-default-7cd649d59c-8m57h"
Oct 30 20:06:26.389247 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:26.389164    6275 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w3-912f24-openshift-default-5f56ff5f6c-sth92"
Oct 30 20:06:26.402689 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:26.402663    6275 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-a475348d-4lhjg"]
Oct 30 20:06:26.433541 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:26.433499    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zvqz2\" (UniqueName: \"kubernetes.io/projected/92ec4258-14ad-48b4-aca6-4716ebb37ec8-kube-api-access-zvqz2\") pod \"maas-api-revoke-sub-a475348d-4lhjg\" (UID: \"92ec4258-14ad-48b4-aca6-4716ebb37ec8\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-a475348d-4lhjg"
Oct 30 20:06:26.433708 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:26.433558    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/92ec4258-14ad-48b4-aca6-4716ebb37ec8-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-a475348d-4lhjg\" (UID: \"92ec4258-14ad-48b4-aca6-4716ebb37ec8\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-a475348d-4lhjg"
Oct 30 20:06:26.433889 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:26.433867    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/92ec4258-14ad-48b4-aca6-4716ebb37ec8-maas-api-xks-ca\") pod \"maas-api-revoke-sub-a475348d-4lhjg\" (UID: \"92ec4258-14ad-48b4-aca6-4716ebb37ec8\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-a475348d-4lhjg"
Oct 30 20:06:26.536485 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:26.535927    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zvqz2\" (UniqueName: \"kubernetes.io/projected/92ec4258-14ad-48b4-aca6-4716ebb37ec8-kube-api-access-zvqz2\") pod \"maas-api-revoke-sub-a475348d-4lhjg\" (UID: \"92ec4258-14ad-48b4-aca6-4716ebb37ec8\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-a475348d-4lhjg"
Oct 30 20:06:26.536485 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:26.535996    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/92ec4258-14ad-48b4-aca6-4716ebb37ec8-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-a475348d-4lhjg\" (UID: \"92ec4258-14ad-48b4-aca6-4716ebb37ec8\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-a475348d-4lhjg"
Oct 30 20:06:26.536485 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:26.536246    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/92ec4258-14ad-48b4-aca6-4716ebb37ec8-maas-api-xks-ca\") pod \"maas-api-revoke-sub-a475348d-4lhjg\" (UID: \"92ec4258-14ad-48b4-aca6-4716ebb37ec8\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-a475348d-4lhjg"
Oct 30 20:06:26.543252 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:26.537493    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/92ec4258-14ad-48b4-aca6-4716ebb37ec8-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-a475348d-4lhjg\" (UID: \"92ec4258-14ad-48b4-aca6-4716ebb37ec8\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-a475348d-4lhjg"
Oct 30 20:06:26.547711 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:26.547686    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/92ec4258-14ad-48b4-aca6-4716ebb37ec8-maas-api-xks-ca\") pod \"maas-api-revoke-sub-a475348d-4lhjg\" (UID: \"92ec4258-14ad-48b4-aca6-4716ebb37ec8\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-a475348d-4lhjg"
Oct 30 20:06:26.569430 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:26.565158    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zvqz2\" (UniqueName: \"kubernetes.io/projected/92ec4258-14ad-48b4-aca6-4716ebb37ec8-kube-api-access-zvqz2\") pod \"maas-api-revoke-sub-a475348d-4lhjg\" (UID: \"92ec4258-14ad-48b4-aca6-4716ebb37ec8\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-a475348d-4lhjg"
Oct 30 20:06:26.648859 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:26.648829    6275 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-c16272d2-4k2d6"
Oct 30 20:06:26.696526 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:26.696499    6275 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-a475348d-4lhjg"
Oct 30 20:06:26.739242 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:26.739213    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/28444cd2-19ee-4c34-bb96-69c8d22feb2a-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/28444cd2-19ee-4c34-bb96-69c8d22feb2a-maas-api-xks-ca\") pod \"28444cd2-19ee-4c34-bb96-69c8d22feb2a\" (UID: \"28444cd2-19ee-4c34-bb96-69c8d22feb2a\") "
Oct 30 20:06:26.739408 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:26.739289    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/28444cd2-19ee-4c34-bb96-69c8d22feb2a-kube-api-access-jdjp9\" (UniqueName: \"kubernetes.io/projected/28444cd2-19ee-4c34-bb96-69c8d22feb2a-kube-api-access-jdjp9\") pod \"28444cd2-19ee-4c34-bb96-69c8d22feb2a\" (UID: \"28444cd2-19ee-4c34-bb96-69c8d22feb2a\") "
Oct 30 20:06:26.739408 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:26.739363    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/28444cd2-19ee-4c34-bb96-69c8d22feb2a-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/28444cd2-19ee-4c34-bb96-69c8d22feb2a-maas-api-openshift-ca\") pod \"28444cd2-19ee-4c34-bb96-69c8d22feb2a\" (UID: \"28444cd2-19ee-4c34-bb96-69c8d22feb2a\") "
Oct 30 20:06:26.740215 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:26.740190    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/28444cd2-19ee-4c34-bb96-69c8d22feb2a-maas-api-openshift-ca" pod "28444cd2-19ee-4c34-bb96-69c8d22feb2a" (UID: "28444cd2-19ee-4c34-bb96-69c8d22feb2a"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:06:26.741776 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:26.741738    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/28444cd2-19ee-4c34-bb96-69c8d22feb2a-kube-api-access-jdjp9" pod "28444cd2-19ee-4c34-bb96-69c8d22feb2a" (UID: "28444cd2-19ee-4c34-bb96-69c8d22feb2a"). InnerVolumeSpecName "kube-api-access-jdjp9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:06:26.743208 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:26.743188    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/28444cd2-19ee-4c34-bb96-69c8d22feb2a-maas-api-xks-ca" pod "28444cd2-19ee-4c34-bb96-69c8d22feb2a" (UID: "28444cd2-19ee-4c34-bb96-69c8d22feb2a"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 20:06:26.841855 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:26.841783    6275 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jdjp9\" (UniqueName: \"kubernetes.io/projected/28444cd2-19ee-4c34-bb96-69c8d22feb2a-kube-api-access-jdjp9\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:06:26.842041 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:26.842021    6275 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/28444cd2-19ee-4c34-bb96-69c8d22feb2a-maas-api-openshift-ca\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:06:26.842125 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:26.842114    6275 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/28444cd2-19ee-4c34-bb96-69c8d22feb2a-maas-api-xks-ca\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:06:27.057487 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:27.056971    6275 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-a475348d-4lhjg"]
Oct 30 20:06:27.059442 ip-10-0-131-26 kubenswrapper[6275]: W1030 20:06:27.059399    6275 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod92ec4258_14ad_48b4_aca6_4716ebb37ec8.slice/crio-ec47dd48b176093db40eb876216deab34d8e63888c42f220f982237f3c6a52c7 WatchSource:0}: Error finding container ec47dd48b176093db40eb876216deab34d8e63888c42f220f982237f3c6a52c7: Status 404 returned error can't find the container with id ec47dd48b176093db40eb876216deab34d8e63888c42f220f982237f3c6a52c7
Oct 30 20:06:27.396136 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:27.396048    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-a475348d-4lhjg" event={"ID":"92ec4258-14ad-48b4-aca6-4716ebb37ec8","Type":"ContainerStarted","Data":"ec47dd48b176093db40eb876216deab34d8e63888c42f220f982237f3c6a52c7"}
Oct 30 20:06:27.397567 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:27.397539    6275 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-c16272d2-4k2d6"
Oct 30 20:06:27.397689 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:27.397577    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-c16272d2-4k2d6" event={"ID":"28444cd2-19ee-4c34-bb96-69c8d22feb2a","Type":"ContainerDied","Data":"326fcbf19df8356d9a87599233025aa9751cbb525b6062f629cd3f10f6d68ffe"}
Oct 30 20:06:27.397689 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:27.397621    6275 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="326fcbf19df8356d9a87599233025aa9751cbb525b6062f629cd3f10f6d68ffe"
Oct 30 20:06:27.626550 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:27.626516    6275 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w4-f1f016/distinct-2-w4-f1f016-kserve-69f97f4b78-4m64r"]
Oct 30 20:06:27.627647 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:27.627619    6275 cpu_manager.go:414] "containerMap: removing container" podUID="28444cd2-19ee-4c34-bb96-69c8d22feb2a" containerName="revoke-keys"
Oct 30 20:06:27.627647 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:27.627645    6275 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="28444cd2-19ee-4c34-bb96-69c8d22feb2a" containerName="revoke-keys"
Oct 30 20:06:27.627848 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:27.627826    6275 memory_manager.go:365] "RemoveStaleState removing state" podUID="28444cd2-19ee-4c34-bb96-69c8d22feb2a" containerName="revoke-keys"
Oct 30 20:06:27.632345 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:27.632321    6275 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-f1f016/distinct-2-w4-f1f016-kserve-69f97f4b78-4m64r"
Oct 30 20:06:27.651945 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:27.651871    6275 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w4-f1f016\"/\"distinct-2-w4-f1f016-kserve-self-signed-certs\""
Oct 30 20:06:27.654396 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:27.654372    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/96f19e7c-d36d-4109-bde0-24725bc670dd-tls-certs\") pod \"distinct-2-w4-f1f016-kserve-69f97f4b78-4m64r\" (UID: \"96f19e7c-d36d-4109-bde0-24725bc670dd\") " pod="e2e-models-e2e-worker-w4-f1f016/distinct-2-w4-f1f016-kserve-69f97f4b78-4m64r"
Oct 30 20:06:27.654557 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:27.654406    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bqpfw\" (UniqueName: \"kubernetes.io/projected/96f19e7c-d36d-4109-bde0-24725bc670dd-kube-api-access-bqpfw\") pod \"distinct-2-w4-f1f016-kserve-69f97f4b78-4m64r\" (UID: \"96f19e7c-d36d-4109-bde0-24725bc670dd\") " pod="e2e-models-e2e-worker-w4-f1f016/distinct-2-w4-f1f016-kserve-69f97f4b78-4m64r"
Oct 30 20:06:27.654613 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:27.654554    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/96f19e7c-d36d-4109-bde0-24725bc670dd-dshm\") pod \"distinct-2-w4-f1f016-kserve-69f97f4b78-4m64r\" (UID: \"96f19e7c-d36d-4109-bde0-24725bc670dd\") " pod="e2e-models-e2e-worker-w4-f1f016/distinct-2-w4-f1f016-kserve-69f97f4b78-4m64r"
Oct 30 20:06:27.654664 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:27.654641    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/96f19e7c-d36d-4109-bde0-24725bc670dd-model-cache\") pod \"distinct-2-w4-f1f016-kserve-69f97f4b78-4m64r\" (UID: \"96f19e7c-d36d-4109-bde0-24725bc670dd\") " pod="e2e-models-e2e-worker-w4-f1f016/distinct-2-w4-f1f016-kserve-69f97f4b78-4m64r"
Oct 30 20:06:27.654759 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:27.654741    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/96f19e7c-d36d-4109-bde0-24725bc670dd-tmp-dir\") pod \"distinct-2-w4-f1f016-kserve-69f97f4b78-4m64r\" (UID: \"96f19e7c-d36d-4109-bde0-24725bc670dd\") " pod="e2e-models-e2e-worker-w4-f1f016/distinct-2-w4-f1f016-kserve-69f97f4b78-4m64r"
Oct 30 20:06:27.654964 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:27.654902    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/96f19e7c-d36d-4109-bde0-24725bc670dd-home\") pod \"distinct-2-w4-f1f016-kserve-69f97f4b78-4m64r\" (UID: \"96f19e7c-d36d-4109-bde0-24725bc670dd\") " pod="e2e-models-e2e-worker-w4-f1f016/distinct-2-w4-f1f016-kserve-69f97f4b78-4m64r"
Oct 30 20:06:27.662318 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:27.662296    6275 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-f1f016/distinct-2-w4-f1f016-kserve-69f97f4b78-4m64r"]
Oct 30 20:06:27.756802 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:27.756765    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/96f19e7c-d36d-4109-bde0-24725bc670dd-home\") pod \"distinct-2-w4-f1f016-kserve-69f97f4b78-4m64r\" (UID: \"96f19e7c-d36d-4109-bde0-24725bc670dd\") " pod="e2e-models-e2e-worker-w4-f1f016/distinct-2-w4-f1f016-kserve-69f97f4b78-4m64r"
Oct 30 20:06:27.757118 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:27.757096    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/96f19e7c-d36d-4109-bde0-24725bc670dd-tls-certs\") pod \"distinct-2-w4-f1f016-kserve-69f97f4b78-4m64r\" (UID: \"96f19e7c-d36d-4109-bde0-24725bc670dd\") " pod="e2e-models-e2e-worker-w4-f1f016/distinct-2-w4-f1f016-kserve-69f97f4b78-4m64r"
Oct 30 20:06:27.757278 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:27.757128    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bqpfw\" (UniqueName: \"kubernetes.io/projected/96f19e7c-d36d-4109-bde0-24725bc670dd-kube-api-access-bqpfw\") pod \"distinct-2-w4-f1f016-kserve-69f97f4b78-4m64r\" (UID: \"96f19e7c-d36d-4109-bde0-24725bc670dd\") " pod="e2e-models-e2e-worker-w4-f1f016/distinct-2-w4-f1f016-kserve-69f97f4b78-4m64r"
Oct 30 20:06:27.757278 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:27.757166    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/96f19e7c-d36d-4109-bde0-24725bc670dd-dshm\") pod \"distinct-2-w4-f1f016-kserve-69f97f4b78-4m64r\" (UID: \"96f19e7c-d36d-4109-bde0-24725bc670dd\") " pod="e2e-models-e2e-worker-w4-f1f016/distinct-2-w4-f1f016-kserve-69f97f4b78-4m64r"
Oct 30 20:06:27.757278 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:27.757195    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/96f19e7c-d36d-4109-bde0-24725bc670dd-model-cache\") pod \"distinct-2-w4-f1f016-kserve-69f97f4b78-4m64r\" (UID: \"96f19e7c-d36d-4109-bde0-24725bc670dd\") " pod="e2e-models-e2e-worker-w4-f1f016/distinct-2-w4-f1f016-kserve-69f97f4b78-4m64r"
Oct 30 20:06:27.757278 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:27.757250    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/96f19e7c-d36d-4109-bde0-24725bc670dd-tmp-dir\") pod \"distinct-2-w4-f1f016-kserve-69f97f4b78-4m64r\" (UID: \"96f19e7c-d36d-4109-bde0-24725bc670dd\") " pod="e2e-models-e2e-worker-w4-f1f016/distinct-2-w4-f1f016-kserve-69f97f4b78-4m64r"
Oct 30 20:06:27.757526 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:27.757355    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/96f19e7c-d36d-4109-bde0-24725bc670dd-home\") pod \"distinct-2-w4-f1f016-kserve-69f97f4b78-4m64r\" (UID: \"96f19e7c-d36d-4109-bde0-24725bc670dd\") " pod="e2e-models-e2e-worker-w4-f1f016/distinct-2-w4-f1f016-kserve-69f97f4b78-4m64r"
Oct 30 20:06:27.757689 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:27.757661    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/96f19e7c-d36d-4109-bde0-24725bc670dd-tmp-dir\") pod \"distinct-2-w4-f1f016-kserve-69f97f4b78-4m64r\" (UID: \"96f19e7c-d36d-4109-bde0-24725bc670dd\") " pod="e2e-models-e2e-worker-w4-f1f016/distinct-2-w4-f1f016-kserve-69f97f4b78-4m64r"
Oct 30 20:06:27.758066 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:27.758040    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/96f19e7c-d36d-4109-bde0-24725bc670dd-model-cache\") pod \"distinct-2-w4-f1f016-kserve-69f97f4b78-4m64r\" (UID: \"96f19e7c-d36d-4109-bde0-24725bc670dd\") " pod="e2e-models-e2e-worker-w4-f1f016/distinct-2-w4-f1f016-kserve-69f97f4b78-4m64r"
Oct 30 20:06:27.760461 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:27.760399    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/96f19e7c-d36d-4109-bde0-24725bc670dd-dshm\") pod \"distinct-2-w4-f1f016-kserve-69f97f4b78-4m64r\" (UID: \"96f19e7c-d36d-4109-bde0-24725bc670dd\") " pod="e2e-models-e2e-worker-w4-f1f016/distinct-2-w4-f1f016-kserve-69f97f4b78-4m64r"
Oct 30 20:06:27.760574 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:27.760529    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/96f19e7c-d36d-4109-bde0-24725bc670dd-tls-certs\") pod \"distinct-2-w4-f1f016-kserve-69f97f4b78-4m64r\" (UID: \"96f19e7c-d36d-4109-bde0-24725bc670dd\") " pod="e2e-models-e2e-worker-w4-f1f016/distinct-2-w4-f1f016-kserve-69f97f4b78-4m64r"
Oct 30 20:06:27.782293 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:27.782272    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bqpfw\" (UniqueName: \"kubernetes.io/projected/96f19e7c-d36d-4109-bde0-24725bc670dd-kube-api-access-bqpfw\") pod \"distinct-2-w4-f1f016-kserve-69f97f4b78-4m64r\" (UID: \"96f19e7c-d36d-4109-bde0-24725bc670dd\") " pod="e2e-models-e2e-worker-w4-f1f016/distinct-2-w4-f1f016-kserve-69f97f4b78-4m64r"
Oct 30 20:06:27.949911 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:27.949819    6275 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-f1f016/distinct-2-w4-f1f016-kserve-69f97f4b78-4m64r"
Oct 30 20:06:28.282053 ip-10-0-131-26 kubenswrapper[6275]: W1030 20:06:28.282022    6275 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod96f19e7c_d36d_4109_bde0_24725bc670dd.slice/crio-df8700c05de1eaf4736e3b301e273d604bbe8457bb04c51eac8d3b228155c25b WatchSource:0}: Error finding container df8700c05de1eaf4736e3b301e273d604bbe8457bb04c51eac8d3b228155c25b: Status 404 returned error can't find the container with id df8700c05de1eaf4736e3b301e273d604bbe8457bb04c51eac8d3b228155c25b
Oct 30 20:06:28.284029 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:28.284004    6275 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-f1f016/distinct-2-w4-f1f016-kserve-69f97f4b78-4m64r"]
Oct 30 20:06:28.408226 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:28.408194    6275 generic.go:356] "Generic (PLEG): container finished" podID="92ec4258-14ad-48b4-aca6-4716ebb37ec8" containerID="5c960b55c9414229b7fdafcd3a290229387bd6c24584da7b1660910f7d7ce6cd" exitCode=0
Oct 30 20:06:28.408649 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:28.408291    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-a475348d-4lhjg" event={"ID":"92ec4258-14ad-48b4-aca6-4716ebb37ec8","Type":"ContainerDied","Data":"5c960b55c9414229b7fdafcd3a290229387bd6c24584da7b1660910f7d7ce6cd"}
Oct 30 20:06:28.410189 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:28.410164    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-f1f016/distinct-2-w4-f1f016-kserve-69f97f4b78-4m64r" event={"ID":"96f19e7c-d36d-4109-bde0-24725bc670dd","Type":"ContainerStarted","Data":"d9d817f395f85aa38f6303f7cd4eb85f4d67b0715806f0708c2d37d0d2b9aea7"}
Oct 30 20:06:28.410301 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:28.410197    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-f1f016/distinct-2-w4-f1f016-kserve-69f97f4b78-4m64r" event={"ID":"96f19e7c-d36d-4109-bde0-24725bc670dd","Type":"ContainerStarted","Data":"df8700c05de1eaf4736e3b301e273d604bbe8457bb04c51eac8d3b228155c25b"}
Oct 30 20:06:28.506925 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:28.506868    6275 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w4-f1f016/distinct-2-w4-f1f016-kserve-69f97f4b78-4m64r" podStartSLOduration=1.506849451 podStartE2EDuration="1.506849451s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:06:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:06:28.499102152 +0000 UTC m=+1098.960829013" watchObservedRunningTime="2026-10-30 20:06:28.506849451 +0000 UTC m=+1098.968576316"
Oct 30 20:06:28.950220 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:28.950152    6275 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w4-f1f016/distinct-2-w4-f1f016-kserve-69f97f4b78-4m64r"
Oct 30 20:06:29.571315 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:29.571290    6275 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-a475348d-4lhjg"
Oct 30 20:06:29.684063 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:29.683998    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/92ec4258-14ad-48b4-aca6-4716ebb37ec8-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/92ec4258-14ad-48b4-aca6-4716ebb37ec8-maas-api-xks-ca\") pod \"92ec4258-14ad-48b4-aca6-4716ebb37ec8\" (UID: \"92ec4258-14ad-48b4-aca6-4716ebb37ec8\") "
Oct 30 20:06:29.684233 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:29.684219    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/92ec4258-14ad-48b4-aca6-4716ebb37ec8-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/92ec4258-14ad-48b4-aca6-4716ebb37ec8-maas-api-openshift-ca\") pod \"92ec4258-14ad-48b4-aca6-4716ebb37ec8\" (UID: \"92ec4258-14ad-48b4-aca6-4716ebb37ec8\") "
Oct 30 20:06:29.684296 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:29.684284    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/92ec4258-14ad-48b4-aca6-4716ebb37ec8-kube-api-access-zvqz2\" (UniqueName: \"kubernetes.io/projected/92ec4258-14ad-48b4-aca6-4716ebb37ec8-kube-api-access-zvqz2\") pod \"92ec4258-14ad-48b4-aca6-4716ebb37ec8\" (UID: \"92ec4258-14ad-48b4-aca6-4716ebb37ec8\") "
Oct 30 20:06:29.684600 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:29.684571    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/92ec4258-14ad-48b4-aca6-4716ebb37ec8-maas-api-openshift-ca" pod "92ec4258-14ad-48b4-aca6-4716ebb37ec8" (UID: "92ec4258-14ad-48b4-aca6-4716ebb37ec8"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:06:29.684756 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:29.684740    6275 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/92ec4258-14ad-48b4-aca6-4716ebb37ec8-maas-api-openshift-ca\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:06:29.686104 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:29.686077    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/92ec4258-14ad-48b4-aca6-4716ebb37ec8-maas-api-xks-ca" pod "92ec4258-14ad-48b4-aca6-4716ebb37ec8" (UID: "92ec4258-14ad-48b4-aca6-4716ebb37ec8"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 20:06:29.686233 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:29.686210    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/92ec4258-14ad-48b4-aca6-4716ebb37ec8-kube-api-access-zvqz2" pod "92ec4258-14ad-48b4-aca6-4716ebb37ec8" (UID: "92ec4258-14ad-48b4-aca6-4716ebb37ec8"). InnerVolumeSpecName "kube-api-access-zvqz2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:06:29.786051 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:29.786022    6275 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zvqz2\" (UniqueName: \"kubernetes.io/projected/92ec4258-14ad-48b4-aca6-4716ebb37ec8-kube-api-access-zvqz2\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:06:29.786051 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:29.786048    6275 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/92ec4258-14ad-48b4-aca6-4716ebb37ec8-maas-api-xks-ca\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:06:30.426260 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:30.426226    6275 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-a475348d-4lhjg"
Oct 30 20:06:30.426435 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:30.426266    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-a475348d-4lhjg" event={"ID":"92ec4258-14ad-48b4-aca6-4716ebb37ec8","Type":"ContainerDied","Data":"ec47dd48b176093db40eb876216deab34d8e63888c42f220f982237f3c6a52c7"}
Oct 30 20:06:30.426435 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:30.426318    6275 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ec47dd48b176093db40eb876216deab34d8e63888c42f220f982237f3c6a52c7"
Oct 30 20:06:37.950274 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:37.950236    6275 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w4-f1f016/distinct-2-w4-f1f016-kserve-69f97f4b78-4m64r"
Oct 30 20:06:37.962501 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:37.962478    6275 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w4-f1f016/distinct-2-w4-f1f016-kserve-69f97f4b78-4m64r"
Oct 30 20:06:38.511005 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:38.510974    6275 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w4-f1f016/distinct-2-w4-f1f016-kserve-69f97f4b78-4m64r"
Oct 30 20:06:40.448670 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:40.448633    6275 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-06b9ffc0-gn8wh"]
Oct 30 20:06:40.450756 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:40.450728    6275 cpu_manager.go:414] "containerMap: removing container" podUID="92ec4258-14ad-48b4-aca6-4716ebb37ec8" containerName="revoke-keys"
Oct 30 20:06:40.450934 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:40.450917    6275 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="92ec4258-14ad-48b4-aca6-4716ebb37ec8" containerName="revoke-keys"
Oct 30 20:06:40.451514 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:40.451495    6275 memory_manager.go:365] "RemoveStaleState removing state" podUID="92ec4258-14ad-48b4-aca6-4716ebb37ec8" containerName="revoke-keys"
Oct 30 20:06:40.461850 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:40.461829    6275 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-06b9ffc0-gn8wh"
Oct 30 20:06:40.476600 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:40.476253    6275 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-06b9ffc0-gn8wh"]
Oct 30 20:06:40.481922 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:40.481884    6275 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\""
Oct 30 20:06:40.492503 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:40.491987    6275 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-scs2w\""
Oct 30 20:06:40.628091 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:40.627369    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/e879d637-cf0f-42f4-979f-2b3230566adb-maas-api-xks-ca\") pod \"maas-api-revoke-sub-06b9ffc0-gn8wh\" (UID: \"e879d637-cf0f-42f4-979f-2b3230566adb\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-06b9ffc0-gn8wh"
Oct 30 20:06:40.628091 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:40.627500    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mgd8f\" (UniqueName: \"kubernetes.io/projected/e879d637-cf0f-42f4-979f-2b3230566adb-kube-api-access-mgd8f\") pod \"maas-api-revoke-sub-06b9ffc0-gn8wh\" (UID: \"e879d637-cf0f-42f4-979f-2b3230566adb\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-06b9ffc0-gn8wh"
Oct 30 20:06:40.628091 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:40.627763    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/e879d637-cf0f-42f4-979f-2b3230566adb-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-06b9ffc0-gn8wh\" (UID: \"e879d637-cf0f-42f4-979f-2b3230566adb\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-06b9ffc0-gn8wh"
Oct 30 20:06:40.732723 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:40.732625    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/e879d637-cf0f-42f4-979f-2b3230566adb-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-06b9ffc0-gn8wh\" (UID: \"e879d637-cf0f-42f4-979f-2b3230566adb\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-06b9ffc0-gn8wh"
Oct 30 20:06:40.734535 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:40.734510    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/e879d637-cf0f-42f4-979f-2b3230566adb-maas-api-xks-ca\") pod \"maas-api-revoke-sub-06b9ffc0-gn8wh\" (UID: \"e879d637-cf0f-42f4-979f-2b3230566adb\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-06b9ffc0-gn8wh"
Oct 30 20:06:40.734822 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:40.734803    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mgd8f\" (UniqueName: \"kubernetes.io/projected/e879d637-cf0f-42f4-979f-2b3230566adb-kube-api-access-mgd8f\") pod \"maas-api-revoke-sub-06b9ffc0-gn8wh\" (UID: \"e879d637-cf0f-42f4-979f-2b3230566adb\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-06b9ffc0-gn8wh"
Oct 30 20:06:40.735447 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:40.734563    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/e879d637-cf0f-42f4-979f-2b3230566adb-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-06b9ffc0-gn8wh\" (UID: \"e879d637-cf0f-42f4-979f-2b3230566adb\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-06b9ffc0-gn8wh"
Oct 30 20:06:40.744236 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:40.739015    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/e879d637-cf0f-42f4-979f-2b3230566adb-maas-api-xks-ca\") pod \"maas-api-revoke-sub-06b9ffc0-gn8wh\" (UID: \"e879d637-cf0f-42f4-979f-2b3230566adb\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-06b9ffc0-gn8wh"
Oct 30 20:06:40.780431 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:40.779012    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mgd8f\" (UniqueName: \"kubernetes.io/projected/e879d637-cf0f-42f4-979f-2b3230566adb-kube-api-access-mgd8f\") pod \"maas-api-revoke-sub-06b9ffc0-gn8wh\" (UID: \"e879d637-cf0f-42f4-979f-2b3230566adb\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-06b9ffc0-gn8wh"
Oct 30 20:06:40.797914 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:40.797654    6275 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-06b9ffc0-gn8wh"
Oct 30 20:06:42.003503 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:42.001168    6275 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-06b9ffc0-gn8wh"]
Oct 30 20:06:42.137763 ip-10-0-131-26 kubenswrapper[6275]: W1030 20:06:42.137728    6275 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode879d637_cf0f_42f4_979f_2b3230566adb.slice/crio-11f534ec986032bc3fc9172c76bc659aeb711ee887e3619d49a8189fd4d43cf6 WatchSource:0}: Error finding container 11f534ec986032bc3fc9172c76bc659aeb711ee887e3619d49a8189fd4d43cf6: Status 404 returned error can't find the container with id 11f534ec986032bc3fc9172c76bc659aeb711ee887e3619d49a8189fd4d43cf6
Oct 30 20:06:42.447141 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:42.445086    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-5f10d2/premium-w1-5f10d2-kserve-644b846669-286m2" podUID="a2ff6903-c1ab-48dd-884b-d119b8ee1ed6" containerName="main" probeResult="failure" output="Get \"https://10.134.0.61:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:06:42.497692 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:42.497641    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-efbac3/premium-w2-efbac3-kserve-55f54cfff6-9fqbz" podUID="083136dc-91fb-454f-a782-87b004e73d1b" containerName="main" probeResult="failure" output="Get \"https://10.134.0.59:8000/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:06:42.517236 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:42.516234    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-f1f016/distinct-2-w4-f1f016-kserve-69f97f4b78-4m64r" podUID="96f19e7c-d36d-4109-bde0-24725bc670dd" containerName="main" probeResult="failure" output="Get \"https://10.134.0.99:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:06:42.568799 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:42.567552    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-626870/premium-w5-626870-kserve-5df7f7b5c4-vx59r" podUID="a1adddd4-3218-4a6b-a145-0290bceff76f" containerName="main" probeResult="failure" output="Get \"https://10.134.0.57:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:06:42.591378 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:42.579293    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-51dd62/simulator-w6-51dd62-kserve-d6bb4985f-65j9h" podUID="f7e1ff07-15d6-49b5-8edc-52c9d6825ed7" containerName="main" probeResult="failure" output="Get \"https://10.134.0.56:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:06:42.633441 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:42.613043    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-f1f016/premium-w4-f1f016-kserve-55d6bd678b-w5hkc" podUID="0e543ba9-1e7a-4d0a-9361-50c98060e824" containerName="main" probeResult="failure" output="Get \"https://10.134.0.60:8000/ready\": context deadline exceeded"
Oct 30 20:06:42.659590 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:42.659538    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-912f24/simulator-w3-912f24-kserve-59897cf48b-sd5wj" podUID="b4de6427-0db0-42d9-8b88-6b35d9d4c314" containerName="main" probeResult="failure" output="Get \"https://10.134.0.54:8000/ready\": context deadline exceeded"
Oct 30 20:06:42.694445 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:42.693975    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-06b9ffc0-gn8wh" event={"ID":"e879d637-cf0f-42f4-979f-2b3230566adb","Type":"ContainerStarted","Data":"11f534ec986032bc3fc9172c76bc659aeb711ee887e3619d49a8189fd4d43cf6"}
Oct 30 20:06:42.898439 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:42.896521    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-f1f016/distinct-w4-f1f016-kserve-79fbfbdbf7-hswb7" podUID="7b6639ea-72b0-49fb-b7fa-9443c1ddff6d" containerName="main" probeResult="failure" output="Get \"https://10.134.0.86:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:06:42.904435 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:42.902497    6275 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w3-912f24/distinct-2-w3-912f24-kserve-566865fdcc-ptx4l" podUID="fcea214a-04a7-4bdd-9695-852f657edfe5" containerName="main" probeResult="failure" output="Get \"https://10.134.0.74:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:06:42.909364 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:42.909329    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-f1f016/simulator-w4-f1f016-kserve-55db8447ff-749tw" podUID="8f3174b6-2fdc-48c2-99be-7a966731f018" containerName="main" probeResult="failure" output="Get \"https://10.134.0.55:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:06:42.909901 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:42.909873    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-626870/distinct-2-w5-626870-kserve-98bfb9b98-xz6xj" podUID="7d49f1ad-8805-4090-8e72-7d828fa73f36" containerName="main" probeResult="failure" output="Get \"https://10.134.0.90:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:06:42.910313 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:42.910286    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-912f24/distinct-2-w3-912f24-kserve-566865fdcc-ptx4l" podUID="fcea214a-04a7-4bdd-9695-852f657edfe5" containerName="main" probeResult="failure" output="Get \"https://10.134.0.74:8000/ready\": context deadline exceeded"
Oct 30 20:06:42.917462 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:42.917431    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-5f10d2/distinct-w1-5f10d2-kserve-5bf49798b8-l2j84" podUID="9e831c5d-2019-4015-ac57-2b4b1b90b9b3" containerName="main" probeResult="failure" output="Get \"https://10.134.0.69:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:06:43.026326 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:43.026284    6275 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w4-f1f016/premium-w4-f1f016-kserve-55d6bd678b-w5hkc" podUID="0e543ba9-1e7a-4d0a-9361-50c98060e824" containerName="main" probeResult="failure" output="Get \"https://10.134.0.60:8000/health\": context deadline exceeded"
Oct 30 20:06:43.633477 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:43.614513    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-f1f016/premium-w4-f1f016-kserve-55d6bd678b-w5hkc" podUID="0e543ba9-1e7a-4d0a-9361-50c98060e824" containerName="main" probeResult="failure" output="Get \"https://10.134.0.60:8000/ready\": context deadline exceeded"
Oct 30 20:06:43.633477 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:43.615225    6275 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w4-f1f016/premium-w4-f1f016-kserve-55d6bd678b-w5hkc"
Oct 30 20:06:44.542440 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:44.541689    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-5f10d2/premium-w1-5f10d2-kserve-644b846669-286m2" podUID="a2ff6903-c1ab-48dd-884b-d119b8ee1ed6" containerName="main" probeResult="failure" output="Get \"https://10.134.0.61:8000/ready\": context deadline exceeded"
Oct 30 20:06:44.602440 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:44.597556    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-626870/premium-w5-626870-kserve-5df7f7b5c4-vx59r" podUID="a1adddd4-3218-4a6b-a145-0290bceff76f" containerName="main" probeResult="failure" output="Get \"https://10.134.0.57:8000/ready\": context deadline exceeded"
Oct 30 20:06:44.602440 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:44.598016    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-efbac3/premium-w2-efbac3-kserve-55f54cfff6-9fqbz" podUID="083136dc-91fb-454f-a782-87b004e73d1b" containerName="main" probeResult="failure" output="Get \"https://10.134.0.59:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:06:44.602440 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:44.598101    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-f1f016/distinct-2-w4-f1f016-kserve-69f97f4b78-4m64r" podUID="96f19e7c-d36d-4109-bde0-24725bc670dd" containerName="main" probeResult="failure" output="Get \"https://10.134.0.99:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:06:44.749441 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:44.746691    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-f1f016/premium-w4-f1f016-kserve-55d6bd678b-w5hkc" podUID="0e543ba9-1e7a-4d0a-9361-50c98060e824" containerName="main" probeResult="failure" output="Get \"https://10.134.0.60:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:06:44.749441 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:44.748618    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-912f24/simulator-w3-912f24-kserve-59897cf48b-sd5wj" podUID="b4de6427-0db0-42d9-8b88-6b35d9d4c314" containerName="main" probeResult="failure" output="Get \"https://10.134.0.54:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:06:45.143451 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:45.140624    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-912f24/distinct-2-w3-912f24-kserve-566865fdcc-ptx4l" podUID="fcea214a-04a7-4bdd-9695-852f657edfe5" containerName="main" probeResult="failure" output="Get \"https://10.134.0.74:8000/ready\": context deadline exceeded"
Oct 30 20:06:45.143451 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:45.141002    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-5f10d2/distinct-w1-5f10d2-kserve-5bf49798b8-l2j84" podUID="9e831c5d-2019-4015-ac57-2b4b1b90b9b3" containerName="main" probeResult="failure" output="Get \"https://10.134.0.69:8000/ready\": context deadline exceeded"
Oct 30 20:06:45.143451 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:45.141278    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-51dd62/simulator-w6-51dd62-kserve-d6bb4985f-65j9h" podUID="f7e1ff07-15d6-49b5-8edc-52c9d6825ed7" containerName="main" probeResult="failure" output="Get \"https://10.134.0.56:8000/ready\": context deadline exceeded"
Oct 30 20:06:45.143451 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:45.143152    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-626870/distinct-2-w5-626870-kserve-98bfb9b98-xz6xj" podUID="7d49f1ad-8805-4090-8e72-7d828fa73f36" containerName="main" probeResult="failure" output="Get \"https://10.134.0.90:8000/ready\": context deadline exceeded"
Oct 30 20:06:45.553230 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:45.553173    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-f1f016/simulator-w4-f1f016-kserve-55db8447ff-749tw" podUID="8f3174b6-2fdc-48c2-99be-7a966731f018" containerName="main" probeResult="failure" output="Get \"https://10.134.0.55:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:06:45.613574 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:45.584561    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-f1f016/distinct-w4-f1f016-kserve-79fbfbdbf7-hswb7" podUID="7b6639ea-72b0-49fb-b7fa-9443c1ddff6d" containerName="main" probeResult="failure" output="Get \"https://10.134.0.86:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:06:45.613574 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:45.589182    6275 generic.go:356] "Generic (PLEG): container finished" podID="e879d637-cf0f-42f4-979f-2b3230566adb" containerID="7ef93492d05a655eb7c8227e76299cd7b87efba426d463e8a0a7875c6c376f86" exitCode=0
Oct 30 20:06:45.613574 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:45.598562    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-5f10d2/premium-w1-5f10d2-kserve-644b846669-286m2" podUID="a2ff6903-c1ab-48dd-884b-d119b8ee1ed6" containerName="main" probeResult="failure" output="Get \"https://10.134.0.61:8000/ready\": context deadline exceeded"
Oct 30 20:06:45.613574 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:45.608919    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-f1f016/distinct-2-w4-f1f016-kserve-69f97f4b78-4m64r" podUID="96f19e7c-d36d-4109-bde0-24725bc670dd" containerName="main" probeResult="failure" output="Get \"https://10.134.0.99:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:06:45.613574 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:45.609159    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-626870/premium-w5-626870-kserve-5df7f7b5c4-vx59r" podUID="a1adddd4-3218-4a6b-a145-0290bceff76f" containerName="main" probeResult="failure" output="Get \"https://10.134.0.57:8000/ready\": context deadline exceeded"
Oct 30 20:06:45.683448 ip-10-0-131-26 kubenswrapper[6275]: E1030 20:06:45.658672    6275 kubelet.go:2711] "Housekeeping took longer than expected" err="housekeeping took too long" expected="1s" actual="1.997s"
Oct 30 20:06:45.697028 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:45.696992    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-06b9ffc0-gn8wh" event={"ID":"e879d637-cf0f-42f4-979f-2b3230566adb","Type":"ContainerDied","Data":"7ef93492d05a655eb7c8227e76299cd7b87efba426d463e8a0a7875c6c376f86"}
Oct 30 20:06:45.697336 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:45.697312    6275 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w3-912f24/distinct-2-w3-912f24-kserve-566865fdcc-ptx4l"
Oct 30 20:06:45.697972 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:45.697954    6275 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w1-5f10d2/distinct-w1-5f10d2-kserve-5bf49798b8-l2j84"
Oct 30 20:06:45.698144 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:45.698130    6275 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w5-626870/distinct-2-w5-626870-kserve-98bfb9b98-xz6xj"
Oct 30 20:06:45.698376 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:45.698362    6275 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w1-5f10d2/premium-w1-5f10d2-kserve-644b846669-286m2"
Oct 30 20:06:45.790465 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:45.769384    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-912f24/simulator-w3-912f24-kserve-59897cf48b-sd5wj" podUID="b4de6427-0db0-42d9-8b88-6b35d9d4c314" containerName="main" probeResult="failure" output="Get \"https://10.134.0.54:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:06:45.796682 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:45.796641    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-efbac3/premium-w2-efbac3-kserve-55f54cfff6-9fqbz" podUID="083136dc-91fb-454f-a782-87b004e73d1b" containerName="main" probeResult="failure" output="Get \"https://10.134.0.59:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:06:45.806678 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:45.806596    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-f1f016/premium-w4-f1f016-kserve-55d6bd678b-w5hkc" podUID="0e543ba9-1e7a-4d0a-9361-50c98060e824" containerName="main" probeResult="failure" output="Get \"https://10.134.0.60:8000/ready\": context deadline exceeded"
Oct 30 20:06:45.933440 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:45.926838    6275 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w4-f1f016/distinct-2-w4-f1f016-kserve-69f97f4b78-4m64r"
Oct 30 20:06:45.933440 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:45.926912    6275 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w5-626870/premium-w5-626870-kserve-5df7f7b5c4-vx59r"
Oct 30 20:06:45.933440 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:45.926950    6275 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w3-912f24/simulator-w3-912f24-kserve-59897cf48b-sd5wj"
Oct 30 20:06:45.933440 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:45.926982    6275 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w2-efbac3/premium-w2-efbac3-kserve-55f54cfff6-9fqbz"
Oct 30 20:06:46.170641 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:46.170539    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-626870/distinct-2-w5-626870-kserve-98bfb9b98-xz6xj" podUID="7d49f1ad-8805-4090-8e72-7d828fa73f36" containerName="main" probeResult="failure" output="Get \"https://10.134.0.90:8000/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:06:46.187454 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:46.173895    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-5f10d2/distinct-w1-5f10d2-kserve-5bf49798b8-l2j84" podUID="9e831c5d-2019-4015-ac57-2b4b1b90b9b3" containerName="main" probeResult="failure" output="Get \"https://10.134.0.69:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:06:46.187454 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:46.174467    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-912f24/distinct-2-w3-912f24-kserve-566865fdcc-ptx4l" podUID="fcea214a-04a7-4bdd-9695-852f657edfe5" containerName="main" probeResult="failure" output="Get \"https://10.134.0.74:8000/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:06:46.187454 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:46.175887    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-51dd62/simulator-w6-51dd62-kserve-d6bb4985f-65j9h" podUID="f7e1ff07-15d6-49b5-8edc-52c9d6825ed7" containerName="main" probeResult="failure" output="Get \"https://10.134.0.56:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:06:46.187454 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:46.184963    6275 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w6-51dd62/simulator-w6-51dd62-kserve-d6bb4985f-65j9h"
Oct 30 20:06:46.255487 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:46.255434    6275 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w1-5f10d2/premium-w1-5f10d2-kserve-644b846669-286m2" podUID="a2ff6903-c1ab-48dd-884b-d119b8ee1ed6" containerName="main" probeResult="failure" output="Get \"https://10.134.0.61:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:06:46.375685 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:46.375640    6275 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w5-626870/premium-w5-626870-kserve-5df7f7b5c4-vx59r" podUID="a1adddd4-3218-4a6b-a145-0290bceff76f" containerName="main" probeResult="failure" output="Get \"https://10.134.0.57:8000/health\": context deadline exceeded"
Oct 30 20:06:46.640439 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:46.591593    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-f1f016/simulator-w4-f1f016-kserve-55db8447ff-749tw" podUID="8f3174b6-2fdc-48c2-99be-7a966731f018" containerName="main" probeResult="failure" output="Get \"https://10.134.0.55:8000/ready\": context deadline exceeded"
Oct 30 20:06:46.640439 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:46.592352    6275 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w4-f1f016/simulator-w4-f1f016-kserve-55db8447ff-749tw"
Oct 30 20:06:46.640439 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:46.594303    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-f1f016/distinct-w4-f1f016-kserve-79fbfbdbf7-hswb7" podUID="7b6639ea-72b0-49fb-b7fa-9443c1ddff6d" containerName="main" probeResult="failure" output="Get \"https://10.134.0.86:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:06:46.640439 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:46.594669    6275 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w4-f1f016/distinct-w4-f1f016-kserve-79fbfbdbf7-hswb7"
Oct 30 20:06:46.644491 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:46.644454    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-f1f016/distinct-2-w4-f1f016-kserve-69f97f4b78-4m64r" podUID="96f19e7c-d36d-4109-bde0-24725bc670dd" containerName="main" probeResult="failure" output="Get \"https://10.134.0.99:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:06:46.649437 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:46.645573    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-626870/premium-w5-626870-kserve-5df7f7b5c4-vx59r" podUID="a1adddd4-3218-4a6b-a145-0290bceff76f" containerName="main" probeResult="failure" output="Get \"https://10.134.0.57:8000/ready\": context deadline exceeded"
Oct 30 20:06:46.953157 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:46.649626    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-5f10d2/premium-w1-5f10d2-kserve-644b846669-286m2" podUID="a2ff6903-c1ab-48dd-884b-d119b8ee1ed6" containerName="main" probeResult="failure" output="Get \"https://10.134.0.61:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:06:46.965611 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:46.807549    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-912f24/simulator-w3-912f24-kserve-59897cf48b-sd5wj" podUID="b4de6427-0db0-42d9-8b88-6b35d9d4c314" containerName="main" probeResult="failure" output="Get \"https://10.134.0.54:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:06:46.994441 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:46.809073    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-f1f016/premium-w4-f1f016-kserve-55d6bd678b-w5hkc" podUID="0e543ba9-1e7a-4d0a-9361-50c98060e824" containerName="main" probeResult="failure" output="Get \"https://10.134.0.60:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:06:46.997002 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:46.874078    6275 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w2-efbac3/premium-w2-efbac3-kserve-55f54cfff6-9fqbz" podUID="083136dc-91fb-454f-a782-87b004e73d1b" containerName="main" probeResult="failure" output="Get \"https://10.134.0.59:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:06:47.000499 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:46.884684    6275 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w1-5f10d2/distinct-w1-5f10d2-kserve-5bf49798b8-l2j84" podUID="9e831c5d-2019-4015-ac57-2b4b1b90b9b3" containerName="main" probeResult="failure" output="Get \"https://10.134.0.69:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:06:47.009530 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:46.884737    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-efbac3/premium-w2-efbac3-kserve-55f54cfff6-9fqbz" podUID="083136dc-91fb-454f-a782-87b004e73d1b" containerName="main" probeResult="failure" output="Get \"https://10.134.0.59:8000/ready\": context deadline exceeded"
Oct 30 20:06:47.181719 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:47.181674    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-5f10d2/distinct-w1-5f10d2-kserve-5bf49798b8-l2j84" podUID="9e831c5d-2019-4015-ac57-2b4b1b90b9b3" containerName="main" probeResult="failure" output="Get \"https://10.134.0.69:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:06:47.205553 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:47.205445    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-626870/distinct-2-w5-626870-kserve-98bfb9b98-xz6xj" podUID="7d49f1ad-8805-4090-8e72-7d828fa73f36" containerName="main" probeResult="failure" output="Get \"https://10.134.0.90:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:06:47.206115 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:47.181605    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-912f24/distinct-2-w3-912f24-kserve-566865fdcc-ptx4l" podUID="fcea214a-04a7-4bdd-9695-852f657edfe5" containerName="main" probeResult="failure" output="Get \"https://10.134.0.74:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:06:47.265440 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:47.237052    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-51dd62/simulator-w6-51dd62-kserve-d6bb4985f-65j9h" podUID="f7e1ff07-15d6-49b5-8edc-52c9d6825ed7" containerName="main" probeResult="failure" output="Get \"https://10.134.0.56:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:06:47.545788 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:47.476877    6275 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w2-efbac3/premium-w2-efbac3-kserve-55f54cfff6-9fqbz"
Oct 30 20:06:47.714716 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:47.705328    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-f1f016/distinct-2-w4-f1f016-kserve-69f97f4b78-4m64r" podUID="96f19e7c-d36d-4109-bde0-24725bc670dd" containerName="main" probeResult="failure" output="Get \"https://10.134.0.99:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:06:47.832766 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:47.832640    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-f1f016/simulator-w4-f1f016-kserve-55db8447ff-749tw" podUID="8f3174b6-2fdc-48c2-99be-7a966731f018" containerName="main" probeResult="failure" output="Get \"https://10.134.0.55:8000/ready\": context deadline exceeded"
Oct 30 20:06:47.864439 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:47.860535    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-f1f016/distinct-w4-f1f016-kserve-79fbfbdbf7-hswb7" podUID="7b6639ea-72b0-49fb-b7fa-9443c1ddff6d" containerName="main" probeResult="failure" output="Get \"https://10.134.0.86:8000/ready\": context deadline exceeded"
Oct 30 20:06:48.075439 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:48.071095    6275 patch_prober.go:29] interesting pod/e2e-worker-w4-f1f016-openshift-default-6c85499cc-697gz container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.58:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 20:06:48.075439 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:48.071164    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w4-f1f016-openshift-default-6c85499cc-697gz" podUID="d0e72a0c-3d64-4e88-af2d-246a329f6215" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.58:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:06:48.139232 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:48.139141    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-5f10d2/premium-w1-5f10d2-kserve-644b846669-286m2" podUID="a2ff6903-c1ab-48dd-884b-d119b8ee1ed6" containerName="main" probeResult="failure" output="Get \"https://10.134.0.61:8000/ready\": context deadline exceeded"
Oct 30 20:06:48.140645 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:48.140405    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-912f24/simulator-w3-912f24-kserve-59897cf48b-sd5wj" podUID="b4de6427-0db0-42d9-8b88-6b35d9d4c314" containerName="main" probeResult="failure" output="Get \"https://10.134.0.54:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:06:48.193474 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:48.192886    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-5f10d2/distinct-w1-5f10d2-kserve-5bf49798b8-l2j84" podUID="9e831c5d-2019-4015-ac57-2b4b1b90b9b3" containerName="main" probeResult="failure" output="Get \"https://10.134.0.69:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:06:48.229508 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:48.222737    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-912f24/distinct-2-w3-912f24-kserve-566865fdcc-ptx4l" podUID="fcea214a-04a7-4bdd-9695-852f657edfe5" containerName="main" probeResult="failure" output="Get \"https://10.134.0.74:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:06:48.256994 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:48.239167    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-626870/premium-w5-626870-kserve-5df7f7b5c4-vx59r" podUID="a1adddd4-3218-4a6b-a145-0290bceff76f" containerName="main" probeResult="failure" output="Get \"https://10.134.0.57:8000/ready\": context deadline exceeded"
Oct 30 20:06:48.376004 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:48.375970    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-51dd62/simulator-w6-51dd62-kserve-d6bb4985f-65j9h" podUID="f7e1ff07-15d6-49b5-8edc-52c9d6825ed7" containerName="main" probeResult="failure" output="Get \"https://10.134.0.56:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:06:48.379912 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:48.379878    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-f1f016/premium-w4-f1f016-kserve-55d6bd678b-w5hkc" podUID="0e543ba9-1e7a-4d0a-9361-50c98060e824" containerName="main" probeResult="failure" output="Get \"https://10.134.0.60:8000/ready\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:06:48.405566 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:48.404915    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-626870/distinct-2-w5-626870-kserve-98bfb9b98-xz6xj" podUID="7d49f1ad-8805-4090-8e72-7d828fa73f36" containerName="main" probeResult="failure" output="Get \"https://10.134.0.90:8000/ready\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:06:48.464221 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:48.464193    6275 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w1-5f10d2/premium-w1-5f10d2-kserve-644b846669-286m2"
Oct 30 20:06:48.464382 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:48.464237    6275 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w3-912f24/simulator-w3-912f24-kserve-59897cf48b-sd5wj"
Oct 30 20:06:48.464382 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:48.464258    6275 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w5-626870/distinct-2-w5-626870-kserve-98bfb9b98-xz6xj"
Oct 30 20:06:48.464382 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:48.464286    6275 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w4-f1f016/distinct-2-w4-f1f016-kserve-69f97f4b78-4m64r"
Oct 30 20:06:48.464382 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:48.464320    6275 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w4-f1f016/simulator-w4-f1f016-kserve-55db8447ff-749tw"
Oct 30 20:06:48.464382 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:48.464340    6275 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w5-626870/premium-w5-626870-kserve-5df7f7b5c4-vx59r"
Oct 30 20:06:48.464382 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:48.464365    6275 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w6-51dd62/simulator-w6-51dd62-kserve-d6bb4985f-65j9h"
Oct 30 20:06:48.464382 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:48.464383    6275 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w3-912f24/distinct-2-w3-912f24-kserve-566865fdcc-ptx4l"
Oct 30 20:06:48.464657 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:48.464407    6275 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w4-f1f016/distinct-w4-f1f016-kserve-79fbfbdbf7-hswb7"
Oct 30 20:06:48.464657 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:48.464454    6275 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w4-f1f016/premium-w4-f1f016-kserve-55d6bd678b-w5hkc"
Oct 30 20:06:48.464657 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:48.464483    6275 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w1-5f10d2/distinct-w1-5f10d2-kserve-5bf49798b8-l2j84"
Oct 30 20:06:48.466304 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:48.466272    6275 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-06b9ffc0-gn8wh"
Oct 30 20:06:48.609309 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:48.609279    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/e879d637-cf0f-42f4-979f-2b3230566adb-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/e879d637-cf0f-42f4-979f-2b3230566adb-maas-api-openshift-ca\") pod \"e879d637-cf0f-42f4-979f-2b3230566adb\" (UID: \"e879d637-cf0f-42f4-979f-2b3230566adb\") "
Oct 30 20:06:48.609509 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:48.609319    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/e879d637-cf0f-42f4-979f-2b3230566adb-kube-api-access-mgd8f\" (UniqueName: \"kubernetes.io/projected/e879d637-cf0f-42f4-979f-2b3230566adb-kube-api-access-mgd8f\") pod \"e879d637-cf0f-42f4-979f-2b3230566adb\" (UID: \"e879d637-cf0f-42f4-979f-2b3230566adb\") "
Oct 30 20:06:48.609599 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:48.609565    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/e879d637-cf0f-42f4-979f-2b3230566adb-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/e879d637-cf0f-42f4-979f-2b3230566adb-maas-api-xks-ca\") pod \"e879d637-cf0f-42f4-979f-2b3230566adb\" (UID: \"e879d637-cf0f-42f4-979f-2b3230566adb\") "
Oct 30 20:06:48.609755 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:48.609729    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e879d637-cf0f-42f4-979f-2b3230566adb-maas-api-openshift-ca" pod "e879d637-cf0f-42f4-979f-2b3230566adb" (UID: "e879d637-cf0f-42f4-979f-2b3230566adb"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:06:48.611837 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:48.611812    6275 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/e879d637-cf0f-42f4-979f-2b3230566adb-maas-api-openshift-ca\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:06:48.612864 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:48.612835    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e879d637-cf0f-42f4-979f-2b3230566adb-kube-api-access-mgd8f" pod "e879d637-cf0f-42f4-979f-2b3230566adb" (UID: "e879d637-cf0f-42f4-979f-2b3230566adb"). InnerVolumeSpecName "kube-api-access-mgd8f". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:06:48.613629 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:48.613604    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e879d637-cf0f-42f4-979f-2b3230566adb-maas-api-xks-ca" pod "e879d637-cf0f-42f4-979f-2b3230566adb" (UID: "e879d637-cf0f-42f4-979f-2b3230566adb"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 20:06:48.713809 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:48.713733    6275 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mgd8f\" (UniqueName: \"kubernetes.io/projected/e879d637-cf0f-42f4-979f-2b3230566adb-kube-api-access-mgd8f\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:06:48.713809 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:48.713764    6275 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/e879d637-cf0f-42f4-979f-2b3230566adb-maas-api-xks-ca\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:06:49.446311 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:49.446284    6275 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-06b9ffc0-gn8wh"
Oct 30 20:06:49.446821 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:49.446320    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-06b9ffc0-gn8wh" event={"ID":"e879d637-cf0f-42f4-979f-2b3230566adb","Type":"ContainerDied","Data":"11f534ec986032bc3fc9172c76bc659aeb711ee887e3619d49a8189fd4d43cf6"}
Oct 30 20:06:49.446821 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:49.446369    6275 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="11f534ec986032bc3fc9172c76bc659aeb711ee887e3619d49a8189fd4d43cf6"
Oct 30 20:06:49.549968 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:49.549931    6275 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-a7979478-fmqll"]
Oct 30 20:06:49.550735 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:49.550711    6275 cpu_manager.go:414] "containerMap: removing container" podUID="e879d637-cf0f-42f4-979f-2b3230566adb" containerName="revoke-keys"
Oct 30 20:06:49.550735 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:49.550734    6275 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="e879d637-cf0f-42f4-979f-2b3230566adb" containerName="revoke-keys"
Oct 30 20:06:49.550966 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:49.550951    6275 memory_manager.go:365] "RemoveStaleState removing state" podUID="e879d637-cf0f-42f4-979f-2b3230566adb" containerName="revoke-keys"
Oct 30 20:06:49.554856 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:49.554836    6275 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-a7979478-fmqll"
Oct 30 20:06:49.574474 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:49.572150    6275 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\""
Oct 30 20:06:49.574474 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:49.573877    6275 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-scs2w\""
Oct 30 20:06:49.578357 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:49.578335    6275 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-a7979478-fmqll"]
Oct 30 20:06:49.628366 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:49.628338    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/dab4f278-63ea-4343-9292-8b1c6cda24ee-maas-api-xks-ca\") pod \"maas-api-revoke-sub-a7979478-fmqll\" (UID: \"dab4f278-63ea-4343-9292-8b1c6cda24ee\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-a7979478-fmqll"
Oct 30 20:06:49.628627 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:49.628605    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/dab4f278-63ea-4343-9292-8b1c6cda24ee-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-a7979478-fmqll\" (UID: \"dab4f278-63ea-4343-9292-8b1c6cda24ee\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-a7979478-fmqll"
Oct 30 20:06:49.628718 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:49.628638    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gx5ww\" (UniqueName: \"kubernetes.io/projected/dab4f278-63ea-4343-9292-8b1c6cda24ee-kube-api-access-gx5ww\") pod \"maas-api-revoke-sub-a7979478-fmqll\" (UID: \"dab4f278-63ea-4343-9292-8b1c6cda24ee\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-a7979478-fmqll"
Oct 30 20:06:49.730245 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:49.730160    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/dab4f278-63ea-4343-9292-8b1c6cda24ee-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-a7979478-fmqll\" (UID: \"dab4f278-63ea-4343-9292-8b1c6cda24ee\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-a7979478-fmqll"
Oct 30 20:06:49.730245 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:49.730200    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gx5ww\" (UniqueName: \"kubernetes.io/projected/dab4f278-63ea-4343-9292-8b1c6cda24ee-kube-api-access-gx5ww\") pod \"maas-api-revoke-sub-a7979478-fmqll\" (UID: \"dab4f278-63ea-4343-9292-8b1c6cda24ee\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-a7979478-fmqll"
Oct 30 20:06:49.730551 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:49.730290    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/dab4f278-63ea-4343-9292-8b1c6cda24ee-maas-api-xks-ca\") pod \"maas-api-revoke-sub-a7979478-fmqll\" (UID: \"dab4f278-63ea-4343-9292-8b1c6cda24ee\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-a7979478-fmqll"
Oct 30 20:06:49.730994 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:49.730952    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/dab4f278-63ea-4343-9292-8b1c6cda24ee-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-a7979478-fmqll\" (UID: \"dab4f278-63ea-4343-9292-8b1c6cda24ee\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-a7979478-fmqll"
Oct 30 20:06:49.732729 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:49.732706    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/dab4f278-63ea-4343-9292-8b1c6cda24ee-maas-api-xks-ca\") pod \"maas-api-revoke-sub-a7979478-fmqll\" (UID: \"dab4f278-63ea-4343-9292-8b1c6cda24ee\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-a7979478-fmqll"
Oct 30 20:06:49.756251 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:49.756226    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gx5ww\" (UniqueName: \"kubernetes.io/projected/dab4f278-63ea-4343-9292-8b1c6cda24ee-kube-api-access-gx5ww\") pod \"maas-api-revoke-sub-a7979478-fmqll\" (UID: \"dab4f278-63ea-4343-9292-8b1c6cda24ee\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-a7979478-fmqll"
Oct 30 20:06:49.871436 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:49.871384    6275 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-a7979478-fmqll"
Oct 30 20:06:50.188947 ip-10-0-131-26 kubenswrapper[6275]: W1030 20:06:50.188916    6275 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddab4f278_63ea_4343_9292_8b1c6cda24ee.slice/crio-1501364a2c88a3b8e4d2b9e26e17dc0fdc08fcfac6053b02e4584312492e760b WatchSource:0}: Error finding container 1501364a2c88a3b8e4d2b9e26e17dc0fdc08fcfac6053b02e4584312492e760b: Status 404 returned error can't find the container with id 1501364a2c88a3b8e4d2b9e26e17dc0fdc08fcfac6053b02e4584312492e760b
Oct 30 20:06:50.188947 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:50.188925    6275 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-a7979478-fmqll"]
Oct 30 20:06:50.455722 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:50.455654    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-a7979478-fmqll" event={"ID":"dab4f278-63ea-4343-9292-8b1c6cda24ee","Type":"ContainerStarted","Data":"1501364a2c88a3b8e4d2b9e26e17dc0fdc08fcfac6053b02e4584312492e760b"}
Oct 30 20:06:51.465840 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:51.465759    6275 generic.go:356] "Generic (PLEG): container finished" podID="dab4f278-63ea-4343-9292-8b1c6cda24ee" containerID="23150de94504eb3d6e4943e9ae01a000643be0d05ffeeda3cd4df0aeb371ba19" exitCode=0
Oct 30 20:06:51.466207 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:51.465853    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-a7979478-fmqll" event={"ID":"dab4f278-63ea-4343-9292-8b1c6cda24ee","Type":"ContainerDied","Data":"23150de94504eb3d6e4943e9ae01a000643be0d05ffeeda3cd4df0aeb371ba19"}
Oct 30 20:06:52.644159 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:52.644134    6275 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-a7979478-fmqll"
Oct 30 20:06:52.777492 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:52.777455    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/dab4f278-63ea-4343-9292-8b1c6cda24ee-kube-api-access-gx5ww\" (UniqueName: \"kubernetes.io/projected/dab4f278-63ea-4343-9292-8b1c6cda24ee-kube-api-access-gx5ww\") pod \"dab4f278-63ea-4343-9292-8b1c6cda24ee\" (UID: \"dab4f278-63ea-4343-9292-8b1c6cda24ee\") "
Oct 30 20:06:52.777681 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:52.777564    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/dab4f278-63ea-4343-9292-8b1c6cda24ee-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/dab4f278-63ea-4343-9292-8b1c6cda24ee-maas-api-xks-ca\") pod \"dab4f278-63ea-4343-9292-8b1c6cda24ee\" (UID: \"dab4f278-63ea-4343-9292-8b1c6cda24ee\") "
Oct 30 20:06:52.777775 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:52.777757    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/dab4f278-63ea-4343-9292-8b1c6cda24ee-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/dab4f278-63ea-4343-9292-8b1c6cda24ee-maas-api-openshift-ca\") pod \"dab4f278-63ea-4343-9292-8b1c6cda24ee\" (UID: \"dab4f278-63ea-4343-9292-8b1c6cda24ee\") "
Oct 30 20:06:52.778145 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:52.778115    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dab4f278-63ea-4343-9292-8b1c6cda24ee-maas-api-openshift-ca" pod "dab4f278-63ea-4343-9292-8b1c6cda24ee" (UID: "dab4f278-63ea-4343-9292-8b1c6cda24ee"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:06:52.778628 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:52.778604    6275 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/dab4f278-63ea-4343-9292-8b1c6cda24ee-maas-api-openshift-ca\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:06:52.780096 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:52.780070    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dab4f278-63ea-4343-9292-8b1c6cda24ee-maas-api-xks-ca" pod "dab4f278-63ea-4343-9292-8b1c6cda24ee" (UID: "dab4f278-63ea-4343-9292-8b1c6cda24ee"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 20:06:52.780175 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:52.780106    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dab4f278-63ea-4343-9292-8b1c6cda24ee-kube-api-access-gx5ww" pod "dab4f278-63ea-4343-9292-8b1c6cda24ee" (UID: "dab4f278-63ea-4343-9292-8b1c6cda24ee"). InnerVolumeSpecName "kube-api-access-gx5ww". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:06:52.880098 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:52.880069    6275 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gx5ww\" (UniqueName: \"kubernetes.io/projected/dab4f278-63ea-4343-9292-8b1c6cda24ee-kube-api-access-gx5ww\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:06:52.880098 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:52.880097    6275 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/dab4f278-63ea-4343-9292-8b1c6cda24ee-maas-api-xks-ca\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:06:53.487357 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:53.487329    6275 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-a7979478-fmqll"
Oct 30 20:06:53.487566 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:53.487362    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-a7979478-fmqll" event={"ID":"dab4f278-63ea-4343-9292-8b1c6cda24ee","Type":"ContainerDied","Data":"1501364a2c88a3b8e4d2b9e26e17dc0fdc08fcfac6053b02e4584312492e760b"}
Oct 30 20:06:53.487566 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:06:53.487446    6275 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1501364a2c88a3b8e4d2b9e26e17dc0fdc08fcfac6053b02e4584312492e760b"
Oct 30 20:06:56.282592 ip-10-0-131-26 kubenswrapper[6275]: E1030 20:06:56.282559    6275 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-fwc77" containerName="extractor"
Oct 30 20:07:03.384438 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:03.379863    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-51dd62/simulator-w6-51dd62-kserve-d6bb4985f-65j9h" podUID="f7e1ff07-15d6-49b5-8edc-52c9d6825ed7" containerName="main" probeResult="failure" output="Get \"https://10.134.0.56:8000/ready\": context deadline exceeded"
Oct 30 20:07:03.441438 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:03.439256    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-f1f016/distinct-2-w4-f1f016-kserve-69f97f4b78-4m64r" podUID="96f19e7c-d36d-4109-bde0-24725bc670dd" containerName="main" probeResult="failure" output="Get \"https://10.134.0.99:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:07:03.492460 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:03.491498    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-efbac3/premium-w2-efbac3-kserve-55f54cfff6-9fqbz" podUID="083136dc-91fb-454f-a782-87b004e73d1b" containerName="main" probeResult="failure" output="Get \"https://10.134.0.59:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:07:03.773560 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:03.769668    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-f1f016/premium-w4-f1f016-kserve-55d6bd678b-w5hkc" podUID="0e543ba9-1e7a-4d0a-9361-50c98060e824" containerName="main" probeResult="failure" output="Get \"https://10.134.0.60:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:07:03.848062 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:03.848015    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-f1f016/simulator-w4-f1f016-kserve-55db8447ff-749tw" podUID="8f3174b6-2fdc-48c2-99be-7a966731f018" containerName="main" probeResult="failure" output="Get \"https://10.134.0.55:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:07:03.856730 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:03.856695    6275 patch_prober.go:29] interesting pod/e2e-worker-w3-912f24-openshift-default-5f56ff5f6c-w5dh9 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.72:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 20:07:03.857012 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:03.856989    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w3-912f24-openshift-default-5f56ff5f6c-w5dh9" podUID="d499ec6a-7c42-4ba2-b4c6-19c6fe1caa99" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.72:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:07:03.977193 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:03.977148    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-626870/premium-w5-626870-kserve-5df7f7b5c4-vx59r" podUID="a1adddd4-3218-4a6b-a145-0290bceff76f" containerName="main" probeResult="failure" output="Get \"https://10.134.0.57:8000/ready\": context deadline exceeded"
Oct 30 20:07:03.977581 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:03.977449    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-5f10d2/premium-w1-5f10d2-kserve-644b846669-286m2" podUID="a2ff6903-c1ab-48dd-884b-d119b8ee1ed6" containerName="main" probeResult="failure" output="Get \"https://10.134.0.61:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:07:04.180613 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:04.180505    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-912f24/distinct-2-w3-912f24-kserve-566865fdcc-ptx4l" podUID="fcea214a-04a7-4bdd-9695-852f657edfe5" containerName="main" probeResult="failure" output="Get \"https://10.134.0.74:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:07:04.206585 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:04.206539    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-5f10d2/distinct-w1-5f10d2-kserve-5bf49798b8-l2j84" podUID="9e831c5d-2019-4015-ac57-2b4b1b90b9b3" containerName="main" probeResult="failure" output="Get \"https://10.134.0.69:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:07:04.381565 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:04.381509    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-51dd62/simulator-w6-51dd62-kserve-d6bb4985f-65j9h" podUID="f7e1ff07-15d6-49b5-8edc-52c9d6825ed7" containerName="main" probeResult="failure" output="Get \"https://10.134.0.56:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:07:04.382600 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:04.382575    6275 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w6-51dd62/simulator-w6-51dd62-kserve-d6bb4985f-65j9h"
Oct 30 20:07:04.442176 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:04.439517    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-912f24/simulator-w3-912f24-kserve-59897cf48b-sd5wj" podUID="b4de6427-0db0-42d9-8b88-6b35d9d4c314" containerName="main" probeResult="failure" output="Get \"https://10.134.0.54:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:07:04.443156 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:04.443124    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-f1f016/distinct-2-w4-f1f016-kserve-69f97f4b78-4m64r" podUID="96f19e7c-d36d-4109-bde0-24725bc670dd" containerName="main" probeResult="failure" output="Get \"https://10.134.0.99:8000/ready\": context deadline exceeded"
Oct 30 20:07:04.444753 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:04.443487    6275 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w4-f1f016/distinct-2-w4-f1f016-kserve-69f97f4b78-4m64r"
Oct 30 20:07:04.475334 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:04.474505    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-f1f016/distinct-w4-f1f016-kserve-79fbfbdbf7-hswb7" podUID="7b6639ea-72b0-49fb-b7fa-9443c1ddff6d" containerName="main" probeResult="failure" output="Get \"https://10.134.0.86:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:07:04.524437 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:04.503657    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-efbac3/premium-w2-efbac3-kserve-55f54cfff6-9fqbz" podUID="083136dc-91fb-454f-a782-87b004e73d1b" containerName="main" probeResult="failure" output="Get \"https://10.134.0.59:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:07:04.524437 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:04.504086    6275 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w2-efbac3/premium-w2-efbac3-kserve-55f54cfff6-9fqbz"
Oct 30 20:07:04.817438 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:04.786485    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-f1f016/premium-w4-f1f016-kserve-55d6bd678b-w5hkc" podUID="0e543ba9-1e7a-4d0a-9361-50c98060e824" containerName="main" probeResult="failure" output="Get \"https://10.134.0.60:8000/ready\": context deadline exceeded"
Oct 30 20:07:04.851883 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:04.851848    6275 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w4-f1f016/premium-w4-f1f016-kserve-55d6bd678b-w5hkc"
Oct 30 20:07:04.859967 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:04.858861    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-f1f016/simulator-w4-f1f016-kserve-55db8447ff-749tw" podUID="8f3174b6-2fdc-48c2-99be-7a966731f018" containerName="main" probeResult="failure" output="Get \"https://10.134.0.55:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:07:04.888008 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:04.860247    6275 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w4-f1f016/simulator-w4-f1f016-kserve-55db8447ff-749tw"
Oct 30 20:07:04.898441 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:04.888824    6275 patch_prober.go:29] interesting pod/e2e-worker-w1-5f10d2-openshift-default-6c6777d6f5-8zmm9 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.77:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 20:07:04.898441 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:04.888888    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w1-5f10d2-openshift-default-6c6777d6f5-8zmm9" podUID="91d406fb-17e3-47cf-bb3c-0a088ea0968e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.77:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:07:04.991452 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:04.978800    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-5f10d2/premium-w1-5f10d2-kserve-644b846669-286m2" podUID="a2ff6903-c1ab-48dd-884b-d119b8ee1ed6" containerName="main" probeResult="failure" output="Get \"https://10.134.0.61:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:07:05.018241 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:05.005747    6275 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w1-5f10d2/premium-w1-5f10d2-kserve-644b846669-286m2"
Oct 30 20:07:05.018241 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:05.007582    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-626870/premium-w5-626870-kserve-5df7f7b5c4-vx59r" podUID="a1adddd4-3218-4a6b-a145-0290bceff76f" containerName="main" probeResult="failure" output="Get \"https://10.134.0.57:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:07:05.018241 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:05.011686    6275 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w5-626870/premium-w5-626870-kserve-5df7f7b5c4-vx59r"
Oct 30 20:07:05.054438 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:05.049838    6275 patch_prober.go:29] interesting pod/e2e-worker-w3-912f24-openshift-default-5f56ff5f6c-r7hx2 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.81:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 20:07:05.054438 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:05.049899    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w3-912f24-openshift-default-5f56ff5f6c-r7hx2" podUID="88b5def9-2eb1-476e-a3ba-8f5b5ac6c32f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.81:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:07:05.211493 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:05.207607    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-912f24/distinct-2-w3-912f24-kserve-566865fdcc-ptx4l" podUID="fcea214a-04a7-4bdd-9695-852f657edfe5" containerName="main" probeResult="failure" output="Get \"https://10.134.0.74:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:07:05.211493 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:05.208376    6275 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w3-912f24/distinct-2-w3-912f24-kserve-566865fdcc-ptx4l"
Oct 30 20:07:05.211493 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:05.208900    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-5f10d2/distinct-w1-5f10d2-kserve-5bf49798b8-l2j84" podUID="9e831c5d-2019-4015-ac57-2b4b1b90b9b3" containerName="main" probeResult="failure" output="Get \"https://10.134.0.69:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:07:05.229374 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:05.225542    6275 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w1-5f10d2/distinct-w1-5f10d2-kserve-5bf49798b8-l2j84"
Oct 30 20:07:05.229374 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:05.227522    6275 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w2-efbac3/premium-w2-efbac3-kserve-55f54cfff6-9fqbz" podUID="083136dc-91fb-454f-a782-87b004e73d1b" containerName="main" probeResult="failure" output="Get \"https://10.134.0.59:8000/health\": context deadline exceeded"
Oct 30 20:07:05.385600 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:05.385550    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-51dd62/simulator-w6-51dd62-kserve-d6bb4985f-65j9h" podUID="f7e1ff07-15d6-49b5-8edc-52c9d6825ed7" containerName="main" probeResult="failure" output="Get \"https://10.134.0.56:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:07:05.446440 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:05.445043    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-f1f016/distinct-2-w4-f1f016-kserve-69f97f4b78-4m64r" podUID="96f19e7c-d36d-4109-bde0-24725bc670dd" containerName="main" probeResult="failure" output="Get \"https://10.134.0.99:8000/ready\": context deadline exceeded"
Oct 30 20:07:05.501061 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:05.484558    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-f1f016/distinct-w4-f1f016-kserve-79fbfbdbf7-hswb7" podUID="7b6639ea-72b0-49fb-b7fa-9443c1ddff6d" containerName="main" probeResult="failure" output="Get \"https://10.134.0.86:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:07:05.523471 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:05.501360    6275 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w4-f1f016/distinct-w4-f1f016-kserve-79fbfbdbf7-hswb7"
Oct 30 20:07:05.524931 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:05.524892    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-efbac3/premium-w2-efbac3-kserve-55f54cfff6-9fqbz" podUID="083136dc-91fb-454f-a782-87b004e73d1b" containerName="main" probeResult="failure" output="Get \"https://10.134.0.59:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:07:05.590661 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:05.590629    6275 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w2-efbac3/premium-w2-efbac3-kserve-55f54cfff6-9fqbz"
Oct 30 20:07:05.723438 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:05.722564    6275 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w5-626870/premium-w5-626870-kserve-5df7f7b5c4-vx59r" podUID="a1adddd4-3218-4a6b-a145-0290bceff76f" containerName="main" probeResult="failure" output="Get \"https://10.134.0.57:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:07:05.832972 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:05.830909    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-f1f016/premium-w4-f1f016-kserve-55d6bd678b-w5hkc" podUID="0e543ba9-1e7a-4d0a-9361-50c98060e824" containerName="main" probeResult="failure" output="Get \"https://10.134.0.60:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:07:05.851526 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:05.851492    6275 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w4-f1f016/distinct-w4-f1f016-kserve-79fbfbdbf7-hswb7"
Oct 30 20:07:05.864373 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:05.864139    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-f1f016/simulator-w4-f1f016-kserve-55db8447ff-749tw" podUID="8f3174b6-2fdc-48c2-99be-7a966731f018" containerName="main" probeResult="failure" output="Get \"https://10.134.0.55:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:07:05.865891 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:05.865864    6275 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w4-f1f016/premium-w4-f1f016-kserve-55d6bd678b-w5hkc"
Oct 30 20:07:05.884096 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:05.884066    6275 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w3-912f24/distinct-2-w3-912f24-kserve-566865fdcc-ptx4l"
Oct 30 20:07:05.990440 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:05.983222    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-5f10d2/premium-w1-5f10d2-kserve-644b846669-286m2" podUID="a2ff6903-c1ab-48dd-884b-d119b8ee1ed6" containerName="main" probeResult="failure" output="Get \"https://10.134.0.61:8000/ready\": context deadline exceeded"
Oct 30 20:07:05.991204 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:05.991168    6275 patch_prober.go:29] interesting pod/e2e-worker-w1-5f10d2-openshift-default-6c6777d6f5-8zmvq container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.85:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 20:07:05.999550 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:05.999503    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w1-5f10d2-openshift-default-6c6777d6f5-8zmvq" podUID="0e4973a9-ead0-4c5f-813c-fa012dc3fade" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.85:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:07:06.021811 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:06.009503    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-626870/premium-w5-626870-kserve-5df7f7b5c4-vx59r" podUID="a1adddd4-3218-4a6b-a145-0290bceff76f" containerName="main" probeResult="failure" output="Get \"https://10.134.0.57:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:07:06.267431 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:06.267310    6275 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w1-5f10d2/premium-w1-5f10d2-kserve-644b846669-286m2" podUID="a2ff6903-c1ab-48dd-884b-d119b8ee1ed6" containerName="main" probeResult="failure" output="Get \"https://10.134.0.61:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:07:06.267859 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:06.267820    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-5f10d2/distinct-w1-5f10d2-kserve-5bf49798b8-l2j84" podUID="9e831c5d-2019-4015-ac57-2b4b1b90b9b3" containerName="main" probeResult="failure" output="Get \"https://10.134.0.69:8000/ready\": context deadline exceeded"
Oct 30 20:07:06.268097 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:06.268053    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-626870/distinct-2-w5-626870-kserve-98bfb9b98-xz6xj" podUID="7d49f1ad-8805-4090-8e72-7d828fa73f36" containerName="main" probeResult="failure" output="Get \"https://10.134.0.90:8000/ready\": context deadline exceeded"
Oct 30 20:07:06.388441 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:06.387506    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-51dd62/simulator-w6-51dd62-kserve-d6bb4985f-65j9h" podUID="f7e1ff07-15d6-49b5-8edc-52c9d6825ed7" containerName="main" probeResult="failure" output="Get \"https://10.134.0.56:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:07:06.431560 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:06.428043    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-912f24/simulator-w3-912f24-kserve-59897cf48b-sd5wj" podUID="b4de6427-0db0-42d9-8b88-6b35d9d4c314" containerName="main" probeResult="failure" output="Get \"https://10.134.0.54:8000/ready\": context deadline exceeded"
Oct 30 20:07:06.460444 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:06.456525    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-f1f016/distinct-2-w4-f1f016-kserve-69f97f4b78-4m64r" podUID="96f19e7c-d36d-4109-bde0-24725bc670dd" containerName="main" probeResult="failure" output="Get \"https://10.134.0.99:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:07:06.831441 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:06.830595    6275 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w1-5f10d2/distinct-w1-5f10d2-kserve-5bf49798b8-l2j84" podUID="9e831c5d-2019-4015-ac57-2b4b1b90b9b3" containerName="main" probeResult="failure" output="Get \"https://10.134.0.69:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:07:06.895174 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:06.895127    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-f1f016/simulator-w4-f1f016-kserve-55db8447ff-749tw" podUID="8f3174b6-2fdc-48c2-99be-7a966731f018" containerName="main" probeResult="failure" output="Get \"https://10.134.0.55:8000/ready\": context deadline exceeded"
Oct 30 20:07:07.010154 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:07.010104    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-5f10d2/premium-w1-5f10d2-kserve-644b846669-286m2" podUID="a2ff6903-c1ab-48dd-884b-d119b8ee1ed6" containerName="main" probeResult="failure" output="Get \"https://10.134.0.61:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:07:07.029042 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:07.028989    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-626870/premium-w5-626870-kserve-5df7f7b5c4-vx59r" podUID="a1adddd4-3218-4a6b-a145-0290bceff76f" containerName="main" probeResult="failure" output="Get \"https://10.134.0.57:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:07:07.273441 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:07.273149    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-626870/distinct-2-w5-626870-kserve-98bfb9b98-xz6xj" podUID="7d49f1ad-8805-4090-8e72-7d828fa73f36" containerName="main" probeResult="failure" output="Get \"https://10.134.0.90:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:07:07.294440 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:07.278015    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-5f10d2/distinct-w1-5f10d2-kserve-5bf49798b8-l2j84" podUID="9e831c5d-2019-4015-ac57-2b4b1b90b9b3" containerName="main" probeResult="failure" output="Get \"https://10.134.0.69:8000/ready\": context deadline exceeded"
Oct 30 20:07:07.321079 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:07.297130    6275 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w5-626870/distinct-2-w5-626870-kserve-98bfb9b98-xz6xj"
Oct 30 20:07:07.435446 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:07.429920    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-912f24/simulator-w3-912f24-kserve-59897cf48b-sd5wj" podUID="b4de6427-0db0-42d9-8b88-6b35d9d4c314" containerName="main" probeResult="failure" output="Get \"https://10.134.0.54:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:07:07.435446 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:07.430305    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-51dd62/simulator-w6-51dd62-kserve-d6bb4985f-65j9h" podUID="f7e1ff07-15d6-49b5-8edc-52c9d6825ed7" containerName="main" probeResult="failure" output="Get \"https://10.134.0.56:8000/ready\": context deadline exceeded"
Oct 30 20:07:07.435446 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:07.430683    6275 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w3-912f24/simulator-w3-912f24-kserve-59897cf48b-sd5wj"
Oct 30 20:07:07.546518 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:07.543079    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-f1f016/distinct-2-w4-f1f016-kserve-69f97f4b78-4m64r" podUID="96f19e7c-d36d-4109-bde0-24725bc670dd" containerName="main" probeResult="failure" output="Get \"https://10.134.0.99:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:07:07.620692 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:07.619521    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-efbac3/premium-w2-efbac3-kserve-55f54cfff6-9fqbz" podUID="083136dc-91fb-454f-a782-87b004e73d1b" containerName="main" probeResult="failure" output="Get \"https://10.134.0.59:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:07:07.867966 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:07.867857    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-f1f016/premium-w4-f1f016-kserve-55d6bd678b-w5hkc" podUID="0e543ba9-1e7a-4d0a-9361-50c98060e824" containerName="main" probeResult="failure" output="Get \"https://10.134.0.60:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:07:07.932609 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:07.932566    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-f1f016/distinct-w4-f1f016-kserve-79fbfbdbf7-hswb7" podUID="7b6639ea-72b0-49fb-b7fa-9443c1ddff6d" containerName="main" probeResult="failure" output="Get \"https://10.134.0.86:8000/ready\": context deadline exceeded"
Oct 30 20:07:07.958569 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:07.958523    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-f1f016/simulator-w4-f1f016-kserve-55db8447ff-749tw" podUID="8f3174b6-2fdc-48c2-99be-7a966731f018" containerName="main" probeResult="failure" output="Get \"https://10.134.0.55:8000/ready\": context deadline exceeded"
Oct 30 20:07:08.011617 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:08.011573    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-5f10d2/premium-w1-5f10d2-kserve-644b846669-286m2" podUID="a2ff6903-c1ab-48dd-884b-d119b8ee1ed6" containerName="main" probeResult="failure" output="Get \"https://10.134.0.61:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:07:08.026514 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:08.023762    6275 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w3-912f24-bz4dp"]
Oct 30 20:07:08.026514 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:08.024788    6275 cpu_manager.go:414] "containerMap: removing container" podUID="dab4f278-63ea-4343-9292-8b1c6cda24ee" containerName="revoke-keys"
Oct 30 20:07:08.026514 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:08.024808    6275 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="dab4f278-63ea-4343-9292-8b1c6cda24ee" containerName="revoke-keys"
Oct 30 20:07:08.026514 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:08.025027    6275 memory_manager.go:365] "RemoveStaleState removing state" podUID="dab4f278-63ea-4343-9292-8b1c6cda24ee" containerName="revoke-keys"
Oct 30 20:07:08.030148 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:08.029633    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-626870/premium-w5-626870-kserve-5df7f7b5c4-vx59r" podUID="a1adddd4-3218-4a6b-a145-0290bceff76f" containerName="main" probeResult="failure" output="Get \"https://10.134.0.57:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:07:08.035935 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:08.035914    6275 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w3-912f24-bz4dp"]
Oct 30 20:07:08.036236 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:08.036158    6275 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w3-912f24-bz4dp"
Oct 30 20:07:08.069941 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:08.069907    6275 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-scs2w\""
Oct 30 20:07:08.070908 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:08.070883    6275 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\""
Oct 30 20:07:08.118533 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:08.118456    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c95tq\" (UniqueName: \"kubernetes.io/projected/38633155-417b-4291-9c29-9e2d8af2a304-kube-api-access-c95tq\") pod \"maas-api-revoke-keys-e2e-worker-w3-912f24-bz4dp\" (UID: \"38633155-417b-4291-9c29-9e2d8af2a304\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w3-912f24-bz4dp"
Oct 30 20:07:08.119012 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:08.118988    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/38633155-417b-4291-9c29-9e2d8af2a304-maas-api-xks-ca\") pod \"maas-api-revoke-keys-e2e-worker-w3-912f24-bz4dp\" (UID: \"38633155-417b-4291-9c29-9e2d8af2a304\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w3-912f24-bz4dp"
Oct 30 20:07:08.137538 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:08.137505    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/38633155-417b-4291-9c29-9e2d8af2a304-maas-api-openshift-ca\") pod \"maas-api-revoke-keys-e2e-worker-w3-912f24-bz4dp\" (UID: \"38633155-417b-4291-9c29-9e2d8af2a304\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w3-912f24-bz4dp"
Oct 30 20:07:08.241713 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:08.240478    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/38633155-417b-4291-9c29-9e2d8af2a304-maas-api-xks-ca\") pod \"maas-api-revoke-keys-e2e-worker-w3-912f24-bz4dp\" (UID: \"38633155-417b-4291-9c29-9e2d8af2a304\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w3-912f24-bz4dp"
Oct 30 20:07:08.241713 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:08.240609    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/38633155-417b-4291-9c29-9e2d8af2a304-maas-api-openshift-ca\") pod \"maas-api-revoke-keys-e2e-worker-w3-912f24-bz4dp\" (UID: \"38633155-417b-4291-9c29-9e2d8af2a304\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w3-912f24-bz4dp"
Oct 30 20:07:08.241713 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:08.240722    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c95tq\" (UniqueName: \"kubernetes.io/projected/38633155-417b-4291-9c29-9e2d8af2a304-kube-api-access-c95tq\") pod \"maas-api-revoke-keys-e2e-worker-w3-912f24-bz4dp\" (UID: \"38633155-417b-4291-9c29-9e2d8af2a304\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w3-912f24-bz4dp"
Oct 30 20:07:08.252042 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:08.251944    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/38633155-417b-4291-9c29-9e2d8af2a304-maas-api-openshift-ca\") pod \"maas-api-revoke-keys-e2e-worker-w3-912f24-bz4dp\" (UID: \"38633155-417b-4291-9c29-9e2d8af2a304\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w3-912f24-bz4dp"
Oct 30 20:07:08.276354 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:08.275962    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-626870/distinct-2-w5-626870-kserve-98bfb9b98-xz6xj" podUID="7d49f1ad-8805-4090-8e72-7d828fa73f36" containerName="main" probeResult="failure" output="Get \"https://10.134.0.90:8000/ready\": context deadline exceeded"
Oct 30 20:07:08.297137 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:08.297069    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c95tq\" (UniqueName: \"kubernetes.io/projected/38633155-417b-4291-9c29-9e2d8af2a304-kube-api-access-c95tq\") pod \"maas-api-revoke-keys-e2e-worker-w3-912f24-bz4dp\" (UID: \"38633155-417b-4291-9c29-9e2d8af2a304\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w3-912f24-bz4dp"
Oct 30 20:07:08.309003 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:08.303699    6275 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w6-51dd62/simulator-w6-51dd62-kserve-d6bb4985f-65j9h"
Oct 30 20:07:08.309003 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:08.308047    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/38633155-417b-4291-9c29-9e2d8af2a304-maas-api-xks-ca\") pod \"maas-api-revoke-keys-e2e-worker-w3-912f24-bz4dp\" (UID: \"38633155-417b-4291-9c29-9e2d8af2a304\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w3-912f24-bz4dp"
Oct 30 20:07:08.337575 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:08.332518    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-5f10d2/distinct-w1-5f10d2-kserve-5bf49798b8-l2j84" podUID="9e831c5d-2019-4015-ac57-2b4b1b90b9b3" containerName="main" probeResult="failure" output="Get \"https://10.134.0.69:8000/ready\": context deadline exceeded"
Oct 30 20:07:08.353952 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:08.353912    6275 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w5-626870/distinct-2-w5-626870-kserve-98bfb9b98-xz6xj"
Oct 30 20:07:08.416885 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:08.416798    6275 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w3-912f24/simulator-w3-912f24-kserve-59897cf48b-sd5wj"
Oct 30 20:07:08.438288 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:08.438235    6275 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w3-912f24-bz4dp"
Oct 30 20:07:08.448045 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:08.447999    6275 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w5-626870/premium-w5-626870-kserve-5df7f7b5c4-vx59r"
Oct 30 20:07:08.529584 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:08.529346    6275 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w1-5f10d2/premium-w1-5f10d2-kserve-644b846669-286m2"
Oct 30 20:07:08.605850 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:08.595845    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-f1f016/distinct-2-w4-f1f016-kserve-69f97f4b78-4m64r" podUID="96f19e7c-d36d-4109-bde0-24725bc670dd" containerName="main" probeResult="failure" output="Get \"https://10.134.0.99:8000/ready\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:07:08.656393 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:08.654537    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-efbac3/premium-w2-efbac3-kserve-55f54cfff6-9fqbz" podUID="083136dc-91fb-454f-a782-87b004e73d1b" containerName="main" probeResult="failure" output="Get \"https://10.134.0.59:8000/ready\": context deadline exceeded"
Oct 30 20:07:08.656393 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:08.655028    6275 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w2-efbac3/premium-w2-efbac3-kserve-55f54cfff6-9fqbz"
Oct 30 20:07:08.851514 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:08.831595    6275 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w4-f1f016/distinct-2-w4-f1f016-kserve-69f97f4b78-4m64r"
Oct 30 20:07:08.851514 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:08.835755    6275 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w1-5f10d2/distinct-w1-5f10d2-kserve-5bf49798b8-l2j84"
Oct 30 20:07:08.851514 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:08.838976    6275 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w4-f1f016/simulator-w4-f1f016-kserve-55db8447ff-749tw"
Oct 30 20:07:08.856925 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:08.856766    6275 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w2-efbac3/premium-w2-efbac3-kserve-55f54cfff6-9fqbz"
Oct 30 20:07:09.108757 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:09.108721    6275 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w3-912f24-bz4dp"]
Oct 30 20:07:09.108964 ip-10-0-131-26 kubenswrapper[6275]: W1030 20:07:09.108940    6275 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod38633155_417b_4291_9c29_9e2d8af2a304.slice/crio-c8e52832ab300d17ff31c05bd66e69e2d055b6ae57fbafb3c1d1d30f6466215b WatchSource:0}: Error finding container c8e52832ab300d17ff31c05bd66e69e2d055b6ae57fbafb3c1d1d30f6466215b: Status 404 returned error can't find the container with id c8e52832ab300d17ff31c05bd66e69e2d055b6ae57fbafb3c1d1d30f6466215b
Oct 30 20:07:09.793537 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:09.793490    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w3-912f24-bz4dp" event={"ID":"38633155-417b-4291-9c29-9e2d8af2a304","Type":"ContainerStarted","Data":"dc52b908f14bc9b86b912855ec360cd02e3cd5a460475e5912aca5c13900c82f"}
Oct 30 20:07:09.793960 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:09.793577    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w3-912f24-bz4dp" event={"ID":"38633155-417b-4291-9c29-9e2d8af2a304","Type":"ContainerStarted","Data":"c8e52832ab300d17ff31c05bd66e69e2d055b6ae57fbafb3c1d1d30f6466215b"}
Oct 30 20:07:09.859681 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:09.859616    6275 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w3-912f24-bz4dp" podStartSLOduration=3.85959769 podStartE2EDuration="3.85959769s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:07:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:07:09.853593146 +0000 UTC m=+1140.315320012" watchObservedRunningTime="2026-10-30 20:07:09.85959769 +0000 UTC m=+1140.321324555"
Oct 30 20:07:10.719186 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:10.719152    6275 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w3-912f24/distinct-2-w3-912f24-kserve-566865fdcc-ptx4l"]
Oct 30 20:07:10.753522 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:10.753489    6275 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w3-912f24/simulator-w3-912f24-kserve-59897cf48b-sd5wj"]
Oct 30 20:07:10.803973 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:10.803937    6275 generic.go:356] "Generic (PLEG): container finished" podID="38633155-417b-4291-9c29-9e2d8af2a304" containerID="dc52b908f14bc9b86b912855ec360cd02e3cd5a460475e5912aca5c13900c82f" exitCode=0
Oct 30 20:07:10.804365 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:10.804020    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w3-912f24-bz4dp" event={"ID":"38633155-417b-4291-9c29-9e2d8af2a304","Type":"ContainerDied","Data":"dc52b908f14bc9b86b912855ec360cd02e3cd5a460475e5912aca5c13900c82f"}
Oct 30 20:07:12.050747 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:12.050721    6275 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w3-912f24-bz4dp"
Oct 30 20:07:12.111616 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:12.111524    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/38633155-417b-4291-9c29-9e2d8af2a304-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/38633155-417b-4291-9c29-9e2d8af2a304-maas-api-openshift-ca\") pod \"38633155-417b-4291-9c29-9e2d8af2a304\" (UID: \"38633155-417b-4291-9c29-9e2d8af2a304\") "
Oct 30 20:07:12.111616 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:12.111581    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/38633155-417b-4291-9c29-9e2d8af2a304-kube-api-access-c95tq\" (UniqueName: \"kubernetes.io/projected/38633155-417b-4291-9c29-9e2d8af2a304-kube-api-access-c95tq\") pod \"38633155-417b-4291-9c29-9e2d8af2a304\" (UID: \"38633155-417b-4291-9c29-9e2d8af2a304\") "
Oct 30 20:07:12.111836 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:12.111628    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/38633155-417b-4291-9c29-9e2d8af2a304-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/38633155-417b-4291-9c29-9e2d8af2a304-maas-api-xks-ca\") pod \"38633155-417b-4291-9c29-9e2d8af2a304\" (UID: \"38633155-417b-4291-9c29-9e2d8af2a304\") "
Oct 30 20:07:12.111968 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:12.111944    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/38633155-417b-4291-9c29-9e2d8af2a304-maas-api-openshift-ca" pod "38633155-417b-4291-9c29-9e2d8af2a304" (UID: "38633155-417b-4291-9c29-9e2d8af2a304"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:07:12.112350 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:12.112321    6275 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/38633155-417b-4291-9c29-9e2d8af2a304-maas-api-openshift-ca\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:07:12.114078 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:12.114049    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/38633155-417b-4291-9c29-9e2d8af2a304-maas-api-xks-ca" pod "38633155-417b-4291-9c29-9e2d8af2a304" (UID: "38633155-417b-4291-9c29-9e2d8af2a304"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 20:07:12.114078 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:12.114058    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/38633155-417b-4291-9c29-9e2d8af2a304-kube-api-access-c95tq" pod "38633155-417b-4291-9c29-9e2d8af2a304" (UID: "38633155-417b-4291-9c29-9e2d8af2a304"). InnerVolumeSpecName "kube-api-access-c95tq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:07:12.214392 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:12.214358    6275 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c95tq\" (UniqueName: \"kubernetes.io/projected/38633155-417b-4291-9c29-9e2d8af2a304-kube-api-access-c95tq\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:07:12.214392 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:12.214392    6275 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/38633155-417b-4291-9c29-9e2d8af2a304-maas-api-xks-ca\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:07:12.318473 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:12.318439    6275 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-f1f016-n7fw6"]
Oct 30 20:07:12.319128 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:12.319112    6275 cpu_manager.go:414] "containerMap: removing container" podUID="38633155-417b-4291-9c29-9e2d8af2a304" containerName="revoke-keys"
Oct 30 20:07:12.319176 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:12.319129    6275 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="38633155-417b-4291-9c29-9e2d8af2a304" containerName="revoke-keys"
Oct 30 20:07:12.319270 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:12.319261    6275 memory_manager.go:365] "RemoveStaleState removing state" podUID="38633155-417b-4291-9c29-9e2d8af2a304" containerName="revoke-keys"
Oct 30 20:07:12.323513 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:12.323491    6275 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-f1f016-n7fw6"
Oct 30 20:07:12.345989 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:12.345959    6275 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-f1f016-n7fw6"]
Oct 30 20:07:12.417814 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:12.417728    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/83b6e849-ee0d-417c-8aea-633e4a9a9f96-maas-api-openshift-ca\") pod \"maas-api-revoke-keys-e2e-worker-w4-f1f016-n7fw6\" (UID: \"83b6e849-ee0d-417c-8aea-633e4a9a9f96\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-f1f016-n7fw6"
Oct 30 20:07:12.417968 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:12.417925    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-48gkd\" (UniqueName: \"kubernetes.io/projected/83b6e849-ee0d-417c-8aea-633e4a9a9f96-kube-api-access-48gkd\") pod \"maas-api-revoke-keys-e2e-worker-w4-f1f016-n7fw6\" (UID: \"83b6e849-ee0d-417c-8aea-633e4a9a9f96\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-f1f016-n7fw6"
Oct 30 20:07:12.418070 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:12.418053    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/83b6e849-ee0d-417c-8aea-633e4a9a9f96-maas-api-xks-ca\") pod \"maas-api-revoke-keys-e2e-worker-w4-f1f016-n7fw6\" (UID: \"83b6e849-ee0d-417c-8aea-633e4a9a9f96\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-f1f016-n7fw6"
Oct 30 20:07:12.451985 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:12.451951    6275 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-cbe808b7-lzctx"]
Oct 30 20:07:12.456632 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:12.456612    6275 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-cbe808b7-lzctx"
Oct 30 20:07:12.483509 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:12.482722    6275 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-cbe808b7-lzctx"]
Oct 30 20:07:12.530463 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:12.530370    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/d7fea45f-b700-4c5a-b101-3c37c7351729-maas-api-xks-ca\") pod \"maas-api-revoke-sub-cbe808b7-lzctx\" (UID: \"d7fea45f-b700-4c5a-b101-3c37c7351729\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-cbe808b7-lzctx"
Oct 30 20:07:12.531071 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:12.530539    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/d7fea45f-b700-4c5a-b101-3c37c7351729-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-cbe808b7-lzctx\" (UID: \"d7fea45f-b700-4c5a-b101-3c37c7351729\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-cbe808b7-lzctx"
Oct 30 20:07:12.531071 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:12.531011    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-48gkd\" (UniqueName: \"kubernetes.io/projected/83b6e849-ee0d-417c-8aea-633e4a9a9f96-kube-api-access-48gkd\") pod \"maas-api-revoke-keys-e2e-worker-w4-f1f016-n7fw6\" (UID: \"83b6e849-ee0d-417c-8aea-633e4a9a9f96\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-f1f016-n7fw6"
Oct 30 20:07:12.531328 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:12.531220    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/83b6e849-ee0d-417c-8aea-633e4a9a9f96-maas-api-xks-ca\") pod \"maas-api-revoke-keys-e2e-worker-w4-f1f016-n7fw6\" (UID: \"83b6e849-ee0d-417c-8aea-633e4a9a9f96\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-f1f016-n7fw6"
Oct 30 20:07:12.531494 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:12.531409    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fxw25\" (UniqueName: \"kubernetes.io/projected/d7fea45f-b700-4c5a-b101-3c37c7351729-kube-api-access-fxw25\") pod \"maas-api-revoke-sub-cbe808b7-lzctx\" (UID: \"d7fea45f-b700-4c5a-b101-3c37c7351729\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-cbe808b7-lzctx"
Oct 30 20:07:12.531679 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:12.531650    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/83b6e849-ee0d-417c-8aea-633e4a9a9f96-maas-api-openshift-ca\") pod \"maas-api-revoke-keys-e2e-worker-w4-f1f016-n7fw6\" (UID: \"83b6e849-ee0d-417c-8aea-633e4a9a9f96\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-f1f016-n7fw6"
Oct 30 20:07:12.532389 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:12.532362    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/83b6e849-ee0d-417c-8aea-633e4a9a9f96-maas-api-openshift-ca\") pod \"maas-api-revoke-keys-e2e-worker-w4-f1f016-n7fw6\" (UID: \"83b6e849-ee0d-417c-8aea-633e4a9a9f96\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-f1f016-n7fw6"
Oct 30 20:07:12.533927 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:12.533902    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/83b6e849-ee0d-417c-8aea-633e4a9a9f96-maas-api-xks-ca\") pod \"maas-api-revoke-keys-e2e-worker-w4-f1f016-n7fw6\" (UID: \"83b6e849-ee0d-417c-8aea-633e4a9a9f96\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-f1f016-n7fw6"
Oct 30 20:07:12.557952 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:12.557926    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-48gkd\" (UniqueName: \"kubernetes.io/projected/83b6e849-ee0d-417c-8aea-633e4a9a9f96-kube-api-access-48gkd\") pod \"maas-api-revoke-keys-e2e-worker-w4-f1f016-n7fw6\" (UID: \"83b6e849-ee0d-417c-8aea-633e4a9a9f96\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-f1f016-n7fw6"
Oct 30 20:07:12.632915 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:12.632876    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/d7fea45f-b700-4c5a-b101-3c37c7351729-maas-api-xks-ca\") pod \"maas-api-revoke-sub-cbe808b7-lzctx\" (UID: \"d7fea45f-b700-4c5a-b101-3c37c7351729\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-cbe808b7-lzctx"
Oct 30 20:07:12.632915 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:12.632917    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/d7fea45f-b700-4c5a-b101-3c37c7351729-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-cbe808b7-lzctx\" (UID: \"d7fea45f-b700-4c5a-b101-3c37c7351729\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-cbe808b7-lzctx"
Oct 30 20:07:12.633107 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:12.633049    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fxw25\" (UniqueName: \"kubernetes.io/projected/d7fea45f-b700-4c5a-b101-3c37c7351729-kube-api-access-fxw25\") pod \"maas-api-revoke-sub-cbe808b7-lzctx\" (UID: \"d7fea45f-b700-4c5a-b101-3c37c7351729\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-cbe808b7-lzctx"
Oct 30 20:07:12.633676 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:12.633655    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/d7fea45f-b700-4c5a-b101-3c37c7351729-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-cbe808b7-lzctx\" (UID: \"d7fea45f-b700-4c5a-b101-3c37c7351729\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-cbe808b7-lzctx"
Oct 30 20:07:12.635268 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:12.635248    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/d7fea45f-b700-4c5a-b101-3c37c7351729-maas-api-xks-ca\") pod \"maas-api-revoke-sub-cbe808b7-lzctx\" (UID: \"d7fea45f-b700-4c5a-b101-3c37c7351729\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-cbe808b7-lzctx"
Oct 30 20:07:12.644358 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:12.644330    6275 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-f1f016-n7fw6"
Oct 30 20:07:12.658355 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:12.658335    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fxw25\" (UniqueName: \"kubernetes.io/projected/d7fea45f-b700-4c5a-b101-3c37c7351729-kube-api-access-fxw25\") pod \"maas-api-revoke-sub-cbe808b7-lzctx\" (UID: \"d7fea45f-b700-4c5a-b101-3c37c7351729\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-cbe808b7-lzctx"
Oct 30 20:07:12.783784 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:12.783736    6275 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-cbe808b7-lzctx"
Oct 30 20:07:12.838436 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:12.835284    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w3-912f24-bz4dp" event={"ID":"38633155-417b-4291-9c29-9e2d8af2a304","Type":"ContainerDied","Data":"c8e52832ab300d17ff31c05bd66e69e2d055b6ae57fbafb3c1d1d30f6466215b"}
Oct 30 20:07:12.838436 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:12.835345    6275 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c8e52832ab300d17ff31c05bd66e69e2d055b6ae57fbafb3c1d1d30f6466215b"
Oct 30 20:07:12.838436 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:12.835455    6275 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w3-912f24-bz4dp"
Oct 30 20:07:12.961968 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:12.961917    6275 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-f1f016-n7fw6"]
Oct 30 20:07:13.133752 ip-10-0-131-26 kubenswrapper[6275]: W1030 20:07:13.133717    6275 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd7fea45f_b700_4c5a_b101_3c37c7351729.slice/crio-41ee0cd056fd8d68042e0e501c789684e53e3dc10b32b2f86e0704065513e352 WatchSource:0}: Error finding container 41ee0cd056fd8d68042e0e501c789684e53e3dc10b32b2f86e0704065513e352: Status 404 returned error can't find the container with id 41ee0cd056fd8d68042e0e501c789684e53e3dc10b32b2f86e0704065513e352
Oct 30 20:07:13.135129 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:13.135102    6275 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-cbe808b7-lzctx"]
Oct 30 20:07:13.847293 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:13.847176    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-cbe808b7-lzctx" event={"ID":"d7fea45f-b700-4c5a-b101-3c37c7351729","Type":"ContainerStarted","Data":"07a7ac7d7535d87e7d3610097af1ac4d9cda00bbe17fa4daf839a2aceb3425b6"}
Oct 30 20:07:13.847293 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:13.847262    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-cbe808b7-lzctx" event={"ID":"d7fea45f-b700-4c5a-b101-3c37c7351729","Type":"ContainerStarted","Data":"41ee0cd056fd8d68042e0e501c789684e53e3dc10b32b2f86e0704065513e352"}
Oct 30 20:07:13.849359 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:13.849331    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-f1f016-n7fw6" event={"ID":"83b6e849-ee0d-417c-8aea-633e4a9a9f96","Type":"ContainerStarted","Data":"f3a6652a093454add87f53cb6d0998d5d709ed07531c18e91fecd3ba9fc1e8e1"}
Oct 30 20:07:13.849515 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:13.849381    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-f1f016-n7fw6" event={"ID":"83b6e849-ee0d-417c-8aea-633e4a9a9f96","Type":"ContainerStarted","Data":"5e2b551e122bfeacd6ba867318d94d44ad2cb2ddb05192811baedf9020e1d441"}
Oct 30 20:07:13.907194 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:13.907142    6275 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-sub-cbe808b7-lzctx" podStartSLOduration=1.907128826 podStartE2EDuration="1.907128826s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:07:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:07:13.890371637 +0000 UTC m=+1144.352098499" watchObservedRunningTime="2026-10-30 20:07:13.907128826 +0000 UTC m=+1144.368855688"
Oct 30 20:07:13.939133 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:13.939084    6275 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-f1f016-n7fw6" podStartSLOduration=1.9390700619999999 podStartE2EDuration="1.939070062s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:07:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:07:13.935734269 +0000 UTC m=+1144.397461134" watchObservedRunningTime="2026-10-30 20:07:13.939070062 +0000 UTC m=+1144.400796925"
Oct 30 20:07:14.859617 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:14.859574    6275 generic.go:356] "Generic (PLEG): container finished" podID="d7fea45f-b700-4c5a-b101-3c37c7351729" containerID="07a7ac7d7535d87e7d3610097af1ac4d9cda00bbe17fa4daf839a2aceb3425b6" exitCode=0
Oct 30 20:07:14.860057 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:14.859654    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-cbe808b7-lzctx" event={"ID":"d7fea45f-b700-4c5a-b101-3c37c7351729","Type":"ContainerDied","Data":"07a7ac7d7535d87e7d3610097af1ac4d9cda00bbe17fa4daf839a2aceb3425b6"}
Oct 30 20:07:14.861620 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:14.861596    6275 generic.go:356] "Generic (PLEG): container finished" podID="83b6e849-ee0d-417c-8aea-633e4a9a9f96" containerID="f3a6652a093454add87f53cb6d0998d5d709ed07531c18e91fecd3ba9fc1e8e1" exitCode=0
Oct 30 20:07:14.861734 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:14.861674    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-f1f016-n7fw6" event={"ID":"83b6e849-ee0d-417c-8aea-633e4a9a9f96","Type":"ContainerDied","Data":"f3a6652a093454add87f53cb6d0998d5d709ed07531c18e91fecd3ba9fc1e8e1"}
Oct 30 20:07:16.060151 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:16.059962    6275 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-f1f016-n7fw6"
Oct 30 20:07:16.092372 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:16.092344    6275 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-cbe808b7-lzctx"
Oct 30 20:07:16.198938 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:16.198841    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/d7fea45f-b700-4c5a-b101-3c37c7351729-kube-api-access-fxw25\" (UniqueName: \"kubernetes.io/projected/d7fea45f-b700-4c5a-b101-3c37c7351729-kube-api-access-fxw25\") pod \"d7fea45f-b700-4c5a-b101-3c37c7351729\" (UID: \"d7fea45f-b700-4c5a-b101-3c37c7351729\") "
Oct 30 20:07:16.199115 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:16.198954    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/d7fea45f-b700-4c5a-b101-3c37c7351729-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/d7fea45f-b700-4c5a-b101-3c37c7351729-maas-api-openshift-ca\") pod \"d7fea45f-b700-4c5a-b101-3c37c7351729\" (UID: \"d7fea45f-b700-4c5a-b101-3c37c7351729\") "
Oct 30 20:07:16.199115 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:16.199024    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/83b6e849-ee0d-417c-8aea-633e4a9a9f96-kube-api-access-48gkd\" (UniqueName: \"kubernetes.io/projected/83b6e849-ee0d-417c-8aea-633e4a9a9f96-kube-api-access-48gkd\") pod \"83b6e849-ee0d-417c-8aea-633e4a9a9f96\" (UID: \"83b6e849-ee0d-417c-8aea-633e4a9a9f96\") "
Oct 30 20:07:16.199115 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:16.199058    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/83b6e849-ee0d-417c-8aea-633e4a9a9f96-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/83b6e849-ee0d-417c-8aea-633e4a9a9f96-maas-api-xks-ca\") pod \"83b6e849-ee0d-417c-8aea-633e4a9a9f96\" (UID: \"83b6e849-ee0d-417c-8aea-633e4a9a9f96\") "
Oct 30 20:07:16.199317 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:16.199272    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/d7fea45f-b700-4c5a-b101-3c37c7351729-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/d7fea45f-b700-4c5a-b101-3c37c7351729-maas-api-xks-ca\") pod \"d7fea45f-b700-4c5a-b101-3c37c7351729\" (UID: \"d7fea45f-b700-4c5a-b101-3c37c7351729\") "
Oct 30 20:07:16.199397 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:16.199368    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d7fea45f-b700-4c5a-b101-3c37c7351729-maas-api-openshift-ca" pod "d7fea45f-b700-4c5a-b101-3c37c7351729" (UID: "d7fea45f-b700-4c5a-b101-3c37c7351729"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:07:16.199658 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:16.199637    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/83b6e849-ee0d-417c-8aea-633e4a9a9f96-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/83b6e849-ee0d-417c-8aea-633e4a9a9f96-maas-api-openshift-ca\") pod \"83b6e849-ee0d-417c-8aea-633e4a9a9f96\" (UID: \"83b6e849-ee0d-417c-8aea-633e4a9a9f96\") "
Oct 30 20:07:16.200089 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:16.200064    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/83b6e849-ee0d-417c-8aea-633e4a9a9f96-maas-api-openshift-ca" pod "83b6e849-ee0d-417c-8aea-633e4a9a9f96" (UID: "83b6e849-ee0d-417c-8aea-633e4a9a9f96"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:07:16.200620 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:16.200598    6275 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/d7fea45f-b700-4c5a-b101-3c37c7351729-maas-api-openshift-ca\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:07:16.200723 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:16.200625    6275 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/83b6e849-ee0d-417c-8aea-633e4a9a9f96-maas-api-openshift-ca\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:07:16.201460 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:16.201399    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d7fea45f-b700-4c5a-b101-3c37c7351729-kube-api-access-fxw25" pod "d7fea45f-b700-4c5a-b101-3c37c7351729" (UID: "d7fea45f-b700-4c5a-b101-3c37c7351729"). InnerVolumeSpecName "kube-api-access-fxw25". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:07:16.201551 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:16.201475    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d7fea45f-b700-4c5a-b101-3c37c7351729-maas-api-xks-ca" pod "d7fea45f-b700-4c5a-b101-3c37c7351729" (UID: "d7fea45f-b700-4c5a-b101-3c37c7351729"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 20:07:16.201551 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:16.201483    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/83b6e849-ee0d-417c-8aea-633e4a9a9f96-maas-api-xks-ca" pod "83b6e849-ee0d-417c-8aea-633e4a9a9f96" (UID: "83b6e849-ee0d-417c-8aea-633e4a9a9f96"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 20:07:16.201625 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:16.201566    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/83b6e849-ee0d-417c-8aea-633e4a9a9f96-kube-api-access-48gkd" pod "83b6e849-ee0d-417c-8aea-633e4a9a9f96" (UID: "83b6e849-ee0d-417c-8aea-633e4a9a9f96"). InnerVolumeSpecName "kube-api-access-48gkd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:07:16.301833 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:16.301795    6275 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fxw25\" (UniqueName: \"kubernetes.io/projected/d7fea45f-b700-4c5a-b101-3c37c7351729-kube-api-access-fxw25\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:07:16.301833 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:16.301827    6275 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-48gkd\" (UniqueName: \"kubernetes.io/projected/83b6e849-ee0d-417c-8aea-633e4a9a9f96-kube-api-access-48gkd\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:07:16.301833 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:16.301840    6275 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/83b6e849-ee0d-417c-8aea-633e4a9a9f96-maas-api-xks-ca\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:07:16.302058 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:16.301852    6275 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/d7fea45f-b700-4c5a-b101-3c37c7351729-maas-api-xks-ca\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:07:16.522535 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:16.522495    6275 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w5-626870/distinct-2-w5-626870-kserve-98bfb9b98-xz6xj"]
Oct 30 20:07:16.561486 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:16.561449    6275 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w5-626870/premium-w5-626870-kserve-5df7f7b5c4-vx59r"]
Oct 30 20:07:16.880739 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:16.880661    6275 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-cbe808b7-lzctx"
Oct 30 20:07:16.880739 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:16.880680    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-cbe808b7-lzctx" event={"ID":"d7fea45f-b700-4c5a-b101-3c37c7351729","Type":"ContainerDied","Data":"41ee0cd056fd8d68042e0e501c789684e53e3dc10b32b2f86e0704065513e352"}
Oct 30 20:07:16.880739 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:16.880739    6275 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="41ee0cd056fd8d68042e0e501c789684e53e3dc10b32b2f86e0704065513e352"
Oct 30 20:07:16.882266 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:16.882246    6275 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-f1f016-n7fw6"
Oct 30 20:07:16.882391 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:16.882285    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-f1f016-n7fw6" event={"ID":"83b6e849-ee0d-417c-8aea-633e4a9a9f96","Type":"ContainerDied","Data":"5e2b551e122bfeacd6ba867318d94d44ad2cb2ddb05192811baedf9020e1d441"}
Oct 30 20:07:16.882391 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:16.882324    6275 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5e2b551e122bfeacd6ba867318d94d44ad2cb2ddb05192811baedf9020e1d441"
Oct 30 20:07:17.092532 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:17.092460    6275 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-f1f016/distinct-2-w4-f1f016-kserve-69f97f4b78-4m64r"]
Oct 30 20:07:17.099715 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:17.099683    6275 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-f1f016/distinct-w4-f1f016-kserve-79fbfbdbf7-hswb7"]
Oct 30 20:07:17.111404 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:17.111378    6275 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-f1f016/premium-w4-f1f016-kserve-55d6bd678b-w5hkc"]
Oct 30 20:07:17.145258 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:17.145194    6275 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-f1f016/simulator-w4-f1f016-kserve-55db8447ff-749tw"]
Oct 30 20:07:17.545236 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:17.545195    6275 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w3-912f24-7bd864565f-fvnth"]
Oct 30 20:07:17.613284 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:17.613253    6275 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w3-912f24-585f6bf47-q7hqs"]
Oct 30 20:07:21.951854 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:21.951821    6275 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w6-51dd62/distinct-2-w6-51dd62-kserve-79ff99c4cd-fvmb6"]
Oct 30 20:07:21.952637 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:21.952615    6275 cpu_manager.go:414] "containerMap: removing container" podUID="d7fea45f-b700-4c5a-b101-3c37c7351729" containerName="revoke-keys"
Oct 30 20:07:21.952637 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:21.952635    6275 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="d7fea45f-b700-4c5a-b101-3c37c7351729" containerName="revoke-keys"
Oct 30 20:07:21.952818 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:21.952682    6275 cpu_manager.go:414] "containerMap: removing container" podUID="83b6e849-ee0d-417c-8aea-633e4a9a9f96" containerName="revoke-keys"
Oct 30 20:07:21.952818 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:21.952692    6275 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="83b6e849-ee0d-417c-8aea-633e4a9a9f96" containerName="revoke-keys"
Oct 30 20:07:21.952818 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:21.952812    6275 memory_manager.go:365] "RemoveStaleState removing state" podUID="d7fea45f-b700-4c5a-b101-3c37c7351729" containerName="revoke-keys"
Oct 30 20:07:21.952909 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:21.952828    6275 memory_manager.go:365] "RemoveStaleState removing state" podUID="83b6e849-ee0d-417c-8aea-633e4a9a9f96" containerName="revoke-keys"
Oct 30 20:07:21.956934 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:21.956910    6275 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w6-51dd62/distinct-2-w6-51dd62-kserve-79ff99c4cd-fvmb6"
Oct 30 20:07:21.980779 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:21.980738    6275 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w6-51dd62/distinct-2-w6-51dd62-kserve-79ff99c4cd-fvmb6"]
Oct 30 20:07:21.986337 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:21.986312    6275 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w6-51dd62\"/\"distinct-2-w6-51dd62-kserve-self-signed-certs\""
Oct 30 20:07:22.106254 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:22.106213    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-spncw\" (UniqueName: \"kubernetes.io/projected/9ed906a7-869d-4314-9976-f50b78a6565b-kube-api-access-spncw\") pod \"distinct-2-w6-51dd62-kserve-79ff99c4cd-fvmb6\" (UID: \"9ed906a7-869d-4314-9976-f50b78a6565b\") " pod="e2e-models-e2e-worker-w6-51dd62/distinct-2-w6-51dd62-kserve-79ff99c4cd-fvmb6"
Oct 30 20:07:22.106462 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:22.106286    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9ed906a7-869d-4314-9976-f50b78a6565b-tls-certs\") pod \"distinct-2-w6-51dd62-kserve-79ff99c4cd-fvmb6\" (UID: \"9ed906a7-869d-4314-9976-f50b78a6565b\") " pod="e2e-models-e2e-worker-w6-51dd62/distinct-2-w6-51dd62-kserve-79ff99c4cd-fvmb6"
Oct 30 20:07:22.106536 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:22.106505    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9ed906a7-869d-4314-9976-f50b78a6565b-model-cache\") pod \"distinct-2-w6-51dd62-kserve-79ff99c4cd-fvmb6\" (UID: \"9ed906a7-869d-4314-9976-f50b78a6565b\") " pod="e2e-models-e2e-worker-w6-51dd62/distinct-2-w6-51dd62-kserve-79ff99c4cd-fvmb6"
Oct 30 20:07:22.106670 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:22.106651    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9ed906a7-869d-4314-9976-f50b78a6565b-tmp-dir\") pod \"distinct-2-w6-51dd62-kserve-79ff99c4cd-fvmb6\" (UID: \"9ed906a7-869d-4314-9976-f50b78a6565b\") " pod="e2e-models-e2e-worker-w6-51dd62/distinct-2-w6-51dd62-kserve-79ff99c4cd-fvmb6"
Oct 30 20:07:22.106737 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:22.106719    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9ed906a7-869d-4314-9976-f50b78a6565b-dshm\") pod \"distinct-2-w6-51dd62-kserve-79ff99c4cd-fvmb6\" (UID: \"9ed906a7-869d-4314-9976-f50b78a6565b\") " pod="e2e-models-e2e-worker-w6-51dd62/distinct-2-w6-51dd62-kserve-79ff99c4cd-fvmb6"
Oct 30 20:07:22.106772 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:22.106760    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9ed906a7-869d-4314-9976-f50b78a6565b-home\") pod \"distinct-2-w6-51dd62-kserve-79ff99c4cd-fvmb6\" (UID: \"9ed906a7-869d-4314-9976-f50b78a6565b\") " pod="e2e-models-e2e-worker-w6-51dd62/distinct-2-w6-51dd62-kserve-79ff99c4cd-fvmb6"
Oct 30 20:07:22.209489 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:22.208528    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9ed906a7-869d-4314-9976-f50b78a6565b-tls-certs\") pod \"distinct-2-w6-51dd62-kserve-79ff99c4cd-fvmb6\" (UID: \"9ed906a7-869d-4314-9976-f50b78a6565b\") " pod="e2e-models-e2e-worker-w6-51dd62/distinct-2-w6-51dd62-kserve-79ff99c4cd-fvmb6"
Oct 30 20:07:22.209489 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:22.208645    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9ed906a7-869d-4314-9976-f50b78a6565b-model-cache\") pod \"distinct-2-w6-51dd62-kserve-79ff99c4cd-fvmb6\" (UID: \"9ed906a7-869d-4314-9976-f50b78a6565b\") " pod="e2e-models-e2e-worker-w6-51dd62/distinct-2-w6-51dd62-kserve-79ff99c4cd-fvmb6"
Oct 30 20:07:22.209489 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:22.208751    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9ed906a7-869d-4314-9976-f50b78a6565b-tmp-dir\") pod \"distinct-2-w6-51dd62-kserve-79ff99c4cd-fvmb6\" (UID: \"9ed906a7-869d-4314-9976-f50b78a6565b\") " pod="e2e-models-e2e-worker-w6-51dd62/distinct-2-w6-51dd62-kserve-79ff99c4cd-fvmb6"
Oct 30 20:07:22.209489 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:22.208813    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9ed906a7-869d-4314-9976-f50b78a6565b-dshm\") pod \"distinct-2-w6-51dd62-kserve-79ff99c4cd-fvmb6\" (UID: \"9ed906a7-869d-4314-9976-f50b78a6565b\") " pod="e2e-models-e2e-worker-w6-51dd62/distinct-2-w6-51dd62-kserve-79ff99c4cd-fvmb6"
Oct 30 20:07:22.209489 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:22.208847    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9ed906a7-869d-4314-9976-f50b78a6565b-home\") pod \"distinct-2-w6-51dd62-kserve-79ff99c4cd-fvmb6\" (UID: \"9ed906a7-869d-4314-9976-f50b78a6565b\") " pod="e2e-models-e2e-worker-w6-51dd62/distinct-2-w6-51dd62-kserve-79ff99c4cd-fvmb6"
Oct 30 20:07:22.209489 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:22.209004    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-spncw\" (UniqueName: \"kubernetes.io/projected/9ed906a7-869d-4314-9976-f50b78a6565b-kube-api-access-spncw\") pod \"distinct-2-w6-51dd62-kserve-79ff99c4cd-fvmb6\" (UID: \"9ed906a7-869d-4314-9976-f50b78a6565b\") " pod="e2e-models-e2e-worker-w6-51dd62/distinct-2-w6-51dd62-kserve-79ff99c4cd-fvmb6"
Oct 30 20:07:22.215829 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:22.210212    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9ed906a7-869d-4314-9976-f50b78a6565b-tmp-dir\") pod \"distinct-2-w6-51dd62-kserve-79ff99c4cd-fvmb6\" (UID: \"9ed906a7-869d-4314-9976-f50b78a6565b\") " pod="e2e-models-e2e-worker-w6-51dd62/distinct-2-w6-51dd62-kserve-79ff99c4cd-fvmb6"
Oct 30 20:07:22.215829 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:22.210510    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9ed906a7-869d-4314-9976-f50b78a6565b-model-cache\") pod \"distinct-2-w6-51dd62-kserve-79ff99c4cd-fvmb6\" (UID: \"9ed906a7-869d-4314-9976-f50b78a6565b\") " pod="e2e-models-e2e-worker-w6-51dd62/distinct-2-w6-51dd62-kserve-79ff99c4cd-fvmb6"
Oct 30 20:07:22.215829 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:22.210803    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9ed906a7-869d-4314-9976-f50b78a6565b-home\") pod \"distinct-2-w6-51dd62-kserve-79ff99c4cd-fvmb6\" (UID: \"9ed906a7-869d-4314-9976-f50b78a6565b\") " pod="e2e-models-e2e-worker-w6-51dd62/distinct-2-w6-51dd62-kserve-79ff99c4cd-fvmb6"
Oct 30 20:07:22.242969 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:22.242935    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9ed906a7-869d-4314-9976-f50b78a6565b-dshm\") pod \"distinct-2-w6-51dd62-kserve-79ff99c4cd-fvmb6\" (UID: \"9ed906a7-869d-4314-9976-f50b78a6565b\") " pod="e2e-models-e2e-worker-w6-51dd62/distinct-2-w6-51dd62-kserve-79ff99c4cd-fvmb6"
Oct 30 20:07:22.265021 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:22.264970    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9ed906a7-869d-4314-9976-f50b78a6565b-tls-certs\") pod \"distinct-2-w6-51dd62-kserve-79ff99c4cd-fvmb6\" (UID: \"9ed906a7-869d-4314-9976-f50b78a6565b\") " pod="e2e-models-e2e-worker-w6-51dd62/distinct-2-w6-51dd62-kserve-79ff99c4cd-fvmb6"
Oct 30 20:07:22.277665 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:22.276056    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-spncw\" (UniqueName: \"kubernetes.io/projected/9ed906a7-869d-4314-9976-f50b78a6565b-kube-api-access-spncw\") pod \"distinct-2-w6-51dd62-kserve-79ff99c4cd-fvmb6\" (UID: \"9ed906a7-869d-4314-9976-f50b78a6565b\") " pod="e2e-models-e2e-worker-w6-51dd62/distinct-2-w6-51dd62-kserve-79ff99c4cd-fvmb6"
Oct 30 20:07:22.277665 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:22.276658    6275 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w6-51dd62/distinct-2-w6-51dd62-kserve-79ff99c4cd-fvmb6"
Oct 30 20:07:22.335561 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:22.335499    6275 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w5-626870-7fd9798fc9-njdrh"]
Oct 30 20:07:22.547197 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:22.547116    6275 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-worker-w3-912f24-7bd864565f-fvnth" podUID="72b9ada9-738c-4c37-96f4-5f827abdf99e" containerName="payload-processing" containerID="cri-o://6fb1d1e604a32ab82798f59f6e3499dba0c13153708eae887e75b60600914e5e" gracePeriod=25
Oct 30 20:07:22.614395 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:22.614314    6275 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-worker-w3-912f24-585f6bf47-q7hqs" podUID="8b04ae86-d3b8-4e51-b357-25e38742b02f" containerName="payload-pre-processing" containerID="cri-o://b64a30d3ff021dea3b430ffac5483b0c084ee9518aeb3fe9a5d6b9d2dc7ca121" gracePeriod=25
Oct 30 20:07:22.759904 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:22.759878    6275 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w6-51dd62/distinct-2-w6-51dd62-kserve-79ff99c4cd-fvmb6"]
Oct 30 20:07:22.762903 ip-10-0-131-26 kubenswrapper[6275]: W1030 20:07:22.762871    6275 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9ed906a7_869d_4314_9976_f50b78a6565b.slice/crio-30700f04dd2312ffd11d04dda93a9ec3b29fa5eb3207333d3bac4f2e15b4aa1d WatchSource:0}: Error finding container 30700f04dd2312ffd11d04dda93a9ec3b29fa5eb3207333d3bac4f2e15b4aa1d: Status 404 returned error can't find the container with id 30700f04dd2312ffd11d04dda93a9ec3b29fa5eb3207333d3bac4f2e15b4aa1d
Oct 30 20:07:22.925900 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:22.925863    6275 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-8375ad3d-nz2zn"]
Oct 30 20:07:22.930723 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:22.930697    6275 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-8375ad3d-nz2zn"
Oct 30 20:07:22.936230 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:22.936197    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w6-51dd62/distinct-2-w6-51dd62-kserve-79ff99c4cd-fvmb6" event={"ID":"9ed906a7-869d-4314-9976-f50b78a6565b","Type":"ContainerStarted","Data":"d8285cd3305c98f6419d7151ac7bc70df5b319f58ab6b4e0bd90c4bebaa23e96"}
Oct 30 20:07:22.936380 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:22.936238    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w6-51dd62/distinct-2-w6-51dd62-kserve-79ff99c4cd-fvmb6" event={"ID":"9ed906a7-869d-4314-9976-f50b78a6565b","Type":"ContainerStarted","Data":"30700f04dd2312ffd11d04dda93a9ec3b29fa5eb3207333d3bac4f2e15b4aa1d"}
Oct 30 20:07:22.954099 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:22.954068    6275 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\""
Oct 30 20:07:22.954444 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:22.954124    6275 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-scs2w\""
Oct 30 20:07:22.963854 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:22.963825    6275 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-8375ad3d-nz2zn"]
Oct 30 20:07:23.068452 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:23.067616    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b48gn\" (UniqueName: \"kubernetes.io/projected/b195a865-3ec2-4556-969e-161d7edfe96d-kube-api-access-b48gn\") pod \"maas-api-revoke-sub-8375ad3d-nz2zn\" (UID: \"b195a865-3ec2-4556-969e-161d7edfe96d\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-8375ad3d-nz2zn"
Oct 30 20:07:23.068452 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:23.067727    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/b195a865-3ec2-4556-969e-161d7edfe96d-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-8375ad3d-nz2zn\" (UID: \"b195a865-3ec2-4556-969e-161d7edfe96d\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-8375ad3d-nz2zn"
Oct 30 20:07:23.068452 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:23.067755    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/b195a865-3ec2-4556-969e-161d7edfe96d-maas-api-xks-ca\") pod \"maas-api-revoke-sub-8375ad3d-nz2zn\" (UID: \"b195a865-3ec2-4556-969e-161d7edfe96d\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-8375ad3d-nz2zn"
Oct 30 20:07:23.149504 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:23.146490    6275 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-b54cc4a5-ttvwv"]
Oct 30 20:07:23.153401 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:23.153373    6275 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-b54cc4a5-ttvwv"]
Oct 30 20:07:23.153801 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:23.153767    6275 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-b54cc4a5-ttvwv"
Oct 30 20:07:23.160531 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:23.159110    6275 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w6-51dd62/distinct-2-w6-51dd62-kserve-79ff99c4cd-fvmb6" podStartSLOduration=2.159097304 podStartE2EDuration="2.159097304s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:07:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:07:23.141680956 +0000 UTC m=+1153.603407821" watchObservedRunningTime="2026-10-30 20:07:23.159097304 +0000 UTC m=+1153.620824216"
Oct 30 20:07:23.161133 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:23.161115    6275 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-73085560-nwxrn"]
Oct 30 20:07:23.171825 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:23.170398    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b48gn\" (UniqueName: \"kubernetes.io/projected/b195a865-3ec2-4556-969e-161d7edfe96d-kube-api-access-b48gn\") pod \"maas-api-revoke-sub-8375ad3d-nz2zn\" (UID: \"b195a865-3ec2-4556-969e-161d7edfe96d\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-8375ad3d-nz2zn"
Oct 30 20:07:23.171825 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:23.170529    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/b195a865-3ec2-4556-969e-161d7edfe96d-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-8375ad3d-nz2zn\" (UID: \"b195a865-3ec2-4556-969e-161d7edfe96d\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-8375ad3d-nz2zn"
Oct 30 20:07:23.171825 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:23.170563    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/b195a865-3ec2-4556-969e-161d7edfe96d-maas-api-xks-ca\") pod \"maas-api-revoke-sub-8375ad3d-nz2zn\" (UID: \"b195a865-3ec2-4556-969e-161d7edfe96d\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-8375ad3d-nz2zn"
Oct 30 20:07:23.176966 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:23.172676    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/b195a865-3ec2-4556-969e-161d7edfe96d-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-8375ad3d-nz2zn\" (UID: \"b195a865-3ec2-4556-969e-161d7edfe96d\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-8375ad3d-nz2zn"
Oct 30 20:07:23.179952 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:23.179924    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/b195a865-3ec2-4556-969e-161d7edfe96d-maas-api-xks-ca\") pod \"maas-api-revoke-sub-8375ad3d-nz2zn\" (UID: \"b195a865-3ec2-4556-969e-161d7edfe96d\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-8375ad3d-nz2zn"
Oct 30 20:07:23.180257 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:23.180239    6275 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-73085560-nwxrn"]
Oct 30 20:07:23.180497 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:23.180482    6275 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-73085560-nwxrn"
Oct 30 20:07:23.204181 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:23.203593    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b48gn\" (UniqueName: \"kubernetes.io/projected/b195a865-3ec2-4556-969e-161d7edfe96d-kube-api-access-b48gn\") pod \"maas-api-revoke-sub-8375ad3d-nz2zn\" (UID: \"b195a865-3ec2-4556-969e-161d7edfe96d\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-8375ad3d-nz2zn"
Oct 30 20:07:23.235552 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:23.226756    6275 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w4-f1f016-6754476fb5-jlhbg"]
Oct 30 20:07:23.247367 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:23.246166    6275 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-8375ad3d-nz2zn"
Oct 30 20:07:23.275037 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:23.273097    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/0382c156-57ff-4ae5-afbb-d2c7683c8272-maas-api-xks-ca\") pod \"maas-api-revoke-sub-73085560-nwxrn\" (UID: \"0382c156-57ff-4ae5-afbb-d2c7683c8272\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-73085560-nwxrn"
Oct 30 20:07:23.275037 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:23.273170    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f5rlz\" (UniqueName: \"kubernetes.io/projected/7058df15-c069-4553-8453-46b806ffb18b-kube-api-access-f5rlz\") pod \"maas-api-revoke-sub-b54cc4a5-ttvwv\" (UID: \"7058df15-c069-4553-8453-46b806ffb18b\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-b54cc4a5-ttvwv"
Oct 30 20:07:23.275037 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:23.273246    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/7058df15-c069-4553-8453-46b806ffb18b-maas-api-xks-ca\") pod \"maas-api-revoke-sub-b54cc4a5-ttvwv\" (UID: \"7058df15-c069-4553-8453-46b806ffb18b\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-b54cc4a5-ttvwv"
Oct 30 20:07:23.275037 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:23.273299    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pxcgc\" (UniqueName: \"kubernetes.io/projected/0382c156-57ff-4ae5-afbb-d2c7683c8272-kube-api-access-pxcgc\") pod \"maas-api-revoke-sub-73085560-nwxrn\" (UID: \"0382c156-57ff-4ae5-afbb-d2c7683c8272\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-73085560-nwxrn"
Oct 30 20:07:23.294782 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:23.282536    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/7058df15-c069-4553-8453-46b806ffb18b-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-b54cc4a5-ttvwv\" (UID: \"7058df15-c069-4553-8453-46b806ffb18b\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-b54cc4a5-ttvwv"
Oct 30 20:07:23.294782 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:23.282782    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/0382c156-57ff-4ae5-afbb-d2c7683c8272-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-73085560-nwxrn\" (UID: \"0382c156-57ff-4ae5-afbb-d2c7683c8272\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-73085560-nwxrn"
Oct 30 20:07:23.294782 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:23.286622    6275 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-f1f016-568d55d755-xjm26"]
Oct 30 20:07:23.294782 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:23.287083    6275 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w6-51dd62/distinct-2-w6-51dd62-kserve-79ff99c4cd-fvmb6"
Oct 30 20:07:23.396147 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:23.394778    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/0382c156-57ff-4ae5-afbb-d2c7683c8272-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-73085560-nwxrn\" (UID: \"0382c156-57ff-4ae5-afbb-d2c7683c8272\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-73085560-nwxrn"
Oct 30 20:07:23.396147 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:23.394983    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/0382c156-57ff-4ae5-afbb-d2c7683c8272-maas-api-xks-ca\") pod \"maas-api-revoke-sub-73085560-nwxrn\" (UID: \"0382c156-57ff-4ae5-afbb-d2c7683c8272\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-73085560-nwxrn"
Oct 30 20:07:23.396147 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:23.395030    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f5rlz\" (UniqueName: \"kubernetes.io/projected/7058df15-c069-4553-8453-46b806ffb18b-kube-api-access-f5rlz\") pod \"maas-api-revoke-sub-b54cc4a5-ttvwv\" (UID: \"7058df15-c069-4553-8453-46b806ffb18b\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-b54cc4a5-ttvwv"
Oct 30 20:07:23.396147 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:23.395098    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/7058df15-c069-4553-8453-46b806ffb18b-maas-api-xks-ca\") pod \"maas-api-revoke-sub-b54cc4a5-ttvwv\" (UID: \"7058df15-c069-4553-8453-46b806ffb18b\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-b54cc4a5-ttvwv"
Oct 30 20:07:23.396147 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:23.395166    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pxcgc\" (UniqueName: \"kubernetes.io/projected/0382c156-57ff-4ae5-afbb-d2c7683c8272-kube-api-access-pxcgc\") pod \"maas-api-revoke-sub-73085560-nwxrn\" (UID: \"0382c156-57ff-4ae5-afbb-d2c7683c8272\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-73085560-nwxrn"
Oct 30 20:07:23.396147 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:23.395194    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/7058df15-c069-4553-8453-46b806ffb18b-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-b54cc4a5-ttvwv\" (UID: \"7058df15-c069-4553-8453-46b806ffb18b\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-b54cc4a5-ttvwv"
Oct 30 20:07:23.396147 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:23.396048    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/7058df15-c069-4553-8453-46b806ffb18b-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-b54cc4a5-ttvwv\" (UID: \"7058df15-c069-4553-8453-46b806ffb18b\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-b54cc4a5-ttvwv"
Oct 30 20:07:23.396787 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:23.396734    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/0382c156-57ff-4ae5-afbb-d2c7683c8272-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-73085560-nwxrn\" (UID: \"0382c156-57ff-4ae5-afbb-d2c7683c8272\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-73085560-nwxrn"
Oct 30 20:07:23.399935 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:23.399603    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/0382c156-57ff-4ae5-afbb-d2c7683c8272-maas-api-xks-ca\") pod \"maas-api-revoke-sub-73085560-nwxrn\" (UID: \"0382c156-57ff-4ae5-afbb-d2c7683c8272\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-73085560-nwxrn"
Oct 30 20:07:23.402681 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:23.400637    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/7058df15-c069-4553-8453-46b806ffb18b-maas-api-xks-ca\") pod \"maas-api-revoke-sub-b54cc4a5-ttvwv\" (UID: \"7058df15-c069-4553-8453-46b806ffb18b\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-b54cc4a5-ttvwv"
Oct 30 20:07:23.423561 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:23.423534    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f5rlz\" (UniqueName: \"kubernetes.io/projected/7058df15-c069-4553-8453-46b806ffb18b-kube-api-access-f5rlz\") pod \"maas-api-revoke-sub-b54cc4a5-ttvwv\" (UID: \"7058df15-c069-4553-8453-46b806ffb18b\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-b54cc4a5-ttvwv"
Oct 30 20:07:23.425381 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:23.425313    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pxcgc\" (UniqueName: \"kubernetes.io/projected/0382c156-57ff-4ae5-afbb-d2c7683c8272-kube-api-access-pxcgc\") pod \"maas-api-revoke-sub-73085560-nwxrn\" (UID: \"0382c156-57ff-4ae5-afbb-d2c7683c8272\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-73085560-nwxrn"
Oct 30 20:07:23.500007 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:23.499967    6275 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-b54cc4a5-ttvwv"
Oct 30 20:07:23.504730 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:23.504684    6275 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-73085560-nwxrn"
Oct 30 20:07:23.622291 ip-10-0-131-26 kubenswrapper[6275]: W1030 20:07:23.622256    6275 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb195a865_3ec2_4556_969e_161d7edfe96d.slice/crio-fd86931513663b811074979d49198a1193ccb4f8033d1f9673f2320a05dc1445 WatchSource:0}: Error finding container fd86931513663b811074979d49198a1193ccb4f8033d1f9673f2320a05dc1445: Status 404 returned error can't find the container with id fd86931513663b811074979d49198a1193ccb4f8033d1f9673f2320a05dc1445
Oct 30 20:07:23.623313 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:23.623255    6275 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-8375ad3d-nz2zn"]
Oct 30 20:07:23.839301 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:23.839270    6275 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-73085560-nwxrn"]
Oct 30 20:07:23.846929 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:23.846901    6275 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-b54cc4a5-ttvwv"]
Oct 30 20:07:23.871502 ip-10-0-131-26 kubenswrapper[6275]: W1030 20:07:23.871406    6275 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0382c156_57ff_4ae5_afbb_d2c7683c8272.slice/crio-e0e07a2b59c3bc98f9e7c9e9e6840b550f4953d996a6d9c37e50deaf3cb62952 WatchSource:0}: Error finding container e0e07a2b59c3bc98f9e7c9e9e6840b550f4953d996a6d9c37e50deaf3cb62952: Status 404 returned error can't find the container with id e0e07a2b59c3bc98f9e7c9e9e6840b550f4953d996a6d9c37e50deaf3cb62952
Oct 30 20:07:23.872994 ip-10-0-131-26 kubenswrapper[6275]: W1030 20:07:23.872965    6275 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7058df15_c069_4553_8453_46b806ffb18b.slice/crio-80046e6808f0bdf57359f00994a0ea23f8df566d386535ef414d2857d6a03c75 WatchSource:0}: Error finding container 80046e6808f0bdf57359f00994a0ea23f8df566d386535ef414d2857d6a03c75: Status 404 returned error can't find the container with id 80046e6808f0bdf57359f00994a0ea23f8df566d386535ef414d2857d6a03c75
Oct 30 20:07:23.945752 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:23.945715    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-b54cc4a5-ttvwv" event={"ID":"7058df15-c069-4553-8453-46b806ffb18b","Type":"ContainerStarted","Data":"80046e6808f0bdf57359f00994a0ea23f8df566d386535ef414d2857d6a03c75"}
Oct 30 20:07:23.947107 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:23.947079    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-73085560-nwxrn" event={"ID":"0382c156-57ff-4ae5-afbb-d2c7683c8272","Type":"ContainerStarted","Data":"e0e07a2b59c3bc98f9e7c9e9e6840b550f4953d996a6d9c37e50deaf3cb62952"}
Oct 30 20:07:23.949783 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:23.949715    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-8375ad3d-nz2zn" event={"ID":"b195a865-3ec2-4556-969e-161d7edfe96d","Type":"ContainerStarted","Data":"fd86931513663b811074979d49198a1193ccb4f8033d1f9673f2320a05dc1445"}
Oct 30 20:07:24.958179 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:24.958145    6275 generic.go:356] "Generic (PLEG): container finished" podID="7058df15-c069-4553-8453-46b806ffb18b" containerID="c1620a4325294ed952b14094e2a50820250ddb529ee33d3058358c29f400c047" exitCode=0
Oct 30 20:07:24.958581 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:24.958181    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-b54cc4a5-ttvwv" event={"ID":"7058df15-c069-4553-8453-46b806ffb18b","Type":"ContainerDied","Data":"c1620a4325294ed952b14094e2a50820250ddb529ee33d3058358c29f400c047"}
Oct 30 20:07:24.959885 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:24.959861    6275 generic.go:356] "Generic (PLEG): container finished" podID="0382c156-57ff-4ae5-afbb-d2c7683c8272" containerID="384092fc1005e98dcf66e2b687ba654c46bf3a90f9e3548b5668de57bb9968f3" exitCode=0
Oct 30 20:07:24.959982 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:24.959940    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-73085560-nwxrn" event={"ID":"0382c156-57ff-4ae5-afbb-d2c7683c8272","Type":"ContainerDied","Data":"384092fc1005e98dcf66e2b687ba654c46bf3a90f9e3548b5668de57bb9968f3"}
Oct 30 20:07:24.961402 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:24.961383    6275 generic.go:356] "Generic (PLEG): container finished" podID="b195a865-3ec2-4556-969e-161d7edfe96d" containerID="6bc23c053f01f18f86151407718119ba712acd0f8751a4c20ed2f03f29992e19" exitCode=0
Oct 30 20:07:24.961494 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:24.961408    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-8375ad3d-nz2zn" event={"ID":"b195a865-3ec2-4556-969e-161d7edfe96d","Type":"ContainerDied","Data":"6bc23c053f01f18f86151407718119ba712acd0f8751a4c20ed2f03f29992e19"}
Oct 30 20:07:25.164918 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:25.164829    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-processing-e2e-worker-w3-912f24-7bd864565f-fvnth" podUID="72b9ada9-738c-4c37-96f4-5f827abdf99e" containerName="payload-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 30 20:07:25.165073 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:25.164829    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-worker-w3-912f24-585f6bf47-q7hqs" podUID="8b04ae86-d3b8-4e51-b357-25e38742b02f" containerName="payload-pre-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 30 20:07:25.742050 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:25.742010    6275 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w3-912f24/distinct-2-w3-912f24-kserve-566865fdcc-ptx4l" podUID="fcea214a-04a7-4bdd-9695-852f657edfe5" containerName="main" containerID="cri-o://f6e6a9170aa512c632afd32db42cb9fe52bf40990ec0631d9cc23f47d3dfd857" gracePeriod=45
Oct 30 20:07:25.747716 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:25.747690    6275 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w2-efbac3-openshift-default-844cb4689c-8mzmn"]
Oct 30 20:07:25.752496 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:25.752474    6275 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-efbac3-openshift-default-844cb4689c-8mzmn"
Oct 30 20:07:25.776771 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:25.776699    6275 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w3-912f24/simulator-w3-912f24-kserve-59897cf48b-sd5wj" podUID="b4de6427-0db0-42d9-8b88-6b35d9d4c314" containerName="main" containerID="cri-o://ad970cd29845aa6154cbce8c2eff7b3e688e5061bd2d1e716dbc921d42d3caa2" gracePeriod=45
Oct 30 20:07:25.793429 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:25.793377    6275 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w2-efbac3-openshift-default-844cb4689c-8mzmn"]
Oct 30 20:07:25.837669 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:25.837628    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9cba92db-f8aa-4a79-9b3e-3481fa8b1fbd-istio-data\") pod \"e2e-worker-w2-efbac3-openshift-default-844cb4689c-8mzmn\" (UID: \"9cba92db-f8aa-4a79-9b3e-3481fa8b1fbd\") " pod="openshift-ingress/e2e-worker-w2-efbac3-openshift-default-844cb4689c-8mzmn"
Oct 30 20:07:25.837860 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:25.837683    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9cba92db-f8aa-4a79-9b3e-3481fa8b1fbd-istio-token\") pod \"e2e-worker-w2-efbac3-openshift-default-844cb4689c-8mzmn\" (UID: \"9cba92db-f8aa-4a79-9b3e-3481fa8b1fbd\") " pod="openshift-ingress/e2e-worker-w2-efbac3-openshift-default-844cb4689c-8mzmn"
Oct 30 20:07:25.838021 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:25.837992    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9cba92db-f8aa-4a79-9b3e-3481fa8b1fbd-istiod-ca-cert\") pod \"e2e-worker-w2-efbac3-openshift-default-844cb4689c-8mzmn\" (UID: \"9cba92db-f8aa-4a79-9b3e-3481fa8b1fbd\") " pod="openshift-ingress/e2e-worker-w2-efbac3-openshift-default-844cb4689c-8mzmn"
Oct 30 20:07:25.838101 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:25.838046    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dxpss\" (UniqueName: \"kubernetes.io/projected/9cba92db-f8aa-4a79-9b3e-3481fa8b1fbd-kube-api-access-dxpss\") pod \"e2e-worker-w2-efbac3-openshift-default-844cb4689c-8mzmn\" (UID: \"9cba92db-f8aa-4a79-9b3e-3481fa8b1fbd\") " pod="openshift-ingress/e2e-worker-w2-efbac3-openshift-default-844cb4689c-8mzmn"
Oct 30 20:07:25.838174 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:25.838145    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9cba92db-f8aa-4a79-9b3e-3481fa8b1fbd-workload-certs\") pod \"e2e-worker-w2-efbac3-openshift-default-844cb4689c-8mzmn\" (UID: \"9cba92db-f8aa-4a79-9b3e-3481fa8b1fbd\") " pod="openshift-ingress/e2e-worker-w2-efbac3-openshift-default-844cb4689c-8mzmn"
Oct 30 20:07:25.838251 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:25.838227    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9cba92db-f8aa-4a79-9b3e-3481fa8b1fbd-credential-socket\") pod \"e2e-worker-w2-efbac3-openshift-default-844cb4689c-8mzmn\" (UID: \"9cba92db-f8aa-4a79-9b3e-3481fa8b1fbd\") " pod="openshift-ingress/e2e-worker-w2-efbac3-openshift-default-844cb4689c-8mzmn"
Oct 30 20:07:25.838396 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:25.838330    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9cba92db-f8aa-4a79-9b3e-3481fa8b1fbd-workload-socket\") pod \"e2e-worker-w2-efbac3-openshift-default-844cb4689c-8mzmn\" (UID: \"9cba92db-f8aa-4a79-9b3e-3481fa8b1fbd\") " pod="openshift-ingress/e2e-worker-w2-efbac3-openshift-default-844cb4689c-8mzmn"
Oct 30 20:07:25.838492 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:25.838426    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9cba92db-f8aa-4a79-9b3e-3481fa8b1fbd-istio-podinfo\") pod \"e2e-worker-w2-efbac3-openshift-default-844cb4689c-8mzmn\" (UID: \"9cba92db-f8aa-4a79-9b3e-3481fa8b1fbd\") " pod="openshift-ingress/e2e-worker-w2-efbac3-openshift-default-844cb4689c-8mzmn"
Oct 30 20:07:25.838492 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:25.838465    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9cba92db-f8aa-4a79-9b3e-3481fa8b1fbd-istio-envoy\") pod \"e2e-worker-w2-efbac3-openshift-default-844cb4689c-8mzmn\" (UID: \"9cba92db-f8aa-4a79-9b3e-3481fa8b1fbd\") " pod="openshift-ingress/e2e-worker-w2-efbac3-openshift-default-844cb4689c-8mzmn"
Oct 30 20:07:25.883587 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:25.883553    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-912f24/distinct-2-w3-912f24-kserve-566865fdcc-ptx4l" podUID="fcea214a-04a7-4bdd-9695-852f657edfe5" containerName="main" probeResult="failure" output="Get \"https://10.134.0.74:8000/ready\": dial tcp 10.134.0.74:8000: connect: connection refused"
Oct 30 20:07:25.940688 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:25.940646    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9cba92db-f8aa-4a79-9b3e-3481fa8b1fbd-istiod-ca-cert\") pod \"e2e-worker-w2-efbac3-openshift-default-844cb4689c-8mzmn\" (UID: \"9cba92db-f8aa-4a79-9b3e-3481fa8b1fbd\") " pod="openshift-ingress/e2e-worker-w2-efbac3-openshift-default-844cb4689c-8mzmn"
Oct 30 20:07:25.940854 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:25.940702    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dxpss\" (UniqueName: \"kubernetes.io/projected/9cba92db-f8aa-4a79-9b3e-3481fa8b1fbd-kube-api-access-dxpss\") pod \"e2e-worker-w2-efbac3-openshift-default-844cb4689c-8mzmn\" (UID: \"9cba92db-f8aa-4a79-9b3e-3481fa8b1fbd\") " pod="openshift-ingress/e2e-worker-w2-efbac3-openshift-default-844cb4689c-8mzmn"
Oct 30 20:07:25.940854 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:25.940734    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9cba92db-f8aa-4a79-9b3e-3481fa8b1fbd-workload-certs\") pod \"e2e-worker-w2-efbac3-openshift-default-844cb4689c-8mzmn\" (UID: \"9cba92db-f8aa-4a79-9b3e-3481fa8b1fbd\") " pod="openshift-ingress/e2e-worker-w2-efbac3-openshift-default-844cb4689c-8mzmn"
Oct 30 20:07:25.940854 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:25.940804    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9cba92db-f8aa-4a79-9b3e-3481fa8b1fbd-credential-socket\") pod \"e2e-worker-w2-efbac3-openshift-default-844cb4689c-8mzmn\" (UID: \"9cba92db-f8aa-4a79-9b3e-3481fa8b1fbd\") " pod="openshift-ingress/e2e-worker-w2-efbac3-openshift-default-844cb4689c-8mzmn"
Oct 30 20:07:25.940854 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:25.940839    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9cba92db-f8aa-4a79-9b3e-3481fa8b1fbd-workload-socket\") pod \"e2e-worker-w2-efbac3-openshift-default-844cb4689c-8mzmn\" (UID: \"9cba92db-f8aa-4a79-9b3e-3481fa8b1fbd\") " pod="openshift-ingress/e2e-worker-w2-efbac3-openshift-default-844cb4689c-8mzmn"
Oct 30 20:07:25.941093 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:25.940925    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9cba92db-f8aa-4a79-9b3e-3481fa8b1fbd-istio-podinfo\") pod \"e2e-worker-w2-efbac3-openshift-default-844cb4689c-8mzmn\" (UID: \"9cba92db-f8aa-4a79-9b3e-3481fa8b1fbd\") " pod="openshift-ingress/e2e-worker-w2-efbac3-openshift-default-844cb4689c-8mzmn"
Oct 30 20:07:25.941093 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:25.940960    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9cba92db-f8aa-4a79-9b3e-3481fa8b1fbd-istio-envoy\") pod \"e2e-worker-w2-efbac3-openshift-default-844cb4689c-8mzmn\" (UID: \"9cba92db-f8aa-4a79-9b3e-3481fa8b1fbd\") " pod="openshift-ingress/e2e-worker-w2-efbac3-openshift-default-844cb4689c-8mzmn"
Oct 30 20:07:25.941093 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:25.940992    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9cba92db-f8aa-4a79-9b3e-3481fa8b1fbd-istio-data\") pod \"e2e-worker-w2-efbac3-openshift-default-844cb4689c-8mzmn\" (UID: \"9cba92db-f8aa-4a79-9b3e-3481fa8b1fbd\") " pod="openshift-ingress/e2e-worker-w2-efbac3-openshift-default-844cb4689c-8mzmn"
Oct 30 20:07:25.941093 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:25.941030    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9cba92db-f8aa-4a79-9b3e-3481fa8b1fbd-istio-token\") pod \"e2e-worker-w2-efbac3-openshift-default-844cb4689c-8mzmn\" (UID: \"9cba92db-f8aa-4a79-9b3e-3481fa8b1fbd\") " pod="openshift-ingress/e2e-worker-w2-efbac3-openshift-default-844cb4689c-8mzmn"
Oct 30 20:07:25.941848 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:25.941816    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9cba92db-f8aa-4a79-9b3e-3481fa8b1fbd-workload-certs\") pod \"e2e-worker-w2-efbac3-openshift-default-844cb4689c-8mzmn\" (UID: \"9cba92db-f8aa-4a79-9b3e-3481fa8b1fbd\") " pod="openshift-ingress/e2e-worker-w2-efbac3-openshift-default-844cb4689c-8mzmn"
Oct 30 20:07:25.942097 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:25.942074    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9cba92db-f8aa-4a79-9b3e-3481fa8b1fbd-istiod-ca-cert\") pod \"e2e-worker-w2-efbac3-openshift-default-844cb4689c-8mzmn\" (UID: \"9cba92db-f8aa-4a79-9b3e-3481fa8b1fbd\") " pod="openshift-ingress/e2e-worker-w2-efbac3-openshift-default-844cb4689c-8mzmn"
Oct 30 20:07:25.942204 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:25.942182    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9cba92db-f8aa-4a79-9b3e-3481fa8b1fbd-istio-data\") pod \"e2e-worker-w2-efbac3-openshift-default-844cb4689c-8mzmn\" (UID: \"9cba92db-f8aa-4a79-9b3e-3481fa8b1fbd\") " pod="openshift-ingress/e2e-worker-w2-efbac3-openshift-default-844cb4689c-8mzmn"
Oct 30 20:07:25.942392 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:25.942372    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9cba92db-f8aa-4a79-9b3e-3481fa8b1fbd-workload-socket\") pod \"e2e-worker-w2-efbac3-openshift-default-844cb4689c-8mzmn\" (UID: \"9cba92db-f8aa-4a79-9b3e-3481fa8b1fbd\") " pod="openshift-ingress/e2e-worker-w2-efbac3-openshift-default-844cb4689c-8mzmn"
Oct 30 20:07:25.942598 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:25.942580    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9cba92db-f8aa-4a79-9b3e-3481fa8b1fbd-credential-socket\") pod \"e2e-worker-w2-efbac3-openshift-default-844cb4689c-8mzmn\" (UID: \"9cba92db-f8aa-4a79-9b3e-3481fa8b1fbd\") " pod="openshift-ingress/e2e-worker-w2-efbac3-openshift-default-844cb4689c-8mzmn"
Oct 30 20:07:25.944702 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:25.944662    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9cba92db-f8aa-4a79-9b3e-3481fa8b1fbd-istio-envoy\") pod \"e2e-worker-w2-efbac3-openshift-default-844cb4689c-8mzmn\" (UID: \"9cba92db-f8aa-4a79-9b3e-3481fa8b1fbd\") " pod="openshift-ingress/e2e-worker-w2-efbac3-openshift-default-844cb4689c-8mzmn"
Oct 30 20:07:25.945088 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:25.945065    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9cba92db-f8aa-4a79-9b3e-3481fa8b1fbd-istio-podinfo\") pod \"e2e-worker-w2-efbac3-openshift-default-844cb4689c-8mzmn\" (UID: \"9cba92db-f8aa-4a79-9b3e-3481fa8b1fbd\") " pod="openshift-ingress/e2e-worker-w2-efbac3-openshift-default-844cb4689c-8mzmn"
Oct 30 20:07:25.973397 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:25.973302    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9cba92db-f8aa-4a79-9b3e-3481fa8b1fbd-istio-token\") pod \"e2e-worker-w2-efbac3-openshift-default-844cb4689c-8mzmn\" (UID: \"9cba92db-f8aa-4a79-9b3e-3481fa8b1fbd\") " pod="openshift-ingress/e2e-worker-w2-efbac3-openshift-default-844cb4689c-8mzmn"
Oct 30 20:07:25.976590 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:25.974919    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dxpss\" (UniqueName: \"kubernetes.io/projected/9cba92db-f8aa-4a79-9b3e-3481fa8b1fbd-kube-api-access-dxpss\") pod \"e2e-worker-w2-efbac3-openshift-default-844cb4689c-8mzmn\" (UID: \"9cba92db-f8aa-4a79-9b3e-3481fa8b1fbd\") " pod="openshift-ingress/e2e-worker-w2-efbac3-openshift-default-844cb4689c-8mzmn"
Oct 30 20:07:25.978440 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:25.978200    6275 generic.go:356] "Generic (PLEG): container finished" podID="fcea214a-04a7-4bdd-9695-852f657edfe5" containerID="f6e6a9170aa512c632afd32db42cb9fe52bf40990ec0631d9cc23f47d3dfd857" exitCode=0
Oct 30 20:07:25.978635 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:25.978406    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w3-912f24/distinct-2-w3-912f24-kserve-566865fdcc-ptx4l" event={"ID":"fcea214a-04a7-4bdd-9695-852f657edfe5","Type":"ContainerDied","Data":"f6e6a9170aa512c632afd32db42cb9fe52bf40990ec0631d9cc23f47d3dfd857"}
Oct 30 20:07:25.980985 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:25.980959    6275 generic.go:356] "Generic (PLEG): container finished" podID="b4de6427-0db0-42d9-8b88-6b35d9d4c314" containerID="ad970cd29845aa6154cbce8c2eff7b3e688e5061bd2d1e716dbc921d42d3caa2" exitCode=0
Oct 30 20:07:25.981466 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:25.981408    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w3-912f24/simulator-w3-912f24-kserve-59897cf48b-sd5wj" event={"ID":"b4de6427-0db0-42d9-8b88-6b35d9d4c314","Type":"ContainerDied","Data":"ad970cd29845aa6154cbce8c2eff7b3e688e5061bd2d1e716dbc921d42d3caa2"}
Oct 30 20:07:26.133610 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:26.133565    6275 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w3-912f24/distinct-2-w3-912f24-kserve-566865fdcc-ptx4l"
Oct 30 20:07:26.137729 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:26.136035    6275 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w3-912f24/simulator-w3-912f24-kserve-59897cf48b-sd5wj"
Oct 30 20:07:26.172390 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:26.172350    6275 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-efbac3-openshift-default-844cb4689c-8mzmn"
Oct 30 20:07:26.228534 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:26.228400    6275 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-73085560-nwxrn"
Oct 30 20:07:26.232661 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:26.232341    6275 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-b54cc4a5-ttvwv"
Oct 30 20:07:26.265474 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:26.262613    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b4de6427-0db0-42d9-8b88-6b35d9d4c314-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b4de6427-0db0-42d9-8b88-6b35d9d4c314-model-cache\") pod \"b4de6427-0db0-42d9-8b88-6b35d9d4c314\" (UID: \"b4de6427-0db0-42d9-8b88-6b35d9d4c314\") "
Oct 30 20:07:26.265474 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:26.262724    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/b4de6427-0db0-42d9-8b88-6b35d9d4c314-kube-api-access-nzz9p\" (UniqueName: \"kubernetes.io/projected/b4de6427-0db0-42d9-8b88-6b35d9d4c314-kube-api-access-nzz9p\") pod \"b4de6427-0db0-42d9-8b88-6b35d9d4c314\" (UID: \"b4de6427-0db0-42d9-8b88-6b35d9d4c314\") "
Oct 30 20:07:26.265474 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:26.262783    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b4de6427-0db0-42d9-8b88-6b35d9d4c314-dshm\" (UniqueName: \"kubernetes.io/empty-dir/b4de6427-0db0-42d9-8b88-6b35d9d4c314-dshm\") pod \"b4de6427-0db0-42d9-8b88-6b35d9d4c314\" (UID: \"b4de6427-0db0-42d9-8b88-6b35d9d4c314\") "
Oct 30 20:07:26.265474 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:26.262840    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/b4de6427-0db0-42d9-8b88-6b35d9d4c314-tls-certs\" (UniqueName: \"kubernetes.io/secret/b4de6427-0db0-42d9-8b88-6b35d9d4c314-tls-certs\") pod \"b4de6427-0db0-42d9-8b88-6b35d9d4c314\" (UID: \"b4de6427-0db0-42d9-8b88-6b35d9d4c314\") "
Oct 30 20:07:26.265474 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:26.262881    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/fcea214a-04a7-4bdd-9695-852f657edfe5-home\" (UniqueName: \"kubernetes.io/empty-dir/fcea214a-04a7-4bdd-9695-852f657edfe5-home\") pod \"fcea214a-04a7-4bdd-9695-852f657edfe5\" (UID: \"fcea214a-04a7-4bdd-9695-852f657edfe5\") "
Oct 30 20:07:26.265474 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:26.262901    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/fcea214a-04a7-4bdd-9695-852f657edfe5-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fcea214a-04a7-4bdd-9695-852f657edfe5-tmp-dir\") pod \"fcea214a-04a7-4bdd-9695-852f657edfe5\" (UID: \"fcea214a-04a7-4bdd-9695-852f657edfe5\") "
Oct 30 20:07:26.266497 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:26.266065    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/fcea214a-04a7-4bdd-9695-852f657edfe5-dshm\" (UniqueName: \"kubernetes.io/empty-dir/fcea214a-04a7-4bdd-9695-852f657edfe5-dshm\") pod \"fcea214a-04a7-4bdd-9695-852f657edfe5\" (UID: \"fcea214a-04a7-4bdd-9695-852f657edfe5\") "
Oct 30 20:07:26.268705 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:26.266648    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/fcea214a-04a7-4bdd-9695-852f657edfe5-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fcea214a-04a7-4bdd-9695-852f657edfe5-model-cache\") pod \"fcea214a-04a7-4bdd-9695-852f657edfe5\" (UID: \"fcea214a-04a7-4bdd-9695-852f657edfe5\") "
Oct 30 20:07:26.268705 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:26.266755    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/fcea214a-04a7-4bdd-9695-852f657edfe5-tls-certs\" (UniqueName: \"kubernetes.io/secret/fcea214a-04a7-4bdd-9695-852f657edfe5-tls-certs\") pod \"fcea214a-04a7-4bdd-9695-852f657edfe5\" (UID: \"fcea214a-04a7-4bdd-9695-852f657edfe5\") "
Oct 30 20:07:26.268705 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:26.266795    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/fcea214a-04a7-4bdd-9695-852f657edfe5-kube-api-access-2lksd\" (UniqueName: \"kubernetes.io/projected/fcea214a-04a7-4bdd-9695-852f657edfe5-kube-api-access-2lksd\") pod \"fcea214a-04a7-4bdd-9695-852f657edfe5\" (UID: \"fcea214a-04a7-4bdd-9695-852f657edfe5\") "
Oct 30 20:07:26.268705 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:26.266836    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b4de6427-0db0-42d9-8b88-6b35d9d4c314-home\" (UniqueName: \"kubernetes.io/empty-dir/b4de6427-0db0-42d9-8b88-6b35d9d4c314-home\") pod \"b4de6427-0db0-42d9-8b88-6b35d9d4c314\" (UID: \"b4de6427-0db0-42d9-8b88-6b35d9d4c314\") "
Oct 30 20:07:26.268705 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:26.266933    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b4de6427-0db0-42d9-8b88-6b35d9d4c314-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b4de6427-0db0-42d9-8b88-6b35d9d4c314-tmp-dir\") pod \"b4de6427-0db0-42d9-8b88-6b35d9d4c314\" (UID: \"b4de6427-0db0-42d9-8b88-6b35d9d4c314\") "
Oct 30 20:07:26.269048 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:26.263331    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fcea214a-04a7-4bdd-9695-852f657edfe5-tmp-dir" pod "fcea214a-04a7-4bdd-9695-852f657edfe5" (UID: "fcea214a-04a7-4bdd-9695-852f657edfe5"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:07:26.269048 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:26.263563    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b4de6427-0db0-42d9-8b88-6b35d9d4c314-model-cache" pod "b4de6427-0db0-42d9-8b88-6b35d9d4c314" (UID: "b4de6427-0db0-42d9-8b88-6b35d9d4c314"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:07:26.269048 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:26.268269    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fcea214a-04a7-4bdd-9695-852f657edfe5-model-cache" pod "fcea214a-04a7-4bdd-9695-852f657edfe5" (UID: "fcea214a-04a7-4bdd-9695-852f657edfe5"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:07:26.269048 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:26.268366    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fcea214a-04a7-4bdd-9695-852f657edfe5-home" pod "fcea214a-04a7-4bdd-9695-852f657edfe5" (UID: "fcea214a-04a7-4bdd-9695-852f657edfe5"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:07:26.272383 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:26.270543    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b4de6427-0db0-42d9-8b88-6b35d9d4c314-tmp-dir" pod "b4de6427-0db0-42d9-8b88-6b35d9d4c314" (UID: "b4de6427-0db0-42d9-8b88-6b35d9d4c314"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:07:26.272383 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:26.271063    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b4de6427-0db0-42d9-8b88-6b35d9d4c314-home" pod "b4de6427-0db0-42d9-8b88-6b35d9d4c314" (UID: "b4de6427-0db0-42d9-8b88-6b35d9d4c314"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:07:26.272383 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:26.272075    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b4de6427-0db0-42d9-8b88-6b35d9d4c314-tls-certs" pod "b4de6427-0db0-42d9-8b88-6b35d9d4c314" (UID: "b4de6427-0db0-42d9-8b88-6b35d9d4c314"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 20:07:26.278815 ip-10-0-131-26 kubenswrapper[6275]: E1030 20:07:26.276963    6275 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-fwc77" containerName="extractor"
Oct 30 20:07:26.279341 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:26.279313    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b4de6427-0db0-42d9-8b88-6b35d9d4c314-dshm" pod "b4de6427-0db0-42d9-8b88-6b35d9d4c314" (UID: "b4de6427-0db0-42d9-8b88-6b35d9d4c314"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:07:26.281111 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:26.280665    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fcea214a-04a7-4bdd-9695-852f657edfe5-kube-api-access-2lksd" pod "fcea214a-04a7-4bdd-9695-852f657edfe5" (UID: "fcea214a-04a7-4bdd-9695-852f657edfe5"). InnerVolumeSpecName "kube-api-access-2lksd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:07:26.282471 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:26.282228    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fcea214a-04a7-4bdd-9695-852f657edfe5-tls-certs" pod "fcea214a-04a7-4bdd-9695-852f657edfe5" (UID: "fcea214a-04a7-4bdd-9695-852f657edfe5"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 20:07:26.282471 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:26.282255    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fcea214a-04a7-4bdd-9695-852f657edfe5-dshm" pod "fcea214a-04a7-4bdd-9695-852f657edfe5" (UID: "fcea214a-04a7-4bdd-9695-852f657edfe5"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:07:26.282471 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:26.282265    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b4de6427-0db0-42d9-8b88-6b35d9d4c314-kube-api-access-nzz9p" pod "b4de6427-0db0-42d9-8b88-6b35d9d4c314" (UID: "b4de6427-0db0-42d9-8b88-6b35d9d4c314"). InnerVolumeSpecName "kube-api-access-nzz9p". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:07:26.289168 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:26.287663    6275 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-8375ad3d-nz2zn"
Oct 30 20:07:26.369515 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:26.369401    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/0382c156-57ff-4ae5-afbb-d2c7683c8272-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/0382c156-57ff-4ae5-afbb-d2c7683c8272-maas-api-xks-ca\") pod \"0382c156-57ff-4ae5-afbb-d2c7683c8272\" (UID: \"0382c156-57ff-4ae5-afbb-d2c7683c8272\") "
Oct 30 20:07:26.369697 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:26.369513    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/7058df15-c069-4553-8453-46b806ffb18b-kube-api-access-f5rlz\" (UniqueName: \"kubernetes.io/projected/7058df15-c069-4553-8453-46b806ffb18b-kube-api-access-f5rlz\") pod \"7058df15-c069-4553-8453-46b806ffb18b\" (UID: \"7058df15-c069-4553-8453-46b806ffb18b\") "
Oct 30 20:07:26.369697 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:26.369548    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/7058df15-c069-4553-8453-46b806ffb18b-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/7058df15-c069-4553-8453-46b806ffb18b-maas-api-xks-ca\") pod \"7058df15-c069-4553-8453-46b806ffb18b\" (UID: \"7058df15-c069-4553-8453-46b806ffb18b\") "
Oct 30 20:07:26.369697 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:26.369610    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/7058df15-c069-4553-8453-46b806ffb18b-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/7058df15-c069-4553-8453-46b806ffb18b-maas-api-openshift-ca\") pod \"7058df15-c069-4553-8453-46b806ffb18b\" (UID: \"7058df15-c069-4553-8453-46b806ffb18b\") "
Oct 30 20:07:26.369911 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:26.369840    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/0382c156-57ff-4ae5-afbb-d2c7683c8272-kube-api-access-pxcgc\" (UniqueName: \"kubernetes.io/projected/0382c156-57ff-4ae5-afbb-d2c7683c8272-kube-api-access-pxcgc\") pod \"0382c156-57ff-4ae5-afbb-d2c7683c8272\" (UID: \"0382c156-57ff-4ae5-afbb-d2c7683c8272\") "
Oct 30 20:07:26.369911 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:26.369892    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/0382c156-57ff-4ae5-afbb-d2c7683c8272-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/0382c156-57ff-4ae5-afbb-d2c7683c8272-maas-api-openshift-ca\") pod \"0382c156-57ff-4ae5-afbb-d2c7683c8272\" (UID: \"0382c156-57ff-4ae5-afbb-d2c7683c8272\") "
Oct 30 20:07:26.370480 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:26.370459    6275 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b4de6427-0db0-42d9-8b88-6b35d9d4c314-tmp-dir\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:07:26.370572 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:26.370482    6275 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b4de6427-0db0-42d9-8b88-6b35d9d4c314-model-cache\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:07:26.370572 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:26.370497    6275 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nzz9p\" (UniqueName: \"kubernetes.io/projected/b4de6427-0db0-42d9-8b88-6b35d9d4c314-kube-api-access-nzz9p\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:07:26.370572 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:26.370509    6275 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b4de6427-0db0-42d9-8b88-6b35d9d4c314-dshm\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:07:26.370572 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:26.370521    6275 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b4de6427-0db0-42d9-8b88-6b35d9d4c314-tls-certs\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:07:26.370572 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:26.370533    6275 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fcea214a-04a7-4bdd-9695-852f657edfe5-home\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:07:26.370572 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:26.370545    6275 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fcea214a-04a7-4bdd-9695-852f657edfe5-tmp-dir\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:07:26.370572 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:26.370557    6275 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fcea214a-04a7-4bdd-9695-852f657edfe5-dshm\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:07:26.370572 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:26.370570    6275 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fcea214a-04a7-4bdd-9695-852f657edfe5-model-cache\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:07:26.371017 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:26.370583    6275 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fcea214a-04a7-4bdd-9695-852f657edfe5-tls-certs\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:07:26.371017 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:26.370596    6275 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2lksd\" (UniqueName: \"kubernetes.io/projected/fcea214a-04a7-4bdd-9695-852f657edfe5-kube-api-access-2lksd\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:07:26.371017 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:26.370609    6275 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b4de6427-0db0-42d9-8b88-6b35d9d4c314-home\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:07:26.371017 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:26.370978    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0382c156-57ff-4ae5-afbb-d2c7683c8272-maas-api-openshift-ca" pod "0382c156-57ff-4ae5-afbb-d2c7683c8272" (UID: "0382c156-57ff-4ae5-afbb-d2c7683c8272"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:07:26.371721 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:26.371701    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7058df15-c069-4553-8453-46b806ffb18b-maas-api-openshift-ca" pod "7058df15-c069-4553-8453-46b806ffb18b" (UID: "7058df15-c069-4553-8453-46b806ffb18b"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:07:26.376964 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:26.376943    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0382c156-57ff-4ae5-afbb-d2c7683c8272-kube-api-access-pxcgc" pod "0382c156-57ff-4ae5-afbb-d2c7683c8272" (UID: "0382c156-57ff-4ae5-afbb-d2c7683c8272"). InnerVolumeSpecName "kube-api-access-pxcgc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:07:26.381494 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:26.381383    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7058df15-c069-4553-8453-46b806ffb18b-kube-api-access-f5rlz" pod "7058df15-c069-4553-8453-46b806ffb18b" (UID: "7058df15-c069-4553-8453-46b806ffb18b"). InnerVolumeSpecName "kube-api-access-f5rlz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:07:26.381494 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:26.381393    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0382c156-57ff-4ae5-afbb-d2c7683c8272-maas-api-xks-ca" pod "0382c156-57ff-4ae5-afbb-d2c7683c8272" (UID: "0382c156-57ff-4ae5-afbb-d2c7683c8272"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 20:07:26.382849 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:26.382682    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7058df15-c069-4553-8453-46b806ffb18b-maas-api-xks-ca" pod "7058df15-c069-4553-8453-46b806ffb18b" (UID: "7058df15-c069-4553-8453-46b806ffb18b"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 20:07:26.471911 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:26.471877    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/b195a865-3ec2-4556-969e-161d7edfe96d-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/b195a865-3ec2-4556-969e-161d7edfe96d-maas-api-openshift-ca\") pod \"b195a865-3ec2-4556-969e-161d7edfe96d\" (UID: \"b195a865-3ec2-4556-969e-161d7edfe96d\") "
Oct 30 20:07:26.472103 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:26.471935    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/b195a865-3ec2-4556-969e-161d7edfe96d-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/b195a865-3ec2-4556-969e-161d7edfe96d-maas-api-xks-ca\") pod \"b195a865-3ec2-4556-969e-161d7edfe96d\" (UID: \"b195a865-3ec2-4556-969e-161d7edfe96d\") "
Oct 30 20:07:26.472214 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:26.472193    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/b195a865-3ec2-4556-969e-161d7edfe96d-kube-api-access-b48gn\" (UniqueName: \"kubernetes.io/projected/b195a865-3ec2-4556-969e-161d7edfe96d-kube-api-access-b48gn\") pod \"b195a865-3ec2-4556-969e-161d7edfe96d\" (UID: \"b195a865-3ec2-4556-969e-161d7edfe96d\") "
Oct 30 20:07:26.472609 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:26.472318    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b195a865-3ec2-4556-969e-161d7edfe96d-maas-api-openshift-ca" pod "b195a865-3ec2-4556-969e-161d7edfe96d" (UID: "b195a865-3ec2-4556-969e-161d7edfe96d"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:07:26.472950 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:26.472923    6275 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/b195a865-3ec2-4556-969e-161d7edfe96d-maas-api-openshift-ca\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:07:26.473045 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:26.472969    6275 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pxcgc\" (UniqueName: \"kubernetes.io/projected/0382c156-57ff-4ae5-afbb-d2c7683c8272-kube-api-access-pxcgc\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:07:26.473045 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:26.472985    6275 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/0382c156-57ff-4ae5-afbb-d2c7683c8272-maas-api-openshift-ca\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:07:26.473045 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:26.473000    6275 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/0382c156-57ff-4ae5-afbb-d2c7683c8272-maas-api-xks-ca\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:07:26.473045 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:26.473014    6275 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f5rlz\" (UniqueName: \"kubernetes.io/projected/7058df15-c069-4553-8453-46b806ffb18b-kube-api-access-f5rlz\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:07:26.473045 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:26.473026    6275 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/7058df15-c069-4553-8453-46b806ffb18b-maas-api-xks-ca\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:07:26.473045 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:26.473040    6275 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/7058df15-c069-4553-8453-46b806ffb18b-maas-api-openshift-ca\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:07:26.474766 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:26.474729    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b195a865-3ec2-4556-969e-161d7edfe96d-kube-api-access-b48gn" pod "b195a865-3ec2-4556-969e-161d7edfe96d" (UID: "b195a865-3ec2-4556-969e-161d7edfe96d"). InnerVolumeSpecName "kube-api-access-b48gn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:07:26.475222 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:26.475196    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b195a865-3ec2-4556-969e-161d7edfe96d-maas-api-xks-ca" pod "b195a865-3ec2-4556-969e-161d7edfe96d" (UID: "b195a865-3ec2-4556-969e-161d7edfe96d"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 20:07:26.563653 ip-10-0-131-26 kubenswrapper[6275]: W1030 20:07:26.563622    6275 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9cba92db_f8aa_4a79_9b3e_3481fa8b1fbd.slice/crio-21b5b404bfa81aacce0d4dbbe4e24cea340910a1bb333101b9444e332f04f779 WatchSource:0}: Error finding container 21b5b404bfa81aacce0d4dbbe4e24cea340910a1bb333101b9444e332f04f779: Status 404 returned error can't find the container with id 21b5b404bfa81aacce0d4dbbe4e24cea340910a1bb333101b9444e332f04f779
Oct 30 20:07:26.564776 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:26.564755    6275 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w2-efbac3-openshift-default-844cb4689c-8mzmn"]
Oct 30 20:07:26.566648 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:26.566616    6275 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Oct 30 20:07:26.566701 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:26.566678    6275 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Oct 30 20:07:26.566745 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:26.566710    6275 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Oct 30 20:07:26.574701 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:26.574680    6275 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b48gn\" (UniqueName: \"kubernetes.io/projected/b195a865-3ec2-4556-969e-161d7edfe96d-kube-api-access-b48gn\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:07:26.574701 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:26.574703    6275 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/b195a865-3ec2-4556-969e-161d7edfe96d-maas-api-xks-ca\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:07:26.993069 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:26.993030    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-73085560-nwxrn" event={"ID":"0382c156-57ff-4ae5-afbb-d2c7683c8272","Type":"ContainerDied","Data":"e0e07a2b59c3bc98f9e7c9e9e6840b550f4953d996a6d9c37e50deaf3cb62952"}
Oct 30 20:07:26.993620 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:26.993096    6275 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e0e07a2b59c3bc98f9e7c9e9e6840b550f4953d996a6d9c37e50deaf3cb62952"
Oct 30 20:07:26.993620 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:26.993045    6275 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-73085560-nwxrn"
Oct 30 20:07:26.995024 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:26.994994    6275 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w3-912f24/distinct-2-w3-912f24-kserve-566865fdcc-ptx4l"
Oct 30 20:07:26.995148 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:26.995031    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w3-912f24/distinct-2-w3-912f24-kserve-566865fdcc-ptx4l" event={"ID":"fcea214a-04a7-4bdd-9695-852f657edfe5","Type":"ContainerDied","Data":"9d924050bcf01c6f05a160ccd82fdd08a227c8319d9440db1d548e4842a9e4e5"}
Oct 30 20:07:26.995148 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:26.995077    6275 scope.go:122] "RemoveContainer" containerID="f6e6a9170aa512c632afd32db42cb9fe52bf40990ec0631d9cc23f47d3dfd857"
Oct 30 20:07:26.996751 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:26.996732    6275 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w3-912f24/simulator-w3-912f24-kserve-59897cf48b-sd5wj"
Oct 30 20:07:26.996839 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:26.996778    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w3-912f24/simulator-w3-912f24-kserve-59897cf48b-sd5wj" event={"ID":"b4de6427-0db0-42d9-8b88-6b35d9d4c314","Type":"ContainerDied","Data":"63dce0e2fafe0b1b057fe9201175d93218f62270b4ff038b596464f729101a36"}
Oct 30 20:07:26.998315 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:26.998290    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-8375ad3d-nz2zn" event={"ID":"b195a865-3ec2-4556-969e-161d7edfe96d","Type":"ContainerDied","Data":"fd86931513663b811074979d49198a1193ccb4f8033d1f9673f2320a05dc1445"}
Oct 30 20:07:26.998485 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:26.998361    6275 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="fd86931513663b811074979d49198a1193ccb4f8033d1f9673f2320a05dc1445"
Oct 30 20:07:26.998485 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:26.998440    6275 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-8375ad3d-nz2zn"
Oct 30 20:07:27.002215 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:27.002187    6275 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-b54cc4a5-ttvwv"
Oct 30 20:07:27.002456 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:27.002191    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-b54cc4a5-ttvwv" event={"ID":"7058df15-c069-4553-8453-46b806ffb18b","Type":"ContainerDied","Data":"80046e6808f0bdf57359f00994a0ea23f8df566d386535ef414d2857d6a03c75"}
Oct 30 20:07:27.002456 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:27.002326    6275 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="80046e6808f0bdf57359f00994a0ea23f8df566d386535ef414d2857d6a03c75"
Oct 30 20:07:27.007033 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:27.007009    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-efbac3-openshift-default-844cb4689c-8mzmn" event={"ID":"9cba92db-f8aa-4a79-9b3e-3481fa8b1fbd","Type":"ContainerStarted","Data":"9054abd996d5485458ff65ff5a106b24659fffbebc6291fa49e030ad8b85e851"}
Oct 30 20:07:27.007126 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:27.007054    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-efbac3-openshift-default-844cb4689c-8mzmn" event={"ID":"9cba92db-f8aa-4a79-9b3e-3481fa8b1fbd","Type":"ContainerStarted","Data":"21b5b404bfa81aacce0d4dbbe4e24cea340910a1bb333101b9444e332f04f779"}
Oct 30 20:07:27.009574 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:27.009552    6275 scope.go:122] "RemoveContainer" containerID="ad970cd29845aa6154cbce8c2eff7b3e688e5061bd2d1e716dbc921d42d3caa2"
Oct 30 20:07:27.098407 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:27.098356    6275 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w2-efbac3-openshift-default-844cb4689c-8mzmn" podStartSLOduration=2.098342381 podStartE2EDuration="2.098342381s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:07:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:07:27.097752108 +0000 UTC m=+1157.559479005" watchObservedRunningTime="2026-10-30 20:07:27.098342381 +0000 UTC m=+1157.560069240"
Oct 30 20:07:27.147862 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:27.147825    6275 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w3-912f24/distinct-2-w3-912f24-kserve-566865fdcc-ptx4l"]
Oct 30 20:07:27.152758 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:27.152728    6275 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w3-912f24/distinct-2-w3-912f24-kserve-566865fdcc-ptx4l"]
Oct 30 20:07:27.175118 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:27.175086    6275 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w2-efbac3-openshift-default-844cb4689c-8mzmn"
Oct 30 20:07:27.177606 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:27.177031    6275 patch_prober.go:29] interesting pod/e2e-worker-w2-efbac3-openshift-default-844cb4689c-8mzmn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.109:15021/healthz/ready\": dial tcp 10.134.0.109:15021: connect: connection refused" start-of-body=
Oct 30 20:07:27.177606 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:27.177252    6275 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-efbac3-openshift-default-844cb4689c-8mzmn" podUID="9cba92db-f8aa-4a79-9b3e-3481fa8b1fbd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.109:15021/healthz/ready\": dial tcp 10.134.0.109:15021: connect: connection refused"
Oct 30 20:07:27.200972 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:27.200900    6275 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w3-912f24/simulator-w3-912f24-kserve-59897cf48b-sd5wj"]
Oct 30 20:07:27.210320 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:27.210280    6275 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w3-912f24/simulator-w3-912f24-kserve-59897cf48b-sd5wj"]
Oct 30 20:07:27.337389 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:27.337296    6275 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-worker-w5-626870-7fd9798fc9-njdrh" podUID="17234422-ae1c-4356-8250-afe91f192888" containerName="payload-pre-processing" containerID="cri-o://615d5ab25cfec242f4059f688cf7dcd79178dae79976dc3375ef279474bd8697" gracePeriod=25
Oct 30 20:07:27.659256 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:27.659175    6275 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="b4de6427-0db0-42d9-8b88-6b35d9d4c314" path="/var/lib/kubelet/pods/b4de6427-0db0-42d9-8b88-6b35d9d4c314/volumes"
Oct 30 20:07:27.659924 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:27.659904    6275 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="fcea214a-04a7-4bdd-9695-852f657edfe5" path="/var/lib/kubelet/pods/fcea214a-04a7-4bdd-9695-852f657edfe5/volumes"
Oct 30 20:07:28.187857 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:28.187813    6275 patch_prober.go:29] interesting pod/e2e-worker-w2-efbac3-openshift-default-844cb4689c-8mzmn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.109:15021/healthz/ready\": dial tcp 10.134.0.109:15021: connect: connection refused" start-of-body=
Oct 30 20:07:28.188519 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:28.188480    6275 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-efbac3-openshift-default-844cb4689c-8mzmn" podUID="9cba92db-f8aa-4a79-9b3e-3481fa8b1fbd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.109:15021/healthz/ready\": dial tcp 10.134.0.109:15021: connect: connection refused"
Oct 30 20:07:28.227502 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:28.227462    6275 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-worker-w4-f1f016-6754476fb5-jlhbg" podUID="5bce3c0a-07d6-490e-9506-1600a2278a23" containerName="payload-processing" containerID="cri-o://29ffbd94cf49b45ba3ea3ea225f5581c8d67534fbf513ce978bea34d8c933e1c" gracePeriod=25
Oct 30 20:07:28.289527 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:28.289476    6275 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-f1f016-568d55d755-xjm26" podUID="0b8c41e3-9d0d-400b-839f-f186bcaae886" containerName="payload-pre-processing" containerID="cri-o://77b58f04a9ced73eedeada330e45ae8399a23e6533bfff8b85ea5ca8147ef942" gracePeriod=25
Oct 30 20:07:29.182446 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:29.179763    6275 patch_prober.go:29] interesting pod/e2e-worker-w2-efbac3-openshift-default-844cb4689c-8mzmn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.109:15021/healthz/ready\": dial tcp 10.134.0.109:15021: connect: connection refused" start-of-body=
Oct 30 20:07:29.182446 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:29.179821    6275 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-efbac3-openshift-default-844cb4689c-8mzmn" podUID="9cba92db-f8aa-4a79-9b3e-3481fa8b1fbd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.109:15021/healthz/ready\": dial tcp 10.134.0.109:15021: connect: connection refused"
Oct 30 20:07:29.764464 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:29.756168    6275 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-bcdd07d8-w54ql"]
Oct 30 20:07:29.764464 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:29.757200    6275 cpu_manager.go:414] "containerMap: removing container" podUID="b195a865-3ec2-4556-969e-161d7edfe96d" containerName="revoke-keys"
Oct 30 20:07:29.764464 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:29.757222    6275 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="b195a865-3ec2-4556-969e-161d7edfe96d" containerName="revoke-keys"
Oct 30 20:07:29.764464 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:29.757248    6275 cpu_manager.go:414] "containerMap: removing container" podUID="b4de6427-0db0-42d9-8b88-6b35d9d4c314" containerName="main"
Oct 30 20:07:29.764464 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:29.757256    6275 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="b4de6427-0db0-42d9-8b88-6b35d9d4c314" containerName="main"
Oct 30 20:07:29.764464 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:29.757278    6275 cpu_manager.go:414] "containerMap: removing container" podUID="7058df15-c069-4553-8453-46b806ffb18b" containerName="revoke-keys"
Oct 30 20:07:29.764464 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:29.757286    6275 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="7058df15-c069-4553-8453-46b806ffb18b" containerName="revoke-keys"
Oct 30 20:07:29.764464 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:29.757308    6275 cpu_manager.go:414] "containerMap: removing container" podUID="0382c156-57ff-4ae5-afbb-d2c7683c8272" containerName="revoke-keys"
Oct 30 20:07:29.764464 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:29.757316    6275 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="0382c156-57ff-4ae5-afbb-d2c7683c8272" containerName="revoke-keys"
Oct 30 20:07:29.764464 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:29.757331    6275 cpu_manager.go:414] "containerMap: removing container" podUID="fcea214a-04a7-4bdd-9695-852f657edfe5" containerName="main"
Oct 30 20:07:29.764464 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:29.757339    6275 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="fcea214a-04a7-4bdd-9695-852f657edfe5" containerName="main"
Oct 30 20:07:29.764464 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:29.757530    6275 memory_manager.go:365] "RemoveStaleState removing state" podUID="b195a865-3ec2-4556-969e-161d7edfe96d" containerName="revoke-keys"
Oct 30 20:07:29.764464 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:29.757548    6275 memory_manager.go:365] "RemoveStaleState removing state" podUID="b4de6427-0db0-42d9-8b88-6b35d9d4c314" containerName="main"
Oct 30 20:07:29.764464 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:29.757559    6275 memory_manager.go:365] "RemoveStaleState removing state" podUID="7058df15-c069-4553-8453-46b806ffb18b" containerName="revoke-keys"
Oct 30 20:07:29.764464 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:29.757572    6275 memory_manager.go:365] "RemoveStaleState removing state" podUID="0382c156-57ff-4ae5-afbb-d2c7683c8272" containerName="revoke-keys"
Oct 30 20:07:29.764464 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:29.757584    6275 memory_manager.go:365] "RemoveStaleState removing state" podUID="fcea214a-04a7-4bdd-9695-852f657edfe5" containerName="main"
Oct 30 20:07:29.906440 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:29.880607    6275 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-bcdd07d8-w54ql"
Oct 30 20:07:29.930610 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:29.929607    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mk7tn\" (UniqueName: \"kubernetes.io/projected/4d8499e4-5a30-454c-b2e0-47f47651220f-kube-api-access-mk7tn\") pod \"maas-api-revoke-sub-bcdd07d8-w54ql\" (UID: \"4d8499e4-5a30-454c-b2e0-47f47651220f\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-bcdd07d8-w54ql"
Oct 30 20:07:29.930610 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:29.929719    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/4d8499e4-5a30-454c-b2e0-47f47651220f-maas-api-xks-ca\") pod \"maas-api-revoke-sub-bcdd07d8-w54ql\" (UID: \"4d8499e4-5a30-454c-b2e0-47f47651220f\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-bcdd07d8-w54ql"
Oct 30 20:07:29.930610 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:29.929794    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/4d8499e4-5a30-454c-b2e0-47f47651220f-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-bcdd07d8-w54ql\" (UID: \"4d8499e4-5a30-454c-b2e0-47f47651220f\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-bcdd07d8-w54ql"
Oct 30 20:07:30.012441 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:29.988984    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-5f10d2/premium-w1-5f10d2-kserve-644b846669-286m2" podUID="a2ff6903-c1ab-48dd-884b-d119b8ee1ed6" containerName="main" probeResult="failure" output="Get \"https://10.134.0.61:8000/ready\": context deadline exceeded"
Oct 30 20:07:30.033199 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:30.029134    6275 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-scs2w\""
Oct 30 20:07:30.033199 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:30.029875    6275 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\""
Oct 30 20:07:30.037633 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:30.034778    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/4d8499e4-5a30-454c-b2e0-47f47651220f-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-bcdd07d8-w54ql\" (UID: \"4d8499e4-5a30-454c-b2e0-47f47651220f\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-bcdd07d8-w54ql"
Oct 30 20:07:30.037633 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:30.035058    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mk7tn\" (UniqueName: \"kubernetes.io/projected/4d8499e4-5a30-454c-b2e0-47f47651220f-kube-api-access-mk7tn\") pod \"maas-api-revoke-sub-bcdd07d8-w54ql\" (UID: \"4d8499e4-5a30-454c-b2e0-47f47651220f\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-bcdd07d8-w54ql"
Oct 30 20:07:30.037633 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:30.035144    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/4d8499e4-5a30-454c-b2e0-47f47651220f-maas-api-xks-ca\") pod \"maas-api-revoke-sub-bcdd07d8-w54ql\" (UID: \"4d8499e4-5a30-454c-b2e0-47f47651220f\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-bcdd07d8-w54ql"
Oct 30 20:07:30.059635 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:30.039125    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/4d8499e4-5a30-454c-b2e0-47f47651220f-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-bcdd07d8-w54ql\" (UID: \"4d8499e4-5a30-454c-b2e0-47f47651220f\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-bcdd07d8-w54ql"
Oct 30 20:07:30.059635 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:30.040597    6275 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-bcdd07d8-w54ql"]
Oct 30 20:07:30.229101 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:30.229028    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/4d8499e4-5a30-454c-b2e0-47f47651220f-maas-api-xks-ca\") pod \"maas-api-revoke-sub-bcdd07d8-w54ql\" (UID: \"4d8499e4-5a30-454c-b2e0-47f47651220f\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-bcdd07d8-w54ql"
Oct 30 20:07:30.233045 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:30.232588    6275 patch_prober.go:29] interesting pod/e2e-worker-w2-efbac3-openshift-default-844cb4689c-8mzmn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.109:15021/healthz/ready\": dial tcp 10.134.0.109:15021: connect: connection refused" start-of-body=
Oct 30 20:07:30.233045 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:30.232648    6275 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-efbac3-openshift-default-844cb4689c-8mzmn" podUID="9cba92db-f8aa-4a79-9b3e-3481fa8b1fbd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.109:15021/healthz/ready\": dial tcp 10.134.0.109:15021: connect: connection refused"
Oct 30 20:07:30.272458 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:30.246906    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-processing-e2e-worker-w4-f1f016-6754476fb5-jlhbg" podUID="5bce3c0a-07d6-490e-9506-1600a2278a23" containerName="payload-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 30 20:07:30.272458 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:30.252018    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mk7tn\" (UniqueName: \"kubernetes.io/projected/4d8499e4-5a30-454c-b2e0-47f47651220f-kube-api-access-mk7tn\") pod \"maas-api-revoke-sub-bcdd07d8-w54ql\" (UID: \"4d8499e4-5a30-454c-b2e0-47f47651220f\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-bcdd07d8-w54ql"
Oct 30 20:07:30.284515 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:30.283462    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-5f10d2/distinct-w1-5f10d2-kserve-5bf49798b8-l2j84" podUID="9e831c5d-2019-4015-ac57-2b4b1b90b9b3" containerName="main" probeResult="failure" output="Get \"https://10.134.0.69:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:07:30.306693 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:30.306636    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-f1f016-568d55d755-xjm26" podUID="0b8c41e3-9d0d-400b-839f-f186bcaae886" containerName="payload-pre-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 30 20:07:30.388449 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:30.376934    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-626870/distinct-2-w5-626870-kserve-98bfb9b98-xz6xj" podUID="7d49f1ad-8805-4090-8e72-7d828fa73f36" containerName="main" probeResult="failure" output="Get \"https://10.134.0.90:8000/ready\": context deadline exceeded"
Oct 30 20:07:30.400192 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:30.395962    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-51dd62/simulator-w6-51dd62-kserve-d6bb4985f-65j9h" podUID="f7e1ff07-15d6-49b5-8edc-52c9d6825ed7" containerName="main" probeResult="failure" output="Get \"https://10.134.0.56:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:07:30.454815 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:30.454772    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-626870/premium-w5-626870-kserve-5df7f7b5c4-vx59r" podUID="a1adddd4-3218-4a6b-a145-0290bceff76f" containerName="main" probeResult="failure" output="Get \"https://10.134.0.57:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:07:30.459528 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:30.459489    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-f1f016/distinct-2-w4-f1f016-kserve-69f97f4b78-4m64r" podUID="96f19e7c-d36d-4109-bde0-24725bc670dd" containerName="main" probeResult="failure" output="Get \"https://10.134.0.99:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:07:30.500968 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:30.500937    6275 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-bcdd07d8-w54ql"
Oct 30 20:07:30.808553 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:30.808499    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-f1f016/distinct-w4-f1f016-kserve-79fbfbdbf7-hswb7" podUID="7b6639ea-72b0-49fb-b7fa-9443c1ddff6d" containerName="main" probeResult="failure" output="Get \"https://10.134.0.86:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:07:30.858337 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:30.858207    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-f1f016/simulator-w4-f1f016-kserve-55db8447ff-749tw" podUID="8f3174b6-2fdc-48c2-99be-7a966731f018" containerName="main" probeResult="failure" output="Get \"https://10.134.0.55:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:07:30.866227 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:30.866189    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-f1f016/premium-w4-f1f016-kserve-55d6bd678b-w5hkc" podUID="0e543ba9-1e7a-4d0a-9361-50c98060e824" containerName="main" probeResult="failure" output="Get \"https://10.134.0.60:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:07:30.867687 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:30.867642    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-efbac3/premium-w2-efbac3-kserve-55f54cfff6-9fqbz" podUID="083136dc-91fb-454f-a782-87b004e73d1b" containerName="main" probeResult="failure" output="Get \"https://10.134.0.59:8000/ready\": context deadline exceeded"
Oct 30 20:07:31.028830 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:31.028772    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-5f10d2/premium-w1-5f10d2-kserve-644b846669-286m2" podUID="a2ff6903-c1ab-48dd-884b-d119b8ee1ed6" containerName="main" probeResult="failure" output="Get \"https://10.134.0.61:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:07:31.031159 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:31.031114    6275 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w1-5f10d2/premium-w1-5f10d2-kserve-644b846669-286m2"
Oct 30 20:07:31.210040 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:31.209948    6275 patch_prober.go:29] interesting pod/e2e-worker-w2-efbac3-openshift-default-844cb4689c-8mzmn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.109:15021/healthz/ready\": dial tcp 10.134.0.109:15021: connect: connection refused" start-of-body=
Oct 30 20:07:31.210328 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:31.210299    6275 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-efbac3-openshift-default-844cb4689c-8mzmn" podUID="9cba92db-f8aa-4a79-9b3e-3481fa8b1fbd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.109:15021/healthz/ready\": dial tcp 10.134.0.109:15021: connect: connection refused"
Oct 30 20:07:31.398577 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:31.398528    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-51dd62/simulator-w6-51dd62-kserve-d6bb4985f-65j9h" podUID="f7e1ff07-15d6-49b5-8edc-52c9d6825ed7" containerName="main" probeResult="failure" output="Get \"https://10.134.0.56:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:07:31.399477 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:31.399452    6275 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w6-51dd62/simulator-w6-51dd62-kserve-d6bb4985f-65j9h"
Oct 30 20:07:31.469599 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:31.469297    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-626870/premium-w5-626870-kserve-5df7f7b5c4-vx59r" podUID="a1adddd4-3218-4a6b-a145-0290bceff76f" containerName="main" probeResult="failure" output="Get \"https://10.134.0.57:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:07:31.492444 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:31.484157    6275 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w5-626870/premium-w5-626870-kserve-5df7f7b5c4-vx59r"
Oct 30 20:07:31.492444 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:31.482893    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-f1f016/distinct-2-w4-f1f016-kserve-69f97f4b78-4m64r" podUID="96f19e7c-d36d-4109-bde0-24725bc670dd" containerName="main" probeResult="failure" output="Get \"https://10.134.0.99:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:07:31.522451 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:31.500730    6275 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w4-f1f016/distinct-2-w4-f1f016-kserve-69f97f4b78-4m64r"
Oct 30 20:07:31.678437 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:31.662773    6275 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w5-626870/premium-w5-626870-kserve-5df7f7b5c4-vx59r" podUID="a1adddd4-3218-4a6b-a145-0290bceff76f" containerName="main" containerID="cri-o://0f80c1ca2254257e0095a7129328cc8407e7dda1b5481f55b17cff1e59bf5abb" gracePeriod=45
Oct 30 20:07:31.708440 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:31.708301    6275 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w5-626870/distinct-2-w5-626870-kserve-98bfb9b98-xz6xj" podUID="7d49f1ad-8805-4090-8e72-7d828fa73f36" containerName="main" containerID="cri-o://22a924bb9db00bd2defbd1d7fa4ffe3ed03412c3a6c334c32c8b7583982d06f3" gracePeriod=45
Oct 30 20:07:31.810734 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:31.810684    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-f1f016/distinct-w4-f1f016-kserve-79fbfbdbf7-hswb7" podUID="7b6639ea-72b0-49fb-b7fa-9443c1ddff6d" containerName="main" probeResult="failure" output="Get \"https://10.134.0.86:8000/ready\": context deadline exceeded"
Oct 30 20:07:31.878367 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:31.878329    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-f1f016/simulator-w4-f1f016-kserve-55db8447ff-749tw" podUID="8f3174b6-2fdc-48c2-99be-7a966731f018" containerName="main" probeResult="failure" output="Get \"https://10.134.0.55:8000/ready\": context deadline exceeded"
Oct 30 20:07:31.890504 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:31.888461    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-f1f016/premium-w4-f1f016-kserve-55d6bd678b-w5hkc" podUID="0e543ba9-1e7a-4d0a-9361-50c98060e824" containerName="main" probeResult="failure" output="Get \"https://10.134.0.60:8000/ready\": context deadline exceeded"
Oct 30 20:07:31.947447 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:31.907652    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-efbac3/premium-w2-efbac3-kserve-55f54cfff6-9fqbz" podUID="083136dc-91fb-454f-a782-87b004e73d1b" containerName="main" probeResult="failure" output="Get \"https://10.134.0.59:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:07:31.947447 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:31.942969    6275 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w4-f1f016/distinct-w4-f1f016-kserve-79fbfbdbf7-hswb7"
Oct 30 20:07:31.947447 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:31.943032    6275 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w4-f1f016/simulator-w4-f1f016-kserve-55db8447ff-749tw"
Oct 30 20:07:31.947447 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:31.943066    6275 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w4-f1f016/premium-w4-f1f016-kserve-55d6bd678b-w5hkc"
Oct 30 20:07:31.947447 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:31.943097    6275 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w2-efbac3/premium-w2-efbac3-kserve-55f54cfff6-9fqbz"
Oct 30 20:07:32.033967 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:32.033507    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-5f10d2/premium-w1-5f10d2-kserve-644b846669-286m2" podUID="a2ff6903-c1ab-48dd-884b-d119b8ee1ed6" containerName="main" probeResult="failure" output="Get \"https://10.134.0.61:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:07:32.440781 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:32.440659    6275 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w4-f1f016/simulator-w4-f1f016-kserve-55db8447ff-749tw" podUID="8f3174b6-2fdc-48c2-99be-7a966731f018" containerName="main" containerID="cri-o://3c2cf123f97b0e961608d423227ed48d17216fe829d88bf5d93109e4c127f48f" gracePeriod=45
Oct 30 20:07:32.441219 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:32.441194    6275 patch_prober.go:29] interesting pod/e2e-worker-w2-efbac3-openshift-default-844cb4689c-8mzmn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.109:15021/healthz/ready\": dial tcp 10.134.0.109:15021: connect: connection refused" start-of-body=
Oct 30 20:07:32.441390 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:32.441367    6275 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-efbac3-openshift-default-844cb4689c-8mzmn" podUID="9cba92db-f8aa-4a79-9b3e-3481fa8b1fbd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.109:15021/healthz/ready\": dial tcp 10.134.0.109:15021: connect: connection refused"
Oct 30 20:07:32.441999 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:32.441974    6275 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w4-f1f016/distinct-2-w4-f1f016-kserve-69f97f4b78-4m64r" podUID="96f19e7c-d36d-4109-bde0-24725bc670dd" containerName="main" containerID="cri-o://d9d817f395f85aa38f6303f7cd4eb85f4d67b0715806f0708c2d37d0d2b9aea7" gracePeriod=45
Oct 30 20:07:32.442785 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:32.442529    6275 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w6-51dd62/distinct-2-w6-51dd62-kserve-79ff99c4cd-fvmb6"
Oct 30 20:07:32.486719 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:32.443780    6275 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w4-f1f016/premium-w4-f1f016-kserve-55d6bd678b-w5hkc" podUID="0e543ba9-1e7a-4d0a-9361-50c98060e824" containerName="main" containerID="cri-o://da18fd21350a4dca4f626fe8f7fff73059f1d032c43a29a2ac53a369793057be" gracePeriod=45
Oct 30 20:07:32.486719 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:32.444653    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-51dd62/simulator-w6-51dd62-kserve-d6bb4985f-65j9h" podUID="f7e1ff07-15d6-49b5-8edc-52c9d6825ed7" containerName="main" probeResult="failure" output="Get \"https://10.134.0.56:8000/ready\": context deadline exceeded"
Oct 30 20:07:32.486719 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:32.483766    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-626870/premium-w5-626870-kserve-5df7f7b5c4-vx59r" podUID="a1adddd4-3218-4a6b-a145-0290bceff76f" containerName="main" probeResult="failure" output="Get \"https://10.134.0.57:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:07:32.487666 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:32.487324    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-626870/distinct-2-w5-626870-kserve-98bfb9b98-xz6xj" podUID="7d49f1ad-8805-4090-8e72-7d828fa73f36" containerName="main" probeResult="failure" output="Get \"https://10.134.0.90:8000/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:07:32.520065 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:32.487922    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-626870/distinct-2-w5-626870-kserve-98bfb9b98-xz6xj" podUID="7d49f1ad-8805-4090-8e72-7d828fa73f36" containerName="main" probeResult="failure" output="Get \"https://10.134.0.90:8000/ready\": dial tcp 10.134.0.90:8000: connect: connection refused"
Oct 30 20:07:32.520065 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:32.511926    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-f1f016/distinct-2-w4-f1f016-kserve-69f97f4b78-4m64r" podUID="96f19e7c-d36d-4109-bde0-24725bc670dd" containerName="main" probeResult="failure" output="Get \"https://10.134.0.99:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:07:32.520065 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:32.517982    6275 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w5-626870/distinct-2-w5-626870-kserve-98bfb9b98-xz6xj"
Oct 30 20:07:32.828906 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:32.828840    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-f1f016/distinct-w4-f1f016-kserve-79fbfbdbf7-hswb7" podUID="7b6639ea-72b0-49fb-b7fa-9443c1ddff6d" containerName="main" probeResult="failure" output="Get \"https://10.134.0.86:8000/ready\": context deadline exceeded"
Oct 30 20:07:32.916439 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:32.882373    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-f1f016/simulator-w4-f1f016-kserve-55db8447ff-749tw" podUID="8f3174b6-2fdc-48c2-99be-7a966731f018" containerName="main" probeResult="failure" output="Get \"https://10.134.0.55:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:07:33.019653 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:32.931529    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-f1f016/premium-w4-f1f016-kserve-55d6bd678b-w5hkc" podUID="0e543ba9-1e7a-4d0a-9361-50c98060e824" containerName="main" probeResult="failure" output="Get \"https://10.134.0.60:8000/ready\": context deadline exceeded"
Oct 30 20:07:33.019653 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:32.934661    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-efbac3/premium-w2-efbac3-kserve-55f54cfff6-9fqbz" podUID="083136dc-91fb-454f-a782-87b004e73d1b" containerName="main" probeResult="failure" output="Get \"https://10.134.0.59:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:07:33.060742 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:33.036060    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-5f10d2/premium-w1-5f10d2-kserve-644b846669-286m2" podUID="a2ff6903-c1ab-48dd-884b-d119b8ee1ed6" containerName="main" probeResult="failure" output="Get \"https://10.134.0.61:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:07:33.377440 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:33.363857    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-5f10d2/distinct-w1-5f10d2-kserve-5bf49798b8-l2j84" podUID="9e831c5d-2019-4015-ac57-2b4b1b90b9b3" containerName="main" probeResult="failure" output="Get \"https://10.134.0.69:8000/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:07:33.378959 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:33.377784    6275 patch_prober.go:29] interesting pod/e2e-worker-w2-efbac3-openshift-default-844cb4689c-8mzmn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.109:15021/healthz/ready\": dial tcp 10.134.0.109:15021: connect: connection refused" start-of-body=
Oct 30 20:07:33.378959 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:33.377846    6275 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-efbac3-openshift-default-844cb4689c-8mzmn" podUID="9cba92db-f8aa-4a79-9b3e-3481fa8b1fbd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.109:15021/healthz/ready\": dial tcp 10.134.0.109:15021: connect: connection refused"
Oct 30 20:07:33.378959 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:33.378390    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-626870/distinct-2-w5-626870-kserve-98bfb9b98-xz6xj" podUID="7d49f1ad-8805-4090-8e72-7d828fa73f36" containerName="main" probeResult="failure" output="Get \"https://10.134.0.90:8000/ready\": dial tcp 10.134.0.90:8000: connect: connection refused"
Oct 30 20:07:33.407782 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:33.407731    6275 prober.go:122] "Probe failed" probeType="Startup" pod="e2e-models-e2e-worker-w6-51dd62/distinct-2-w6-51dd62-kserve-79ff99c4cd-fvmb6" podUID="9ed906a7-869d-4314-9976-f50b78a6565b" containerName="main" probeResult="failure" output="Get \"https://10.134.0.105:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:07:33.446008 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:33.445960    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-51dd62/simulator-w6-51dd62-kserve-d6bb4985f-65j9h" podUID="f7e1ff07-15d6-49b5-8edc-52c9d6825ed7" containerName="main" probeResult="failure" output="Get \"https://10.134.0.56:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:07:33.484344 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:33.484297    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-626870/premium-w5-626870-kserve-5df7f7b5c4-vx59r" podUID="a1adddd4-3218-4a6b-a145-0290bceff76f" containerName="main" probeResult="failure" output="Get \"https://10.134.0.57:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:07:33.486751 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:33.486723    6275 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w4-f1f016/distinct-w4-f1f016-kserve-79fbfbdbf7-hswb7"
Oct 30 20:07:33.517099 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:33.517049    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-f1f016/distinct-2-w4-f1f016-kserve-69f97f4b78-4m64r" podUID="96f19e7c-d36d-4109-bde0-24725bc670dd" containerName="main" probeResult="failure" output="Get \"https://10.134.0.99:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:07:33.555119 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:33.554425    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-f1f016/distinct-2-w4-f1f016-kserve-69f97f4b78-4m64r" podUID="96f19e7c-d36d-4109-bde0-24725bc670dd" containerName="main" probeResult="failure" output="Get \"https://10.134.0.99:8000/ready\": read tcp 10.134.0.2:37794->10.134.0.99:8000: read: connection reset by peer"
Oct 30 20:07:33.950747 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:33.950700    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-f1f016/premium-w4-f1f016-kserve-55d6bd678b-w5hkc" podUID="0e543ba9-1e7a-4d0a-9361-50c98060e824" containerName="main" probeResult="failure" output="Get \"https://10.134.0.60:8000/ready\": context deadline exceeded"
Oct 30 20:07:33.952292 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:33.952251    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-efbac3/premium-w2-efbac3-kserve-55f54cfff6-9fqbz" podUID="083136dc-91fb-454f-a782-87b004e73d1b" containerName="main" probeResult="failure" output="Get \"https://10.134.0.59:8000/ready\": context deadline exceeded"
Oct 30 20:07:34.091028 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:34.062649    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-5f10d2/premium-w1-5f10d2-kserve-644b846669-286m2" podUID="a2ff6903-c1ab-48dd-884b-d119b8ee1ed6" containerName="main" probeResult="failure" output="Get \"https://10.134.0.61:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:07:34.091028 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:34.065956    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-f1f016/simulator-w4-f1f016-kserve-55db8447ff-749tw" podUID="8f3174b6-2fdc-48c2-99be-7a966731f018" containerName="main" probeResult="failure" output="Get \"https://10.134.0.55:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:07:34.190440 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:34.176674    6275 patch_prober.go:29] interesting pod/e2e-worker-w2-efbac3-openshift-default-844cb4689c-8mzmn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.109:15021/healthz/ready\": dial tcp 10.134.0.109:15021: connect: connection refused" start-of-body=
Oct 30 20:07:34.190440 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:34.176734    6275 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-efbac3-openshift-default-844cb4689c-8mzmn" podUID="9cba92db-f8aa-4a79-9b3e-3481fa8b1fbd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.109:15021/healthz/ready\": dial tcp 10.134.0.109:15021: connect: connection refused"
Oct 30 20:07:34.190440 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:34.184916    6275 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w4-f1f016/distinct-w4-f1f016-kserve-79fbfbdbf7-hswb7" podUID="7b6639ea-72b0-49fb-b7fa-9443c1ddff6d" containerName="main" containerID="cri-o://71e3b30b0a4e9db23c724f202ba676ddc248495f9cb9629afcc0ba3d6b23aa50" gracePeriod=43
Oct 30 20:07:34.367492 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:34.327567    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-worker-w5-626870-7fd9798fc9-njdrh" podUID="17234422-ae1c-4356-8250-afe91f192888" containerName="payload-pre-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 30 20:07:34.406756 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:34.406717    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-f1f016/distinct-w4-f1f016-kserve-79fbfbdbf7-hswb7" podUID="7b6639ea-72b0-49fb-b7fa-9443c1ddff6d" containerName="main" probeResult="failure" output="Get \"https://10.134.0.86:8000/ready\": read tcp 10.134.0.2:45230->10.134.0.86:8000: read: connection reset by peer"
Oct 30 20:07:34.476440 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:34.440382    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-5f10d2/distinct-w1-5f10d2-kserve-5bf49798b8-l2j84" podUID="9e831c5d-2019-4015-ac57-2b4b1b90b9b3" containerName="main" probeResult="failure" output="Get \"https://10.134.0.69:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:07:34.476440 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:34.441033    6275 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w1-5f10d2/distinct-w1-5f10d2-kserve-5bf49798b8-l2j84"
Oct 30 20:07:34.476440 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:34.442976    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-626870/distinct-2-w5-626870-kserve-98bfb9b98-xz6xj" podUID="7d49f1ad-8805-4090-8e72-7d828fa73f36" containerName="main" probeResult="failure" output="Get \"https://10.134.0.90:8000/ready\": dial tcp 10.134.0.90:8000: connect: connection refused"
Oct 30 20:07:34.539612 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:34.539569    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-51dd62/simulator-w6-51dd62-kserve-d6bb4985f-65j9h" podUID="f7e1ff07-15d6-49b5-8edc-52c9d6825ed7" containerName="main" probeResult="failure" output="Get \"https://10.134.0.56:8000/ready\": context deadline exceeded"
Oct 30 20:07:34.567515 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:34.540984    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-f1f016/distinct-2-w4-f1f016-kserve-69f97f4b78-4m64r" podUID="96f19e7c-d36d-4109-bde0-24725bc670dd" containerName="main" probeResult="failure" output="Get \"https://10.134.0.99:8000/ready\": dial tcp 10.134.0.99:8000: connect: connection refused"
Oct 30 20:07:34.567769 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:34.541237    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-626870/premium-w5-626870-kserve-5df7f7b5c4-vx59r" podUID="a1adddd4-3218-4a6b-a145-0290bceff76f" containerName="main" probeResult="failure" output="Get \"https://10.134.0.57:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:07:34.687626 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:34.682257    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-bcdd07d8-w54ql" event={"ID":"4d8499e4-5a30-454c-b2e0-47f47651220f","Type":"ContainerStarted","Data":"778471768b32aba5353e1224d071d2b512e74cfc8ed1df6900c434b41d9ac68b"}
Oct 30 20:07:34.743178 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:34.735646    6275 patch_prober.go:29] interesting pod/e2e-worker-w5-626870-openshift-default-7cd649d59c-74vj7 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.83:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 20:07:34.743178 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:34.735721    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w5-626870-openshift-default-7cd649d59c-74vj7" podUID="f35ca7ba-e2b8-4e65-bc7b-0051dea979e8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.83:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:07:34.791461 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:34.789722    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-f1f016/distinct-w4-f1f016-kserve-79fbfbdbf7-hswb7" podUID="7b6639ea-72b0-49fb-b7fa-9443c1ddff6d" containerName="main" probeResult="failure" output="Get \"https://10.134.0.86:8000/ready\": dial tcp 10.134.0.86:8000: connect: connection refused"
Oct 30 20:07:34.791461 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:34.789845    6275 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w4-f1f016/distinct-w4-f1f016-kserve-79fbfbdbf7-hswb7"
Oct 30 20:07:34.835452 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:34.831629    6275 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-bcdd07d8-w54ql"]
Oct 30 20:07:34.913502 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:34.913397    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-626870/premium-w5-626870-kserve-5df7f7b5c4-vx59r" podUID="a1adddd4-3218-4a6b-a145-0290bceff76f" containerName="main" probeResult="failure" output="Get \"https://10.134.0.57:8000/ready\": read tcp 10.134.0.2:58258->10.134.0.57:8000: read: connection reset by peer"
Oct 30 20:07:34.951828 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:34.951691    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-f1f016/premium-w4-f1f016-kserve-55d6bd678b-w5hkc" podUID="0e543ba9-1e7a-4d0a-9361-50c98060e824" containerName="main" probeResult="failure" output="Get \"https://10.134.0.60:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:07:34.954141 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:34.952496    6275 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w1-5f10d2/distinct-w1-5f10d2-kserve-5bf49798b8-l2j84"
Oct 30 20:07:34.954141 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:34.953005    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-efbac3/premium-w2-efbac3-kserve-55f54cfff6-9fqbz" podUID="083136dc-91fb-454f-a782-87b004e73d1b" containerName="main" probeResult="failure" output="Get \"https://10.134.0.59:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:07:34.961737 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:34.961254    6275 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w1-5f10d2/premium-w1-5f10d2-kserve-644b846669-286m2"
Oct 30 20:07:35.047706 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:35.047670    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-f1f016/premium-w4-f1f016-kserve-55d6bd678b-w5hkc" podUID="0e543ba9-1e7a-4d0a-9361-50c98060e824" containerName="main" probeResult="failure" output="Get \"https://10.134.0.60:8000/ready\": read tcp 10.134.0.2:58948->10.134.0.60:8000: read: connection reset by peer"
Oct 30 20:07:35.067122 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:35.066081    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-f1f016/simulator-w4-f1f016-kserve-55db8447ff-749tw" podUID="8f3174b6-2fdc-48c2-99be-7a966731f018" containerName="main" probeResult="failure" output="Get \"https://10.134.0.55:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:07:35.120117 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:35.069516    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-f1f016/simulator-w4-f1f016-kserve-55db8447ff-749tw" podUID="8f3174b6-2fdc-48c2-99be-7a966731f018" containerName="main" probeResult="failure" output="Get \"https://10.134.0.55:8000/ready\": dial tcp 10.134.0.55:8000: connect: connection refused"
Oct 30 20:07:35.162430 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:35.137696    6275 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w2-efbac3/premium-w2-efbac3-kserve-55f54cfff6-9fqbz"
Oct 30 20:07:35.162430 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:35.160668    6275 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w6-51dd62/simulator-w6-51dd62-kserve-d6bb4985f-65j9h"
Oct 30 20:07:35.216453 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:35.208052    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-worker-w3-912f24-585f6bf47-q7hqs" podUID="8b04ae86-d3b8-4e51-b357-25e38742b02f" containerName="payload-pre-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 30 20:07:35.219001 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:35.218625    6275 patch_prober.go:29] interesting pod/e2e-worker-w2-efbac3-openshift-default-844cb4689c-8mzmn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.109:15021/healthz/ready\": dial tcp 10.134.0.109:15021: connect: connection refused" start-of-body=
Oct 30 20:07:35.219001 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:35.218680    6275 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-efbac3-openshift-default-844cb4689c-8mzmn" podUID="9cba92db-f8aa-4a79-9b3e-3481fa8b1fbd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.109:15021/healthz/ready\": dial tcp 10.134.0.109:15021: connect: connection refused"
Oct 30 20:07:35.249143 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:35.244659    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-processing-e2e-worker-w3-912f24-7bd864565f-fvnth" podUID="72b9ada9-738c-4c37-96f4-5f827abdf99e" containerName="payload-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 30 20:07:35.363856 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:35.358447    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-626870/distinct-2-w5-626870-kserve-98bfb9b98-xz6xj" podUID="7d49f1ad-8805-4090-8e72-7d828fa73f36" containerName="main" probeResult="failure" output="Get \"https://10.134.0.90:8000/ready\": dial tcp 10.134.0.90:8000: connect: connection refused"
Oct 30 20:07:35.437633 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:35.437552    6275 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w1-5f10d2-gzczw"]
Oct 30 20:07:35.448480 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:35.448384    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-626870/premium-w5-626870-kserve-5df7f7b5c4-vx59r" podUID="a1adddd4-3218-4a6b-a145-0290bceff76f" containerName="main" probeResult="failure" output="Get \"https://10.134.0.57:8000/ready\": dial tcp 10.134.0.57:8000: connect: connection refused"
Oct 30 20:07:35.448869 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:35.448834    6275 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w1-5f10d2-gzczw"]
Oct 30 20:07:35.449030 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:35.448954    6275 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w1-5f10d2-gzczw"
Oct 30 20:07:35.464433 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:35.460155    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-f1f016/distinct-2-w4-f1f016-kserve-69f97f4b78-4m64r" podUID="96f19e7c-d36d-4109-bde0-24725bc670dd" containerName="main" probeResult="failure" output="Get \"https://10.134.0.99:8000/ready\": dial tcp 10.134.0.99:8000: connect: connection refused"
Oct 30 20:07:35.571755 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:35.571710    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qjp7z\" (UniqueName: \"kubernetes.io/projected/803f3028-5e38-40f3-baa2-dd3fee4093e8-kube-api-access-qjp7z\") pod \"maas-api-revoke-keys-e2e-worker-w1-5f10d2-gzczw\" (UID: \"803f3028-5e38-40f3-baa2-dd3fee4093e8\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w1-5f10d2-gzczw"
Oct 30 20:07:35.571915 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:35.571886    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/803f3028-5e38-40f3-baa2-dd3fee4093e8-maas-api-xks-ca\") pod \"maas-api-revoke-keys-e2e-worker-w1-5f10d2-gzczw\" (UID: \"803f3028-5e38-40f3-baa2-dd3fee4093e8\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w1-5f10d2-gzczw"
Oct 30 20:07:35.572005 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:35.571986    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/803f3028-5e38-40f3-baa2-dd3fee4093e8-maas-api-openshift-ca\") pod \"maas-api-revoke-keys-e2e-worker-w1-5f10d2-gzczw\" (UID: \"803f3028-5e38-40f3-baa2-dd3fee4093e8\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w1-5f10d2-gzczw"
Oct 30 20:07:35.652099 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:35.652071    6275 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-f1f016/simulator-w4-f1f016-kserve-55db8447ff-749tw"
Oct 30 20:07:35.707688 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:35.705302    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qjp7z\" (UniqueName: \"kubernetes.io/projected/803f3028-5e38-40f3-baa2-dd3fee4093e8-kube-api-access-qjp7z\") pod \"maas-api-revoke-keys-e2e-worker-w1-5f10d2-gzczw\" (UID: \"803f3028-5e38-40f3-baa2-dd3fee4093e8\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w1-5f10d2-gzczw"
Oct 30 20:07:35.707688 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:35.705471    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/803f3028-5e38-40f3-baa2-dd3fee4093e8-maas-api-xks-ca\") pod \"maas-api-revoke-keys-e2e-worker-w1-5f10d2-gzczw\" (UID: \"803f3028-5e38-40f3-baa2-dd3fee4093e8\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w1-5f10d2-gzczw"
Oct 30 20:07:35.707688 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:35.705571    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/803f3028-5e38-40f3-baa2-dd3fee4093e8-maas-api-openshift-ca\") pod \"maas-api-revoke-keys-e2e-worker-w1-5f10d2-gzczw\" (UID: \"803f3028-5e38-40f3-baa2-dd3fee4093e8\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w1-5f10d2-gzczw"
Oct 30 20:07:35.707688 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:35.706480    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/803f3028-5e38-40f3-baa2-dd3fee4093e8-maas-api-openshift-ca\") pod \"maas-api-revoke-keys-e2e-worker-w1-5f10d2-gzczw\" (UID: \"803f3028-5e38-40f3-baa2-dd3fee4093e8\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w1-5f10d2-gzczw"
Oct 30 20:07:35.711219 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:35.711190    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/803f3028-5e38-40f3-baa2-dd3fee4093e8-maas-api-xks-ca\") pod \"maas-api-revoke-keys-e2e-worker-w1-5f10d2-gzczw\" (UID: \"803f3028-5e38-40f3-baa2-dd3fee4093e8\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w1-5f10d2-gzczw"
Oct 30 20:07:35.721538 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:35.721505    6275 generic.go:356] "Generic (PLEG): container finished" podID="7d49f1ad-8805-4090-8e72-7d828fa73f36" containerID="22a924bb9db00bd2defbd1d7fa4ffe3ed03412c3a6c334c32c8b7583982d06f3" exitCode=0
Oct 30 20:07:35.728998 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:35.728970    6275 generic.go:356] "Generic (PLEG): container finished" podID="a1adddd4-3218-4a6b-a145-0290bceff76f" containerID="0f80c1ca2254257e0095a7129328cc8407e7dda1b5481f55b17cff1e59bf5abb" exitCode=0
Oct 30 20:07:35.730866 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:35.730840    6275 generic.go:356] "Generic (PLEG): container finished" podID="7b6639ea-72b0-49fb-b7fa-9443c1ddff6d" containerID="71e3b30b0a4e9db23c724f202ba676ddc248495f9cb9629afcc0ba3d6b23aa50" exitCode=0
Oct 30 20:07:35.732552 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:35.732527    6275 generic.go:356] "Generic (PLEG): container finished" podID="4d8499e4-5a30-454c-b2e0-47f47651220f" containerID="6e874a0974e31f90fc0b5029c0a892b0eed64c39561797aeeb59c5277e72809d" exitCode=0
Oct 30 20:07:35.733182 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:35.733102    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qjp7z\" (UniqueName: \"kubernetes.io/projected/803f3028-5e38-40f3-baa2-dd3fee4093e8-kube-api-access-qjp7z\") pod \"maas-api-revoke-keys-e2e-worker-w1-5f10d2-gzczw\" (UID: \"803f3028-5e38-40f3-baa2-dd3fee4093e8\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w1-5f10d2-gzczw"
Oct 30 20:07:35.734558 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:35.734291    6275 generic.go:356] "Generic (PLEG): container finished" podID="8f3174b6-2fdc-48c2-99be-7a966731f018" containerID="3c2cf123f97b0e961608d423227ed48d17216fe829d88bf5d93109e4c127f48f" exitCode=0
Oct 30 20:07:35.734558 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:35.734398    6275 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-f1f016/simulator-w4-f1f016-kserve-55db8447ff-749tw"
Oct 30 20:07:35.736247 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:35.736217    6275 generic.go:356] "Generic (PLEG): container finished" podID="0e543ba9-1e7a-4d0a-9361-50c98060e824" containerID="da18fd21350a4dca4f626fe8f7fff73059f1d032c43a29a2ac53a369793057be" exitCode=0
Oct 30 20:07:35.736458 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:35.736436    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w5-626870/distinct-2-w5-626870-kserve-98bfb9b98-xz6xj" event={"ID":"7d49f1ad-8805-4090-8e72-7d828fa73f36","Type":"ContainerDied","Data":"22a924bb9db00bd2defbd1d7fa4ffe3ed03412c3a6c334c32c8b7583982d06f3"}
Oct 30 20:07:35.736562 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:35.736478    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w5-626870/premium-w5-626870-kserve-5df7f7b5c4-vx59r" event={"ID":"a1adddd4-3218-4a6b-a145-0290bceff76f","Type":"ContainerDied","Data":"0f80c1ca2254257e0095a7129328cc8407e7dda1b5481f55b17cff1e59bf5abb"}
Oct 30 20:07:35.736562 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:35.736499    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-f1f016/distinct-w4-f1f016-kserve-79fbfbdbf7-hswb7" event={"ID":"7b6639ea-72b0-49fb-b7fa-9443c1ddff6d","Type":"ContainerDied","Data":"71e3b30b0a4e9db23c724f202ba676ddc248495f9cb9629afcc0ba3d6b23aa50"}
Oct 30 20:07:35.736562 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:35.736517    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-f1f016/distinct-w4-f1f016-kserve-79fbfbdbf7-hswb7" event={"ID":"7b6639ea-72b0-49fb-b7fa-9443c1ddff6d","Type":"ContainerDied","Data":"d2a638de4595f4573d145cea701727572b8c7cc503d470c5ee75949e9f2a9605"}
Oct 30 20:07:35.736562 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:35.736533    6275 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d2a638de4595f4573d145cea701727572b8c7cc503d470c5ee75949e9f2a9605"
Oct 30 20:07:35.736562 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:35.736544    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-bcdd07d8-w54ql" event={"ID":"4d8499e4-5a30-454c-b2e0-47f47651220f","Type":"ContainerDied","Data":"6e874a0974e31f90fc0b5029c0a892b0eed64c39561797aeeb59c5277e72809d"}
Oct 30 20:07:35.736786 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:35.736575    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-f1f016/simulator-w4-f1f016-kserve-55db8447ff-749tw" event={"ID":"8f3174b6-2fdc-48c2-99be-7a966731f018","Type":"ContainerDied","Data":"3c2cf123f97b0e961608d423227ed48d17216fe829d88bf5d93109e4c127f48f"}
Oct 30 20:07:35.736786 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:35.736594    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-f1f016/simulator-w4-f1f016-kserve-55db8447ff-749tw" event={"ID":"8f3174b6-2fdc-48c2-99be-7a966731f018","Type":"ContainerDied","Data":"c5c1e4726b75eda5f9006cf02a8db3cf2e5e5aeb30f799ca595b6a05e0dbdabb"}
Oct 30 20:07:35.736786 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:35.736610    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-f1f016/premium-w4-f1f016-kserve-55d6bd678b-w5hkc" event={"ID":"0e543ba9-1e7a-4d0a-9361-50c98060e824","Type":"ContainerDied","Data":"da18fd21350a4dca4f626fe8f7fff73059f1d032c43a29a2ac53a369793057be"}
Oct 30 20:07:35.736786 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:35.736633    6275 scope.go:122] "RemoveContainer" containerID="3c2cf123f97b0e961608d423227ed48d17216fe829d88bf5d93109e4c127f48f"
Oct 30 20:07:35.758341 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:35.756574    6275 generic.go:356] "Generic (PLEG): container finished" podID="96f19e7c-d36d-4109-bde0-24725bc670dd" containerID="d9d817f395f85aa38f6303f7cd4eb85f4d67b0715806f0708c2d37d0d2b9aea7" exitCode=0
Oct 30 20:07:35.758341 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:35.757793    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-f1f016/distinct-2-w4-f1f016-kserve-69f97f4b78-4m64r" event={"ID":"96f19e7c-d36d-4109-bde0-24725bc670dd","Type":"ContainerDied","Data":"d9d817f395f85aa38f6303f7cd4eb85f4d67b0715806f0708c2d37d0d2b9aea7"}
Oct 30 20:07:35.763026 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:35.763003    6275 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-f1f016/distinct-w4-f1f016-kserve-79fbfbdbf7-hswb7"
Oct 30 20:07:35.815466 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:35.812244    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/8f3174b6-2fdc-48c2-99be-7a966731f018-tls-certs\" (UniqueName: \"kubernetes.io/secret/8f3174b6-2fdc-48c2-99be-7a966731f018-tls-certs\") pod \"8f3174b6-2fdc-48c2-99be-7a966731f018\" (UID: \"8f3174b6-2fdc-48c2-99be-7a966731f018\") "
Oct 30 20:07:35.815466 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:35.812507    6275 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w1-5f10d2-gzczw"
Oct 30 20:07:35.815466 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:35.812630    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8f3174b6-2fdc-48c2-99be-7a966731f018-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8f3174b6-2fdc-48c2-99be-7a966731f018-model-cache\") pod \"8f3174b6-2fdc-48c2-99be-7a966731f018\" (UID: \"8f3174b6-2fdc-48c2-99be-7a966731f018\") "
Oct 30 20:07:35.815466 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:35.812683    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8f3174b6-2fdc-48c2-99be-7a966731f018-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8f3174b6-2fdc-48c2-99be-7a966731f018-tmp-dir\") pod \"8f3174b6-2fdc-48c2-99be-7a966731f018\" (UID: \"8f3174b6-2fdc-48c2-99be-7a966731f018\") "
Oct 30 20:07:35.815466 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:35.812731    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/8f3174b6-2fdc-48c2-99be-7a966731f018-kube-api-access-7g2x8\" (UniqueName: \"kubernetes.io/projected/8f3174b6-2fdc-48c2-99be-7a966731f018-kube-api-access-7g2x8\") pod \"8f3174b6-2fdc-48c2-99be-7a966731f018\" (UID: \"8f3174b6-2fdc-48c2-99be-7a966731f018\") "
Oct 30 20:07:35.815466 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:35.812822    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8f3174b6-2fdc-48c2-99be-7a966731f018-dshm\" (UniqueName: \"kubernetes.io/empty-dir/8f3174b6-2fdc-48c2-99be-7a966731f018-dshm\") pod \"8f3174b6-2fdc-48c2-99be-7a966731f018\" (UID: \"8f3174b6-2fdc-48c2-99be-7a966731f018\") "
Oct 30 20:07:35.815466 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:35.812862    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8f3174b6-2fdc-48c2-99be-7a966731f018-home\" (UniqueName: \"kubernetes.io/empty-dir/8f3174b6-2fdc-48c2-99be-7a966731f018-home\") pod \"8f3174b6-2fdc-48c2-99be-7a966731f018\" (UID: \"8f3174b6-2fdc-48c2-99be-7a966731f018\") "
Oct 30 20:07:35.815466 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:35.813615    6275 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w5-626870/distinct-2-w5-626870-kserve-98bfb9b98-xz6xj"
Oct 30 20:07:35.815985 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:35.815643    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8f3174b6-2fdc-48c2-99be-7a966731f018-model-cache" pod "8f3174b6-2fdc-48c2-99be-7a966731f018" (UID: "8f3174b6-2fdc-48c2-99be-7a966731f018"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:07:35.815985 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:35.815965    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8f3174b6-2fdc-48c2-99be-7a966731f018-home" pod "8f3174b6-2fdc-48c2-99be-7a966731f018" (UID: "8f3174b6-2fdc-48c2-99be-7a966731f018"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:07:35.816198 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:35.816178    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8f3174b6-2fdc-48c2-99be-7a966731f018-tmp-dir" pod "8f3174b6-2fdc-48c2-99be-7a966731f018" (UID: "8f3174b6-2fdc-48c2-99be-7a966731f018"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:07:35.817692 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:35.817162    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8f3174b6-2fdc-48c2-99be-7a966731f018-tls-certs" pod "8f3174b6-2fdc-48c2-99be-7a966731f018" (UID: "8f3174b6-2fdc-48c2-99be-7a966731f018"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 20:07:35.821000 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:35.820575    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8f3174b6-2fdc-48c2-99be-7a966731f018-kube-api-access-7g2x8" pod "8f3174b6-2fdc-48c2-99be-7a966731f018" (UID: "8f3174b6-2fdc-48c2-99be-7a966731f018"). InnerVolumeSpecName "kube-api-access-7g2x8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:07:35.821000 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:35.820608    6275 scope.go:122] "RemoveContainer" containerID="3c2cf123f97b0e961608d423227ed48d17216fe829d88bf5d93109e4c127f48f"
Oct 30 20:07:35.821821 ip-10-0-131-26 kubenswrapper[6275]: E1030 20:07:35.821700    6275 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3c2cf123f97b0e961608d423227ed48d17216fe829d88bf5d93109e4c127f48f\": container with ID starting with 3c2cf123f97b0e961608d423227ed48d17216fe829d88bf5d93109e4c127f48f not found: ID does not exist" containerID="3c2cf123f97b0e961608d423227ed48d17216fe829d88bf5d93109e4c127f48f"
Oct 30 20:07:35.821821 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:35.821739    6275 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3c2cf123f97b0e961608d423227ed48d17216fe829d88bf5d93109e4c127f48f"} err="failed to get container status \"3c2cf123f97b0e961608d423227ed48d17216fe829d88bf5d93109e4c127f48f\": rpc error: code = NotFound desc = could not find container \"3c2cf123f97b0e961608d423227ed48d17216fe829d88bf5d93109e4c127f48f\": container with ID starting with 3c2cf123f97b0e961608d423227ed48d17216fe829d88bf5d93109e4c127f48f not found: ID does not exist"
Oct 30 20:07:35.822150 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:35.822034    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8f3174b6-2fdc-48c2-99be-7a966731f018-dshm" pod "8f3174b6-2fdc-48c2-99be-7a966731f018" (UID: "8f3174b6-2fdc-48c2-99be-7a966731f018"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:07:35.837334 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:35.836979    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-f1f016/premium-w4-f1f016-kserve-55d6bd678b-w5hkc" podUID="0e543ba9-1e7a-4d0a-9361-50c98060e824" containerName="main" probeResult="failure" output="Get \"https://10.134.0.60:8000/ready\": dial tcp 10.134.0.60:8000: connect: connection refused"
Oct 30 20:07:35.844760 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:35.844740    6275 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-f1f016/distinct-2-w4-f1f016-kserve-69f97f4b78-4m64r"
Oct 30 20:07:35.847675 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:35.847648    6275 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w5-626870/premium-w5-626870-kserve-5df7f7b5c4-vx59r"
Oct 30 20:07:35.922008 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:35.921971    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/7d49f1ad-8805-4090-8e72-7d828fa73f36-tls-certs\" (UniqueName: \"kubernetes.io/secret/7d49f1ad-8805-4090-8e72-7d828fa73f36-tls-certs\") pod \"7d49f1ad-8805-4090-8e72-7d828fa73f36\" (UID: \"7d49f1ad-8805-4090-8e72-7d828fa73f36\") "
Oct 30 20:07:35.922675 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:35.922641    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/7d49f1ad-8805-4090-8e72-7d828fa73f36-dshm\" (UniqueName: \"kubernetes.io/empty-dir/7d49f1ad-8805-4090-8e72-7d828fa73f36-dshm\") pod \"7d49f1ad-8805-4090-8e72-7d828fa73f36\" (UID: \"7d49f1ad-8805-4090-8e72-7d828fa73f36\") "
Oct 30 20:07:35.922819 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:35.922730    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/7b6639ea-72b0-49fb-b7fa-9443c1ddff6d-kube-api-access-pnskr\" (UniqueName: \"kubernetes.io/projected/7b6639ea-72b0-49fb-b7fa-9443c1ddff6d-kube-api-access-pnskr\") pod \"7b6639ea-72b0-49fb-b7fa-9443c1ddff6d\" (UID: \"7b6639ea-72b0-49fb-b7fa-9443c1ddff6d\") "
Oct 30 20:07:35.922819 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:35.922767    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/7b6639ea-72b0-49fb-b7fa-9443c1ddff6d-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7b6639ea-72b0-49fb-b7fa-9443c1ddff6d-tmp-dir\") pod \"7b6639ea-72b0-49fb-b7fa-9443c1ddff6d\" (UID: \"7b6639ea-72b0-49fb-b7fa-9443c1ddff6d\") "
Oct 30 20:07:35.922919 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:35.922879    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/7b6639ea-72b0-49fb-b7fa-9443c1ddff6d-home\" (UniqueName: \"kubernetes.io/empty-dir/7b6639ea-72b0-49fb-b7fa-9443c1ddff6d-home\") pod \"7b6639ea-72b0-49fb-b7fa-9443c1ddff6d\" (UID: \"7b6639ea-72b0-49fb-b7fa-9443c1ddff6d\") "
Oct 30 20:07:35.922970 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:35.922939    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/7b6639ea-72b0-49fb-b7fa-9443c1ddff6d-dshm\" (UniqueName: \"kubernetes.io/empty-dir/7b6639ea-72b0-49fb-b7fa-9443c1ddff6d-dshm\") pod \"7b6639ea-72b0-49fb-b7fa-9443c1ddff6d\" (UID: \"7b6639ea-72b0-49fb-b7fa-9443c1ddff6d\") "
Oct 30 20:07:35.923025 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:35.922972    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/7b6639ea-72b0-49fb-b7fa-9443c1ddff6d-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7b6639ea-72b0-49fb-b7fa-9443c1ddff6d-model-cache\") pod \"7b6639ea-72b0-49fb-b7fa-9443c1ddff6d\" (UID: \"7b6639ea-72b0-49fb-b7fa-9443c1ddff6d\") "
Oct 30 20:07:35.923025 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:35.923015    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/7d49f1ad-8805-4090-8e72-7d828fa73f36-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7d49f1ad-8805-4090-8e72-7d828fa73f36-model-cache\") pod \"7d49f1ad-8805-4090-8e72-7d828fa73f36\" (UID: \"7d49f1ad-8805-4090-8e72-7d828fa73f36\") "
Oct 30 20:07:35.923127 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:35.923064    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/7d49f1ad-8805-4090-8e72-7d828fa73f36-kube-api-access-8r5vf\" (UniqueName: \"kubernetes.io/projected/7d49f1ad-8805-4090-8e72-7d828fa73f36-kube-api-access-8r5vf\") pod \"7d49f1ad-8805-4090-8e72-7d828fa73f36\" (UID: \"7d49f1ad-8805-4090-8e72-7d828fa73f36\") "
Oct 30 20:07:35.923127 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:35.923105    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/7b6639ea-72b0-49fb-b7fa-9443c1ddff6d-tls-certs\" (UniqueName: \"kubernetes.io/secret/7b6639ea-72b0-49fb-b7fa-9443c1ddff6d-tls-certs\") pod \"7b6639ea-72b0-49fb-b7fa-9443c1ddff6d\" (UID: \"7b6639ea-72b0-49fb-b7fa-9443c1ddff6d\") "
Oct 30 20:07:35.923220 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:35.923186    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/7d49f1ad-8805-4090-8e72-7d828fa73f36-home\" (UniqueName: \"kubernetes.io/empty-dir/7d49f1ad-8805-4090-8e72-7d828fa73f36-home\") pod \"7d49f1ad-8805-4090-8e72-7d828fa73f36\" (UID: \"7d49f1ad-8805-4090-8e72-7d828fa73f36\") "
Oct 30 20:07:35.926245 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:35.923295    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/7d49f1ad-8805-4090-8e72-7d828fa73f36-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7d49f1ad-8805-4090-8e72-7d828fa73f36-tmp-dir\") pod \"7d49f1ad-8805-4090-8e72-7d828fa73f36\" (UID: \"7d49f1ad-8805-4090-8e72-7d828fa73f36\") "
Oct 30 20:07:35.926245 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:35.924275    6275 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8f3174b6-2fdc-48c2-99be-7a966731f018-tls-certs\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:07:35.926245 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:35.924308    6275 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8f3174b6-2fdc-48c2-99be-7a966731f018-model-cache\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:07:35.926245 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:35.924322    6275 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8f3174b6-2fdc-48c2-99be-7a966731f018-tmp-dir\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:07:35.926245 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:35.924337    6275 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7g2x8\" (UniqueName: \"kubernetes.io/projected/8f3174b6-2fdc-48c2-99be-7a966731f018-kube-api-access-7g2x8\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:07:35.926245 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:35.924350    6275 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8f3174b6-2fdc-48c2-99be-7a966731f018-dshm\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:07:35.926245 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:35.924363    6275 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8f3174b6-2fdc-48c2-99be-7a966731f018-home\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:07:35.926245 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:35.924926    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7b6639ea-72b0-49fb-b7fa-9443c1ddff6d-tmp-dir" pod "7b6639ea-72b0-49fb-b7fa-9443c1ddff6d" (UID: "7b6639ea-72b0-49fb-b7fa-9443c1ddff6d"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:07:35.926245 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:35.925029    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7d49f1ad-8805-4090-8e72-7d828fa73f36-home" pod "7d49f1ad-8805-4090-8e72-7d828fa73f36" (UID: "7d49f1ad-8805-4090-8e72-7d828fa73f36"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:07:35.926245 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:35.925087    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7b6639ea-72b0-49fb-b7fa-9443c1ddff6d-model-cache" pod "7b6639ea-72b0-49fb-b7fa-9443c1ddff6d" (UID: "7b6639ea-72b0-49fb-b7fa-9443c1ddff6d"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:07:35.926245 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:35.925099    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7b6639ea-72b0-49fb-b7fa-9443c1ddff6d-home" pod "7b6639ea-72b0-49fb-b7fa-9443c1ddff6d" (UID: "7b6639ea-72b0-49fb-b7fa-9443c1ddff6d"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:07:35.926245 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:35.926164    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7d49f1ad-8805-4090-8e72-7d828fa73f36-model-cache" pod "7d49f1ad-8805-4090-8e72-7d828fa73f36" (UID: "7d49f1ad-8805-4090-8e72-7d828fa73f36"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:07:35.926245 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:35.926220    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7d49f1ad-8805-4090-8e72-7d828fa73f36-tmp-dir" pod "7d49f1ad-8805-4090-8e72-7d828fa73f36" (UID: "7d49f1ad-8805-4090-8e72-7d828fa73f36"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:07:35.937947 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:35.937899    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7b6639ea-72b0-49fb-b7fa-9443c1ddff6d-dshm" pod "7b6639ea-72b0-49fb-b7fa-9443c1ddff6d" (UID: "7b6639ea-72b0-49fb-b7fa-9443c1ddff6d"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:07:35.938237 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:35.938213    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7b6639ea-72b0-49fb-b7fa-9443c1ddff6d-tls-certs" pod "7b6639ea-72b0-49fb-b7fa-9443c1ddff6d" (UID: "7b6639ea-72b0-49fb-b7fa-9443c1ddff6d"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 20:07:35.938986 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:35.938846    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7d49f1ad-8805-4090-8e72-7d828fa73f36-dshm" pod "7d49f1ad-8805-4090-8e72-7d828fa73f36" (UID: "7d49f1ad-8805-4090-8e72-7d828fa73f36"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:07:35.941359 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:35.940311    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7d49f1ad-8805-4090-8e72-7d828fa73f36-tls-certs" pod "7d49f1ad-8805-4090-8e72-7d828fa73f36" (UID: "7d49f1ad-8805-4090-8e72-7d828fa73f36"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 20:07:35.941359 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:35.940401    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7b6639ea-72b0-49fb-b7fa-9443c1ddff6d-kube-api-access-pnskr" pod "7b6639ea-72b0-49fb-b7fa-9443c1ddff6d" (UID: "7b6639ea-72b0-49fb-b7fa-9443c1ddff6d"). InnerVolumeSpecName "kube-api-access-pnskr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:07:35.941359 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:35.941299    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7d49f1ad-8805-4090-8e72-7d828fa73f36-kube-api-access-8r5vf" pod "7d49f1ad-8805-4090-8e72-7d828fa73f36" (UID: "7d49f1ad-8805-4090-8e72-7d828fa73f36"). InnerVolumeSpecName "kube-api-access-8r5vf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:07:36.025640 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:36.025604    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/96f19e7c-d36d-4109-bde0-24725bc670dd-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/96f19e7c-d36d-4109-bde0-24725bc670dd-model-cache\") pod \"96f19e7c-d36d-4109-bde0-24725bc670dd\" (UID: \"96f19e7c-d36d-4109-bde0-24725bc670dd\") "
Oct 30 20:07:36.026048 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:36.025679    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/96f19e7c-d36d-4109-bde0-24725bc670dd-home\" (UniqueName: \"kubernetes.io/empty-dir/96f19e7c-d36d-4109-bde0-24725bc670dd-home\") pod \"96f19e7c-d36d-4109-bde0-24725bc670dd\" (UID: \"96f19e7c-d36d-4109-bde0-24725bc670dd\") "
Oct 30 20:07:36.026048 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:36.025710    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/96f19e7c-d36d-4109-bde0-24725bc670dd-dshm\" (UniqueName: \"kubernetes.io/empty-dir/96f19e7c-d36d-4109-bde0-24725bc670dd-dshm\") pod \"96f19e7c-d36d-4109-bde0-24725bc670dd\" (UID: \"96f19e7c-d36d-4109-bde0-24725bc670dd\") "
Oct 30 20:07:36.026048 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:36.025816    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/96f19e7c-d36d-4109-bde0-24725bc670dd-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/96f19e7c-d36d-4109-bde0-24725bc670dd-tmp-dir\") pod \"96f19e7c-d36d-4109-bde0-24725bc670dd\" (UID: \"96f19e7c-d36d-4109-bde0-24725bc670dd\") "
Oct 30 20:07:36.026048 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:36.025869    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/96f19e7c-d36d-4109-bde0-24725bc670dd-model-cache" pod "96f19e7c-d36d-4109-bde0-24725bc670dd" (UID: "96f19e7c-d36d-4109-bde0-24725bc670dd"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:07:36.026048 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:36.025885    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/a1adddd4-3218-4a6b-a145-0290bceff76f-kube-api-access-whwsx\" (UniqueName: \"kubernetes.io/projected/a1adddd4-3218-4a6b-a145-0290bceff76f-kube-api-access-whwsx\") pod \"a1adddd4-3218-4a6b-a145-0290bceff76f\" (UID: \"a1adddd4-3218-4a6b-a145-0290bceff76f\") "
Oct 30 20:07:36.026048 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:36.025953    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/96f19e7c-d36d-4109-bde0-24725bc670dd-home" pod "96f19e7c-d36d-4109-bde0-24725bc670dd" (UID: "96f19e7c-d36d-4109-bde0-24725bc670dd"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:07:36.026048 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:36.025976    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a1adddd4-3218-4a6b-a145-0290bceff76f-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a1adddd4-3218-4a6b-a145-0290bceff76f-tmp-dir\") pod \"a1adddd4-3218-4a6b-a145-0290bceff76f\" (UID: \"a1adddd4-3218-4a6b-a145-0290bceff76f\") "
Oct 30 20:07:36.026048 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:36.026019    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a1adddd4-3218-4a6b-a145-0290bceff76f-dshm\" (UniqueName: \"kubernetes.io/empty-dir/a1adddd4-3218-4a6b-a145-0290bceff76f-dshm\") pod \"a1adddd4-3218-4a6b-a145-0290bceff76f\" (UID: \"a1adddd4-3218-4a6b-a145-0290bceff76f\") "
Oct 30 20:07:36.026048 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:36.026047    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/a1adddd4-3218-4a6b-a145-0290bceff76f-tls-certs\" (UniqueName: \"kubernetes.io/secret/a1adddd4-3218-4a6b-a145-0290bceff76f-tls-certs\") pod \"a1adddd4-3218-4a6b-a145-0290bceff76f\" (UID: \"a1adddd4-3218-4a6b-a145-0290bceff76f\") "
Oct 30 20:07:36.026503 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:36.026125    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a1adddd4-3218-4a6b-a145-0290bceff76f-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a1adddd4-3218-4a6b-a145-0290bceff76f-model-cache\") pod \"a1adddd4-3218-4a6b-a145-0290bceff76f\" (UID: \"a1adddd4-3218-4a6b-a145-0290bceff76f\") "
Oct 30 20:07:36.026503 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:36.026147    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/96f19e7c-d36d-4109-bde0-24725bc670dd-kube-api-access-bqpfw\" (UniqueName: \"kubernetes.io/projected/96f19e7c-d36d-4109-bde0-24725bc670dd-kube-api-access-bqpfw\") pod \"96f19e7c-d36d-4109-bde0-24725bc670dd\" (UID: \"96f19e7c-d36d-4109-bde0-24725bc670dd\") "
Oct 30 20:07:36.026503 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:36.026227    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a1adddd4-3218-4a6b-a145-0290bceff76f-home\" (UniqueName: \"kubernetes.io/empty-dir/a1adddd4-3218-4a6b-a145-0290bceff76f-home\") pod \"a1adddd4-3218-4a6b-a145-0290bceff76f\" (UID: \"a1adddd4-3218-4a6b-a145-0290bceff76f\") "
Oct 30 20:07:36.026503 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:36.026263    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/96f19e7c-d36d-4109-bde0-24725bc670dd-tls-certs\" (UniqueName: \"kubernetes.io/secret/96f19e7c-d36d-4109-bde0-24725bc670dd-tls-certs\") pod \"96f19e7c-d36d-4109-bde0-24725bc670dd\" (UID: \"96f19e7c-d36d-4109-bde0-24725bc670dd\") "
Oct 30 20:07:36.026794 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:36.026776    6275 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7d49f1ad-8805-4090-8e72-7d828fa73f36-tls-certs\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:07:36.026853 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:36.026795    6275 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7d49f1ad-8805-4090-8e72-7d828fa73f36-dshm\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:07:36.026853 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:36.026805    6275 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pnskr\" (UniqueName: \"kubernetes.io/projected/7b6639ea-72b0-49fb-b7fa-9443c1ddff6d-kube-api-access-pnskr\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:07:36.026853 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:36.026815    6275 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7b6639ea-72b0-49fb-b7fa-9443c1ddff6d-tmp-dir\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:07:36.026853 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:36.026825    6275 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/96f19e7c-d36d-4109-bde0-24725bc670dd-model-cache\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:07:36.026853 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:36.026833    6275 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7b6639ea-72b0-49fb-b7fa-9443c1ddff6d-home\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:07:36.026853 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:36.026840    6275 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/96f19e7c-d36d-4109-bde0-24725bc670dd-home\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:07:36.026853 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:36.026847    6275 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7b6639ea-72b0-49fb-b7fa-9443c1ddff6d-dshm\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:07:36.026853 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:36.026854    6275 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7b6639ea-72b0-49fb-b7fa-9443c1ddff6d-model-cache\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:07:36.027156 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:36.026862    6275 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7d49f1ad-8805-4090-8e72-7d828fa73f36-model-cache\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:07:36.027156 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:36.026870    6275 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8r5vf\" (UniqueName: \"kubernetes.io/projected/7d49f1ad-8805-4090-8e72-7d828fa73f36-kube-api-access-8r5vf\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:07:36.027156 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:36.026878    6275 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7b6639ea-72b0-49fb-b7fa-9443c1ddff6d-tls-certs\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:07:36.027156 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:36.026886    6275 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7d49f1ad-8805-4090-8e72-7d828fa73f36-home\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:07:36.027156 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:36.026893    6275 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7d49f1ad-8805-4090-8e72-7d828fa73f36-tmp-dir\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:07:36.027437 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:36.027354    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a1adddd4-3218-4a6b-a145-0290bceff76f-home" pod "a1adddd4-3218-4a6b-a145-0290bceff76f" (UID: "a1adddd4-3218-4a6b-a145-0290bceff76f"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:07:36.027584 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:36.027560    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/96f19e7c-d36d-4109-bde0-24725bc670dd-tmp-dir" pod "96f19e7c-d36d-4109-bde0-24725bc670dd" (UID: "96f19e7c-d36d-4109-bde0-24725bc670dd"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:07:36.027696 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:36.027672    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a1adddd4-3218-4a6b-a145-0290bceff76f-tmp-dir" pod "a1adddd4-3218-4a6b-a145-0290bceff76f" (UID: "a1adddd4-3218-4a6b-a145-0290bceff76f"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:07:36.027754 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:36.027731    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a1adddd4-3218-4a6b-a145-0290bceff76f-model-cache" pod "a1adddd4-3218-4a6b-a145-0290bceff76f" (UID: "a1adddd4-3218-4a6b-a145-0290bceff76f"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:07:36.028585 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:36.028559    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/96f19e7c-d36d-4109-bde0-24725bc670dd-dshm" pod "96f19e7c-d36d-4109-bde0-24725bc670dd" (UID: "96f19e7c-d36d-4109-bde0-24725bc670dd"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:07:36.029113 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:36.029082    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a1adddd4-3218-4a6b-a145-0290bceff76f-tls-certs" pod "a1adddd4-3218-4a6b-a145-0290bceff76f" (UID: "a1adddd4-3218-4a6b-a145-0290bceff76f"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 20:07:36.029181 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:36.029166    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/96f19e7c-d36d-4109-bde0-24725bc670dd-tls-certs" pod "96f19e7c-d36d-4109-bde0-24725bc670dd" (UID: "96f19e7c-d36d-4109-bde0-24725bc670dd"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 20:07:36.029864 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:36.029840    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a1adddd4-3218-4a6b-a145-0290bceff76f-kube-api-access-whwsx" pod "a1adddd4-3218-4a6b-a145-0290bceff76f" (UID: "a1adddd4-3218-4a6b-a145-0290bceff76f"). InnerVolumeSpecName "kube-api-access-whwsx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:07:36.030000 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:36.029883    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a1adddd4-3218-4a6b-a145-0290bceff76f-dshm" pod "a1adddd4-3218-4a6b-a145-0290bceff76f" (UID: "a1adddd4-3218-4a6b-a145-0290bceff76f"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:07:36.032481 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:36.032456    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/96f19e7c-d36d-4109-bde0-24725bc670dd-kube-api-access-bqpfw" pod "96f19e7c-d36d-4109-bde0-24725bc670dd" (UID: "96f19e7c-d36d-4109-bde0-24725bc670dd"). InnerVolumeSpecName "kube-api-access-bqpfw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:07:36.034710 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:36.034687    6275 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-f1f016/premium-w4-f1f016-kserve-55d6bd678b-w5hkc"
Oct 30 20:07:36.127897 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:36.127864    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/0e543ba9-1e7a-4d0a-9361-50c98060e824-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0e543ba9-1e7a-4d0a-9361-50c98060e824-tmp-dir\") pod \"0e543ba9-1e7a-4d0a-9361-50c98060e824\" (UID: \"0e543ba9-1e7a-4d0a-9361-50c98060e824\") "
Oct 30 20:07:36.128090 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:36.127909    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/0e543ba9-1e7a-4d0a-9361-50c98060e824-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0e543ba9-1e7a-4d0a-9361-50c98060e824-model-cache\") pod \"0e543ba9-1e7a-4d0a-9361-50c98060e824\" (UID: \"0e543ba9-1e7a-4d0a-9361-50c98060e824\") "
Oct 30 20:07:36.128090 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:36.128013    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/0e543ba9-1e7a-4d0a-9361-50c98060e824-kube-api-access-kwbgv\" (UniqueName: \"kubernetes.io/projected/0e543ba9-1e7a-4d0a-9361-50c98060e824-kube-api-access-kwbgv\") pod \"0e543ba9-1e7a-4d0a-9361-50c98060e824\" (UID: \"0e543ba9-1e7a-4d0a-9361-50c98060e824\") "
Oct 30 20:07:36.128221 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:36.128093    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/0e543ba9-1e7a-4d0a-9361-50c98060e824-dshm\" (UniqueName: \"kubernetes.io/empty-dir/0e543ba9-1e7a-4d0a-9361-50c98060e824-dshm\") pod \"0e543ba9-1e7a-4d0a-9361-50c98060e824\" (UID: \"0e543ba9-1e7a-4d0a-9361-50c98060e824\") "
Oct 30 20:07:36.128221 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:36.128189    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0e543ba9-1e7a-4d0a-9361-50c98060e824-tmp-dir" pod "0e543ba9-1e7a-4d0a-9361-50c98060e824" (UID: "0e543ba9-1e7a-4d0a-9361-50c98060e824"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:07:36.128353 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:36.128234    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/0e543ba9-1e7a-4d0a-9361-50c98060e824-tls-certs\" (UniqueName: \"kubernetes.io/secret/0e543ba9-1e7a-4d0a-9361-50c98060e824-tls-certs\") pod \"0e543ba9-1e7a-4d0a-9361-50c98060e824\" (UID: \"0e543ba9-1e7a-4d0a-9361-50c98060e824\") "
Oct 30 20:07:36.128353 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:36.128272    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/0e543ba9-1e7a-4d0a-9361-50c98060e824-home\" (UniqueName: \"kubernetes.io/empty-dir/0e543ba9-1e7a-4d0a-9361-50c98060e824-home\") pod \"0e543ba9-1e7a-4d0a-9361-50c98060e824\" (UID: \"0e543ba9-1e7a-4d0a-9361-50c98060e824\") "
Oct 30 20:07:36.128642 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:36.128618    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0e543ba9-1e7a-4d0a-9361-50c98060e824-model-cache" pod "0e543ba9-1e7a-4d0a-9361-50c98060e824" (UID: "0e543ba9-1e7a-4d0a-9361-50c98060e824"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:07:36.128844 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:36.128825    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0e543ba9-1e7a-4d0a-9361-50c98060e824-home" pod "0e543ba9-1e7a-4d0a-9361-50c98060e824" (UID: "0e543ba9-1e7a-4d0a-9361-50c98060e824"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:07:36.129173 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:36.129150    6275 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a1adddd4-3218-4a6b-a145-0290bceff76f-home\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:07:36.129256 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:36.129179    6275 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/96f19e7c-d36d-4109-bde0-24725bc670dd-tls-certs\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:07:36.129256 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:36.129194    6275 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/96f19e7c-d36d-4109-bde0-24725bc670dd-dshm\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:07:36.129256 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:36.129205    6275 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0e543ba9-1e7a-4d0a-9361-50c98060e824-home\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:07:36.129256 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:36.129217    6275 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/96f19e7c-d36d-4109-bde0-24725bc670dd-tmp-dir\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:07:36.129256 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:36.129230    6275 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-whwsx\" (UniqueName: \"kubernetes.io/projected/a1adddd4-3218-4a6b-a145-0290bceff76f-kube-api-access-whwsx\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:07:36.129256 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:36.129243    6275 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a1adddd4-3218-4a6b-a145-0290bceff76f-tmp-dir\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:07:36.129256 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:36.129257    6275 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0e543ba9-1e7a-4d0a-9361-50c98060e824-tmp-dir\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:07:36.129628 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:36.129270    6275 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0e543ba9-1e7a-4d0a-9361-50c98060e824-model-cache\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:07:36.129628 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:36.129281    6275 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a1adddd4-3218-4a6b-a145-0290bceff76f-dshm\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:07:36.129628 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:36.129293    6275 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a1adddd4-3218-4a6b-a145-0290bceff76f-tls-certs\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:07:36.129628 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:36.129304    6275 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a1adddd4-3218-4a6b-a145-0290bceff76f-model-cache\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:07:36.129628 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:36.129317    6275 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bqpfw\" (UniqueName: \"kubernetes.io/projected/96f19e7c-d36d-4109-bde0-24725bc670dd-kube-api-access-bqpfw\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:07:36.131201 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:36.131151    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0e543ba9-1e7a-4d0a-9361-50c98060e824-tls-certs" pod "0e543ba9-1e7a-4d0a-9361-50c98060e824" (UID: "0e543ba9-1e7a-4d0a-9361-50c98060e824"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 20:07:36.132053 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:36.132021    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0e543ba9-1e7a-4d0a-9361-50c98060e824-kube-api-access-kwbgv" pod "0e543ba9-1e7a-4d0a-9361-50c98060e824" (UID: "0e543ba9-1e7a-4d0a-9361-50c98060e824"). InnerVolumeSpecName "kube-api-access-kwbgv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:07:36.133105 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:36.133084    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0e543ba9-1e7a-4d0a-9361-50c98060e824-dshm" pod "0e543ba9-1e7a-4d0a-9361-50c98060e824" (UID: "0e543ba9-1e7a-4d0a-9361-50c98060e824"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:07:36.181344 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:36.175244    6275 patch_prober.go:29] interesting pod/e2e-worker-w2-efbac3-openshift-default-844cb4689c-8mzmn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.109:15021/healthz/ready\": dial tcp 10.134.0.109:15021: connect: connection refused" start-of-body=
Oct 30 20:07:36.181344 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:36.175295    6275 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-efbac3-openshift-default-844cb4689c-8mzmn" podUID="9cba92db-f8aa-4a79-9b3e-3481fa8b1fbd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.109:15021/healthz/ready\": dial tcp 10.134.0.109:15021: connect: connection refused"
Oct 30 20:07:36.230499 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:36.230423    6275 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-f1f016/simulator-w4-f1f016-kserve-55db8447ff-749tw"]
Oct 30 20:07:36.230816 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:36.230795    6275 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kwbgv\" (UniqueName: \"kubernetes.io/projected/0e543ba9-1e7a-4d0a-9361-50c98060e824-kube-api-access-kwbgv\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:07:36.230873 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:36.230819    6275 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0e543ba9-1e7a-4d0a-9361-50c98060e824-dshm\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:07:36.230873 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:36.230828    6275 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0e543ba9-1e7a-4d0a-9361-50c98060e824-tls-certs\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:07:36.239052 ip-10-0-131-26 kubenswrapper[6275]: W1030 20:07:36.239027    6275 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod803f3028_5e38_40f3_baa2_dd3fee4093e8.slice/crio-6b64b6964ac58fe8d3682df88f1333f95f84c6c215042c501e4889b291d15b2e WatchSource:0}: Error finding container 6b64b6964ac58fe8d3682df88f1333f95f84c6c215042c501e4889b291d15b2e: Status 404 returned error can't find the container with id 6b64b6964ac58fe8d3682df88f1333f95f84c6c215042c501e4889b291d15b2e
Oct 30 20:07:36.241304 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:36.241281    6275 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w1-5f10d2-gzczw"]
Oct 30 20:07:36.247616 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:36.247591    6275 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w4-f1f016/simulator-w4-f1f016-kserve-55db8447ff-749tw"]
Oct 30 20:07:36.767932 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:36.767844    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-f1f016/premium-w4-f1f016-kserve-55d6bd678b-w5hkc" event={"ID":"0e543ba9-1e7a-4d0a-9361-50c98060e824","Type":"ContainerDied","Data":"e225d800fcc17f3cf50989931d6b6a57a3880883f9091b774bfd17b314704698"}
Oct 30 20:07:36.767932 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:36.767901    6275 scope.go:122] "RemoveContainer" containerID="da18fd21350a4dca4f626fe8f7fff73059f1d032c43a29a2ac53a369793057be"
Oct 30 20:07:36.768156 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:36.767852    6275 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-f1f016/premium-w4-f1f016-kserve-55d6bd678b-w5hkc"
Oct 30 20:07:36.770270 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:36.770240    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w1-5f10d2-gzczw" event={"ID":"803f3028-5e38-40f3-baa2-dd3fee4093e8","Type":"ContainerStarted","Data":"6664fecfdf89b53dee44d1d7627e20a3bb35d7927cc2dcd6a60bafea288ab55a"}
Oct 30 20:07:36.770527 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:36.770297    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w1-5f10d2-gzczw" event={"ID":"803f3028-5e38-40f3-baa2-dd3fee4093e8","Type":"ContainerStarted","Data":"6b64b6964ac58fe8d3682df88f1333f95f84c6c215042c501e4889b291d15b2e"}
Oct 30 20:07:36.772135 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:36.772113    6275 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-f1f016/distinct-2-w4-f1f016-kserve-69f97f4b78-4m64r"
Oct 30 20:07:36.772245 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:36.772114    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-f1f016/distinct-2-w4-f1f016-kserve-69f97f4b78-4m64r" event={"ID":"96f19e7c-d36d-4109-bde0-24725bc670dd","Type":"ContainerDied","Data":"df8700c05de1eaf4736e3b301e273d604bbe8457bb04c51eac8d3b228155c25b"}
Oct 30 20:07:36.773981 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:36.773958    6275 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w5-626870/distinct-2-w5-626870-kserve-98bfb9b98-xz6xj"
Oct 30 20:07:36.774083 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:36.774008    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w5-626870/distinct-2-w5-626870-kserve-98bfb9b98-xz6xj" event={"ID":"7d49f1ad-8805-4090-8e72-7d828fa73f36","Type":"ContainerDied","Data":"942b8fa946f313cf256de5290513f44d35a90be2dece60f100d62323ed581b93"}
Oct 30 20:07:36.775751 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:36.775676    6275 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w5-626870/premium-w5-626870-kserve-5df7f7b5c4-vx59r"
Oct 30 20:07:36.775751 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:36.775713    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w5-626870/premium-w5-626870-kserve-5df7f7b5c4-vx59r" event={"ID":"a1adddd4-3218-4a6b-a145-0290bceff76f","Type":"ContainerDied","Data":"a5d560d12f89b7230d1f212c3dc11b72daf3a503c1fb5472277446eb0b56a553"}
Oct 30 20:07:36.777084 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:36.777065    6275 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-f1f016/distinct-w4-f1f016-kserve-79fbfbdbf7-hswb7"
Oct 30 20:07:36.786457 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:36.786432    6275 scope.go:122] "RemoveContainer" containerID="d9d817f395f85aa38f6303f7cd4eb85f4d67b0715806f0708c2d37d0d2b9aea7"
Oct 30 20:07:36.801908 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:36.801871    6275 scope.go:122] "RemoveContainer" containerID="22a924bb9db00bd2defbd1d7fa4ffe3ed03412c3a6c334c32c8b7583982d06f3"
Oct 30 20:07:36.816622 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:36.816576    6275 scope.go:122] "RemoveContainer" containerID="0f80c1ca2254257e0095a7129328cc8407e7dda1b5481f55b17cff1e59bf5abb"
Oct 30 20:07:36.842064 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:36.842029    6275 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-f1f016/premium-w4-f1f016-kserve-55d6bd678b-w5hkc"]
Oct 30 20:07:36.847008 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:36.846935    6275 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w4-f1f016/premium-w4-f1f016-kserve-55d6bd678b-w5hkc"]
Oct 30 20:07:36.891753 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:36.891687    6275 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w1-5f10d2-gzczw" podStartSLOduration=1.891666295 podStartE2EDuration="1.891666295s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:07:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:07:36.885899878 +0000 UTC m=+1167.347626741" watchObservedRunningTime="2026-10-30 20:07:36.891666295 +0000 UTC m=+1167.353393161"
Oct 30 20:07:36.951858 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:36.951830    6275 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w5-626870/distinct-2-w5-626870-kserve-98bfb9b98-xz6xj"]
Oct 30 20:07:36.957743 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:36.957715    6275 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w5-626870/distinct-2-w5-626870-kserve-98bfb9b98-xz6xj"]
Oct 30 20:07:36.959105 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:36.959086    6275 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-bcdd07d8-w54ql"
Oct 30 20:07:37.033999 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:37.033905    6275 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-f1f016/distinct-w4-f1f016-kserve-79fbfbdbf7-hswb7"]
Oct 30 20:07:37.039428 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:37.039392    6275 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w4-f1f016/distinct-w4-f1f016-kserve-79fbfbdbf7-hswb7"]
Oct 30 20:07:37.074815 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:37.074781    6275 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w5-626870/premium-w5-626870-kserve-5df7f7b5c4-vx59r"]
Oct 30 20:07:37.082201 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:37.082170    6275 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w5-626870/premium-w5-626870-kserve-5df7f7b5c4-vx59r"]
Oct 30 20:07:37.120912 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:37.120719    6275 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-f1f016/distinct-2-w4-f1f016-kserve-69f97f4b78-4m64r"]
Oct 30 20:07:37.126856 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:37.126825    6275 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w4-f1f016/distinct-2-w4-f1f016-kserve-69f97f4b78-4m64r"]
Oct 30 20:07:37.146217 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:37.146192    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/4d8499e4-5a30-454c-b2e0-47f47651220f-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/4d8499e4-5a30-454c-b2e0-47f47651220f-maas-api-openshift-ca\") pod \"4d8499e4-5a30-454c-b2e0-47f47651220f\" (UID: \"4d8499e4-5a30-454c-b2e0-47f47651220f\") "
Oct 30 20:07:37.146399 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:37.146305    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/4d8499e4-5a30-454c-b2e0-47f47651220f-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/4d8499e4-5a30-454c-b2e0-47f47651220f-maas-api-xks-ca\") pod \"4d8499e4-5a30-454c-b2e0-47f47651220f\" (UID: \"4d8499e4-5a30-454c-b2e0-47f47651220f\") "
Oct 30 20:07:37.146399 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:37.146342    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/4d8499e4-5a30-454c-b2e0-47f47651220f-kube-api-access-mk7tn\" (UniqueName: \"kubernetes.io/projected/4d8499e4-5a30-454c-b2e0-47f47651220f-kube-api-access-mk7tn\") pod \"4d8499e4-5a30-454c-b2e0-47f47651220f\" (UID: \"4d8499e4-5a30-454c-b2e0-47f47651220f\") "
Oct 30 20:07:37.146620 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:37.146599    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4d8499e4-5a30-454c-b2e0-47f47651220f-maas-api-openshift-ca" pod "4d8499e4-5a30-454c-b2e0-47f47651220f" (UID: "4d8499e4-5a30-454c-b2e0-47f47651220f"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:07:37.146954 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:37.146934    6275 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/4d8499e4-5a30-454c-b2e0-47f47651220f-maas-api-openshift-ca\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:07:37.148537 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:37.148512    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4d8499e4-5a30-454c-b2e0-47f47651220f-maas-api-xks-ca" pod "4d8499e4-5a30-454c-b2e0-47f47651220f" (UID: "4d8499e4-5a30-454c-b2e0-47f47651220f"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 20:07:37.148613 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:37.148545    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4d8499e4-5a30-454c-b2e0-47f47651220f-kube-api-access-mk7tn" pod "4d8499e4-5a30-454c-b2e0-47f47651220f" (UID: "4d8499e4-5a30-454c-b2e0-47f47651220f"). InnerVolumeSpecName "kube-api-access-mk7tn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:07:37.173540 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:37.173504    6275 patch_prober.go:29] interesting pod/e2e-worker-w2-efbac3-openshift-default-844cb4689c-8mzmn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.109:15021/healthz/ready\": dial tcp 10.134.0.109:15021: connect: connection refused" start-of-body=
Oct 30 20:07:37.173736 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:37.173612    6275 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-efbac3-openshift-default-844cb4689c-8mzmn" podUID="9cba92db-f8aa-4a79-9b3e-3481fa8b1fbd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.109:15021/healthz/ready\": dial tcp 10.134.0.109:15021: connect: connection refused"
Oct 30 20:07:37.247833 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:37.247789    6275 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/4d8499e4-5a30-454c-b2e0-47f47651220f-maas-api-xks-ca\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:07:37.247833 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:37.247826    6275 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mk7tn\" (UniqueName: \"kubernetes.io/projected/4d8499e4-5a30-454c-b2e0-47f47651220f-kube-api-access-mk7tn\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:07:37.660105 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:37.660003    6275 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="0e543ba9-1e7a-4d0a-9361-50c98060e824" path="/var/lib/kubelet/pods/0e543ba9-1e7a-4d0a-9361-50c98060e824/volumes"
Oct 30 20:07:37.660724 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:37.660688    6275 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="7b6639ea-72b0-49fb-b7fa-9443c1ddff6d" path="/var/lib/kubelet/pods/7b6639ea-72b0-49fb-b7fa-9443c1ddff6d/volumes"
Oct 30 20:07:37.661292 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:37.661271    6275 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="7d49f1ad-8805-4090-8e72-7d828fa73f36" path="/var/lib/kubelet/pods/7d49f1ad-8805-4090-8e72-7d828fa73f36/volumes"
Oct 30 20:07:37.662261 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:37.662242    6275 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="8f3174b6-2fdc-48c2-99be-7a966731f018" path="/var/lib/kubelet/pods/8f3174b6-2fdc-48c2-99be-7a966731f018/volumes"
Oct 30 20:07:37.662704 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:37.662688    6275 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="96f19e7c-d36d-4109-bde0-24725bc670dd" path="/var/lib/kubelet/pods/96f19e7c-d36d-4109-bde0-24725bc670dd/volumes"
Oct 30 20:07:37.663094 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:37.663081    6275 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="a1adddd4-3218-4a6b-a145-0290bceff76f" path="/var/lib/kubelet/pods/a1adddd4-3218-4a6b-a145-0290bceff76f/volumes"
Oct 30 20:07:37.704370 ip-10-0-131-26 kubenswrapper[6275]: E1030 20:07:37.704323    6275 cadvisor_stats_provider.go:569] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d8499e4_5a30_454c_b2e0_47f47651220f.slice\": RecentStats: unable to find data in memory cache]"
Oct 30 20:07:37.791314 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:37.791272    6275 generic.go:356] "Generic (PLEG): container finished" podID="803f3028-5e38-40f3-baa2-dd3fee4093e8" containerID="6664fecfdf89b53dee44d1d7627e20a3bb35d7927cc2dcd6a60bafea288ab55a" exitCode=0
Oct 30 20:07:37.791527 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:37.791351    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w1-5f10d2-gzczw" event={"ID":"803f3028-5e38-40f3-baa2-dd3fee4093e8","Type":"ContainerDied","Data":"6664fecfdf89b53dee44d1d7627e20a3bb35d7927cc2dcd6a60bafea288ab55a"}
Oct 30 20:07:37.798596 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:37.798573    6275 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-bcdd07d8-w54ql"
Oct 30 20:07:37.798596 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:37.798584    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-bcdd07d8-w54ql" event={"ID":"4d8499e4-5a30-454c-b2e0-47f47651220f","Type":"ContainerDied","Data":"778471768b32aba5353e1224d071d2b512e74cfc8ed1df6900c434b41d9ac68b"}
Oct 30 20:07:37.798793 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:37.798629    6275 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="778471768b32aba5353e1224d071d2b512e74cfc8ed1df6900c434b41d9ac68b"
Oct 30 20:07:38.291713 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:38.291671    6275 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w2-efbac3-openshift-default-844cb4689c-8mzmn"
Oct 30 20:07:38.292673 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:38.292651    6275 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w2-efbac3-openshift-default-844cb4689c-8mzmn"
Oct 30 20:07:38.293551 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:38.293529    6275 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w2-efbac3-openshift-default-844cb4689c-8mzmn"
Oct 30 20:07:38.979819 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:38.979792    6275 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w1-5f10d2-gzczw"
Oct 30 20:07:39.074995 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:39.074150    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/803f3028-5e38-40f3-baa2-dd3fee4093e8-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/803f3028-5e38-40f3-baa2-dd3fee4093e8-maas-api-openshift-ca\") pod \"803f3028-5e38-40f3-baa2-dd3fee4093e8\" (UID: \"803f3028-5e38-40f3-baa2-dd3fee4093e8\") "
Oct 30 20:07:39.074995 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:39.074257    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/803f3028-5e38-40f3-baa2-dd3fee4093e8-kube-api-access-qjp7z\" (UniqueName: \"kubernetes.io/projected/803f3028-5e38-40f3-baa2-dd3fee4093e8-kube-api-access-qjp7z\") pod \"803f3028-5e38-40f3-baa2-dd3fee4093e8\" (UID: \"803f3028-5e38-40f3-baa2-dd3fee4093e8\") "
Oct 30 20:07:39.074995 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:39.074520    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/803f3028-5e38-40f3-baa2-dd3fee4093e8-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/803f3028-5e38-40f3-baa2-dd3fee4093e8-maas-api-xks-ca\") pod \"803f3028-5e38-40f3-baa2-dd3fee4093e8\" (UID: \"803f3028-5e38-40f3-baa2-dd3fee4093e8\") "
Oct 30 20:07:39.077200 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:39.077163    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/803f3028-5e38-40f3-baa2-dd3fee4093e8-maas-api-openshift-ca" pod "803f3028-5e38-40f3-baa2-dd3fee4093e8" (UID: "803f3028-5e38-40f3-baa2-dd3fee4093e8"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:07:39.093502 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:39.093176    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/803f3028-5e38-40f3-baa2-dd3fee4093e8-kube-api-access-qjp7z" pod "803f3028-5e38-40f3-baa2-dd3fee4093e8" (UID: "803f3028-5e38-40f3-baa2-dd3fee4093e8"). InnerVolumeSpecName "kube-api-access-qjp7z". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:07:39.093832 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:39.093797    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/803f3028-5e38-40f3-baa2-dd3fee4093e8-maas-api-xks-ca" pod "803f3028-5e38-40f3-baa2-dd3fee4093e8" (UID: "803f3028-5e38-40f3-baa2-dd3fee4093e8"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 20:07:39.177574 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:39.177534    6275 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/803f3028-5e38-40f3-baa2-dd3fee4093e8-maas-api-xks-ca\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:07:39.177574 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:39.177577    6275 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/803f3028-5e38-40f3-baa2-dd3fee4093e8-maas-api-openshift-ca\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:07:39.177784 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:39.177593    6275 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qjp7z\" (UniqueName: \"kubernetes.io/projected/803f3028-5e38-40f3-baa2-dd3fee4093e8-kube-api-access-qjp7z\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:07:39.822476 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:39.822445    6275 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w1-5f10d2-gzczw"
Oct 30 20:07:39.822878 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:39.822444    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w1-5f10d2-gzczw" event={"ID":"803f3028-5e38-40f3-baa2-dd3fee4093e8","Type":"ContainerDied","Data":"6b64b6964ac58fe8d3682df88f1333f95f84c6c215042c501e4889b291d15b2e"}
Oct 30 20:07:39.822878 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:39.822564    6275 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6b64b6964ac58fe8d3682df88f1333f95f84c6c215042c501e4889b291d15b2e"
Oct 30 20:07:40.090127 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:40.090091    6275 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-42d7cdd3-rznq7"]
Oct 30 20:07:40.100840 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:40.100803    6275 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-42d7cdd3-rznq7"]
Oct 30 20:07:40.112311 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:40.112282    6275 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w1-5f10d2/distinct-w1-5f10d2-kserve-5bf49798b8-l2j84"]
Oct 30 20:07:40.125607 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:40.125583    6275 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w1-5f10d2/premium-w1-5f10d2-kserve-644b846669-286m2"]
Oct 30 20:07:40.201969 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:40.201928    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-f1f016-568d55d755-xjm26" podUID="0b8c41e3-9d0d-400b-839f-f186bcaae886" containerName="payload-pre-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 30 20:07:40.202148 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:40.201934    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-processing-e2e-worker-w4-f1f016-6754476fb5-jlhbg" podUID="5bce3c0a-07d6-490e-9506-1600a2278a23" containerName="payload-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 30 20:07:41.658160 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:41.658124    6275 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="33637d8a-827f-4aa1-8920-88dba99cb546" path="/var/lib/kubelet/pods/33637d8a-827f-4aa1-8920-88dba99cb546/volumes"
Oct 30 20:07:42.305791 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:42.305747    6275 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w6-51dd62/distinct-2-w6-51dd62-kserve-79ff99c4cd-fvmb6"
Oct 30 20:07:42.321940 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:42.321903    6275 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w6-51dd62/distinct-2-w6-51dd62-kserve-79ff99c4cd-fvmb6"
Oct 30 20:07:42.855879 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:42.855845    6275 generic.go:356] "Generic (PLEG): container finished" podID="8b04ae86-d3b8-4e51-b357-25e38742b02f" containerID="b64a30d3ff021dea3b430ffac5483b0c084ee9518aeb3fe9a5d6b9d2dc7ca121" exitCode=0
Oct 30 20:07:42.856376 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:42.856011    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w3-912f24-585f6bf47-q7hqs" event={"ID":"8b04ae86-d3b8-4e51-b357-25e38742b02f","Type":"ContainerDied","Data":"b64a30d3ff021dea3b430ffac5483b0c084ee9518aeb3fe9a5d6b9d2dc7ca121"}
Oct 30 20:07:42.859326 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:42.858352    6275 generic.go:356] "Generic (PLEG): container finished" podID="72b9ada9-738c-4c37-96f4-5f827abdf99e" containerID="6fb1d1e604a32ab82798f59f6e3499dba0c13153708eae887e75b60600914e5e" exitCode=0
Oct 30 20:07:42.859326 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:42.858399    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w3-912f24-7bd864565f-fvnth" event={"ID":"72b9ada9-738c-4c37-96f4-5f827abdf99e","Type":"ContainerDied","Data":"6fb1d1e604a32ab82798f59f6e3499dba0c13153708eae887e75b60600914e5e"}
Oct 30 20:07:42.918611 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:42.918585    6275 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w3-912f24-7bd864565f-fvnth"
Oct 30 20:07:42.938664 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:42.938642    6275 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w3-912f24-585f6bf47-q7hqs"
Oct 30 20:07:43.040737 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:43.040705    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/8b04ae86-d3b8-4e51-b357-25e38742b02f-kube-api-access-6csfn\" (UniqueName: \"kubernetes.io/projected/8b04ae86-d3b8-4e51-b357-25e38742b02f-kube-api-access-6csfn\") pod \"8b04ae86-d3b8-4e51-b357-25e38742b02f\" (UID: \"8b04ae86-d3b8-4e51-b357-25e38742b02f\") "
Oct 30 20:07:43.040933 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:43.040848    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/72b9ada9-738c-4c37-96f4-5f827abdf99e-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/72b9ada9-738c-4c37-96f4-5f827abdf99e-plugins-config-volume\") pod \"72b9ada9-738c-4c37-96f4-5f827abdf99e\" (UID: \"72b9ada9-738c-4c37-96f4-5f827abdf99e\") "
Oct 30 20:07:43.041055 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:43.041039    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/72b9ada9-738c-4c37-96f4-5f827abdf99e-kube-api-access-mb2pt\" (UniqueName: \"kubernetes.io/projected/72b9ada9-738c-4c37-96f4-5f827abdf99e-kube-api-access-mb2pt\") pod \"72b9ada9-738c-4c37-96f4-5f827abdf99e\" (UID: \"72b9ada9-738c-4c37-96f4-5f827abdf99e\") "
Oct 30 20:07:43.041169 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:43.041156    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/8b04ae86-d3b8-4e51-b357-25e38742b02f-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8b04ae86-d3b8-4e51-b357-25e38742b02f-plugins-config-volume\") pod \"8b04ae86-d3b8-4e51-b357-25e38742b02f\" (UID: \"8b04ae86-d3b8-4e51-b357-25e38742b02f\") "
Oct 30 20:07:43.041867 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:43.041218    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/72b9ada9-738c-4c37-96f4-5f827abdf99e-plugins-config-volume" pod "72b9ada9-738c-4c37-96f4-5f827abdf99e" (UID: "72b9ada9-738c-4c37-96f4-5f827abdf99e"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:07:43.041867 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:43.041576    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8b04ae86-d3b8-4e51-b357-25e38742b02f-plugins-config-volume" pod "8b04ae86-d3b8-4e51-b357-25e38742b02f" (UID: "8b04ae86-d3b8-4e51-b357-25e38742b02f"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:07:43.041982 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:43.041877    6275 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/72b9ada9-738c-4c37-96f4-5f827abdf99e-plugins-config-volume\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:07:43.041982 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:43.041902    6275 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8b04ae86-d3b8-4e51-b357-25e38742b02f-plugins-config-volume\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:07:43.043631 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:43.043602    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8b04ae86-d3b8-4e51-b357-25e38742b02f-kube-api-access-6csfn" pod "8b04ae86-d3b8-4e51-b357-25e38742b02f" (UID: "8b04ae86-d3b8-4e51-b357-25e38742b02f"). InnerVolumeSpecName "kube-api-access-6csfn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:07:43.043631 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:43.043626    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/72b9ada9-738c-4c37-96f4-5f827abdf99e-kube-api-access-mb2pt" pod "72b9ada9-738c-4c37-96f4-5f827abdf99e" (UID: "72b9ada9-738c-4c37-96f4-5f827abdf99e"). InnerVolumeSpecName "kube-api-access-mb2pt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:07:43.150509 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:43.147117    6275 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mb2pt\" (UniqueName: \"kubernetes.io/projected/72b9ada9-738c-4c37-96f4-5f827abdf99e-kube-api-access-mb2pt\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:07:43.150509 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:43.147152    6275 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6csfn\" (UniqueName: \"kubernetes.io/projected/8b04ae86-d3b8-4e51-b357-25e38742b02f-kube-api-access-6csfn\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:07:43.869250 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:43.869162    6275 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w3-912f24-585f6bf47-q7hqs"
Oct 30 20:07:43.869250 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:43.869189    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w3-912f24-585f6bf47-q7hqs" event={"ID":"8b04ae86-d3b8-4e51-b357-25e38742b02f","Type":"ContainerDied","Data":"2fe3a82018138e0b04c1cac1191877da88eaae01cbfb107264c81720cc2890ce"}
Oct 30 20:07:43.869777 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:43.869263    6275 scope.go:122] "RemoveContainer" containerID="b64a30d3ff021dea3b430ffac5483b0c084ee9518aeb3fe9a5d6b9d2dc7ca121"
Oct 30 20:07:43.870985 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:43.870960    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w3-912f24-7bd864565f-fvnth" event={"ID":"72b9ada9-738c-4c37-96f4-5f827abdf99e","Type":"ContainerDied","Data":"41284166c683bf002cb466bfa8be3728c87108436a4c764481f227336364d64d"}
Oct 30 20:07:43.871095 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:43.871007    6275 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w3-912f24-7bd864565f-fvnth"
Oct 30 20:07:43.880373 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:43.880351    6275 scope.go:122] "RemoveContainer" containerID="6fb1d1e604a32ab82798f59f6e3499dba0c13153708eae887e75b60600914e5e"
Oct 30 20:07:43.935933 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:43.935896    6275 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w3-912f24-7bd864565f-fvnth"]
Oct 30 20:07:43.951940 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:43.951899    6275 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w3-912f24-7bd864565f-fvnth"]
Oct 30 20:07:43.976786 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:43.976752    6275 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w3-912f24-585f6bf47-q7hqs"]
Oct 30 20:07:43.983718 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:43.983685    6275 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w3-912f24-585f6bf47-q7hqs"]
Oct 30 20:07:44.172313 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:44.171695    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-worker-w5-626870-7fd9798fc9-njdrh" podUID="17234422-ae1c-4356-8250-afe91f192888" containerName="payload-pre-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 30 20:07:44.806518 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:44.806482    6275 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-f1f016-n7fw6"]
Oct 30 20:07:44.834281 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:44.831575    6275 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-f1f016-n7fw6"]
Oct 30 20:07:45.668519 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:45.668186    6275 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="72b9ada9-738c-4c37-96f4-5f827abdf99e" path="/var/lib/kubelet/pods/72b9ada9-738c-4c37-96f4-5f827abdf99e/volumes"
Oct 30 20:07:45.675395 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:45.675361    6275 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="83b6e849-ee0d-417c-8aea-633e4a9a9f96" path="/var/lib/kubelet/pods/83b6e849-ee0d-417c-8aea-633e4a9a9f96/volumes"
Oct 30 20:07:45.675962 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:45.675938    6275 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="8b04ae86-d3b8-4e51-b357-25e38742b02f" path="/var/lib/kubelet/pods/8b04ae86-d3b8-4e51-b357-25e38742b02f/volumes"
Oct 30 20:07:46.051374 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:46.051233    6275 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w1-5f10d2-67674b9455-6zbsz"]
Oct 30 20:07:47.647349 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:47.647317    6275 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w5-626870-7fd9798fc9-njdrh"
Oct 30 20:07:47.805550 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:47.793171    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/17234422-ae1c-4356-8250-afe91f192888-kube-api-access-6nf25\" (UniqueName: \"kubernetes.io/projected/17234422-ae1c-4356-8250-afe91f192888-kube-api-access-6nf25\") pod \"17234422-ae1c-4356-8250-afe91f192888\" (UID: \"17234422-ae1c-4356-8250-afe91f192888\") "
Oct 30 20:07:47.806183 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:47.806149    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/17234422-ae1c-4356-8250-afe91f192888-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/17234422-ae1c-4356-8250-afe91f192888-plugins-config-volume\") pod \"17234422-ae1c-4356-8250-afe91f192888\" (UID: \"17234422-ae1c-4356-8250-afe91f192888\") "
Oct 30 20:07:47.808901 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:47.808863    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/17234422-ae1c-4356-8250-afe91f192888-kube-api-access-6nf25" pod "17234422-ae1c-4356-8250-afe91f192888" (UID: "17234422-ae1c-4356-8250-afe91f192888"). InnerVolumeSpecName "kube-api-access-6nf25". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:07:47.810103 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:47.810080    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/17234422-ae1c-4356-8250-afe91f192888-plugins-config-volume" pod "17234422-ae1c-4356-8250-afe91f192888" (UID: "17234422-ae1c-4356-8250-afe91f192888"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:07:47.815313 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:47.815287    6275 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/17234422-ae1c-4356-8250-afe91f192888-plugins-config-volume\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:07:47.819149 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:47.819126    6275 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6nf25\" (UniqueName: \"kubernetes.io/projected/17234422-ae1c-4356-8250-afe91f192888-kube-api-access-6nf25\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:07:47.837687 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:47.837645    6275 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-6d58de42-bk9lp"]
Oct 30 20:07:47.855712 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:47.855621    6275 cpu_manager.go:414] "containerMap: removing container" podUID="803f3028-5e38-40f3-baa2-dd3fee4093e8" containerName="revoke-keys"
Oct 30 20:07:47.862806 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:47.862775    6275 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="803f3028-5e38-40f3-baa2-dd3fee4093e8" containerName="revoke-keys"
Oct 30 20:07:47.870453 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:47.863056    6275 cpu_manager.go:414] "containerMap: removing container" podUID="4d8499e4-5a30-454c-b2e0-47f47651220f" containerName="revoke-keys"
Oct 30 20:07:47.870698 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:47.870675    6275 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="4d8499e4-5a30-454c-b2e0-47f47651220f" containerName="revoke-keys"
Oct 30 20:07:47.870820 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:47.870808    6275 cpu_manager.go:414] "containerMap: removing container" podUID="17234422-ae1c-4356-8250-afe91f192888" containerName="payload-pre-processing"
Oct 30 20:07:47.870927 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:47.870916    6275 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="17234422-ae1c-4356-8250-afe91f192888" containerName="payload-pre-processing"
Oct 30 20:07:47.886520 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:47.886480    6275 cpu_manager.go:414] "containerMap: removing container" podUID="96f19e7c-d36d-4109-bde0-24725bc670dd" containerName="main"
Oct 30 20:07:47.886747 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:47.886727    6275 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="96f19e7c-d36d-4109-bde0-24725bc670dd" containerName="main"
Oct 30 20:07:47.886879 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:47.886866    6275 cpu_manager.go:414] "containerMap: removing container" podUID="a1adddd4-3218-4a6b-a145-0290bceff76f" containerName="main"
Oct 30 20:07:47.886983 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:47.886971    6275 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="a1adddd4-3218-4a6b-a145-0290bceff76f" containerName="main"
Oct 30 20:07:47.887109 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:47.887095    6275 cpu_manager.go:414] "containerMap: removing container" podUID="8b04ae86-d3b8-4e51-b357-25e38742b02f" containerName="payload-pre-processing"
Oct 30 20:07:47.887213 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:47.887201    6275 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="8b04ae86-d3b8-4e51-b357-25e38742b02f" containerName="payload-pre-processing"
Oct 30 20:07:47.887323 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:47.887312    6275 cpu_manager.go:414] "containerMap: removing container" podUID="0e543ba9-1e7a-4d0a-9361-50c98060e824" containerName="main"
Oct 30 20:07:47.887426 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:47.887403    6275 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="0e543ba9-1e7a-4d0a-9361-50c98060e824" containerName="main"
Oct 30 20:07:47.887522 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:47.887512    6275 cpu_manager.go:414] "containerMap: removing container" podUID="7d49f1ad-8805-4090-8e72-7d828fa73f36" containerName="main"
Oct 30 20:07:47.887619 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:47.887608    6275 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="7d49f1ad-8805-4090-8e72-7d828fa73f36" containerName="main"
Oct 30 20:07:47.920437 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:47.914347    6275 cpu_manager.go:414] "containerMap: removing container" podUID="72b9ada9-738c-4c37-96f4-5f827abdf99e" containerName="payload-processing"
Oct 30 20:07:47.920437 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:47.914432    6275 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="72b9ada9-738c-4c37-96f4-5f827abdf99e" containerName="payload-processing"
Oct 30 20:07:47.920437 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:47.914468    6275 cpu_manager.go:414] "containerMap: removing container" podUID="8f3174b6-2fdc-48c2-99be-7a966731f018" containerName="main"
Oct 30 20:07:47.920437 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:47.914476    6275 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="8f3174b6-2fdc-48c2-99be-7a966731f018" containerName="main"
Oct 30 20:07:47.920437 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:47.914506    6275 cpu_manager.go:414] "containerMap: removing container" podUID="7b6639ea-72b0-49fb-b7fa-9443c1ddff6d" containerName="main"
Oct 30 20:07:47.920437 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:47.914514    6275 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="7b6639ea-72b0-49fb-b7fa-9443c1ddff6d" containerName="main"
Oct 30 20:07:47.920437 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:47.914830    6275 memory_manager.go:365] "RemoveStaleState removing state" podUID="803f3028-5e38-40f3-baa2-dd3fee4093e8" containerName="revoke-keys"
Oct 30 20:07:47.920437 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:47.914854    6275 memory_manager.go:365] "RemoveStaleState removing state" podUID="4d8499e4-5a30-454c-b2e0-47f47651220f" containerName="revoke-keys"
Oct 30 20:07:47.920437 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:47.914863    6275 memory_manager.go:365] "RemoveStaleState removing state" podUID="17234422-ae1c-4356-8250-afe91f192888" containerName="payload-pre-processing"
Oct 30 20:07:47.920437 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:47.914885    6275 memory_manager.go:365] "RemoveStaleState removing state" podUID="96f19e7c-d36d-4109-bde0-24725bc670dd" containerName="main"
Oct 30 20:07:47.920437 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:47.914895    6275 memory_manager.go:365] "RemoveStaleState removing state" podUID="a1adddd4-3218-4a6b-a145-0290bceff76f" containerName="main"
Oct 30 20:07:47.920437 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:47.914906    6275 memory_manager.go:365] "RemoveStaleState removing state" podUID="8b04ae86-d3b8-4e51-b357-25e38742b02f" containerName="payload-pre-processing"
Oct 30 20:07:47.920437 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:47.914918    6275 memory_manager.go:365] "RemoveStaleState removing state" podUID="0e543ba9-1e7a-4d0a-9361-50c98060e824" containerName="main"
Oct 30 20:07:47.920437 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:47.914926    6275 memory_manager.go:365] "RemoveStaleState removing state" podUID="7d49f1ad-8805-4090-8e72-7d828fa73f36" containerName="main"
Oct 30 20:07:47.920437 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:47.914935    6275 memory_manager.go:365] "RemoveStaleState removing state" podUID="72b9ada9-738c-4c37-96f4-5f827abdf99e" containerName="payload-processing"
Oct 30 20:07:47.920437 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:47.914945    6275 memory_manager.go:365] "RemoveStaleState removing state" podUID="8f3174b6-2fdc-48c2-99be-7a966731f018" containerName="main"
Oct 30 20:07:47.920437 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:47.914964    6275 memory_manager.go:365] "RemoveStaleState removing state" podUID="7b6639ea-72b0-49fb-b7fa-9443c1ddff6d" containerName="main"
Oct 30 20:07:48.017437 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:48.009311    6275 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-6d58de42-bk9lp"]
Oct 30 20:07:48.017437 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:48.009477    6275 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-6d58de42-bk9lp"
Oct 30 20:07:48.060477 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:48.060397    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ssjmh\" (UniqueName: \"kubernetes.io/projected/80aca8dc-febd-440a-80e8-7216a642911c-kube-api-access-ssjmh\") pod \"maas-api-revoke-sub-6d58de42-bk9lp\" (UID: \"80aca8dc-febd-440a-80e8-7216a642911c\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-6d58de42-bk9lp"
Oct 30 20:07:48.060666 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:48.060616    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/80aca8dc-febd-440a-80e8-7216a642911c-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-6d58de42-bk9lp\" (UID: \"80aca8dc-febd-440a-80e8-7216a642911c\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-6d58de42-bk9lp"
Oct 30 20:07:48.060770 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:48.060749    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/80aca8dc-febd-440a-80e8-7216a642911c-maas-api-xks-ca\") pod \"maas-api-revoke-sub-6d58de42-bk9lp\" (UID: \"80aca8dc-febd-440a-80e8-7216a642911c\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-6d58de42-bk9lp"
Oct 30 20:07:48.071428 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:48.071383    6275 generic.go:356] "Generic (PLEG): container finished" podID="17234422-ae1c-4356-8250-afe91f192888" containerID="615d5ab25cfec242f4059f688cf7dcd79178dae79976dc3375ef279474bd8697" exitCode=0
Oct 30 20:07:48.071567 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:48.071544    6275 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w5-626870-7fd9798fc9-njdrh"
Oct 30 20:07:48.071672 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:48.071645    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w5-626870-7fd9798fc9-njdrh" event={"ID":"17234422-ae1c-4356-8250-afe91f192888","Type":"ContainerDied","Data":"615d5ab25cfec242f4059f688cf7dcd79178dae79976dc3375ef279474bd8697"}
Oct 30 20:07:48.071787 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:48.071776    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w5-626870-7fd9798fc9-njdrh" event={"ID":"17234422-ae1c-4356-8250-afe91f192888","Type":"ContainerDied","Data":"5854d88d48eea672f14ec72df7630f1e8ee109e8b5609a22e04a51b4ed3c41c4"}
Oct 30 20:07:48.071869 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:48.071850    6275 scope.go:122] "RemoveContainer" containerID="615d5ab25cfec242f4059f688cf7dcd79178dae79976dc3375ef279474bd8697"
Oct 30 20:07:48.099900 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:48.099878    6275 scope.go:122] "RemoveContainer" containerID="615d5ab25cfec242f4059f688cf7dcd79178dae79976dc3375ef279474bd8697"
Oct 30 20:07:48.100256 ip-10-0-131-26 kubenswrapper[6275]: E1030 20:07:48.100233    6275 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"615d5ab25cfec242f4059f688cf7dcd79178dae79976dc3375ef279474bd8697\": container with ID starting with 615d5ab25cfec242f4059f688cf7dcd79178dae79976dc3375ef279474bd8697 not found: ID does not exist" containerID="615d5ab25cfec242f4059f688cf7dcd79178dae79976dc3375ef279474bd8697"
Oct 30 20:07:48.100347 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:48.100265    6275 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"615d5ab25cfec242f4059f688cf7dcd79178dae79976dc3375ef279474bd8697"} err="failed to get container status \"615d5ab25cfec242f4059f688cf7dcd79178dae79976dc3375ef279474bd8697\": rpc error: code = NotFound desc = could not find container \"615d5ab25cfec242f4059f688cf7dcd79178dae79976dc3375ef279474bd8697\": container with ID starting with 615d5ab25cfec242f4059f688cf7dcd79178dae79976dc3375ef279474bd8697 not found: ID does not exist"
Oct 30 20:07:48.121325 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:48.121269    6275 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\""
Oct 30 20:07:48.121452 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:48.121395    6275 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-scs2w\""
Oct 30 20:07:48.143749 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:48.143725    6275 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w5-626870-7fd9798fc9-njdrh"]
Oct 30 20:07:48.153815 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:48.153789    6275 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w5-626870-7fd9798fc9-njdrh"]
Oct 30 20:07:48.161773 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:48.161748    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ssjmh\" (UniqueName: \"kubernetes.io/projected/80aca8dc-febd-440a-80e8-7216a642911c-kube-api-access-ssjmh\") pod \"maas-api-revoke-sub-6d58de42-bk9lp\" (UID: \"80aca8dc-febd-440a-80e8-7216a642911c\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-6d58de42-bk9lp"
Oct 30 20:07:48.161881 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:48.161812    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/80aca8dc-febd-440a-80e8-7216a642911c-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-6d58de42-bk9lp\" (UID: \"80aca8dc-febd-440a-80e8-7216a642911c\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-6d58de42-bk9lp"
Oct 30 20:07:48.161927 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:48.161891    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/80aca8dc-febd-440a-80e8-7216a642911c-maas-api-xks-ca\") pod \"maas-api-revoke-sub-6d58de42-bk9lp\" (UID: \"80aca8dc-febd-440a-80e8-7216a642911c\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-6d58de42-bk9lp"
Oct 30 20:07:48.162391 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:48.162371    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/80aca8dc-febd-440a-80e8-7216a642911c-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-6d58de42-bk9lp\" (UID: \"80aca8dc-febd-440a-80e8-7216a642911c\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-6d58de42-bk9lp"
Oct 30 20:07:48.164173 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:48.164155    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/80aca8dc-febd-440a-80e8-7216a642911c-maas-api-xks-ca\") pod \"maas-api-revoke-sub-6d58de42-bk9lp\" (UID: \"80aca8dc-febd-440a-80e8-7216a642911c\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-6d58de42-bk9lp"
Oct 30 20:07:48.187782 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:48.187756    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ssjmh\" (UniqueName: \"kubernetes.io/projected/80aca8dc-febd-440a-80e8-7216a642911c-kube-api-access-ssjmh\") pod \"maas-api-revoke-sub-6d58de42-bk9lp\" (UID: \"80aca8dc-febd-440a-80e8-7216a642911c\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-6d58de42-bk9lp"
Oct 30 20:07:48.369211 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:48.369173    6275 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-6d58de42-bk9lp"
Oct 30 20:07:48.563940 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:48.563903    6275 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w3-912f24-bz4dp"]
Oct 30 20:07:48.569941 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:48.569912    6275 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w3-912f24-bz4dp"]
Oct 30 20:07:48.660048 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:48.660020    6275 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w4-f1f016-6754476fb5-jlhbg"
Oct 30 20:07:48.667800 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:48.667773    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/5bce3c0a-07d6-490e-9506-1600a2278a23-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5bce3c0a-07d6-490e-9506-1600a2278a23-plugins-config-volume\") pod \"5bce3c0a-07d6-490e-9506-1600a2278a23\" (UID: \"5bce3c0a-07d6-490e-9506-1600a2278a23\") "
Oct 30 20:07:48.667933 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:48.667893    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/5bce3c0a-07d6-490e-9506-1600a2278a23-kube-api-access-9r266\" (UniqueName: \"kubernetes.io/projected/5bce3c0a-07d6-490e-9506-1600a2278a23-kube-api-access-9r266\") pod \"5bce3c0a-07d6-490e-9506-1600a2278a23\" (UID: \"5bce3c0a-07d6-490e-9506-1600a2278a23\") "
Oct 30 20:07:48.668250 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:48.668219    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5bce3c0a-07d6-490e-9506-1600a2278a23-plugins-config-volume" pod "5bce3c0a-07d6-490e-9506-1600a2278a23" (UID: "5bce3c0a-07d6-490e-9506-1600a2278a23"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:07:48.670732 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:48.670696    6275 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5bce3c0a-07d6-490e-9506-1600a2278a23-plugins-config-volume\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:07:48.671868 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:48.671834    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5bce3c0a-07d6-490e-9506-1600a2278a23-kube-api-access-9r266" pod "5bce3c0a-07d6-490e-9506-1600a2278a23" (UID: "5bce3c0a-07d6-490e-9506-1600a2278a23"). InnerVolumeSpecName "kube-api-access-9r266". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:07:48.698161 ip-10-0-131-26 kubenswrapper[6275]: W1030 20:07:48.698113    6275 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod80aca8dc_febd_440a_80e8_7216a642911c.slice/crio-a78b03eeda3e04287fd710970b16cb1ccce99d12d1bded64ca44b3d476db312c WatchSource:0}: Error finding container a78b03eeda3e04287fd710970b16cb1ccce99d12d1bded64ca44b3d476db312c: Status 404 returned error can't find the container with id a78b03eeda3e04287fd710970b16cb1ccce99d12d1bded64ca44b3d476db312c
Oct 30 20:07:48.698319 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:48.698243    6275 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-6d58de42-bk9lp"]
Oct 30 20:07:48.715259 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:48.712931    6275 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-f1f016-568d55d755-xjm26"
Oct 30 20:07:48.772162 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:48.772130    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/0b8c41e3-9d0d-400b-839f-f186bcaae886-kube-api-access-smgqc\" (UniqueName: \"kubernetes.io/projected/0b8c41e3-9d0d-400b-839f-f186bcaae886-kube-api-access-smgqc\") pod \"0b8c41e3-9d0d-400b-839f-f186bcaae886\" (UID: \"0b8c41e3-9d0d-400b-839f-f186bcaae886\") "
Oct 30 20:07:48.772340 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:48.772204    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/0b8c41e3-9d0d-400b-839f-f186bcaae886-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0b8c41e3-9d0d-400b-839f-f186bcaae886-plugins-config-volume\") pod \"0b8c41e3-9d0d-400b-839f-f186bcaae886\" (UID: \"0b8c41e3-9d0d-400b-839f-f186bcaae886\") "
Oct 30 20:07:48.772700 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:48.772674    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0b8c41e3-9d0d-400b-839f-f186bcaae886-plugins-config-volume" pod "0b8c41e3-9d0d-400b-839f-f186bcaae886" (UID: "0b8c41e3-9d0d-400b-839f-f186bcaae886"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:07:48.773160 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:48.773138    6275 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9r266\" (UniqueName: \"kubernetes.io/projected/5bce3c0a-07d6-490e-9506-1600a2278a23-kube-api-access-9r266\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:07:48.773160 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:48.773160    6275 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0b8c41e3-9d0d-400b-839f-f186bcaae886-plugins-config-volume\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:07:48.868705 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:48.868668    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0b8c41e3-9d0d-400b-839f-f186bcaae886-kube-api-access-smgqc" pod "0b8c41e3-9d0d-400b-839f-f186bcaae886" (UID: "0b8c41e3-9d0d-400b-839f-f186bcaae886"). InnerVolumeSpecName "kube-api-access-smgqc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:07:48.874635 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:48.874603    6275 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-smgqc\" (UniqueName: \"kubernetes.io/projected/0b8c41e3-9d0d-400b-839f-f186bcaae886-kube-api-access-smgqc\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:07:49.064985 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:49.064948    6275 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-91bd96a0-nvrh5"]
Oct 30 20:07:49.072162 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:49.072126    6275 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-91bd96a0-nvrh5"]
Oct 30 20:07:49.081616 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:49.081589    6275 generic.go:356] "Generic (PLEG): container finished" podID="5bce3c0a-07d6-490e-9506-1600a2278a23" containerID="29ffbd94cf49b45ba3ea3ea225f5581c8d67534fbf513ce978bea34d8c933e1c" exitCode=0
Oct 30 20:07:49.081746 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:49.081656    6275 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w4-f1f016-6754476fb5-jlhbg"
Oct 30 20:07:49.081746 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:49.081668    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w4-f1f016-6754476fb5-jlhbg" event={"ID":"5bce3c0a-07d6-490e-9506-1600a2278a23","Type":"ContainerDied","Data":"29ffbd94cf49b45ba3ea3ea225f5581c8d67534fbf513ce978bea34d8c933e1c"}
Oct 30 20:07:49.081854 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:49.081761    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w4-f1f016-6754476fb5-jlhbg" event={"ID":"5bce3c0a-07d6-490e-9506-1600a2278a23","Type":"ContainerDied","Data":"f45173fef01f3e98cdd9df6f8d71a7e32712f4a4a8c94124dd371cc3590ff1f6"}
Oct 30 20:07:49.081854 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:49.081791    6275 scope.go:122] "RemoveContainer" containerID="29ffbd94cf49b45ba3ea3ea225f5581c8d67534fbf513ce978bea34d8c933e1c"
Oct 30 20:07:49.083737 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:49.083714    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-6d58de42-bk9lp" event={"ID":"80aca8dc-febd-440a-80e8-7216a642911c","Type":"ContainerStarted","Data":"a78b03eeda3e04287fd710970b16cb1ccce99d12d1bded64ca44b3d476db312c"}
Oct 30 20:07:49.085229 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:49.085205    6275 generic.go:356] "Generic (PLEG): container finished" podID="0b8c41e3-9d0d-400b-839f-f186bcaae886" containerID="77b58f04a9ced73eedeada330e45ae8399a23e6533bfff8b85ea5ca8147ef942" exitCode=0
Oct 30 20:07:49.085314 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:49.085235    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-f1f016-568d55d755-xjm26" event={"ID":"0b8c41e3-9d0d-400b-839f-f186bcaae886","Type":"ContainerDied","Data":"77b58f04a9ced73eedeada330e45ae8399a23e6533bfff8b85ea5ca8147ef942"}
Oct 30 20:07:49.085314 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:49.085287    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-f1f016-568d55d755-xjm26" event={"ID":"0b8c41e3-9d0d-400b-839f-f186bcaae886","Type":"ContainerDied","Data":"242984319cb3af299b5278bd894da9884780ff5dad226a8c5d8048bbe3f1dff0"}
Oct 30 20:07:49.085519 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:49.085500    6275 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-f1f016-568d55d755-xjm26"
Oct 30 20:07:49.127508 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:49.099705    6275 scope.go:122] "RemoveContainer" containerID="29ffbd94cf49b45ba3ea3ea225f5581c8d67534fbf513ce978bea34d8c933e1c"
Oct 30 20:07:49.127508 ip-10-0-131-26 kubenswrapper[6275]: E1030 20:07:49.100116    6275 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"29ffbd94cf49b45ba3ea3ea225f5581c8d67534fbf513ce978bea34d8c933e1c\": container with ID starting with 29ffbd94cf49b45ba3ea3ea225f5581c8d67534fbf513ce978bea34d8c933e1c not found: ID does not exist" containerID="29ffbd94cf49b45ba3ea3ea225f5581c8d67534fbf513ce978bea34d8c933e1c"
Oct 30 20:07:49.127508 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:49.100151    6275 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"29ffbd94cf49b45ba3ea3ea225f5581c8d67534fbf513ce978bea34d8c933e1c"} err="failed to get container status \"29ffbd94cf49b45ba3ea3ea225f5581c8d67534fbf513ce978bea34d8c933e1c\": rpc error: code = NotFound desc = could not find container \"29ffbd94cf49b45ba3ea3ea225f5581c8d67534fbf513ce978bea34d8c933e1c\": container with ID starting with 29ffbd94cf49b45ba3ea3ea225f5581c8d67534fbf513ce978bea34d8c933e1c not found: ID does not exist"
Oct 30 20:07:49.127508 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:49.100194    6275 scope.go:122] "RemoveContainer" containerID="77b58f04a9ced73eedeada330e45ae8399a23e6533bfff8b85ea5ca8147ef942"
Oct 30 20:07:49.172466 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:49.170464    6275 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w4-f1f016-6754476fb5-jlhbg"]
Oct 30 20:07:49.178868 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:49.178804    6275 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w4-f1f016-6754476fb5-jlhbg"]
Oct 30 20:07:49.193376 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:49.193347    6275 scope.go:122] "RemoveContainer" containerID="77b58f04a9ced73eedeada330e45ae8399a23e6533bfff8b85ea5ca8147ef942"
Oct 30 20:07:49.194117 ip-10-0-131-26 kubenswrapper[6275]: E1030 20:07:49.194086    6275 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"77b58f04a9ced73eedeada330e45ae8399a23e6533bfff8b85ea5ca8147ef942\": container with ID starting with 77b58f04a9ced73eedeada330e45ae8399a23e6533bfff8b85ea5ca8147ef942 not found: ID does not exist" containerID="77b58f04a9ced73eedeada330e45ae8399a23e6533bfff8b85ea5ca8147ef942"
Oct 30 20:07:49.194255 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:49.194127    6275 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"77b58f04a9ced73eedeada330e45ae8399a23e6533bfff8b85ea5ca8147ef942"} err="failed to get container status \"77b58f04a9ced73eedeada330e45ae8399a23e6533bfff8b85ea5ca8147ef942\": rpc error: code = NotFound desc = could not find container \"77b58f04a9ced73eedeada330e45ae8399a23e6533bfff8b85ea5ca8147ef942\": container with ID starting with 77b58f04a9ced73eedeada330e45ae8399a23e6533bfff8b85ea5ca8147ef942 not found: ID does not exist"
Oct 30 20:07:49.228013 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:49.227972    6275 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-f1f016-568d55d755-xjm26"]
Oct 30 20:07:49.234833 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:49.234805    6275 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-f1f016-568d55d755-xjm26"]
Oct 30 20:07:49.665181 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:49.665146    6275 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="0b8c41e3-9d0d-400b-839f-f186bcaae886" path="/var/lib/kubelet/pods/0b8c41e3-9d0d-400b-839f-f186bcaae886/volumes"
Oct 30 20:07:49.665808 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:49.665788    6275 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="17234422-ae1c-4356-8250-afe91f192888" path="/var/lib/kubelet/pods/17234422-ae1c-4356-8250-afe91f192888/volumes"
Oct 30 20:07:49.666279 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:49.666259    6275 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="2bfb097e-80f9-4b22-9b57-420533197d3e" path="/var/lib/kubelet/pods/2bfb097e-80f9-4b22-9b57-420533197d3e/volumes"
Oct 30 20:07:49.667041 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:49.667022    6275 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="38633155-417b-4291-9c29-9e2d8af2a304" path="/var/lib/kubelet/pods/38633155-417b-4291-9c29-9e2d8af2a304/volumes"
Oct 30 20:07:49.667498 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:49.667478    6275 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="5bce3c0a-07d6-490e-9506-1600a2278a23" path="/var/lib/kubelet/pods/5bce3c0a-07d6-490e-9506-1600a2278a23/volumes"
Oct 30 20:07:50.206499 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:50.183946    6275 generic.go:356] "Generic (PLEG): container finished" podID="80aca8dc-febd-440a-80e8-7216a642911c" containerID="ea0bd832eacde17de5f33c2c6e23844dad8e0f24fe7dba576381d1c3e2d6a4f2" exitCode=0
Oct 30 20:07:50.277677 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:50.187479    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-6d58de42-bk9lp" event={"ID":"80aca8dc-febd-440a-80e8-7216a642911c","Type":"ContainerDied","Data":"ea0bd832eacde17de5f33c2c6e23844dad8e0f24fe7dba576381d1c3e2d6a4f2"}
Oct 30 20:07:50.955503 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:50.954508    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-efbac3/premium-w2-efbac3-kserve-55f54cfff6-9fqbz" podUID="083136dc-91fb-454f-a782-87b004e73d1b" containerName="main" probeResult="failure" output="Get \"https://10.134.0.59:8000/ready\": context deadline exceeded"
Oct 30 20:07:50.966435 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:50.963670    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-5f10d2/premium-w1-5f10d2-kserve-644b846669-286m2" podUID="a2ff6903-c1ab-48dd-884b-d119b8ee1ed6" containerName="main" probeResult="failure" output="Get \"https://10.134.0.61:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:07:51.063442 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:51.062497    6275 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-worker-w1-5f10d2-67674b9455-6zbsz" podUID="1e73518f-783a-4762-96b8-42d3f38a5cd6" containerName="payload-processing" containerID="cri-o://4f2ab27f4b4c8ab7b8d6694289ff320156aa6aa9e051f5c587d35cce33bf6b61" gracePeriod=25
Oct 30 20:07:51.311441 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:51.309519    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-51dd62/distinct-2-w6-51dd62-kserve-79ff99c4cd-fvmb6" podUID="9ed906a7-869d-4314-9976-f50b78a6565b" containerName="main" probeResult="failure" output="Get \"https://10.134.0.105:8000/ready\": context deadline exceeded"
Oct 30 20:07:51.473705 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:51.473620    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-51dd62/simulator-w6-51dd62-kserve-d6bb4985f-65j9h" podUID="f7e1ff07-15d6-49b5-8edc-52c9d6825ed7" containerName="main" probeResult="failure" output="Get \"https://10.134.0.56:8000/ready\": context deadline exceeded"
Oct 30 20:07:51.971304 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:51.971197    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-5f10d2/distinct-w1-5f10d2-kserve-5bf49798b8-l2j84" podUID="9e831c5d-2019-4015-ac57-2b4b1b90b9b3" containerName="main" probeResult="failure" output="Get \"https://10.134.0.69:8000/ready\": context deadline exceeded"
Oct 30 20:07:52.324264 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:52.324212    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-51dd62/distinct-2-w6-51dd62-kserve-79ff99c4cd-fvmb6" podUID="9ed906a7-869d-4314-9976-f50b78a6565b" containerName="main" probeResult="failure" output="Get \"https://10.134.0.105:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:07:52.346948 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:52.346912    6275 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w6-51dd62/distinct-2-w6-51dd62-kserve-79ff99c4cd-fvmb6"
Oct 30 20:07:52.974699 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:52.974665    6275 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w6-51dd62/distinct-2-w6-51dd62-kserve-79ff99c4cd-fvmb6"
Oct 30 20:07:53.027501 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:53.023520    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-efbac3/premium-w2-efbac3-kserve-55f54cfff6-9fqbz" podUID="083136dc-91fb-454f-a782-87b004e73d1b" containerName="main" probeResult="failure" output="Get \"https://10.134.0.59:8000/ready\": context deadline exceeded"
Oct 30 20:07:53.626668 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:53.626547    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-51dd62/simulator-w6-51dd62-kserve-d6bb4985f-65j9h" podUID="f7e1ff07-15d6-49b5-8edc-52c9d6825ed7" containerName="main" probeResult="failure" output="Get \"https://10.134.0.56:8000/ready\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:07:54.298499 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:54.048873    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-51dd62/distinct-2-w6-51dd62-kserve-79ff99c4cd-fvmb6" podUID="9ed906a7-869d-4314-9976-f50b78a6565b" containerName="main" probeResult="failure" output="Get \"https://10.134.0.105:8000/ready\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:07:54.402441 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:54.322682    6275 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-6a61c2b0-vfmpd"]
Oct 30 20:07:54.419448 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:54.406508    6275 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-6a61c2b0-vfmpd"]
Oct 30 20:07:54.442593 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:54.442560    6275 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-f1f016-openshift-default-6c85499cc-697gz"]
Oct 30 20:07:54.452450 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:54.330159    6275 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-6d58de42-bk9lp"
Oct 30 20:07:54.452854 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:54.444090    6275 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w4-f1f016-openshift-default-6c85499cc-697gz" podUID="d0e72a0c-3d64-4e88-af2d-246a329f6215" containerName="istio-proxy" containerID="cri-o://7281c421542ceeb45b70aec8f7bb80efdfa3c122860c4eb37fc8d63b633d5c8b" gracePeriod=30
Oct 30 20:07:54.467873 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:54.462127    6275 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-f1f016-openshift-default-6c85499cc-zn5bc"]
Oct 30 20:07:54.467873 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:54.467030    6275 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w4-f1f016-openshift-default-6c85499cc-zn5bc" podUID="65f30ed1-2ae6-464b-8293-a36c663bde0a" containerName="istio-proxy" containerID="cri-o://33ba9d1afb3fe52e66d1b620393f61c331fa066ec19c9913797541da6a58d8e0" gracePeriod=30
Oct 30 20:07:54.510614 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:54.510490    6275 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-f1f016-openshift-default-6c85499cc-7s68h"]
Oct 30 20:07:54.511257 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:54.511224    6275 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w4-f1f016-openshift-default-6c85499cc-7s68h" podUID="e32412d9-4dc9-4ef9-af01-8adeace37d59" containerName="istio-proxy" containerID="cri-o://3e2700b73e6208967d178bac1a4f5b1e8a32d28b1fb789d99d062ac49d8ae7ec" gracePeriod=30
Oct 30 20:07:54.641771 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:54.641667    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-51dd62/simulator-w6-51dd62-kserve-d6bb4985f-65j9h" podUID="f7e1ff07-15d6-49b5-8edc-52c9d6825ed7" containerName="main" probeResult="failure" output="Get \"https://10.134.0.56:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:07:54.652541 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:54.652510    6275 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w6-51dd62/simulator-w6-51dd62-kserve-d6bb4985f-65j9h"
Oct 30 20:07:54.669669 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:54.669631    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/80aca8dc-febd-440a-80e8-7216a642911c-kube-api-access-ssjmh\" (UniqueName: \"kubernetes.io/projected/80aca8dc-febd-440a-80e8-7216a642911c-kube-api-access-ssjmh\") pod \"80aca8dc-febd-440a-80e8-7216a642911c\" (UID: \"80aca8dc-febd-440a-80e8-7216a642911c\") "
Oct 30 20:07:54.670141 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:54.670115    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/80aca8dc-febd-440a-80e8-7216a642911c-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/80aca8dc-febd-440a-80e8-7216a642911c-maas-api-xks-ca\") pod \"80aca8dc-febd-440a-80e8-7216a642911c\" (UID: \"80aca8dc-febd-440a-80e8-7216a642911c\") "
Oct 30 20:07:54.670500 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:54.670473    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/80aca8dc-febd-440a-80e8-7216a642911c-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/80aca8dc-febd-440a-80e8-7216a642911c-maas-api-openshift-ca\") pod \"80aca8dc-febd-440a-80e8-7216a642911c\" (UID: \"80aca8dc-febd-440a-80e8-7216a642911c\") "
Oct 30 20:07:54.671653 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:54.671629    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/80aca8dc-febd-440a-80e8-7216a642911c-maas-api-openshift-ca" pod "80aca8dc-febd-440a-80e8-7216a642911c" (UID: "80aca8dc-febd-440a-80e8-7216a642911c"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:07:54.774469 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:54.734205    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-5f10d2/distinct-w1-5f10d2-kserve-5bf49798b8-l2j84" podUID="9e831c5d-2019-4015-ac57-2b4b1b90b9b3" containerName="main" probeResult="failure" output="Get \"https://10.134.0.69:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:07:54.774469 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:54.772794    6275 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/80aca8dc-febd-440a-80e8-7216a642911c-maas-api-openshift-ca\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:07:54.802345 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:54.802294    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/80aca8dc-febd-440a-80e8-7216a642911c-maas-api-xks-ca" pod "80aca8dc-febd-440a-80e8-7216a642911c" (UID: "80aca8dc-febd-440a-80e8-7216a642911c"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 20:07:54.921499 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:54.897666    6275 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/80aca8dc-febd-440a-80e8-7216a642911c-maas-api-xks-ca\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:07:54.921499 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:54.914820    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/80aca8dc-febd-440a-80e8-7216a642911c-kube-api-access-ssjmh" pod "80aca8dc-febd-440a-80e8-7216a642911c" (UID: "80aca8dc-febd-440a-80e8-7216a642911c"). InnerVolumeSpecName "kube-api-access-ssjmh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:07:54.961264 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:54.956577    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-efbac3/premium-w2-efbac3-kserve-55f54cfff6-9fqbz" podUID="083136dc-91fb-454f-a782-87b004e73d1b" containerName="main" probeResult="failure" output="Get \"https://10.134.0.59:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:07:55.029440 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:55.004205    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-5f10d2/premium-w1-5f10d2-kserve-644b846669-286m2" podUID="a2ff6903-c1ab-48dd-884b-d119b8ee1ed6" containerName="main" probeResult="failure" output="Get \"https://10.134.0.61:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:07:55.058272 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:55.058223    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-51dd62/distinct-2-w6-51dd62-kserve-79ff99c4cd-fvmb6" podUID="9ed906a7-869d-4314-9976-f50b78a6565b" containerName="main" probeResult="failure" output="Get \"https://10.134.0.105:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:07:55.059200 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:55.059174    6275 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w6-51dd62/distinct-2-w6-51dd62-kserve-79ff99c4cd-fvmb6"
Oct 30 20:07:55.085452 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:55.067323    6275 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ssjmh\" (UniqueName: \"kubernetes.io/projected/80aca8dc-febd-440a-80e8-7216a642911c-kube-api-access-ssjmh\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:07:55.116506 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:55.095308    6275 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-6d58de42-bk9lp"
Oct 30 20:07:55.119576 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:55.117003    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-6d58de42-bk9lp" event={"ID":"80aca8dc-febd-440a-80e8-7216a642911c","Type":"ContainerDied","Data":"a78b03eeda3e04287fd710970b16cb1ccce99d12d1bded64ca44b3d476db312c"}
Oct 30 20:07:55.119576 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:55.118569    6275 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a78b03eeda3e04287fd710970b16cb1ccce99d12d1bded64ca44b3d476db312c"
Oct 30 20:07:55.242515 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:55.212464    6275 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w1-5f10d2/distinct-w1-5f10d2-kserve-5bf49798b8-l2j84" podUID="9e831c5d-2019-4015-ac57-2b4b1b90b9b3" containerName="main" containerID="cri-o://82b69e481aab6a4f38d0e16e3208f839e4c07a7d2f1fc2762ed1340dbe22c826" gracePeriod=45
Oct 30 20:07:55.251461 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:55.249538    6275 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w2-efbac3/premium-w2-efbac3-kserve-55f54cfff6-9fqbz" podUID="083136dc-91fb-454f-a782-87b004e73d1b" containerName="main" probeResult="failure" output="Get \"https://10.134.0.59:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:07:55.519077 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:55.518869    6275 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w1-5f10d2/premium-w1-5f10d2-kserve-644b846669-286m2" podUID="a2ff6903-c1ab-48dd-884b-d119b8ee1ed6" containerName="main" containerID="cri-o://05d58ef408538bca17176972c12e6eac1b20eaf3948d0cc83d56a0201d6d3680" gracePeriod=45
Oct 30 20:07:55.566440 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:55.564815    6275 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w5-626870-openshift-default-7cd649d59c-74vj7"]
Oct 30 20:07:55.590649 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:55.590605    6275 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w5-626870-openshift-default-7cd649d59c-74vj7" podUID="f35ca7ba-e2b8-4e65-bc7b-0051dea979e8" containerName="istio-proxy" containerID="cri-o://b2d672f4c4c542f8c81c1e59ae15e9f5e636e262235126b188ec1756c38c8a48" gracePeriod=30
Oct 30 20:07:55.735441 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:55.715566    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-51dd62/simulator-w6-51dd62-kserve-d6bb4985f-65j9h" podUID="f7e1ff07-15d6-49b5-8edc-52c9d6825ed7" containerName="main" probeResult="failure" output="Get \"https://10.134.0.56:8000/ready\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:07:55.736492 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:55.736447    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-5f10d2/distinct-w1-5f10d2-kserve-5bf49798b8-l2j84" podUID="9e831c5d-2019-4015-ac57-2b4b1b90b9b3" containerName="main" probeResult="failure" output="Get \"https://10.134.0.69:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:07:55.737312 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:55.737274    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-5f10d2/distinct-w1-5f10d2-kserve-5bf49798b8-l2j84" podUID="9e831c5d-2019-4015-ac57-2b4b1b90b9b3" containerName="main" probeResult="failure" output="Get \"https://10.134.0.69:8000/ready\": dial tcp 10.134.0.69:8000: connect: connection refused"
Oct 30 20:07:55.826854 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:55.826763    6275 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="96008440-649e-42fe-ac7a-9746bc327f0d" path="/var/lib/kubelet/pods/96008440-649e-42fe-ac7a-9746bc327f0d/volumes"
Oct 30 20:07:55.830537 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:55.830513    6275 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w1-5f10d2/distinct-w1-5f10d2-kserve-5bf49798b8-l2j84"
Oct 30 20:07:55.845749 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:55.845700    6275 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w5-626870-openshift-default-7cd649d59c-8m57h"]
Oct 30 20:07:55.885696 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:55.885647    6275 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w5-626870-openshift-default-7cd649d59c-8m57h" podUID="8c41c1e8-30e2-416d-a07e-cb0177f33ff6" containerName="istio-proxy" containerID="cri-o://443795b6bb8c0729620eaa585eb2a7e5d7c07ad6ba02cc7ec7b66e2705faf32b" gracePeriod=30
Oct 30 20:07:55.890164 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:55.885953    6275 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w5-626870-openshift-default-7cd649d59c-zchw8"]
Oct 30 20:07:55.890799 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:55.890759    6275 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w5-626870-openshift-default-7cd649d59c-zchw8" podUID="5aec32f5-a318-4b0c-9c2f-2af7f36b8fd4" containerName="istio-proxy" containerID="cri-o://f79a5b92da7715f36409d00672164dd25ee74a9f37ca8852a4f9e37e39c5ee4f" gracePeriod=30
Oct 30 20:07:55.926756 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:55.905873    6275 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w6-51dd62/distinct-2-w6-51dd62-kserve-79ff99c4cd-fvmb6"
Oct 30 20:07:55.954236 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:55.954192    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-5f10d2/distinct-w1-5f10d2-kserve-5bf49798b8-l2j84" podUID="9e831c5d-2019-4015-ac57-2b4b1b90b9b3" containerName="main" probeResult="failure" output="Get \"https://10.134.0.69:8000/ready\": dial tcp 10.134.0.69:8000: connect: connection refused"
Oct 30 20:07:55.962547 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:55.962500    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-5f10d2/premium-w1-5f10d2-kserve-644b846669-286m2" podUID="a2ff6903-c1ab-48dd-884b-d119b8ee1ed6" containerName="main" probeResult="failure" output="Get \"https://10.134.0.61:8000/ready\": dial tcp 10.134.0.61:8000: connect: connection refused"
Oct 30 20:07:56.608902 ip-10-0-131-26 kubenswrapper[6275]: E1030 20:07:56.608766    6275 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-fwc77" containerName="extractor"
Oct 30 20:07:56.724613 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:56.723689    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-51dd62/simulator-w6-51dd62-kserve-d6bb4985f-65j9h" podUID="f7e1ff07-15d6-49b5-8edc-52c9d6825ed7" containerName="main" probeResult="failure" output="Get \"https://10.134.0.56:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:07:56.836922 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:56.834626    6275 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w6-51dd62/simulator-w6-51dd62-kserve-d6bb4985f-65j9h"
Oct 30 20:07:56.902248 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:56.902200    6275 patch_prober.go:29] interesting pod/e2e-worker-w5-626870-openshift-default-7cd649d59c-8m57h container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Oct 30 20:07:56.902470 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:56.902275    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w5-626870-openshift-default-7cd649d59c-8m57h" podUID="8c41c1e8-30e2-416d-a07e-cb0177f33ff6" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 20:07:56.952435 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:56.952374    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-5f10d2/distinct-w1-5f10d2-kserve-5bf49798b8-l2j84" podUID="9e831c5d-2019-4015-ac57-2b4b1b90b9b3" containerName="main" probeResult="failure" output="Get \"https://10.134.0.69:8000/ready\": dial tcp 10.134.0.69:8000: connect: connection refused"
Oct 30 20:07:57.005117 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:57.005092    6275 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w1-5f10d2/premium-w1-5f10d2-kserve-644b846669-286m2"
Oct 30 20:07:57.022494 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:57.022462    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/a2ff6903-c1ab-48dd-884b-d119b8ee1ed6-tls-certs\" (UniqueName: \"kubernetes.io/secret/a2ff6903-c1ab-48dd-884b-d119b8ee1ed6-tls-certs\") pod \"a2ff6903-c1ab-48dd-884b-d119b8ee1ed6\" (UID: \"a2ff6903-c1ab-48dd-884b-d119b8ee1ed6\") "
Oct 30 20:07:57.022691 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:57.022535    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a2ff6903-c1ab-48dd-884b-d119b8ee1ed6-home\" (UniqueName: \"kubernetes.io/empty-dir/a2ff6903-c1ab-48dd-884b-d119b8ee1ed6-home\") pod \"a2ff6903-c1ab-48dd-884b-d119b8ee1ed6\" (UID: \"a2ff6903-c1ab-48dd-884b-d119b8ee1ed6\") "
Oct 30 20:07:57.022691 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:57.022627    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a2ff6903-c1ab-48dd-884b-d119b8ee1ed6-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a2ff6903-c1ab-48dd-884b-d119b8ee1ed6-tmp-dir\") pod \"a2ff6903-c1ab-48dd-884b-d119b8ee1ed6\" (UID: \"a2ff6903-c1ab-48dd-884b-d119b8ee1ed6\") "
Oct 30 20:07:57.022691 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:57.022666    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a2ff6903-c1ab-48dd-884b-d119b8ee1ed6-dshm\" (UniqueName: \"kubernetes.io/empty-dir/a2ff6903-c1ab-48dd-884b-d119b8ee1ed6-dshm\") pod \"a2ff6903-c1ab-48dd-884b-d119b8ee1ed6\" (UID: \"a2ff6903-c1ab-48dd-884b-d119b8ee1ed6\") "
Oct 30 20:07:57.022863 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:57.022780    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/a2ff6903-c1ab-48dd-884b-d119b8ee1ed6-kube-api-access-vf69w\" (UniqueName: \"kubernetes.io/projected/a2ff6903-c1ab-48dd-884b-d119b8ee1ed6-kube-api-access-vf69w\") pod \"a2ff6903-c1ab-48dd-884b-d119b8ee1ed6\" (UID: \"a2ff6903-c1ab-48dd-884b-d119b8ee1ed6\") "
Oct 30 20:07:57.022863 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:57.022831    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a2ff6903-c1ab-48dd-884b-d119b8ee1ed6-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a2ff6903-c1ab-48dd-884b-d119b8ee1ed6-model-cache\") pod \"a2ff6903-c1ab-48dd-884b-d119b8ee1ed6\" (UID: \"a2ff6903-c1ab-48dd-884b-d119b8ee1ed6\") "
Oct 30 20:07:57.022863 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:57.022847    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a2ff6903-c1ab-48dd-884b-d119b8ee1ed6-home" pod "a2ff6903-c1ab-48dd-884b-d119b8ee1ed6" (UID: "a2ff6903-c1ab-48dd-884b-d119b8ee1ed6"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:07:57.023010 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:57.022895    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a2ff6903-c1ab-48dd-884b-d119b8ee1ed6-tmp-dir" pod "a2ff6903-c1ab-48dd-884b-d119b8ee1ed6" (UID: "a2ff6903-c1ab-48dd-884b-d119b8ee1ed6"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:07:57.023097 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:57.023069    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a2ff6903-c1ab-48dd-884b-d119b8ee1ed6-model-cache" pod "a2ff6903-c1ab-48dd-884b-d119b8ee1ed6" (UID: "a2ff6903-c1ab-48dd-884b-d119b8ee1ed6"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:07:57.023409 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:57.023387    6275 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a2ff6903-c1ab-48dd-884b-d119b8ee1ed6-tmp-dir\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:07:57.023409 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:57.023410    6275 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a2ff6903-c1ab-48dd-884b-d119b8ee1ed6-model-cache\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:07:57.023409 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:57.023438    6275 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a2ff6903-c1ab-48dd-884b-d119b8ee1ed6-home\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:07:57.024977 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:57.024951    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a2ff6903-c1ab-48dd-884b-d119b8ee1ed6-tls-certs" pod "a2ff6903-c1ab-48dd-884b-d119b8ee1ed6" (UID: "a2ff6903-c1ab-48dd-884b-d119b8ee1ed6"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 20:07:57.025066 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:57.025006    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a2ff6903-c1ab-48dd-884b-d119b8ee1ed6-kube-api-access-vf69w" pod "a2ff6903-c1ab-48dd-884b-d119b8ee1ed6" (UID: "a2ff6903-c1ab-48dd-884b-d119b8ee1ed6"). InnerVolumeSpecName "kube-api-access-vf69w". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:07:57.025103 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:57.025064    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a2ff6903-c1ab-48dd-884b-d119b8ee1ed6-dshm" pod "a2ff6903-c1ab-48dd-884b-d119b8ee1ed6" (UID: "a2ff6903-c1ab-48dd-884b-d119b8ee1ed6"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:07:57.125013 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:57.124925    6275 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a2ff6903-c1ab-48dd-884b-d119b8ee1ed6-tls-certs\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:07:57.125013 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:57.124959    6275 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a2ff6903-c1ab-48dd-884b-d119b8ee1ed6-dshm\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:07:57.125013 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:57.124969    6275 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vf69w\" (UniqueName: \"kubernetes.io/projected/a2ff6903-c1ab-48dd-884b-d119b8ee1ed6-kube-api-access-vf69w\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:07:57.157585 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:57.157555    6275 generic.go:356] "Generic (PLEG): container finished" podID="9e831c5d-2019-4015-ac57-2b4b1b90b9b3" containerID="82b69e481aab6a4f38d0e16e3208f839e4c07a7d2f1fc2762ed1340dbe22c826" exitCode=0
Oct 30 20:07:57.157745 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:57.157624    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w1-5f10d2/distinct-w1-5f10d2-kserve-5bf49798b8-l2j84" event={"ID":"9e831c5d-2019-4015-ac57-2b4b1b90b9b3","Type":"ContainerDied","Data":"82b69e481aab6a4f38d0e16e3208f839e4c07a7d2f1fc2762ed1340dbe22c826"}
Oct 30 20:07:57.159068 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:57.159048    6275 generic.go:356] "Generic (PLEG): container finished" podID="a2ff6903-c1ab-48dd-884b-d119b8ee1ed6" containerID="05d58ef408538bca17176972c12e6eac1b20eaf3948d0cc83d56a0201d6d3680" exitCode=0
Oct 30 20:07:57.159172 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:57.159096    6275 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w1-5f10d2/premium-w1-5f10d2-kserve-644b846669-286m2"
Oct 30 20:07:57.159172 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:57.159131    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w1-5f10d2/premium-w1-5f10d2-kserve-644b846669-286m2" event={"ID":"a2ff6903-c1ab-48dd-884b-d119b8ee1ed6","Type":"ContainerDied","Data":"05d58ef408538bca17176972c12e6eac1b20eaf3948d0cc83d56a0201d6d3680"}
Oct 30 20:07:57.159243 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:57.159174    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w1-5f10d2/premium-w1-5f10d2-kserve-644b846669-286m2" event={"ID":"a2ff6903-c1ab-48dd-884b-d119b8ee1ed6","Type":"ContainerDied","Data":"dd707d261494810086dedb9d33edc06022bbd992077935224c91ddff4da87678"}
Oct 30 20:07:57.159243 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:57.159195    6275 scope.go:122] "RemoveContainer" containerID="05d58ef408538bca17176972c12e6eac1b20eaf3948d0cc83d56a0201d6d3680"
Oct 30 20:07:57.170662 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:57.170636    6275 scope.go:122] "RemoveContainer" containerID="05d58ef408538bca17176972c12e6eac1b20eaf3948d0cc83d56a0201d6d3680"
Oct 30 20:07:57.170963 ip-10-0-131-26 kubenswrapper[6275]: E1030 20:07:57.170943    6275 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"05d58ef408538bca17176972c12e6eac1b20eaf3948d0cc83d56a0201d6d3680\": container with ID starting with 05d58ef408538bca17176972c12e6eac1b20eaf3948d0cc83d56a0201d6d3680 not found: ID does not exist" containerID="05d58ef408538bca17176972c12e6eac1b20eaf3948d0cc83d56a0201d6d3680"
Oct 30 20:07:57.171033 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:57.170972    6275 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"05d58ef408538bca17176972c12e6eac1b20eaf3948d0cc83d56a0201d6d3680"} err="failed to get container status \"05d58ef408538bca17176972c12e6eac1b20eaf3948d0cc83d56a0201d6d3680\": rpc error: code = NotFound desc = could not find container \"05d58ef408538bca17176972c12e6eac1b20eaf3948d0cc83d56a0201d6d3680\": container with ID starting with 05d58ef408538bca17176972c12e6eac1b20eaf3948d0cc83d56a0201d6d3680 not found: ID does not exist"
Oct 30 20:07:57.258754 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:57.258720    6275 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w1-5f10d2/premium-w1-5f10d2-kserve-644b846669-286m2"]
Oct 30 20:07:57.274641 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:57.274607    6275 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w1-5f10d2/premium-w1-5f10d2-kserve-644b846669-286m2"]
Oct 30 20:07:57.662318 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:57.662288    6275 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="a2ff6903-c1ab-48dd-884b-d119b8ee1ed6" path="/var/lib/kubelet/pods/a2ff6903-c1ab-48dd-884b-d119b8ee1ed6/volumes"
Oct 30 20:07:57.702894 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:57.702868    6275 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w1-5f10d2/distinct-w1-5f10d2-kserve-5bf49798b8-l2j84"
Oct 30 20:07:57.732590 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:57.732557    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9e831c5d-2019-4015-ac57-2b4b1b90b9b3-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9e831c5d-2019-4015-ac57-2b4b1b90b9b3-tmp-dir\") pod \"9e831c5d-2019-4015-ac57-2b4b1b90b9b3\" (UID: \"9e831c5d-2019-4015-ac57-2b4b1b90b9b3\") "
Oct 30 20:07:57.732590 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:57.732594    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9e831c5d-2019-4015-ac57-2b4b1b90b9b3-home\" (UniqueName: \"kubernetes.io/empty-dir/9e831c5d-2019-4015-ac57-2b4b1b90b9b3-home\") pod \"9e831c5d-2019-4015-ac57-2b4b1b90b9b3\" (UID: \"9e831c5d-2019-4015-ac57-2b4b1b90b9b3\") "
Oct 30 20:07:57.732848 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:57.732740    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9e831c5d-2019-4015-ac57-2b4b1b90b9b3-dshm\" (UniqueName: \"kubernetes.io/empty-dir/9e831c5d-2019-4015-ac57-2b4b1b90b9b3-dshm\") pod \"9e831c5d-2019-4015-ac57-2b4b1b90b9b3\" (UID: \"9e831c5d-2019-4015-ac57-2b4b1b90b9b3\") "
Oct 30 20:07:57.732848 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:57.732781    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9e831c5d-2019-4015-ac57-2b4b1b90b9b3-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9e831c5d-2019-4015-ac57-2b4b1b90b9b3-model-cache\") pod \"9e831c5d-2019-4015-ac57-2b4b1b90b9b3\" (UID: \"9e831c5d-2019-4015-ac57-2b4b1b90b9b3\") "
Oct 30 20:07:57.732946 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:57.732898    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9e831c5d-2019-4015-ac57-2b4b1b90b9b3-tmp-dir" pod "9e831c5d-2019-4015-ac57-2b4b1b90b9b3" (UID: "9e831c5d-2019-4015-ac57-2b4b1b90b9b3"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:07:57.732946 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:57.732907    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/9e831c5d-2019-4015-ac57-2b4b1b90b9b3-tls-certs\" (UniqueName: \"kubernetes.io/secret/9e831c5d-2019-4015-ac57-2b4b1b90b9b3-tls-certs\") pod \"9e831c5d-2019-4015-ac57-2b4b1b90b9b3\" (UID: \"9e831c5d-2019-4015-ac57-2b4b1b90b9b3\") "
Oct 30 20:07:57.732946 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:57.732915    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9e831c5d-2019-4015-ac57-2b4b1b90b9b3-home" pod "9e831c5d-2019-4015-ac57-2b4b1b90b9b3" (UID: "9e831c5d-2019-4015-ac57-2b4b1b90b9b3"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:07:57.733100 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:57.732953    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/9e831c5d-2019-4015-ac57-2b4b1b90b9b3-kube-api-access-dbzx2\" (UniqueName: \"kubernetes.io/projected/9e831c5d-2019-4015-ac57-2b4b1b90b9b3-kube-api-access-dbzx2\") pod \"9e831c5d-2019-4015-ac57-2b4b1b90b9b3\" (UID: \"9e831c5d-2019-4015-ac57-2b4b1b90b9b3\") "
Oct 30 20:07:57.733205 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:57.733185    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9e831c5d-2019-4015-ac57-2b4b1b90b9b3-model-cache" pod "9e831c5d-2019-4015-ac57-2b4b1b90b9b3" (UID: "9e831c5d-2019-4015-ac57-2b4b1b90b9b3"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:07:57.733821 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:57.733797    6275 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9e831c5d-2019-4015-ac57-2b4b1b90b9b3-tmp-dir\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:07:57.733821 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:57.733821    6275 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9e831c5d-2019-4015-ac57-2b4b1b90b9b3-home\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:07:57.734008 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:57.733835    6275 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9e831c5d-2019-4015-ac57-2b4b1b90b9b3-model-cache\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:07:57.734989 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:57.734962    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9e831c5d-2019-4015-ac57-2b4b1b90b9b3-dshm" pod "9e831c5d-2019-4015-ac57-2b4b1b90b9b3" (UID: "9e831c5d-2019-4015-ac57-2b4b1b90b9b3"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:07:57.735147 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:57.735126    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9e831c5d-2019-4015-ac57-2b4b1b90b9b3-kube-api-access-dbzx2" pod "9e831c5d-2019-4015-ac57-2b4b1b90b9b3" (UID: "9e831c5d-2019-4015-ac57-2b4b1b90b9b3"). InnerVolumeSpecName "kube-api-access-dbzx2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:07:57.735212 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:57.735197    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9e831c5d-2019-4015-ac57-2b4b1b90b9b3-tls-certs" pod "9e831c5d-2019-4015-ac57-2b4b1b90b9b3" (UID: "9e831c5d-2019-4015-ac57-2b4b1b90b9b3"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 20:07:57.835367 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:57.835287    6275 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9e831c5d-2019-4015-ac57-2b4b1b90b9b3-tls-certs\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:07:57.835367 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:57.835317    6275 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dbzx2\" (UniqueName: \"kubernetes.io/projected/9e831c5d-2019-4015-ac57-2b4b1b90b9b3-kube-api-access-dbzx2\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:07:57.835367 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:57.835329    6275 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9e831c5d-2019-4015-ac57-2b4b1b90b9b3-dshm\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:07:57.962579 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:57.962540    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-5f10d2/premium-w1-5f10d2-kserve-644b846669-286m2" podUID="a2ff6903-c1ab-48dd-884b-d119b8ee1ed6" containerName="main" probeResult="failure" output="Get \"https://10.134.0.61:8000/ready\": context deadline exceeded"
Oct 30 20:07:58.168296 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:58.168203    6275 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w1-5f10d2/distinct-w1-5f10d2-kserve-5bf49798b8-l2j84"
Oct 30 20:07:58.168296 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:58.168221    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w1-5f10d2/distinct-w1-5f10d2-kserve-5bf49798b8-l2j84" event={"ID":"9e831c5d-2019-4015-ac57-2b4b1b90b9b3","Type":"ContainerDied","Data":"a21d2db5c56411674f6474169efe24fefecfd967d224e720596f0dbd93546952"}
Oct 30 20:07:58.168296 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:58.168267    6275 scope.go:122] "RemoveContainer" containerID="82b69e481aab6a4f38d0e16e3208f839e4c07a7d2f1fc2762ed1340dbe22c826"
Oct 30 20:07:58.227776 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:58.227747    6275 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w1-5f10d2/distinct-w1-5f10d2-kserve-5bf49798b8-l2j84"]
Oct 30 20:07:58.238001 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:58.237974    6275 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w1-5f10d2/distinct-w1-5f10d2-kserve-5bf49798b8-l2j84"]
Oct 30 20:07:59.196030 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:59.195989    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-processing-e2e-worker-w1-5f10d2-67674b9455-6zbsz" podUID="1e73518f-783a-4762-96b8-42d3f38a5cd6" containerName="payload-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 30 20:07:59.289536 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:59.289504    6275 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w3-912f24-openshift-default-5f56ff5f6c-sth92"]
Oct 30 20:07:59.289749 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:59.289722    6275 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w3-912f24-openshift-default-5f56ff5f6c-sth92" podUID="8a7d6f48-c37d-4f85-82e1-46b8b330b366" containerName="istio-proxy" containerID="cri-o://2b9f21f1056f1c31d49cdf332613ebabf786eb908ba2bdc51c2c96cba9a9cca5" gracePeriod=30
Oct 30 20:07:59.327124 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:59.327094    6275 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w3-912f24-openshift-default-5f56ff5f6c-w5dh9"]
Oct 30 20:07:59.327316 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:59.327295    6275 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w3-912f24-openshift-default-5f56ff5f6c-w5dh9" podUID="d499ec6a-7c42-4ba2-b4c6-19c6fe1caa99" containerName="istio-proxy" containerID="cri-o://3dcc11efdf9b09a50116a56af3f886d34ca66a8c4800f9c2ee602fda7ed1c898" gracePeriod=30
Oct 30 20:07:59.349230 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:59.349185    6275 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w3-912f24-openshift-default-5f56ff5f6c-r7hx2"]
Oct 30 20:07:59.349481 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:59.349437    6275 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w3-912f24-openshift-default-5f56ff5f6c-r7hx2" podUID="88b5def9-2eb1-476e-a3ba-8f5b5ac6c32f" containerName="istio-proxy" containerID="cri-o://5c918d4a452b1a9f10e29341541dbb47115deed9914cd1bad4bea9e631a25646" gracePeriod=30
Oct 30 20:07:59.362979 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:59.362948    6275 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-7a9e878d-xhhls"]
Oct 30 20:07:59.363670 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:59.363636    6275 cpu_manager.go:414] "containerMap: removing container" podUID="9e831c5d-2019-4015-ac57-2b4b1b90b9b3" containerName="main"
Oct 30 20:07:59.363670 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:59.363661    6275 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="9e831c5d-2019-4015-ac57-2b4b1b90b9b3" containerName="main"
Oct 30 20:07:59.363821 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:59.363689    6275 cpu_manager.go:414] "containerMap: removing container" podUID="a2ff6903-c1ab-48dd-884b-d119b8ee1ed6" containerName="main"
Oct 30 20:07:59.363821 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:59.363698    6275 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="a2ff6903-c1ab-48dd-884b-d119b8ee1ed6" containerName="main"
Oct 30 20:07:59.363821 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:59.363711    6275 cpu_manager.go:414] "containerMap: removing container" podUID="80aca8dc-febd-440a-80e8-7216a642911c" containerName="revoke-keys"
Oct 30 20:07:59.363821 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:59.363719    6275 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="80aca8dc-febd-440a-80e8-7216a642911c" containerName="revoke-keys"
Oct 30 20:07:59.363821 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:59.363756    6275 cpu_manager.go:414] "containerMap: removing container" podUID="5bce3c0a-07d6-490e-9506-1600a2278a23" containerName="payload-processing"
Oct 30 20:07:59.363821 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:59.363764    6275 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="5bce3c0a-07d6-490e-9506-1600a2278a23" containerName="payload-processing"
Oct 30 20:07:59.363821 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:59.363799    6275 cpu_manager.go:414] "containerMap: removing container" podUID="0b8c41e3-9d0d-400b-839f-f186bcaae886" containerName="payload-pre-processing"
Oct 30 20:07:59.363821 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:59.363807    6275 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="0b8c41e3-9d0d-400b-839f-f186bcaae886" containerName="payload-pre-processing"
Oct 30 20:07:59.364136 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:59.363980    6275 memory_manager.go:365] "RemoveStaleState removing state" podUID="0b8c41e3-9d0d-400b-839f-f186bcaae886" containerName="payload-pre-processing"
Oct 30 20:07:59.364136 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:59.363994    6275 memory_manager.go:365] "RemoveStaleState removing state" podUID="9e831c5d-2019-4015-ac57-2b4b1b90b9b3" containerName="main"
Oct 30 20:07:59.364136 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:59.364002    6275 memory_manager.go:365] "RemoveStaleState removing state" podUID="a2ff6903-c1ab-48dd-884b-d119b8ee1ed6" containerName="main"
Oct 30 20:07:59.364136 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:59.364007    6275 memory_manager.go:365] "RemoveStaleState removing state" podUID="80aca8dc-febd-440a-80e8-7216a642911c" containerName="revoke-keys"
Oct 30 20:07:59.364136 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:59.364022    6275 memory_manager.go:365] "RemoveStaleState removing state" podUID="5bce3c0a-07d6-490e-9506-1600a2278a23" containerName="payload-processing"
Oct 30 20:07:59.369315 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:59.369296    6275 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-7a9e878d-xhhls"
Oct 30 20:07:59.393573 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:59.392819    6275 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-scs2w\""
Oct 30 20:07:59.411471 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:59.399003    6275 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\""
Oct 30 20:07:59.411471 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:59.400352    6275 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-7a9e878d-xhhls"]
Oct 30 20:07:59.460496 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:59.458629    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/2df32608-dcec-4946-acc6-957287e09fbb-maas-api-xks-ca\") pod \"maas-api-revoke-sub-7a9e878d-xhhls\" (UID: \"2df32608-dcec-4946-acc6-957287e09fbb\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-7a9e878d-xhhls"
Oct 30 20:07:59.460496 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:59.458680    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/2df32608-dcec-4946-acc6-957287e09fbb-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-7a9e878d-xhhls\" (UID: \"2df32608-dcec-4946-acc6-957287e09fbb\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-7a9e878d-xhhls"
Oct 30 20:07:59.460496 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:59.458876    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-72wlk\" (UniqueName: \"kubernetes.io/projected/2df32608-dcec-4946-acc6-957287e09fbb-kube-api-access-72wlk\") pod \"maas-api-revoke-sub-7a9e878d-xhhls\" (UID: \"2df32608-dcec-4946-acc6-957287e09fbb\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-7a9e878d-xhhls"
Oct 30 20:07:59.559730 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:59.559693    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/2df32608-dcec-4946-acc6-957287e09fbb-maas-api-xks-ca\") pod \"maas-api-revoke-sub-7a9e878d-xhhls\" (UID: \"2df32608-dcec-4946-acc6-957287e09fbb\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-7a9e878d-xhhls"
Oct 30 20:07:59.559730 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:59.559732    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/2df32608-dcec-4946-acc6-957287e09fbb-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-7a9e878d-xhhls\" (UID: \"2df32608-dcec-4946-acc6-957287e09fbb\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-7a9e878d-xhhls"
Oct 30 20:07:59.559912 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:59.559797    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-72wlk\" (UniqueName: \"kubernetes.io/projected/2df32608-dcec-4946-acc6-957287e09fbb-kube-api-access-72wlk\") pod \"maas-api-revoke-sub-7a9e878d-xhhls\" (UID: \"2df32608-dcec-4946-acc6-957287e09fbb\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-7a9e878d-xhhls"
Oct 30 20:07:59.560490 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:59.560469    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/2df32608-dcec-4946-acc6-957287e09fbb-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-7a9e878d-xhhls\" (UID: \"2df32608-dcec-4946-acc6-957287e09fbb\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-7a9e878d-xhhls"
Oct 30 20:07:59.562149 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:59.562125    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/2df32608-dcec-4946-acc6-957287e09fbb-maas-api-xks-ca\") pod \"maas-api-revoke-sub-7a9e878d-xhhls\" (UID: \"2df32608-dcec-4946-acc6-957287e09fbb\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-7a9e878d-xhhls"
Oct 30 20:07:59.587862 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:59.587822    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-72wlk\" (UniqueName: \"kubernetes.io/projected/2df32608-dcec-4946-acc6-957287e09fbb-kube-api-access-72wlk\") pod \"maas-api-revoke-sub-7a9e878d-xhhls\" (UID: \"2df32608-dcec-4946-acc6-957287e09fbb\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-7a9e878d-xhhls"
Oct 30 20:07:59.658576 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:59.658539    6275 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="9e831c5d-2019-4015-ac57-2b4b1b90b9b3" path="/var/lib/kubelet/pods/9e831c5d-2019-4015-ac57-2b4b1b90b9b3/volumes"
Oct 30 20:07:59.685079 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:07:59.685049    6275 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-7a9e878d-xhhls"
Oct 30 20:08:00.080618 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:00.080586    6275 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-7a9e878d-xhhls"]
Oct 30 20:08:00.082341 ip-10-0-131-26 kubenswrapper[6275]: W1030 20:08:00.082308    6275 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2df32608_dcec_4946_acc6_957287e09fbb.slice/crio-bc0221a9f4d5035161247e81e8af94b19d0314ce9c15f029b625f910af227f93 WatchSource:0}: Error finding container bc0221a9f4d5035161247e81e8af94b19d0314ce9c15f029b625f910af227f93: Status 404 returned error can't find the container with id bc0221a9f4d5035161247e81e8af94b19d0314ce9c15f029b625f910af227f93
Oct 30 20:08:00.174228 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:00.174198    6275 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-f1f016-openshift-default-6c85499cc-7s68h"
Oct 30 20:08:00.195454 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:00.194898    6275 generic.go:356] "Generic (PLEG): container finished" podID="e32412d9-4dc9-4ef9-af01-8adeace37d59" containerID="3e2700b73e6208967d178bac1a4f5b1e8a32d28b1fb789d99d062ac49d8ae7ec" exitCode=0
Oct 30 20:08:00.195454 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:00.195154    6275 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-f1f016-openshift-default-6c85499cc-7s68h"
Oct 30 20:08:00.195454 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:00.195289    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-f1f016-openshift-default-6c85499cc-7s68h" event={"ID":"e32412d9-4dc9-4ef9-af01-8adeace37d59","Type":"ContainerDied","Data":"3e2700b73e6208967d178bac1a4f5b1e8a32d28b1fb789d99d062ac49d8ae7ec"}
Oct 30 20:08:00.195454 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:00.195329    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-f1f016-openshift-default-6c85499cc-7s68h" event={"ID":"e32412d9-4dc9-4ef9-af01-8adeace37d59","Type":"ContainerDied","Data":"1d302c0c890e29c4cc7162193541cbb520ac4dd80b021f7f1f7b556020afa9b1"}
Oct 30 20:08:00.195454 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:00.195351    6275 scope.go:122] "RemoveContainer" containerID="3e2700b73e6208967d178bac1a4f5b1e8a32d28b1fb789d99d062ac49d8ae7ec"
Oct 30 20:08:00.197461 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:00.197391    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-7a9e878d-xhhls" event={"ID":"2df32608-dcec-4946-acc6-957287e09fbb","Type":"ContainerStarted","Data":"bc0221a9f4d5035161247e81e8af94b19d0314ce9c15f029b625f910af227f93"}
Oct 30 20:08:00.207884 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:00.207860    6275 scope.go:122] "RemoveContainer" containerID="3e2700b73e6208967d178bac1a4f5b1e8a32d28b1fb789d99d062ac49d8ae7ec"
Oct 30 20:08:00.208200 ip-10-0-131-26 kubenswrapper[6275]: E1030 20:08:00.208177    6275 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3e2700b73e6208967d178bac1a4f5b1e8a32d28b1fb789d99d062ac49d8ae7ec\": container with ID starting with 3e2700b73e6208967d178bac1a4f5b1e8a32d28b1fb789d99d062ac49d8ae7ec not found: ID does not exist" containerID="3e2700b73e6208967d178bac1a4f5b1e8a32d28b1fb789d99d062ac49d8ae7ec"
Oct 30 20:08:00.208300 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:00.208209    6275 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3e2700b73e6208967d178bac1a4f5b1e8a32d28b1fb789d99d062ac49d8ae7ec"} err="failed to get container status \"3e2700b73e6208967d178bac1a4f5b1e8a32d28b1fb789d99d062ac49d8ae7ec\": rpc error: code = NotFound desc = could not find container \"3e2700b73e6208967d178bac1a4f5b1e8a32d28b1fb789d99d062ac49d8ae7ec\": container with ID starting with 3e2700b73e6208967d178bac1a4f5b1e8a32d28b1fb789d99d062ac49d8ae7ec not found: ID does not exist"
Oct 30 20:08:00.270505 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:00.270472    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e32412d9-4dc9-4ef9-af01-8adeace37d59-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e32412d9-4dc9-4ef9-af01-8adeace37d59-workload-certs\") pod \"e32412d9-4dc9-4ef9-af01-8adeace37d59\" (UID: \"e32412d9-4dc9-4ef9-af01-8adeace37d59\") "
Oct 30 20:08:00.270663 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:00.270513    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/e32412d9-4dc9-4ef9-af01-8adeace37d59-kube-api-access-wxs7d\" (UniqueName: \"kubernetes.io/projected/e32412d9-4dc9-4ef9-af01-8adeace37d59-kube-api-access-wxs7d\") pod \"e32412d9-4dc9-4ef9-af01-8adeace37d59\" (UID: \"e32412d9-4dc9-4ef9-af01-8adeace37d59\") "
Oct 30 20:08:00.270663 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:00.270548    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e32412d9-4dc9-4ef9-af01-8adeace37d59-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e32412d9-4dc9-4ef9-af01-8adeace37d59-workload-socket\") pod \"e32412d9-4dc9-4ef9-af01-8adeace37d59\" (UID: \"e32412d9-4dc9-4ef9-af01-8adeace37d59\") "
Oct 30 20:08:00.270663 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:00.270577    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e32412d9-4dc9-4ef9-af01-8adeace37d59-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e32412d9-4dc9-4ef9-af01-8adeace37d59-credential-socket\") pod \"e32412d9-4dc9-4ef9-af01-8adeace37d59\" (UID: \"e32412d9-4dc9-4ef9-af01-8adeace37d59\") "
Oct 30 20:08:00.270663 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:00.270595    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/e32412d9-4dc9-4ef9-af01-8adeace37d59-istio-token\" (UniqueName: \"kubernetes.io/projected/e32412d9-4dc9-4ef9-af01-8adeace37d59-istio-token\") pod \"e32412d9-4dc9-4ef9-af01-8adeace37d59\" (UID: \"e32412d9-4dc9-4ef9-af01-8adeace37d59\") "
Oct 30 20:08:00.270663 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:00.270623    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/e32412d9-4dc9-4ef9-af01-8adeace37d59-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e32412d9-4dc9-4ef9-af01-8adeace37d59-istiod-ca-cert\") pod \"e32412d9-4dc9-4ef9-af01-8adeace37d59\" (UID: \"e32412d9-4dc9-4ef9-af01-8adeace37d59\") "
Oct 30 20:08:00.270935 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:00.270764    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e32412d9-4dc9-4ef9-af01-8adeace37d59-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e32412d9-4dc9-4ef9-af01-8adeace37d59-istio-data\") pod \"e32412d9-4dc9-4ef9-af01-8adeace37d59\" (UID: \"e32412d9-4dc9-4ef9-af01-8adeace37d59\") "
Oct 30 20:08:00.270935 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:00.270770    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e32412d9-4dc9-4ef9-af01-8adeace37d59-workload-certs" pod "e32412d9-4dc9-4ef9-af01-8adeace37d59" (UID: "e32412d9-4dc9-4ef9-af01-8adeace37d59"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:08:00.271042 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:00.270875    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e32412d9-4dc9-4ef9-af01-8adeace37d59-workload-socket" pod "e32412d9-4dc9-4ef9-af01-8adeace37d59" (UID: "e32412d9-4dc9-4ef9-af01-8adeace37d59"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:08:00.271042 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:00.270925    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/e32412d9-4dc9-4ef9-af01-8adeace37d59-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e32412d9-4dc9-4ef9-af01-8adeace37d59-istio-podinfo\") pod \"e32412d9-4dc9-4ef9-af01-8adeace37d59\" (UID: \"e32412d9-4dc9-4ef9-af01-8adeace37d59\") "
Oct 30 20:08:00.271042 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:00.271007    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e32412d9-4dc9-4ef9-af01-8adeace37d59-istio-data" pod "e32412d9-4dc9-4ef9-af01-8adeace37d59" (UID: "e32412d9-4dc9-4ef9-af01-8adeace37d59"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:08:00.271261 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:00.271069    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e32412d9-4dc9-4ef9-af01-8adeace37d59-istiod-ca-cert" pod "e32412d9-4dc9-4ef9-af01-8adeace37d59" (UID: "e32412d9-4dc9-4ef9-af01-8adeace37d59"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:08:00.271261 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:00.271081    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e32412d9-4dc9-4ef9-af01-8adeace37d59-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e32412d9-4dc9-4ef9-af01-8adeace37d59-istio-envoy\") pod \"e32412d9-4dc9-4ef9-af01-8adeace37d59\" (UID: \"e32412d9-4dc9-4ef9-af01-8adeace37d59\") "
Oct 30 20:08:00.271403 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:00.271377    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e32412d9-4dc9-4ef9-af01-8adeace37d59-credential-socket" pod "e32412d9-4dc9-4ef9-af01-8adeace37d59" (UID: "e32412d9-4dc9-4ef9-af01-8adeace37d59"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:08:00.271856 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:00.271836    6275 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e32412d9-4dc9-4ef9-af01-8adeace37d59-workload-certs\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:08:00.271908 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:00.271864    6275 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e32412d9-4dc9-4ef9-af01-8adeace37d59-workload-socket\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:08:00.271908 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:00.271880    6275 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e32412d9-4dc9-4ef9-af01-8adeace37d59-credential-socket\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:08:00.271908 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:00.271895    6275 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e32412d9-4dc9-4ef9-af01-8adeace37d59-istiod-ca-cert\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:08:00.272016 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:00.271907    6275 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e32412d9-4dc9-4ef9-af01-8adeace37d59-istio-data\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:08:00.273006 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:00.272984    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/e32412d9-4dc9-4ef9-af01-8adeace37d59-istio-podinfo" pod "e32412d9-4dc9-4ef9-af01-8adeace37d59" (UID: "e32412d9-4dc9-4ef9-af01-8adeace37d59"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 20:08:00.273101 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:00.273046    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e32412d9-4dc9-4ef9-af01-8adeace37d59-istio-token" pod "e32412d9-4dc9-4ef9-af01-8adeace37d59" (UID: "e32412d9-4dc9-4ef9-af01-8adeace37d59"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:08:00.273289 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:00.273269    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e32412d9-4dc9-4ef9-af01-8adeace37d59-kube-api-access-wxs7d" pod "e32412d9-4dc9-4ef9-af01-8adeace37d59" (UID: "e32412d9-4dc9-4ef9-af01-8adeace37d59"). InnerVolumeSpecName "kube-api-access-wxs7d". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:08:00.273387 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:00.273372    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e32412d9-4dc9-4ef9-af01-8adeace37d59-istio-envoy" pod "e32412d9-4dc9-4ef9-af01-8adeace37d59" (UID: "e32412d9-4dc9-4ef9-af01-8adeace37d59"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:08:00.373168 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:00.373100    6275 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e32412d9-4dc9-4ef9-af01-8adeace37d59-istio-podinfo\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:08:00.373168 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:00.373128    6275 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e32412d9-4dc9-4ef9-af01-8adeace37d59-istio-envoy\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:08:00.373168 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:00.373139    6275 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wxs7d\" (UniqueName: \"kubernetes.io/projected/e32412d9-4dc9-4ef9-af01-8adeace37d59-kube-api-access-wxs7d\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:08:00.373168 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:00.373148    6275 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e32412d9-4dc9-4ef9-af01-8adeace37d59-istio-token\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:08:00.556175 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:00.556143    6275 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-f1f016-openshift-default-6c85499cc-7s68h"]
Oct 30 20:08:00.561986 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:00.561959    6275 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w4-f1f016-openshift-default-6c85499cc-7s68h"]
Oct 30 20:08:01.214252 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:01.214212    6275 generic.go:356] "Generic (PLEG): container finished" podID="2df32608-dcec-4946-acc6-957287e09fbb" containerID="87cfaf2aa3a663c77ebdb8ca8164ad49bf80789409dc5f3123feed1a45335d13" exitCode=0
Oct 30 20:08:01.214727 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:01.214297    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-7a9e878d-xhhls" event={"ID":"2df32608-dcec-4946-acc6-957287e09fbb","Type":"ContainerDied","Data":"87cfaf2aa3a663c77ebdb8ca8164ad49bf80789409dc5f3123feed1a45335d13"}
Oct 30 20:08:01.345651 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:01.345620    6275 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-dc2c5ee5-q2jfx"]
Oct 30 20:08:01.346313 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:01.346295    6275 cpu_manager.go:414] "containerMap: removing container" podUID="e32412d9-4dc9-4ef9-af01-8adeace37d59" containerName="istio-proxy"
Oct 30 20:08:01.346407 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:01.346315    6275 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="e32412d9-4dc9-4ef9-af01-8adeace37d59" containerName="istio-proxy"
Oct 30 20:08:01.346503 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:01.346488    6275 memory_manager.go:365] "RemoveStaleState removing state" podUID="e32412d9-4dc9-4ef9-af01-8adeace37d59" containerName="istio-proxy"
Oct 30 20:08:01.350064 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:01.350045    6275 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-dc2c5ee5-q2jfx"
Oct 30 20:08:01.366489 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:01.366456    6275 patch_prober.go:29] interesting pod/e2e-worker-w4-f1f016-openshift-default-6c85499cc-zn5bc container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Oct 30 20:08:01.366637 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:01.366522    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w4-f1f016-openshift-default-6c85499cc-zn5bc" podUID="65f30ed1-2ae6-464b-8293-a36c663bde0a" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 20:08:01.385267 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:01.384622    6275 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-dc2c5ee5-q2jfx"]
Oct 30 20:08:01.387244 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:01.387012    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/328802e4-c003-41a2-a292-1f735cc8cec9-maas-api-xks-ca\") pod \"maas-api-revoke-sub-dc2c5ee5-q2jfx\" (UID: \"328802e4-c003-41a2-a292-1f735cc8cec9\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-dc2c5ee5-q2jfx"
Oct 30 20:08:01.387244 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:01.387061    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/328802e4-c003-41a2-a292-1f735cc8cec9-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-dc2c5ee5-q2jfx\" (UID: \"328802e4-c003-41a2-a292-1f735cc8cec9\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-dc2c5ee5-q2jfx"
Oct 30 20:08:01.387244 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:01.387088    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l9lxv\" (UniqueName: \"kubernetes.io/projected/328802e4-c003-41a2-a292-1f735cc8cec9-kube-api-access-l9lxv\") pod \"maas-api-revoke-sub-dc2c5ee5-q2jfx\" (UID: \"328802e4-c003-41a2-a292-1f735cc8cec9\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-dc2c5ee5-q2jfx"
Oct 30 20:08:01.489124 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:01.489094    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/328802e4-c003-41a2-a292-1f735cc8cec9-maas-api-xks-ca\") pod \"maas-api-revoke-sub-dc2c5ee5-q2jfx\" (UID: \"328802e4-c003-41a2-a292-1f735cc8cec9\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-dc2c5ee5-q2jfx"
Oct 30 20:08:01.489258 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:01.489150    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/328802e4-c003-41a2-a292-1f735cc8cec9-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-dc2c5ee5-q2jfx\" (UID: \"328802e4-c003-41a2-a292-1f735cc8cec9\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-dc2c5ee5-q2jfx"
Oct 30 20:08:01.489258 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:01.489178    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l9lxv\" (UniqueName: \"kubernetes.io/projected/328802e4-c003-41a2-a292-1f735cc8cec9-kube-api-access-l9lxv\") pod \"maas-api-revoke-sub-dc2c5ee5-q2jfx\" (UID: \"328802e4-c003-41a2-a292-1f735cc8cec9\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-dc2c5ee5-q2jfx"
Oct 30 20:08:01.489887 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:01.489868    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/328802e4-c003-41a2-a292-1f735cc8cec9-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-dc2c5ee5-q2jfx\" (UID: \"328802e4-c003-41a2-a292-1f735cc8cec9\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-dc2c5ee5-q2jfx"
Oct 30 20:08:01.491499 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:01.491476    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/328802e4-c003-41a2-a292-1f735cc8cec9-maas-api-xks-ca\") pod \"maas-api-revoke-sub-dc2c5ee5-q2jfx\" (UID: \"328802e4-c003-41a2-a292-1f735cc8cec9\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-dc2c5ee5-q2jfx"
Oct 30 20:08:01.515496 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:01.515470    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l9lxv\" (UniqueName: \"kubernetes.io/projected/328802e4-c003-41a2-a292-1f735cc8cec9-kube-api-access-l9lxv\") pod \"maas-api-revoke-sub-dc2c5ee5-q2jfx\" (UID: \"328802e4-c003-41a2-a292-1f735cc8cec9\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-dc2c5ee5-q2jfx"
Oct 30 20:08:01.524813 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:01.524788    6275 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-f1f016-openshift-default-6c85499cc-697gz"
Oct 30 20:08:01.590660 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:01.590582    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/d0e72a0c-3d64-4e88-af2d-246a329f6215-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d0e72a0c-3d64-4e88-af2d-246a329f6215-istio-podinfo\") pod \"d0e72a0c-3d64-4e88-af2d-246a329f6215\" (UID: \"d0e72a0c-3d64-4e88-af2d-246a329f6215\") "
Oct 30 20:08:01.592339 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:01.590855    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d0e72a0c-3d64-4e88-af2d-246a329f6215-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d0e72a0c-3d64-4e88-af2d-246a329f6215-workload-certs\") pod \"d0e72a0c-3d64-4e88-af2d-246a329f6215\" (UID: \"d0e72a0c-3d64-4e88-af2d-246a329f6215\") "
Oct 30 20:08:01.592339 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:01.591030    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d0e72a0c-3d64-4e88-af2d-246a329f6215-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d0e72a0c-3d64-4e88-af2d-246a329f6215-credential-socket\") pod \"d0e72a0c-3d64-4e88-af2d-246a329f6215\" (UID: \"d0e72a0c-3d64-4e88-af2d-246a329f6215\") "
Oct 30 20:08:01.592339 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:01.591081    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/d0e72a0c-3d64-4e88-af2d-246a329f6215-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d0e72a0c-3d64-4e88-af2d-246a329f6215-istiod-ca-cert\") pod \"d0e72a0c-3d64-4e88-af2d-246a329f6215\" (UID: \"d0e72a0c-3d64-4e88-af2d-246a329f6215\") "
Oct 30 20:08:01.592339 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:01.591126    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d0e72a0c-3d64-4e88-af2d-246a329f6215-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d0e72a0c-3d64-4e88-af2d-246a329f6215-istio-envoy\") pod \"d0e72a0c-3d64-4e88-af2d-246a329f6215\" (UID: \"d0e72a0c-3d64-4e88-af2d-246a329f6215\") "
Oct 30 20:08:01.592339 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:01.591206    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d0e72a0c-3d64-4e88-af2d-246a329f6215-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d0e72a0c-3d64-4e88-af2d-246a329f6215-istio-data\") pod \"d0e72a0c-3d64-4e88-af2d-246a329f6215\" (UID: \"d0e72a0c-3d64-4e88-af2d-246a329f6215\") "
Oct 30 20:08:01.592339 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:01.591268    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d0e72a0c-3d64-4e88-af2d-246a329f6215-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d0e72a0c-3d64-4e88-af2d-246a329f6215-workload-socket\") pod \"d0e72a0c-3d64-4e88-af2d-246a329f6215\" (UID: \"d0e72a0c-3d64-4e88-af2d-246a329f6215\") "
Oct 30 20:08:01.592339 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:01.591311    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/d0e72a0c-3d64-4e88-af2d-246a329f6215-istio-token\" (UniqueName: \"kubernetes.io/projected/d0e72a0c-3d64-4e88-af2d-246a329f6215-istio-token\") pod \"d0e72a0c-3d64-4e88-af2d-246a329f6215\" (UID: \"d0e72a0c-3d64-4e88-af2d-246a329f6215\") "
Oct 30 20:08:01.592339 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:01.591454    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/d0e72a0c-3d64-4e88-af2d-246a329f6215-kube-api-access-vjb5p\" (UniqueName: \"kubernetes.io/projected/d0e72a0c-3d64-4e88-af2d-246a329f6215-kube-api-access-vjb5p\") pod \"d0e72a0c-3d64-4e88-af2d-246a329f6215\" (UID: \"d0e72a0c-3d64-4e88-af2d-246a329f6215\") "
Oct 30 20:08:01.594144 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:01.593574    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d0e72a0c-3d64-4e88-af2d-246a329f6215-workload-certs" pod "d0e72a0c-3d64-4e88-af2d-246a329f6215" (UID: "d0e72a0c-3d64-4e88-af2d-246a329f6215"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:08:01.594144 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:01.593632    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d0e72a0c-3d64-4e88-af2d-246a329f6215-workload-socket" pod "d0e72a0c-3d64-4e88-af2d-246a329f6215" (UID: "d0e72a0c-3d64-4e88-af2d-246a329f6215"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:08:01.594144 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:01.593653    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d0e72a0c-3d64-4e88-af2d-246a329f6215-istio-data" pod "d0e72a0c-3d64-4e88-af2d-246a329f6215" (UID: "d0e72a0c-3d64-4e88-af2d-246a329f6215"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:08:01.594144 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:01.593920    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d0e72a0c-3d64-4e88-af2d-246a329f6215-credential-socket" pod "d0e72a0c-3d64-4e88-af2d-246a329f6215" (UID: "d0e72a0c-3d64-4e88-af2d-246a329f6215"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:08:01.594144 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:01.594099    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d0e72a0c-3d64-4e88-af2d-246a329f6215-istiod-ca-cert" pod "d0e72a0c-3d64-4e88-af2d-246a329f6215" (UID: "d0e72a0c-3d64-4e88-af2d-246a329f6215"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:08:01.595053 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:01.595027    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/d0e72a0c-3d64-4e88-af2d-246a329f6215-istio-podinfo" pod "d0e72a0c-3d64-4e88-af2d-246a329f6215" (UID: "d0e72a0c-3d64-4e88-af2d-246a329f6215"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 20:08:01.595288 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:01.595263    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d0e72a0c-3d64-4e88-af2d-246a329f6215-kube-api-access-vjb5p" pod "d0e72a0c-3d64-4e88-af2d-246a329f6215" (UID: "d0e72a0c-3d64-4e88-af2d-246a329f6215"). InnerVolumeSpecName "kube-api-access-vjb5p". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:08:01.596707 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:01.596676    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d0e72a0c-3d64-4e88-af2d-246a329f6215-istio-envoy" pod "d0e72a0c-3d64-4e88-af2d-246a329f6215" (UID: "d0e72a0c-3d64-4e88-af2d-246a329f6215"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:08:01.597023 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:01.597003    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d0e72a0c-3d64-4e88-af2d-246a329f6215-istio-token" pod "d0e72a0c-3d64-4e88-af2d-246a329f6215" (UID: "d0e72a0c-3d64-4e88-af2d-246a329f6215"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:08:01.644112 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:01.644086    6275 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-f1f016-openshift-default-6c85499cc-zn5bc"
Oct 30 20:08:01.659143 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:01.659112    6275 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="e32412d9-4dc9-4ef9-af01-8adeace37d59" path="/var/lib/kubelet/pods/e32412d9-4dc9-4ef9-af01-8adeace37d59/volumes"
Oct 30 20:08:01.692986 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:01.692542    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/65f30ed1-2ae6-464b-8293-a36c663bde0a-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/65f30ed1-2ae6-464b-8293-a36c663bde0a-istio-podinfo\") pod \"65f30ed1-2ae6-464b-8293-a36c663bde0a\" (UID: \"65f30ed1-2ae6-464b-8293-a36c663bde0a\") "
Oct 30 20:08:01.692986 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:01.692660    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/65f30ed1-2ae6-464b-8293-a36c663bde0a-istio-token\" (UniqueName: \"kubernetes.io/projected/65f30ed1-2ae6-464b-8293-a36c663bde0a-istio-token\") pod \"65f30ed1-2ae6-464b-8293-a36c663bde0a\" (UID: \"65f30ed1-2ae6-464b-8293-a36c663bde0a\") "
Oct 30 20:08:01.693223 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:01.693190    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/65f30ed1-2ae6-464b-8293-a36c663bde0a-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/65f30ed1-2ae6-464b-8293-a36c663bde0a-workload-socket\") pod \"65f30ed1-2ae6-464b-8293-a36c663bde0a\" (UID: \"65f30ed1-2ae6-464b-8293-a36c663bde0a\") "
Oct 30 20:08:01.693954 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:01.693296    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/65f30ed1-2ae6-464b-8293-a36c663bde0a-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/65f30ed1-2ae6-464b-8293-a36c663bde0a-istio-envoy\") pod \"65f30ed1-2ae6-464b-8293-a36c663bde0a\" (UID: \"65f30ed1-2ae6-464b-8293-a36c663bde0a\") "
Oct 30 20:08:01.693954 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:01.693455    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/65f30ed1-2ae6-464b-8293-a36c663bde0a-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/65f30ed1-2ae6-464b-8293-a36c663bde0a-istio-data\") pod \"65f30ed1-2ae6-464b-8293-a36c663bde0a\" (UID: \"65f30ed1-2ae6-464b-8293-a36c663bde0a\") "
Oct 30 20:08:01.693954 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:01.693538    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/65f30ed1-2ae6-464b-8293-a36c663bde0a-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/65f30ed1-2ae6-464b-8293-a36c663bde0a-istiod-ca-cert\") pod \"65f30ed1-2ae6-464b-8293-a36c663bde0a\" (UID: \"65f30ed1-2ae6-464b-8293-a36c663bde0a\") "
Oct 30 20:08:01.693954 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:01.693629    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/65f30ed1-2ae6-464b-8293-a36c663bde0a-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/65f30ed1-2ae6-464b-8293-a36c663bde0a-credential-socket\") pod \"65f30ed1-2ae6-464b-8293-a36c663bde0a\" (UID: \"65f30ed1-2ae6-464b-8293-a36c663bde0a\") "
Oct 30 20:08:01.693954 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:01.693779    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/65f30ed1-2ae6-464b-8293-a36c663bde0a-istio-data" pod "65f30ed1-2ae6-464b-8293-a36c663bde0a" (UID: "65f30ed1-2ae6-464b-8293-a36c663bde0a"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:08:01.693954 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:01.693936    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/65f30ed1-2ae6-464b-8293-a36c663bde0a-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/65f30ed1-2ae6-464b-8293-a36c663bde0a-workload-certs\") pod \"65f30ed1-2ae6-464b-8293-a36c663bde0a\" (UID: \"65f30ed1-2ae6-464b-8293-a36c663bde0a\") "
Oct 30 20:08:01.694360 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:01.694047    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/65f30ed1-2ae6-464b-8293-a36c663bde0a-credential-socket" pod "65f30ed1-2ae6-464b-8293-a36c663bde0a" (UID: "65f30ed1-2ae6-464b-8293-a36c663bde0a"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:08:01.694360 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:01.694165    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/65f30ed1-2ae6-464b-8293-a36c663bde0a-workload-socket" pod "65f30ed1-2ae6-464b-8293-a36c663bde0a" (UID: "65f30ed1-2ae6-464b-8293-a36c663bde0a"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:08:01.694360 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:01.694293    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/65f30ed1-2ae6-464b-8293-a36c663bde0a-kube-api-access-glkk7\" (UniqueName: \"kubernetes.io/projected/65f30ed1-2ae6-464b-8293-a36c663bde0a-kube-api-access-glkk7\") pod \"65f30ed1-2ae6-464b-8293-a36c663bde0a\" (UID: \"65f30ed1-2ae6-464b-8293-a36c663bde0a\") "
Oct 30 20:08:01.694360 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:01.694319    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/65f30ed1-2ae6-464b-8293-a36c663bde0a-workload-certs" pod "65f30ed1-2ae6-464b-8293-a36c663bde0a" (UID: "65f30ed1-2ae6-464b-8293-a36c663bde0a"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:08:01.695019 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:01.694730    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/65f30ed1-2ae6-464b-8293-a36c663bde0a-istiod-ca-cert" pod "65f30ed1-2ae6-464b-8293-a36c663bde0a" (UID: "65f30ed1-2ae6-464b-8293-a36c663bde0a"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:08:01.695231 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:01.695140    6275 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/65f30ed1-2ae6-464b-8293-a36c663bde0a-istiod-ca-cert\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:08:01.695231 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:01.695167    6275 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/65f30ed1-2ae6-464b-8293-a36c663bde0a-credential-socket\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:08:01.695231 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:01.695183    6275 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d0e72a0c-3d64-4e88-af2d-246a329f6215-credential-socket\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:08:01.695231 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:01.695197    6275 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d0e72a0c-3d64-4e88-af2d-246a329f6215-istiod-ca-cert\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:08:01.695670 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:01.695364    6275 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d0e72a0c-3d64-4e88-af2d-246a329f6215-istio-envoy\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:08:01.695670 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:01.695385    6275 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d0e72a0c-3d64-4e88-af2d-246a329f6215-istio-data\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:08:01.695670 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:01.695398    6275 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d0e72a0c-3d64-4e88-af2d-246a329f6215-workload-socket\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:08:01.695670 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:01.695431    6275 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/65f30ed1-2ae6-464b-8293-a36c663bde0a-workload-certs\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:08:01.695670 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:01.695446    6275 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d0e72a0c-3d64-4e88-af2d-246a329f6215-istio-token\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:08:01.695670 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:01.695458    6275 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vjb5p\" (UniqueName: \"kubernetes.io/projected/d0e72a0c-3d64-4e88-af2d-246a329f6215-kube-api-access-vjb5p\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:08:01.695670 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:01.695471    6275 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/65f30ed1-2ae6-464b-8293-a36c663bde0a-workload-socket\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:08:01.695670 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:01.695483    6275 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d0e72a0c-3d64-4e88-af2d-246a329f6215-istio-podinfo\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:08:01.695670 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:01.695496    6275 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d0e72a0c-3d64-4e88-af2d-246a329f6215-workload-certs\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:08:01.695670 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:01.695507    6275 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/65f30ed1-2ae6-464b-8293-a36c663bde0a-istio-data\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:08:01.696125 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:01.695868    6275 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-dc2c5ee5-q2jfx"
Oct 30 20:08:01.697976 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:01.697952    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/65f30ed1-2ae6-464b-8293-a36c663bde0a-istio-podinfo" pod "65f30ed1-2ae6-464b-8293-a36c663bde0a" (UID: "65f30ed1-2ae6-464b-8293-a36c663bde0a"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 20:08:01.699310 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:01.699273    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/65f30ed1-2ae6-464b-8293-a36c663bde0a-kube-api-access-glkk7" pod "65f30ed1-2ae6-464b-8293-a36c663bde0a" (UID: "65f30ed1-2ae6-464b-8293-a36c663bde0a"). InnerVolumeSpecName "kube-api-access-glkk7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:08:01.703808 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:01.703780    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/65f30ed1-2ae6-464b-8293-a36c663bde0a-istio-token" pod "65f30ed1-2ae6-464b-8293-a36c663bde0a" (UID: "65f30ed1-2ae6-464b-8293-a36c663bde0a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:08:01.714829 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:01.714784    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/65f30ed1-2ae6-464b-8293-a36c663bde0a-istio-envoy" pod "65f30ed1-2ae6-464b-8293-a36c663bde0a" (UID: "65f30ed1-2ae6-464b-8293-a36c663bde0a"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:08:01.797572 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:01.797239    6275 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/65f30ed1-2ae6-464b-8293-a36c663bde0a-istio-token\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:08:01.797572 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:01.797275    6275 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/65f30ed1-2ae6-464b-8293-a36c663bde0a-istio-envoy\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:08:01.797572 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:01.797289    6275 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-glkk7\" (UniqueName: \"kubernetes.io/projected/65f30ed1-2ae6-464b-8293-a36c663bde0a-kube-api-access-glkk7\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:08:01.797572 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:01.797301    6275 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/65f30ed1-2ae6-464b-8293-a36c663bde0a-istio-podinfo\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:08:02.013066 ip-10-0-131-26 kubenswrapper[6275]: W1030 20:08:02.013015    6275 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod328802e4_c003_41a2_a292_1f735cc8cec9.slice/crio-cfce027a74daec507d7b373871e976f7bc7ef30602db31026eded8066d0aa1f4 WatchSource:0}: Error finding container cfce027a74daec507d7b373871e976f7bc7ef30602db31026eded8066d0aa1f4: Status 404 returned error can't find the container with id cfce027a74daec507d7b373871e976f7bc7ef30602db31026eded8066d0aa1f4
Oct 30 20:08:02.017524 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:02.016915    6275 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-dc2c5ee5-q2jfx"]
Oct 30 20:08:02.047104 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:02.047062    6275 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-626870-openshift-default-7cd649d59c-74vj7"
Oct 30 20:08:02.102630 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:02.102212    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/f35ca7ba-e2b8-4e65-bc7b-0051dea979e8-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f35ca7ba-e2b8-4e65-bc7b-0051dea979e8-istio-podinfo\") pod \"f35ca7ba-e2b8-4e65-bc7b-0051dea979e8\" (UID: \"f35ca7ba-e2b8-4e65-bc7b-0051dea979e8\") "
Oct 30 20:08:02.103616 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:02.103589    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/f35ca7ba-e2b8-4e65-bc7b-0051dea979e8-istio-token\" (UniqueName: \"kubernetes.io/projected/f35ca7ba-e2b8-4e65-bc7b-0051dea979e8-istio-token\") pod \"f35ca7ba-e2b8-4e65-bc7b-0051dea979e8\" (UID: \"f35ca7ba-e2b8-4e65-bc7b-0051dea979e8\") "
Oct 30 20:08:02.103749 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:02.103710    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f35ca7ba-e2b8-4e65-bc7b-0051dea979e8-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f35ca7ba-e2b8-4e65-bc7b-0051dea979e8-workload-socket\") pod \"f35ca7ba-e2b8-4e65-bc7b-0051dea979e8\" (UID: \"f35ca7ba-e2b8-4e65-bc7b-0051dea979e8\") "
Oct 30 20:08:02.103749 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:02.103740    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/f35ca7ba-e2b8-4e65-bc7b-0051dea979e8-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f35ca7ba-e2b8-4e65-bc7b-0051dea979e8-istiod-ca-cert\") pod \"f35ca7ba-e2b8-4e65-bc7b-0051dea979e8\" (UID: \"f35ca7ba-e2b8-4e65-bc7b-0051dea979e8\") "
Oct 30 20:08:02.104335 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:02.103788    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f35ca7ba-e2b8-4e65-bc7b-0051dea979e8-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f35ca7ba-e2b8-4e65-bc7b-0051dea979e8-credential-socket\") pod \"f35ca7ba-e2b8-4e65-bc7b-0051dea979e8\" (UID: \"f35ca7ba-e2b8-4e65-bc7b-0051dea979e8\") "
Oct 30 20:08:02.104335 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:02.103822    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f35ca7ba-e2b8-4e65-bc7b-0051dea979e8-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f35ca7ba-e2b8-4e65-bc7b-0051dea979e8-istio-data\") pod \"f35ca7ba-e2b8-4e65-bc7b-0051dea979e8\" (UID: \"f35ca7ba-e2b8-4e65-bc7b-0051dea979e8\") "
Oct 30 20:08:02.104335 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:02.103863    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f35ca7ba-e2b8-4e65-bc7b-0051dea979e8-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f35ca7ba-e2b8-4e65-bc7b-0051dea979e8-istio-envoy\") pod \"f35ca7ba-e2b8-4e65-bc7b-0051dea979e8\" (UID: \"f35ca7ba-e2b8-4e65-bc7b-0051dea979e8\") "
Oct 30 20:08:02.104335 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:02.103912    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f35ca7ba-e2b8-4e65-bc7b-0051dea979e8-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f35ca7ba-e2b8-4e65-bc7b-0051dea979e8-workload-certs\") pod \"f35ca7ba-e2b8-4e65-bc7b-0051dea979e8\" (UID: \"f35ca7ba-e2b8-4e65-bc7b-0051dea979e8\") "
Oct 30 20:08:02.104335 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:02.104002    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/f35ca7ba-e2b8-4e65-bc7b-0051dea979e8-kube-api-access-825jx\" (UniqueName: \"kubernetes.io/projected/f35ca7ba-e2b8-4e65-bc7b-0051dea979e8-kube-api-access-825jx\") pod \"f35ca7ba-e2b8-4e65-bc7b-0051dea979e8\" (UID: \"f35ca7ba-e2b8-4e65-bc7b-0051dea979e8\") "
Oct 30 20:08:02.105428 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:02.105058    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f35ca7ba-e2b8-4e65-bc7b-0051dea979e8-credential-socket" pod "f35ca7ba-e2b8-4e65-bc7b-0051dea979e8" (UID: "f35ca7ba-e2b8-4e65-bc7b-0051dea979e8"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:08:02.105950 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:02.105833    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f35ca7ba-e2b8-4e65-bc7b-0051dea979e8-istio-data" pod "f35ca7ba-e2b8-4e65-bc7b-0051dea979e8" (UID: "f35ca7ba-e2b8-4e65-bc7b-0051dea979e8"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:08:02.105950 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:02.105896    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f35ca7ba-e2b8-4e65-bc7b-0051dea979e8-workload-socket" pod "f35ca7ba-e2b8-4e65-bc7b-0051dea979e8" (UID: "f35ca7ba-e2b8-4e65-bc7b-0051dea979e8"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:08:02.106105 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:02.106026    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f35ca7ba-e2b8-4e65-bc7b-0051dea979e8-workload-certs" pod "f35ca7ba-e2b8-4e65-bc7b-0051dea979e8" (UID: "f35ca7ba-e2b8-4e65-bc7b-0051dea979e8"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:08:02.106105 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:02.106060    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f35ca7ba-e2b8-4e65-bc7b-0051dea979e8-istiod-ca-cert" pod "f35ca7ba-e2b8-4e65-bc7b-0051dea979e8" (UID: "f35ca7ba-e2b8-4e65-bc7b-0051dea979e8"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:08:02.106264 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:02.106231    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/f35ca7ba-e2b8-4e65-bc7b-0051dea979e8-istio-podinfo" pod "f35ca7ba-e2b8-4e65-bc7b-0051dea979e8" (UID: "f35ca7ba-e2b8-4e65-bc7b-0051dea979e8"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 20:08:02.109101 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:02.109077    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f35ca7ba-e2b8-4e65-bc7b-0051dea979e8-istio-envoy" pod "f35ca7ba-e2b8-4e65-bc7b-0051dea979e8" (UID: "f35ca7ba-e2b8-4e65-bc7b-0051dea979e8"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:08:02.109755 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:02.109720    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f35ca7ba-e2b8-4e65-bc7b-0051dea979e8-kube-api-access-825jx" pod "f35ca7ba-e2b8-4e65-bc7b-0051dea979e8" (UID: "f35ca7ba-e2b8-4e65-bc7b-0051dea979e8"). InnerVolumeSpecName "kube-api-access-825jx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:08:02.112502 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:02.111362    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f35ca7ba-e2b8-4e65-bc7b-0051dea979e8-istio-token" pod "f35ca7ba-e2b8-4e65-bc7b-0051dea979e8" (UID: "f35ca7ba-e2b8-4e65-bc7b-0051dea979e8"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:08:02.160245 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:02.160210    6275 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-626870-openshift-default-7cd649d59c-zchw8"
Oct 30 20:08:02.205503 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:02.205470    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/5aec32f5-a318-4b0c-9c2f-2af7f36b8fd4-istio-token\" (UniqueName: \"kubernetes.io/projected/5aec32f5-a318-4b0c-9c2f-2af7f36b8fd4-istio-token\") pod \"5aec32f5-a318-4b0c-9c2f-2af7f36b8fd4\" (UID: \"5aec32f5-a318-4b0c-9c2f-2af7f36b8fd4\") "
Oct 30 20:08:02.205503 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:02.205506    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/5aec32f5-a318-4b0c-9c2f-2af7f36b8fd4-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5aec32f5-a318-4b0c-9c2f-2af7f36b8fd4-istiod-ca-cert\") pod \"5aec32f5-a318-4b0c-9c2f-2af7f36b8fd4\" (UID: \"5aec32f5-a318-4b0c-9c2f-2af7f36b8fd4\") "
Oct 30 20:08:02.205691 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:02.205532    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/5aec32f5-a318-4b0c-9c2f-2af7f36b8fd4-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5aec32f5-a318-4b0c-9c2f-2af7f36b8fd4-credential-socket\") pod \"5aec32f5-a318-4b0c-9c2f-2af7f36b8fd4\" (UID: \"5aec32f5-a318-4b0c-9c2f-2af7f36b8fd4\") "
Oct 30 20:08:02.205691 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:02.205601    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/5aec32f5-a318-4b0c-9c2f-2af7f36b8fd4-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5aec32f5-a318-4b0c-9c2f-2af7f36b8fd4-istio-data\") pod \"5aec32f5-a318-4b0c-9c2f-2af7f36b8fd4\" (UID: \"5aec32f5-a318-4b0c-9c2f-2af7f36b8fd4\") "
Oct 30 20:08:02.205804 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:02.205725    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/5aec32f5-a318-4b0c-9c2f-2af7f36b8fd4-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5aec32f5-a318-4b0c-9c2f-2af7f36b8fd4-istio-envoy\") pod \"5aec32f5-a318-4b0c-9c2f-2af7f36b8fd4\" (UID: \"5aec32f5-a318-4b0c-9c2f-2af7f36b8fd4\") "
Oct 30 20:08:02.205804 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:02.205769    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/5aec32f5-a318-4b0c-9c2f-2af7f36b8fd4-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5aec32f5-a318-4b0c-9c2f-2af7f36b8fd4-workload-certs\") pod \"5aec32f5-a318-4b0c-9c2f-2af7f36b8fd4\" (UID: \"5aec32f5-a318-4b0c-9c2f-2af7f36b8fd4\") "
Oct 30 20:08:02.205903 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:02.205868    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/5aec32f5-a318-4b0c-9c2f-2af7f36b8fd4-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5aec32f5-a318-4b0c-9c2f-2af7f36b8fd4-istio-podinfo\") pod \"5aec32f5-a318-4b0c-9c2f-2af7f36b8fd4\" (UID: \"5aec32f5-a318-4b0c-9c2f-2af7f36b8fd4\") "
Oct 30 20:08:02.205965 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:02.205892    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5aec32f5-a318-4b0c-9c2f-2af7f36b8fd4-credential-socket" pod "5aec32f5-a318-4b0c-9c2f-2af7f36b8fd4" (UID: "5aec32f5-a318-4b0c-9c2f-2af7f36b8fd4"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:08:02.205965 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:02.205938    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5aec32f5-a318-4b0c-9c2f-2af7f36b8fd4-istio-data" pod "5aec32f5-a318-4b0c-9c2f-2af7f36b8fd4" (UID: "5aec32f5-a318-4b0c-9c2f-2af7f36b8fd4"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:08:02.206071 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:02.205987    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5aec32f5-a318-4b0c-9c2f-2af7f36b8fd4-istiod-ca-cert" pod "5aec32f5-a318-4b0c-9c2f-2af7f36b8fd4" (UID: "5aec32f5-a318-4b0c-9c2f-2af7f36b8fd4"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:08:02.206071 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:02.206028    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/5aec32f5-a318-4b0c-9c2f-2af7f36b8fd4-kube-api-access-nvbp9\" (UniqueName: \"kubernetes.io/projected/5aec32f5-a318-4b0c-9c2f-2af7f36b8fd4-kube-api-access-nvbp9\") pod \"5aec32f5-a318-4b0c-9c2f-2af7f36b8fd4\" (UID: \"5aec32f5-a318-4b0c-9c2f-2af7f36b8fd4\") "
Oct 30 20:08:02.206071 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:02.206063    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/5aec32f5-a318-4b0c-9c2f-2af7f36b8fd4-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5aec32f5-a318-4b0c-9c2f-2af7f36b8fd4-workload-socket\") pod \"5aec32f5-a318-4b0c-9c2f-2af7f36b8fd4\" (UID: \"5aec32f5-a318-4b0c-9c2f-2af7f36b8fd4\") "
Oct 30 20:08:02.206190 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:02.206107    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5aec32f5-a318-4b0c-9c2f-2af7f36b8fd4-workload-certs" pod "5aec32f5-a318-4b0c-9c2f-2af7f36b8fd4" (UID: "5aec32f5-a318-4b0c-9c2f-2af7f36b8fd4"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:08:02.206405 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:02.206379    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5aec32f5-a318-4b0c-9c2f-2af7f36b8fd4-workload-socket" pod "5aec32f5-a318-4b0c-9c2f-2af7f36b8fd4" (UID: "5aec32f5-a318-4b0c-9c2f-2af7f36b8fd4"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:08:02.206608 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:02.206592    6275 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5aec32f5-a318-4b0c-9c2f-2af7f36b8fd4-istiod-ca-cert\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:08:02.206681 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:02.206612    6275 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5aec32f5-a318-4b0c-9c2f-2af7f36b8fd4-credential-socket\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:08:02.206681 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:02.206626    6275 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-825jx\" (UniqueName: \"kubernetes.io/projected/f35ca7ba-e2b8-4e65-bc7b-0051dea979e8-kube-api-access-825jx\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:08:02.206681 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:02.206636    6275 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5aec32f5-a318-4b0c-9c2f-2af7f36b8fd4-istio-data\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:08:02.206681 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:02.206652    6275 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f35ca7ba-e2b8-4e65-bc7b-0051dea979e8-istio-podinfo\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:08:02.206681 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:02.206665    6275 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5aec32f5-a318-4b0c-9c2f-2af7f36b8fd4-workload-certs\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:08:02.206681 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:02.206676    6275 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f35ca7ba-e2b8-4e65-bc7b-0051dea979e8-istio-token\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:08:02.206681 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:02.206684    6275 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f35ca7ba-e2b8-4e65-bc7b-0051dea979e8-workload-socket\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:08:02.207048 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:02.206692    6275 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f35ca7ba-e2b8-4e65-bc7b-0051dea979e8-istiod-ca-cert\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:08:02.207048 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:02.206700    6275 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f35ca7ba-e2b8-4e65-bc7b-0051dea979e8-credential-socket\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:08:02.207048 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:02.206708    6275 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f35ca7ba-e2b8-4e65-bc7b-0051dea979e8-istio-data\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:08:02.207048 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:02.206716    6275 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f35ca7ba-e2b8-4e65-bc7b-0051dea979e8-istio-envoy\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:08:02.207048 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:02.206724    6275 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5aec32f5-a318-4b0c-9c2f-2af7f36b8fd4-workload-socket\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:08:02.207048 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:02.206732    6275 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f35ca7ba-e2b8-4e65-bc7b-0051dea979e8-workload-certs\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:08:02.208326 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:02.208300    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5aec32f5-a318-4b0c-9c2f-2af7f36b8fd4-istio-envoy" pod "5aec32f5-a318-4b0c-9c2f-2af7f36b8fd4" (UID: "5aec32f5-a318-4b0c-9c2f-2af7f36b8fd4"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:08:02.208326 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:02.208306    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5aec32f5-a318-4b0c-9c2f-2af7f36b8fd4-kube-api-access-nvbp9" pod "5aec32f5-a318-4b0c-9c2f-2af7f36b8fd4" (UID: "5aec32f5-a318-4b0c-9c2f-2af7f36b8fd4"). InnerVolumeSpecName "kube-api-access-nvbp9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:08:02.208484 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:02.208396    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5aec32f5-a318-4b0c-9c2f-2af7f36b8fd4-istio-token" pod "5aec32f5-a318-4b0c-9c2f-2af7f36b8fd4" (UID: "5aec32f5-a318-4b0c-9c2f-2af7f36b8fd4"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:08:02.208484 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:02.208406    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/5aec32f5-a318-4b0c-9c2f-2af7f36b8fd4-istio-podinfo" pod "5aec32f5-a318-4b0c-9c2f-2af7f36b8fd4" (UID: "5aec32f5-a318-4b0c-9c2f-2af7f36b8fd4"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 20:08:02.226141 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:02.226107    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-dc2c5ee5-q2jfx" event={"ID":"328802e4-c003-41a2-a292-1f735cc8cec9","Type":"ContainerStarted","Data":"cfce027a74daec507d7b373871e976f7bc7ef30602db31026eded8066d0aa1f4"}
Oct 30 20:08:02.227796 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:02.227770    6275 generic.go:356] "Generic (PLEG): container finished" podID="d0e72a0c-3d64-4e88-af2d-246a329f6215" containerID="7281c421542ceeb45b70aec8f7bb80efdfa3c122860c4eb37fc8d63b633d5c8b" exitCode=0
Oct 30 20:08:02.227925 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:02.227823    6275 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-f1f016-openshift-default-6c85499cc-697gz"
Oct 30 20:08:02.227925 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:02.227842    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-f1f016-openshift-default-6c85499cc-697gz" event={"ID":"d0e72a0c-3d64-4e88-af2d-246a329f6215","Type":"ContainerDied","Data":"7281c421542ceeb45b70aec8f7bb80efdfa3c122860c4eb37fc8d63b633d5c8b"}
Oct 30 20:08:02.227925 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:02.227901    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-f1f016-openshift-default-6c85499cc-697gz" event={"ID":"d0e72a0c-3d64-4e88-af2d-246a329f6215","Type":"ContainerDied","Data":"f85d2c6c8a6e5854337e6d9a285493028c9a7dcb51212e881455d0a6a96aa134"}
Oct 30 20:08:02.228130 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:02.227931    6275 scope.go:122] "RemoveContainer" containerID="7281c421542ceeb45b70aec8f7bb80efdfa3c122860c4eb37fc8d63b633d5c8b"
Oct 30 20:08:02.231694 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:02.229875    6275 generic.go:356] "Generic (PLEG): container finished" podID="5aec32f5-a318-4b0c-9c2f-2af7f36b8fd4" containerID="f79a5b92da7715f36409d00672164dd25ee74a9f37ca8852a4f9e37e39c5ee4f" exitCode=0
Oct 30 20:08:02.231694 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:02.229939    6275 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-626870-openshift-default-7cd649d59c-zchw8"
Oct 30 20:08:02.231694 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:02.230025    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-626870-openshift-default-7cd649d59c-zchw8" event={"ID":"5aec32f5-a318-4b0c-9c2f-2af7f36b8fd4","Type":"ContainerDied","Data":"f79a5b92da7715f36409d00672164dd25ee74a9f37ca8852a4f9e37e39c5ee4f"}
Oct 30 20:08:02.231694 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:02.230107    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-626870-openshift-default-7cd649d59c-zchw8" event={"ID":"5aec32f5-a318-4b0c-9c2f-2af7f36b8fd4","Type":"ContainerDied","Data":"a72eee906c1fa02ec1cd33a2e45031eb0ba415de87d6737885bc470d477a83cb"}
Oct 30 20:08:02.232995 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:02.232970    6275 generic.go:356] "Generic (PLEG): container finished" podID="8c41c1e8-30e2-416d-a07e-cb0177f33ff6" containerID="443795b6bb8c0729620eaa585eb2a7e5d7c07ad6ba02cc7ec7b66e2705faf32b" exitCode=0
Oct 30 20:08:02.233112 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:02.233037    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-626870-openshift-default-7cd649d59c-8m57h" event={"ID":"8c41c1e8-30e2-416d-a07e-cb0177f33ff6","Type":"ContainerDied","Data":"443795b6bb8c0729620eaa585eb2a7e5d7c07ad6ba02cc7ec7b66e2705faf32b"}
Oct 30 20:08:02.234598 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:02.234569    6275 generic.go:356] "Generic (PLEG): container finished" podID="65f30ed1-2ae6-464b-8293-a36c663bde0a" containerID="33ba9d1afb3fe52e66d1b620393f61c331fa066ec19c9913797541da6a58d8e0" exitCode=0
Oct 30 20:08:02.234697 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:02.234621    6275 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-f1f016-openshift-default-6c85499cc-zn5bc"
Oct 30 20:08:02.234697 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:02.234659    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-f1f016-openshift-default-6c85499cc-zn5bc" event={"ID":"65f30ed1-2ae6-464b-8293-a36c663bde0a","Type":"ContainerDied","Data":"33ba9d1afb3fe52e66d1b620393f61c331fa066ec19c9913797541da6a58d8e0"}
Oct 30 20:08:02.234697 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:02.234695    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-f1f016-openshift-default-6c85499cc-zn5bc" event={"ID":"65f30ed1-2ae6-464b-8293-a36c663bde0a","Type":"ContainerDied","Data":"3118770f8b2f99adc634465a69d92e1b3915e8c2f8d08a80e5e3e4cca95e2028"}
Oct 30 20:08:02.236142 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:02.236118    6275 generic.go:356] "Generic (PLEG): container finished" podID="f35ca7ba-e2b8-4e65-bc7b-0051dea979e8" containerID="b2d672f4c4c542f8c81c1e59ae15e9f5e636e262235126b188ec1756c38c8a48" exitCode=0
Oct 30 20:08:02.236288 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:02.236260    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-626870-openshift-default-7cd649d59c-74vj7" event={"ID":"f35ca7ba-e2b8-4e65-bc7b-0051dea979e8","Type":"ContainerDied","Data":"b2d672f4c4c542f8c81c1e59ae15e9f5e636e262235126b188ec1756c38c8a48"}
Oct 30 20:08:02.236383 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:02.236314    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-626870-openshift-default-7cd649d59c-74vj7" event={"ID":"f35ca7ba-e2b8-4e65-bc7b-0051dea979e8","Type":"ContainerDied","Data":"69ea63f0e8eee487950928ef080d20e8cf257a91da902d77301aff3946365cc2"}
Oct 30 20:08:02.236383 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:02.236373    6275 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-626870-openshift-default-7cd649d59c-74vj7"
Oct 30 20:08:02.245577 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:02.245555    6275 scope.go:122] "RemoveContainer" containerID="7281c421542ceeb45b70aec8f7bb80efdfa3c122860c4eb37fc8d63b633d5c8b"
Oct 30 20:08:02.246123 ip-10-0-131-26 kubenswrapper[6275]: E1030 20:08:02.246094    6275 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7281c421542ceeb45b70aec8f7bb80efdfa3c122860c4eb37fc8d63b633d5c8b\": container with ID starting with 7281c421542ceeb45b70aec8f7bb80efdfa3c122860c4eb37fc8d63b633d5c8b not found: ID does not exist" containerID="7281c421542ceeb45b70aec8f7bb80efdfa3c122860c4eb37fc8d63b633d5c8b"
Oct 30 20:08:02.246235 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:02.246131    6275 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7281c421542ceeb45b70aec8f7bb80efdfa3c122860c4eb37fc8d63b633d5c8b"} err="failed to get container status \"7281c421542ceeb45b70aec8f7bb80efdfa3c122860c4eb37fc8d63b633d5c8b\": rpc error: code = NotFound desc = could not find container \"7281c421542ceeb45b70aec8f7bb80efdfa3c122860c4eb37fc8d63b633d5c8b\": container with ID starting with 7281c421542ceeb45b70aec8f7bb80efdfa3c122860c4eb37fc8d63b633d5c8b not found: ID does not exist"
Oct 30 20:08:02.246235 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:02.246154    6275 scope.go:122] "RemoveContainer" containerID="f79a5b92da7715f36409d00672164dd25ee74a9f37ca8852a4f9e37e39c5ee4f"
Oct 30 20:08:02.260981 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:02.260949    6275 scope.go:122] "RemoveContainer" containerID="f79a5b92da7715f36409d00672164dd25ee74a9f37ca8852a4f9e37e39c5ee4f"
Oct 30 20:08:02.261360 ip-10-0-131-26 kubenswrapper[6275]: E1030 20:08:02.261329    6275 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f79a5b92da7715f36409d00672164dd25ee74a9f37ca8852a4f9e37e39c5ee4f\": container with ID starting with f79a5b92da7715f36409d00672164dd25ee74a9f37ca8852a4f9e37e39c5ee4f not found: ID does not exist" containerID="f79a5b92da7715f36409d00672164dd25ee74a9f37ca8852a4f9e37e39c5ee4f"
Oct 30 20:08:02.261503 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:02.261376    6275 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f79a5b92da7715f36409d00672164dd25ee74a9f37ca8852a4f9e37e39c5ee4f"} err="failed to get container status \"f79a5b92da7715f36409d00672164dd25ee74a9f37ca8852a4f9e37e39c5ee4f\": rpc error: code = NotFound desc = could not find container \"f79a5b92da7715f36409d00672164dd25ee74a9f37ca8852a4f9e37e39c5ee4f\": container with ID starting with f79a5b92da7715f36409d00672164dd25ee74a9f37ca8852a4f9e37e39c5ee4f not found: ID does not exist"
Oct 30 20:08:02.261503 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:02.261403    6275 scope.go:122] "RemoveContainer" containerID="33ba9d1afb3fe52e66d1b620393f61c331fa066ec19c9913797541da6a58d8e0"
Oct 30 20:08:02.284680 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:02.284572    6275 scope.go:122] "RemoveContainer" containerID="33ba9d1afb3fe52e66d1b620393f61c331fa066ec19c9913797541da6a58d8e0"
Oct 30 20:08:02.287773 ip-10-0-131-26 kubenswrapper[6275]: E1030 20:08:02.287709    6275 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"33ba9d1afb3fe52e66d1b620393f61c331fa066ec19c9913797541da6a58d8e0\": container with ID starting with 33ba9d1afb3fe52e66d1b620393f61c331fa066ec19c9913797541da6a58d8e0 not found: ID does not exist" containerID="33ba9d1afb3fe52e66d1b620393f61c331fa066ec19c9913797541da6a58d8e0"
Oct 30 20:08:02.287773 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:02.287748    6275 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"33ba9d1afb3fe52e66d1b620393f61c331fa066ec19c9913797541da6a58d8e0"} err="failed to get container status \"33ba9d1afb3fe52e66d1b620393f61c331fa066ec19c9913797541da6a58d8e0\": rpc error: code = NotFound desc = could not find container \"33ba9d1afb3fe52e66d1b620393f61c331fa066ec19c9913797541da6a58d8e0\": container with ID starting with 33ba9d1afb3fe52e66d1b620393f61c331fa066ec19c9913797541da6a58d8e0 not found: ID does not exist"
Oct 30 20:08:02.287773 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:02.287773    6275 scope.go:122] "RemoveContainer" containerID="b2d672f4c4c542f8c81c1e59ae15e9f5e636e262235126b188ec1756c38c8a48"
Oct 30 20:08:02.310355 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:02.307930    6275 scope.go:122] "RemoveContainer" containerID="b2d672f4c4c542f8c81c1e59ae15e9f5e636e262235126b188ec1756c38c8a48"
Oct 30 20:08:02.310355 ip-10-0-131-26 kubenswrapper[6275]: E1030 20:08:02.308346    6275 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b2d672f4c4c542f8c81c1e59ae15e9f5e636e262235126b188ec1756c38c8a48\": container with ID starting with b2d672f4c4c542f8c81c1e59ae15e9f5e636e262235126b188ec1756c38c8a48 not found: ID does not exist" containerID="b2d672f4c4c542f8c81c1e59ae15e9f5e636e262235126b188ec1756c38c8a48"
Oct 30 20:08:02.310355 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:02.308382    6275 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b2d672f4c4c542f8c81c1e59ae15e9f5e636e262235126b188ec1756c38c8a48"} err="failed to get container status \"b2d672f4c4c542f8c81c1e59ae15e9f5e636e262235126b188ec1756c38c8a48\": rpc error: code = NotFound desc = could not find container \"b2d672f4c4c542f8c81c1e59ae15e9f5e636e262235126b188ec1756c38c8a48\": container with ID starting with b2d672f4c4c542f8c81c1e59ae15e9f5e636e262235126b188ec1756c38c8a48 not found: ID does not exist"
Oct 30 20:08:02.310355 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:02.309121    6275 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5aec32f5-a318-4b0c-9c2f-2af7f36b8fd4-istio-podinfo\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:08:02.310355 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:02.309146    6275 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nvbp9\" (UniqueName: \"kubernetes.io/projected/5aec32f5-a318-4b0c-9c2f-2af7f36b8fd4-kube-api-access-nvbp9\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:08:02.310355 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:02.309180    6275 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5aec32f5-a318-4b0c-9c2f-2af7f36b8fd4-istio-token\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:08:02.310355 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:02.309196    6275 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5aec32f5-a318-4b0c-9c2f-2af7f36b8fd4-istio-envoy\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:08:02.346123 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:02.346085    6275 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-f1f016-openshift-default-6c85499cc-697gz"]
Oct 30 20:08:02.354670 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:02.354593    6275 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w4-f1f016-openshift-default-6c85499cc-697gz"]
Oct 30 20:08:02.394324 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:02.394293    6275 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-7a9e878d-xhhls"
Oct 30 20:08:02.398710 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:02.398683    6275 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w5-626870-openshift-default-7cd649d59c-74vj7"]
Oct 30 20:08:02.405021 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:02.404993    6275 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w5-626870-openshift-default-7cd649d59c-74vj7"]
Oct 30 20:08:02.439860 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:02.439821    6275 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w5-626870-openshift-default-7cd649d59c-zchw8"]
Oct 30 20:08:02.445855 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:02.445824    6275 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w5-626870-openshift-default-7cd649d59c-zchw8"]
Oct 30 20:08:02.455083 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:02.455057    6275 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-626870-openshift-default-7cd649d59c-8m57h"
Oct 30 20:08:02.484985 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:02.484948    6275 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-f1f016-openshift-default-6c85499cc-zn5bc"]
Oct 30 20:08:02.493342 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:02.493315    6275 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w4-f1f016-openshift-default-6c85499cc-zn5bc"]
Oct 30 20:08:02.510772 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:02.510734    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8c41c1e8-30e2-416d-a07e-cb0177f33ff6-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8c41c1e8-30e2-416d-a07e-cb0177f33ff6-workload-certs\") pod \"8c41c1e8-30e2-416d-a07e-cb0177f33ff6\" (UID: \"8c41c1e8-30e2-416d-a07e-cb0177f33ff6\") "
Oct 30 20:08:02.510915 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:02.510790    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/8c41c1e8-30e2-416d-a07e-cb0177f33ff6-istio-token\" (UniqueName: \"kubernetes.io/projected/8c41c1e8-30e2-416d-a07e-cb0177f33ff6-istio-token\") pod \"8c41c1e8-30e2-416d-a07e-cb0177f33ff6\" (UID: \"8c41c1e8-30e2-416d-a07e-cb0177f33ff6\") "
Oct 30 20:08:02.510915 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:02.510833    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8c41c1e8-30e2-416d-a07e-cb0177f33ff6-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8c41c1e8-30e2-416d-a07e-cb0177f33ff6-istio-data\") pod \"8c41c1e8-30e2-416d-a07e-cb0177f33ff6\" (UID: \"8c41c1e8-30e2-416d-a07e-cb0177f33ff6\") "
Oct 30 20:08:02.510915 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:02.510893    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8c41c1e8-30e2-416d-a07e-cb0177f33ff6-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8c41c1e8-30e2-416d-a07e-cb0177f33ff6-workload-socket\") pod \"8c41c1e8-30e2-416d-a07e-cb0177f33ff6\" (UID: \"8c41c1e8-30e2-416d-a07e-cb0177f33ff6\") "
Oct 30 20:08:02.511097 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:02.511010    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8c41c1e8-30e2-416d-a07e-cb0177f33ff6-workload-certs" pod "8c41c1e8-30e2-416d-a07e-cb0177f33ff6" (UID: "8c41c1e8-30e2-416d-a07e-cb0177f33ff6"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:08:02.511097 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:02.511048    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8c41c1e8-30e2-416d-a07e-cb0177f33ff6-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8c41c1e8-30e2-416d-a07e-cb0177f33ff6-credential-socket\") pod \"8c41c1e8-30e2-416d-a07e-cb0177f33ff6\" (UID: \"8c41c1e8-30e2-416d-a07e-cb0177f33ff6\") "
Oct 30 20:08:02.511097 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:02.511076    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/2df32608-dcec-4946-acc6-957287e09fbb-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/2df32608-dcec-4946-acc6-957287e09fbb-maas-api-xks-ca\") pod \"2df32608-dcec-4946-acc6-957287e09fbb\" (UID: \"2df32608-dcec-4946-acc6-957287e09fbb\") "
Oct 30 20:08:02.511244 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:02.511117    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/8c41c1e8-30e2-416d-a07e-cb0177f33ff6-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8c41c1e8-30e2-416d-a07e-cb0177f33ff6-istiod-ca-cert\") pod \"8c41c1e8-30e2-416d-a07e-cb0177f33ff6\" (UID: \"8c41c1e8-30e2-416d-a07e-cb0177f33ff6\") "
Oct 30 20:08:02.511244 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:02.511155    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/2df32608-dcec-4946-acc6-957287e09fbb-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/2df32608-dcec-4946-acc6-957287e09fbb-maas-api-openshift-ca\") pod \"2df32608-dcec-4946-acc6-957287e09fbb\" (UID: \"2df32608-dcec-4946-acc6-957287e09fbb\") "
Oct 30 20:08:02.511244 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:02.511195    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/8c41c1e8-30e2-416d-a07e-cb0177f33ff6-kube-api-access-zw7v7\" (UniqueName: \"kubernetes.io/projected/8c41c1e8-30e2-416d-a07e-cb0177f33ff6-kube-api-access-zw7v7\") pod \"8c41c1e8-30e2-416d-a07e-cb0177f33ff6\" (UID: \"8c41c1e8-30e2-416d-a07e-cb0177f33ff6\") "
Oct 30 20:08:02.511244 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:02.511235    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/2df32608-dcec-4946-acc6-957287e09fbb-kube-api-access-72wlk\" (UniqueName: \"kubernetes.io/projected/2df32608-dcec-4946-acc6-957287e09fbb-kube-api-access-72wlk\") pod \"2df32608-dcec-4946-acc6-957287e09fbb\" (UID: \"2df32608-dcec-4946-acc6-957287e09fbb\") "
Oct 30 20:08:02.511500 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:02.511473    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8c41c1e8-30e2-416d-a07e-cb0177f33ff6-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8c41c1e8-30e2-416d-a07e-cb0177f33ff6-istio-envoy\") pod \"8c41c1e8-30e2-416d-a07e-cb0177f33ff6\" (UID: \"8c41c1e8-30e2-416d-a07e-cb0177f33ff6\") "
Oct 30 20:08:02.511582 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:02.511564    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/8c41c1e8-30e2-416d-a07e-cb0177f33ff6-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8c41c1e8-30e2-416d-a07e-cb0177f33ff6-istio-podinfo\") pod \"8c41c1e8-30e2-416d-a07e-cb0177f33ff6\" (UID: \"8c41c1e8-30e2-416d-a07e-cb0177f33ff6\") "
Oct 30 20:08:02.512564 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:02.511587    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2df32608-dcec-4946-acc6-957287e09fbb-maas-api-openshift-ca" pod "2df32608-dcec-4946-acc6-957287e09fbb" (UID: "2df32608-dcec-4946-acc6-957287e09fbb"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:08:02.512564 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:02.512103    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8c41c1e8-30e2-416d-a07e-cb0177f33ff6-istio-data" pod "8c41c1e8-30e2-416d-a07e-cb0177f33ff6" (UID: "8c41c1e8-30e2-416d-a07e-cb0177f33ff6"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:08:02.512564 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:02.512304    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8c41c1e8-30e2-416d-a07e-cb0177f33ff6-workload-socket" pod "8c41c1e8-30e2-416d-a07e-cb0177f33ff6" (UID: "8c41c1e8-30e2-416d-a07e-cb0177f33ff6"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:08:02.512564 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:02.512404    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8c41c1e8-30e2-416d-a07e-cb0177f33ff6-istiod-ca-cert" pod "8c41c1e8-30e2-416d-a07e-cb0177f33ff6" (UID: "8c41c1e8-30e2-416d-a07e-cb0177f33ff6"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:08:02.512816 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:02.512574    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8c41c1e8-30e2-416d-a07e-cb0177f33ff6-credential-socket" pod "8c41c1e8-30e2-416d-a07e-cb0177f33ff6" (UID: "8c41c1e8-30e2-416d-a07e-cb0177f33ff6"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:08:02.513374 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:02.513349    6275 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8c41c1e8-30e2-416d-a07e-cb0177f33ff6-workload-socket\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:08:02.513623 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:02.513377    6275 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8c41c1e8-30e2-416d-a07e-cb0177f33ff6-credential-socket\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:08:02.513623 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:02.513394    6275 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8c41c1e8-30e2-416d-a07e-cb0177f33ff6-istiod-ca-cert\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:08:02.513623 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:02.513408    6275 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/2df32608-dcec-4946-acc6-957287e09fbb-maas-api-openshift-ca\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:08:02.513623 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:02.513436    6275 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8c41c1e8-30e2-416d-a07e-cb0177f33ff6-workload-certs\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:08:02.513623 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:02.513451    6275 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8c41c1e8-30e2-416d-a07e-cb0177f33ff6-istio-data\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:08:02.513967 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:02.513706    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2df32608-dcec-4946-acc6-957287e09fbb-maas-api-xks-ca" pod "2df32608-dcec-4946-acc6-957287e09fbb" (UID: "2df32608-dcec-4946-acc6-957287e09fbb"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 20:08:02.514082 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:02.514057    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/8c41c1e8-30e2-416d-a07e-cb0177f33ff6-istio-podinfo" pod "8c41c1e8-30e2-416d-a07e-cb0177f33ff6" (UID: "8c41c1e8-30e2-416d-a07e-cb0177f33ff6"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 20:08:02.514215 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:02.514148    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2df32608-dcec-4946-acc6-957287e09fbb-kube-api-access-72wlk" pod "2df32608-dcec-4946-acc6-957287e09fbb" (UID: "2df32608-dcec-4946-acc6-957287e09fbb"). InnerVolumeSpecName "kube-api-access-72wlk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:08:02.514215 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:02.514185    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8c41c1e8-30e2-416d-a07e-cb0177f33ff6-istio-token" pod "8c41c1e8-30e2-416d-a07e-cb0177f33ff6" (UID: "8c41c1e8-30e2-416d-a07e-cb0177f33ff6"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:08:02.515070 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:02.515049    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8c41c1e8-30e2-416d-a07e-cb0177f33ff6-istio-envoy" pod "8c41c1e8-30e2-416d-a07e-cb0177f33ff6" (UID: "8c41c1e8-30e2-416d-a07e-cb0177f33ff6"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:08:02.515324 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:02.515303    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8c41c1e8-30e2-416d-a07e-cb0177f33ff6-kube-api-access-zw7v7" pod "8c41c1e8-30e2-416d-a07e-cb0177f33ff6" (UID: "8c41c1e8-30e2-416d-a07e-cb0177f33ff6"). InnerVolumeSpecName "kube-api-access-zw7v7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:08:02.614610 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:02.614539    6275 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/2df32608-dcec-4946-acc6-957287e09fbb-maas-api-xks-ca\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:08:02.614610 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:02.614577    6275 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zw7v7\" (UniqueName: \"kubernetes.io/projected/8c41c1e8-30e2-416d-a07e-cb0177f33ff6-kube-api-access-zw7v7\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:08:02.614610 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:02.614592    6275 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-72wlk\" (UniqueName: \"kubernetes.io/projected/2df32608-dcec-4946-acc6-957287e09fbb-kube-api-access-72wlk\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:08:02.614610 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:02.614606    6275 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8c41c1e8-30e2-416d-a07e-cb0177f33ff6-istio-envoy\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:08:02.614835 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:02.614621    6275 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8c41c1e8-30e2-416d-a07e-cb0177f33ff6-istio-podinfo\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:08:02.614835 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:02.614633    6275 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8c41c1e8-30e2-416d-a07e-cb0177f33ff6-istio-token\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:08:02.810552 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:02.810522    6275 patch_prober.go:29] interesting pod/e2e-worker-w3-912f24-openshift-default-5f56ff5f6c-w5dh9 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Oct 30 20:08:02.810657 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:02.810580    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w3-912f24-openshift-default-5f56ff5f6c-w5dh9" podUID="d499ec6a-7c42-4ba2-b4c6-19c6fe1caa99" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 20:08:03.248902 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:03.248866    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-626870-openshift-default-7cd649d59c-8m57h" event={"ID":"8c41c1e8-30e2-416d-a07e-cb0177f33ff6","Type":"ContainerDied","Data":"10989ffe3bfec8ab10590ee2f600c2129693b114b5a3dcd6d646fbbb4cfc94e5"}
Oct 30 20:08:03.248902 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:03.248892    6275 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-626870-openshift-default-7cd649d59c-8m57h"
Oct 30 20:08:03.249441 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:03.248973    6275 scope.go:122] "RemoveContainer" containerID="443795b6bb8c0729620eaa585eb2a7e5d7c07ad6ba02cc7ec7b66e2705faf32b"
Oct 30 20:08:03.252744 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:03.252712    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-7a9e878d-xhhls" event={"ID":"2df32608-dcec-4946-acc6-957287e09fbb","Type":"ContainerDied","Data":"bc0221a9f4d5035161247e81e8af94b19d0314ce9c15f029b625f910af227f93"}
Oct 30 20:08:03.252875 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:03.252760    6275 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="bc0221a9f4d5035161247e81e8af94b19d0314ce9c15f029b625f910af227f93"
Oct 30 20:08:03.252875 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:03.252727    6275 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-7a9e878d-xhhls"
Oct 30 20:08:03.254553 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:03.254527    6275 generic.go:356] "Generic (PLEG): container finished" podID="328802e4-c003-41a2-a292-1f735cc8cec9" containerID="124aa29fa9f29e01fd00543070e00a87e2aa990c1788484e2f8d51171fe2a077" exitCode=0
Oct 30 20:08:03.254674 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:03.254616    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-dc2c5ee5-q2jfx" event={"ID":"328802e4-c003-41a2-a292-1f735cc8cec9","Type":"ContainerDied","Data":"124aa29fa9f29e01fd00543070e00a87e2aa990c1788484e2f8d51171fe2a077"}
Oct 30 20:08:03.310013 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:03.309980    6275 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w5-626870-openshift-default-7cd649d59c-8m57h"]
Oct 30 20:08:03.323567 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:03.323536    6275 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w5-626870-openshift-default-7cd649d59c-8m57h"]
Oct 30 20:08:03.659717 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:03.659634    6275 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="5aec32f5-a318-4b0c-9c2f-2af7f36b8fd4" path="/var/lib/kubelet/pods/5aec32f5-a318-4b0c-9c2f-2af7f36b8fd4/volumes"
Oct 30 20:08:03.660233 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:03.660211    6275 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="65f30ed1-2ae6-464b-8293-a36c663bde0a" path="/var/lib/kubelet/pods/65f30ed1-2ae6-464b-8293-a36c663bde0a/volumes"
Oct 30 20:08:03.660756 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:03.660736    6275 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="8c41c1e8-30e2-416d-a07e-cb0177f33ff6" path="/var/lib/kubelet/pods/8c41c1e8-30e2-416d-a07e-cb0177f33ff6/volumes"
Oct 30 20:08:03.661586 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:03.661567    6275 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="d0e72a0c-3d64-4e88-af2d-246a329f6215" path="/var/lib/kubelet/pods/d0e72a0c-3d64-4e88-af2d-246a329f6215/volumes"
Oct 30 20:08:03.662049 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:03.662030    6275 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="f35ca7ba-e2b8-4e65-bc7b-0051dea979e8" path="/var/lib/kubelet/pods/f35ca7ba-e2b8-4e65-bc7b-0051dea979e8/volumes"
Oct 30 20:08:03.978605 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:03.977914    6275 patch_prober.go:29] interesting pod/e2e-worker-w3-912f24-openshift-default-5f56ff5f6c-r7hx2 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Oct 30 20:08:03.978605 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:03.978056    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w3-912f24-openshift-default-5f56ff5f6c-r7hx2" podUID="88b5def9-2eb1-476e-a3ba-8f5b5ac6c32f" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 20:08:04.038653 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:04.038619    6275 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-0de909cb-94q4p"]
Oct 30 20:08:04.043987 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:04.043951    6275 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-0de909cb-94q4p"]
Oct 30 20:08:04.524762 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:04.524683    6275 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-dc2c5ee5-q2jfx"
Oct 30 20:08:04.638072 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:04.638045    6275 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-912f24-openshift-default-5f56ff5f6c-sth92"
Oct 30 20:08:04.642113 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:04.642085    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/328802e4-c003-41a2-a292-1f735cc8cec9-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/328802e4-c003-41a2-a292-1f735cc8cec9-maas-api-xks-ca\") pod \"328802e4-c003-41a2-a292-1f735cc8cec9\" (UID: \"328802e4-c003-41a2-a292-1f735cc8cec9\") "
Oct 30 20:08:04.642321 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:04.642145    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/328802e4-c003-41a2-a292-1f735cc8cec9-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/328802e4-c003-41a2-a292-1f735cc8cec9-maas-api-openshift-ca\") pod \"328802e4-c003-41a2-a292-1f735cc8cec9\" (UID: \"328802e4-c003-41a2-a292-1f735cc8cec9\") "
Oct 30 20:08:04.642426 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:04.642383    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/328802e4-c003-41a2-a292-1f735cc8cec9-kube-api-access-l9lxv\" (UniqueName: \"kubernetes.io/projected/328802e4-c003-41a2-a292-1f735cc8cec9-kube-api-access-l9lxv\") pod \"328802e4-c003-41a2-a292-1f735cc8cec9\" (UID: \"328802e4-c003-41a2-a292-1f735cc8cec9\") "
Oct 30 20:08:04.642700 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:04.642678    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/328802e4-c003-41a2-a292-1f735cc8cec9-maas-api-openshift-ca" pod "328802e4-c003-41a2-a292-1f735cc8cec9" (UID: "328802e4-c003-41a2-a292-1f735cc8cec9"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:08:04.643316 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:04.643291    6275 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/328802e4-c003-41a2-a292-1f735cc8cec9-maas-api-openshift-ca\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:08:04.645497 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:04.645471    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/328802e4-c003-41a2-a292-1f735cc8cec9-kube-api-access-l9lxv" pod "328802e4-c003-41a2-a292-1f735cc8cec9" (UID: "328802e4-c003-41a2-a292-1f735cc8cec9"). InnerVolumeSpecName "kube-api-access-l9lxv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:08:04.645589 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:04.645560    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/328802e4-c003-41a2-a292-1f735cc8cec9-maas-api-xks-ca" pod "328802e4-c003-41a2-a292-1f735cc8cec9" (UID: "328802e4-c003-41a2-a292-1f735cc8cec9"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 20:08:04.706145 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:04.706118    6275 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-912f24-openshift-default-5f56ff5f6c-r7hx2"
Oct 30 20:08:04.713684 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:04.713660    6275 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-912f24-openshift-default-5f56ff5f6c-w5dh9"
Oct 30 20:08:04.743695 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:04.743656    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8a7d6f48-c37d-4f85-82e1-46b8b330b366-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8a7d6f48-c37d-4f85-82e1-46b8b330b366-istio-envoy\") pod \"8a7d6f48-c37d-4f85-82e1-46b8b330b366\" (UID: \"8a7d6f48-c37d-4f85-82e1-46b8b330b366\") "
Oct 30 20:08:04.743867 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:04.743702    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/8a7d6f48-c37d-4f85-82e1-46b8b330b366-istio-token\" (UniqueName: \"kubernetes.io/projected/8a7d6f48-c37d-4f85-82e1-46b8b330b366-istio-token\") pod \"8a7d6f48-c37d-4f85-82e1-46b8b330b366\" (UID: \"8a7d6f48-c37d-4f85-82e1-46b8b330b366\") "
Oct 30 20:08:04.743867 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:04.743756    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8a7d6f48-c37d-4f85-82e1-46b8b330b366-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8a7d6f48-c37d-4f85-82e1-46b8b330b366-istio-data\") pod \"8a7d6f48-c37d-4f85-82e1-46b8b330b366\" (UID: \"8a7d6f48-c37d-4f85-82e1-46b8b330b366\") "
Oct 30 20:08:04.743981 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:04.743944    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/8a7d6f48-c37d-4f85-82e1-46b8b330b366-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8a7d6f48-c37d-4f85-82e1-46b8b330b366-istiod-ca-cert\") pod \"8a7d6f48-c37d-4f85-82e1-46b8b330b366\" (UID: \"8a7d6f48-c37d-4f85-82e1-46b8b330b366\") "
Oct 30 20:08:04.744033 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:04.744002    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/8a7d6f48-c37d-4f85-82e1-46b8b330b366-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8a7d6f48-c37d-4f85-82e1-46b8b330b366-istio-podinfo\") pod \"8a7d6f48-c37d-4f85-82e1-46b8b330b366\" (UID: \"8a7d6f48-c37d-4f85-82e1-46b8b330b366\") "
Oct 30 20:08:04.744081 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:04.744044    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8a7d6f48-c37d-4f85-82e1-46b8b330b366-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8a7d6f48-c37d-4f85-82e1-46b8b330b366-workload-socket\") pod \"8a7d6f48-c37d-4f85-82e1-46b8b330b366\" (UID: \"8a7d6f48-c37d-4f85-82e1-46b8b330b366\") "
Oct 30 20:08:04.744134 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:04.744113    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8a7d6f48-c37d-4f85-82e1-46b8b330b366-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8a7d6f48-c37d-4f85-82e1-46b8b330b366-workload-certs\") pod \"8a7d6f48-c37d-4f85-82e1-46b8b330b366\" (UID: \"8a7d6f48-c37d-4f85-82e1-46b8b330b366\") "
Oct 30 20:08:04.744134 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:04.744115    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8a7d6f48-c37d-4f85-82e1-46b8b330b366-istio-data" pod "8a7d6f48-c37d-4f85-82e1-46b8b330b366" (UID: "8a7d6f48-c37d-4f85-82e1-46b8b330b366"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:08:04.744238 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:04.744204    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8a7d6f48-c37d-4f85-82e1-46b8b330b366-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8a7d6f48-c37d-4f85-82e1-46b8b330b366-credential-socket\") pod \"8a7d6f48-c37d-4f85-82e1-46b8b330b366\" (UID: \"8a7d6f48-c37d-4f85-82e1-46b8b330b366\") "
Oct 30 20:08:04.744317 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:04.744295    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/8a7d6f48-c37d-4f85-82e1-46b8b330b366-kube-api-access-5tsjx\" (UniqueName: \"kubernetes.io/projected/8a7d6f48-c37d-4f85-82e1-46b8b330b366-kube-api-access-5tsjx\") pod \"8a7d6f48-c37d-4f85-82e1-46b8b330b366\" (UID: \"8a7d6f48-c37d-4f85-82e1-46b8b330b366\") "
Oct 30 20:08:04.744596 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:04.744393    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8a7d6f48-c37d-4f85-82e1-46b8b330b366-istiod-ca-cert" pod "8a7d6f48-c37d-4f85-82e1-46b8b330b366" (UID: "8a7d6f48-c37d-4f85-82e1-46b8b330b366"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:08:04.744596 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:04.744516    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8a7d6f48-c37d-4f85-82e1-46b8b330b366-workload-certs" pod "8a7d6f48-c37d-4f85-82e1-46b8b330b366" (UID: "8a7d6f48-c37d-4f85-82e1-46b8b330b366"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:08:04.744596 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:04.744548    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8a7d6f48-c37d-4f85-82e1-46b8b330b366-workload-socket" pod "8a7d6f48-c37d-4f85-82e1-46b8b330b366" (UID: "8a7d6f48-c37d-4f85-82e1-46b8b330b366"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:08:04.744596 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:04.744583    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8a7d6f48-c37d-4f85-82e1-46b8b330b366-credential-socket" pod "8a7d6f48-c37d-4f85-82e1-46b8b330b366" (UID: "8a7d6f48-c37d-4f85-82e1-46b8b330b366"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:08:04.745036 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:04.745010    6275 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8a7d6f48-c37d-4f85-82e1-46b8b330b366-workload-certs\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:08:04.745150 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:04.745039    6275 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l9lxv\" (UniqueName: \"kubernetes.io/projected/328802e4-c003-41a2-a292-1f735cc8cec9-kube-api-access-l9lxv\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:08:04.745150 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:04.745057    6275 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8a7d6f48-c37d-4f85-82e1-46b8b330b366-credential-socket\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:08:04.745150 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:04.745071    6275 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/328802e4-c003-41a2-a292-1f735cc8cec9-maas-api-xks-ca\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:08:04.745150 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:04.745087    6275 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8a7d6f48-c37d-4f85-82e1-46b8b330b366-istio-data\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:08:04.745150 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:04.745101    6275 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8a7d6f48-c37d-4f85-82e1-46b8b330b366-istiod-ca-cert\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:08:04.745150 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:04.745114    6275 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8a7d6f48-c37d-4f85-82e1-46b8b330b366-workload-socket\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:08:04.746173 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:04.746148    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8a7d6f48-c37d-4f85-82e1-46b8b330b366-istio-token" pod "8a7d6f48-c37d-4f85-82e1-46b8b330b366" (UID: "8a7d6f48-c37d-4f85-82e1-46b8b330b366"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:08:04.746308 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:04.746290    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/8a7d6f48-c37d-4f85-82e1-46b8b330b366-istio-podinfo" pod "8a7d6f48-c37d-4f85-82e1-46b8b330b366" (UID: "8a7d6f48-c37d-4f85-82e1-46b8b330b366"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 20:08:04.746484 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:04.746402    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8a7d6f48-c37d-4f85-82e1-46b8b330b366-istio-envoy" pod "8a7d6f48-c37d-4f85-82e1-46b8b330b366" (UID: "8a7d6f48-c37d-4f85-82e1-46b8b330b366"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:08:04.746596 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:04.746575    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8a7d6f48-c37d-4f85-82e1-46b8b330b366-kube-api-access-5tsjx" pod "8a7d6f48-c37d-4f85-82e1-46b8b330b366" (UID: "8a7d6f48-c37d-4f85-82e1-46b8b330b366"). InnerVolumeSpecName "kube-api-access-5tsjx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:08:04.846037 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:04.845956    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/d499ec6a-7c42-4ba2-b4c6-19c6fe1caa99-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d499ec6a-7c42-4ba2-b4c6-19c6fe1caa99-istiod-ca-cert\") pod \"d499ec6a-7c42-4ba2-b4c6-19c6fe1caa99\" (UID: \"d499ec6a-7c42-4ba2-b4c6-19c6fe1caa99\") "
Oct 30 20:08:04.846037 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:04.846018    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/d499ec6a-7c42-4ba2-b4c6-19c6fe1caa99-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d499ec6a-7c42-4ba2-b4c6-19c6fe1caa99-istio-podinfo\") pod \"d499ec6a-7c42-4ba2-b4c6-19c6fe1caa99\" (UID: \"d499ec6a-7c42-4ba2-b4c6-19c6fe1caa99\") "
Oct 30 20:08:04.846272 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:04.846076    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/88b5def9-2eb1-476e-a3ba-8f5b5ac6c32f-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/88b5def9-2eb1-476e-a3ba-8f5b5ac6c32f-istio-podinfo\") pod \"88b5def9-2eb1-476e-a3ba-8f5b5ac6c32f\" (UID: \"88b5def9-2eb1-476e-a3ba-8f5b5ac6c32f\") "
Oct 30 20:08:04.846272 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:04.846099    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/88b5def9-2eb1-476e-a3ba-8f5b5ac6c32f-kube-api-access-bjbpm\" (UniqueName: \"kubernetes.io/projected/88b5def9-2eb1-476e-a3ba-8f5b5ac6c32f-kube-api-access-bjbpm\") pod \"88b5def9-2eb1-476e-a3ba-8f5b5ac6c32f\" (UID: \"88b5def9-2eb1-476e-a3ba-8f5b5ac6c32f\") "
Oct 30 20:08:04.846272 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:04.846145    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/d499ec6a-7c42-4ba2-b4c6-19c6fe1caa99-istio-token\" (UniqueName: \"kubernetes.io/projected/d499ec6a-7c42-4ba2-b4c6-19c6fe1caa99-istio-token\") pod \"d499ec6a-7c42-4ba2-b4c6-19c6fe1caa99\" (UID: \"d499ec6a-7c42-4ba2-b4c6-19c6fe1caa99\") "
Oct 30 20:08:04.846272 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:04.846174    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/88b5def9-2eb1-476e-a3ba-8f5b5ac6c32f-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/88b5def9-2eb1-476e-a3ba-8f5b5ac6c32f-istiod-ca-cert\") pod \"88b5def9-2eb1-476e-a3ba-8f5b5ac6c32f\" (UID: \"88b5def9-2eb1-476e-a3ba-8f5b5ac6c32f\") "
Oct 30 20:08:04.846272 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:04.846229    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d499ec6a-7c42-4ba2-b4c6-19c6fe1caa99-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d499ec6a-7c42-4ba2-b4c6-19c6fe1caa99-istio-data\") pod \"d499ec6a-7c42-4ba2-b4c6-19c6fe1caa99\" (UID: \"d499ec6a-7c42-4ba2-b4c6-19c6fe1caa99\") "
Oct 30 20:08:04.846272 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:04.846262    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d499ec6a-7c42-4ba2-b4c6-19c6fe1caa99-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d499ec6a-7c42-4ba2-b4c6-19c6fe1caa99-workload-certs\") pod \"d499ec6a-7c42-4ba2-b4c6-19c6fe1caa99\" (UID: \"d499ec6a-7c42-4ba2-b4c6-19c6fe1caa99\") "
Oct 30 20:08:04.846621 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:04.846300    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/88b5def9-2eb1-476e-a3ba-8f5b5ac6c32f-istio-token\" (UniqueName: \"kubernetes.io/projected/88b5def9-2eb1-476e-a3ba-8f5b5ac6c32f-istio-token\") pod \"88b5def9-2eb1-476e-a3ba-8f5b5ac6c32f\" (UID: \"88b5def9-2eb1-476e-a3ba-8f5b5ac6c32f\") "
Oct 30 20:08:04.846621 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:04.846343    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/88b5def9-2eb1-476e-a3ba-8f5b5ac6c32f-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/88b5def9-2eb1-476e-a3ba-8f5b5ac6c32f-workload-certs\") pod \"88b5def9-2eb1-476e-a3ba-8f5b5ac6c32f\" (UID: \"88b5def9-2eb1-476e-a3ba-8f5b5ac6c32f\") "
Oct 30 20:08:04.846621 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:04.846399    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/88b5def9-2eb1-476e-a3ba-8f5b5ac6c32f-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/88b5def9-2eb1-476e-a3ba-8f5b5ac6c32f-istio-envoy\") pod \"88b5def9-2eb1-476e-a3ba-8f5b5ac6c32f\" (UID: \"88b5def9-2eb1-476e-a3ba-8f5b5ac6c32f\") "
Oct 30 20:08:04.846621 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:04.846461    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/88b5def9-2eb1-476e-a3ba-8f5b5ac6c32f-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/88b5def9-2eb1-476e-a3ba-8f5b5ac6c32f-credential-socket\") pod \"88b5def9-2eb1-476e-a3ba-8f5b5ac6c32f\" (UID: \"88b5def9-2eb1-476e-a3ba-8f5b5ac6c32f\") "
Oct 30 20:08:04.846621 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:04.846551    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/88b5def9-2eb1-476e-a3ba-8f5b5ac6c32f-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/88b5def9-2eb1-476e-a3ba-8f5b5ac6c32f-istio-data\") pod \"88b5def9-2eb1-476e-a3ba-8f5b5ac6c32f\" (UID: \"88b5def9-2eb1-476e-a3ba-8f5b5ac6c32f\") "
Oct 30 20:08:04.846621 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:04.846588    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d499ec6a-7c42-4ba2-b4c6-19c6fe1caa99-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d499ec6a-7c42-4ba2-b4c6-19c6fe1caa99-credential-socket\") pod \"d499ec6a-7c42-4ba2-b4c6-19c6fe1caa99\" (UID: \"d499ec6a-7c42-4ba2-b4c6-19c6fe1caa99\") "
Oct 30 20:08:04.846902 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:04.846631    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/88b5def9-2eb1-476e-a3ba-8f5b5ac6c32f-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/88b5def9-2eb1-476e-a3ba-8f5b5ac6c32f-workload-socket\") pod \"88b5def9-2eb1-476e-a3ba-8f5b5ac6c32f\" (UID: \"88b5def9-2eb1-476e-a3ba-8f5b5ac6c32f\") "
Oct 30 20:08:04.846902 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:04.846664    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d499ec6a-7c42-4ba2-b4c6-19c6fe1caa99-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d499ec6a-7c42-4ba2-b4c6-19c6fe1caa99-workload-socket\") pod \"d499ec6a-7c42-4ba2-b4c6-19c6fe1caa99\" (UID: \"d499ec6a-7c42-4ba2-b4c6-19c6fe1caa99\") "
Oct 30 20:08:04.846902 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:04.846719    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/d499ec6a-7c42-4ba2-b4c6-19c6fe1caa99-kube-api-access-nrlrp\" (UniqueName: \"kubernetes.io/projected/d499ec6a-7c42-4ba2-b4c6-19c6fe1caa99-kube-api-access-nrlrp\") pod \"d499ec6a-7c42-4ba2-b4c6-19c6fe1caa99\" (UID: \"d499ec6a-7c42-4ba2-b4c6-19c6fe1caa99\") "
Oct 30 20:08:04.846902 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:04.846804    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d499ec6a-7c42-4ba2-b4c6-19c6fe1caa99-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d499ec6a-7c42-4ba2-b4c6-19c6fe1caa99-istio-envoy\") pod \"d499ec6a-7c42-4ba2-b4c6-19c6fe1caa99\" (UID: \"d499ec6a-7c42-4ba2-b4c6-19c6fe1caa99\") "
Oct 30 20:08:04.847594 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:04.847564    6275 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8a7d6f48-c37d-4f85-82e1-46b8b330b366-istio-podinfo\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:08:04.847720 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:04.847595    6275 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5tsjx\" (UniqueName: \"kubernetes.io/projected/8a7d6f48-c37d-4f85-82e1-46b8b330b366-kube-api-access-5tsjx\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:08:04.847720 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:04.847613    6275 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8a7d6f48-c37d-4f85-82e1-46b8b330b366-istio-envoy\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:08:04.847720 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:04.847628    6275 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8a7d6f48-c37d-4f85-82e1-46b8b330b366-istio-token\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:08:04.848687 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:04.846393    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d499ec6a-7c42-4ba2-b4c6-19c6fe1caa99-istiod-ca-cert" pod "d499ec6a-7c42-4ba2-b4c6-19c6fe1caa99" (UID: "d499ec6a-7c42-4ba2-b4c6-19c6fe1caa99"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:08:04.848687 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:04.846704    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d499ec6a-7c42-4ba2-b4c6-19c6fe1caa99-workload-certs" pod "d499ec6a-7c42-4ba2-b4c6-19c6fe1caa99" (UID: "d499ec6a-7c42-4ba2-b4c6-19c6fe1caa99"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:08:04.848883 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:04.846936    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d499ec6a-7c42-4ba2-b4c6-19c6fe1caa99-istio-data" pod "d499ec6a-7c42-4ba2-b4c6-19c6fe1caa99" (UID: "d499ec6a-7c42-4ba2-b4c6-19c6fe1caa99"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:08:04.848883 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:04.847307    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/88b5def9-2eb1-476e-a3ba-8f5b5ac6c32f-istiod-ca-cert" pod "88b5def9-2eb1-476e-a3ba-8f5b5ac6c32f" (UID: "88b5def9-2eb1-476e-a3ba-8f5b5ac6c32f"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:08:04.848883 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:04.847898    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/88b5def9-2eb1-476e-a3ba-8f5b5ac6c32f-istio-data" pod "88b5def9-2eb1-476e-a3ba-8f5b5ac6c32f" (UID: "88b5def9-2eb1-476e-a3ba-8f5b5ac6c32f"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:08:04.848883 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:04.848179    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/88b5def9-2eb1-476e-a3ba-8f5b5ac6c32f-workload-certs" pod "88b5def9-2eb1-476e-a3ba-8f5b5ac6c32f" (UID: "88b5def9-2eb1-476e-a3ba-8f5b5ac6c32f"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:08:04.848883 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:04.848478    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/88b5def9-2eb1-476e-a3ba-8f5b5ac6c32f-workload-socket" pod "88b5def9-2eb1-476e-a3ba-8f5b5ac6c32f" (UID: "88b5def9-2eb1-476e-a3ba-8f5b5ac6c32f"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:08:04.848883 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:04.848651    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d499ec6a-7c42-4ba2-b4c6-19c6fe1caa99-credential-socket" pod "d499ec6a-7c42-4ba2-b4c6-19c6fe1caa99" (UID: "d499ec6a-7c42-4ba2-b4c6-19c6fe1caa99"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:08:04.849196 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:04.848929    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/88b5def9-2eb1-476e-a3ba-8f5b5ac6c32f-credential-socket" pod "88b5def9-2eb1-476e-a3ba-8f5b5ac6c32f" (UID: "88b5def9-2eb1-476e-a3ba-8f5b5ac6c32f"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:08:04.849196 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:04.849131    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d499ec6a-7c42-4ba2-b4c6-19c6fe1caa99-workload-socket" pod "d499ec6a-7c42-4ba2-b4c6-19c6fe1caa99" (UID: "d499ec6a-7c42-4ba2-b4c6-19c6fe1caa99"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:08:04.849302 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:04.849239    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/88b5def9-2eb1-476e-a3ba-8f5b5ac6c32f-istio-token" pod "88b5def9-2eb1-476e-a3ba-8f5b5ac6c32f" (UID: "88b5def9-2eb1-476e-a3ba-8f5b5ac6c32f"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:08:04.849476 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:04.849394    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d499ec6a-7c42-4ba2-b4c6-19c6fe1caa99-istio-envoy" pod "d499ec6a-7c42-4ba2-b4c6-19c6fe1caa99" (UID: "d499ec6a-7c42-4ba2-b4c6-19c6fe1caa99"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:08:04.849928 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:04.849905    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/88b5def9-2eb1-476e-a3ba-8f5b5ac6c32f-istio-envoy" pod "88b5def9-2eb1-476e-a3ba-8f5b5ac6c32f" (UID: "88b5def9-2eb1-476e-a3ba-8f5b5ac6c32f"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:08:04.850854 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:04.850831    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d499ec6a-7c42-4ba2-b4c6-19c6fe1caa99-kube-api-access-nrlrp" pod "d499ec6a-7c42-4ba2-b4c6-19c6fe1caa99" (UID: "d499ec6a-7c42-4ba2-b4c6-19c6fe1caa99"). InnerVolumeSpecName "kube-api-access-nrlrp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:08:04.851371 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:04.851334    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d499ec6a-7c42-4ba2-b4c6-19c6fe1caa99-istio-token" pod "d499ec6a-7c42-4ba2-b4c6-19c6fe1caa99" (UID: "d499ec6a-7c42-4ba2-b4c6-19c6fe1caa99"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:08:04.851501 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:04.851370    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/88b5def9-2eb1-476e-a3ba-8f5b5ac6c32f-istio-podinfo" pod "88b5def9-2eb1-476e-a3ba-8f5b5ac6c32f" (UID: "88b5def9-2eb1-476e-a3ba-8f5b5ac6c32f"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 20:08:04.851501 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:04.851455    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/d499ec6a-7c42-4ba2-b4c6-19c6fe1caa99-istio-podinfo" pod "d499ec6a-7c42-4ba2-b4c6-19c6fe1caa99" (UID: "d499ec6a-7c42-4ba2-b4c6-19c6fe1caa99"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 20:08:04.852677 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:04.852651    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/88b5def9-2eb1-476e-a3ba-8f5b5ac6c32f-kube-api-access-bjbpm" pod "88b5def9-2eb1-476e-a3ba-8f5b5ac6c32f" (UID: "88b5def9-2eb1-476e-a3ba-8f5b5ac6c32f"). InnerVolumeSpecName "kube-api-access-bjbpm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:08:04.949278 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:04.949239    6275 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/88b5def9-2eb1-476e-a3ba-8f5b5ac6c32f-workload-certs\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:08:04.949278 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:04.949280    6275 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/88b5def9-2eb1-476e-a3ba-8f5b5ac6c32f-istio-envoy\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:08:04.949501 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:04.949294    6275 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/88b5def9-2eb1-476e-a3ba-8f5b5ac6c32f-credential-socket\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:08:04.949501 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:04.949308    6275 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/88b5def9-2eb1-476e-a3ba-8f5b5ac6c32f-istio-data\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:08:04.949501 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:04.949323    6275 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d499ec6a-7c42-4ba2-b4c6-19c6fe1caa99-credential-socket\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:08:04.949501 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:04.949356    6275 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/88b5def9-2eb1-476e-a3ba-8f5b5ac6c32f-workload-socket\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:08:04.949501 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:04.949371    6275 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d499ec6a-7c42-4ba2-b4c6-19c6fe1caa99-workload-socket\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:08:04.949501 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:04.949389    6275 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nrlrp\" (UniqueName: \"kubernetes.io/projected/d499ec6a-7c42-4ba2-b4c6-19c6fe1caa99-kube-api-access-nrlrp\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:08:04.949501 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:04.949403    6275 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d499ec6a-7c42-4ba2-b4c6-19c6fe1caa99-istio-envoy\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:08:04.949501 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:04.949437    6275 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d499ec6a-7c42-4ba2-b4c6-19c6fe1caa99-istiod-ca-cert\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:08:04.949501 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:04.949450    6275 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d499ec6a-7c42-4ba2-b4c6-19c6fe1caa99-istio-podinfo\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:08:04.949501 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:04.949463    6275 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/88b5def9-2eb1-476e-a3ba-8f5b5ac6c32f-istio-podinfo\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:08:04.949501 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:04.949476    6275 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bjbpm\" (UniqueName: \"kubernetes.io/projected/88b5def9-2eb1-476e-a3ba-8f5b5ac6c32f-kube-api-access-bjbpm\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:08:04.949501 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:04.949492    6275 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d499ec6a-7c42-4ba2-b4c6-19c6fe1caa99-istio-token\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:08:04.949877 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:04.949507    6275 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/88b5def9-2eb1-476e-a3ba-8f5b5ac6c32f-istiod-ca-cert\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:08:04.949877 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:04.949520    6275 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d499ec6a-7c42-4ba2-b4c6-19c6fe1caa99-istio-data\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:08:04.949877 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:04.949535    6275 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d499ec6a-7c42-4ba2-b4c6-19c6fe1caa99-workload-certs\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:08:04.949877 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:04.949548    6275 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/88b5def9-2eb1-476e-a3ba-8f5b5ac6c32f-istio-token\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:08:05.274873 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:05.274840    6275 generic.go:356] "Generic (PLEG): container finished" podID="88b5def9-2eb1-476e-a3ba-8f5b5ac6c32f" containerID="5c918d4a452b1a9f10e29341541dbb47115deed9914cd1bad4bea9e631a25646" exitCode=0
Oct 30 20:08:05.275042 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:05.274889    6275 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-912f24-openshift-default-5f56ff5f6c-r7hx2"
Oct 30 20:08:05.275042 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:05.274926    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-912f24-openshift-default-5f56ff5f6c-r7hx2" event={"ID":"88b5def9-2eb1-476e-a3ba-8f5b5ac6c32f","Type":"ContainerDied","Data":"5c918d4a452b1a9f10e29341541dbb47115deed9914cd1bad4bea9e631a25646"}
Oct 30 20:08:05.275042 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:05.274982    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-912f24-openshift-default-5f56ff5f6c-r7hx2" event={"ID":"88b5def9-2eb1-476e-a3ba-8f5b5ac6c32f","Type":"ContainerDied","Data":"d6e3f1165f3f76315172f1baf997db4b3c24b57514a42990ce55ac395ddfbcdd"}
Oct 30 20:08:05.275042 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:05.275010    6275 scope.go:122] "RemoveContainer" containerID="5c918d4a452b1a9f10e29341541dbb47115deed9914cd1bad4bea9e631a25646"
Oct 30 20:08:05.276634 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:05.276609    6275 generic.go:356] "Generic (PLEG): container finished" podID="d499ec6a-7c42-4ba2-b4c6-19c6fe1caa99" containerID="3dcc11efdf9b09a50116a56af3f886d34ca66a8c4800f9c2ee602fda7ed1c898" exitCode=0
Oct 30 20:08:05.276755 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:05.276638    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-912f24-openshift-default-5f56ff5f6c-w5dh9" event={"ID":"d499ec6a-7c42-4ba2-b4c6-19c6fe1caa99","Type":"ContainerDied","Data":"3dcc11efdf9b09a50116a56af3f886d34ca66a8c4800f9c2ee602fda7ed1c898"}
Oct 30 20:08:05.276755 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:05.276664    6275 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-912f24-openshift-default-5f56ff5f6c-w5dh9"
Oct 30 20:08:05.276755 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:05.276698    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-912f24-openshift-default-5f56ff5f6c-w5dh9" event={"ID":"d499ec6a-7c42-4ba2-b4c6-19c6fe1caa99","Type":"ContainerDied","Data":"e87b10da156d499218db59914b8d9b91ec96b65036322b1fe0eaff71ebff4397"}
Oct 30 20:08:05.278231 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:05.278207    6275 generic.go:356] "Generic (PLEG): container finished" podID="8a7d6f48-c37d-4f85-82e1-46b8b330b366" containerID="2b9f21f1056f1c31d49cdf332613ebabf786eb908ba2bdc51c2c96cba9a9cca5" exitCode=0
Oct 30 20:08:05.278325 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:05.278258    6275 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-912f24-openshift-default-5f56ff5f6c-sth92"
Oct 30 20:08:05.278325 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:05.278287    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-912f24-openshift-default-5f56ff5f6c-sth92" event={"ID":"8a7d6f48-c37d-4f85-82e1-46b8b330b366","Type":"ContainerDied","Data":"2b9f21f1056f1c31d49cdf332613ebabf786eb908ba2bdc51c2c96cba9a9cca5"}
Oct 30 20:08:05.278451 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:05.278334    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-912f24-openshift-default-5f56ff5f6c-sth92" event={"ID":"8a7d6f48-c37d-4f85-82e1-46b8b330b366","Type":"ContainerDied","Data":"c56d6042c356a4c24bf18f6125cd446afc48b1ba73f149fcab4f47ff4d2490f9"}
Oct 30 20:08:05.289433 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:05.289301    6275 scope.go:122] "RemoveContainer" containerID="5c918d4a452b1a9f10e29341541dbb47115deed9914cd1bad4bea9e631a25646"
Oct 30 20:08:05.289787 ip-10-0-131-26 kubenswrapper[6275]: E1030 20:08:05.289755    6275 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5c918d4a452b1a9f10e29341541dbb47115deed9914cd1bad4bea9e631a25646\": container with ID starting with 5c918d4a452b1a9f10e29341541dbb47115deed9914cd1bad4bea9e631a25646 not found: ID does not exist" containerID="5c918d4a452b1a9f10e29341541dbb47115deed9914cd1bad4bea9e631a25646"
Oct 30 20:08:05.289892 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:05.289805    6275 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5c918d4a452b1a9f10e29341541dbb47115deed9914cd1bad4bea9e631a25646"} err="failed to get container status \"5c918d4a452b1a9f10e29341541dbb47115deed9914cd1bad4bea9e631a25646\": rpc error: code = NotFound desc = could not find container \"5c918d4a452b1a9f10e29341541dbb47115deed9914cd1bad4bea9e631a25646\": container with ID starting with 5c918d4a452b1a9f10e29341541dbb47115deed9914cd1bad4bea9e631a25646 not found: ID does not exist"
Oct 30 20:08:05.289892 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:05.289830    6275 scope.go:122] "RemoveContainer" containerID="3dcc11efdf9b09a50116a56af3f886d34ca66a8c4800f9c2ee602fda7ed1c898"
Oct 30 20:08:05.291293 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:05.291229    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-dc2c5ee5-q2jfx" event={"ID":"328802e4-c003-41a2-a292-1f735cc8cec9","Type":"ContainerDied","Data":"cfce027a74daec507d7b373871e976f7bc7ef30602db31026eded8066d0aa1f4"}
Oct 30 20:08:05.291377 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:05.291361    6275 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="cfce027a74daec507d7b373871e976f7bc7ef30602db31026eded8066d0aa1f4"
Oct 30 20:08:05.291488 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:05.291470    6275 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-dc2c5ee5-q2jfx"
Oct 30 20:08:05.304380 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:05.304359    6275 scope.go:122] "RemoveContainer" containerID="3dcc11efdf9b09a50116a56af3f886d34ca66a8c4800f9c2ee602fda7ed1c898"
Oct 30 20:08:05.304759 ip-10-0-131-26 kubenswrapper[6275]: E1030 20:08:05.304738    6275 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3dcc11efdf9b09a50116a56af3f886d34ca66a8c4800f9c2ee602fda7ed1c898\": container with ID starting with 3dcc11efdf9b09a50116a56af3f886d34ca66a8c4800f9c2ee602fda7ed1c898 not found: ID does not exist" containerID="3dcc11efdf9b09a50116a56af3f886d34ca66a8c4800f9c2ee602fda7ed1c898"
Oct 30 20:08:05.304830 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:05.304767    6275 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3dcc11efdf9b09a50116a56af3f886d34ca66a8c4800f9c2ee602fda7ed1c898"} err="failed to get container status \"3dcc11efdf9b09a50116a56af3f886d34ca66a8c4800f9c2ee602fda7ed1c898\": rpc error: code = NotFound desc = could not find container \"3dcc11efdf9b09a50116a56af3f886d34ca66a8c4800f9c2ee602fda7ed1c898\": container with ID starting with 3dcc11efdf9b09a50116a56af3f886d34ca66a8c4800f9c2ee602fda7ed1c898 not found: ID does not exist"
Oct 30 20:08:05.304830 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:05.304786    6275 scope.go:122] "RemoveContainer" containerID="2b9f21f1056f1c31d49cdf332613ebabf786eb908ba2bdc51c2c96cba9a9cca5"
Oct 30 20:08:05.316618 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:05.316600    6275 scope.go:122] "RemoveContainer" containerID="2b9f21f1056f1c31d49cdf332613ebabf786eb908ba2bdc51c2c96cba9a9cca5"
Oct 30 20:08:05.316928 ip-10-0-131-26 kubenswrapper[6275]: E1030 20:08:05.316907    6275 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2b9f21f1056f1c31d49cdf332613ebabf786eb908ba2bdc51c2c96cba9a9cca5\": container with ID starting with 2b9f21f1056f1c31d49cdf332613ebabf786eb908ba2bdc51c2c96cba9a9cca5 not found: ID does not exist" containerID="2b9f21f1056f1c31d49cdf332613ebabf786eb908ba2bdc51c2c96cba9a9cca5"
Oct 30 20:08:05.316979 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:05.316935    6275 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2b9f21f1056f1c31d49cdf332613ebabf786eb908ba2bdc51c2c96cba9a9cca5"} err="failed to get container status \"2b9f21f1056f1c31d49cdf332613ebabf786eb908ba2bdc51c2c96cba9a9cca5\": rpc error: code = NotFound desc = could not find container \"2b9f21f1056f1c31d49cdf332613ebabf786eb908ba2bdc51c2c96cba9a9cca5\": container with ID starting with 2b9f21f1056f1c31d49cdf332613ebabf786eb908ba2bdc51c2c96cba9a9cca5 not found: ID does not exist"
Oct 30 20:08:05.373328 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:05.373299    6275 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w3-912f24-openshift-default-5f56ff5f6c-sth92"]
Oct 30 20:08:05.385281 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:05.385254    6275 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w3-912f24-openshift-default-5f56ff5f6c-sth92"]
Oct 30 20:08:05.414038 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:05.414007    6275 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w3-912f24-openshift-default-5f56ff5f6c-r7hx2"]
Oct 30 20:08:05.420433 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:05.420392    6275 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w3-912f24-openshift-default-5f56ff5f6c-r7hx2"]
Oct 30 20:08:05.474458 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:05.474425    6275 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w3-912f24-openshift-default-5f56ff5f6c-w5dh9"]
Oct 30 20:08:05.481340 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:05.481312    6275 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w3-912f24-openshift-default-5f56ff5f6c-w5dh9"]
Oct 30 20:08:05.657007 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:05.656932    6275 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="86aa5049-8a13-4895-b56c-9823cbec69c6" path="/var/lib/kubelet/pods/86aa5049-8a13-4895-b56c-9823cbec69c6/volumes"
Oct 30 20:08:05.657485 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:05.657469    6275 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="88b5def9-2eb1-476e-a3ba-8f5b5ac6c32f" path="/var/lib/kubelet/pods/88b5def9-2eb1-476e-a3ba-8f5b5ac6c32f/volumes"
Oct 30 20:08:05.657932 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:05.657918    6275 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="8a7d6f48-c37d-4f85-82e1-46b8b330b366" path="/var/lib/kubelet/pods/8a7d6f48-c37d-4f85-82e1-46b8b330b366/volumes"
Oct 30 20:08:05.658679 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:05.658665    6275 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="d499ec6a-7c42-4ba2-b4c6-19c6fe1caa99" path="/var/lib/kubelet/pods/d499ec6a-7c42-4ba2-b4c6-19c6fe1caa99/volumes"
Oct 30 20:08:09.195128 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:09.195094    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-processing-e2e-worker-w1-5f10d2-67674b9455-6zbsz" podUID="1e73518f-783a-4762-96b8-42d3f38a5cd6" containerName="payload-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 30 20:08:11.375980 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:11.375896    6275 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w1-5f10d2-59db957d85-lhp47"]
Oct 30 20:08:11.376553 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:11.376158    6275 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-5f10d2-59db957d85-lhp47" podUID="8c28cbc6-12e2-4297-8652-fd5215a5414b" containerName="maas-api" containerID="cri-o://7647e6c334603691b3b7c1c0d30c329578e294cbb806b082fe1e71aa8d13d974" gracePeriod=30
Oct 30 20:08:11.393521 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:11.389668    6275 generic.go:356] "Generic (PLEG): container finished" podID="1e73518f-783a-4762-96b8-42d3f38a5cd6" containerID="4f2ab27f4b4c8ab7b8d6694289ff320156aa6aa9e051f5c587d35cce33bf6b61" exitCode=0
Oct 30 20:08:11.393521 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:11.390050    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w1-5f10d2-67674b9455-6zbsz" event={"ID":"1e73518f-783a-4762-96b8-42d3f38a5cd6","Type":"ContainerDied","Data":"4f2ab27f4b4c8ab7b8d6694289ff320156aa6aa9e051f5c587d35cce33bf6b61"}
Oct 30 20:08:11.493685 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:11.493657    6275 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w1-5f10d2-67674b9455-6zbsz"
Oct 30 20:08:11.631732 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:11.631707    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/1e73518f-783a-4762-96b8-42d3f38a5cd6-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1e73518f-783a-4762-96b8-42d3f38a5cd6-plugins-config-volume\") pod \"1e73518f-783a-4762-96b8-42d3f38a5cd6\" (UID: \"1e73518f-783a-4762-96b8-42d3f38a5cd6\") "
Oct 30 20:08:11.631895 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:11.631883    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/1e73518f-783a-4762-96b8-42d3f38a5cd6-kube-api-access-5m5sm\" (UniqueName: \"kubernetes.io/projected/1e73518f-783a-4762-96b8-42d3f38a5cd6-kube-api-access-5m5sm\") pod \"1e73518f-783a-4762-96b8-42d3f38a5cd6\" (UID: \"1e73518f-783a-4762-96b8-42d3f38a5cd6\") "
Oct 30 20:08:11.632071 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:11.632048    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1e73518f-783a-4762-96b8-42d3f38a5cd6-plugins-config-volume" pod "1e73518f-783a-4762-96b8-42d3f38a5cd6" (UID: "1e73518f-783a-4762-96b8-42d3f38a5cd6"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:08:11.632284 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:11.632262    6275 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1e73518f-783a-4762-96b8-42d3f38a5cd6-plugins-config-volume\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:08:11.634093 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:11.634066    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1e73518f-783a-4762-96b8-42d3f38a5cd6-kube-api-access-5m5sm" pod "1e73518f-783a-4762-96b8-42d3f38a5cd6" (UID: "1e73518f-783a-4762-96b8-42d3f38a5cd6"). InnerVolumeSpecName "kube-api-access-5m5sm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:08:11.763352 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:11.752429    6275 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5m5sm\" (UniqueName: \"kubernetes.io/projected/1e73518f-783a-4762-96b8-42d3f38a5cd6-kube-api-access-5m5sm\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:08:11.835044 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:11.835010    6275 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-5f10d2-59db957d85-lhp47"
Oct 30 20:08:11.836850 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:11.836824    6275 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w6-51dd62-openshift-default-7954bd8797-5phnf"]
Oct 30 20:08:11.838230 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:11.838204    6275 cpu_manager.go:414] "containerMap: removing container" podUID="88b5def9-2eb1-476e-a3ba-8f5b5ac6c32f" containerName="istio-proxy"
Oct 30 20:08:11.838379 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:11.838365    6275 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="88b5def9-2eb1-476e-a3ba-8f5b5ac6c32f" containerName="istio-proxy"
Oct 30 20:08:11.838531 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:11.838518    6275 cpu_manager.go:414] "containerMap: removing container" podUID="8c41c1e8-30e2-416d-a07e-cb0177f33ff6" containerName="istio-proxy"
Oct 30 20:08:11.838614 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:11.838603    6275 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="8c41c1e8-30e2-416d-a07e-cb0177f33ff6" containerName="istio-proxy"
Oct 30 20:08:11.838704 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:11.838694    6275 cpu_manager.go:414] "containerMap: removing container" podUID="5aec32f5-a318-4b0c-9c2f-2af7f36b8fd4" containerName="istio-proxy"
Oct 30 20:08:11.838776 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:11.838766    6275 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="5aec32f5-a318-4b0c-9c2f-2af7f36b8fd4" containerName="istio-proxy"
Oct 30 20:08:11.838862 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:11.838852    6275 cpu_manager.go:414] "containerMap: removing container" podUID="8a7d6f48-c37d-4f85-82e1-46b8b330b366" containerName="istio-proxy"
Oct 30 20:08:11.838934 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:11.838924    6275 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="8a7d6f48-c37d-4f85-82e1-46b8b330b366" containerName="istio-proxy"
Oct 30 20:08:11.839104 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:11.839093    6275 cpu_manager.go:414] "containerMap: removing container" podUID="d499ec6a-7c42-4ba2-b4c6-19c6fe1caa99" containerName="istio-proxy"
Oct 30 20:08:11.839182 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:11.839173    6275 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="d499ec6a-7c42-4ba2-b4c6-19c6fe1caa99" containerName="istio-proxy"
Oct 30 20:08:11.839259 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:11.839250    6275 cpu_manager.go:414] "containerMap: removing container" podUID="f35ca7ba-e2b8-4e65-bc7b-0051dea979e8" containerName="istio-proxy"
Oct 30 20:08:11.839333 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:11.839324    6275 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="f35ca7ba-e2b8-4e65-bc7b-0051dea979e8" containerName="istio-proxy"
Oct 30 20:08:11.839441 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:11.839430    6275 cpu_manager.go:414] "containerMap: removing container" podUID="328802e4-c003-41a2-a292-1f735cc8cec9" containerName="revoke-keys"
Oct 30 20:08:11.839575 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:11.839513    6275 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="328802e4-c003-41a2-a292-1f735cc8cec9" containerName="revoke-keys"
Oct 30 20:08:11.839779 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:11.839765    6275 cpu_manager.go:414] "containerMap: removing container" podUID="65f30ed1-2ae6-464b-8293-a36c663bde0a" containerName="istio-proxy"
Oct 30 20:08:11.839878 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:11.839866    6275 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="65f30ed1-2ae6-464b-8293-a36c663bde0a" containerName="istio-proxy"
Oct 30 20:08:11.839973 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:11.839963    6275 cpu_manager.go:414] "containerMap: removing container" podUID="1e73518f-783a-4762-96b8-42d3f38a5cd6" containerName="payload-processing"
Oct 30 20:08:11.840047 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:11.840038    6275 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="1e73518f-783a-4762-96b8-42d3f38a5cd6" containerName="payload-processing"
Oct 30 20:08:11.840138 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:11.840129    6275 cpu_manager.go:414] "containerMap: removing container" podUID="d0e72a0c-3d64-4e88-af2d-246a329f6215" containerName="istio-proxy"
Oct 30 20:08:11.840219 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:11.840209    6275 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="d0e72a0c-3d64-4e88-af2d-246a329f6215" containerName="istio-proxy"
Oct 30 20:08:11.840321 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:11.840311    6275 cpu_manager.go:414] "containerMap: removing container" podUID="8c28cbc6-12e2-4297-8652-fd5215a5414b" containerName="maas-api"
Oct 30 20:08:11.840400 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:11.840391    6275 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="8c28cbc6-12e2-4297-8652-fd5215a5414b" containerName="maas-api"
Oct 30 20:08:11.840511 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:11.840500    6275 cpu_manager.go:414] "containerMap: removing container" podUID="2df32608-dcec-4946-acc6-957287e09fbb" containerName="revoke-keys"
Oct 30 20:08:11.840585 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:11.840576    6275 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="2df32608-dcec-4946-acc6-957287e09fbb" containerName="revoke-keys"
Oct 30 20:08:11.840919 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:11.840905    6275 memory_manager.go:365] "RemoveStaleState removing state" podUID="65f30ed1-2ae6-464b-8293-a36c663bde0a" containerName="istio-proxy"
Oct 30 20:08:11.841025 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:11.841015    6275 memory_manager.go:365] "RemoveStaleState removing state" podUID="1e73518f-783a-4762-96b8-42d3f38a5cd6" containerName="payload-processing"
Oct 30 20:08:11.841107 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:11.841097    6275 memory_manager.go:365] "RemoveStaleState removing state" podUID="d0e72a0c-3d64-4e88-af2d-246a329f6215" containerName="istio-proxy"
Oct 30 20:08:11.841202 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:11.841192    6275 memory_manager.go:365] "RemoveStaleState removing state" podUID="8c28cbc6-12e2-4297-8652-fd5215a5414b" containerName="maas-api"
Oct 30 20:08:11.841285 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:11.841276    6275 memory_manager.go:365] "RemoveStaleState removing state" podUID="2df32608-dcec-4946-acc6-957287e09fbb" containerName="revoke-keys"
Oct 30 20:08:11.841360 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:11.841351    6275 memory_manager.go:365] "RemoveStaleState removing state" podUID="88b5def9-2eb1-476e-a3ba-8f5b5ac6c32f" containerName="istio-proxy"
Oct 30 20:08:11.841455 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:11.841445    6275 memory_manager.go:365] "RemoveStaleState removing state" podUID="8c41c1e8-30e2-416d-a07e-cb0177f33ff6" containerName="istio-proxy"
Oct 30 20:08:11.841526 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:11.841517    6275 memory_manager.go:365] "RemoveStaleState removing state" podUID="5aec32f5-a318-4b0c-9c2f-2af7f36b8fd4" containerName="istio-proxy"
Oct 30 20:08:11.841609 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:11.841600    6275 memory_manager.go:365] "RemoveStaleState removing state" podUID="8a7d6f48-c37d-4f85-82e1-46b8b330b366" containerName="istio-proxy"
Oct 30 20:08:11.841699 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:11.841690    6275 memory_manager.go:365] "RemoveStaleState removing state" podUID="d499ec6a-7c42-4ba2-b4c6-19c6fe1caa99" containerName="istio-proxy"
Oct 30 20:08:11.841772 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:11.841763    6275 memory_manager.go:365] "RemoveStaleState removing state" podUID="f35ca7ba-e2b8-4e65-bc7b-0051dea979e8" containerName="istio-proxy"
Oct 30 20:08:11.841855 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:11.841843    6275 memory_manager.go:365] "RemoveStaleState removing state" podUID="328802e4-c003-41a2-a292-1f735cc8cec9" containerName="revoke-keys"
Oct 30 20:08:11.851082 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:11.849523    6275 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w6-51dd62-openshift-default-7954bd8797-5phnf"]
Oct 30 20:08:11.851082 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:11.849652    6275 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-51dd62-openshift-default-7954bd8797-5phnf"
Oct 30 20:08:11.853899 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:11.853876    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/debc38ac-d2b2-47f4-b94b-5d140d1b1194-istio-data\") pod \"e2e-worker-w6-51dd62-openshift-default-7954bd8797-5phnf\" (UID: \"debc38ac-d2b2-47f4-b94b-5d140d1b1194\") " pod="openshift-ingress/e2e-worker-w6-51dd62-openshift-default-7954bd8797-5phnf"
Oct 30 20:08:11.854085 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:11.854065    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/debc38ac-d2b2-47f4-b94b-5d140d1b1194-istiod-ca-cert\") pod \"e2e-worker-w6-51dd62-openshift-default-7954bd8797-5phnf\" (UID: \"debc38ac-d2b2-47f4-b94b-5d140d1b1194\") " pod="openshift-ingress/e2e-worker-w6-51dd62-openshift-default-7954bd8797-5phnf"
Oct 30 20:08:11.854203 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:11.854187    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/debc38ac-d2b2-47f4-b94b-5d140d1b1194-workload-socket\") pod \"e2e-worker-w6-51dd62-openshift-default-7954bd8797-5phnf\" (UID: \"debc38ac-d2b2-47f4-b94b-5d140d1b1194\") " pod="openshift-ingress/e2e-worker-w6-51dd62-openshift-default-7954bd8797-5phnf"
Oct 30 20:08:11.854291 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:11.854279    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/debc38ac-d2b2-47f4-b94b-5d140d1b1194-istio-envoy\") pod \"e2e-worker-w6-51dd62-openshift-default-7954bd8797-5phnf\" (UID: \"debc38ac-d2b2-47f4-b94b-5d140d1b1194\") " pod="openshift-ingress/e2e-worker-w6-51dd62-openshift-default-7954bd8797-5phnf"
Oct 30 20:08:11.854480 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:11.854465    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/debc38ac-d2b2-47f4-b94b-5d140d1b1194-credential-socket\") pod \"e2e-worker-w6-51dd62-openshift-default-7954bd8797-5phnf\" (UID: \"debc38ac-d2b2-47f4-b94b-5d140d1b1194\") " pod="openshift-ingress/e2e-worker-w6-51dd62-openshift-default-7954bd8797-5phnf"
Oct 30 20:08:11.854595 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:11.854582    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5vg2r\" (UniqueName: \"kubernetes.io/projected/debc38ac-d2b2-47f4-b94b-5d140d1b1194-kube-api-access-5vg2r\") pod \"e2e-worker-w6-51dd62-openshift-default-7954bd8797-5phnf\" (UID: \"debc38ac-d2b2-47f4-b94b-5d140d1b1194\") " pod="openshift-ingress/e2e-worker-w6-51dd62-openshift-default-7954bd8797-5phnf"
Oct 30 20:08:11.854716 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:11.854704    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/debc38ac-d2b2-47f4-b94b-5d140d1b1194-istio-token\") pod \"e2e-worker-w6-51dd62-openshift-default-7954bd8797-5phnf\" (UID: \"debc38ac-d2b2-47f4-b94b-5d140d1b1194\") " pod="openshift-ingress/e2e-worker-w6-51dd62-openshift-default-7954bd8797-5phnf"
Oct 30 20:08:11.854828 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:11.854816    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/debc38ac-d2b2-47f4-b94b-5d140d1b1194-workload-certs\") pod \"e2e-worker-w6-51dd62-openshift-default-7954bd8797-5phnf\" (UID: \"debc38ac-d2b2-47f4-b94b-5d140d1b1194\") " pod="openshift-ingress/e2e-worker-w6-51dd62-openshift-default-7954bd8797-5phnf"
Oct 30 20:08:11.854945 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:11.854921    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/debc38ac-d2b2-47f4-b94b-5d140d1b1194-istio-podinfo\") pod \"e2e-worker-w6-51dd62-openshift-default-7954bd8797-5phnf\" (UID: \"debc38ac-d2b2-47f4-b94b-5d140d1b1194\") " pod="openshift-ingress/e2e-worker-w6-51dd62-openshift-default-7954bd8797-5phnf"
Oct 30 20:08:11.956036 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:11.955932    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/8c28cbc6-12e2-4297-8652-fd5215a5414b-metrics-certs\" (UniqueName: \"kubernetes.io/secret/8c28cbc6-12e2-4297-8652-fd5215a5414b-metrics-certs\") pod \"8c28cbc6-12e2-4297-8652-fd5215a5414b\" (UID: \"8c28cbc6-12e2-4297-8652-fd5215a5414b\") "
Oct 30 20:08:11.956207 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:11.956060    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/8c28cbc6-12e2-4297-8652-fd5215a5414b-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8c28cbc6-12e2-4297-8652-fd5215a5414b-maas-api-tls\") pod \"8c28cbc6-12e2-4297-8652-fd5215a5414b\" (UID: \"8c28cbc6-12e2-4297-8652-fd5215a5414b\") "
Oct 30 20:08:11.956207 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:11.956139    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/8c28cbc6-12e2-4297-8652-fd5215a5414b-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8c28cbc6-12e2-4297-8652-fd5215a5414b-openshift-service-ca\") pod \"8c28cbc6-12e2-4297-8652-fd5215a5414b\" (UID: \"8c28cbc6-12e2-4297-8652-fd5215a5414b\") "
Oct 30 20:08:11.956357 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:11.956258    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/8c28cbc6-12e2-4297-8652-fd5215a5414b-kube-api-access-2kmqn\" (UniqueName: \"kubernetes.io/projected/8c28cbc6-12e2-4297-8652-fd5215a5414b-kube-api-access-2kmqn\") pod \"8c28cbc6-12e2-4297-8652-fd5215a5414b\" (UID: \"8c28cbc6-12e2-4297-8652-fd5215a5414b\") "
Oct 30 20:08:11.956566 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:11.956537    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/debc38ac-d2b2-47f4-b94b-5d140d1b1194-istiod-ca-cert\") pod \"e2e-worker-w6-51dd62-openshift-default-7954bd8797-5phnf\" (UID: \"debc38ac-d2b2-47f4-b94b-5d140d1b1194\") " pod="openshift-ingress/e2e-worker-w6-51dd62-openshift-default-7954bd8797-5phnf"
Oct 30 20:08:11.956703 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:11.956579    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/debc38ac-d2b2-47f4-b94b-5d140d1b1194-workload-socket\") pod \"e2e-worker-w6-51dd62-openshift-default-7954bd8797-5phnf\" (UID: \"debc38ac-d2b2-47f4-b94b-5d140d1b1194\") " pod="openshift-ingress/e2e-worker-w6-51dd62-openshift-default-7954bd8797-5phnf"
Oct 30 20:08:11.956703 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:11.956606    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/debc38ac-d2b2-47f4-b94b-5d140d1b1194-istio-envoy\") pod \"e2e-worker-w6-51dd62-openshift-default-7954bd8797-5phnf\" (UID: \"debc38ac-d2b2-47f4-b94b-5d140d1b1194\") " pod="openshift-ingress/e2e-worker-w6-51dd62-openshift-default-7954bd8797-5phnf"
Oct 30 20:08:11.956703 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:11.956595    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8c28cbc6-12e2-4297-8652-fd5215a5414b-openshift-service-ca" pod "8c28cbc6-12e2-4297-8652-fd5215a5414b" (UID: "8c28cbc6-12e2-4297-8652-fd5215a5414b"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:08:11.956703 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:11.956681    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/debc38ac-d2b2-47f4-b94b-5d140d1b1194-credential-socket\") pod \"e2e-worker-w6-51dd62-openshift-default-7954bd8797-5phnf\" (UID: \"debc38ac-d2b2-47f4-b94b-5d140d1b1194\") " pod="openshift-ingress/e2e-worker-w6-51dd62-openshift-default-7954bd8797-5phnf"
Oct 30 20:08:11.956919 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:11.956723    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5vg2r\" (UniqueName: \"kubernetes.io/projected/debc38ac-d2b2-47f4-b94b-5d140d1b1194-kube-api-access-5vg2r\") pod \"e2e-worker-w6-51dd62-openshift-default-7954bd8797-5phnf\" (UID: \"debc38ac-d2b2-47f4-b94b-5d140d1b1194\") " pod="openshift-ingress/e2e-worker-w6-51dd62-openshift-default-7954bd8797-5phnf"
Oct 30 20:08:11.956919 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:11.956792    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/debc38ac-d2b2-47f4-b94b-5d140d1b1194-istio-token\") pod \"e2e-worker-w6-51dd62-openshift-default-7954bd8797-5phnf\" (UID: \"debc38ac-d2b2-47f4-b94b-5d140d1b1194\") " pod="openshift-ingress/e2e-worker-w6-51dd62-openshift-default-7954bd8797-5phnf"
Oct 30 20:08:11.957024 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:11.956939    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/debc38ac-d2b2-47f4-b94b-5d140d1b1194-workload-certs\") pod \"e2e-worker-w6-51dd62-openshift-default-7954bd8797-5phnf\" (UID: \"debc38ac-d2b2-47f4-b94b-5d140d1b1194\") " pod="openshift-ingress/e2e-worker-w6-51dd62-openshift-default-7954bd8797-5phnf"
Oct 30 20:08:11.957024 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:11.957008    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/debc38ac-d2b2-47f4-b94b-5d140d1b1194-istio-podinfo\") pod \"e2e-worker-w6-51dd62-openshift-default-7954bd8797-5phnf\" (UID: \"debc38ac-d2b2-47f4-b94b-5d140d1b1194\") " pod="openshift-ingress/e2e-worker-w6-51dd62-openshift-default-7954bd8797-5phnf"
Oct 30 20:08:11.957146 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:11.957126    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/debc38ac-d2b2-47f4-b94b-5d140d1b1194-istio-data\") pod \"e2e-worker-w6-51dd62-openshift-default-7954bd8797-5phnf\" (UID: \"debc38ac-d2b2-47f4-b94b-5d140d1b1194\") " pod="openshift-ingress/e2e-worker-w6-51dd62-openshift-default-7954bd8797-5phnf"
Oct 30 20:08:11.958097 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:11.957209    6275 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8c28cbc6-12e2-4297-8652-fd5215a5414b-openshift-service-ca\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:08:11.958097 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:11.957273    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/debc38ac-d2b2-47f4-b94b-5d140d1b1194-credential-socket\") pod \"e2e-worker-w6-51dd62-openshift-default-7954bd8797-5phnf\" (UID: \"debc38ac-d2b2-47f4-b94b-5d140d1b1194\") " pod="openshift-ingress/e2e-worker-w6-51dd62-openshift-default-7954bd8797-5phnf"
Oct 30 20:08:11.958097 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:11.957527    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/debc38ac-d2b2-47f4-b94b-5d140d1b1194-istio-data\") pod \"e2e-worker-w6-51dd62-openshift-default-7954bd8797-5phnf\" (UID: \"debc38ac-d2b2-47f4-b94b-5d140d1b1194\") " pod="openshift-ingress/e2e-worker-w6-51dd62-openshift-default-7954bd8797-5phnf"
Oct 30 20:08:11.958097 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:11.957755    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/debc38ac-d2b2-47f4-b94b-5d140d1b1194-workload-certs\") pod \"e2e-worker-w6-51dd62-openshift-default-7954bd8797-5phnf\" (UID: \"debc38ac-d2b2-47f4-b94b-5d140d1b1194\") " pod="openshift-ingress/e2e-worker-w6-51dd62-openshift-default-7954bd8797-5phnf"
Oct 30 20:08:11.958097 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:11.957925    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/debc38ac-d2b2-47f4-b94b-5d140d1b1194-istiod-ca-cert\") pod \"e2e-worker-w6-51dd62-openshift-default-7954bd8797-5phnf\" (UID: \"debc38ac-d2b2-47f4-b94b-5d140d1b1194\") " pod="openshift-ingress/e2e-worker-w6-51dd62-openshift-default-7954bd8797-5phnf"
Oct 30 20:08:11.958459 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:11.958159    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/debc38ac-d2b2-47f4-b94b-5d140d1b1194-workload-socket\") pod \"e2e-worker-w6-51dd62-openshift-default-7954bd8797-5phnf\" (UID: \"debc38ac-d2b2-47f4-b94b-5d140d1b1194\") " pod="openshift-ingress/e2e-worker-w6-51dd62-openshift-default-7954bd8797-5phnf"
Oct 30 20:08:11.958856 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:11.958822    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8c28cbc6-12e2-4297-8652-fd5215a5414b-metrics-certs" pod "8c28cbc6-12e2-4297-8652-fd5215a5414b" (UID: "8c28cbc6-12e2-4297-8652-fd5215a5414b"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 20:08:11.958933 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:11.958843    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8c28cbc6-12e2-4297-8652-fd5215a5414b-maas-api-tls" pod "8c28cbc6-12e2-4297-8652-fd5215a5414b" (UID: "8c28cbc6-12e2-4297-8652-fd5215a5414b"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 20:08:11.959337 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:11.959297    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/debc38ac-d2b2-47f4-b94b-5d140d1b1194-istio-envoy\") pod \"e2e-worker-w6-51dd62-openshift-default-7954bd8797-5phnf\" (UID: \"debc38ac-d2b2-47f4-b94b-5d140d1b1194\") " pod="openshift-ingress/e2e-worker-w6-51dd62-openshift-default-7954bd8797-5phnf"
Oct 30 20:08:11.959992 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:11.959972    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/debc38ac-d2b2-47f4-b94b-5d140d1b1194-istio-podinfo\") pod \"e2e-worker-w6-51dd62-openshift-default-7954bd8797-5phnf\" (UID: \"debc38ac-d2b2-47f4-b94b-5d140d1b1194\") " pod="openshift-ingress/e2e-worker-w6-51dd62-openshift-default-7954bd8797-5phnf"
Oct 30 20:08:11.960511 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:11.960483    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8c28cbc6-12e2-4297-8652-fd5215a5414b-kube-api-access-2kmqn" pod "8c28cbc6-12e2-4297-8652-fd5215a5414b" (UID: "8c28cbc6-12e2-4297-8652-fd5215a5414b"). InnerVolumeSpecName "kube-api-access-2kmqn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:08:11.983850 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:11.983824    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5vg2r\" (UniqueName: \"kubernetes.io/projected/debc38ac-d2b2-47f4-b94b-5d140d1b1194-kube-api-access-5vg2r\") pod \"e2e-worker-w6-51dd62-openshift-default-7954bd8797-5phnf\" (UID: \"debc38ac-d2b2-47f4-b94b-5d140d1b1194\") " pod="openshift-ingress/e2e-worker-w6-51dd62-openshift-default-7954bd8797-5phnf"
Oct 30 20:08:11.983977 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:11.983864    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/debc38ac-d2b2-47f4-b94b-5d140d1b1194-istio-token\") pod \"e2e-worker-w6-51dd62-openshift-default-7954bd8797-5phnf\" (UID: \"debc38ac-d2b2-47f4-b94b-5d140d1b1194\") " pod="openshift-ingress/e2e-worker-w6-51dd62-openshift-default-7954bd8797-5phnf"
Oct 30 20:08:12.072786 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:12.072749    6275 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8c28cbc6-12e2-4297-8652-fd5215a5414b-metrics-certs\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:08:12.072786 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:12.072783    6275 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8c28cbc6-12e2-4297-8652-fd5215a5414b-maas-api-tls\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:08:12.073050 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:12.072795    6275 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2kmqn\" (UniqueName: \"kubernetes.io/projected/8c28cbc6-12e2-4297-8652-fd5215a5414b-kube-api-access-2kmqn\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:08:12.168587 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:12.168546    6275 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-51dd62-openshift-default-7954bd8797-5phnf"
Oct 30 20:08:12.398801 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:12.398766    6275 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w1-5f10d2-67674b9455-6zbsz"
Oct 30 20:08:12.398801 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:12.398783    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w1-5f10d2-67674b9455-6zbsz" event={"ID":"1e73518f-783a-4762-96b8-42d3f38a5cd6","Type":"ContainerDied","Data":"77acf1aca3abc5b6c840c3fe7707e44cd011c5b8c677bc8796cd62638c3742de"}
Oct 30 20:08:12.399334 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:12.398850    6275 scope.go:122] "RemoveContainer" containerID="4f2ab27f4b4c8ab7b8d6694289ff320156aa6aa9e051f5c587d35cce33bf6b61"
Oct 30 20:08:12.400338 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:12.400316    6275 generic.go:356] "Generic (PLEG): container finished" podID="8c28cbc6-12e2-4297-8652-fd5215a5414b" containerID="7647e6c334603691b3b7c1c0d30c329578e294cbb806b082fe1e71aa8d13d974" exitCode=0
Oct 30 20:08:12.400460 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:12.400374    6275 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-5f10d2-59db957d85-lhp47"
Oct 30 20:08:12.400460 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:12.400399    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-5f10d2-59db957d85-lhp47" event={"ID":"8c28cbc6-12e2-4297-8652-fd5215a5414b","Type":"ContainerDied","Data":"7647e6c334603691b3b7c1c0d30c329578e294cbb806b082fe1e71aa8d13d974"}
Oct 30 20:08:12.400565 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:12.400476    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-5f10d2-59db957d85-lhp47" event={"ID":"8c28cbc6-12e2-4297-8652-fd5215a5414b","Type":"ContainerDied","Data":"394b132f8783844a3ac8435789c6958126b8cf46945d0c37687dd86272e432f2"}
Oct 30 20:08:12.410905 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:12.410883    6275 scope.go:122] "RemoveContainer" containerID="7647e6c334603691b3b7c1c0d30c329578e294cbb806b082fe1e71aa8d13d974"
Oct 30 20:08:12.449575 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:12.448887    6275 scope.go:122] "RemoveContainer" containerID="7647e6c334603691b3b7c1c0d30c329578e294cbb806b082fe1e71aa8d13d974"
Oct 30 20:08:12.450494 ip-10-0-131-26 kubenswrapper[6275]: E1030 20:08:12.450464    6275 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7647e6c334603691b3b7c1c0d30c329578e294cbb806b082fe1e71aa8d13d974\": container with ID starting with 7647e6c334603691b3b7c1c0d30c329578e294cbb806b082fe1e71aa8d13d974 not found: ID does not exist" containerID="7647e6c334603691b3b7c1c0d30c329578e294cbb806b082fe1e71aa8d13d974"
Oct 30 20:08:12.450631 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:12.450500    6275 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7647e6c334603691b3b7c1c0d30c329578e294cbb806b082fe1e71aa8d13d974"} err="failed to get container status \"7647e6c334603691b3b7c1c0d30c329578e294cbb806b082fe1e71aa8d13d974\": rpc error: code = NotFound desc = could not find container \"7647e6c334603691b3b7c1c0d30c329578e294cbb806b082fe1e71aa8d13d974\": container with ID starting with 7647e6c334603691b3b7c1c0d30c329578e294cbb806b082fe1e71aa8d13d974 not found: ID does not exist"
Oct 30 20:08:12.489700 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:12.489624    6275 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w1-5f10d2-59db957d85-lhp47"]
Oct 30 20:08:12.501573 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:12.501545    6275 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w1-5f10d2-59db957d85-lhp47"]
Oct 30 20:08:12.546172 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:12.546143    6275 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w6-51dd62-openshift-default-7954bd8797-5phnf"]
Oct 30 20:08:12.547124 ip-10-0-131-26 kubenswrapper[6275]: W1030 20:08:12.547093    6275 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddebc38ac_d2b2_47f4_b94b_5d140d1b1194.slice/crio-010f622eb919fb2493d9bd05a2034950091321e9782df1caf3edd70cdbd19a87 WatchSource:0}: Error finding container 010f622eb919fb2493d9bd05a2034950091321e9782df1caf3edd70cdbd19a87: Status 404 returned error can't find the container with id 010f622eb919fb2493d9bd05a2034950091321e9782df1caf3edd70cdbd19a87
Oct 30 20:08:12.550024 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:12.549981    6275 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Oct 30 20:08:12.550136 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:12.550082    6275 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Oct 30 20:08:12.550180 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:12.550142    6275 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Oct 30 20:08:12.550817 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:12.550763    6275 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w1-5f10d2-67674b9455-6zbsz"]
Oct 30 20:08:12.554624 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:12.554604    6275 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w1-5f10d2-67674b9455-6zbsz"]
Oct 30 20:08:12.564461 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:12.559561    6275 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w1-5f10d2-gzczw"]
Oct 30 20:08:12.564461 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:12.564130    6275 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w1-5f10d2-gzczw"]
Oct 30 20:08:13.409794 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:13.409755    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-51dd62-openshift-default-7954bd8797-5phnf" event={"ID":"debc38ac-d2b2-47f4-b94b-5d140d1b1194","Type":"ContainerStarted","Data":"83a83c7f5e8ff797da9d512a41802ed76e27ea4c967bf9308db066e4cb2f2f2a"}
Oct 30 20:08:13.410343 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:13.409817    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-51dd62-openshift-default-7954bd8797-5phnf" event={"ID":"debc38ac-d2b2-47f4-b94b-5d140d1b1194","Type":"ContainerStarted","Data":"010f622eb919fb2493d9bd05a2034950091321e9782df1caf3edd70cdbd19a87"}
Oct 30 20:08:13.657379 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:13.657340    6275 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="1e73518f-783a-4762-96b8-42d3f38a5cd6" path="/var/lib/kubelet/pods/1e73518f-783a-4762-96b8-42d3f38a5cd6/volumes"
Oct 30 20:08:13.657960 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:13.657936    6275 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="803f3028-5e38-40f3-baa2-dd3fee4093e8" path="/var/lib/kubelet/pods/803f3028-5e38-40f3-baa2-dd3fee4093e8/volumes"
Oct 30 20:08:13.658445 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:13.658395    6275 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="8c28cbc6-12e2-4297-8652-fd5215a5414b" path="/var/lib/kubelet/pods/8c28cbc6-12e2-4297-8652-fd5215a5414b/volumes"
Oct 30 20:08:14.180439 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:14.173770    6275 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w6-51dd62-openshift-default-7954bd8797-5phnf"
Oct 30 20:08:14.180439 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:14.177802    6275 patch_prober.go:29] interesting pod/e2e-worker-w6-51dd62-openshift-default-7954bd8797-5phnf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.115:15021/healthz/ready\": dial tcp 10.134.0.115:15021: connect: connection refused" start-of-body=
Oct 30 20:08:14.180439 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:14.177855    6275 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-51dd62-openshift-default-7954bd8797-5phnf" podUID="debc38ac-d2b2-47f4-b94b-5d140d1b1194" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.115:15021/healthz/ready\": dial tcp 10.134.0.115:15021: connect: connection refused"
Oct 30 20:08:15.181440 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:15.178939    6275 patch_prober.go:29] interesting pod/e2e-worker-w6-51dd62-openshift-default-7954bd8797-5phnf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.115:15021/healthz/ready\": dial tcp 10.134.0.115:15021: connect: connection refused" start-of-body=
Oct 30 20:08:15.181440 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:15.179017    6275 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-51dd62-openshift-default-7954bd8797-5phnf" podUID="debc38ac-d2b2-47f4-b94b-5d140d1b1194" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.115:15021/healthz/ready\": dial tcp 10.134.0.115:15021: connect: connection refused"
Oct 30 20:08:16.179857 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:16.179819    6275 patch_prober.go:29] interesting pod/e2e-worker-w6-51dd62-openshift-default-7954bd8797-5phnf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.115:15021/healthz/ready\": dial tcp 10.134.0.115:15021: connect: connection refused" start-of-body=
Oct 30 20:08:16.180574 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:16.180126    6275 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-51dd62-openshift-default-7954bd8797-5phnf" podUID="debc38ac-d2b2-47f4-b94b-5d140d1b1194" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.115:15021/healthz/ready\": dial tcp 10.134.0.115:15021: connect: connection refused"
Oct 30 20:08:16.405141 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:16.405084    6275 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w6-51dd62-openshift-default-7954bd8797-5phnf" podStartSLOduration=5.405067573 podStartE2EDuration="5.405067573s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:08:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:08:13.482725124 +0000 UTC m=+1203.944451989" watchObservedRunningTime="2026-10-30 20:08:16.405067573 +0000 UTC m=+1206.866794435"
Oct 30 20:08:16.407282 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:16.407254    6275 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-sgdlr"]
Oct 30 20:08:16.416682 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:16.416653    6275 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-sgdlr"
Oct 30 20:08:16.426585 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:16.426562    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/4e8840f7-113f-409e-bba7-3f8ec2dabb56-local-certs\") pod \"istiod-openshift-gateway-7ddd9cfdc8-sgdlr\" (UID: \"4e8840f7-113f-409e-bba7-3f8ec2dabb56\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-sgdlr"
Oct 30 20:08:16.426709 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:16.426694    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g6c67\" (UniqueName: \"kubernetes.io/projected/4e8840f7-113f-409e-bba7-3f8ec2dabb56-kube-api-access-g6c67\") pod \"istiod-openshift-gateway-7ddd9cfdc8-sgdlr\" (UID: \"4e8840f7-113f-409e-bba7-3f8ec2dabb56\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-sgdlr"
Oct 30 20:08:16.426752 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:16.426723    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/4e8840f7-113f-409e-bba7-3f8ec2dabb56-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7ddd9cfdc8-sgdlr\" (UID: \"4e8840f7-113f-409e-bba7-3f8ec2dabb56\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-sgdlr"
Oct 30 20:08:16.426867 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:16.426842    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4e8840f7-113f-409e-bba7-3f8ec2dabb56-istio-token\") pod \"istiod-openshift-gateway-7ddd9cfdc8-sgdlr\" (UID: \"4e8840f7-113f-409e-bba7-3f8ec2dabb56\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-sgdlr"
Oct 30 20:08:16.426908 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:16.426894    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/4e8840f7-113f-409e-bba7-3f8ec2dabb56-cacerts\") pod \"istiod-openshift-gateway-7ddd9cfdc8-sgdlr\" (UID: \"4e8840f7-113f-409e-bba7-3f8ec2dabb56\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-sgdlr"
Oct 30 20:08:16.426974 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:16.426959    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/4e8840f7-113f-409e-bba7-3f8ec2dabb56-istio-kubeconfig\") pod \"istiod-openshift-gateway-7ddd9cfdc8-sgdlr\" (UID: \"4e8840f7-113f-409e-bba7-3f8ec2dabb56\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-sgdlr"
Oct 30 20:08:16.427009 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:16.426985    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/4e8840f7-113f-409e-bba7-3f8ec2dabb56-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7ddd9cfdc8-sgdlr\" (UID: \"4e8840f7-113f-409e-bba7-3f8ec2dabb56\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-sgdlr"
Oct 30 20:08:16.435628 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:16.435566    6275 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Oct 30 20:08:16.440069 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:16.440042    6275 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-sgdlr"]
Oct 30 20:08:16.447181 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:16.446956    6275 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Oct 30 20:08:16.447181 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:16.446994    6275 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Oct 30 20:08:16.447181 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:16.447027    6275 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-r79wj\""
Oct 30 20:08:16.528658 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:16.528615    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4e8840f7-113f-409e-bba7-3f8ec2dabb56-istio-token\") pod \"istiod-openshift-gateway-7ddd9cfdc8-sgdlr\" (UID: \"4e8840f7-113f-409e-bba7-3f8ec2dabb56\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-sgdlr"
Oct 30 20:08:16.528658 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:16.528660    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/4e8840f7-113f-409e-bba7-3f8ec2dabb56-cacerts\") pod \"istiod-openshift-gateway-7ddd9cfdc8-sgdlr\" (UID: \"4e8840f7-113f-409e-bba7-3f8ec2dabb56\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-sgdlr"
Oct 30 20:08:16.528925 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:16.528703    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/4e8840f7-113f-409e-bba7-3f8ec2dabb56-istio-kubeconfig\") pod \"istiod-openshift-gateway-7ddd9cfdc8-sgdlr\" (UID: \"4e8840f7-113f-409e-bba7-3f8ec2dabb56\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-sgdlr"
Oct 30 20:08:16.528925 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:16.528721    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/4e8840f7-113f-409e-bba7-3f8ec2dabb56-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7ddd9cfdc8-sgdlr\" (UID: \"4e8840f7-113f-409e-bba7-3f8ec2dabb56\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-sgdlr"
Oct 30 20:08:16.528925 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:16.528765    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/4e8840f7-113f-409e-bba7-3f8ec2dabb56-local-certs\") pod \"istiod-openshift-gateway-7ddd9cfdc8-sgdlr\" (UID: \"4e8840f7-113f-409e-bba7-3f8ec2dabb56\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-sgdlr"
Oct 30 20:08:16.528925 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:16.528849    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g6c67\" (UniqueName: \"kubernetes.io/projected/4e8840f7-113f-409e-bba7-3f8ec2dabb56-kube-api-access-g6c67\") pod \"istiod-openshift-gateway-7ddd9cfdc8-sgdlr\" (UID: \"4e8840f7-113f-409e-bba7-3f8ec2dabb56\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-sgdlr"
Oct 30 20:08:16.528925 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:16.528867    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/4e8840f7-113f-409e-bba7-3f8ec2dabb56-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7ddd9cfdc8-sgdlr\" (UID: \"4e8840f7-113f-409e-bba7-3f8ec2dabb56\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-sgdlr"
Oct 30 20:08:16.529622 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:16.529593    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/4e8840f7-113f-409e-bba7-3f8ec2dabb56-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7ddd9cfdc8-sgdlr\" (UID: \"4e8840f7-113f-409e-bba7-3f8ec2dabb56\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-sgdlr"
Oct 30 20:08:16.531541 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:16.531511    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/4e8840f7-113f-409e-bba7-3f8ec2dabb56-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7ddd9cfdc8-sgdlr\" (UID: \"4e8840f7-113f-409e-bba7-3f8ec2dabb56\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-sgdlr"
Oct 30 20:08:16.531682 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:16.531588    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/4e8840f7-113f-409e-bba7-3f8ec2dabb56-cacerts\") pod \"istiod-openshift-gateway-7ddd9cfdc8-sgdlr\" (UID: \"4e8840f7-113f-409e-bba7-3f8ec2dabb56\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-sgdlr"
Oct 30 20:08:16.531682 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:16.531607    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/4e8840f7-113f-409e-bba7-3f8ec2dabb56-istio-kubeconfig\") pod \"istiod-openshift-gateway-7ddd9cfdc8-sgdlr\" (UID: \"4e8840f7-113f-409e-bba7-3f8ec2dabb56\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-sgdlr"
Oct 30 20:08:16.531754 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:16.531695    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/4e8840f7-113f-409e-bba7-3f8ec2dabb56-local-certs\") pod \"istiod-openshift-gateway-7ddd9cfdc8-sgdlr\" (UID: \"4e8840f7-113f-409e-bba7-3f8ec2dabb56\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-sgdlr"
Oct 30 20:08:16.553576 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:16.553552    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4e8840f7-113f-409e-bba7-3f8ec2dabb56-istio-token\") pod \"istiod-openshift-gateway-7ddd9cfdc8-sgdlr\" (UID: \"4e8840f7-113f-409e-bba7-3f8ec2dabb56\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-sgdlr"
Oct 30 20:08:16.554713 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:16.554689    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g6c67\" (UniqueName: \"kubernetes.io/projected/4e8840f7-113f-409e-bba7-3f8ec2dabb56-kube-api-access-g6c67\") pod \"istiod-openshift-gateway-7ddd9cfdc8-sgdlr\" (UID: \"4e8840f7-113f-409e-bba7-3f8ec2dabb56\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-sgdlr"
Oct 30 20:08:16.730468 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:16.730369    6275 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-sgdlr"
Oct 30 20:08:17.192867 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:17.192825    6275 patch_prober.go:29] interesting pod/e2e-worker-w6-51dd62-openshift-default-7954bd8797-5phnf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.115:15021/healthz/ready\": dial tcp 10.134.0.115:15021: connect: connection refused" start-of-body=
Oct 30 20:08:17.193056 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:17.192906    6275 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-51dd62-openshift-default-7954bd8797-5phnf" podUID="debc38ac-d2b2-47f4-b94b-5d140d1b1194" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.115:15021/healthz/ready\": dial tcp 10.134.0.115:15021: connect: connection refused"
Oct 30 20:08:17.196045 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:17.196016    6275 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-sgdlr"]
Oct 30 20:08:17.197088 ip-10-0-131-26 kubenswrapper[6275]: W1030 20:08:17.197063    6275 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4e8840f7_113f_409e_bba7_3f8ec2dabb56.slice/crio-bf29d4f48417242054a9b8ebfe3745959bd2451cb546cdcbf35ebd175efbccdd WatchSource:0}: Error finding container bf29d4f48417242054a9b8ebfe3745959bd2451cb546cdcbf35ebd175efbccdd: Status 404 returned error can't find the container with id bf29d4f48417242054a9b8ebfe3745959bd2451cb546cdcbf35ebd175efbccdd
Oct 30 20:08:17.199244 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:17.199227    6275 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Oct 30 20:08:17.451111 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:17.451022    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-sgdlr" event={"ID":"4e8840f7-113f-409e-bba7-3f8ec2dabb56","Type":"ContainerStarted","Data":"bf29d4f48417242054a9b8ebfe3745959bd2451cb546cdcbf35ebd175efbccdd"}
Oct 30 20:08:18.172239 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:18.171782    6275 patch_prober.go:29] interesting pod/e2e-worker-w6-51dd62-openshift-default-7954bd8797-5phnf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.115:15021/healthz/ready\": dial tcp 10.134.0.115:15021: connect: connection refused" start-of-body=
Oct 30 20:08:18.172239 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:18.171858    6275 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-51dd62-openshift-default-7954bd8797-5phnf" podUID="debc38ac-d2b2-47f4-b94b-5d140d1b1194" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.115:15021/healthz/ready\": dial tcp 10.134.0.115:15021: connect: connection refused"
Oct 30 20:08:19.169288 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:19.169246    6275 patch_prober.go:29] interesting pod/e2e-worker-w6-51dd62-openshift-default-7954bd8797-5phnf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.115:15021/healthz/ready\": dial tcp 10.134.0.115:15021: connect: connection refused" start-of-body=
Oct 30 20:08:19.169827 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:19.169305    6275 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-51dd62-openshift-default-7954bd8797-5phnf" podUID="debc38ac-d2b2-47f4-b94b-5d140d1b1194" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.115:15021/healthz/ready\": dial tcp 10.134.0.115:15021: connect: connection refused"
Oct 30 20:08:20.173089 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:20.172805    6275 patch_prober.go:29] interesting pod/e2e-worker-w6-51dd62-openshift-default-7954bd8797-5phnf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.115:15021/healthz/ready\": dial tcp 10.134.0.115:15021: connect: connection refused" start-of-body=
Oct 30 20:08:20.173089 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:20.172861    6275 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-51dd62-openshift-default-7954bd8797-5phnf" podUID="debc38ac-d2b2-47f4-b94b-5d140d1b1194" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.115:15021/healthz/ready\": dial tcp 10.134.0.115:15021: connect: connection refused"
Oct 30 20:08:21.928487 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:21.927145    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-51dd62/distinct-2-w6-51dd62-kserve-79ff99c4cd-fvmb6" podUID="9ed906a7-869d-4314-9976-f50b78a6565b" containerName="main" probeResult="failure" output="Get \"https://10.134.0.105:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:08:21.996541 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:21.995554    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-efbac3/premium-w2-efbac3-kserve-55f54cfff6-9fqbz" podUID="083136dc-91fb-454f-a782-87b004e73d1b" containerName="main" probeResult="failure" output="Get \"https://10.134.0.59:8000/ready\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:08:22.214352 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:22.213592    6275 patch_prober.go:29] interesting pod/e2e-worker-w6-51dd62-openshift-default-7954bd8797-5phnf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.115:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 20:08:22.214352 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:22.213681    6275 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-51dd62-openshift-default-7954bd8797-5phnf" podUID="debc38ac-d2b2-47f4-b94b-5d140d1b1194" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.115:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:08:23.031442 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:23.014605    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-efbac3/premium-w2-efbac3-kserve-55f54cfff6-9fqbz" podUID="083136dc-91fb-454f-a782-87b004e73d1b" containerName="main" probeResult="failure" output="Get \"https://10.134.0.59:8000/ready\": context deadline exceeded"
Oct 30 20:08:23.032641 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:23.032608    6275 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w2-efbac3/premium-w2-efbac3-kserve-55f54cfff6-9fqbz"
Oct 30 20:08:23.287621 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:23.287523    6275 patch_prober.go:29] interesting pod/e2e-worker-w6-51dd62-openshift-default-7954bd8797-5phnf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.115:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 20:08:23.287889 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:23.287854    6275 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-51dd62-openshift-default-7954bd8797-5phnf" podUID="debc38ac-d2b2-47f4-b94b-5d140d1b1194" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.115:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:08:23.301884 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:23.291855    6275 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w6-51dd62/distinct-2-w6-51dd62-kserve-79ff99c4cd-fvmb6" podUID="9ed906a7-869d-4314-9976-f50b78a6565b" containerName="main" probeResult="failure" output="Get \"https://10.134.0.105:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:08:23.311735 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:23.311704    6275 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w6-51dd62-openshift-default-7954bd8797-5phnf"
Oct 30 20:08:23.387854 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:23.387816    6275 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w6-51dd62-openshift-default-7954bd8797-5phnf"
Oct 30 20:08:23.445737 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:23.445701    6275 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w6-51dd62-openshift-default-7954bd8797-5phnf"
Oct 30 20:08:23.716627 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:23.716519    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-51dd62/simulator-w6-51dd62-kserve-d6bb4985f-65j9h" podUID="f7e1ff07-15d6-49b5-8edc-52c9d6825ed7" containerName="main" probeResult="failure" output="Get \"https://10.134.0.56:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:08:23.951604 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:23.950971    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-51dd62/distinct-2-w6-51dd62-kserve-79ff99c4cd-fvmb6" podUID="9ed906a7-869d-4314-9976-f50b78a6565b" containerName="main" probeResult="failure" output="Get \"https://10.134.0.105:8000/ready\": context deadline exceeded"
Oct 30 20:08:23.995190 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:23.994515    6275 patch_prober.go:29] interesting pod/e2e-worker-w6-51dd62-openshift-default-7954bd8797-jjfwb container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.89:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 20:08:23.995190 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:23.994588    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w6-51dd62-openshift-default-7954bd8797-jjfwb" podUID="e06b5b8f-8e8e-4568-9f30-1997b0bd259e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.89:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:08:24.033702 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:24.032505    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-efbac3/premium-w2-efbac3-kserve-55f54cfff6-9fqbz" podUID="083136dc-91fb-454f-a782-87b004e73d1b" containerName="main" probeResult="failure" output="Get \"https://10.134.0.59:8000/ready\": context deadline exceeded"
Oct 30 20:08:24.066499 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:24.066463    6275 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w1-5f10d2-openshift-default-6c6777d6f5-8zmvq"]
Oct 30 20:08:24.080768 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:24.080722    6275 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w1-5f10d2-openshift-default-6c6777d6f5-8zmvq" podUID="0e4973a9-ead0-4c5f-813c-fa012dc3fade" containerName="istio-proxy" containerID="cri-o://0c82a67a9f21ab5792001461eeb80d2a5c07b16638b0e39f4cc59a89cdeaf38e" gracePeriod=30
Oct 30 20:08:24.322237 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:24.159213    6275 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w1-5f10d2-openshift-default-6c6777d6f5-dj7jb"]
Oct 30 20:08:24.347885 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:24.347846    6275 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w1-5f10d2-openshift-default-6c6777d6f5-8zmm9"]
Oct 30 20:08:24.349090 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:24.348637    6275 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w1-5f10d2-openshift-default-6c6777d6f5-dj7jb" podUID="d41d4ace-e4ec-4c16-abdb-c1dcdecc40e0" containerName="istio-proxy" containerID="cri-o://33abf82c2490167788c4a794c719a4e4aff8a68c802e5c8b0fe4e6982cc56463" gracePeriod=30
Oct 30 20:08:24.349375 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:24.349351    6275 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w2-efbac3/premium-w2-efbac3-kserve-55f54cfff6-9fqbz"
Oct 30 20:08:24.349762 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:24.349745    6275 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-62f4a1-openshift-default-7fc84fbccc-xwj24"]
Oct 30 20:08:24.355122 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:24.354811    6275 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w1-5f10d2-openshift-default-6c6777d6f5-8zmm9" podUID="91d406fb-17e3-47cf-bb3c-0a088ea0968e" containerName="istio-proxy" containerID="cri-o://d601d2994c106837cf09d70d0dddc461217a7c2b93e13b33c7c3c87810e4689f" gracePeriod=30
Oct 30 20:08:24.379452 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:24.376574    6275 patch_prober.go:29] interesting pod/e2e-worker-w2-efbac3-openshift-default-844cb4689c-8mzmn container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.109:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 20:08:24.379452 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:24.376642    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w2-efbac3-openshift-default-844cb4689c-8mzmn" podUID="9cba92db-f8aa-4a79-9b3e-3481fa8b1fbd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.109:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:08:24.411219 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:24.411182    6275 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w0-62f4a1-openshift-default-7fc84fbccc-xwj24" podUID="943aa671-36e0-4eac-aa11-807858253698" containerName="istio-proxy" containerID="cri-o://9bd76bf6ce477ec797390390994793f4ca0b9509fb530fba3ebdd3cc3387aa30" gracePeriod=30
Oct 30 20:08:24.565749 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:24.565404    6275 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-62f4a1-openshift-default-7fc84fbccc-52l47"]
Oct 30 20:08:24.565945 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:24.565781    6275 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w0-62f4a1-openshift-default-7fc84fbccc-52l47" podUID="e3f64fa4-b2e2-4ab4-9da5-76bbfac9116d" containerName="istio-proxy" containerID="cri-o://eca7fa7d549a1e9d0c85a897ab438f5c3e7f4e44aa7009891ef536d76d8eb603" gracePeriod=30
Oct 30 20:08:24.927384 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:24.927345    6275 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-62f4a1-openshift-default-7fc84fbccc-7qzmg"]
Oct 30 20:08:24.927886 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:24.927849    6275 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w0-62f4a1-openshift-default-7fc84fbccc-7qzmg" podUID="555e958d-9abd-41f1-b08a-0db0b32fe79f" containerName="istio-proxy" containerID="cri-o://6380e096c69463037b49fbf888cf7ab5016054777548b93e6d47ad6fa445d0fd" gracePeriod=30
Oct 30 20:08:26.217071 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:26.217018    6275 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Oct 30 20:08:26.217527 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:26.217128    6275 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Oct 30 20:08:26.258627 ip-10-0-131-26 kubenswrapper[6275]: E1030 20:08:26.258586    6275 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-fwc77" containerName="extractor"
Oct 30 20:08:27.067483 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:27.065230    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-sgdlr" event={"ID":"4e8840f7-113f-409e-bba7-3f8ec2dabb56","Type":"ContainerStarted","Data":"4a6fdcc22d0894973b6cdf7cf6d33721e8a6a5a782cbc3578e87b9ba6e8e8fb4"}
Oct 30 20:08:27.067483 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:27.065802    6275 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-sgdlr"
Oct 30 20:08:27.068796 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:27.068767    6275 patch_prober.go:29] interesting pod/istiod-openshift-gateway-7ddd9cfdc8-sgdlr container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Oct 30 20:08:27.068941 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:27.068817    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-sgdlr" podUID="4e8840f7-113f-409e-bba7-3f8ec2dabb56" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 20:08:27.138335 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:27.138266    6275 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-sgdlr" podStartSLOduration=2.121819998 podStartE2EDuration="11.138246849s" totalImagesPullingTime="9.016426851s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:08:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:08:27.133138579 +0000 UTC m=+1217.594865469" watchObservedRunningTime="2026-10-30 20:08:27.138246849 +0000 UTC m=+1217.599973713"
Oct 30 20:08:27.660454 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:27.660404    6275 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-b4cf9b1f-5klgm"]
Oct 30 20:08:27.664697 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:27.664671    6275 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-b4cf9b1f-5klgm"
Oct 30 20:08:27.684717 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:27.684695    6275 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-b4cf9b1f-5klgm"]
Oct 30 20:08:27.692792 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:27.692760    6275 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-scs2w\""
Oct 30 20:08:27.693109 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:27.693067    6275 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\""
Oct 30 20:08:27.742487 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:27.742448    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/e6ac148d-3229-49ab-861f-7b79b60febc4-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-b4cf9b1f-5klgm\" (UID: \"e6ac148d-3229-49ab-861f-7b79b60febc4\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-b4cf9b1f-5klgm"
Oct 30 20:08:27.742717 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:27.742676    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/e6ac148d-3229-49ab-861f-7b79b60febc4-maas-api-xks-ca\") pod \"maas-api-revoke-sub-b4cf9b1f-5klgm\" (UID: \"e6ac148d-3229-49ab-861f-7b79b60febc4\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-b4cf9b1f-5klgm"
Oct 30 20:08:27.742943 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:27.742911    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2dn48\" (UniqueName: \"kubernetes.io/projected/e6ac148d-3229-49ab-861f-7b79b60febc4-kube-api-access-2dn48\") pod \"maas-api-revoke-sub-b4cf9b1f-5klgm\" (UID: \"e6ac148d-3229-49ab-861f-7b79b60febc4\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-b4cf9b1f-5klgm"
Oct 30 20:08:27.844507 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:27.844475    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/e6ac148d-3229-49ab-861f-7b79b60febc4-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-b4cf9b1f-5klgm\" (UID: \"e6ac148d-3229-49ab-861f-7b79b60febc4\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-b4cf9b1f-5klgm"
Oct 30 20:08:27.844663 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:27.844579    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/e6ac148d-3229-49ab-861f-7b79b60febc4-maas-api-xks-ca\") pod \"maas-api-revoke-sub-b4cf9b1f-5klgm\" (UID: \"e6ac148d-3229-49ab-861f-7b79b60febc4\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-b4cf9b1f-5klgm"
Oct 30 20:08:27.844726 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:27.844682    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2dn48\" (UniqueName: \"kubernetes.io/projected/e6ac148d-3229-49ab-861f-7b79b60febc4-kube-api-access-2dn48\") pod \"maas-api-revoke-sub-b4cf9b1f-5klgm\" (UID: \"e6ac148d-3229-49ab-861f-7b79b60febc4\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-b4cf9b1f-5klgm"
Oct 30 20:08:27.845158 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:27.845132    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/e6ac148d-3229-49ab-861f-7b79b60febc4-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-b4cf9b1f-5klgm\" (UID: \"e6ac148d-3229-49ab-861f-7b79b60febc4\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-b4cf9b1f-5klgm"
Oct 30 20:08:27.846900 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:27.846876    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/e6ac148d-3229-49ab-861f-7b79b60febc4-maas-api-xks-ca\") pod \"maas-api-revoke-sub-b4cf9b1f-5klgm\" (UID: \"e6ac148d-3229-49ab-861f-7b79b60febc4\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-b4cf9b1f-5klgm"
Oct 30 20:08:27.870976 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:27.870947    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2dn48\" (UniqueName: \"kubernetes.io/projected/e6ac148d-3229-49ab-861f-7b79b60febc4-kube-api-access-2dn48\") pod \"maas-api-revoke-sub-b4cf9b1f-5klgm\" (UID: \"e6ac148d-3229-49ab-861f-7b79b60febc4\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-b4cf9b1f-5klgm"
Oct 30 20:08:27.979463 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:27.979373    6275 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-b4cf9b1f-5klgm"
Oct 30 20:08:28.077336 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:28.077297    6275 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-sgdlr"
Oct 30 20:08:28.292829 ip-10-0-131-26 kubenswrapper[6275]: W1030 20:08:28.292793    6275 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode6ac148d_3229_49ab_861f_7b79b60febc4.slice/crio-9dfb6ba8e8e6e2b285dadf560c9c81009c5db379a1d6a7b6890b85156f0f869b WatchSource:0}: Error finding container 9dfb6ba8e8e6e2b285dadf560c9c81009c5db379a1d6a7b6890b85156f0f869b: Status 404 returned error can't find the container with id 9dfb6ba8e8e6e2b285dadf560c9c81009c5db379a1d6a7b6890b85156f0f869b
Oct 30 20:08:28.293929 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:28.293899    6275 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-b4cf9b1f-5klgm"]
Oct 30 20:08:29.095466 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:29.095396    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-b4cf9b1f-5klgm" event={"ID":"e6ac148d-3229-49ab-861f-7b79b60febc4","Type":"ContainerStarted","Data":"7dbd178239c3e32a9705b054748fb5395d41d3cab2947042d51b87cda15d6d13"}
Oct 30 20:08:29.096190 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:29.096128    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-b4cf9b1f-5klgm" event={"ID":"e6ac148d-3229-49ab-861f-7b79b60febc4","Type":"ContainerStarted","Data":"9dfb6ba8e8e6e2b285dadf560c9c81009c5db379a1d6a7b6890b85156f0f869b"}
Oct 30 20:08:29.147301 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:29.147249    6275 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-sub-b4cf9b1f-5klgm" podStartSLOduration=2.147235782 podStartE2EDuration="2.147235782s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:08:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:08:29.146465726 +0000 UTC m=+1219.608192589" watchObservedRunningTime="2026-10-30 20:08:29.147235782 +0000 UTC m=+1219.608962645"
Oct 30 20:08:29.881327 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:29.881304    6275 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-62f4a1-openshift-default-7fc84fbccc-52l47"
Oct 30 20:08:29.885782 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:29.885728    6275 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-5f10d2-openshift-default-6c6777d6f5-8zmm9"
Oct 30 20:08:29.972565 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:29.972523    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e3f64fa4-b2e2-4ab4-9da5-76bbfac9116d-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e3f64fa4-b2e2-4ab4-9da5-76bbfac9116d-workload-certs\") pod \"e3f64fa4-b2e2-4ab4-9da5-76bbfac9116d\" (UID: \"e3f64fa4-b2e2-4ab4-9da5-76bbfac9116d\") "
Oct 30 20:08:29.972767 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:29.972580    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e3f64fa4-b2e2-4ab4-9da5-76bbfac9116d-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e3f64fa4-b2e2-4ab4-9da5-76bbfac9116d-istio-envoy\") pod \"e3f64fa4-b2e2-4ab4-9da5-76bbfac9116d\" (UID: \"e3f64fa4-b2e2-4ab4-9da5-76bbfac9116d\") "
Oct 30 20:08:29.972767 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:29.972642    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/91d406fb-17e3-47cf-bb3c-0a088ea0968e-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/91d406fb-17e3-47cf-bb3c-0a088ea0968e-workload-socket\") pod \"91d406fb-17e3-47cf-bb3c-0a088ea0968e\" (UID: \"91d406fb-17e3-47cf-bb3c-0a088ea0968e\") "
Oct 30 20:08:29.972767 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:29.972726    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/91d406fb-17e3-47cf-bb3c-0a088ea0968e-kube-api-access-hwkkb\" (UniqueName: \"kubernetes.io/projected/91d406fb-17e3-47cf-bb3c-0a088ea0968e-kube-api-access-hwkkb\") pod \"91d406fb-17e3-47cf-bb3c-0a088ea0968e\" (UID: \"91d406fb-17e3-47cf-bb3c-0a088ea0968e\") "
Oct 30 20:08:29.972767 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:29.972755    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/91d406fb-17e3-47cf-bb3c-0a088ea0968e-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/91d406fb-17e3-47cf-bb3c-0a088ea0968e-istiod-ca-cert\") pod \"91d406fb-17e3-47cf-bb3c-0a088ea0968e\" (UID: \"91d406fb-17e3-47cf-bb3c-0a088ea0968e\") "
Oct 30 20:08:29.972986 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:29.972785    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e3f64fa4-b2e2-4ab4-9da5-76bbfac9116d-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e3f64fa4-b2e2-4ab4-9da5-76bbfac9116d-workload-socket\") pod \"e3f64fa4-b2e2-4ab4-9da5-76bbfac9116d\" (UID: \"e3f64fa4-b2e2-4ab4-9da5-76bbfac9116d\") "
Oct 30 20:08:29.972986 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:29.972824    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/91d406fb-17e3-47cf-bb3c-0a088ea0968e-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/91d406fb-17e3-47cf-bb3c-0a088ea0968e-istio-podinfo\") pod \"91d406fb-17e3-47cf-bb3c-0a088ea0968e\" (UID: \"91d406fb-17e3-47cf-bb3c-0a088ea0968e\") "
Oct 30 20:08:29.972986 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:29.972899    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/91d406fb-17e3-47cf-bb3c-0a088ea0968e-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/91d406fb-17e3-47cf-bb3c-0a088ea0968e-istio-envoy\") pod \"91d406fb-17e3-47cf-bb3c-0a088ea0968e\" (UID: \"91d406fb-17e3-47cf-bb3c-0a088ea0968e\") "
Oct 30 20:08:29.972986 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:29.972941    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/91d406fb-17e3-47cf-bb3c-0a088ea0968e-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/91d406fb-17e3-47cf-bb3c-0a088ea0968e-istio-data\") pod \"91d406fb-17e3-47cf-bb3c-0a088ea0968e\" (UID: \"91d406fb-17e3-47cf-bb3c-0a088ea0968e\") "
Oct 30 20:08:29.973181 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:29.973009    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/e3f64fa4-b2e2-4ab4-9da5-76bbfac9116d-kube-api-access-7qr64\" (UniqueName: \"kubernetes.io/projected/e3f64fa4-b2e2-4ab4-9da5-76bbfac9116d-kube-api-access-7qr64\") pod \"e3f64fa4-b2e2-4ab4-9da5-76bbfac9116d\" (UID: \"e3f64fa4-b2e2-4ab4-9da5-76bbfac9116d\") "
Oct 30 20:08:29.973181 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:29.973046    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/e3f64fa4-b2e2-4ab4-9da5-76bbfac9116d-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e3f64fa4-b2e2-4ab4-9da5-76bbfac9116d-istio-podinfo\") pod \"e3f64fa4-b2e2-4ab4-9da5-76bbfac9116d\" (UID: \"e3f64fa4-b2e2-4ab4-9da5-76bbfac9116d\") "
Oct 30 20:08:29.973181 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:29.973078    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/e3f64fa4-b2e2-4ab4-9da5-76bbfac9116d-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e3f64fa4-b2e2-4ab4-9da5-76bbfac9116d-istiod-ca-cert\") pod \"e3f64fa4-b2e2-4ab4-9da5-76bbfac9116d\" (UID: \"e3f64fa4-b2e2-4ab4-9da5-76bbfac9116d\") "
Oct 30 20:08:29.973181 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:29.973107    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/e3f64fa4-b2e2-4ab4-9da5-76bbfac9116d-istio-token\" (UniqueName: \"kubernetes.io/projected/e3f64fa4-b2e2-4ab4-9da5-76bbfac9116d-istio-token\") pod \"e3f64fa4-b2e2-4ab4-9da5-76bbfac9116d\" (UID: \"e3f64fa4-b2e2-4ab4-9da5-76bbfac9116d\") "
Oct 30 20:08:29.973181 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:29.973154    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e3f64fa4-b2e2-4ab4-9da5-76bbfac9116d-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e3f64fa4-b2e2-4ab4-9da5-76bbfac9116d-istio-data\") pod \"e3f64fa4-b2e2-4ab4-9da5-76bbfac9116d\" (UID: \"e3f64fa4-b2e2-4ab4-9da5-76bbfac9116d\") "
Oct 30 20:08:29.973456 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:29.973186    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/91d406fb-17e3-47cf-bb3c-0a088ea0968e-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/91d406fb-17e3-47cf-bb3c-0a088ea0968e-credential-socket\") pod \"91d406fb-17e3-47cf-bb3c-0a088ea0968e\" (UID: \"91d406fb-17e3-47cf-bb3c-0a088ea0968e\") "
Oct 30 20:08:29.973456 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:29.973219    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e3f64fa4-b2e2-4ab4-9da5-76bbfac9116d-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e3f64fa4-b2e2-4ab4-9da5-76bbfac9116d-credential-socket\") pod \"e3f64fa4-b2e2-4ab4-9da5-76bbfac9116d\" (UID: \"e3f64fa4-b2e2-4ab4-9da5-76bbfac9116d\") "
Oct 30 20:08:29.973456 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:29.973278    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/91d406fb-17e3-47cf-bb3c-0a088ea0968e-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/91d406fb-17e3-47cf-bb3c-0a088ea0968e-workload-certs\") pod \"91d406fb-17e3-47cf-bb3c-0a088ea0968e\" (UID: \"91d406fb-17e3-47cf-bb3c-0a088ea0968e\") "
Oct 30 20:08:29.973456 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:29.973343    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/91d406fb-17e3-47cf-bb3c-0a088ea0968e-istio-token\" (UniqueName: \"kubernetes.io/projected/91d406fb-17e3-47cf-bb3c-0a088ea0968e-istio-token\") pod \"91d406fb-17e3-47cf-bb3c-0a088ea0968e\" (UID: \"91d406fb-17e3-47cf-bb3c-0a088ea0968e\") "
Oct 30 20:08:29.974674 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:29.974548    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e3f64fa4-b2e2-4ab4-9da5-76bbfac9116d-workload-socket" pod "e3f64fa4-b2e2-4ab4-9da5-76bbfac9116d" (UID: "e3f64fa4-b2e2-4ab4-9da5-76bbfac9116d"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:08:29.974815 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:29.974729    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/91d406fb-17e3-47cf-bb3c-0a088ea0968e-credential-socket" pod "91d406fb-17e3-47cf-bb3c-0a088ea0968e" (UID: "91d406fb-17e3-47cf-bb3c-0a088ea0968e"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:08:29.975058 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:29.975030    6275 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e3f64fa4-b2e2-4ab4-9da5-76bbfac9116d-workload-socket\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:08:29.975058 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:29.975046    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e3f64fa4-b2e2-4ab4-9da5-76bbfac9116d-istiod-ca-cert" pod "e3f64fa4-b2e2-4ab4-9da5-76bbfac9116d" (UID: "e3f64fa4-b2e2-4ab4-9da5-76bbfac9116d"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:08:29.975058 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:29.975059    6275 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/91d406fb-17e3-47cf-bb3c-0a088ea0968e-credential-socket\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:08:29.975345 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:29.975321    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e3f64fa4-b2e2-4ab4-9da5-76bbfac9116d-istio-data" pod "e3f64fa4-b2e2-4ab4-9da5-76bbfac9116d" (UID: "e3f64fa4-b2e2-4ab4-9da5-76bbfac9116d"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:08:29.975409 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:29.975362    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/91d406fb-17e3-47cf-bb3c-0a088ea0968e-istiod-ca-cert" pod "91d406fb-17e3-47cf-bb3c-0a088ea0968e" (UID: "91d406fb-17e3-47cf-bb3c-0a088ea0968e"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:08:29.975644 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:29.975625    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e3f64fa4-b2e2-4ab4-9da5-76bbfac9116d-workload-certs" pod "e3f64fa4-b2e2-4ab4-9da5-76bbfac9116d" (UID: "e3f64fa4-b2e2-4ab4-9da5-76bbfac9116d"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:08:29.975855 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:29.975836    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/91d406fb-17e3-47cf-bb3c-0a088ea0968e-workload-certs" pod "91d406fb-17e3-47cf-bb3c-0a088ea0968e" (UID: "91d406fb-17e3-47cf-bb3c-0a088ea0968e"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:08:29.976484 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:29.976103    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/91d406fb-17e3-47cf-bb3c-0a088ea0968e-istio-data" pod "91d406fb-17e3-47cf-bb3c-0a088ea0968e" (UID: "91d406fb-17e3-47cf-bb3c-0a088ea0968e"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:08:29.976694 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:29.976588    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e3f64fa4-b2e2-4ab4-9da5-76bbfac9116d-credential-socket" pod "e3f64fa4-b2e2-4ab4-9da5-76bbfac9116d" (UID: "e3f64fa4-b2e2-4ab4-9da5-76bbfac9116d"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:08:29.977156 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:29.976917    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/91d406fb-17e3-47cf-bb3c-0a088ea0968e-workload-socket" pod "91d406fb-17e3-47cf-bb3c-0a088ea0968e" (UID: "91d406fb-17e3-47cf-bb3c-0a088ea0968e"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:08:29.986107 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:29.979398    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/91d406fb-17e3-47cf-bb3c-0a088ea0968e-istio-podinfo" pod "91d406fb-17e3-47cf-bb3c-0a088ea0968e" (UID: "91d406fb-17e3-47cf-bb3c-0a088ea0968e"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 20:08:29.986107 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:29.982056    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e3f64fa4-b2e2-4ab4-9da5-76bbfac9116d-kube-api-access-7qr64" pod "e3f64fa4-b2e2-4ab4-9da5-76bbfac9116d" (UID: "e3f64fa4-b2e2-4ab4-9da5-76bbfac9116d"). InnerVolumeSpecName "kube-api-access-7qr64". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:08:29.986107 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:29.982643    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/91d406fb-17e3-47cf-bb3c-0a088ea0968e-istio-token" pod "91d406fb-17e3-47cf-bb3c-0a088ea0968e" (UID: "91d406fb-17e3-47cf-bb3c-0a088ea0968e"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:08:29.986107 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:29.983629    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/91d406fb-17e3-47cf-bb3c-0a088ea0968e-istio-envoy" pod "91d406fb-17e3-47cf-bb3c-0a088ea0968e" (UID: "91d406fb-17e3-47cf-bb3c-0a088ea0968e"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:08:29.986107 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:29.984305    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e3f64fa4-b2e2-4ab4-9da5-76bbfac9116d-istio-envoy" pod "e3f64fa4-b2e2-4ab4-9da5-76bbfac9116d" (UID: "e3f64fa4-b2e2-4ab4-9da5-76bbfac9116d"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:08:30.002561 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:30.002524    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/91d406fb-17e3-47cf-bb3c-0a088ea0968e-kube-api-access-hwkkb" pod "91d406fb-17e3-47cf-bb3c-0a088ea0968e" (UID: "91d406fb-17e3-47cf-bb3c-0a088ea0968e"). InnerVolumeSpecName "kube-api-access-hwkkb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:08:30.006726 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:30.006670    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/e3f64fa4-b2e2-4ab4-9da5-76bbfac9116d-istio-podinfo" pod "e3f64fa4-b2e2-4ab4-9da5-76bbfac9116d" (UID: "e3f64fa4-b2e2-4ab4-9da5-76bbfac9116d"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 20:08:30.008832 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:30.008788    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e3f64fa4-b2e2-4ab4-9da5-76bbfac9116d-istio-token" pod "e3f64fa4-b2e2-4ab4-9da5-76bbfac9116d" (UID: "e3f64fa4-b2e2-4ab4-9da5-76bbfac9116d"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:08:30.076295 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:30.076252    6275 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hwkkb\" (UniqueName: \"kubernetes.io/projected/91d406fb-17e3-47cf-bb3c-0a088ea0968e-kube-api-access-hwkkb\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:08:30.076295 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:30.076291    6275 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/91d406fb-17e3-47cf-bb3c-0a088ea0968e-istiod-ca-cert\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:08:30.076295 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:30.076301    6275 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/91d406fb-17e3-47cf-bb3c-0a088ea0968e-istio-podinfo\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:08:30.076635 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:30.076310    6275 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/91d406fb-17e3-47cf-bb3c-0a088ea0968e-istio-envoy\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:08:30.076635 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:30.076318    6275 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/91d406fb-17e3-47cf-bb3c-0a088ea0968e-istio-data\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:08:30.076635 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:30.076325    6275 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7qr64\" (UniqueName: \"kubernetes.io/projected/e3f64fa4-b2e2-4ab4-9da5-76bbfac9116d-kube-api-access-7qr64\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:08:30.076635 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:30.076334    6275 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e3f64fa4-b2e2-4ab4-9da5-76bbfac9116d-istio-podinfo\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:08:30.076635 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:30.076343    6275 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e3f64fa4-b2e2-4ab4-9da5-76bbfac9116d-istiod-ca-cert\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:08:30.076635 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:30.076350    6275 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e3f64fa4-b2e2-4ab4-9da5-76bbfac9116d-istio-token\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:08:30.076635 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:30.076359    6275 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e3f64fa4-b2e2-4ab4-9da5-76bbfac9116d-istio-data\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:08:30.076635 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:30.076366    6275 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e3f64fa4-b2e2-4ab4-9da5-76bbfac9116d-credential-socket\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:08:30.076635 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:30.076374    6275 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/91d406fb-17e3-47cf-bb3c-0a088ea0968e-workload-certs\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:08:30.076635 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:30.076382    6275 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/91d406fb-17e3-47cf-bb3c-0a088ea0968e-istio-token\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:08:30.076635 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:30.076391    6275 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e3f64fa4-b2e2-4ab4-9da5-76bbfac9116d-workload-certs\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:08:30.076635 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:30.076398    6275 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e3f64fa4-b2e2-4ab4-9da5-76bbfac9116d-istio-envoy\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:08:30.076635 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:30.076405    6275 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/91d406fb-17e3-47cf-bb3c-0a088ea0968e-workload-socket\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:08:30.084363 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:30.084263    6275 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-5f10d2-openshift-default-6c6777d6f5-8zmvq"
Oct 30 20:08:30.105995 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:30.105874    6275 generic.go:356] "Generic (PLEG): container finished" podID="e3f64fa4-b2e2-4ab4-9da5-76bbfac9116d" containerID="eca7fa7d549a1e9d0c85a897ab438f5c3e7f4e44aa7009891ef536d76d8eb603" exitCode=0
Oct 30 20:08:30.105995 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:30.105949    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-62f4a1-openshift-default-7fc84fbccc-52l47" event={"ID":"e3f64fa4-b2e2-4ab4-9da5-76bbfac9116d","Type":"ContainerDied","Data":"eca7fa7d549a1e9d0c85a897ab438f5c3e7f4e44aa7009891ef536d76d8eb603"}
Oct 30 20:08:30.105995 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:30.105996    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-62f4a1-openshift-default-7fc84fbccc-52l47" event={"ID":"e3f64fa4-b2e2-4ab4-9da5-76bbfac9116d","Type":"ContainerDied","Data":"85848d6f69702baa778000bb08917457d6a045e229d9744ea172434de79f3881"}
Oct 30 20:08:30.106610 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:30.106026    6275 scope.go:122] "RemoveContainer" containerID="eca7fa7d549a1e9d0c85a897ab438f5c3e7f4e44aa7009891ef536d76d8eb603"
Oct 30 20:08:30.106610 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:30.106181    6275 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-62f4a1-openshift-default-7fc84fbccc-52l47"
Oct 30 20:08:30.114638 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:30.114447    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-62f4a1-openshift-default-7fc84fbccc-xwj24" event={"ID":"943aa671-36e0-4eac-aa11-807858253698","Type":"ContainerDied","Data":"9bd76bf6ce477ec797390390994793f4ca0b9509fb530fba3ebdd3cc3387aa30"}
Oct 30 20:08:30.114638 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:30.114449    6275 generic.go:356] "Generic (PLEG): container finished" podID="943aa671-36e0-4eac-aa11-807858253698" containerID="9bd76bf6ce477ec797390390994793f4ca0b9509fb530fba3ebdd3cc3387aa30" exitCode=0
Oct 30 20:08:30.120840 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:30.119657    6275 generic.go:356] "Generic (PLEG): container finished" podID="0e4973a9-ead0-4c5f-813c-fa012dc3fade" containerID="0c82a67a9f21ab5792001461eeb80d2a5c07b16638b0e39f4cc59a89cdeaf38e" exitCode=0
Oct 30 20:08:30.120840 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:30.119807    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-5f10d2-openshift-default-6c6777d6f5-8zmvq" event={"ID":"0e4973a9-ead0-4c5f-813c-fa012dc3fade","Type":"ContainerDied","Data":"0c82a67a9f21ab5792001461eeb80d2a5c07b16638b0e39f4cc59a89cdeaf38e"}
Oct 30 20:08:30.120840 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:30.119853    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-5f10d2-openshift-default-6c6777d6f5-8zmvq" event={"ID":"0e4973a9-ead0-4c5f-813c-fa012dc3fade","Type":"ContainerDied","Data":"f7676242fb02351874295703bb203c54b5a82662fa3a455dac355d9964e9a2e8"}
Oct 30 20:08:30.120840 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:30.120008    6275 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-5f10d2-openshift-default-6c6777d6f5-8zmvq"
Oct 30 20:08:30.124641 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:30.124612    6275 generic.go:356] "Generic (PLEG): container finished" podID="d41d4ace-e4ec-4c16-abdb-c1dcdecc40e0" containerID="33abf82c2490167788c4a794c719a4e4aff8a68c802e5c8b0fe4e6982cc56463" exitCode=0
Oct 30 20:08:30.124847 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:30.124807    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-5f10d2-openshift-default-6c6777d6f5-dj7jb" event={"ID":"d41d4ace-e4ec-4c16-abdb-c1dcdecc40e0","Type":"ContainerDied","Data":"33abf82c2490167788c4a794c719a4e4aff8a68c802e5c8b0fe4e6982cc56463"}
Oct 30 20:08:30.125200 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:30.125156    6275 scope.go:122] "RemoveContainer" containerID="eca7fa7d549a1e9d0c85a897ab438f5c3e7f4e44aa7009891ef536d76d8eb603"
Oct 30 20:08:30.125448 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:30.125275    6275 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-5f10d2-openshift-default-6c6777d6f5-dj7jb"
Oct 30 20:08:30.125593 ip-10-0-131-26 kubenswrapper[6275]: E1030 20:08:30.125538    6275 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eca7fa7d549a1e9d0c85a897ab438f5c3e7f4e44aa7009891ef536d76d8eb603\": container with ID starting with eca7fa7d549a1e9d0c85a897ab438f5c3e7f4e44aa7009891ef536d76d8eb603 not found: ID does not exist" containerID="eca7fa7d549a1e9d0c85a897ab438f5c3e7f4e44aa7009891ef536d76d8eb603"
Oct 30 20:08:30.125662 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:30.125605    6275 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eca7fa7d549a1e9d0c85a897ab438f5c3e7f4e44aa7009891ef536d76d8eb603"} err="failed to get container status \"eca7fa7d549a1e9d0c85a897ab438f5c3e7f4e44aa7009891ef536d76d8eb603\": rpc error: code = NotFound desc = could not find container \"eca7fa7d549a1e9d0c85a897ab438f5c3e7f4e44aa7009891ef536d76d8eb603\": container with ID starting with eca7fa7d549a1e9d0c85a897ab438f5c3e7f4e44aa7009891ef536d76d8eb603 not found: ID does not exist"
Oct 30 20:08:30.125662 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:30.125627    6275 scope.go:122] "RemoveContainer" containerID="0c82a67a9f21ab5792001461eeb80d2a5c07b16638b0e39f4cc59a89cdeaf38e"
Oct 30 20:08:30.132800 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:30.132775    6275 generic.go:356] "Generic (PLEG): container finished" podID="91d406fb-17e3-47cf-bb3c-0a088ea0968e" containerID="d601d2994c106837cf09d70d0dddc461217a7c2b93e13b33c7c3c87810e4689f" exitCode=0
Oct 30 20:08:30.132890 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:30.132829    6275 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-5f10d2-openshift-default-6c6777d6f5-8zmm9"
Oct 30 20:08:30.132958 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:30.132941    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-5f10d2-openshift-default-6c6777d6f5-8zmm9" event={"ID":"91d406fb-17e3-47cf-bb3c-0a088ea0968e","Type":"ContainerDied","Data":"d601d2994c106837cf09d70d0dddc461217a7c2b93e13b33c7c3c87810e4689f"}
Oct 30 20:08:30.133009 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:30.132978    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-5f10d2-openshift-default-6c6777d6f5-8zmm9" event={"ID":"91d406fb-17e3-47cf-bb3c-0a088ea0968e","Type":"ContainerDied","Data":"c9b96a9caf7ba555114e0fc99c6fd1e28b7c88c7fe732aa0a2be3461c9034d76"}
Oct 30 20:08:30.134895 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:30.134841    6275 generic.go:356] "Generic (PLEG): container finished" podID="555e958d-9abd-41f1-b08a-0db0b32fe79f" containerID="6380e096c69463037b49fbf888cf7ab5016054777548b93e6d47ad6fa445d0fd" exitCode=0
Oct 30 20:08:30.134997 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:30.134906    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-62f4a1-openshift-default-7fc84fbccc-7qzmg" event={"ID":"555e958d-9abd-41f1-b08a-0db0b32fe79f","Type":"ContainerDied","Data":"6380e096c69463037b49fbf888cf7ab5016054777548b93e6d47ad6fa445d0fd"}
Oct 30 20:08:30.138891 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:30.138213    6275 generic.go:356] "Generic (PLEG): container finished" podID="e6ac148d-3229-49ab-861f-7b79b60febc4" containerID="7dbd178239c3e32a9705b054748fb5395d41d3cab2947042d51b87cda15d6d13" exitCode=0
Oct 30 20:08:30.138891 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:30.138248    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-b4cf9b1f-5klgm" event={"ID":"e6ac148d-3229-49ab-861f-7b79b60febc4","Type":"ContainerDied","Data":"7dbd178239c3e32a9705b054748fb5395d41d3cab2947042d51b87cda15d6d13"}
Oct 30 20:08:30.151093 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:30.151067    6275 scope.go:122] "RemoveContainer" containerID="0c82a67a9f21ab5792001461eeb80d2a5c07b16638b0e39f4cc59a89cdeaf38e"
Oct 30 20:08:30.151457 ip-10-0-131-26 kubenswrapper[6275]: E1030 20:08:30.151397    6275 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0c82a67a9f21ab5792001461eeb80d2a5c07b16638b0e39f4cc59a89cdeaf38e\": container with ID starting with 0c82a67a9f21ab5792001461eeb80d2a5c07b16638b0e39f4cc59a89cdeaf38e not found: ID does not exist" containerID="0c82a67a9f21ab5792001461eeb80d2a5c07b16638b0e39f4cc59a89cdeaf38e"
Oct 30 20:08:30.151541 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:30.151470    6275 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0c82a67a9f21ab5792001461eeb80d2a5c07b16638b0e39f4cc59a89cdeaf38e"} err="failed to get container status \"0c82a67a9f21ab5792001461eeb80d2a5c07b16638b0e39f4cc59a89cdeaf38e\": rpc error: code = NotFound desc = could not find container \"0c82a67a9f21ab5792001461eeb80d2a5c07b16638b0e39f4cc59a89cdeaf38e\": container with ID starting with 0c82a67a9f21ab5792001461eeb80d2a5c07b16638b0e39f4cc59a89cdeaf38e not found: ID does not exist"
Oct 30 20:08:30.151541 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:30.151496    6275 scope.go:122] "RemoveContainer" containerID="d601d2994c106837cf09d70d0dddc461217a7c2b93e13b33c7c3c87810e4689f"
Oct 30 20:08:30.162297 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:30.162085    6275 scope.go:122] "RemoveContainer" containerID="d601d2994c106837cf09d70d0dddc461217a7c2b93e13b33c7c3c87810e4689f"
Oct 30 20:08:30.162836 ip-10-0-131-26 kubenswrapper[6275]: E1030 20:08:30.162745    6275 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d601d2994c106837cf09d70d0dddc461217a7c2b93e13b33c7c3c87810e4689f\": container with ID starting with d601d2994c106837cf09d70d0dddc461217a7c2b93e13b33c7c3c87810e4689f not found: ID does not exist" containerID="d601d2994c106837cf09d70d0dddc461217a7c2b93e13b33c7c3c87810e4689f"
Oct 30 20:08:30.162836 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:30.162772    6275 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d601d2994c106837cf09d70d0dddc461217a7c2b93e13b33c7c3c87810e4689f"} err="failed to get container status \"d601d2994c106837cf09d70d0dddc461217a7c2b93e13b33c7c3c87810e4689f\": rpc error: code = NotFound desc = could not find container \"d601d2994c106837cf09d70d0dddc461217a7c2b93e13b33c7c3c87810e4689f\": container with ID starting with d601d2994c106837cf09d70d0dddc461217a7c2b93e13b33c7c3c87810e4689f not found: ID does not exist"
Oct 30 20:08:30.172675 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:30.172644    6275 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-62f4a1-openshift-default-7fc84fbccc-xwj24"
Oct 30 20:08:30.177733 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:30.177712    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d41d4ace-e4ec-4c16-abdb-c1dcdecc40e0-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d41d4ace-e4ec-4c16-abdb-c1dcdecc40e0-workload-socket\") pod \"d41d4ace-e4ec-4c16-abdb-c1dcdecc40e0\" (UID: \"d41d4ace-e4ec-4c16-abdb-c1dcdecc40e0\") "
Oct 30 20:08:30.177817 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:30.177745    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/0e4973a9-ead0-4c5f-813c-fa012dc3fade-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0e4973a9-ead0-4c5f-813c-fa012dc3fade-workload-certs\") pod \"0e4973a9-ead0-4c5f-813c-fa012dc3fade\" (UID: \"0e4973a9-ead0-4c5f-813c-fa012dc3fade\") "
Oct 30 20:08:30.177817 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:30.177797    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/d41d4ace-e4ec-4c16-abdb-c1dcdecc40e0-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d41d4ace-e4ec-4c16-abdb-c1dcdecc40e0-istio-podinfo\") pod \"d41d4ace-e4ec-4c16-abdb-c1dcdecc40e0\" (UID: \"d41d4ace-e4ec-4c16-abdb-c1dcdecc40e0\") "
Oct 30 20:08:30.177904 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:30.177860    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d41d4ace-e4ec-4c16-abdb-c1dcdecc40e0-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d41d4ace-e4ec-4c16-abdb-c1dcdecc40e0-istio-data\") pod \"d41d4ace-e4ec-4c16-abdb-c1dcdecc40e0\" (UID: \"d41d4ace-e4ec-4c16-abdb-c1dcdecc40e0\") "
Oct 30 20:08:30.177904 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:30.177890    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/d41d4ace-e4ec-4c16-abdb-c1dcdecc40e0-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d41d4ace-e4ec-4c16-abdb-c1dcdecc40e0-istiod-ca-cert\") pod \"d41d4ace-e4ec-4c16-abdb-c1dcdecc40e0\" (UID: \"d41d4ace-e4ec-4c16-abdb-c1dcdecc40e0\") "
Oct 30 20:08:30.178014 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:30.177977    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d41d4ace-e4ec-4c16-abdb-c1dcdecc40e0-workload-socket" pod "d41d4ace-e4ec-4c16-abdb-c1dcdecc40e0" (UID: "d41d4ace-e4ec-4c16-abdb-c1dcdecc40e0"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:08:30.178065 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:30.178017    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/0e4973a9-ead0-4c5f-813c-fa012dc3fade-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0e4973a9-ead0-4c5f-813c-fa012dc3fade-credential-socket\") pod \"0e4973a9-ead0-4c5f-813c-fa012dc3fade\" (UID: \"0e4973a9-ead0-4c5f-813c-fa012dc3fade\") "
Oct 30 20:08:30.178065 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:30.178059    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/0e4973a9-ead0-4c5f-813c-fa012dc3fade-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0e4973a9-ead0-4c5f-813c-fa012dc3fade-istio-data\") pod \"0e4973a9-ead0-4c5f-813c-fa012dc3fade\" (UID: \"0e4973a9-ead0-4c5f-813c-fa012dc3fade\") "
Oct 30 20:08:30.178163 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:30.178124    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/0e4973a9-ead0-4c5f-813c-fa012dc3fade-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0e4973a9-ead0-4c5f-813c-fa012dc3fade-istio-podinfo\") pod \"0e4973a9-ead0-4c5f-813c-fa012dc3fade\" (UID: \"0e4973a9-ead0-4c5f-813c-fa012dc3fade\") "
Oct 30 20:08:30.178163 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:30.178150    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/0e4973a9-ead0-4c5f-813c-fa012dc3fade-istio-token\" (UniqueName: \"kubernetes.io/projected/0e4973a9-ead0-4c5f-813c-fa012dc3fade-istio-token\") pod \"0e4973a9-ead0-4c5f-813c-fa012dc3fade\" (UID: \"0e4973a9-ead0-4c5f-813c-fa012dc3fade\") "
Oct 30 20:08:30.178257 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:30.178175    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0e4973a9-ead0-4c5f-813c-fa012dc3fade-workload-certs" pod "0e4973a9-ead0-4c5f-813c-fa012dc3fade" (UID: "0e4973a9-ead0-4c5f-813c-fa012dc3fade"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:08:30.178257 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:30.178190    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d41d4ace-e4ec-4c16-abdb-c1dcdecc40e0-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d41d4ace-e4ec-4c16-abdb-c1dcdecc40e0-workload-certs\") pod \"d41d4ace-e4ec-4c16-abdb-c1dcdecc40e0\" (UID: \"d41d4ace-e4ec-4c16-abdb-c1dcdecc40e0\") "
Oct 30 20:08:30.178257 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:30.178241    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/0e4973a9-ead0-4c5f-813c-fa012dc3fade-kube-api-access-v692p\" (UniqueName: \"kubernetes.io/projected/0e4973a9-ead0-4c5f-813c-fa012dc3fade-kube-api-access-v692p\") pod \"0e4973a9-ead0-4c5f-813c-fa012dc3fade\" (UID: \"0e4973a9-ead0-4c5f-813c-fa012dc3fade\") "
Oct 30 20:08:30.178376 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:30.178257    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d41d4ace-e4ec-4c16-abdb-c1dcdecc40e0-istiod-ca-cert" pod "d41d4ace-e4ec-4c16-abdb-c1dcdecc40e0" (UID: "d41d4ace-e4ec-4c16-abdb-c1dcdecc40e0"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:08:30.178446 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:30.178370    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d41d4ace-e4ec-4c16-abdb-c1dcdecc40e0-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d41d4ace-e4ec-4c16-abdb-c1dcdecc40e0-credential-socket\") pod \"d41d4ace-e4ec-4c16-abdb-c1dcdecc40e0\" (UID: \"d41d4ace-e4ec-4c16-abdb-c1dcdecc40e0\") "
Oct 30 20:08:30.178486 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:30.178472    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/0e4973a9-ead0-4c5f-813c-fa012dc3fade-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0e4973a9-ead0-4c5f-813c-fa012dc3fade-istio-envoy\") pod \"0e4973a9-ead0-4c5f-813c-fa012dc3fade\" (UID: \"0e4973a9-ead0-4c5f-813c-fa012dc3fade\") "
Oct 30 20:08:30.178542 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:30.178522    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/d41d4ace-e4ec-4c16-abdb-c1dcdecc40e0-istio-token\" (UniqueName: \"kubernetes.io/projected/d41d4ace-e4ec-4c16-abdb-c1dcdecc40e0-istio-token\") pod \"d41d4ace-e4ec-4c16-abdb-c1dcdecc40e0\" (UID: \"d41d4ace-e4ec-4c16-abdb-c1dcdecc40e0\") "
Oct 30 20:08:30.178623 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:30.178552    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d41d4ace-e4ec-4c16-abdb-c1dcdecc40e0-workload-certs" pod "d41d4ace-e4ec-4c16-abdb-c1dcdecc40e0" (UID: "d41d4ace-e4ec-4c16-abdb-c1dcdecc40e0"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:08:30.178623 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:30.178563    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/d41d4ace-e4ec-4c16-abdb-c1dcdecc40e0-kube-api-access-fbbtd\" (UniqueName: \"kubernetes.io/projected/d41d4ace-e4ec-4c16-abdb-c1dcdecc40e0-kube-api-access-fbbtd\") pod \"d41d4ace-e4ec-4c16-abdb-c1dcdecc40e0\" (UID: \"d41d4ace-e4ec-4c16-abdb-c1dcdecc40e0\") "
Oct 30 20:08:30.178623 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:30.178608    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d41d4ace-e4ec-4c16-abdb-c1dcdecc40e0-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d41d4ace-e4ec-4c16-abdb-c1dcdecc40e0-istio-envoy\") pod \"d41d4ace-e4ec-4c16-abdb-c1dcdecc40e0\" (UID: \"d41d4ace-e4ec-4c16-abdb-c1dcdecc40e0\") "
Oct 30 20:08:30.178771 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:30.178739    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/0e4973a9-ead0-4c5f-813c-fa012dc3fade-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0e4973a9-ead0-4c5f-813c-fa012dc3fade-istiod-ca-cert\") pod \"0e4973a9-ead0-4c5f-813c-fa012dc3fade\" (UID: \"0e4973a9-ead0-4c5f-813c-fa012dc3fade\") "
Oct 30 20:08:30.178814 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:30.178773    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/0e4973a9-ead0-4c5f-813c-fa012dc3fade-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0e4973a9-ead0-4c5f-813c-fa012dc3fade-workload-socket\") pod \"0e4973a9-ead0-4c5f-813c-fa012dc3fade\" (UID: \"0e4973a9-ead0-4c5f-813c-fa012dc3fade\") "
Oct 30 20:08:30.179340 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:30.179317    6275 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d41d4ace-e4ec-4c16-abdb-c1dcdecc40e0-workload-socket\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:08:30.179482 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:30.179343    6275 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0e4973a9-ead0-4c5f-813c-fa012dc3fade-workload-certs\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:08:30.179482 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:30.179357    6275 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d41d4ace-e4ec-4c16-abdb-c1dcdecc40e0-istiod-ca-cert\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:08:30.179482 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:30.179369    6275 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d41d4ace-e4ec-4c16-abdb-c1dcdecc40e0-workload-certs\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:08:30.179679 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:30.178569    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0e4973a9-ead0-4c5f-813c-fa012dc3fade-istio-data" pod "0e4973a9-ead0-4c5f-813c-fa012dc3fade" (UID: "0e4973a9-ead0-4c5f-813c-fa012dc3fade"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:08:30.179679 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:30.178749    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0e4973a9-ead0-4c5f-813c-fa012dc3fade-credential-socket" pod "0e4973a9-ead0-4c5f-813c-fa012dc3fade" (UID: "0e4973a9-ead0-4c5f-813c-fa012dc3fade"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:08:30.179679 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:30.179031    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d41d4ace-e4ec-4c16-abdb-c1dcdecc40e0-istio-data" pod "d41d4ace-e4ec-4c16-abdb-c1dcdecc40e0" (UID: "d41d4ace-e4ec-4c16-abdb-c1dcdecc40e0"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:08:30.179679 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:30.179306    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d41d4ace-e4ec-4c16-abdb-c1dcdecc40e0-credential-socket" pod "d41d4ace-e4ec-4c16-abdb-c1dcdecc40e0" (UID: "d41d4ace-e4ec-4c16-abdb-c1dcdecc40e0"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:08:30.179679 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:30.179546    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0e4973a9-ead0-4c5f-813c-fa012dc3fade-workload-socket" pod "0e4973a9-ead0-4c5f-813c-fa012dc3fade" (UID: "0e4973a9-ead0-4c5f-813c-fa012dc3fade"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:08:30.181143 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:30.181118    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d41d4ace-e4ec-4c16-abdb-c1dcdecc40e0-kube-api-access-fbbtd" pod "d41d4ace-e4ec-4c16-abdb-c1dcdecc40e0" (UID: "d41d4ace-e4ec-4c16-abdb-c1dcdecc40e0"). InnerVolumeSpecName "kube-api-access-fbbtd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:08:30.181248 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:30.181204    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0e4973a9-ead0-4c5f-813c-fa012dc3fade-istio-envoy" pod "0e4973a9-ead0-4c5f-813c-fa012dc3fade" (UID: "0e4973a9-ead0-4c5f-813c-fa012dc3fade"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:08:30.181624 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:30.181599    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0e4973a9-ead0-4c5f-813c-fa012dc3fade-istiod-ca-cert" pod "0e4973a9-ead0-4c5f-813c-fa012dc3fade" (UID: "0e4973a9-ead0-4c5f-813c-fa012dc3fade"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:08:30.182163 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:30.182138    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/0e4973a9-ead0-4c5f-813c-fa012dc3fade-istio-podinfo" pod "0e4973a9-ead0-4c5f-813c-fa012dc3fade" (UID: "0e4973a9-ead0-4c5f-813c-fa012dc3fade"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 20:08:30.182257 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:30.182167    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/d41d4ace-e4ec-4c16-abdb-c1dcdecc40e0-istio-podinfo" pod "d41d4ace-e4ec-4c16-abdb-c1dcdecc40e0" (UID: "d41d4ace-e4ec-4c16-abdb-c1dcdecc40e0"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 20:08:30.182257 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:30.182177    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0e4973a9-ead0-4c5f-813c-fa012dc3fade-istio-token" pod "0e4973a9-ead0-4c5f-813c-fa012dc3fade" (UID: "0e4973a9-ead0-4c5f-813c-fa012dc3fade"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:08:30.182257 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:30.182183    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0e4973a9-ead0-4c5f-813c-fa012dc3fade-kube-api-access-v692p" pod "0e4973a9-ead0-4c5f-813c-fa012dc3fade" (UID: "0e4973a9-ead0-4c5f-813c-fa012dc3fade"). InnerVolumeSpecName "kube-api-access-v692p". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:08:30.182893 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:30.182877    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d41d4ace-e4ec-4c16-abdb-c1dcdecc40e0-istio-token" pod "d41d4ace-e4ec-4c16-abdb-c1dcdecc40e0" (UID: "d41d4ace-e4ec-4c16-abdb-c1dcdecc40e0"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:08:30.183376 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:30.183354    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d41d4ace-e4ec-4c16-abdb-c1dcdecc40e0-istio-envoy" pod "d41d4ace-e4ec-4c16-abdb-c1dcdecc40e0" (UID: "d41d4ace-e4ec-4c16-abdb-c1dcdecc40e0"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:08:30.184821 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:30.184792    6275 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-62f4a1-openshift-default-7fc84fbccc-52l47"]
Oct 30 20:08:30.190079 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:30.190057    6275 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w0-62f4a1-openshift-default-7fc84fbccc-52l47"]
Oct 30 20:08:30.280503 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:30.280469    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/943aa671-36e0-4eac-aa11-807858253698-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/943aa671-36e0-4eac-aa11-807858253698-workload-socket\") pod \"943aa671-36e0-4eac-aa11-807858253698\" (UID: \"943aa671-36e0-4eac-aa11-807858253698\") "
Oct 30 20:08:30.280503 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:30.280509    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/943aa671-36e0-4eac-aa11-807858253698-kube-api-access-sp2zn\" (UniqueName: \"kubernetes.io/projected/943aa671-36e0-4eac-aa11-807858253698-kube-api-access-sp2zn\") pod \"943aa671-36e0-4eac-aa11-807858253698\" (UID: \"943aa671-36e0-4eac-aa11-807858253698\") "
Oct 30 20:08:30.280763 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:30.280551    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/943aa671-36e0-4eac-aa11-807858253698-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/943aa671-36e0-4eac-aa11-807858253698-istio-envoy\") pod \"943aa671-36e0-4eac-aa11-807858253698\" (UID: \"943aa671-36e0-4eac-aa11-807858253698\") "
Oct 30 20:08:30.280763 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:30.280625    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/943aa671-36e0-4eac-aa11-807858253698-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/943aa671-36e0-4eac-aa11-807858253698-istio-data\") pod \"943aa671-36e0-4eac-aa11-807858253698\" (UID: \"943aa671-36e0-4eac-aa11-807858253698\") "
Oct 30 20:08:30.280763 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:30.280669    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/943aa671-36e0-4eac-aa11-807858253698-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/943aa671-36e0-4eac-aa11-807858253698-workload-certs\") pod \"943aa671-36e0-4eac-aa11-807858253698\" (UID: \"943aa671-36e0-4eac-aa11-807858253698\") "
Oct 30 20:08:30.280763 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:30.280730    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/943aa671-36e0-4eac-aa11-807858253698-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/943aa671-36e0-4eac-aa11-807858253698-istiod-ca-cert\") pod \"943aa671-36e0-4eac-aa11-807858253698\" (UID: \"943aa671-36e0-4eac-aa11-807858253698\") "
Oct 30 20:08:30.280968 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:30.280757    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/943aa671-36e0-4eac-aa11-807858253698-workload-socket" pod "943aa671-36e0-4eac-aa11-807858253698" (UID: "943aa671-36e0-4eac-aa11-807858253698"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:08:30.280968 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:30.280813    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/943aa671-36e0-4eac-aa11-807858253698-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/943aa671-36e0-4eac-aa11-807858253698-istio-podinfo\") pod \"943aa671-36e0-4eac-aa11-807858253698\" (UID: \"943aa671-36e0-4eac-aa11-807858253698\") "
Oct 30 20:08:30.280968 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:30.280902    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/943aa671-36e0-4eac-aa11-807858253698-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/943aa671-36e0-4eac-aa11-807858253698-credential-socket\") pod \"943aa671-36e0-4eac-aa11-807858253698\" (UID: \"943aa671-36e0-4eac-aa11-807858253698\") "
Oct 30 20:08:30.280968 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:30.280939    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/943aa671-36e0-4eac-aa11-807858253698-istio-token\" (UniqueName: \"kubernetes.io/projected/943aa671-36e0-4eac-aa11-807858253698-istio-token\") pod \"943aa671-36e0-4eac-aa11-807858253698\" (UID: \"943aa671-36e0-4eac-aa11-807858253698\") "
Oct 30 20:08:30.281170 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:30.280951    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/943aa671-36e0-4eac-aa11-807858253698-istio-data" pod "943aa671-36e0-4eac-aa11-807858253698" (UID: "943aa671-36e0-4eac-aa11-807858253698"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:08:30.281170 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:30.280997    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/943aa671-36e0-4eac-aa11-807858253698-workload-certs" pod "943aa671-36e0-4eac-aa11-807858253698" (UID: "943aa671-36e0-4eac-aa11-807858253698"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:08:30.281170 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:30.281150    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/943aa671-36e0-4eac-aa11-807858253698-istiod-ca-cert" pod "943aa671-36e0-4eac-aa11-807858253698" (UID: "943aa671-36e0-4eac-aa11-807858253698"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:08:30.281475 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:30.281453    6275 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0e4973a9-ead0-4c5f-813c-fa012dc3fade-istio-data\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:08:30.281580 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:30.281477    6275 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/943aa671-36e0-4eac-aa11-807858253698-istiod-ca-cert\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:08:30.281580 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:30.281491    6275 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0e4973a9-ead0-4c5f-813c-fa012dc3fade-istio-podinfo\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:08:30.281580 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:30.281505    6275 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0e4973a9-ead0-4c5f-813c-fa012dc3fade-istio-token\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:08:30.281580 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:30.281518    6275 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v692p\" (UniqueName: \"kubernetes.io/projected/0e4973a9-ead0-4c5f-813c-fa012dc3fade-kube-api-access-v692p\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:08:30.281580 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:30.281533    6275 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d41d4ace-e4ec-4c16-abdb-c1dcdecc40e0-credential-socket\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:08:30.281580 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:30.281546    6275 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0e4973a9-ead0-4c5f-813c-fa012dc3fade-istio-envoy\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:08:30.281580 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:30.281559    6275 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d41d4ace-e4ec-4c16-abdb-c1dcdecc40e0-istio-token\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:08:30.281580 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:30.281574    6275 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fbbtd\" (UniqueName: \"kubernetes.io/projected/d41d4ace-e4ec-4c16-abdb-c1dcdecc40e0-kube-api-access-fbbtd\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:08:30.281964 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:30.281588    6275 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d41d4ace-e4ec-4c16-abdb-c1dcdecc40e0-istio-envoy\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:08:30.281964 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:30.281601    6275 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/943aa671-36e0-4eac-aa11-807858253698-workload-socket\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:08:30.281964 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:30.281614    6275 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0e4973a9-ead0-4c5f-813c-fa012dc3fade-istiod-ca-cert\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:08:30.281964 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:30.281627    6275 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0e4973a9-ead0-4c5f-813c-fa012dc3fade-workload-socket\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:08:30.281964 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:30.281639    6275 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d41d4ace-e4ec-4c16-abdb-c1dcdecc40e0-istio-podinfo\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:08:30.281964 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:30.281651    6275 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/943aa671-36e0-4eac-aa11-807858253698-istio-data\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:08:30.281964 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:30.281662    6275 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d41d4ace-e4ec-4c16-abdb-c1dcdecc40e0-istio-data\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:08:30.281964 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:30.281675    6275 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0e4973a9-ead0-4c5f-813c-fa012dc3fade-credential-socket\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:08:30.281964 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:30.281687    6275 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/943aa671-36e0-4eac-aa11-807858253698-workload-certs\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:08:30.282730 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:30.281979    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/943aa671-36e0-4eac-aa11-807858253698-credential-socket" pod "943aa671-36e0-4eac-aa11-807858253698" (UID: "943aa671-36e0-4eac-aa11-807858253698"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:08:30.283452 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:30.283406    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/943aa671-36e0-4eac-aa11-807858253698-istio-envoy" pod "943aa671-36e0-4eac-aa11-807858253698" (UID: "943aa671-36e0-4eac-aa11-807858253698"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:08:30.283563 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:30.283523    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/943aa671-36e0-4eac-aa11-807858253698-istio-podinfo" pod "943aa671-36e0-4eac-aa11-807858253698" (UID: "943aa671-36e0-4eac-aa11-807858253698"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 20:08:30.283613 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:30.283558    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/943aa671-36e0-4eac-aa11-807858253698-istio-token" pod "943aa671-36e0-4eac-aa11-807858253698" (UID: "943aa671-36e0-4eac-aa11-807858253698"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:08:30.283677 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:30.283661    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/943aa671-36e0-4eac-aa11-807858253698-kube-api-access-sp2zn" pod "943aa671-36e0-4eac-aa11-807858253698" (UID: "943aa671-36e0-4eac-aa11-807858253698"). InnerVolumeSpecName "kube-api-access-sp2zn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:08:30.382798 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:30.382762    6275 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/943aa671-36e0-4eac-aa11-807858253698-istio-podinfo\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:08:30.382798 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:30.382801    6275 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/943aa671-36e0-4eac-aa11-807858253698-credential-socket\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:08:30.383007 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:30.382816    6275 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/943aa671-36e0-4eac-aa11-807858253698-istio-token\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:08:30.383007 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:30.382833    6275 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sp2zn\" (UniqueName: \"kubernetes.io/projected/943aa671-36e0-4eac-aa11-807858253698-kube-api-access-sp2zn\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:08:30.383007 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:30.382848    6275 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/943aa671-36e0-4eac-aa11-807858253698-istio-envoy\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:08:30.406942 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:30.406842    6275 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w1-5f10d2-openshift-default-6c6777d6f5-8zmm9"]
Oct 30 20:08:30.415721 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:30.415689    6275 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w1-5f10d2-openshift-default-6c6777d6f5-8zmm9"]
Oct 30 20:08:30.480714 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:30.480663    6275 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w1-5f10d2-openshift-default-6c6777d6f5-8zmvq"]
Oct 30 20:08:30.487263 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:30.487229    6275 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w1-5f10d2-openshift-default-6c6777d6f5-8zmvq"]
Oct 30 20:08:30.643132 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:30.643108    6275 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-62f4a1-openshift-default-7fc84fbccc-7qzmg"
Oct 30 20:08:30.687154 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:30.687071    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/555e958d-9abd-41f1-b08a-0db0b32fe79f-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/555e958d-9abd-41f1-b08a-0db0b32fe79f-istio-podinfo\") pod \"555e958d-9abd-41f1-b08a-0db0b32fe79f\" (UID: \"555e958d-9abd-41f1-b08a-0db0b32fe79f\") "
Oct 30 20:08:30.687295 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:30.687242    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/555e958d-9abd-41f1-b08a-0db0b32fe79f-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/555e958d-9abd-41f1-b08a-0db0b32fe79f-istio-data\") pod \"555e958d-9abd-41f1-b08a-0db0b32fe79f\" (UID: \"555e958d-9abd-41f1-b08a-0db0b32fe79f\") "
Oct 30 20:08:30.687362 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:30.687303    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/555e958d-9abd-41f1-b08a-0db0b32fe79f-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/555e958d-9abd-41f1-b08a-0db0b32fe79f-istio-envoy\") pod \"555e958d-9abd-41f1-b08a-0db0b32fe79f\" (UID: \"555e958d-9abd-41f1-b08a-0db0b32fe79f\") "
Oct 30 20:08:30.687362 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:30.687348    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/555e958d-9abd-41f1-b08a-0db0b32fe79f-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/555e958d-9abd-41f1-b08a-0db0b32fe79f-workload-certs\") pod \"555e958d-9abd-41f1-b08a-0db0b32fe79f\" (UID: \"555e958d-9abd-41f1-b08a-0db0b32fe79f\") "
Oct 30 20:08:30.687529 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:30.687495    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/555e958d-9abd-41f1-b08a-0db0b32fe79f-kube-api-access-99c2d\" (UniqueName: \"kubernetes.io/projected/555e958d-9abd-41f1-b08a-0db0b32fe79f-kube-api-access-99c2d\") pod \"555e958d-9abd-41f1-b08a-0db0b32fe79f\" (UID: \"555e958d-9abd-41f1-b08a-0db0b32fe79f\") "
Oct 30 20:08:30.687582 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:30.687537    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/555e958d-9abd-41f1-b08a-0db0b32fe79f-istio-token\" (UniqueName: \"kubernetes.io/projected/555e958d-9abd-41f1-b08a-0db0b32fe79f-istio-token\") pod \"555e958d-9abd-41f1-b08a-0db0b32fe79f\" (UID: \"555e958d-9abd-41f1-b08a-0db0b32fe79f\") "
Oct 30 20:08:30.687629 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:30.687600    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/555e958d-9abd-41f1-b08a-0db0b32fe79f-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/555e958d-9abd-41f1-b08a-0db0b32fe79f-workload-socket\") pod \"555e958d-9abd-41f1-b08a-0db0b32fe79f\" (UID: \"555e958d-9abd-41f1-b08a-0db0b32fe79f\") "
Oct 30 20:08:30.687687 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:30.687640    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/555e958d-9abd-41f1-b08a-0db0b32fe79f-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/555e958d-9abd-41f1-b08a-0db0b32fe79f-istiod-ca-cert\") pod \"555e958d-9abd-41f1-b08a-0db0b32fe79f\" (UID: \"555e958d-9abd-41f1-b08a-0db0b32fe79f\") "
Oct 30 20:08:30.687736 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:30.687702    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/555e958d-9abd-41f1-b08a-0db0b32fe79f-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/555e958d-9abd-41f1-b08a-0db0b32fe79f-credential-socket\") pod \"555e958d-9abd-41f1-b08a-0db0b32fe79f\" (UID: \"555e958d-9abd-41f1-b08a-0db0b32fe79f\") "
Oct 30 20:08:30.690000 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:30.689393    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/555e958d-9abd-41f1-b08a-0db0b32fe79f-istiod-ca-cert" pod "555e958d-9abd-41f1-b08a-0db0b32fe79f" (UID: "555e958d-9abd-41f1-b08a-0db0b32fe79f"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:08:30.690000 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:30.689799    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/555e958d-9abd-41f1-b08a-0db0b32fe79f-credential-socket" pod "555e958d-9abd-41f1-b08a-0db0b32fe79f" (UID: "555e958d-9abd-41f1-b08a-0db0b32fe79f"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:08:30.690201 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:30.690117    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/555e958d-9abd-41f1-b08a-0db0b32fe79f-workload-certs" pod "555e958d-9abd-41f1-b08a-0db0b32fe79f" (UID: "555e958d-9abd-41f1-b08a-0db0b32fe79f"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:08:30.690342 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:30.690248    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/555e958d-9abd-41f1-b08a-0db0b32fe79f-workload-socket" pod "555e958d-9abd-41f1-b08a-0db0b32fe79f" (UID: "555e958d-9abd-41f1-b08a-0db0b32fe79f"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:08:30.691008 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:30.690876    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/555e958d-9abd-41f1-b08a-0db0b32fe79f-istio-podinfo" pod "555e958d-9abd-41f1-b08a-0db0b32fe79f" (UID: "555e958d-9abd-41f1-b08a-0db0b32fe79f"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 20:08:30.695334 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:30.694356    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/555e958d-9abd-41f1-b08a-0db0b32fe79f-istio-envoy" pod "555e958d-9abd-41f1-b08a-0db0b32fe79f" (UID: "555e958d-9abd-41f1-b08a-0db0b32fe79f"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:08:30.697470 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:30.695488    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/555e958d-9abd-41f1-b08a-0db0b32fe79f-istio-data" pod "555e958d-9abd-41f1-b08a-0db0b32fe79f" (UID: "555e958d-9abd-41f1-b08a-0db0b32fe79f"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:08:30.702029 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:30.701995    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/555e958d-9abd-41f1-b08a-0db0b32fe79f-kube-api-access-99c2d" pod "555e958d-9abd-41f1-b08a-0db0b32fe79f" (UID: "555e958d-9abd-41f1-b08a-0db0b32fe79f"). InnerVolumeSpecName "kube-api-access-99c2d". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:08:30.703445 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:30.703391    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/555e958d-9abd-41f1-b08a-0db0b32fe79f-istio-token" pod "555e958d-9abd-41f1-b08a-0db0b32fe79f" (UID: "555e958d-9abd-41f1-b08a-0db0b32fe79f"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:08:30.789426 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:30.789383    6275 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/555e958d-9abd-41f1-b08a-0db0b32fe79f-istio-envoy\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:08:30.789426 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:30.789409    6275 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/555e958d-9abd-41f1-b08a-0db0b32fe79f-workload-certs\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:08:30.789426 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:30.789432    6275 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-99c2d\" (UniqueName: \"kubernetes.io/projected/555e958d-9abd-41f1-b08a-0db0b32fe79f-kube-api-access-99c2d\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:08:30.789652 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:30.789442    6275 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/555e958d-9abd-41f1-b08a-0db0b32fe79f-istio-token\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:08:30.789652 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:30.789450    6275 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/555e958d-9abd-41f1-b08a-0db0b32fe79f-workload-socket\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:08:30.789652 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:30.789458    6275 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/555e958d-9abd-41f1-b08a-0db0b32fe79f-istiod-ca-cert\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:08:30.789652 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:30.789466    6275 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/555e958d-9abd-41f1-b08a-0db0b32fe79f-credential-socket\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:08:30.789652 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:30.789474    6275 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/555e958d-9abd-41f1-b08a-0db0b32fe79f-istio-podinfo\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:08:30.789652 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:30.789482    6275 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/555e958d-9abd-41f1-b08a-0db0b32fe79f-istio-data\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:08:31.148261 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:31.148226    6275 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-62f4a1-openshift-default-7fc84fbccc-7qzmg"
Oct 30 20:08:31.148836 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:31.148227    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-62f4a1-openshift-default-7fc84fbccc-7qzmg" event={"ID":"555e958d-9abd-41f1-b08a-0db0b32fe79f","Type":"ContainerDied","Data":"c0789902196f44e1b0efbf5c4245d1929814c996b7d5a26e54229ced68295476"}
Oct 30 20:08:31.148836 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:31.148398    6275 scope.go:122] "RemoveContainer" containerID="6380e096c69463037b49fbf888cf7ab5016054777548b93e6d47ad6fa445d0fd"
Oct 30 20:08:31.151242 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:31.151210    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-62f4a1-openshift-default-7fc84fbccc-xwj24" event={"ID":"943aa671-36e0-4eac-aa11-807858253698","Type":"ContainerDied","Data":"c4f7daf1eb112aef13d4ed57ced80efab87f18b4f93ebd8ecfac1a6b81ded160"}
Oct 30 20:08:31.151350 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:31.151248    6275 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-62f4a1-openshift-default-7fc84fbccc-xwj24"
Oct 30 20:08:31.154120 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:31.154096    6275 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-5f10d2-openshift-default-6c6777d6f5-dj7jb"
Oct 30 20:08:31.154246 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:31.154119    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-5f10d2-openshift-default-6c6777d6f5-dj7jb" event={"ID":"d41d4ace-e4ec-4c16-abdb-c1dcdecc40e0","Type":"ContainerDied","Data":"194e1c93a3d83ff21a562efa5eca93fb04d72d375defbae41c8bd705ad278297"}
Oct 30 20:08:31.160975 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:31.160949    6275 scope.go:122] "RemoveContainer" containerID="9bd76bf6ce477ec797390390994793f4ca0b9509fb530fba3ebdd3cc3387aa30"
Oct 30 20:08:31.173092 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:31.173072    6275 scope.go:122] "RemoveContainer" containerID="33abf82c2490167788c4a794c719a4e4aff8a68c802e5c8b0fe4e6982cc56463"
Oct 30 20:08:31.226335 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:31.226303    6275 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-62f4a1-openshift-default-7fc84fbccc-7qzmg"]
Oct 30 20:08:31.239317 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:31.239290    6275 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w0-62f4a1-openshift-default-7fc84fbccc-7qzmg"]
Oct 30 20:08:31.288807 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:31.288780    6275 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w1-5f10d2-openshift-default-6c6777d6f5-dj7jb"]
Oct 30 20:08:31.296248 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:31.296220    6275 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w1-5f10d2-openshift-default-6c6777d6f5-dj7jb"]
Oct 30 20:08:31.302424 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:31.302390    6275 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-b4cf9b1f-5klgm"
Oct 30 20:08:31.333092 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:31.333059    6275 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-62f4a1-openshift-default-7fc84fbccc-xwj24"]
Oct 30 20:08:31.339401 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:31.339378    6275 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w0-62f4a1-openshift-default-7fc84fbccc-xwj24"]
Oct 30 20:08:31.396009 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:31.395981    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/e6ac148d-3229-49ab-861f-7b79b60febc4-kube-api-access-2dn48\" (UniqueName: \"kubernetes.io/projected/e6ac148d-3229-49ab-861f-7b79b60febc4-kube-api-access-2dn48\") pod \"e6ac148d-3229-49ab-861f-7b79b60febc4\" (UID: \"e6ac148d-3229-49ab-861f-7b79b60febc4\") "
Oct 30 20:08:31.396156 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:31.396025    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/e6ac148d-3229-49ab-861f-7b79b60febc4-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/e6ac148d-3229-49ab-861f-7b79b60febc4-maas-api-openshift-ca\") pod \"e6ac148d-3229-49ab-861f-7b79b60febc4\" (UID: \"e6ac148d-3229-49ab-861f-7b79b60febc4\") "
Oct 30 20:08:31.396156 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:31.396079    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/e6ac148d-3229-49ab-861f-7b79b60febc4-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/e6ac148d-3229-49ab-861f-7b79b60febc4-maas-api-xks-ca\") pod \"e6ac148d-3229-49ab-861f-7b79b60febc4\" (UID: \"e6ac148d-3229-49ab-861f-7b79b60febc4\") "
Oct 30 20:08:31.396526 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:31.396499    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e6ac148d-3229-49ab-861f-7b79b60febc4-maas-api-openshift-ca" pod "e6ac148d-3229-49ab-861f-7b79b60febc4" (UID: "e6ac148d-3229-49ab-861f-7b79b60febc4"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:08:31.396710 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:31.396692    6275 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/e6ac148d-3229-49ab-861f-7b79b60febc4-maas-api-openshift-ca\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:08:31.398219 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:31.398190    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e6ac148d-3229-49ab-861f-7b79b60febc4-maas-api-xks-ca" pod "e6ac148d-3229-49ab-861f-7b79b60febc4" (UID: "e6ac148d-3229-49ab-861f-7b79b60febc4"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 20:08:31.398324 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:31.398264    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e6ac148d-3229-49ab-861f-7b79b60febc4-kube-api-access-2dn48" pod "e6ac148d-3229-49ab-861f-7b79b60febc4" (UID: "e6ac148d-3229-49ab-861f-7b79b60febc4"). InnerVolumeSpecName "kube-api-access-2dn48". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:08:31.498011 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:31.497971    6275 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2dn48\" (UniqueName: \"kubernetes.io/projected/e6ac148d-3229-49ab-861f-7b79b60febc4-kube-api-access-2dn48\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:08:31.498011 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:31.498011    6275 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/e6ac148d-3229-49ab-861f-7b79b60febc4-maas-api-xks-ca\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:08:31.657358 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:31.657278    6275 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="0e4973a9-ead0-4c5f-813c-fa012dc3fade" path="/var/lib/kubelet/pods/0e4973a9-ead0-4c5f-813c-fa012dc3fade/volumes"
Oct 30 20:08:31.657856 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:31.657840    6275 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="555e958d-9abd-41f1-b08a-0db0b32fe79f" path="/var/lib/kubelet/pods/555e958d-9abd-41f1-b08a-0db0b32fe79f/volumes"
Oct 30 20:08:31.658298 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:31.658284    6275 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="91d406fb-17e3-47cf-bb3c-0a088ea0968e" path="/var/lib/kubelet/pods/91d406fb-17e3-47cf-bb3c-0a088ea0968e/volumes"
Oct 30 20:08:31.659090 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:31.659075    6275 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="943aa671-36e0-4eac-aa11-807858253698" path="/var/lib/kubelet/pods/943aa671-36e0-4eac-aa11-807858253698/volumes"
Oct 30 20:08:31.659534 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:31.659520    6275 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="d41d4ace-e4ec-4c16-abdb-c1dcdecc40e0" path="/var/lib/kubelet/pods/d41d4ace-e4ec-4c16-abdb-c1dcdecc40e0/volumes"
Oct 30 20:08:31.660010 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:31.659990    6275 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="e3f64fa4-b2e2-4ab4-9da5-76bbfac9116d" path="/var/lib/kubelet/pods/e3f64fa4-b2e2-4ab4-9da5-76bbfac9116d/volumes"
Oct 30 20:08:32.165712 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:32.165682    6275 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-b4cf9b1f-5klgm"
Oct 30 20:08:32.166194 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:32.165679    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-b4cf9b1f-5klgm" event={"ID":"e6ac148d-3229-49ab-861f-7b79b60febc4","Type":"ContainerDied","Data":"9dfb6ba8e8e6e2b285dadf560c9c81009c5db379a1d6a7b6890b85156f0f869b"}
Oct 30 20:08:32.166194 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:32.165826    6275 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9dfb6ba8e8e6e2b285dadf560c9c81009c5db379a1d6a7b6890b85156f0f869b"
Oct 30 20:08:39.392520 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:39.392470    6275 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-0dbf386e-g9v54"]
Oct 30 20:08:39.393251 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:39.393224    6275 cpu_manager.go:414] "containerMap: removing container" podUID="943aa671-36e0-4eac-aa11-807858253698" containerName="istio-proxy"
Oct 30 20:08:39.393404 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:39.393253    6275 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="943aa671-36e0-4eac-aa11-807858253698" containerName="istio-proxy"
Oct 30 20:08:39.393404 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:39.393283    6275 cpu_manager.go:414] "containerMap: removing container" podUID="91d406fb-17e3-47cf-bb3c-0a088ea0968e" containerName="istio-proxy"
Oct 30 20:08:39.393404 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:39.393292    6275 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="91d406fb-17e3-47cf-bb3c-0a088ea0968e" containerName="istio-proxy"
Oct 30 20:08:39.393404 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:39.393312    6275 cpu_manager.go:414] "containerMap: removing container" podUID="e6ac148d-3229-49ab-861f-7b79b60febc4" containerName="revoke-keys"
Oct 30 20:08:39.393404 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:39.393322    6275 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="e6ac148d-3229-49ab-861f-7b79b60febc4" containerName="revoke-keys"
Oct 30 20:08:39.393404 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:39.393338    6275 cpu_manager.go:414] "containerMap: removing container" podUID="0e4973a9-ead0-4c5f-813c-fa012dc3fade" containerName="istio-proxy"
Oct 30 20:08:39.393404 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:39.393345    6275 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="0e4973a9-ead0-4c5f-813c-fa012dc3fade" containerName="istio-proxy"
Oct 30 20:08:39.393404 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:39.393375    6275 cpu_manager.go:414] "containerMap: removing container" podUID="d41d4ace-e4ec-4c16-abdb-c1dcdecc40e0" containerName="istio-proxy"
Oct 30 20:08:39.393404 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:39.393384    6275 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="d41d4ace-e4ec-4c16-abdb-c1dcdecc40e0" containerName="istio-proxy"
Oct 30 20:08:39.393404 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:39.393396    6275 cpu_manager.go:414] "containerMap: removing container" podUID="e3f64fa4-b2e2-4ab4-9da5-76bbfac9116d" containerName="istio-proxy"
Oct 30 20:08:39.393404 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:39.393403    6275 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="e3f64fa4-b2e2-4ab4-9da5-76bbfac9116d" containerName="istio-proxy"
Oct 30 20:08:39.394107 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:39.393441    6275 cpu_manager.go:414] "containerMap: removing container" podUID="555e958d-9abd-41f1-b08a-0db0b32fe79f" containerName="istio-proxy"
Oct 30 20:08:39.394107 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:39.393450    6275 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="555e958d-9abd-41f1-b08a-0db0b32fe79f" containerName="istio-proxy"
Oct 30 20:08:39.394107 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:39.393581    6275 memory_manager.go:365] "RemoveStaleState removing state" podUID="e6ac148d-3229-49ab-861f-7b79b60febc4" containerName="revoke-keys"
Oct 30 20:08:39.394107 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:39.393594    6275 memory_manager.go:365] "RemoveStaleState removing state" podUID="0e4973a9-ead0-4c5f-813c-fa012dc3fade" containerName="istio-proxy"
Oct 30 20:08:39.394107 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:39.393609    6275 memory_manager.go:365] "RemoveStaleState removing state" podUID="d41d4ace-e4ec-4c16-abdb-c1dcdecc40e0" containerName="istio-proxy"
Oct 30 20:08:39.394107 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:39.393620    6275 memory_manager.go:365] "RemoveStaleState removing state" podUID="e3f64fa4-b2e2-4ab4-9da5-76bbfac9116d" containerName="istio-proxy"
Oct 30 20:08:39.394107 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:39.393632    6275 memory_manager.go:365] "RemoveStaleState removing state" podUID="555e958d-9abd-41f1-b08a-0db0b32fe79f" containerName="istio-proxy"
Oct 30 20:08:39.394107 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:39.393645    6275 memory_manager.go:365] "RemoveStaleState removing state" podUID="943aa671-36e0-4eac-aa11-807858253698" containerName="istio-proxy"
Oct 30 20:08:39.394107 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:39.393656    6275 memory_manager.go:365] "RemoveStaleState removing state" podUID="91d406fb-17e3-47cf-bb3c-0a088ea0968e" containerName="istio-proxy"
Oct 30 20:08:39.399602 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:39.399567    6275 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-0dbf386e-g9v54"
Oct 30 20:08:39.436442 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:39.434120    6275 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\""
Oct 30 20:08:39.436442 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:39.434336    6275 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-scs2w\""
Oct 30 20:08:39.448155 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:39.448092    6275 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-0dbf386e-g9v54"]
Oct 30 20:08:39.494989 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:39.494945    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kxw4f\" (UniqueName: \"kubernetes.io/projected/561556e4-1b94-4e88-8eed-f6bc003bbb91-kube-api-access-kxw4f\") pod \"maas-api-revoke-sub-0dbf386e-g9v54\" (UID: \"561556e4-1b94-4e88-8eed-f6bc003bbb91\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-0dbf386e-g9v54"
Oct 30 20:08:39.495237 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:39.495071    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/561556e4-1b94-4e88-8eed-f6bc003bbb91-maas-api-xks-ca\") pod \"maas-api-revoke-sub-0dbf386e-g9v54\" (UID: \"561556e4-1b94-4e88-8eed-f6bc003bbb91\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-0dbf386e-g9v54"
Oct 30 20:08:39.495237 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:39.495133    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/561556e4-1b94-4e88-8eed-f6bc003bbb91-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-0dbf386e-g9v54\" (UID: \"561556e4-1b94-4e88-8eed-f6bc003bbb91\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-0dbf386e-g9v54"
Oct 30 20:08:39.596350 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:39.596312    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kxw4f\" (UniqueName: \"kubernetes.io/projected/561556e4-1b94-4e88-8eed-f6bc003bbb91-kube-api-access-kxw4f\") pod \"maas-api-revoke-sub-0dbf386e-g9v54\" (UID: \"561556e4-1b94-4e88-8eed-f6bc003bbb91\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-0dbf386e-g9v54"
Oct 30 20:08:39.596578 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:39.596439    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/561556e4-1b94-4e88-8eed-f6bc003bbb91-maas-api-xks-ca\") pod \"maas-api-revoke-sub-0dbf386e-g9v54\" (UID: \"561556e4-1b94-4e88-8eed-f6bc003bbb91\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-0dbf386e-g9v54"
Oct 30 20:08:39.596578 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:39.596499    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/561556e4-1b94-4e88-8eed-f6bc003bbb91-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-0dbf386e-g9v54\" (UID: \"561556e4-1b94-4e88-8eed-f6bc003bbb91\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-0dbf386e-g9v54"
Oct 30 20:08:39.597315 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:39.597287    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/561556e4-1b94-4e88-8eed-f6bc003bbb91-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-0dbf386e-g9v54\" (UID: \"561556e4-1b94-4e88-8eed-f6bc003bbb91\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-0dbf386e-g9v54"
Oct 30 20:08:39.601424 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:39.601384    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/561556e4-1b94-4e88-8eed-f6bc003bbb91-maas-api-xks-ca\") pod \"maas-api-revoke-sub-0dbf386e-g9v54\" (UID: \"561556e4-1b94-4e88-8eed-f6bc003bbb91\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-0dbf386e-g9v54"
Oct 30 20:08:39.622508 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:39.622472    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kxw4f\" (UniqueName: \"kubernetes.io/projected/561556e4-1b94-4e88-8eed-f6bc003bbb91-kube-api-access-kxw4f\") pod \"maas-api-revoke-sub-0dbf386e-g9v54\" (UID: \"561556e4-1b94-4e88-8eed-f6bc003bbb91\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-0dbf386e-g9v54"
Oct 30 20:08:39.743899 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:39.743859    6275 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-0dbf386e-g9v54"
Oct 30 20:08:40.356972 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:40.350446    6275 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-0dbf386e-g9v54"]
Oct 30 20:08:41.269372 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:41.269333    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-0dbf386e-g9v54" event={"ID":"561556e4-1b94-4e88-8eed-f6bc003bbb91","Type":"ContainerStarted","Data":"362281d10c3782648e436c2486c334518bc0b1070f8ce9dcab60f7f377ae0dcd"}
Oct 30 20:08:41.269816 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:41.269399    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-0dbf386e-g9v54" event={"ID":"561556e4-1b94-4e88-8eed-f6bc003bbb91","Type":"ContainerStarted","Data":"2c5d99b902c194f8829ffc7c0747b480b7768dade4cc601c81023b73594ccec9"}
Oct 30 20:08:41.325558 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:41.325494    6275 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-sub-0dbf386e-g9v54" podStartSLOduration=2.325475097 podStartE2EDuration="2.325475097s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:08:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:08:41.317815676 +0000 UTC m=+1231.779542540" watchObservedRunningTime="2026-10-30 20:08:41.325475097 +0000 UTC m=+1231.787201962"
Oct 30 20:08:41.555573 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:41.555480    6275 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-bl2ds"]
Oct 30 20:08:41.555792 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:41.555767    6275 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-bl2ds" podUID="23c6b368-9921-4b40-8d73-91f6be15fd07" containerName="istio-proxy" containerID="cri-o://4890d940856bca8a9ab7d1c98b984586201484e9e34e56973ddd9828d49dde4d" gracePeriod=30
Oct 30 20:08:42.278148 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:42.278112    6275 generic.go:356] "Generic (PLEG): container finished" podID="561556e4-1b94-4e88-8eed-f6bc003bbb91" containerID="362281d10c3782648e436c2486c334518bc0b1070f8ce9dcab60f7f377ae0dcd" exitCode=0
Oct 30 20:08:42.278648 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:42.278198    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-0dbf386e-g9v54" event={"ID":"561556e4-1b94-4e88-8eed-f6bc003bbb91","Type":"ContainerDied","Data":"362281d10c3782648e436c2486c334518bc0b1070f8ce9dcab60f7f377ae0dcd"}
Oct 30 20:08:43.443093 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:43.443067    6275 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-0dbf386e-g9v54"
Oct 30 20:08:43.621457 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:43.621339    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/561556e4-1b94-4e88-8eed-f6bc003bbb91-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/561556e4-1b94-4e88-8eed-f6bc003bbb91-maas-api-xks-ca\") pod \"561556e4-1b94-4e88-8eed-f6bc003bbb91\" (UID: \"561556e4-1b94-4e88-8eed-f6bc003bbb91\") "
Oct 30 20:08:43.621660 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:43.621483    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/561556e4-1b94-4e88-8eed-f6bc003bbb91-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/561556e4-1b94-4e88-8eed-f6bc003bbb91-maas-api-openshift-ca\") pod \"561556e4-1b94-4e88-8eed-f6bc003bbb91\" (UID: \"561556e4-1b94-4e88-8eed-f6bc003bbb91\") "
Oct 30 20:08:43.621660 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:43.621565    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/561556e4-1b94-4e88-8eed-f6bc003bbb91-kube-api-access-kxw4f\" (UniqueName: \"kubernetes.io/projected/561556e4-1b94-4e88-8eed-f6bc003bbb91-kube-api-access-kxw4f\") pod \"561556e4-1b94-4e88-8eed-f6bc003bbb91\" (UID: \"561556e4-1b94-4e88-8eed-f6bc003bbb91\") "
Oct 30 20:08:43.621846 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:43.621819    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/561556e4-1b94-4e88-8eed-f6bc003bbb91-maas-api-openshift-ca" pod "561556e4-1b94-4e88-8eed-f6bc003bbb91" (UID: "561556e4-1b94-4e88-8eed-f6bc003bbb91"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:08:43.621977 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:43.621958    6275 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/561556e4-1b94-4e88-8eed-f6bc003bbb91-maas-api-openshift-ca\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:08:43.623514 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:43.623483    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/561556e4-1b94-4e88-8eed-f6bc003bbb91-maas-api-xks-ca" pod "561556e4-1b94-4e88-8eed-f6bc003bbb91" (UID: "561556e4-1b94-4e88-8eed-f6bc003bbb91"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 20:08:43.623713 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:43.623691    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/561556e4-1b94-4e88-8eed-f6bc003bbb91-kube-api-access-kxw4f" pod "561556e4-1b94-4e88-8eed-f6bc003bbb91" (UID: "561556e4-1b94-4e88-8eed-f6bc003bbb91"). InnerVolumeSpecName "kube-api-access-kxw4f". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:08:43.723158 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:43.723125    6275 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/561556e4-1b94-4e88-8eed-f6bc003bbb91-maas-api-xks-ca\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:08:43.723158 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:43.723153    6275 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kxw4f\" (UniqueName: \"kubernetes.io/projected/561556e4-1b94-4e88-8eed-f6bc003bbb91-kube-api-access-kxw4f\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:08:44.294132 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:44.294099    6275 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-0dbf386e-g9v54"
Oct 30 20:08:44.294326 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:44.294133    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-0dbf386e-g9v54" event={"ID":"561556e4-1b94-4e88-8eed-f6bc003bbb91","Type":"ContainerDied","Data":"2c5d99b902c194f8829ffc7c0747b480b7768dade4cc601c81023b73594ccec9"}
Oct 30 20:08:44.294326 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:44.294220    6275 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2c5d99b902c194f8829ffc7c0747b480b7768dade4cc601c81023b73594ccec9"
Oct 30 20:08:45.374358 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:45.374321    6275 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w6-51dd62/distinct-2-w6-51dd62-kserve-79ff99c4cd-fvmb6"]
Oct 30 20:08:45.407334 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:45.407304    6275 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w6-51dd62/simulator-w6-51dd62-kserve-d6bb4985f-65j9h"]
Oct 30 20:08:47.001449 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:46.999625    6275 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-bl2ds"
Oct 30 20:08:47.072989 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:47.071792    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/23c6b368-9921-4b40-8d73-91f6be15fd07-istio-token\" (UniqueName: \"kubernetes.io/projected/23c6b368-9921-4b40-8d73-91f6be15fd07-istio-token\") pod \"23c6b368-9921-4b40-8d73-91f6be15fd07\" (UID: \"23c6b368-9921-4b40-8d73-91f6be15fd07\") "
Oct 30 20:08:47.072989 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:47.071897    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/23c6b368-9921-4b40-8d73-91f6be15fd07-kube-api-access-nh5nl\" (UniqueName: \"kubernetes.io/projected/23c6b368-9921-4b40-8d73-91f6be15fd07-kube-api-access-nh5nl\") pod \"23c6b368-9921-4b40-8d73-91f6be15fd07\" (UID: \"23c6b368-9921-4b40-8d73-91f6be15fd07\") "
Oct 30 20:08:47.072989 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:47.071960    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/23c6b368-9921-4b40-8d73-91f6be15fd07-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/23c6b368-9921-4b40-8d73-91f6be15fd07-workload-socket\") pod \"23c6b368-9921-4b40-8d73-91f6be15fd07\" (UID: \"23c6b368-9921-4b40-8d73-91f6be15fd07\") "
Oct 30 20:08:47.072989 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:47.072007    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/23c6b368-9921-4b40-8d73-91f6be15fd07-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/23c6b368-9921-4b40-8d73-91f6be15fd07-credential-socket\") pod \"23c6b368-9921-4b40-8d73-91f6be15fd07\" (UID: \"23c6b368-9921-4b40-8d73-91f6be15fd07\") "
Oct 30 20:08:47.072989 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:47.072068    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/23c6b368-9921-4b40-8d73-91f6be15fd07-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/23c6b368-9921-4b40-8d73-91f6be15fd07-istio-podinfo\") pod \"23c6b368-9921-4b40-8d73-91f6be15fd07\" (UID: \"23c6b368-9921-4b40-8d73-91f6be15fd07\") "
Oct 30 20:08:47.072989 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:47.072108    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/23c6b368-9921-4b40-8d73-91f6be15fd07-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/23c6b368-9921-4b40-8d73-91f6be15fd07-istio-data\") pod \"23c6b368-9921-4b40-8d73-91f6be15fd07\" (UID: \"23c6b368-9921-4b40-8d73-91f6be15fd07\") "
Oct 30 20:08:47.072989 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:47.072166    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/23c6b368-9921-4b40-8d73-91f6be15fd07-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/23c6b368-9921-4b40-8d73-91f6be15fd07-istiod-ca-cert\") pod \"23c6b368-9921-4b40-8d73-91f6be15fd07\" (UID: \"23c6b368-9921-4b40-8d73-91f6be15fd07\") "
Oct 30 20:08:47.072989 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:47.072200    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/23c6b368-9921-4b40-8d73-91f6be15fd07-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/23c6b368-9921-4b40-8d73-91f6be15fd07-istio-envoy\") pod \"23c6b368-9921-4b40-8d73-91f6be15fd07\" (UID: \"23c6b368-9921-4b40-8d73-91f6be15fd07\") "
Oct 30 20:08:47.072989 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:47.072229    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/23c6b368-9921-4b40-8d73-91f6be15fd07-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/23c6b368-9921-4b40-8d73-91f6be15fd07-workload-certs\") pod \"23c6b368-9921-4b40-8d73-91f6be15fd07\" (UID: \"23c6b368-9921-4b40-8d73-91f6be15fd07\") "
Oct 30 20:08:47.073871 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:47.073791    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/23c6b368-9921-4b40-8d73-91f6be15fd07-workload-certs" pod "23c6b368-9921-4b40-8d73-91f6be15fd07" (UID: "23c6b368-9921-4b40-8d73-91f6be15fd07"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:08:47.084217 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:47.083496    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/23c6b368-9921-4b40-8d73-91f6be15fd07-credential-socket" pod "23c6b368-9921-4b40-8d73-91f6be15fd07" (UID: "23c6b368-9921-4b40-8d73-91f6be15fd07"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:08:47.084217 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:47.083669    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/23c6b368-9921-4b40-8d73-91f6be15fd07-istio-data" pod "23c6b368-9921-4b40-8d73-91f6be15fd07" (UID: "23c6b368-9921-4b40-8d73-91f6be15fd07"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:08:47.084217 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:47.083945    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/23c6b368-9921-4b40-8d73-91f6be15fd07-istiod-ca-cert" pod "23c6b368-9921-4b40-8d73-91f6be15fd07" (UID: "23c6b368-9921-4b40-8d73-91f6be15fd07"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:08:47.084929 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:47.084905    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/23c6b368-9921-4b40-8d73-91f6be15fd07-workload-socket" pod "23c6b368-9921-4b40-8d73-91f6be15fd07" (UID: "23c6b368-9921-4b40-8d73-91f6be15fd07"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:08:47.109815 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:47.109754    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/23c6b368-9921-4b40-8d73-91f6be15fd07-istio-envoy" pod "23c6b368-9921-4b40-8d73-91f6be15fd07" (UID: "23c6b368-9921-4b40-8d73-91f6be15fd07"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:08:47.122825 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:47.122775    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/23c6b368-9921-4b40-8d73-91f6be15fd07-istio-token" pod "23c6b368-9921-4b40-8d73-91f6be15fd07" (UID: "23c6b368-9921-4b40-8d73-91f6be15fd07"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:08:47.123061 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:47.123040    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/23c6b368-9921-4b40-8d73-91f6be15fd07-istio-podinfo" pod "23c6b368-9921-4b40-8d73-91f6be15fd07" (UID: "23c6b368-9921-4b40-8d73-91f6be15fd07"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 20:08:47.123298 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:47.123265    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/23c6b368-9921-4b40-8d73-91f6be15fd07-kube-api-access-nh5nl" pod "23c6b368-9921-4b40-8d73-91f6be15fd07" (UID: "23c6b368-9921-4b40-8d73-91f6be15fd07"). InnerVolumeSpecName "kube-api-access-nh5nl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:08:47.214523 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:47.191793    6275 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/23c6b368-9921-4b40-8d73-91f6be15fd07-credential-socket\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:08:47.214523 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:47.191837    6275 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/23c6b368-9921-4b40-8d73-91f6be15fd07-istio-podinfo\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:08:47.214523 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:47.191853    6275 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/23c6b368-9921-4b40-8d73-91f6be15fd07-istio-data\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:08:47.214523 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:47.191867    6275 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/23c6b368-9921-4b40-8d73-91f6be15fd07-istiod-ca-cert\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:08:47.214523 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:47.191883    6275 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/23c6b368-9921-4b40-8d73-91f6be15fd07-istio-envoy\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:08:47.214523 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:47.191896    6275 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/23c6b368-9921-4b40-8d73-91f6be15fd07-workload-certs\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:08:47.214523 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:47.191909    6275 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/23c6b368-9921-4b40-8d73-91f6be15fd07-istio-token\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:08:47.214523 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:47.191922    6275 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nh5nl\" (UniqueName: \"kubernetes.io/projected/23c6b368-9921-4b40-8d73-91f6be15fd07-kube-api-access-nh5nl\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:08:47.214523 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:47.191936    6275 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/23c6b368-9921-4b40-8d73-91f6be15fd07-workload-socket\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:08:47.402184 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:47.402093    6275 generic.go:356] "Generic (PLEG): container finished" podID="23c6b368-9921-4b40-8d73-91f6be15fd07" containerID="4890d940856bca8a9ab7d1c98b984586201484e9e34e56973ddd9828d49dde4d" exitCode=0
Oct 30 20:08:47.402465 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:47.402439    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-bl2ds" event={"ID":"23c6b368-9921-4b40-8d73-91f6be15fd07","Type":"ContainerDied","Data":"4890d940856bca8a9ab7d1c98b984586201484e9e34e56973ddd9828d49dde4d"}
Oct 30 20:08:47.402658 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:47.402638    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-bl2ds" event={"ID":"23c6b368-9921-4b40-8d73-91f6be15fd07","Type":"ContainerDied","Data":"20ff74c6c83afc1dd0707260a97461dfe786832c812355c6d4c109cfa4a64eda"}
Oct 30 20:08:47.402781 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:47.402767    6275 scope.go:122] "RemoveContainer" containerID="4890d940856bca8a9ab7d1c98b984586201484e9e34e56973ddd9828d49dde4d"
Oct 30 20:08:47.410468 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:47.403069    6275 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-bl2ds"
Oct 30 20:08:47.497629 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:47.497255    6275 scope.go:122] "RemoveContainer" containerID="4890d940856bca8a9ab7d1c98b984586201484e9e34e56973ddd9828d49dde4d"
Oct 30 20:08:47.497971 ip-10-0-131-26 kubenswrapper[6275]: E1030 20:08:47.497870    6275 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4890d940856bca8a9ab7d1c98b984586201484e9e34e56973ddd9828d49dde4d\": container with ID starting with 4890d940856bca8a9ab7d1c98b984586201484e9e34e56973ddd9828d49dde4d not found: ID does not exist" containerID="4890d940856bca8a9ab7d1c98b984586201484e9e34e56973ddd9828d49dde4d"
Oct 30 20:08:47.497971 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:47.497909    6275 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4890d940856bca8a9ab7d1c98b984586201484e9e34e56973ddd9828d49dde4d"} err="failed to get container status \"4890d940856bca8a9ab7d1c98b984586201484e9e34e56973ddd9828d49dde4d\": rpc error: code = NotFound desc = could not find container \"4890d940856bca8a9ab7d1c98b984586201484e9e34e56973ddd9828d49dde4d\": container with ID starting with 4890d940856bca8a9ab7d1c98b984586201484e9e34e56973ddd9828d49dde4d not found: ID does not exist"
Oct 30 20:08:47.523163 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:47.523131    6275 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-bl2ds"]
Oct 30 20:08:47.544880 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:47.544855    6275 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-bl2ds"]
Oct 30 20:08:47.718465 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:47.718357    6275 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="23c6b368-9921-4b40-8d73-91f6be15fd07" path="/var/lib/kubelet/pods/23c6b368-9921-4b40-8d73-91f6be15fd07/volumes"
Oct 30 20:08:51.510150 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:51.510115    6275 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w2-efbac3-7rd5n"]
Oct 30 20:08:51.510668 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:51.510652    6275 cpu_manager.go:414] "containerMap: removing container" podUID="23c6b368-9921-4b40-8d73-91f6be15fd07" containerName="istio-proxy"
Oct 30 20:08:51.510732 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:51.510669    6275 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="23c6b368-9921-4b40-8d73-91f6be15fd07" containerName="istio-proxy"
Oct 30 20:08:51.510732 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:51.510693    6275 cpu_manager.go:414] "containerMap: removing container" podUID="561556e4-1b94-4e88-8eed-f6bc003bbb91" containerName="revoke-keys"
Oct 30 20:08:51.510732 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:51.510698    6275 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="561556e4-1b94-4e88-8eed-f6bc003bbb91" containerName="revoke-keys"
Oct 30 20:08:51.510827 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:51.510770    6275 memory_manager.go:365] "RemoveStaleState removing state" podUID="23c6b368-9921-4b40-8d73-91f6be15fd07" containerName="istio-proxy"
Oct 30 20:08:51.510827 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:51.510780    6275 memory_manager.go:365] "RemoveStaleState removing state" podUID="561556e4-1b94-4e88-8eed-f6bc003bbb91" containerName="revoke-keys"
Oct 30 20:08:51.515751 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:51.515733    6275 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w2-efbac3-7rd5n"
Oct 30 20:08:51.536661 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:51.536630    6275 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w2-efbac3-7rd5n"]
Oct 30 20:08:51.544352 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:51.544328    6275 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\""
Oct 30 20:08:51.544549 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:51.544401    6275 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-scs2w\""
Oct 30 20:08:51.673704 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:51.673674    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/91833992-e328-4b1e-b532-f4e8e284e2e5-maas-api-xks-ca\") pod \"maas-api-revoke-keys-e2e-worker-w2-efbac3-7rd5n\" (UID: \"91833992-e328-4b1e-b532-f4e8e284e2e5\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w2-efbac3-7rd5n"
Oct 30 20:08:51.673842 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:51.673717    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mvgfz\" (UniqueName: \"kubernetes.io/projected/91833992-e328-4b1e-b532-f4e8e284e2e5-kube-api-access-mvgfz\") pod \"maas-api-revoke-keys-e2e-worker-w2-efbac3-7rd5n\" (UID: \"91833992-e328-4b1e-b532-f4e8e284e2e5\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w2-efbac3-7rd5n"
Oct 30 20:08:51.673842 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:51.673743    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/91833992-e328-4b1e-b532-f4e8e284e2e5-maas-api-openshift-ca\") pod \"maas-api-revoke-keys-e2e-worker-w2-efbac3-7rd5n\" (UID: \"91833992-e328-4b1e-b532-f4e8e284e2e5\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w2-efbac3-7rd5n"
Oct 30 20:08:51.785971 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:51.785366    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/91833992-e328-4b1e-b532-f4e8e284e2e5-maas-api-xks-ca\") pod \"maas-api-revoke-keys-e2e-worker-w2-efbac3-7rd5n\" (UID: \"91833992-e328-4b1e-b532-f4e8e284e2e5\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w2-efbac3-7rd5n"
Oct 30 20:08:51.787516 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:51.787483    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mvgfz\" (UniqueName: \"kubernetes.io/projected/91833992-e328-4b1e-b532-f4e8e284e2e5-kube-api-access-mvgfz\") pod \"maas-api-revoke-keys-e2e-worker-w2-efbac3-7rd5n\" (UID: \"91833992-e328-4b1e-b532-f4e8e284e2e5\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w2-efbac3-7rd5n"
Oct 30 20:08:51.788126 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:51.788105    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/91833992-e328-4b1e-b532-f4e8e284e2e5-maas-api-openshift-ca\") pod \"maas-api-revoke-keys-e2e-worker-w2-efbac3-7rd5n\" (UID: \"91833992-e328-4b1e-b532-f4e8e284e2e5\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w2-efbac3-7rd5n"
Oct 30 20:08:51.792806 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:51.792779    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/91833992-e328-4b1e-b532-f4e8e284e2e5-maas-api-openshift-ca\") pod \"maas-api-revoke-keys-e2e-worker-w2-efbac3-7rd5n\" (UID: \"91833992-e328-4b1e-b532-f4e8e284e2e5\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w2-efbac3-7rd5n"
Oct 30 20:08:51.803367 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:51.803310    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/91833992-e328-4b1e-b532-f4e8e284e2e5-maas-api-xks-ca\") pod \"maas-api-revoke-keys-e2e-worker-w2-efbac3-7rd5n\" (UID: \"91833992-e328-4b1e-b532-f4e8e284e2e5\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w2-efbac3-7rd5n"
Oct 30 20:08:51.821184 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:51.821152    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mvgfz\" (UniqueName: \"kubernetes.io/projected/91833992-e328-4b1e-b532-f4e8e284e2e5-kube-api-access-mvgfz\") pod \"maas-api-revoke-keys-e2e-worker-w2-efbac3-7rd5n\" (UID: \"91833992-e328-4b1e-b532-f4e8e284e2e5\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w2-efbac3-7rd5n"
Oct 30 20:08:51.829316 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:51.829286    6275 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w2-efbac3-7rd5n"
Oct 30 20:08:52.151016 ip-10-0-131-26 kubenswrapper[6275]: W1030 20:08:52.150989    6275 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod91833992_e328_4b1e_b532_f4e8e284e2e5.slice/crio-3f990c8ad5711f487bb3598949f1502aad14b6edeb72b092d2cb70a4ebf48834 WatchSource:0}: Error finding container 3f990c8ad5711f487bb3598949f1502aad14b6edeb72b092d2cb70a4ebf48834: Status 404 returned error can't find the container with id 3f990c8ad5711f487bb3598949f1502aad14b6edeb72b092d2cb70a4ebf48834
Oct 30 20:08:52.151567 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:52.151540    6275 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w2-efbac3-7rd5n"]
Oct 30 20:08:52.439182 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:52.439110    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w2-efbac3-7rd5n" event={"ID":"91833992-e328-4b1e-b532-f4e8e284e2e5","Type":"ContainerStarted","Data":"3f990c8ad5711f487bb3598949f1502aad14b6edeb72b092d2cb70a4ebf48834"}
Oct 30 20:08:53.452978 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:53.452878    6275 generic.go:356] "Generic (PLEG): container finished" podID="91833992-e328-4b1e-b532-f4e8e284e2e5" containerID="738fac76776e2b60c9f488cdc58a76bef6b91118212496b4cb510e3e22166786" exitCode=0
Oct 30 20:08:53.453491 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:53.452971    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w2-efbac3-7rd5n" event={"ID":"91833992-e328-4b1e-b532-f4e8e284e2e5","Type":"ContainerDied","Data":"738fac76776e2b60c9f488cdc58a76bef6b91118212496b4cb510e3e22166786"}
Oct 30 20:08:54.172736 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:54.172697    6275 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-e456a47a-slmkd"]
Oct 30 20:08:54.177788 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:54.177759    6275 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-e456a47a-slmkd"
Oct 30 20:08:54.202043 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:54.202007    6275 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-e456a47a-slmkd"]
Oct 30 20:08:54.222982 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:54.222947    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/d866bc34-401f-412e-a16a-72328de246f4-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-e456a47a-slmkd\" (UID: \"d866bc34-401f-412e-a16a-72328de246f4\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-e456a47a-slmkd"
Oct 30 20:08:54.223158 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:54.223013    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-26cml\" (UniqueName: \"kubernetes.io/projected/d866bc34-401f-412e-a16a-72328de246f4-kube-api-access-26cml\") pod \"maas-api-revoke-sub-e456a47a-slmkd\" (UID: \"d866bc34-401f-412e-a16a-72328de246f4\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-e456a47a-slmkd"
Oct 30 20:08:54.223158 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:54.223079    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/d866bc34-401f-412e-a16a-72328de246f4-maas-api-xks-ca\") pod \"maas-api-revoke-sub-e456a47a-slmkd\" (UID: \"d866bc34-401f-412e-a16a-72328de246f4\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-e456a47a-slmkd"
Oct 30 20:08:54.324786 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:54.324753    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/d866bc34-401f-412e-a16a-72328de246f4-maas-api-xks-ca\") pod \"maas-api-revoke-sub-e456a47a-slmkd\" (UID: \"d866bc34-401f-412e-a16a-72328de246f4\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-e456a47a-slmkd"
Oct 30 20:08:54.324950 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:54.324877    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/d866bc34-401f-412e-a16a-72328de246f4-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-e456a47a-slmkd\" (UID: \"d866bc34-401f-412e-a16a-72328de246f4\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-e456a47a-slmkd"
Oct 30 20:08:54.324950 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:54.324911    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-26cml\" (UniqueName: \"kubernetes.io/projected/d866bc34-401f-412e-a16a-72328de246f4-kube-api-access-26cml\") pod \"maas-api-revoke-sub-e456a47a-slmkd\" (UID: \"d866bc34-401f-412e-a16a-72328de246f4\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-e456a47a-slmkd"
Oct 30 20:08:54.325656 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:54.325635    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/d866bc34-401f-412e-a16a-72328de246f4-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-e456a47a-slmkd\" (UID: \"d866bc34-401f-412e-a16a-72328de246f4\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-e456a47a-slmkd"
Oct 30 20:08:54.327260 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:54.327228    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/d866bc34-401f-412e-a16a-72328de246f4-maas-api-xks-ca\") pod \"maas-api-revoke-sub-e456a47a-slmkd\" (UID: \"d866bc34-401f-412e-a16a-72328de246f4\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-e456a47a-slmkd"
Oct 30 20:08:54.350364 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:54.350335    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-26cml\" (UniqueName: \"kubernetes.io/projected/d866bc34-401f-412e-a16a-72328de246f4-kube-api-access-26cml\") pod \"maas-api-revoke-sub-e456a47a-slmkd\" (UID: \"d866bc34-401f-412e-a16a-72328de246f4\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-e456a47a-slmkd"
Oct 30 20:08:54.502139 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:54.502103    6275 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-e456a47a-slmkd"
Oct 30 20:08:54.621755 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:54.621721    6275 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w2-efbac3-7rd5n"
Oct 30 20:08:54.729621 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:54.729548    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/91833992-e328-4b1e-b532-f4e8e284e2e5-kube-api-access-mvgfz\" (UniqueName: \"kubernetes.io/projected/91833992-e328-4b1e-b532-f4e8e284e2e5-kube-api-access-mvgfz\") pod \"91833992-e328-4b1e-b532-f4e8e284e2e5\" (UID: \"91833992-e328-4b1e-b532-f4e8e284e2e5\") "
Oct 30 20:08:54.729757 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:54.729665    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/91833992-e328-4b1e-b532-f4e8e284e2e5-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/91833992-e328-4b1e-b532-f4e8e284e2e5-maas-api-openshift-ca\") pod \"91833992-e328-4b1e-b532-f4e8e284e2e5\" (UID: \"91833992-e328-4b1e-b532-f4e8e284e2e5\") "
Oct 30 20:08:54.729757 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:54.729705    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/91833992-e328-4b1e-b532-f4e8e284e2e5-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/91833992-e328-4b1e-b532-f4e8e284e2e5-maas-api-xks-ca\") pod \"91833992-e328-4b1e-b532-f4e8e284e2e5\" (UID: \"91833992-e328-4b1e-b532-f4e8e284e2e5\") "
Oct 30 20:08:54.730016 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:54.729982    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/91833992-e328-4b1e-b532-f4e8e284e2e5-maas-api-openshift-ca" pod "91833992-e328-4b1e-b532-f4e8e284e2e5" (UID: "91833992-e328-4b1e-b532-f4e8e284e2e5"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:08:54.730252 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:54.730235    6275 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/91833992-e328-4b1e-b532-f4e8e284e2e5-maas-api-openshift-ca\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:08:54.731781 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:54.731761    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/91833992-e328-4b1e-b532-f4e8e284e2e5-maas-api-xks-ca" pod "91833992-e328-4b1e-b532-f4e8e284e2e5" (UID: "91833992-e328-4b1e-b532-f4e8e284e2e5"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 20:08:54.731843 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:54.731814    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/91833992-e328-4b1e-b532-f4e8e284e2e5-kube-api-access-mvgfz" pod "91833992-e328-4b1e-b532-f4e8e284e2e5" (UID: "91833992-e328-4b1e-b532-f4e8e284e2e5"). InnerVolumeSpecName "kube-api-access-mvgfz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:08:54.831350 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:54.831326    6275 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/91833992-e328-4b1e-b532-f4e8e284e2e5-maas-api-xks-ca\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:08:54.831469 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:54.831353    6275 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mvgfz\" (UniqueName: \"kubernetes.io/projected/91833992-e328-4b1e-b532-f4e8e284e2e5-kube-api-access-mvgfz\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:08:54.834127 ip-10-0-131-26 kubenswrapper[6275]: W1030 20:08:54.834099    6275 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd866bc34_401f_412e_a16a_72328de246f4.slice/crio-9cf95d1e5be7931c9b66dabfe5ab53039d4ddfa4aec857fd5efe4b3bf714d95c WatchSource:0}: Error finding container 9cf95d1e5be7931c9b66dabfe5ab53039d4ddfa4aec857fd5efe4b3bf714d95c: Status 404 returned error can't find the container with id 9cf95d1e5be7931c9b66dabfe5ab53039d4ddfa4aec857fd5efe4b3bf714d95c
Oct 30 20:08:54.834801 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:54.834759    6275 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-e456a47a-slmkd"]
Oct 30 20:08:55.468140 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:55.468102    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-e456a47a-slmkd" event={"ID":"d866bc34-401f-412e-a16a-72328de246f4","Type":"ContainerStarted","Data":"01767d5a810b557718fb39eb02da5c3f3d3f87d1fa95ecaf9a1329552cec4c1c"}
Oct 30 20:08:55.468325 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:55.468164    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-e456a47a-slmkd" event={"ID":"d866bc34-401f-412e-a16a-72328de246f4","Type":"ContainerStarted","Data":"9cf95d1e5be7931c9b66dabfe5ab53039d4ddfa4aec857fd5efe4b3bf714d95c"}
Oct 30 20:08:55.469762 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:55.469733    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w2-efbac3-7rd5n" event={"ID":"91833992-e328-4b1e-b532-f4e8e284e2e5","Type":"ContainerDied","Data":"3f990c8ad5711f487bb3598949f1502aad14b6edeb72b092d2cb70a4ebf48834"}
Oct 30 20:08:55.469762 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:55.469752    6275 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w2-efbac3-7rd5n"
Oct 30 20:08:55.469960 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:55.469775    6275 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3f990c8ad5711f487bb3598949f1502aad14b6edeb72b092d2cb70a4ebf48834"
Oct 30 20:08:55.515118 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:55.515065    6275 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-sub-e456a47a-slmkd" podStartSLOduration=1.515052824 podStartE2EDuration="1.515052824s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:08:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:08:55.512176284 +0000 UTC m=+1245.973903147" watchObservedRunningTime="2026-10-30 20:08:55.515052824 +0000 UTC m=+1245.976779678"
Oct 30 20:08:56.255200 ip-10-0-131-26 kubenswrapper[6275]: E1030 20:08:56.255162    6275 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-fwc77" containerName="extractor"
Oct 30 20:08:56.299354 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:56.299321    6275 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w2-efbac3/premium-w2-efbac3-kserve-55f54cfff6-9fqbz"]
Oct 30 20:08:56.478994 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:56.478955    6275 generic.go:356] "Generic (PLEG): container finished" podID="d866bc34-401f-412e-a16a-72328de246f4" containerID="01767d5a810b557718fb39eb02da5c3f3d3f87d1fa95ecaf9a1329552cec4c1c" exitCode=0
Oct 30 20:08:56.479175 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:56.479034    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-e456a47a-slmkd" event={"ID":"d866bc34-401f-412e-a16a-72328de246f4","Type":"ContainerDied","Data":"01767d5a810b557718fb39eb02da5c3f3d3f87d1fa95ecaf9a1329552cec4c1c"}
Oct 30 20:08:57.631251 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:57.631225    6275 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-e456a47a-slmkd"
Oct 30 20:08:57.660953 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:57.660927    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/d866bc34-401f-412e-a16a-72328de246f4-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/d866bc34-401f-412e-a16a-72328de246f4-maas-api-xks-ca\") pod \"d866bc34-401f-412e-a16a-72328de246f4\" (UID: \"d866bc34-401f-412e-a16a-72328de246f4\") "
Oct 30 20:08:57.661111 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:57.660964    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/d866bc34-401f-412e-a16a-72328de246f4-kube-api-access-26cml\" (UniqueName: \"kubernetes.io/projected/d866bc34-401f-412e-a16a-72328de246f4-kube-api-access-26cml\") pod \"d866bc34-401f-412e-a16a-72328de246f4\" (UID: \"d866bc34-401f-412e-a16a-72328de246f4\") "
Oct 30 20:08:57.661111 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:57.661090    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/d866bc34-401f-412e-a16a-72328de246f4-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/d866bc34-401f-412e-a16a-72328de246f4-maas-api-openshift-ca\") pod \"d866bc34-401f-412e-a16a-72328de246f4\" (UID: \"d866bc34-401f-412e-a16a-72328de246f4\") "
Oct 30 20:08:57.661441 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:57.661388    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d866bc34-401f-412e-a16a-72328de246f4-maas-api-openshift-ca" pod "d866bc34-401f-412e-a16a-72328de246f4" (UID: "d866bc34-401f-412e-a16a-72328de246f4"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:08:57.663007 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:57.662979    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d866bc34-401f-412e-a16a-72328de246f4-maas-api-xks-ca" pod "d866bc34-401f-412e-a16a-72328de246f4" (UID: "d866bc34-401f-412e-a16a-72328de246f4"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 20:08:57.663007 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:57.662983    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d866bc34-401f-412e-a16a-72328de246f4-kube-api-access-26cml" pod "d866bc34-401f-412e-a16a-72328de246f4" (UID: "d866bc34-401f-412e-a16a-72328de246f4"). InnerVolumeSpecName "kube-api-access-26cml". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:08:57.762040 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:57.761964    6275 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/d866bc34-401f-412e-a16a-72328de246f4-maas-api-xks-ca\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:08:57.762040 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:57.761994    6275 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-26cml\" (UniqueName: \"kubernetes.io/projected/d866bc34-401f-412e-a16a-72328de246f4-kube-api-access-26cml\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:08:57.762040 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:57.762005    6275 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/d866bc34-401f-412e-a16a-72328de246f4-maas-api-openshift-ca\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:08:58.495537 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:58.495508    6275 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-e456a47a-slmkd"
Oct 30 20:08:58.495811 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:58.495541    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-e456a47a-slmkd" event={"ID":"d866bc34-401f-412e-a16a-72328de246f4","Type":"ContainerDied","Data":"9cf95d1e5be7931c9b66dabfe5ab53039d4ddfa4aec857fd5efe4b3bf714d95c"}
Oct 30 20:08:58.495811 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:08:58.495601    6275 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9cf95d1e5be7931c9b66dabfe5ab53039d4ddfa4aec857fd5efe4b3bf714d95c"
Oct 30 20:09:00.395544 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:00.395484    6275 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w6-51dd62/distinct-2-w6-51dd62-kserve-79ff99c4cd-fvmb6" podUID="9ed906a7-869d-4314-9976-f50b78a6565b" containerName="main" containerID="cri-o://d8285cd3305c98f6419d7151ac7bc70df5b319f58ab6b4e0bd90c4bebaa23e96" gracePeriod=45
Oct 30 20:09:00.427516 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:00.427465    6275 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w6-51dd62/simulator-w6-51dd62-kserve-d6bb4985f-65j9h" podUID="f7e1ff07-15d6-49b5-8edc-52c9d6825ed7" containerName="main" containerID="cri-o://c5d8ba8404b5f50c087a98387f19229313ad69d2ff0c0963d2c1474718866d55" gracePeriod=45
Oct 30 20:09:00.511699 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:00.511669    6275 generic.go:356] "Generic (PLEG): container finished" podID="9ed906a7-869d-4314-9976-f50b78a6565b" containerID="d8285cd3305c98f6419d7151ac7bc70df5b319f58ab6b4e0bd90c4bebaa23e96" exitCode=0
Oct 30 20:09:00.511822 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:00.511738    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w6-51dd62/distinct-2-w6-51dd62-kserve-79ff99c4cd-fvmb6" event={"ID":"9ed906a7-869d-4314-9976-f50b78a6565b","Type":"ContainerDied","Data":"d8285cd3305c98f6419d7151ac7bc70df5b319f58ab6b4e0bd90c4bebaa23e96"}
Oct 30 20:09:00.692245 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:00.692207    6275 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w6-51dd62/distinct-2-w6-51dd62-kserve-79ff99c4cd-fvmb6"
Oct 30 20:09:00.719087 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:00.719065    6275 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w6-51dd62/simulator-w6-51dd62-kserve-d6bb4985f-65j9h"
Oct 30 20:09:00.797493 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:00.797453    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f7e1ff07-15d6-49b5-8edc-52c9d6825ed7-dshm\" (UniqueName: \"kubernetes.io/empty-dir/f7e1ff07-15d6-49b5-8edc-52c9d6825ed7-dshm\") pod \"f7e1ff07-15d6-49b5-8edc-52c9d6825ed7\" (UID: \"f7e1ff07-15d6-49b5-8edc-52c9d6825ed7\") "
Oct 30 20:09:00.797493 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:00.797490    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9ed906a7-869d-4314-9976-f50b78a6565b-dshm\" (UniqueName: \"kubernetes.io/empty-dir/9ed906a7-869d-4314-9976-f50b78a6565b-dshm\") pod \"9ed906a7-869d-4314-9976-f50b78a6565b\" (UID: \"9ed906a7-869d-4314-9976-f50b78a6565b\") "
Oct 30 20:09:00.797737 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:00.797525    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/f7e1ff07-15d6-49b5-8edc-52c9d6825ed7-kube-api-access-5sbb4\" (UniqueName: \"kubernetes.io/projected/f7e1ff07-15d6-49b5-8edc-52c9d6825ed7-kube-api-access-5sbb4\") pod \"f7e1ff07-15d6-49b5-8edc-52c9d6825ed7\" (UID: \"f7e1ff07-15d6-49b5-8edc-52c9d6825ed7\") "
Oct 30 20:09:00.797737 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:00.797572    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f7e1ff07-15d6-49b5-8edc-52c9d6825ed7-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f7e1ff07-15d6-49b5-8edc-52c9d6825ed7-model-cache\") pod \"f7e1ff07-15d6-49b5-8edc-52c9d6825ed7\" (UID: \"f7e1ff07-15d6-49b5-8edc-52c9d6825ed7\") "
Oct 30 20:09:00.797737 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:00.797620    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/9ed906a7-869d-4314-9976-f50b78a6565b-tls-certs\" (UniqueName: \"kubernetes.io/secret/9ed906a7-869d-4314-9976-f50b78a6565b-tls-certs\") pod \"9ed906a7-869d-4314-9976-f50b78a6565b\" (UID: \"9ed906a7-869d-4314-9976-f50b78a6565b\") "
Oct 30 20:09:00.797737 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:00.797714    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/9ed906a7-869d-4314-9976-f50b78a6565b-kube-api-access-spncw\" (UniqueName: \"kubernetes.io/projected/9ed906a7-869d-4314-9976-f50b78a6565b-kube-api-access-spncw\") pod \"9ed906a7-869d-4314-9976-f50b78a6565b\" (UID: \"9ed906a7-869d-4314-9976-f50b78a6565b\") "
Oct 30 20:09:00.797962 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:00.797762    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/f7e1ff07-15d6-49b5-8edc-52c9d6825ed7-tls-certs\" (UniqueName: \"kubernetes.io/secret/f7e1ff07-15d6-49b5-8edc-52c9d6825ed7-tls-certs\") pod \"f7e1ff07-15d6-49b5-8edc-52c9d6825ed7\" (UID: \"f7e1ff07-15d6-49b5-8edc-52c9d6825ed7\") "
Oct 30 20:09:00.797962 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:00.797804    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9ed906a7-869d-4314-9976-f50b78a6565b-home\" (UniqueName: \"kubernetes.io/empty-dir/9ed906a7-869d-4314-9976-f50b78a6565b-home\") pod \"9ed906a7-869d-4314-9976-f50b78a6565b\" (UID: \"9ed906a7-869d-4314-9976-f50b78a6565b\") "
Oct 30 20:09:00.797962 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:00.797857    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f7e1ff07-15d6-49b5-8edc-52c9d6825ed7-home\" (UniqueName: \"kubernetes.io/empty-dir/f7e1ff07-15d6-49b5-8edc-52c9d6825ed7-home\") pod \"f7e1ff07-15d6-49b5-8edc-52c9d6825ed7\" (UID: \"f7e1ff07-15d6-49b5-8edc-52c9d6825ed7\") "
Oct 30 20:09:00.797962 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:00.797905    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9ed906a7-869d-4314-9976-f50b78a6565b-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9ed906a7-869d-4314-9976-f50b78a6565b-tmp-dir\") pod \"9ed906a7-869d-4314-9976-f50b78a6565b\" (UID: \"9ed906a7-869d-4314-9976-f50b78a6565b\") "
Oct 30 20:09:00.797962 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:00.797947    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f7e1ff07-15d6-49b5-8edc-52c9d6825ed7-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f7e1ff07-15d6-49b5-8edc-52c9d6825ed7-tmp-dir\") pod \"f7e1ff07-15d6-49b5-8edc-52c9d6825ed7\" (UID: \"f7e1ff07-15d6-49b5-8edc-52c9d6825ed7\") "
Oct 30 20:09:00.798209 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:00.797983    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f7e1ff07-15d6-49b5-8edc-52c9d6825ed7-model-cache" pod "f7e1ff07-15d6-49b5-8edc-52c9d6825ed7" (UID: "f7e1ff07-15d6-49b5-8edc-52c9d6825ed7"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:09:00.798209 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:00.798012    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9ed906a7-869d-4314-9976-f50b78a6565b-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9ed906a7-869d-4314-9976-f50b78a6565b-model-cache\") pod \"9ed906a7-869d-4314-9976-f50b78a6565b\" (UID: \"9ed906a7-869d-4314-9976-f50b78a6565b\") "
Oct 30 20:09:00.798209 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:00.798182    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f7e1ff07-15d6-49b5-8edc-52c9d6825ed7-home" pod "f7e1ff07-15d6-49b5-8edc-52c9d6825ed7" (UID: "f7e1ff07-15d6-49b5-8edc-52c9d6825ed7"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:09:00.798430 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:00.798394    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9ed906a7-869d-4314-9976-f50b78a6565b-model-cache" pod "9ed906a7-869d-4314-9976-f50b78a6565b" (UID: "9ed906a7-869d-4314-9976-f50b78a6565b"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:09:00.798677 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:00.798547    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9ed906a7-869d-4314-9976-f50b78a6565b-tmp-dir" pod "9ed906a7-869d-4314-9976-f50b78a6565b" (UID: "9ed906a7-869d-4314-9976-f50b78a6565b"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:09:00.798677 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:00.798640    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f7e1ff07-15d6-49b5-8edc-52c9d6825ed7-tmp-dir" pod "f7e1ff07-15d6-49b5-8edc-52c9d6825ed7" (UID: "f7e1ff07-15d6-49b5-8edc-52c9d6825ed7"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:09:00.798859 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:00.798723    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9ed906a7-869d-4314-9976-f50b78a6565b-home" pod "9ed906a7-869d-4314-9976-f50b78a6565b" (UID: "9ed906a7-869d-4314-9976-f50b78a6565b"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:09:00.798859 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:00.798829    6275 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f7e1ff07-15d6-49b5-8edc-52c9d6825ed7-tmp-dir\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:09:00.798859 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:00.798850    6275 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9ed906a7-869d-4314-9976-f50b78a6565b-model-cache\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:09:00.799032 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:00.798865    6275 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f7e1ff07-15d6-49b5-8edc-52c9d6825ed7-model-cache\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:09:00.799032 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:00.798877    6275 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f7e1ff07-15d6-49b5-8edc-52c9d6825ed7-home\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:09:00.799032 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:00.798891    6275 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9ed906a7-869d-4314-9976-f50b78a6565b-tmp-dir\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:09:00.801313 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:00.801274    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f7e1ff07-15d6-49b5-8edc-52c9d6825ed7-tls-certs" pod "f7e1ff07-15d6-49b5-8edc-52c9d6825ed7" (UID: "f7e1ff07-15d6-49b5-8edc-52c9d6825ed7"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 20:09:00.802781 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:00.802753    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9ed906a7-869d-4314-9976-f50b78a6565b-kube-api-access-spncw" pod "9ed906a7-869d-4314-9976-f50b78a6565b" (UID: "9ed906a7-869d-4314-9976-f50b78a6565b"). InnerVolumeSpecName "kube-api-access-spncw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:09:00.804102 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:00.804080    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9ed906a7-869d-4314-9976-f50b78a6565b-tls-certs" pod "9ed906a7-869d-4314-9976-f50b78a6565b" (UID: "9ed906a7-869d-4314-9976-f50b78a6565b"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 20:09:00.804757 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:00.804730    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f7e1ff07-15d6-49b5-8edc-52c9d6825ed7-dshm" pod "f7e1ff07-15d6-49b5-8edc-52c9d6825ed7" (UID: "f7e1ff07-15d6-49b5-8edc-52c9d6825ed7"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:09:00.804757 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:00.804742    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9ed906a7-869d-4314-9976-f50b78a6565b-dshm" pod "9ed906a7-869d-4314-9976-f50b78a6565b" (UID: "9ed906a7-869d-4314-9976-f50b78a6565b"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:09:00.805901 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:00.805877    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f7e1ff07-15d6-49b5-8edc-52c9d6825ed7-kube-api-access-5sbb4" pod "f7e1ff07-15d6-49b5-8edc-52c9d6825ed7" (UID: "f7e1ff07-15d6-49b5-8edc-52c9d6825ed7"). InnerVolumeSpecName "kube-api-access-5sbb4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:09:00.899643 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:00.899611    6275 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-spncw\" (UniqueName: \"kubernetes.io/projected/9ed906a7-869d-4314-9976-f50b78a6565b-kube-api-access-spncw\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:09:00.899643 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:00.899637    6275 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f7e1ff07-15d6-49b5-8edc-52c9d6825ed7-tls-certs\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:09:00.899643 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:00.899649    6275 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9ed906a7-869d-4314-9976-f50b78a6565b-home\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:09:00.899878 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:00.899657    6275 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f7e1ff07-15d6-49b5-8edc-52c9d6825ed7-dshm\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:09:00.899878 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:00.899666    6275 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9ed906a7-869d-4314-9976-f50b78a6565b-dshm\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:09:00.899878 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:00.899676    6275 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5sbb4\" (UniqueName: \"kubernetes.io/projected/f7e1ff07-15d6-49b5-8edc-52c9d6825ed7-kube-api-access-5sbb4\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:09:00.899878 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:00.899683    6275 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9ed906a7-869d-4314-9976-f50b78a6565b-tls-certs\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:09:01.520643 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:01.520607    6275 generic.go:356] "Generic (PLEG): container finished" podID="f7e1ff07-15d6-49b5-8edc-52c9d6825ed7" containerID="c5d8ba8404b5f50c087a98387f19229313ad69d2ff0c0963d2c1474718866d55" exitCode=0
Oct 30 20:09:01.521159 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:01.520671    6275 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w6-51dd62/simulator-w6-51dd62-kserve-d6bb4985f-65j9h"
Oct 30 20:09:01.521159 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:01.520704    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w6-51dd62/simulator-w6-51dd62-kserve-d6bb4985f-65j9h" event={"ID":"f7e1ff07-15d6-49b5-8edc-52c9d6825ed7","Type":"ContainerDied","Data":"c5d8ba8404b5f50c087a98387f19229313ad69d2ff0c0963d2c1474718866d55"}
Oct 30 20:09:01.521159 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:01.520757    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w6-51dd62/simulator-w6-51dd62-kserve-d6bb4985f-65j9h" event={"ID":"f7e1ff07-15d6-49b5-8edc-52c9d6825ed7","Type":"ContainerDied","Data":"f3a02212067bec433b1e33b835256714670fd18b59b3cf43e766238e0ffe8cd5"}
Oct 30 20:09:01.521159 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:01.520785    6275 scope.go:122] "RemoveContainer" containerID="c5d8ba8404b5f50c087a98387f19229313ad69d2ff0c0963d2c1474718866d55"
Oct 30 20:09:01.523161 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:01.523139    6275 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w6-51dd62/distinct-2-w6-51dd62-kserve-79ff99c4cd-fvmb6"
Oct 30 20:09:01.523300 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:01.523136    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w6-51dd62/distinct-2-w6-51dd62-kserve-79ff99c4cd-fvmb6" event={"ID":"9ed906a7-869d-4314-9976-f50b78a6565b","Type":"ContainerDied","Data":"30700f04dd2312ffd11d04dda93a9ec3b29fa5eb3207333d3bac4f2e15b4aa1d"}
Oct 30 20:09:01.545194 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:01.545169    6275 scope.go:122] "RemoveContainer" containerID="c5d8ba8404b5f50c087a98387f19229313ad69d2ff0c0963d2c1474718866d55"
Oct 30 20:09:01.545555 ip-10-0-131-26 kubenswrapper[6275]: E1030 20:09:01.545533    6275 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c5d8ba8404b5f50c087a98387f19229313ad69d2ff0c0963d2c1474718866d55\": container with ID starting with c5d8ba8404b5f50c087a98387f19229313ad69d2ff0c0963d2c1474718866d55 not found: ID does not exist" containerID="c5d8ba8404b5f50c087a98387f19229313ad69d2ff0c0963d2c1474718866d55"
Oct 30 20:09:01.545631 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:01.545563    6275 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c5d8ba8404b5f50c087a98387f19229313ad69d2ff0c0963d2c1474718866d55"} err="failed to get container status \"c5d8ba8404b5f50c087a98387f19229313ad69d2ff0c0963d2c1474718866d55\": rpc error: code = NotFound desc = could not find container \"c5d8ba8404b5f50c087a98387f19229313ad69d2ff0c0963d2c1474718866d55\": container with ID starting with c5d8ba8404b5f50c087a98387f19229313ad69d2ff0c0963d2c1474718866d55 not found: ID does not exist"
Oct 30 20:09:01.545631 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:01.545582    6275 scope.go:122] "RemoveContainer" containerID="d8285cd3305c98f6419d7151ac7bc70df5b319f58ab6b4e0bd90c4bebaa23e96"
Oct 30 20:09:01.594536 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:01.594507    6275 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w6-51dd62/simulator-w6-51dd62-kserve-d6bb4985f-65j9h"]
Oct 30 20:09:01.606471 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:01.606437    6275 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w6-51dd62/simulator-w6-51dd62-kserve-d6bb4985f-65j9h"]
Oct 30 20:09:01.637056 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:01.637020    6275 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w6-51dd62/distinct-2-w6-51dd62-kserve-79ff99c4cd-fvmb6"]
Oct 30 20:09:01.649612 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:01.649580    6275 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w6-51dd62/distinct-2-w6-51dd62-kserve-79ff99c4cd-fvmb6"]
Oct 30 20:09:01.656278 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:01.656250    6275 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="9ed906a7-869d-4314-9976-f50b78a6565b" path="/var/lib/kubelet/pods/9ed906a7-869d-4314-9976-f50b78a6565b/volumes"
Oct 30 20:09:01.656718 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:01.656703    6275 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="f7e1ff07-15d6-49b5-8edc-52c9d6825ed7" path="/var/lib/kubelet/pods/f7e1ff07-15d6-49b5-8edc-52c9d6825ed7/volumes"
Oct 30 20:09:01.979474 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:01.979438    6275 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w2-efbac3-7bbf454b5c-w9rzj"]
Oct 30 20:09:03.784431 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:03.784375    6275 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-03fa6844-dx2t4"]
Oct 30 20:09:03.785091 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:03.785068    6275 cpu_manager.go:414] "containerMap: removing container" podUID="9ed906a7-869d-4314-9976-f50b78a6565b" containerName="main"
Oct 30 20:09:03.785192 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:03.785092    6275 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="9ed906a7-869d-4314-9976-f50b78a6565b" containerName="main"
Oct 30 20:09:03.785192 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:03.785112    6275 cpu_manager.go:414] "containerMap: removing container" podUID="f7e1ff07-15d6-49b5-8edc-52c9d6825ed7" containerName="main"
Oct 30 20:09:03.785192 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:03.785120    6275 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="f7e1ff07-15d6-49b5-8edc-52c9d6825ed7" containerName="main"
Oct 30 20:09:03.785192 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:03.785151    6275 cpu_manager.go:414] "containerMap: removing container" podUID="91833992-e328-4b1e-b532-f4e8e284e2e5" containerName="revoke-keys"
Oct 30 20:09:03.785192 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:03.785160    6275 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="91833992-e328-4b1e-b532-f4e8e284e2e5" containerName="revoke-keys"
Oct 30 20:09:03.785192 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:03.785190    6275 cpu_manager.go:414] "containerMap: removing container" podUID="d866bc34-401f-412e-a16a-72328de246f4" containerName="revoke-keys"
Oct 30 20:09:03.785544 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:03.785197    6275 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="d866bc34-401f-412e-a16a-72328de246f4" containerName="revoke-keys"
Oct 30 20:09:03.785544 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:03.785401    6275 memory_manager.go:365] "RemoveStaleState removing state" podUID="d866bc34-401f-412e-a16a-72328de246f4" containerName="revoke-keys"
Oct 30 20:09:03.785544 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:03.785435    6275 memory_manager.go:365] "RemoveStaleState removing state" podUID="9ed906a7-869d-4314-9976-f50b78a6565b" containerName="main"
Oct 30 20:09:03.785544 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:03.785445    6275 memory_manager.go:365] "RemoveStaleState removing state" podUID="f7e1ff07-15d6-49b5-8edc-52c9d6825ed7" containerName="main"
Oct 30 20:09:03.785544 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:03.785458    6275 memory_manager.go:365] "RemoveStaleState removing state" podUID="91833992-e328-4b1e-b532-f4e8e284e2e5" containerName="revoke-keys"
Oct 30 20:09:03.790551 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:03.790529    6275 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-03fa6844-dx2t4"
Oct 30 20:09:03.819142 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:03.819113    6275 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-03fa6844-dx2t4"]
Oct 30 20:09:03.826522 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:03.826493    6275 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\""
Oct 30 20:09:03.826649 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:03.826574    6275 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-scs2w\""
Oct 30 20:09:03.833145 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:03.833120    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/0a672bb2-1f1b-4ec3-a67f-28b288eaa651-maas-api-xks-ca\") pod \"maas-api-revoke-sub-03fa6844-dx2t4\" (UID: \"0a672bb2-1f1b-4ec3-a67f-28b288eaa651\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-03fa6844-dx2t4"
Oct 30 20:09:03.833245 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:03.833153    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lwrtx\" (UniqueName: \"kubernetes.io/projected/0a672bb2-1f1b-4ec3-a67f-28b288eaa651-kube-api-access-lwrtx\") pod \"maas-api-revoke-sub-03fa6844-dx2t4\" (UID: \"0a672bb2-1f1b-4ec3-a67f-28b288eaa651\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-03fa6844-dx2t4"
Oct 30 20:09:03.833300 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:03.833285    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/0a672bb2-1f1b-4ec3-a67f-28b288eaa651-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-03fa6844-dx2t4\" (UID: \"0a672bb2-1f1b-4ec3-a67f-28b288eaa651\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-03fa6844-dx2t4"
Oct 30 20:09:03.934551 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:03.934513    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/0a672bb2-1f1b-4ec3-a67f-28b288eaa651-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-03fa6844-dx2t4\" (UID: \"0a672bb2-1f1b-4ec3-a67f-28b288eaa651\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-03fa6844-dx2t4"
Oct 30 20:09:03.934755 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:03.934632    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/0a672bb2-1f1b-4ec3-a67f-28b288eaa651-maas-api-xks-ca\") pod \"maas-api-revoke-sub-03fa6844-dx2t4\" (UID: \"0a672bb2-1f1b-4ec3-a67f-28b288eaa651\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-03fa6844-dx2t4"
Oct 30 20:09:03.934755 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:03.934660    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lwrtx\" (UniqueName: \"kubernetes.io/projected/0a672bb2-1f1b-4ec3-a67f-28b288eaa651-kube-api-access-lwrtx\") pod \"maas-api-revoke-sub-03fa6844-dx2t4\" (UID: \"0a672bb2-1f1b-4ec3-a67f-28b288eaa651\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-03fa6844-dx2t4"
Oct 30 20:09:03.935147 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:03.935122    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/0a672bb2-1f1b-4ec3-a67f-28b288eaa651-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-03fa6844-dx2t4\" (UID: \"0a672bb2-1f1b-4ec3-a67f-28b288eaa651\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-03fa6844-dx2t4"
Oct 30 20:09:03.937007 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:03.936977    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/0a672bb2-1f1b-4ec3-a67f-28b288eaa651-maas-api-xks-ca\") pod \"maas-api-revoke-sub-03fa6844-dx2t4\" (UID: \"0a672bb2-1f1b-4ec3-a67f-28b288eaa651\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-03fa6844-dx2t4"
Oct 30 20:09:03.961777 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:03.961754    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lwrtx\" (UniqueName: \"kubernetes.io/projected/0a672bb2-1f1b-4ec3-a67f-28b288eaa651-kube-api-access-lwrtx\") pod \"maas-api-revoke-sub-03fa6844-dx2t4\" (UID: \"0a672bb2-1f1b-4ec3-a67f-28b288eaa651\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-03fa6844-dx2t4"
Oct 30 20:09:04.104144 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:04.104056    6275 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-03fa6844-dx2t4"
Oct 30 20:09:04.412739 ip-10-0-131-26 kubenswrapper[6275]: W1030 20:09:04.412706    6275 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0a672bb2_1f1b_4ec3_a67f_28b288eaa651.slice/crio-7d17625878e229bdca8d602e1bc868ef824dbfda97b0c8d918e3ea179e374ed6 WatchSource:0}: Error finding container 7d17625878e229bdca8d602e1bc868ef824dbfda97b0c8d918e3ea179e374ed6: Status 404 returned error can't find the container with id 7d17625878e229bdca8d602e1bc868ef824dbfda97b0c8d918e3ea179e374ed6
Oct 30 20:09:04.412859 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:04.412826    6275 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-03fa6844-dx2t4"]
Oct 30 20:09:04.548179 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:04.548144    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-03fa6844-dx2t4" event={"ID":"0a672bb2-1f1b-4ec3-a67f-28b288eaa651","Type":"ContainerStarted","Data":"7d17625878e229bdca8d602e1bc868ef824dbfda97b0c8d918e3ea179e374ed6"}
Oct 30 20:09:05.557697 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:05.557600    6275 generic.go:356] "Generic (PLEG): container finished" podID="0a672bb2-1f1b-4ec3-a67f-28b288eaa651" containerID="71299610d34ec54db12c15e96ad69c9ac98952c6b441a37cca8db3ea89a424e9" exitCode=0
Oct 30 20:09:05.558064 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:05.557686    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-03fa6844-dx2t4" event={"ID":"0a672bb2-1f1b-4ec3-a67f-28b288eaa651","Type":"ContainerDied","Data":"71299610d34ec54db12c15e96ad69c9ac98952c6b441a37cca8db3ea89a424e9"}
Oct 30 20:09:06.709109 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:06.709085    6275 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-03fa6844-dx2t4"
Oct 30 20:09:06.765679 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:06.765644    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/0a672bb2-1f1b-4ec3-a67f-28b288eaa651-kube-api-access-lwrtx\" (UniqueName: \"kubernetes.io/projected/0a672bb2-1f1b-4ec3-a67f-28b288eaa651-kube-api-access-lwrtx\") pod \"0a672bb2-1f1b-4ec3-a67f-28b288eaa651\" (UID: \"0a672bb2-1f1b-4ec3-a67f-28b288eaa651\") "
Oct 30 20:09:06.765840 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:06.765701    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/0a672bb2-1f1b-4ec3-a67f-28b288eaa651-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/0a672bb2-1f1b-4ec3-a67f-28b288eaa651-maas-api-openshift-ca\") pod \"0a672bb2-1f1b-4ec3-a67f-28b288eaa651\" (UID: \"0a672bb2-1f1b-4ec3-a67f-28b288eaa651\") "
Oct 30 20:09:06.765840 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:06.765814    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/0a672bb2-1f1b-4ec3-a67f-28b288eaa651-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/0a672bb2-1f1b-4ec3-a67f-28b288eaa651-maas-api-xks-ca\") pod \"0a672bb2-1f1b-4ec3-a67f-28b288eaa651\" (UID: \"0a672bb2-1f1b-4ec3-a67f-28b288eaa651\") "
Oct 30 20:09:06.766028 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:06.766001    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0a672bb2-1f1b-4ec3-a67f-28b288eaa651-maas-api-openshift-ca" pod "0a672bb2-1f1b-4ec3-a67f-28b288eaa651" (UID: "0a672bb2-1f1b-4ec3-a67f-28b288eaa651"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:09:06.766956 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:06.766566    6275 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/0a672bb2-1f1b-4ec3-a67f-28b288eaa651-maas-api-openshift-ca\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:09:06.771564 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:06.771537    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0a672bb2-1f1b-4ec3-a67f-28b288eaa651-maas-api-xks-ca" pod "0a672bb2-1f1b-4ec3-a67f-28b288eaa651" (UID: "0a672bb2-1f1b-4ec3-a67f-28b288eaa651"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 20:09:06.771564 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:06.771543    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0a672bb2-1f1b-4ec3-a67f-28b288eaa651-kube-api-access-lwrtx" pod "0a672bb2-1f1b-4ec3-a67f-28b288eaa651" (UID: "0a672bb2-1f1b-4ec3-a67f-28b288eaa651"). InnerVolumeSpecName "kube-api-access-lwrtx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:09:06.868398 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:06.867898    6275 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/0a672bb2-1f1b-4ec3-a67f-28b288eaa651-maas-api-xks-ca\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:09:06.868398 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:06.867935    6275 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lwrtx\" (UniqueName: \"kubernetes.io/projected/0a672bb2-1f1b-4ec3-a67f-28b288eaa651-kube-api-access-lwrtx\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:09:06.980657 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:06.980593    6275 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-worker-w2-efbac3-7bbf454b5c-w9rzj" podUID="186a15c4-0926-472b-9524-ea6f2d31f30f" containerName="payload-processing" containerID="cri-o://4a9be1bcfb637a86d2a2d2c0f855a4eacd18d605b8a13c6012498fa9b93ccb91" gracePeriod=25
Oct 30 20:09:07.573829 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:07.573796    6275 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-03fa6844-dx2t4"
Oct 30 20:09:07.573829 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:07.573807    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-03fa6844-dx2t4" event={"ID":"0a672bb2-1f1b-4ec3-a67f-28b288eaa651","Type":"ContainerDied","Data":"7d17625878e229bdca8d602e1bc868ef824dbfda97b0c8d918e3ea179e374ed6"}
Oct 30 20:09:07.574062 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:07.573905    6275 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7d17625878e229bdca8d602e1bc868ef824dbfda97b0c8d918e3ea179e374ed6"
Oct 30 20:09:10.389024 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:10.388988    6275 scope.go:122] "RemoveContainer" containerID="810f4ae687e7c30a6a77e6856326abf3f4c897783400a635f3dc1280d6817200"
Oct 30 20:09:10.399595 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:10.399572    6275 scope.go:122] "RemoveContainer" containerID="9f79166d8ef4adb09cc287afd675ad768518add6f17583a4990f230a7fce8a00"
Oct 30 20:09:10.408851 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:10.408831    6275 scope.go:122] "RemoveContainer" containerID="f5dd9096c7d76229c4e3873090d5b4eebc2520219628c5d54b7ed3663bce31e7"
Oct 30 20:09:10.417620 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:10.417597    6275 scope.go:122] "RemoveContainer" containerID="33662fc27dc5bb65c7357ae7c20ce21878404aa91f6d106390a4608942c84ec4"
Oct 30 20:09:11.320627 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:11.320583    6275 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w2-efbac3/premium-w2-efbac3-kserve-55f54cfff6-9fqbz" podUID="083136dc-91fb-454f-a782-87b004e73d1b" containerName="main" containerID="cri-o://14dd77b19cf39114c3725ceb98eecefdb747ddd4b7a33721f4fbb6641f0825ed" gracePeriod=45
Oct 30 20:09:11.574338 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:11.574288    6275 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w2-efbac3/premium-w2-efbac3-kserve-55f54cfff6-9fqbz"
Oct 30 20:09:11.633475 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:11.633401    6275 generic.go:356] "Generic (PLEG): container finished" podID="083136dc-91fb-454f-a782-87b004e73d1b" containerID="14dd77b19cf39114c3725ceb98eecefdb747ddd4b7a33721f4fbb6641f0825ed" exitCode=0
Oct 30 20:09:11.633735 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:11.633482    6275 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w2-efbac3/premium-w2-efbac3-kserve-55f54cfff6-9fqbz"
Oct 30 20:09:11.633855 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:11.633501    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w2-efbac3/premium-w2-efbac3-kserve-55f54cfff6-9fqbz" event={"ID":"083136dc-91fb-454f-a782-87b004e73d1b","Type":"ContainerDied","Data":"14dd77b19cf39114c3725ceb98eecefdb747ddd4b7a33721f4fbb6641f0825ed"}
Oct 30 20:09:11.633926 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:11.633877    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w2-efbac3/premium-w2-efbac3-kserve-55f54cfff6-9fqbz" event={"ID":"083136dc-91fb-454f-a782-87b004e73d1b","Type":"ContainerDied","Data":"e0c0a2231c04d1d32acaffe32be1e94517977a5b09959f143d9b5e2aeb9bfb1b"}
Oct 30 20:09:11.633926 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:11.633907    6275 scope.go:122] "RemoveContainer" containerID="14dd77b19cf39114c3725ceb98eecefdb747ddd4b7a33721f4fbb6641f0825ed"
Oct 30 20:09:11.645470 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:11.645452    6275 scope.go:122] "RemoveContainer" containerID="14dd77b19cf39114c3725ceb98eecefdb747ddd4b7a33721f4fbb6641f0825ed"
Oct 30 20:09:11.645765 ip-10-0-131-26 kubenswrapper[6275]: E1030 20:09:11.645737    6275 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"14dd77b19cf39114c3725ceb98eecefdb747ddd4b7a33721f4fbb6641f0825ed\": container with ID starting with 14dd77b19cf39114c3725ceb98eecefdb747ddd4b7a33721f4fbb6641f0825ed not found: ID does not exist" containerID="14dd77b19cf39114c3725ceb98eecefdb747ddd4b7a33721f4fbb6641f0825ed"
Oct 30 20:09:11.645871 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:11.645771    6275 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"14dd77b19cf39114c3725ceb98eecefdb747ddd4b7a33721f4fbb6641f0825ed"} err="failed to get container status \"14dd77b19cf39114c3725ceb98eecefdb747ddd4b7a33721f4fbb6641f0825ed\": rpc error: code = NotFound desc = could not find container \"14dd77b19cf39114c3725ceb98eecefdb747ddd4b7a33721f4fbb6641f0825ed\": container with ID starting with 14dd77b19cf39114c3725ceb98eecefdb747ddd4b7a33721f4fbb6641f0825ed not found: ID does not exist"
Oct 30 20:09:11.680058 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:11.680023    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/083136dc-91fb-454f-a782-87b004e73d1b-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/083136dc-91fb-454f-a782-87b004e73d1b-tmp-dir\") pod \"083136dc-91fb-454f-a782-87b004e73d1b\" (UID: \"083136dc-91fb-454f-a782-87b004e73d1b\") "
Oct 30 20:09:11.680207 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:11.680072    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/083136dc-91fb-454f-a782-87b004e73d1b-dshm\" (UniqueName: \"kubernetes.io/empty-dir/083136dc-91fb-454f-a782-87b004e73d1b-dshm\") pod \"083136dc-91fb-454f-a782-87b004e73d1b\" (UID: \"083136dc-91fb-454f-a782-87b004e73d1b\") "
Oct 30 20:09:11.680207 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:11.680102    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/083136dc-91fb-454f-a782-87b004e73d1b-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/083136dc-91fb-454f-a782-87b004e73d1b-model-cache\") pod \"083136dc-91fb-454f-a782-87b004e73d1b\" (UID: \"083136dc-91fb-454f-a782-87b004e73d1b\") "
Oct 30 20:09:11.680207 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:11.680181    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/083136dc-91fb-454f-a782-87b004e73d1b-kube-api-access-6r794\" (UniqueName: \"kubernetes.io/projected/083136dc-91fb-454f-a782-87b004e73d1b-kube-api-access-6r794\") pod \"083136dc-91fb-454f-a782-87b004e73d1b\" (UID: \"083136dc-91fb-454f-a782-87b004e73d1b\") "
Oct 30 20:09:11.680384 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:11.680309    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/083136dc-91fb-454f-a782-87b004e73d1b-tmp-dir" pod "083136dc-91fb-454f-a782-87b004e73d1b" (UID: "083136dc-91fb-454f-a782-87b004e73d1b"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:09:11.680384 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:11.680369    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/083136dc-91fb-454f-a782-87b004e73d1b-tls-certs\" (UniqueName: \"kubernetes.io/secret/083136dc-91fb-454f-a782-87b004e73d1b-tls-certs\") pod \"083136dc-91fb-454f-a782-87b004e73d1b\" (UID: \"083136dc-91fb-454f-a782-87b004e73d1b\") "
Oct 30 20:09:11.680513 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:11.680486    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/083136dc-91fb-454f-a782-87b004e73d1b-model-cache" pod "083136dc-91fb-454f-a782-87b004e73d1b" (UID: "083136dc-91fb-454f-a782-87b004e73d1b"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:09:11.680513 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:11.680505    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/083136dc-91fb-454f-a782-87b004e73d1b-home\" (UniqueName: \"kubernetes.io/empty-dir/083136dc-91fb-454f-a782-87b004e73d1b-home\") pod \"083136dc-91fb-454f-a782-87b004e73d1b\" (UID: \"083136dc-91fb-454f-a782-87b004e73d1b\") "
Oct 30 20:09:11.680801 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:11.680773    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/083136dc-91fb-454f-a782-87b004e73d1b-home" pod "083136dc-91fb-454f-a782-87b004e73d1b" (UID: "083136dc-91fb-454f-a782-87b004e73d1b"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:09:11.680925 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:11.680892    6275 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/083136dc-91fb-454f-a782-87b004e73d1b-home\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:09:11.681002 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:11.680938    6275 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/083136dc-91fb-454f-a782-87b004e73d1b-tmp-dir\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:09:11.681002 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:11.680953    6275 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/083136dc-91fb-454f-a782-87b004e73d1b-model-cache\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:09:11.682465 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:11.682436    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/083136dc-91fb-454f-a782-87b004e73d1b-tls-certs" pod "083136dc-91fb-454f-a782-87b004e73d1b" (UID: "083136dc-91fb-454f-a782-87b004e73d1b"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 20:09:11.682665 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:11.682637    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/083136dc-91fb-454f-a782-87b004e73d1b-dshm" pod "083136dc-91fb-454f-a782-87b004e73d1b" (UID: "083136dc-91fb-454f-a782-87b004e73d1b"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:09:11.682897 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:11.682861    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/083136dc-91fb-454f-a782-87b004e73d1b-kube-api-access-6r794" pod "083136dc-91fb-454f-a782-87b004e73d1b" (UID: "083136dc-91fb-454f-a782-87b004e73d1b"). InnerVolumeSpecName "kube-api-access-6r794". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:09:11.782512 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:11.782438    6275 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/083136dc-91fb-454f-a782-87b004e73d1b-tls-certs\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:09:11.782512 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:11.782472    6275 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/083136dc-91fb-454f-a782-87b004e73d1b-dshm\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:09:11.782512 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:11.782487    6275 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6r794\" (UniqueName: \"kubernetes.io/projected/083136dc-91fb-454f-a782-87b004e73d1b-kube-api-access-6r794\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:09:11.996422 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:11.996382    6275 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w2-efbac3/premium-w2-efbac3-kserve-55f54cfff6-9fqbz"]
Oct 30 20:09:12.005810 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:12.005786    6275 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w2-efbac3/premium-w2-efbac3-kserve-55f54cfff6-9fqbz"]
Oct 30 20:09:13.655621 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:13.655587    6275 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="083136dc-91fb-454f-a782-87b004e73d1b" path="/var/lib/kubelet/pods/083136dc-91fb-454f-a782-87b004e73d1b/volumes"
Oct 30 20:09:15.166315 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:15.165728    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-processing-e2e-worker-w2-efbac3-7bbf454b5c-w9rzj" podUID="186a15c4-0926-472b-9524-ea6f2d31f30f" containerName="payload-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 30 20:09:17.857226 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:17.857191    6275 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w2-efbac3-7rd5n"]
Oct 30 20:09:17.870670 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:17.870638    6275 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w2-efbac3-7rd5n"]
Oct 30 20:09:19.657756 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:19.657718    6275 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="91833992-e328-4b1e-b532-f4e8e284e2e5" path="/var/lib/kubelet/pods/91833992-e328-4b1e-b532-f4e8e284e2e5/volumes"
Oct 30 20:09:19.709792 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:19.709757    6275 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w6-51dd62-openshift-default-7954bd8797-qhldt"]
Oct 30 20:09:19.710016 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:19.709986    6275 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w6-51dd62-openshift-default-7954bd8797-qhldt" podUID="8d508b96-1463-414f-85be-ba11cc47d5c7" containerName="istio-proxy" containerID="cri-o://1d885bea05b22e520a55cf09b8bd49f18705b09c2a1ff5c4864bf202c97cc579" gracePeriod=30
Oct 30 20:09:19.742695 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:19.742660    6275 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w6-51dd62-openshift-default-7954bd8797-5phnf"]
Oct 30 20:09:19.742950 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:19.742925    6275 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w6-51dd62-openshift-default-7954bd8797-5phnf" podUID="debc38ac-d2b2-47f4-b94b-5d140d1b1194" containerName="istio-proxy" containerID="cri-o://83a83c7f5e8ff797da9d512a41802ed76e27ea4c967bf9308db066e4cb2f2f2a" gracePeriod=30
Oct 30 20:09:19.746733 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:19.746702    6275 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w6-51dd62-openshift-default-7954bd8797-jjfwb"]
Oct 30 20:09:19.746900 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:19.746879    6275 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w6-51dd62-openshift-default-7954bd8797-jjfwb" podUID="e06b5b8f-8e8e-4568-9f30-1997b0bd259e" containerName="istio-proxy" containerID="cri-o://5c204f70a2983d1f175a0fbf744e39120e84e9a0858c191b18404710dd449610" gracePeriod=30
Oct 30 20:09:22.933877 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:22.933785    6275 patch_prober.go:29] interesting pod/e2e-worker-w6-51dd62-openshift-default-7954bd8797-jjfwb container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Oct 30 20:09:22.933877 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:22.933856    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w6-51dd62-openshift-default-7954bd8797-jjfwb" podUID="e06b5b8f-8e8e-4568-9f30-1997b0bd259e" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 20:09:23.390035 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:23.389993    6275 patch_prober.go:29] interesting pod/e2e-worker-w6-51dd62-openshift-default-7954bd8797-5phnf container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Oct 30 20:09:23.390188 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:23.390067    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w6-51dd62-openshift-default-7954bd8797-5phnf" podUID="debc38ac-d2b2-47f4-b94b-5d140d1b1194" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 20:09:25.006068 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:25.006034    6275 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-51dd62-openshift-default-7954bd8797-5phnf"
Oct 30 20:09:25.054509 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:25.054487    6275 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-51dd62-openshift-default-7954bd8797-qhldt"
Oct 30 20:09:25.057815 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:25.057791    6275 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-51dd62-openshift-default-7954bd8797-jjfwb"
Oct 30 20:09:25.107833 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:25.107802    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/debc38ac-d2b2-47f4-b94b-5d140d1b1194-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/debc38ac-d2b2-47f4-b94b-5d140d1b1194-workload-certs\") pod \"debc38ac-d2b2-47f4-b94b-5d140d1b1194\" (UID: \"debc38ac-d2b2-47f4-b94b-5d140d1b1194\") "
Oct 30 20:09:25.108005 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:25.107847    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8d508b96-1463-414f-85be-ba11cc47d5c7-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8d508b96-1463-414f-85be-ba11cc47d5c7-workload-certs\") pod \"8d508b96-1463-414f-85be-ba11cc47d5c7\" (UID: \"8d508b96-1463-414f-85be-ba11cc47d5c7\") "
Oct 30 20:09:25.108005 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:25.107867    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e06b5b8f-8e8e-4568-9f30-1997b0bd259e-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e06b5b8f-8e8e-4568-9f30-1997b0bd259e-workload-certs\") pod \"e06b5b8f-8e8e-4568-9f30-1997b0bd259e\" (UID: \"e06b5b8f-8e8e-4568-9f30-1997b0bd259e\") "
Oct 30 20:09:25.108005 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:25.107885    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/debc38ac-d2b2-47f4-b94b-5d140d1b1194-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/debc38ac-d2b2-47f4-b94b-5d140d1b1194-workload-socket\") pod \"debc38ac-d2b2-47f4-b94b-5d140d1b1194\" (UID: \"debc38ac-d2b2-47f4-b94b-5d140d1b1194\") "
Oct 30 20:09:25.108005 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:25.107912    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/8d508b96-1463-414f-85be-ba11cc47d5c7-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8d508b96-1463-414f-85be-ba11cc47d5c7-istio-podinfo\") pod \"8d508b96-1463-414f-85be-ba11cc47d5c7\" (UID: \"8d508b96-1463-414f-85be-ba11cc47d5c7\") "
Oct 30 20:09:25.108005 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:25.107939    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/e06b5b8f-8e8e-4568-9f30-1997b0bd259e-kube-api-access-g4sdd\" (UniqueName: \"kubernetes.io/projected/e06b5b8f-8e8e-4568-9f30-1997b0bd259e-kube-api-access-g4sdd\") pod \"e06b5b8f-8e8e-4568-9f30-1997b0bd259e\" (UID: \"e06b5b8f-8e8e-4568-9f30-1997b0bd259e\") "
Oct 30 20:09:25.108005 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:25.107969    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/e06b5b8f-8e8e-4568-9f30-1997b0bd259e-istio-token\" (UniqueName: \"kubernetes.io/projected/e06b5b8f-8e8e-4568-9f30-1997b0bd259e-istio-token\") pod \"e06b5b8f-8e8e-4568-9f30-1997b0bd259e\" (UID: \"e06b5b8f-8e8e-4568-9f30-1997b0bd259e\") "
Oct 30 20:09:25.108005 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:25.107999    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/debc38ac-d2b2-47f4-b94b-5d140d1b1194-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/debc38ac-d2b2-47f4-b94b-5d140d1b1194-istio-podinfo\") pod \"debc38ac-d2b2-47f4-b94b-5d140d1b1194\" (UID: \"debc38ac-d2b2-47f4-b94b-5d140d1b1194\") "
Oct 30 20:09:25.108389 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:25.108055    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e06b5b8f-8e8e-4568-9f30-1997b0bd259e-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e06b5b8f-8e8e-4568-9f30-1997b0bd259e-istio-data\") pod \"e06b5b8f-8e8e-4568-9f30-1997b0bd259e\" (UID: \"e06b5b8f-8e8e-4568-9f30-1997b0bd259e\") "
Oct 30 20:09:25.108389 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:25.108080    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/debc38ac-d2b2-47f4-b94b-5d140d1b1194-kube-api-access-5vg2r\" (UniqueName: \"kubernetes.io/projected/debc38ac-d2b2-47f4-b94b-5d140d1b1194-kube-api-access-5vg2r\") pod \"debc38ac-d2b2-47f4-b94b-5d140d1b1194\" (UID: \"debc38ac-d2b2-47f4-b94b-5d140d1b1194\") "
Oct 30 20:09:25.108389 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:25.108134    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/debc38ac-d2b2-47f4-b94b-5d140d1b1194-istio-token\" (UniqueName: \"kubernetes.io/projected/debc38ac-d2b2-47f4-b94b-5d140d1b1194-istio-token\") pod \"debc38ac-d2b2-47f4-b94b-5d140d1b1194\" (UID: \"debc38ac-d2b2-47f4-b94b-5d140d1b1194\") "
Oct 30 20:09:25.108389 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:25.108148    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/debc38ac-d2b2-47f4-b94b-5d140d1b1194-workload-socket" pod "debc38ac-d2b2-47f4-b94b-5d140d1b1194" (UID: "debc38ac-d2b2-47f4-b94b-5d140d1b1194"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:09:25.108389 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:25.108166    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/8d508b96-1463-414f-85be-ba11cc47d5c7-kube-api-access-44m44\" (UniqueName: \"kubernetes.io/projected/8d508b96-1463-414f-85be-ba11cc47d5c7-kube-api-access-44m44\") pod \"8d508b96-1463-414f-85be-ba11cc47d5c7\" (UID: \"8d508b96-1463-414f-85be-ba11cc47d5c7\") "
Oct 30 20:09:25.108389 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:25.108205    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8d508b96-1463-414f-85be-ba11cc47d5c7-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8d508b96-1463-414f-85be-ba11cc47d5c7-istio-envoy\") pod \"8d508b96-1463-414f-85be-ba11cc47d5c7\" (UID: \"8d508b96-1463-414f-85be-ba11cc47d5c7\") "
Oct 30 20:09:25.108389 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:25.108261    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/8d508b96-1463-414f-85be-ba11cc47d5c7-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8d508b96-1463-414f-85be-ba11cc47d5c7-istiod-ca-cert\") pod \"8d508b96-1463-414f-85be-ba11cc47d5c7\" (UID: \"8d508b96-1463-414f-85be-ba11cc47d5c7\") "
Oct 30 20:09:25.108389 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:25.108296    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8d508b96-1463-414f-85be-ba11cc47d5c7-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8d508b96-1463-414f-85be-ba11cc47d5c7-workload-socket\") pod \"8d508b96-1463-414f-85be-ba11cc47d5c7\" (UID: \"8d508b96-1463-414f-85be-ba11cc47d5c7\") "
Oct 30 20:09:25.108389 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:25.108333    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/debc38ac-d2b2-47f4-b94b-5d140d1b1194-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/debc38ac-d2b2-47f4-b94b-5d140d1b1194-istio-envoy\") pod \"debc38ac-d2b2-47f4-b94b-5d140d1b1194\" (UID: \"debc38ac-d2b2-47f4-b94b-5d140d1b1194\") "
Oct 30 20:09:25.108389 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:25.108371    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8d508b96-1463-414f-85be-ba11cc47d5c7-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8d508b96-1463-414f-85be-ba11cc47d5c7-istio-data\") pod \"8d508b96-1463-414f-85be-ba11cc47d5c7\" (UID: \"8d508b96-1463-414f-85be-ba11cc47d5c7\") "
Oct 30 20:09:25.108389 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:25.108159    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8d508b96-1463-414f-85be-ba11cc47d5c7-workload-certs" pod "8d508b96-1463-414f-85be-ba11cc47d5c7" (UID: "8d508b96-1463-414f-85be-ba11cc47d5c7"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:09:25.108389 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:25.108164    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e06b5b8f-8e8e-4568-9f30-1997b0bd259e-workload-certs" pod "e06b5b8f-8e8e-4568-9f30-1997b0bd259e" (UID: "e06b5b8f-8e8e-4568-9f30-1997b0bd259e"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:09:25.109021 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:25.108379    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e06b5b8f-8e8e-4568-9f30-1997b0bd259e-istio-data" pod "e06b5b8f-8e8e-4568-9f30-1997b0bd259e" (UID: "e06b5b8f-8e8e-4568-9f30-1997b0bd259e"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:09:25.109021 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:25.108409    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/e06b5b8f-8e8e-4568-9f30-1997b0bd259e-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e06b5b8f-8e8e-4568-9f30-1997b0bd259e-istiod-ca-cert\") pod \"e06b5b8f-8e8e-4568-9f30-1997b0bd259e\" (UID: \"e06b5b8f-8e8e-4568-9f30-1997b0bd259e\") "
Oct 30 20:09:25.109021 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:25.108460    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e06b5b8f-8e8e-4568-9f30-1997b0bd259e-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e06b5b8f-8e8e-4568-9f30-1997b0bd259e-workload-socket\") pod \"e06b5b8f-8e8e-4568-9f30-1997b0bd259e\" (UID: \"e06b5b8f-8e8e-4568-9f30-1997b0bd259e\") "
Oct 30 20:09:25.109021 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:25.108514    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e06b5b8f-8e8e-4568-9f30-1997b0bd259e-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e06b5b8f-8e8e-4568-9f30-1997b0bd259e-credential-socket\") pod \"e06b5b8f-8e8e-4568-9f30-1997b0bd259e\" (UID: \"e06b5b8f-8e8e-4568-9f30-1997b0bd259e\") "
Oct 30 20:09:25.109021 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:25.108588    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8d508b96-1463-414f-85be-ba11cc47d5c7-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8d508b96-1463-414f-85be-ba11cc47d5c7-credential-socket\") pod \"8d508b96-1463-414f-85be-ba11cc47d5c7\" (UID: \"8d508b96-1463-414f-85be-ba11cc47d5c7\") "
Oct 30 20:09:25.109021 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:25.108643    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/debc38ac-d2b2-47f4-b94b-5d140d1b1194-workload-certs" pod "debc38ac-d2b2-47f4-b94b-5d140d1b1194" (UID: "debc38ac-d2b2-47f4-b94b-5d140d1b1194"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:09:25.109021 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:25.108652    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/e06b5b8f-8e8e-4568-9f30-1997b0bd259e-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e06b5b8f-8e8e-4568-9f30-1997b0bd259e-istio-podinfo\") pod \"e06b5b8f-8e8e-4568-9f30-1997b0bd259e\" (UID: \"e06b5b8f-8e8e-4568-9f30-1997b0bd259e\") "
Oct 30 20:09:25.109021 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:25.108722    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8d508b96-1463-414f-85be-ba11cc47d5c7-workload-socket" pod "8d508b96-1463-414f-85be-ba11cc47d5c7" (UID: "8d508b96-1463-414f-85be-ba11cc47d5c7"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:09:25.109021 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:25.108741    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/debc38ac-d2b2-47f4-b94b-5d140d1b1194-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/debc38ac-d2b2-47f4-b94b-5d140d1b1194-credential-socket\") pod \"debc38ac-d2b2-47f4-b94b-5d140d1b1194\" (UID: \"debc38ac-d2b2-47f4-b94b-5d140d1b1194\") "
Oct 30 20:09:25.109021 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:25.108777    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e06b5b8f-8e8e-4568-9f30-1997b0bd259e-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e06b5b8f-8e8e-4568-9f30-1997b0bd259e-istio-envoy\") pod \"e06b5b8f-8e8e-4568-9f30-1997b0bd259e\" (UID: \"e06b5b8f-8e8e-4568-9f30-1997b0bd259e\") "
Oct 30 20:09:25.109021 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:25.108807    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/debc38ac-d2b2-47f4-b94b-5d140d1b1194-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/debc38ac-d2b2-47f4-b94b-5d140d1b1194-istiod-ca-cert\") pod \"debc38ac-d2b2-47f4-b94b-5d140d1b1194\" (UID: \"debc38ac-d2b2-47f4-b94b-5d140d1b1194\") "
Oct 30 20:09:25.109021 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:25.108839    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/8d508b96-1463-414f-85be-ba11cc47d5c7-istio-token\" (UniqueName: \"kubernetes.io/projected/8d508b96-1463-414f-85be-ba11cc47d5c7-istio-token\") pod \"8d508b96-1463-414f-85be-ba11cc47d5c7\" (UID: \"8d508b96-1463-414f-85be-ba11cc47d5c7\") "
Oct 30 20:09:25.109021 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:25.108887    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/debc38ac-d2b2-47f4-b94b-5d140d1b1194-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/debc38ac-d2b2-47f4-b94b-5d140d1b1194-istio-data\") pod \"debc38ac-d2b2-47f4-b94b-5d140d1b1194\" (UID: \"debc38ac-d2b2-47f4-b94b-5d140d1b1194\") "
Oct 30 20:09:25.109650 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:25.109338    6275 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/debc38ac-d2b2-47f4-b94b-5d140d1b1194-workload-certs\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:09:25.109650 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:25.109360    6275 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8d508b96-1463-414f-85be-ba11cc47d5c7-workload-certs\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:09:25.109650 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:25.109374    6275 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e06b5b8f-8e8e-4568-9f30-1997b0bd259e-workload-certs\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:09:25.109650 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:25.109387    6275 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/debc38ac-d2b2-47f4-b94b-5d140d1b1194-workload-socket\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:09:25.109650 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:25.109400    6275 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e06b5b8f-8e8e-4568-9f30-1997b0bd259e-istio-data\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:09:25.109650 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:25.109432    6275 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8d508b96-1463-414f-85be-ba11cc47d5c7-workload-socket\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:09:25.109650 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:25.109629    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/debc38ac-d2b2-47f4-b94b-5d140d1b1194-istio-data" pod "debc38ac-d2b2-47f4-b94b-5d140d1b1194" (UID: "debc38ac-d2b2-47f4-b94b-5d140d1b1194"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:09:25.110009 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:25.109905    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8d508b96-1463-414f-85be-ba11cc47d5c7-istiod-ca-cert" pod "8d508b96-1463-414f-85be-ba11cc47d5c7" (UID: "8d508b96-1463-414f-85be-ba11cc47d5c7"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:09:25.110009 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:25.109998    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e06b5b8f-8e8e-4568-9f30-1997b0bd259e-istiod-ca-cert" pod "e06b5b8f-8e8e-4568-9f30-1997b0bd259e" (UID: "e06b5b8f-8e8e-4568-9f30-1997b0bd259e"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:09:25.110276 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:25.110249    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e06b5b8f-8e8e-4568-9f30-1997b0bd259e-workload-socket" pod "e06b5b8f-8e8e-4568-9f30-1997b0bd259e" (UID: "e06b5b8f-8e8e-4568-9f30-1997b0bd259e"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:09:25.110368 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:25.110277    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8d508b96-1463-414f-85be-ba11cc47d5c7-istio-data" pod "8d508b96-1463-414f-85be-ba11cc47d5c7" (UID: "8d508b96-1463-414f-85be-ba11cc47d5c7"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:09:25.110368 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:25.110323    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/debc38ac-d2b2-47f4-b94b-5d140d1b1194-credential-socket" pod "debc38ac-d2b2-47f4-b94b-5d140d1b1194" (UID: "debc38ac-d2b2-47f4-b94b-5d140d1b1194"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:09:25.110531 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:25.110508    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e06b5b8f-8e8e-4568-9f30-1997b0bd259e-credential-socket" pod "e06b5b8f-8e8e-4568-9f30-1997b0bd259e" (UID: "e06b5b8f-8e8e-4568-9f30-1997b0bd259e"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:09:25.110599 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:25.110577    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8d508b96-1463-414f-85be-ba11cc47d5c7-credential-socket" pod "8d508b96-1463-414f-85be-ba11cc47d5c7" (UID: "8d508b96-1463-414f-85be-ba11cc47d5c7"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:09:25.110707 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:25.110683    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/debc38ac-d2b2-47f4-b94b-5d140d1b1194-istiod-ca-cert" pod "debc38ac-d2b2-47f4-b94b-5d140d1b1194" (UID: "debc38ac-d2b2-47f4-b94b-5d140d1b1194"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:09:25.113360 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:25.113331    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8d508b96-1463-414f-85be-ba11cc47d5c7-istio-token" pod "8d508b96-1463-414f-85be-ba11cc47d5c7" (UID: "8d508b96-1463-414f-85be-ba11cc47d5c7"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:09:25.114619 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:25.113605    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/8d508b96-1463-414f-85be-ba11cc47d5c7-istio-podinfo" pod "8d508b96-1463-414f-85be-ba11cc47d5c7" (UID: "8d508b96-1463-414f-85be-ba11cc47d5c7"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 20:09:25.114619 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:25.113723    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e06b5b8f-8e8e-4568-9f30-1997b0bd259e-kube-api-access-g4sdd" pod "e06b5b8f-8e8e-4568-9f30-1997b0bd259e" (UID: "e06b5b8f-8e8e-4568-9f30-1997b0bd259e"). InnerVolumeSpecName "kube-api-access-g4sdd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:09:25.114619 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:25.113820    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e06b5b8f-8e8e-4568-9f30-1997b0bd259e-istio-envoy" pod "e06b5b8f-8e8e-4568-9f30-1997b0bd259e" (UID: "e06b5b8f-8e8e-4568-9f30-1997b0bd259e"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:09:25.114619 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:25.113904    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8d508b96-1463-414f-85be-ba11cc47d5c7-istio-envoy" pod "8d508b96-1463-414f-85be-ba11cc47d5c7" (UID: "8d508b96-1463-414f-85be-ba11cc47d5c7"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:09:25.114871 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:25.114716    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/debc38ac-d2b2-47f4-b94b-5d140d1b1194-kube-api-access-5vg2r" pod "debc38ac-d2b2-47f4-b94b-5d140d1b1194" (UID: "debc38ac-d2b2-47f4-b94b-5d140d1b1194"). InnerVolumeSpecName "kube-api-access-5vg2r". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:09:25.114940 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:25.114871    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/debc38ac-d2b2-47f4-b94b-5d140d1b1194-istio-envoy" pod "debc38ac-d2b2-47f4-b94b-5d140d1b1194" (UID: "debc38ac-d2b2-47f4-b94b-5d140d1b1194"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:09:25.115112 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:25.115080    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e06b5b8f-8e8e-4568-9f30-1997b0bd259e-istio-token" pod "e06b5b8f-8e8e-4568-9f30-1997b0bd259e" (UID: "e06b5b8f-8e8e-4568-9f30-1997b0bd259e"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:09:25.115300 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:25.115261    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8d508b96-1463-414f-85be-ba11cc47d5c7-kube-api-access-44m44" pod "8d508b96-1463-414f-85be-ba11cc47d5c7" (UID: "8d508b96-1463-414f-85be-ba11cc47d5c7"). InnerVolumeSpecName "kube-api-access-44m44". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:09:25.115711 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:25.115687    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/debc38ac-d2b2-47f4-b94b-5d140d1b1194-istio-token" pod "debc38ac-d2b2-47f4-b94b-5d140d1b1194" (UID: "debc38ac-d2b2-47f4-b94b-5d140d1b1194"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:09:25.115969 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:25.115888    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/debc38ac-d2b2-47f4-b94b-5d140d1b1194-istio-podinfo" pod "debc38ac-d2b2-47f4-b94b-5d140d1b1194" (UID: "debc38ac-d2b2-47f4-b94b-5d140d1b1194"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 20:09:25.116112 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:25.116096    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/e06b5b8f-8e8e-4568-9f30-1997b0bd259e-istio-podinfo" pod "e06b5b8f-8e8e-4568-9f30-1997b0bd259e" (UID: "e06b5b8f-8e8e-4568-9f30-1997b0bd259e"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 20:09:25.164634 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:25.164596    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-processing-e2e-worker-w2-efbac3-7bbf454b5c-w9rzj" podUID="186a15c4-0926-472b-9524-ea6f2d31f30f" containerName="payload-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 30 20:09:25.210653 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:25.210626    6275 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8d508b96-1463-414f-85be-ba11cc47d5c7-istiod-ca-cert\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:09:25.210653 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:25.210650    6275 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/debc38ac-d2b2-47f4-b94b-5d140d1b1194-istio-envoy\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:09:25.210810 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:25.210661    6275 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8d508b96-1463-414f-85be-ba11cc47d5c7-istio-data\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:09:25.210810 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:25.210670    6275 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e06b5b8f-8e8e-4568-9f30-1997b0bd259e-istiod-ca-cert\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:09:25.210810 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:25.210681    6275 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e06b5b8f-8e8e-4568-9f30-1997b0bd259e-workload-socket\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:09:25.210810 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:25.210690    6275 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e06b5b8f-8e8e-4568-9f30-1997b0bd259e-credential-socket\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:09:25.210810 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:25.210699    6275 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8d508b96-1463-414f-85be-ba11cc47d5c7-credential-socket\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:09:25.210810 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:25.210708    6275 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e06b5b8f-8e8e-4568-9f30-1997b0bd259e-istio-podinfo\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:09:25.210810 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:25.210716    6275 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/debc38ac-d2b2-47f4-b94b-5d140d1b1194-credential-socket\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:09:25.210810 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:25.210726    6275 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e06b5b8f-8e8e-4568-9f30-1997b0bd259e-istio-envoy\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:09:25.210810 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:25.210735    6275 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/debc38ac-d2b2-47f4-b94b-5d140d1b1194-istiod-ca-cert\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:09:25.210810 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:25.210742    6275 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8d508b96-1463-414f-85be-ba11cc47d5c7-istio-token\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:09:25.210810 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:25.210750    6275 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/debc38ac-d2b2-47f4-b94b-5d140d1b1194-istio-data\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:09:25.210810 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:25.210757    6275 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8d508b96-1463-414f-85be-ba11cc47d5c7-istio-podinfo\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:09:25.210810 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:25.210765    6275 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g4sdd\" (UniqueName: \"kubernetes.io/projected/e06b5b8f-8e8e-4568-9f30-1997b0bd259e-kube-api-access-g4sdd\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:09:25.210810 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:25.210773    6275 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e06b5b8f-8e8e-4568-9f30-1997b0bd259e-istio-token\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:09:25.210810 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:25.210783    6275 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/debc38ac-d2b2-47f4-b94b-5d140d1b1194-istio-podinfo\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:09:25.210810 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:25.210791    6275 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5vg2r\" (UniqueName: \"kubernetes.io/projected/debc38ac-d2b2-47f4-b94b-5d140d1b1194-kube-api-access-5vg2r\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:09:25.210810 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:25.210799    6275 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/debc38ac-d2b2-47f4-b94b-5d140d1b1194-istio-token\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:09:25.210810 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:25.210807    6275 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-44m44\" (UniqueName: \"kubernetes.io/projected/8d508b96-1463-414f-85be-ba11cc47d5c7-kube-api-access-44m44\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:09:25.210810 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:25.210816    6275 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8d508b96-1463-414f-85be-ba11cc47d5c7-istio-envoy\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:09:25.752626 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:25.752599    6275 generic.go:356] "Generic (PLEG): container finished" podID="debc38ac-d2b2-47f4-b94b-5d140d1b1194" containerID="83a83c7f5e8ff797da9d512a41802ed76e27ea4c967bf9308db066e4cb2f2f2a" exitCode=0
Oct 30 20:09:25.752749 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:25.752661    6275 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-51dd62-openshift-default-7954bd8797-5phnf"
Oct 30 20:09:25.752749 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:25.752685    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-51dd62-openshift-default-7954bd8797-5phnf" event={"ID":"debc38ac-d2b2-47f4-b94b-5d140d1b1194","Type":"ContainerDied","Data":"83a83c7f5e8ff797da9d512a41802ed76e27ea4c967bf9308db066e4cb2f2f2a"}
Oct 30 20:09:25.752749 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:25.752739    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-51dd62-openshift-default-7954bd8797-5phnf" event={"ID":"debc38ac-d2b2-47f4-b94b-5d140d1b1194","Type":"ContainerDied","Data":"010f622eb919fb2493d9bd05a2034950091321e9782df1caf3edd70cdbd19a87"}
Oct 30 20:09:25.752909 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:25.752771    6275 scope.go:122] "RemoveContainer" containerID="83a83c7f5e8ff797da9d512a41802ed76e27ea4c967bf9308db066e4cb2f2f2a"
Oct 30 20:09:25.754240 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:25.754213    6275 generic.go:356] "Generic (PLEG): container finished" podID="8d508b96-1463-414f-85be-ba11cc47d5c7" containerID="1d885bea05b22e520a55cf09b8bd49f18705b09c2a1ff5c4864bf202c97cc579" exitCode=0
Oct 30 20:09:25.754338 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:25.754256    6275 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-51dd62-openshift-default-7954bd8797-qhldt"
Oct 30 20:09:25.754338 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:25.754291    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-51dd62-openshift-default-7954bd8797-qhldt" event={"ID":"8d508b96-1463-414f-85be-ba11cc47d5c7","Type":"ContainerDied","Data":"1d885bea05b22e520a55cf09b8bd49f18705b09c2a1ff5c4864bf202c97cc579"}
Oct 30 20:09:25.754491 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:25.754337    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-51dd62-openshift-default-7954bd8797-qhldt" event={"ID":"8d508b96-1463-414f-85be-ba11cc47d5c7","Type":"ContainerDied","Data":"65f6525d6276bfc3154a8f2baeea221fb18c21967141f71a6795b1ab3cc561aa"}
Oct 30 20:09:25.756029 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:25.756005    6275 generic.go:356] "Generic (PLEG): container finished" podID="e06b5b8f-8e8e-4568-9f30-1997b0bd259e" containerID="5c204f70a2983d1f175a0fbf744e39120e84e9a0858c191b18404710dd449610" exitCode=0
Oct 30 20:09:25.756140 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:25.756051    6275 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-51dd62-openshift-default-7954bd8797-jjfwb"
Oct 30 20:09:25.756140 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:25.756098    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-51dd62-openshift-default-7954bd8797-jjfwb" event={"ID":"e06b5b8f-8e8e-4568-9f30-1997b0bd259e","Type":"ContainerDied","Data":"5c204f70a2983d1f175a0fbf744e39120e84e9a0858c191b18404710dd449610"}
Oct 30 20:09:25.756313 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:25.756158    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-51dd62-openshift-default-7954bd8797-jjfwb" event={"ID":"e06b5b8f-8e8e-4568-9f30-1997b0bd259e","Type":"ContainerDied","Data":"00729e8a10671b695dd2785d822942dcabb6eea16cde9af83be32e962f70a18c"}
Oct 30 20:09:25.763957 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:25.763941    6275 scope.go:122] "RemoveContainer" containerID="83a83c7f5e8ff797da9d512a41802ed76e27ea4c967bf9308db066e4cb2f2f2a"
Oct 30 20:09:25.764222 ip-10-0-131-26 kubenswrapper[6275]: E1030 20:09:25.764204    6275 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"83a83c7f5e8ff797da9d512a41802ed76e27ea4c967bf9308db066e4cb2f2f2a\": container with ID starting with 83a83c7f5e8ff797da9d512a41802ed76e27ea4c967bf9308db066e4cb2f2f2a not found: ID does not exist" containerID="83a83c7f5e8ff797da9d512a41802ed76e27ea4c967bf9308db066e4cb2f2f2a"
Oct 30 20:09:25.764287 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:25.764228    6275 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"83a83c7f5e8ff797da9d512a41802ed76e27ea4c967bf9308db066e4cb2f2f2a"} err="failed to get container status \"83a83c7f5e8ff797da9d512a41802ed76e27ea4c967bf9308db066e4cb2f2f2a\": rpc error: code = NotFound desc = could not find container \"83a83c7f5e8ff797da9d512a41802ed76e27ea4c967bf9308db066e4cb2f2f2a\": container with ID starting with 83a83c7f5e8ff797da9d512a41802ed76e27ea4c967bf9308db066e4cb2f2f2a not found: ID does not exist"
Oct 30 20:09:25.764287 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:25.764251    6275 scope.go:122] "RemoveContainer" containerID="1d885bea05b22e520a55cf09b8bd49f18705b09c2a1ff5c4864bf202c97cc579"
Oct 30 20:09:25.773155 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:25.773136    6275 scope.go:122] "RemoveContainer" containerID="1d885bea05b22e520a55cf09b8bd49f18705b09c2a1ff5c4864bf202c97cc579"
Oct 30 20:09:25.773488 ip-10-0-131-26 kubenswrapper[6275]: E1030 20:09:25.773464    6275 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1d885bea05b22e520a55cf09b8bd49f18705b09c2a1ff5c4864bf202c97cc579\": container with ID starting with 1d885bea05b22e520a55cf09b8bd49f18705b09c2a1ff5c4864bf202c97cc579 not found: ID does not exist" containerID="1d885bea05b22e520a55cf09b8bd49f18705b09c2a1ff5c4864bf202c97cc579"
Oct 30 20:09:25.773562 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:25.773500    6275 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1d885bea05b22e520a55cf09b8bd49f18705b09c2a1ff5c4864bf202c97cc579"} err="failed to get container status \"1d885bea05b22e520a55cf09b8bd49f18705b09c2a1ff5c4864bf202c97cc579\": rpc error: code = NotFound desc = could not find container \"1d885bea05b22e520a55cf09b8bd49f18705b09c2a1ff5c4864bf202c97cc579\": container with ID starting with 1d885bea05b22e520a55cf09b8bd49f18705b09c2a1ff5c4864bf202c97cc579 not found: ID does not exist"
Oct 30 20:09:25.773562 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:25.773522    6275 scope.go:122] "RemoveContainer" containerID="5c204f70a2983d1f175a0fbf744e39120e84e9a0858c191b18404710dd449610"
Oct 30 20:09:25.782220 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:25.782202    6275 scope.go:122] "RemoveContainer" containerID="5c204f70a2983d1f175a0fbf744e39120e84e9a0858c191b18404710dd449610"
Oct 30 20:09:25.782584 ip-10-0-131-26 kubenswrapper[6275]: E1030 20:09:25.782561    6275 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5c204f70a2983d1f175a0fbf744e39120e84e9a0858c191b18404710dd449610\": container with ID starting with 5c204f70a2983d1f175a0fbf744e39120e84e9a0858c191b18404710dd449610 not found: ID does not exist" containerID="5c204f70a2983d1f175a0fbf744e39120e84e9a0858c191b18404710dd449610"
Oct 30 20:09:25.782633 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:25.782588    6275 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5c204f70a2983d1f175a0fbf744e39120e84e9a0858c191b18404710dd449610"} err="failed to get container status \"5c204f70a2983d1f175a0fbf744e39120e84e9a0858c191b18404710dd449610\": rpc error: code = NotFound desc = could not find container \"5c204f70a2983d1f175a0fbf744e39120e84e9a0858c191b18404710dd449610\": container with ID starting with 5c204f70a2983d1f175a0fbf744e39120e84e9a0858c191b18404710dd449610 not found: ID does not exist"
Oct 30 20:09:25.820225 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:25.820202    6275 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w6-51dd62-openshift-default-7954bd8797-5phnf"]
Oct 30 20:09:25.830419 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:25.830398    6275 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w6-51dd62-openshift-default-7954bd8797-5phnf"]
Oct 30 20:09:25.872318 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:25.872298    6275 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w6-51dd62-openshift-default-7954bd8797-jjfwb"]
Oct 30 20:09:25.875154 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:25.875135    6275 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w6-51dd62-openshift-default-7954bd8797-jjfwb"]
Oct 30 20:09:25.915178 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:25.915121    6275 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w6-51dd62-openshift-default-7954bd8797-qhldt"]
Oct 30 20:09:25.926160 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:25.926139    6275 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w6-51dd62-openshift-default-7954bd8797-qhldt"]
Oct 30 20:09:26.255493 ip-10-0-131-26 kubenswrapper[6275]: E1030 20:09:26.255452    6275 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-fwc77" containerName="extractor"
Oct 30 20:09:27.242926 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:27.242869    6275 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w2-efbac3-7bbf454b5c-w9rzj"
Oct 30 20:09:27.331688 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:27.331661    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/186a15c4-0926-472b-9524-ea6f2d31f30f-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/186a15c4-0926-472b-9524-ea6f2d31f30f-plugins-config-volume\") pod \"186a15c4-0926-472b-9524-ea6f2d31f30f\" (UID: \"186a15c4-0926-472b-9524-ea6f2d31f30f\") "
Oct 30 20:09:27.332100 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:27.331777    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/186a15c4-0926-472b-9524-ea6f2d31f30f-kube-api-access-4p92w\" (UniqueName: \"kubernetes.io/projected/186a15c4-0926-472b-9524-ea6f2d31f30f-kube-api-access-4p92w\") pod \"186a15c4-0926-472b-9524-ea6f2d31f30f\" (UID: \"186a15c4-0926-472b-9524-ea6f2d31f30f\") "
Oct 30 20:09:27.332100 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:27.332001    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/186a15c4-0926-472b-9524-ea6f2d31f30f-plugins-config-volume" pod "186a15c4-0926-472b-9524-ea6f2d31f30f" (UID: "186a15c4-0926-472b-9524-ea6f2d31f30f"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:09:27.333897 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:27.333873    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/186a15c4-0926-472b-9524-ea6f2d31f30f-kube-api-access-4p92w" pod "186a15c4-0926-472b-9524-ea6f2d31f30f" (UID: "186a15c4-0926-472b-9524-ea6f2d31f30f"). InnerVolumeSpecName "kube-api-access-4p92w". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:09:27.432571 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:27.432541    6275 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4p92w\" (UniqueName: \"kubernetes.io/projected/186a15c4-0926-472b-9524-ea6f2d31f30f-kube-api-access-4p92w\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:09:27.432571 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:27.432569    6275 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/186a15c4-0926-472b-9524-ea6f2d31f30f-plugins-config-volume\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:09:27.656875 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:27.656799    6275 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="8d508b96-1463-414f-85be-ba11cc47d5c7" path="/var/lib/kubelet/pods/8d508b96-1463-414f-85be-ba11cc47d5c7/volumes"
Oct 30 20:09:27.657365 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:27.657350    6275 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="debc38ac-d2b2-47f4-b94b-5d140d1b1194" path="/var/lib/kubelet/pods/debc38ac-d2b2-47f4-b94b-5d140d1b1194/volumes"
Oct 30 20:09:27.657789 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:27.657775    6275 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="e06b5b8f-8e8e-4568-9f30-1997b0bd259e" path="/var/lib/kubelet/pods/e06b5b8f-8e8e-4568-9f30-1997b0bd259e/volumes"
Oct 30 20:09:27.773582 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:27.773551    6275 generic.go:356] "Generic (PLEG): container finished" podID="186a15c4-0926-472b-9524-ea6f2d31f30f" containerID="4a9be1bcfb637a86d2a2d2c0f855a4eacd18d605b8a13c6012498fa9b93ccb91" exitCode=0
Oct 30 20:09:27.773713 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:27.773599    6275 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w2-efbac3-7bbf454b5c-w9rzj"
Oct 30 20:09:27.773713 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:27.773596    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w2-efbac3-7bbf454b5c-w9rzj" event={"ID":"186a15c4-0926-472b-9524-ea6f2d31f30f","Type":"ContainerDied","Data":"4a9be1bcfb637a86d2a2d2c0f855a4eacd18d605b8a13c6012498fa9b93ccb91"}
Oct 30 20:09:27.773713 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:27.773658    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w2-efbac3-7bbf454b5c-w9rzj" event={"ID":"186a15c4-0926-472b-9524-ea6f2d31f30f","Type":"ContainerDied","Data":"f5552c0d2536a28eecac8b51675213734431379edbc08c513cdc590b094e9509"}
Oct 30 20:09:27.773713 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:27.773689    6275 scope.go:122] "RemoveContainer" containerID="4a9be1bcfb637a86d2a2d2c0f855a4eacd18d605b8a13c6012498fa9b93ccb91"
Oct 30 20:09:27.783278 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:27.783260    6275 scope.go:122] "RemoveContainer" containerID="4a9be1bcfb637a86d2a2d2c0f855a4eacd18d605b8a13c6012498fa9b93ccb91"
Oct 30 20:09:27.783570 ip-10-0-131-26 kubenswrapper[6275]: E1030 20:09:27.783548    6275 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4a9be1bcfb637a86d2a2d2c0f855a4eacd18d605b8a13c6012498fa9b93ccb91\": container with ID starting with 4a9be1bcfb637a86d2a2d2c0f855a4eacd18d605b8a13c6012498fa9b93ccb91 not found: ID does not exist" containerID="4a9be1bcfb637a86d2a2d2c0f855a4eacd18d605b8a13c6012498fa9b93ccb91"
Oct 30 20:09:27.783623 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:27.783579    6275 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4a9be1bcfb637a86d2a2d2c0f855a4eacd18d605b8a13c6012498fa9b93ccb91"} err="failed to get container status \"4a9be1bcfb637a86d2a2d2c0f855a4eacd18d605b8a13c6012498fa9b93ccb91\": rpc error: code = NotFound desc = could not find container \"4a9be1bcfb637a86d2a2d2c0f855a4eacd18d605b8a13c6012498fa9b93ccb91\": container with ID starting with 4a9be1bcfb637a86d2a2d2c0f855a4eacd18d605b8a13c6012498fa9b93ccb91 not found: ID does not exist"
Oct 30 20:09:27.833174 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:27.833149    6275 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w2-efbac3-7bbf454b5c-w9rzj"]
Oct 30 20:09:27.850707 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:27.850674    6275 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w2-efbac3-7bbf454b5c-w9rzj"]
Oct 30 20:09:27.903973 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:27.903940    6275 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w2-efbac3-openshift-default-844cb4689c-8mzmn"]
Oct 30 20:09:27.904165 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:27.904139    6275 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w2-efbac3-openshift-default-844cb4689c-8mzmn" podUID="9cba92db-f8aa-4a79-9b3e-3481fa8b1fbd" containerName="istio-proxy" containerID="cri-o://9054abd996d5485458ff65ff5a106b24659fffbebc6291fa49e030ad8b85e851" gracePeriod=30
Oct 30 20:09:27.919836 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:27.919767    6275 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w2-efbac3-openshift-default-844cb4689c-485mw"]
Oct 30 20:09:27.920029 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:27.920006    6275 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w2-efbac3-openshift-default-844cb4689c-485mw" podUID="58046c91-9885-452a-ae30-01edbceb6312" containerName="istio-proxy" containerID="cri-o://02d8654d81376fb4ef91998858749adfbae09cdc9039a874891a2b74931acd4c" gracePeriod=30
Oct 30 20:09:27.931016 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:27.930992    6275 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w2-efbac3-openshift-default-844cb4689c-vwdfb"]
Oct 30 20:09:27.931175 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:27.931157    6275 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w2-efbac3-openshift-default-844cb4689c-vwdfb" podUID="04fcd0d1-5d59-485a-aba6-1e9fa4ba2144" containerName="istio-proxy" containerID="cri-o://dca3a547339a4c2fbdd2497c2834a0dd5bbc0b8bedc414e395b0cc0150026d8d" gracePeriod=30
Oct 30 20:09:29.055248 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:29.055217    6275 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-375e5a55-t88c4"]
Oct 30 20:09:29.071132 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:29.071105    6275 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-375e5a55-t88c4"]
Oct 30 20:09:29.656222 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:29.656191    6275 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="186a15c4-0926-472b-9524-ea6f2d31f30f" path="/var/lib/kubelet/pods/186a15c4-0926-472b-9524-ea6f2d31f30f/volumes"
Oct 30 20:09:29.656634 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:29.656617    6275 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="aa5c03b3-8071-45e5-aa3a-f3be239f9985" path="/var/lib/kubelet/pods/aa5c03b3-8071-45e5-aa3a-f3be239f9985/volumes"
Oct 30 20:09:33.040322 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:33.040293    6275 patch_prober.go:29] interesting pod/e2e-worker-w2-efbac3-openshift-default-844cb4689c-485mw container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused" start-of-body=
Oct 30 20:09:33.040782 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:33.040350    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w2-efbac3-openshift-default-844cb4689c-485mw" podUID="58046c91-9885-452a-ae30-01edbceb6312" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused"
Oct 30 20:09:33.085453 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:33.082283    6275 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-774477d6c-n9tw6"]
Oct 30 20:09:33.085453 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:33.082476    6275 kuberuntime_container.go:898] "Killing container with a grace period" pod="opendatahub/maas-controller-774477d6c-n9tw6" podUID="7aed72fd-804a-45b7-9bda-ed055d3a3d6f" containerName="manager" containerID="cri-o://4134c5b5f7c9bf89465d87d0f11fe6dea93337767b8440cd280aa9f73d98204c" gracePeriod=30
Oct 30 20:09:33.252142 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:33.252106    6275 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-efbac3-openshift-default-844cb4689c-8mzmn"
Oct 30 20:09:33.302734 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:33.292976    6275 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-efbac3-openshift-default-844cb4689c-vwdfb"
Oct 30 20:09:33.302734 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:33.293202    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9cba92db-f8aa-4a79-9b3e-3481fa8b1fbd-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9cba92db-f8aa-4a79-9b3e-3481fa8b1fbd-workload-certs\") pod \"9cba92db-f8aa-4a79-9b3e-3481fa8b1fbd\" (UID: \"9cba92db-f8aa-4a79-9b3e-3481fa8b1fbd\") "
Oct 30 20:09:33.302734 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:33.293255    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/9cba92db-f8aa-4a79-9b3e-3481fa8b1fbd-kube-api-access-dxpss\" (UniqueName: \"kubernetes.io/projected/9cba92db-f8aa-4a79-9b3e-3481fa8b1fbd-kube-api-access-dxpss\") pod \"9cba92db-f8aa-4a79-9b3e-3481fa8b1fbd\" (UID: \"9cba92db-f8aa-4a79-9b3e-3481fa8b1fbd\") "
Oct 30 20:09:33.302734 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:33.293292    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9cba92db-f8aa-4a79-9b3e-3481fa8b1fbd-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9cba92db-f8aa-4a79-9b3e-3481fa8b1fbd-credential-socket\") pod \"9cba92db-f8aa-4a79-9b3e-3481fa8b1fbd\" (UID: \"9cba92db-f8aa-4a79-9b3e-3481fa8b1fbd\") "
Oct 30 20:09:33.302734 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:33.293351    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9cba92db-f8aa-4a79-9b3e-3481fa8b1fbd-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9cba92db-f8aa-4a79-9b3e-3481fa8b1fbd-istio-data\") pod \"9cba92db-f8aa-4a79-9b3e-3481fa8b1fbd\" (UID: \"9cba92db-f8aa-4a79-9b3e-3481fa8b1fbd\") "
Oct 30 20:09:33.302734 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:33.293383    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/9cba92db-f8aa-4a79-9b3e-3481fa8b1fbd-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9cba92db-f8aa-4a79-9b3e-3481fa8b1fbd-istio-podinfo\") pod \"9cba92db-f8aa-4a79-9b3e-3481fa8b1fbd\" (UID: \"9cba92db-f8aa-4a79-9b3e-3481fa8b1fbd\") "
Oct 30 20:09:33.302734 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:33.293544    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9cba92db-f8aa-4a79-9b3e-3481fa8b1fbd-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9cba92db-f8aa-4a79-9b3e-3481fa8b1fbd-istio-envoy\") pod \"9cba92db-f8aa-4a79-9b3e-3481fa8b1fbd\" (UID: \"9cba92db-f8aa-4a79-9b3e-3481fa8b1fbd\") "
Oct 30 20:09:33.302734 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:33.293587    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/9cba92db-f8aa-4a79-9b3e-3481fa8b1fbd-istio-token\" (UniqueName: \"kubernetes.io/projected/9cba92db-f8aa-4a79-9b3e-3481fa8b1fbd-istio-token\") pod \"9cba92db-f8aa-4a79-9b3e-3481fa8b1fbd\" (UID: \"9cba92db-f8aa-4a79-9b3e-3481fa8b1fbd\") "
Oct 30 20:09:33.302734 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:33.293625    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/9cba92db-f8aa-4a79-9b3e-3481fa8b1fbd-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9cba92db-f8aa-4a79-9b3e-3481fa8b1fbd-istiod-ca-cert\") pod \"9cba92db-f8aa-4a79-9b3e-3481fa8b1fbd\" (UID: \"9cba92db-f8aa-4a79-9b3e-3481fa8b1fbd\") "
Oct 30 20:09:33.302734 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:33.293656    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9cba92db-f8aa-4a79-9b3e-3481fa8b1fbd-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9cba92db-f8aa-4a79-9b3e-3481fa8b1fbd-workload-socket\") pod \"9cba92db-f8aa-4a79-9b3e-3481fa8b1fbd\" (UID: \"9cba92db-f8aa-4a79-9b3e-3481fa8b1fbd\") "
Oct 30 20:09:33.302734 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:33.294244    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9cba92db-f8aa-4a79-9b3e-3481fa8b1fbd-workload-socket" pod "9cba92db-f8aa-4a79-9b3e-3481fa8b1fbd" (UID: "9cba92db-f8aa-4a79-9b3e-3481fa8b1fbd"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:09:33.302734 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:33.294498    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9cba92db-f8aa-4a79-9b3e-3481fa8b1fbd-workload-certs" pod "9cba92db-f8aa-4a79-9b3e-3481fa8b1fbd" (UID: "9cba92db-f8aa-4a79-9b3e-3481fa8b1fbd"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:09:33.302734 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:33.297552    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9cba92db-f8aa-4a79-9b3e-3481fa8b1fbd-credential-socket" pod "9cba92db-f8aa-4a79-9b3e-3481fa8b1fbd" (UID: "9cba92db-f8aa-4a79-9b3e-3481fa8b1fbd"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:09:33.310482 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:33.308640    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/9cba92db-f8aa-4a79-9b3e-3481fa8b1fbd-istio-podinfo" pod "9cba92db-f8aa-4a79-9b3e-3481fa8b1fbd" (UID: "9cba92db-f8aa-4a79-9b3e-3481fa8b1fbd"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 20:09:33.320441 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:33.314575    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9cba92db-f8aa-4a79-9b3e-3481fa8b1fbd-kube-api-access-dxpss" pod "9cba92db-f8aa-4a79-9b3e-3481fa8b1fbd" (UID: "9cba92db-f8aa-4a79-9b3e-3481fa8b1fbd"). InnerVolumeSpecName "kube-api-access-dxpss". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:09:33.320441 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:33.316619    6275 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-efbac3-openshift-default-844cb4689c-485mw"
Oct 30 20:09:33.322191 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:33.320832    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9cba92db-f8aa-4a79-9b3e-3481fa8b1fbd-istiod-ca-cert" pod "9cba92db-f8aa-4a79-9b3e-3481fa8b1fbd" (UID: "9cba92db-f8aa-4a79-9b3e-3481fa8b1fbd"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:09:33.324765 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:33.324715    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9cba92db-f8aa-4a79-9b3e-3481fa8b1fbd-istio-data" pod "9cba92db-f8aa-4a79-9b3e-3481fa8b1fbd" (UID: "9cba92db-f8aa-4a79-9b3e-3481fa8b1fbd"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:09:33.342963 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:33.342798    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9cba92db-f8aa-4a79-9b3e-3481fa8b1fbd-istio-envoy" pod "9cba92db-f8aa-4a79-9b3e-3481fa8b1fbd" (UID: "9cba92db-f8aa-4a79-9b3e-3481fa8b1fbd"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:09:33.350113 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:33.347506    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9cba92db-f8aa-4a79-9b3e-3481fa8b1fbd-istio-token" pod "9cba92db-f8aa-4a79-9b3e-3481fa8b1fbd" (UID: "9cba92db-f8aa-4a79-9b3e-3481fa8b1fbd"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:09:33.377974 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:33.377883    6275 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-774477d6c-n9tw6"
Oct 30 20:09:33.397462 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:33.396224    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/04fcd0d1-5d59-485a-aba6-1e9fa4ba2144-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/04fcd0d1-5d59-485a-aba6-1e9fa4ba2144-workload-certs\") pod \"04fcd0d1-5d59-485a-aba6-1e9fa4ba2144\" (UID: \"04fcd0d1-5d59-485a-aba6-1e9fa4ba2144\") "
Oct 30 20:09:33.397462 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:33.396282    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/04fcd0d1-5d59-485a-aba6-1e9fa4ba2144-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/04fcd0d1-5d59-485a-aba6-1e9fa4ba2144-istio-envoy\") pod \"04fcd0d1-5d59-485a-aba6-1e9fa4ba2144\" (UID: \"04fcd0d1-5d59-485a-aba6-1e9fa4ba2144\") "
Oct 30 20:09:33.397462 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:33.396333    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/04fcd0d1-5d59-485a-aba6-1e9fa4ba2144-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/04fcd0d1-5d59-485a-aba6-1e9fa4ba2144-istiod-ca-cert\") pod \"04fcd0d1-5d59-485a-aba6-1e9fa4ba2144\" (UID: \"04fcd0d1-5d59-485a-aba6-1e9fa4ba2144\") "
Oct 30 20:09:33.397462 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:33.396384    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/04fcd0d1-5d59-485a-aba6-1e9fa4ba2144-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/04fcd0d1-5d59-485a-aba6-1e9fa4ba2144-istio-podinfo\") pod \"04fcd0d1-5d59-485a-aba6-1e9fa4ba2144\" (UID: \"04fcd0d1-5d59-485a-aba6-1e9fa4ba2144\") "
Oct 30 20:09:33.397462 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:33.396436    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/04fcd0d1-5d59-485a-aba6-1e9fa4ba2144-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/04fcd0d1-5d59-485a-aba6-1e9fa4ba2144-credential-socket\") pod \"04fcd0d1-5d59-485a-aba6-1e9fa4ba2144\" (UID: \"04fcd0d1-5d59-485a-aba6-1e9fa4ba2144\") "
Oct 30 20:09:33.397462 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:33.396467    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/58046c91-9885-452a-ae30-01edbceb6312-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/58046c91-9885-452a-ae30-01edbceb6312-istiod-ca-cert\") pod \"58046c91-9885-452a-ae30-01edbceb6312\" (UID: \"58046c91-9885-452a-ae30-01edbceb6312\") "
Oct 30 20:09:33.397462 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:33.396500    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/58046c91-9885-452a-ae30-01edbceb6312-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/58046c91-9885-452a-ae30-01edbceb6312-istio-podinfo\") pod \"58046c91-9885-452a-ae30-01edbceb6312\" (UID: \"58046c91-9885-452a-ae30-01edbceb6312\") "
Oct 30 20:09:33.397462 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:33.396531    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/04fcd0d1-5d59-485a-aba6-1e9fa4ba2144-istio-token\" (UniqueName: \"kubernetes.io/projected/04fcd0d1-5d59-485a-aba6-1e9fa4ba2144-istio-token\") pod \"04fcd0d1-5d59-485a-aba6-1e9fa4ba2144\" (UID: \"04fcd0d1-5d59-485a-aba6-1e9fa4ba2144\") "
Oct 30 20:09:33.397462 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:33.396570    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/58046c91-9885-452a-ae30-01edbceb6312-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/58046c91-9885-452a-ae30-01edbceb6312-credential-socket\") pod \"58046c91-9885-452a-ae30-01edbceb6312\" (UID: \"58046c91-9885-452a-ae30-01edbceb6312\") "
Oct 30 20:09:33.397462 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:33.396602    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/04fcd0d1-5d59-485a-aba6-1e9fa4ba2144-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/04fcd0d1-5d59-485a-aba6-1e9fa4ba2144-istio-data\") pod \"04fcd0d1-5d59-485a-aba6-1e9fa4ba2144\" (UID: \"04fcd0d1-5d59-485a-aba6-1e9fa4ba2144\") "
Oct 30 20:09:33.397462 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:33.396630    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/04fcd0d1-5d59-485a-aba6-1e9fa4ba2144-kube-api-access-nmskm\" (UniqueName: \"kubernetes.io/projected/04fcd0d1-5d59-485a-aba6-1e9fa4ba2144-kube-api-access-nmskm\") pod \"04fcd0d1-5d59-485a-aba6-1e9fa4ba2144\" (UID: \"04fcd0d1-5d59-485a-aba6-1e9fa4ba2144\") "
Oct 30 20:09:33.397462 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:33.396689    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/58046c91-9885-452a-ae30-01edbceb6312-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/58046c91-9885-452a-ae30-01edbceb6312-workload-certs\") pod \"58046c91-9885-452a-ae30-01edbceb6312\" (UID: \"58046c91-9885-452a-ae30-01edbceb6312\") "
Oct 30 20:09:33.397462 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:33.396735    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/58046c91-9885-452a-ae30-01edbceb6312-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/58046c91-9885-452a-ae30-01edbceb6312-istio-envoy\") pod \"58046c91-9885-452a-ae30-01edbceb6312\" (UID: \"58046c91-9885-452a-ae30-01edbceb6312\") "
Oct 30 20:09:33.397462 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:33.396779    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/04fcd0d1-5d59-485a-aba6-1e9fa4ba2144-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/04fcd0d1-5d59-485a-aba6-1e9fa4ba2144-workload-socket\") pod \"04fcd0d1-5d59-485a-aba6-1e9fa4ba2144\" (UID: \"04fcd0d1-5d59-485a-aba6-1e9fa4ba2144\") "
Oct 30 20:09:33.397462 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:33.396816    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/58046c91-9885-452a-ae30-01edbceb6312-istio-token\" (UniqueName: \"kubernetes.io/projected/58046c91-9885-452a-ae30-01edbceb6312-istio-token\") pod \"58046c91-9885-452a-ae30-01edbceb6312\" (UID: \"58046c91-9885-452a-ae30-01edbceb6312\") "
Oct 30 20:09:33.397462 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:33.396859    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/58046c91-9885-452a-ae30-01edbceb6312-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/58046c91-9885-452a-ae30-01edbceb6312-istio-data\") pod \"58046c91-9885-452a-ae30-01edbceb6312\" (UID: \"58046c91-9885-452a-ae30-01edbceb6312\") "
Oct 30 20:09:33.397462 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:33.396887    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/58046c91-9885-452a-ae30-01edbceb6312-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/58046c91-9885-452a-ae30-01edbceb6312-workload-socket\") pod \"58046c91-9885-452a-ae30-01edbceb6312\" (UID: \"58046c91-9885-452a-ae30-01edbceb6312\") "
Oct 30 20:09:33.397462 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:33.396929    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/58046c91-9885-452a-ae30-01edbceb6312-kube-api-access-5tlzt\" (UniqueName: \"kubernetes.io/projected/58046c91-9885-452a-ae30-01edbceb6312-kube-api-access-5tlzt\") pod \"58046c91-9885-452a-ae30-01edbceb6312\" (UID: \"58046c91-9885-452a-ae30-01edbceb6312\") "
Oct 30 20:09:33.397462 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:33.397309    6275 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9cba92db-f8aa-4a79-9b3e-3481fa8b1fbd-istio-envoy\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:09:33.397462 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:33.397330    6275 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9cba92db-f8aa-4a79-9b3e-3481fa8b1fbd-istio-token\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:09:33.397462 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:33.397344    6275 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9cba92db-f8aa-4a79-9b3e-3481fa8b1fbd-istiod-ca-cert\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:09:33.397462 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:33.397358    6275 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9cba92db-f8aa-4a79-9b3e-3481fa8b1fbd-workload-socket\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:09:33.397462 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:33.397373    6275 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9cba92db-f8aa-4a79-9b3e-3481fa8b1fbd-workload-certs\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:09:33.397462 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:33.397388    6275 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dxpss\" (UniqueName: \"kubernetes.io/projected/9cba92db-f8aa-4a79-9b3e-3481fa8b1fbd-kube-api-access-dxpss\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:09:33.411021 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:33.397402    6275 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9cba92db-f8aa-4a79-9b3e-3481fa8b1fbd-credential-socket\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:09:33.411021 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:33.401681    6275 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9cba92db-f8aa-4a79-9b3e-3481fa8b1fbd-istio-data\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:09:33.411021 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:33.401702    6275 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9cba92db-f8aa-4a79-9b3e-3481fa8b1fbd-istio-podinfo\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:09:33.411021 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:33.401192    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/58046c91-9885-452a-ae30-01edbceb6312-credential-socket" pod "58046c91-9885-452a-ae30-01edbceb6312" (UID: "58046c91-9885-452a-ae30-01edbceb6312"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:09:33.411021 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:33.401384    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/04fcd0d1-5d59-485a-aba6-1e9fa4ba2144-workload-certs" pod "04fcd0d1-5d59-485a-aba6-1e9fa4ba2144" (UID: "04fcd0d1-5d59-485a-aba6-1e9fa4ba2144"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:09:33.413546 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:33.411678    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/04fcd0d1-5d59-485a-aba6-1e9fa4ba2144-istio-data" pod "04fcd0d1-5d59-485a-aba6-1e9fa4ba2144" (UID: "04fcd0d1-5d59-485a-aba6-1e9fa4ba2144"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:09:33.413546 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:33.412182    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/04fcd0d1-5d59-485a-aba6-1e9fa4ba2144-workload-socket" pod "04fcd0d1-5d59-485a-aba6-1e9fa4ba2144" (UID: "04fcd0d1-5d59-485a-aba6-1e9fa4ba2144"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:09:33.413546 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:33.413252    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/58046c91-9885-452a-ae30-01edbceb6312-istiod-ca-cert" pod "58046c91-9885-452a-ae30-01edbceb6312" (UID: "58046c91-9885-452a-ae30-01edbceb6312"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:09:33.415149 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:33.414464    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/04fcd0d1-5d59-485a-aba6-1e9fa4ba2144-credential-socket" pod "04fcd0d1-5d59-485a-aba6-1e9fa4ba2144" (UID: "04fcd0d1-5d59-485a-aba6-1e9fa4ba2144"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:09:33.415149 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:33.414683    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/58046c91-9885-452a-ae30-01edbceb6312-workload-socket" pod "58046c91-9885-452a-ae30-01edbceb6312" (UID: "58046c91-9885-452a-ae30-01edbceb6312"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:09:33.415149 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:33.414872    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/58046c91-9885-452a-ae30-01edbceb6312-istio-data" pod "58046c91-9885-452a-ae30-01edbceb6312" (UID: "58046c91-9885-452a-ae30-01edbceb6312"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:09:33.415675 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:33.415545    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/58046c91-9885-452a-ae30-01edbceb6312-kube-api-access-5tlzt" pod "58046c91-9885-452a-ae30-01edbceb6312" (UID: "58046c91-9885-452a-ae30-01edbceb6312"). InnerVolumeSpecName "kube-api-access-5tlzt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:09:33.415675 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:33.415618    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/58046c91-9885-452a-ae30-01edbceb6312-workload-certs" pod "58046c91-9885-452a-ae30-01edbceb6312" (UID: "58046c91-9885-452a-ae30-01edbceb6312"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:09:33.432652 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:33.432605    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/04fcd0d1-5d59-485a-aba6-1e9fa4ba2144-istiod-ca-cert" pod "04fcd0d1-5d59-485a-aba6-1e9fa4ba2144" (UID: "04fcd0d1-5d59-485a-aba6-1e9fa4ba2144"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:09:33.438617 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:33.438579    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/04fcd0d1-5d59-485a-aba6-1e9fa4ba2144-istio-envoy" pod "04fcd0d1-5d59-485a-aba6-1e9fa4ba2144" (UID: "04fcd0d1-5d59-485a-aba6-1e9fa4ba2144"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:09:33.438900 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:33.438860    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/58046c91-9885-452a-ae30-01edbceb6312-istio-envoy" pod "58046c91-9885-452a-ae30-01edbceb6312" (UID: "58046c91-9885-452a-ae30-01edbceb6312"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:09:33.440739 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:33.440706    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/04fcd0d1-5d59-485a-aba6-1e9fa4ba2144-kube-api-access-nmskm" pod "04fcd0d1-5d59-485a-aba6-1e9fa4ba2144" (UID: "04fcd0d1-5d59-485a-aba6-1e9fa4ba2144"). InnerVolumeSpecName "kube-api-access-nmskm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:09:33.440917 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:33.440893    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/58046c91-9885-452a-ae30-01edbceb6312-istio-podinfo" pod "58046c91-9885-452a-ae30-01edbceb6312" (UID: "58046c91-9885-452a-ae30-01edbceb6312"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 20:09:33.441106 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:33.441080    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/58046c91-9885-452a-ae30-01edbceb6312-istio-token" pod "58046c91-9885-452a-ae30-01edbceb6312" (UID: "58046c91-9885-452a-ae30-01edbceb6312"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:09:33.442438 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:33.442071    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/04fcd0d1-5d59-485a-aba6-1e9fa4ba2144-istio-token" pod "04fcd0d1-5d59-485a-aba6-1e9fa4ba2144" (UID: "04fcd0d1-5d59-485a-aba6-1e9fa4ba2144"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:09:33.442617 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:33.442591    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/04fcd0d1-5d59-485a-aba6-1e9fa4ba2144-istio-podinfo" pod "04fcd0d1-5d59-485a-aba6-1e9fa4ba2144" (UID: "04fcd0d1-5d59-485a-aba6-1e9fa4ba2144"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 20:09:33.511777 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:33.506397    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/7aed72fd-804a-45b7-9bda-ed055d3a3d6f-metrics-certs\" (UniqueName: \"kubernetes.io/secret/7aed72fd-804a-45b7-9bda-ed055d3a3d6f-metrics-certs\") pod \"7aed72fd-804a-45b7-9bda-ed055d3a3d6f\" (UID: \"7aed72fd-804a-45b7-9bda-ed055d3a3d6f\") "
Oct 30 20:09:33.511777 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:33.506466    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/7aed72fd-804a-45b7-9bda-ed055d3a3d6f-webhook-cert\" (UniqueName: \"kubernetes.io/secret/7aed72fd-804a-45b7-9bda-ed055d3a3d6f-webhook-cert\") pod \"7aed72fd-804a-45b7-9bda-ed055d3a3d6f\" (UID: \"7aed72fd-804a-45b7-9bda-ed055d3a3d6f\") "
Oct 30 20:09:33.511777 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:33.506505    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/7aed72fd-804a-45b7-9bda-ed055d3a3d6f-kube-api-access-6b4hx\" (UniqueName: \"kubernetes.io/projected/7aed72fd-804a-45b7-9bda-ed055d3a3d6f-kube-api-access-6b4hx\") pod \"7aed72fd-804a-45b7-9bda-ed055d3a3d6f\" (UID: \"7aed72fd-804a-45b7-9bda-ed055d3a3d6f\") "
Oct 30 20:09:33.511777 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:33.506816    6275 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/04fcd0d1-5d59-485a-aba6-1e9fa4ba2144-workload-certs\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:09:33.511777 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:33.506836    6275 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/04fcd0d1-5d59-485a-aba6-1e9fa4ba2144-istio-envoy\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:09:33.511777 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:33.506850    6275 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/04fcd0d1-5d59-485a-aba6-1e9fa4ba2144-istiod-ca-cert\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:09:33.511777 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:33.506863    6275 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/04fcd0d1-5d59-485a-aba6-1e9fa4ba2144-istio-podinfo\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:09:33.511777 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:33.506877    6275 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/04fcd0d1-5d59-485a-aba6-1e9fa4ba2144-credential-socket\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:09:33.511777 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:33.506891    6275 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/58046c91-9885-452a-ae30-01edbceb6312-istiod-ca-cert\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:09:33.511777 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:33.506904    6275 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/58046c91-9885-452a-ae30-01edbceb6312-istio-podinfo\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:09:33.511777 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:33.506915    6275 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/04fcd0d1-5d59-485a-aba6-1e9fa4ba2144-istio-token\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:09:33.511777 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:33.506928    6275 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/58046c91-9885-452a-ae30-01edbceb6312-credential-socket\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:09:33.511777 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:33.506941    6275 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/04fcd0d1-5d59-485a-aba6-1e9fa4ba2144-istio-data\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:09:33.511777 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:33.506955    6275 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nmskm\" (UniqueName: \"kubernetes.io/projected/04fcd0d1-5d59-485a-aba6-1e9fa4ba2144-kube-api-access-nmskm\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:09:33.511777 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:33.506969    6275 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/58046c91-9885-452a-ae30-01edbceb6312-workload-certs\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:09:33.511777 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:33.506982    6275 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/58046c91-9885-452a-ae30-01edbceb6312-istio-envoy\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:09:33.511777 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:33.506994    6275 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/04fcd0d1-5d59-485a-aba6-1e9fa4ba2144-workload-socket\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:09:33.511777 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:33.507007    6275 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/58046c91-9885-452a-ae30-01edbceb6312-istio-token\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:09:33.511777 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:33.507024    6275 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/58046c91-9885-452a-ae30-01edbceb6312-istio-data\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:09:33.511777 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:33.507038    6275 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/58046c91-9885-452a-ae30-01edbceb6312-workload-socket\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:09:33.511777 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:33.507051    6275 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5tlzt\" (UniqueName: \"kubernetes.io/projected/58046c91-9885-452a-ae30-01edbceb6312-kube-api-access-5tlzt\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:09:33.513109 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:33.511832    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7aed72fd-804a-45b7-9bda-ed055d3a3d6f-webhook-cert" pod "7aed72fd-804a-45b7-9bda-ed055d3a3d6f" (UID: "7aed72fd-804a-45b7-9bda-ed055d3a3d6f"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 20:09:33.516003 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:33.515961    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7aed72fd-804a-45b7-9bda-ed055d3a3d6f-kube-api-access-6b4hx" pod "7aed72fd-804a-45b7-9bda-ed055d3a3d6f" (UID: "7aed72fd-804a-45b7-9bda-ed055d3a3d6f"). InnerVolumeSpecName "kube-api-access-6b4hx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:09:33.528755 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:33.528716    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7aed72fd-804a-45b7-9bda-ed055d3a3d6f-metrics-certs" pod "7aed72fd-804a-45b7-9bda-ed055d3a3d6f" (UID: "7aed72fd-804a-45b7-9bda-ed055d3a3d6f"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 20:09:33.608108 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:33.608020    6275 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7aed72fd-804a-45b7-9bda-ed055d3a3d6f-metrics-certs\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:09:33.608108 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:33.608056    6275 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7aed72fd-804a-45b7-9bda-ed055d3a3d6f-webhook-cert\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:09:33.608108 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:33.608075    6275 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6b4hx\" (UniqueName: \"kubernetes.io/projected/7aed72fd-804a-45b7-9bda-ed055d3a3d6f-kube-api-access-6b4hx\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:09:33.815501 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:33.815391    6275 generic.go:356] "Generic (PLEG): container finished" podID="9cba92db-f8aa-4a79-9b3e-3481fa8b1fbd" containerID="9054abd996d5485458ff65ff5a106b24659fffbebc6291fa49e030ad8b85e851" exitCode=0
Oct 30 20:09:33.815681 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:33.815559    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-efbac3-openshift-default-844cb4689c-8mzmn" event={"ID":"9cba92db-f8aa-4a79-9b3e-3481fa8b1fbd","Type":"ContainerDied","Data":"9054abd996d5485458ff65ff5a106b24659fffbebc6291fa49e030ad8b85e851"}
Oct 30 20:09:33.815681 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:33.815612    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-efbac3-openshift-default-844cb4689c-8mzmn" event={"ID":"9cba92db-f8aa-4a79-9b3e-3481fa8b1fbd","Type":"ContainerDied","Data":"21b5b404bfa81aacce0d4dbbe4e24cea340910a1bb333101b9444e332f04f779"}
Oct 30 20:09:33.815681 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:33.815641    6275 scope.go:122] "RemoveContainer" containerID="9054abd996d5485458ff65ff5a106b24659fffbebc6291fa49e030ad8b85e851"
Oct 30 20:09:33.818151 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:33.817158    6275 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-efbac3-openshift-default-844cb4689c-8mzmn"
Oct 30 20:09:33.819906 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:33.819066    6275 generic.go:356] "Generic (PLEG): container finished" podID="04fcd0d1-5d59-485a-aba6-1e9fa4ba2144" containerID="dca3a547339a4c2fbdd2497c2834a0dd5bbc0b8bedc414e395b0cc0150026d8d" exitCode=0
Oct 30 20:09:33.819906 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:33.819753    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-efbac3-openshift-default-844cb4689c-vwdfb" event={"ID":"04fcd0d1-5d59-485a-aba6-1e9fa4ba2144","Type":"ContainerDied","Data":"dca3a547339a4c2fbdd2497c2834a0dd5bbc0b8bedc414e395b0cc0150026d8d"}
Oct 30 20:09:33.819906 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:33.819811    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-efbac3-openshift-default-844cb4689c-vwdfb" event={"ID":"04fcd0d1-5d59-485a-aba6-1e9fa4ba2144","Type":"ContainerDied","Data":"e980bed991a64166f89093f2ba4dc7c6b363f1e5508ae95a4973e0e5f3962eee"}
Oct 30 20:09:33.820752 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:33.820288    6275 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-efbac3-openshift-default-844cb4689c-vwdfb"
Oct 30 20:09:33.826025 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:33.825842    6275 generic.go:356] "Generic (PLEG): container finished" podID="7aed72fd-804a-45b7-9bda-ed055d3a3d6f" containerID="4134c5b5f7c9bf89465d87d0f11fe6dea93337767b8440cd280aa9f73d98204c" exitCode=0
Oct 30 20:09:33.826793 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:33.826272    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-774477d6c-n9tw6" event={"ID":"7aed72fd-804a-45b7-9bda-ed055d3a3d6f","Type":"ContainerDied","Data":"4134c5b5f7c9bf89465d87d0f11fe6dea93337767b8440cd280aa9f73d98204c"}
Oct 30 20:09:33.826793 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:33.826321    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-774477d6c-n9tw6" event={"ID":"7aed72fd-804a-45b7-9bda-ed055d3a3d6f","Type":"ContainerDied","Data":"baa3ca781a35c6429f4797ab9561c4372f7c2a7a20e2e7e44e466686b2bbc7a7"}
Oct 30 20:09:33.826793 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:33.826398    6275 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-774477d6c-n9tw6"
Oct 30 20:09:33.829401 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:33.829244    6275 generic.go:356] "Generic (PLEG): container finished" podID="58046c91-9885-452a-ae30-01edbceb6312" containerID="02d8654d81376fb4ef91998858749adfbae09cdc9039a874891a2b74931acd4c" exitCode=0
Oct 30 20:09:33.829401 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:33.829309    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-efbac3-openshift-default-844cb4689c-485mw" event={"ID":"58046c91-9885-452a-ae30-01edbceb6312","Type":"ContainerDied","Data":"02d8654d81376fb4ef91998858749adfbae09cdc9039a874891a2b74931acd4c"}
Oct 30 20:09:33.829401 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:33.829346    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-efbac3-openshift-default-844cb4689c-485mw" event={"ID":"58046c91-9885-452a-ae30-01edbceb6312","Type":"ContainerDied","Data":"1e8a84a27ce4b49afd653d20956a24b4c5fe430530ba511d10fe93a307461d28"}
Oct 30 20:09:33.830500 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:33.829846    6275 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-efbac3-openshift-default-844cb4689c-485mw"
Oct 30 20:09:33.836945 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:33.836910    6275 scope.go:122] "RemoveContainer" containerID="9054abd996d5485458ff65ff5a106b24659fffbebc6291fa49e030ad8b85e851"
Oct 30 20:09:33.837240 ip-10-0-131-26 kubenswrapper[6275]: E1030 20:09:33.837217    6275 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9054abd996d5485458ff65ff5a106b24659fffbebc6291fa49e030ad8b85e851\": container with ID starting with 9054abd996d5485458ff65ff5a106b24659fffbebc6291fa49e030ad8b85e851 not found: ID does not exist" containerID="9054abd996d5485458ff65ff5a106b24659fffbebc6291fa49e030ad8b85e851"
Oct 30 20:09:33.837292 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:33.837249    6275 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9054abd996d5485458ff65ff5a106b24659fffbebc6291fa49e030ad8b85e851"} err="failed to get container status \"9054abd996d5485458ff65ff5a106b24659fffbebc6291fa49e030ad8b85e851\": rpc error: code = NotFound desc = could not find container \"9054abd996d5485458ff65ff5a106b24659fffbebc6291fa49e030ad8b85e851\": container with ID starting with 9054abd996d5485458ff65ff5a106b24659fffbebc6291fa49e030ad8b85e851 not found: ID does not exist"
Oct 30 20:09:33.837292 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:33.837265    6275 scope.go:122] "RemoveContainer" containerID="dca3a547339a4c2fbdd2497c2834a0dd5bbc0b8bedc414e395b0cc0150026d8d"
Oct 30 20:09:33.845937 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:33.845920    6275 scope.go:122] "RemoveContainer" containerID="dca3a547339a4c2fbdd2497c2834a0dd5bbc0b8bedc414e395b0cc0150026d8d"
Oct 30 20:09:33.846196 ip-10-0-131-26 kubenswrapper[6275]: E1030 20:09:33.846173    6275 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dca3a547339a4c2fbdd2497c2834a0dd5bbc0b8bedc414e395b0cc0150026d8d\": container with ID starting with dca3a547339a4c2fbdd2497c2834a0dd5bbc0b8bedc414e395b0cc0150026d8d not found: ID does not exist" containerID="dca3a547339a4c2fbdd2497c2834a0dd5bbc0b8bedc414e395b0cc0150026d8d"
Oct 30 20:09:33.846264 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:33.846201    6275 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dca3a547339a4c2fbdd2497c2834a0dd5bbc0b8bedc414e395b0cc0150026d8d"} err="failed to get container status \"dca3a547339a4c2fbdd2497c2834a0dd5bbc0b8bedc414e395b0cc0150026d8d\": rpc error: code = NotFound desc = could not find container \"dca3a547339a4c2fbdd2497c2834a0dd5bbc0b8bedc414e395b0cc0150026d8d\": container with ID starting with dca3a547339a4c2fbdd2497c2834a0dd5bbc0b8bedc414e395b0cc0150026d8d not found: ID does not exist"
Oct 30 20:09:33.846264 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:33.846218    6275 scope.go:122] "RemoveContainer" containerID="4134c5b5f7c9bf89465d87d0f11fe6dea93337767b8440cd280aa9f73d98204c"
Oct 30 20:09:33.855810 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:33.855791    6275 scope.go:122] "RemoveContainer" containerID="4134c5b5f7c9bf89465d87d0f11fe6dea93337767b8440cd280aa9f73d98204c"
Oct 30 20:09:33.856072 ip-10-0-131-26 kubenswrapper[6275]: E1030 20:09:33.856054    6275 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4134c5b5f7c9bf89465d87d0f11fe6dea93337767b8440cd280aa9f73d98204c\": container with ID starting with 4134c5b5f7c9bf89465d87d0f11fe6dea93337767b8440cd280aa9f73d98204c not found: ID does not exist" containerID="4134c5b5f7c9bf89465d87d0f11fe6dea93337767b8440cd280aa9f73d98204c"
Oct 30 20:09:33.856114 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:33.856077    6275 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4134c5b5f7c9bf89465d87d0f11fe6dea93337767b8440cd280aa9f73d98204c"} err="failed to get container status \"4134c5b5f7c9bf89465d87d0f11fe6dea93337767b8440cd280aa9f73d98204c\": rpc error: code = NotFound desc = could not find container \"4134c5b5f7c9bf89465d87d0f11fe6dea93337767b8440cd280aa9f73d98204c\": container with ID starting with 4134c5b5f7c9bf89465d87d0f11fe6dea93337767b8440cd280aa9f73d98204c not found: ID does not exist"
Oct 30 20:09:33.856114 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:33.856095    6275 scope.go:122] "RemoveContainer" containerID="02d8654d81376fb4ef91998858749adfbae09cdc9039a874891a2b74931acd4c"
Oct 30 20:09:33.864258 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:33.864241    6275 scope.go:122] "RemoveContainer" containerID="02d8654d81376fb4ef91998858749adfbae09cdc9039a874891a2b74931acd4c"
Oct 30 20:09:33.864534 ip-10-0-131-26 kubenswrapper[6275]: E1030 20:09:33.864515    6275 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"02d8654d81376fb4ef91998858749adfbae09cdc9039a874891a2b74931acd4c\": container with ID starting with 02d8654d81376fb4ef91998858749adfbae09cdc9039a874891a2b74931acd4c not found: ID does not exist" containerID="02d8654d81376fb4ef91998858749adfbae09cdc9039a874891a2b74931acd4c"
Oct 30 20:09:33.864589 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:33.864540    6275 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"02d8654d81376fb4ef91998858749adfbae09cdc9039a874891a2b74931acd4c"} err="failed to get container status \"02d8654d81376fb4ef91998858749adfbae09cdc9039a874891a2b74931acd4c\": rpc error: code = NotFound desc = could not find container \"02d8654d81376fb4ef91998858749adfbae09cdc9039a874891a2b74931acd4c\": container with ID starting with 02d8654d81376fb4ef91998858749adfbae09cdc9039a874891a2b74931acd4c not found: ID does not exist"
Oct 30 20:09:33.876880 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:33.876859    6275 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-774477d6c-n9tw6"]
Oct 30 20:09:33.882959 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:33.882937    6275 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-774477d6c-n9tw6"]
Oct 30 20:09:33.924382 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:33.924360    6275 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w2-efbac3-openshift-default-844cb4689c-485mw"]
Oct 30 20:09:33.928479 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:33.928460    6275 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w2-efbac3-openshift-default-844cb4689c-485mw"]
Oct 30 20:09:33.964777 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:33.964745    6275 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w2-efbac3-openshift-default-844cb4689c-vwdfb"]
Oct 30 20:09:33.970508 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:33.970485    6275 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w2-efbac3-openshift-default-844cb4689c-vwdfb"]
Oct 30 20:09:34.033217 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:34.033189    6275 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w2-efbac3-openshift-default-844cb4689c-8mzmn"]
Oct 30 20:09:34.038459 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:34.038408    6275 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w2-efbac3-openshift-default-844cb4689c-8mzmn"]
Oct 30 20:09:35.657463 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:35.657396    6275 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="04fcd0d1-5d59-485a-aba6-1e9fa4ba2144" path="/var/lib/kubelet/pods/04fcd0d1-5d59-485a-aba6-1e9fa4ba2144/volumes"
Oct 30 20:09:35.658057 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:35.658035    6275 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="58046c91-9885-452a-ae30-01edbceb6312" path="/var/lib/kubelet/pods/58046c91-9885-452a-ae30-01edbceb6312/volumes"
Oct 30 20:09:35.658466 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:35.658444    6275 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="7aed72fd-804a-45b7-9bda-ed055d3a3d6f" path="/var/lib/kubelet/pods/7aed72fd-804a-45b7-9bda-ed055d3a3d6f/volumes"
Oct 30 20:09:35.659235 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:35.659216    6275 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="9cba92db-f8aa-4a79-9b3e-3481fa8b1fbd" path="/var/lib/kubelet/pods/9cba92db-f8aa-4a79-9b3e-3481fa8b1fbd/volumes"
Oct 30 20:09:40.042553 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:40.042486    6275 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-ffba6574-67lrj"]
Oct 30 20:09:40.055275 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:40.055244    6275 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-ffba6574-67lrj"]
Oct 30 20:09:41.656786 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:41.656748    6275 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="922c18e5-36a6-4665-abf1-4873e6479202" path="/var/lib/kubelet/pods/922c18e5-36a6-4665-abf1-4873e6479202/volumes"
Oct 30 20:09:42.035282 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:42.035254    6275 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-4508ea12-42d67"]
Oct 30 20:09:42.047523 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:42.047497    6275 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-4508ea12-42d67"]
Oct 30 20:09:43.655054 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:43.655018    6275 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="2e0ddfd8-905a-453c-85cb-64e3902fc535" path="/var/lib/kubelet/pods/2e0ddfd8-905a-453c-85cb-64e3902fc535/volumes"
Oct 30 20:09:56.054561 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:56.054525    6275 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-9c0ed893-272hm"]
Oct 30 20:09:56.067151 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:56.067124    6275 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-9c0ed893-272hm"]
Oct 30 20:09:56.254680 ip-10-0-131-26 kubenswrapper[6275]: E1030 20:09:56.254646    6275 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-fwc77" containerName="extractor"
Oct 30 20:09:56.846610 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:56.846577    6275 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-k7qfk"]
Oct 30 20:09:56.847145 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:56.847120    6275 cpu_manager.go:414] "containerMap: removing container" podUID="58046c91-9885-452a-ae30-01edbceb6312" containerName="istio-proxy"
Oct 30 20:09:56.847145 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:56.847142    6275 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="58046c91-9885-452a-ae30-01edbceb6312" containerName="istio-proxy"
Oct 30 20:09:56.847301 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:56.847157    6275 cpu_manager.go:414] "containerMap: removing container" podUID="9cba92db-f8aa-4a79-9b3e-3481fa8b1fbd" containerName="istio-proxy"
Oct 30 20:09:56.847301 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:56.847162    6275 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="9cba92db-f8aa-4a79-9b3e-3481fa8b1fbd" containerName="istio-proxy"
Oct 30 20:09:56.847301 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:56.847172    6275 cpu_manager.go:414] "containerMap: removing container" podUID="7aed72fd-804a-45b7-9bda-ed055d3a3d6f" containerName="manager"
Oct 30 20:09:56.847301 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:56.847181    6275 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="7aed72fd-804a-45b7-9bda-ed055d3a3d6f" containerName="manager"
Oct 30 20:09:56.847301 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:56.847192    6275 cpu_manager.go:414] "containerMap: removing container" podUID="debc38ac-d2b2-47f4-b94b-5d140d1b1194" containerName="istio-proxy"
Oct 30 20:09:56.847301 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:56.847197    6275 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="debc38ac-d2b2-47f4-b94b-5d140d1b1194" containerName="istio-proxy"
Oct 30 20:09:56.847301 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:56.847216    6275 cpu_manager.go:414] "containerMap: removing container" podUID="186a15c4-0926-472b-9524-ea6f2d31f30f" containerName="payload-processing"
Oct 30 20:09:56.847301 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:56.847220    6275 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="186a15c4-0926-472b-9524-ea6f2d31f30f" containerName="payload-processing"
Oct 30 20:09:56.847301 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:56.847226    6275 cpu_manager.go:414] "containerMap: removing container" podUID="0a672bb2-1f1b-4ec3-a67f-28b288eaa651" containerName="revoke-keys"
Oct 30 20:09:56.847301 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:56.847231    6275 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="0a672bb2-1f1b-4ec3-a67f-28b288eaa651" containerName="revoke-keys"
Oct 30 20:09:56.847301 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:56.847238    6275 cpu_manager.go:414] "containerMap: removing container" podUID="083136dc-91fb-454f-a782-87b004e73d1b" containerName="main"
Oct 30 20:09:56.847301 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:56.847243    6275 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="083136dc-91fb-454f-a782-87b004e73d1b" containerName="main"
Oct 30 20:09:56.847301 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:56.847252    6275 cpu_manager.go:414] "containerMap: removing container" podUID="8d508b96-1463-414f-85be-ba11cc47d5c7" containerName="istio-proxy"
Oct 30 20:09:56.847301 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:56.847259    6275 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="8d508b96-1463-414f-85be-ba11cc47d5c7" containerName="istio-proxy"
Oct 30 20:09:56.847301 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:56.847268    6275 cpu_manager.go:414] "containerMap: removing container" podUID="e06b5b8f-8e8e-4568-9f30-1997b0bd259e" containerName="istio-proxy"
Oct 30 20:09:56.847301 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:56.847273    6275 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="e06b5b8f-8e8e-4568-9f30-1997b0bd259e" containerName="istio-proxy"
Oct 30 20:09:56.847301 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:56.847281    6275 cpu_manager.go:414] "containerMap: removing container" podUID="04fcd0d1-5d59-485a-aba6-1e9fa4ba2144" containerName="istio-proxy"
Oct 30 20:09:56.847301 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:56.847286    6275 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="04fcd0d1-5d59-485a-aba6-1e9fa4ba2144" containerName="istio-proxy"
Oct 30 20:09:56.847895 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:56.847352    6275 memory_manager.go:365] "RemoveStaleState removing state" podUID="186a15c4-0926-472b-9524-ea6f2d31f30f" containerName="payload-processing"
Oct 30 20:09:56.847895 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:56.847365    6275 memory_manager.go:365] "RemoveStaleState removing state" podUID="0a672bb2-1f1b-4ec3-a67f-28b288eaa651" containerName="revoke-keys"
Oct 30 20:09:56.847895 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:56.847375    6275 memory_manager.go:365] "RemoveStaleState removing state" podUID="083136dc-91fb-454f-a782-87b004e73d1b" containerName="main"
Oct 30 20:09:56.847895 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:56.847381    6275 memory_manager.go:365] "RemoveStaleState removing state" podUID="8d508b96-1463-414f-85be-ba11cc47d5c7" containerName="istio-proxy"
Oct 30 20:09:56.847895 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:56.847387    6275 memory_manager.go:365] "RemoveStaleState removing state" podUID="e06b5b8f-8e8e-4568-9f30-1997b0bd259e" containerName="istio-proxy"
Oct 30 20:09:56.847895 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:56.847392    6275 memory_manager.go:365] "RemoveStaleState removing state" podUID="04fcd0d1-5d59-485a-aba6-1e9fa4ba2144" containerName="istio-proxy"
Oct 30 20:09:56.847895 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:56.847400    6275 memory_manager.go:365] "RemoveStaleState removing state" podUID="58046c91-9885-452a-ae30-01edbceb6312" containerName="istio-proxy"
Oct 30 20:09:56.847895 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:56.847408    6275 memory_manager.go:365] "RemoveStaleState removing state" podUID="9cba92db-f8aa-4a79-9b3e-3481fa8b1fbd" containerName="istio-proxy"
Oct 30 20:09:56.847895 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:56.847425    6275 memory_manager.go:365] "RemoveStaleState removing state" podUID="7aed72fd-804a-45b7-9bda-ed055d3a3d6f" containerName="manager"
Oct 30 20:09:56.847895 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:56.847431    6275 memory_manager.go:365] "RemoveStaleState removing state" podUID="debc38ac-d2b2-47f4-b94b-5d140d1b1194" containerName="istio-proxy"
Oct 30 20:09:56.852881 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:56.852852    6275 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-k7qfk"
Oct 30 20:09:56.879801 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:56.879775    6275 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-k7qfk"]
Oct 30 20:09:57.012194 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:57.012161    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/17354614-7251-47e9-a513-b626ebbb598f-workload-socket\") pod \"maas-default-gateway-openshift-default-7f5667f86c-k7qfk\" (UID: \"17354614-7251-47e9-a513-b626ebbb598f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-k7qfk"
Oct 30 20:09:57.012194 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:57.012194    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/17354614-7251-47e9-a513-b626ebbb598f-istio-envoy\") pod \"maas-default-gateway-openshift-default-7f5667f86c-k7qfk\" (UID: \"17354614-7251-47e9-a513-b626ebbb598f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-k7qfk"
Oct 30 20:09:57.012378 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:57.012220    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/17354614-7251-47e9-a513-b626ebbb598f-workload-certs\") pod \"maas-default-gateway-openshift-default-7f5667f86c-k7qfk\" (UID: \"17354614-7251-47e9-a513-b626ebbb598f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-k7qfk"
Oct 30 20:09:57.012378 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:57.012365    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/17354614-7251-47e9-a513-b626ebbb598f-credential-socket\") pod \"maas-default-gateway-openshift-default-7f5667f86c-k7qfk\" (UID: \"17354614-7251-47e9-a513-b626ebbb598f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-k7qfk"
Oct 30 20:09:57.012502 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:57.012481    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/17354614-7251-47e9-a513-b626ebbb598f-istio-podinfo\") pod \"maas-default-gateway-openshift-default-7f5667f86c-k7qfk\" (UID: \"17354614-7251-47e9-a513-b626ebbb598f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-k7qfk"
Oct 30 20:09:57.012537 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:57.012518    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/17354614-7251-47e9-a513-b626ebbb598f-istio-data\") pod \"maas-default-gateway-openshift-default-7f5667f86c-k7qfk\" (UID: \"17354614-7251-47e9-a513-b626ebbb598f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-k7qfk"
Oct 30 20:09:57.012575 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:57.012543    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rqd8d\" (UniqueName: \"kubernetes.io/projected/17354614-7251-47e9-a513-b626ebbb598f-kube-api-access-rqd8d\") pod \"maas-default-gateway-openshift-default-7f5667f86c-k7qfk\" (UID: \"17354614-7251-47e9-a513-b626ebbb598f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-k7qfk"
Oct 30 20:09:57.012634 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:57.012622    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/17354614-7251-47e9-a513-b626ebbb598f-istio-token\") pod \"maas-default-gateway-openshift-default-7f5667f86c-k7qfk\" (UID: \"17354614-7251-47e9-a513-b626ebbb598f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-k7qfk"
Oct 30 20:09:57.012670 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:57.012652    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/17354614-7251-47e9-a513-b626ebbb598f-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-7f5667f86c-k7qfk\" (UID: \"17354614-7251-47e9-a513-b626ebbb598f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-k7qfk"
Oct 30 20:09:57.113248 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:57.113179    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/17354614-7251-47e9-a513-b626ebbb598f-credential-socket\") pod \"maas-default-gateway-openshift-default-7f5667f86c-k7qfk\" (UID: \"17354614-7251-47e9-a513-b626ebbb598f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-k7qfk"
Oct 30 20:09:57.113248 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:57.113224    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/17354614-7251-47e9-a513-b626ebbb598f-istio-podinfo\") pod \"maas-default-gateway-openshift-default-7f5667f86c-k7qfk\" (UID: \"17354614-7251-47e9-a513-b626ebbb598f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-k7qfk"
Oct 30 20:09:57.113248 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:57.113245    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/17354614-7251-47e9-a513-b626ebbb598f-istio-data\") pod \"maas-default-gateway-openshift-default-7f5667f86c-k7qfk\" (UID: \"17354614-7251-47e9-a513-b626ebbb598f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-k7qfk"
Oct 30 20:09:57.113804 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:57.113359    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rqd8d\" (UniqueName: \"kubernetes.io/projected/17354614-7251-47e9-a513-b626ebbb598f-kube-api-access-rqd8d\") pod \"maas-default-gateway-openshift-default-7f5667f86c-k7qfk\" (UID: \"17354614-7251-47e9-a513-b626ebbb598f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-k7qfk"
Oct 30 20:09:57.113804 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:57.113468    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/17354614-7251-47e9-a513-b626ebbb598f-istio-token\") pod \"maas-default-gateway-openshift-default-7f5667f86c-k7qfk\" (UID: \"17354614-7251-47e9-a513-b626ebbb598f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-k7qfk"
Oct 30 20:09:57.113804 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:57.113505    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/17354614-7251-47e9-a513-b626ebbb598f-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-7f5667f86c-k7qfk\" (UID: \"17354614-7251-47e9-a513-b626ebbb598f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-k7qfk"
Oct 30 20:09:57.113804 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:57.113539    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/17354614-7251-47e9-a513-b626ebbb598f-workload-socket\") pod \"maas-default-gateway-openshift-default-7f5667f86c-k7qfk\" (UID: \"17354614-7251-47e9-a513-b626ebbb598f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-k7qfk"
Oct 30 20:09:57.113804 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:57.113570    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/17354614-7251-47e9-a513-b626ebbb598f-istio-envoy\") pod \"maas-default-gateway-openshift-default-7f5667f86c-k7qfk\" (UID: \"17354614-7251-47e9-a513-b626ebbb598f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-k7qfk"
Oct 30 20:09:57.113804 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:57.113653    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/17354614-7251-47e9-a513-b626ebbb598f-istio-data\") pod \"maas-default-gateway-openshift-default-7f5667f86c-k7qfk\" (UID: \"17354614-7251-47e9-a513-b626ebbb598f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-k7qfk"
Oct 30 20:09:57.113804 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:57.113699    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/17354614-7251-47e9-a513-b626ebbb598f-workload-certs\") pod \"maas-default-gateway-openshift-default-7f5667f86c-k7qfk\" (UID: \"17354614-7251-47e9-a513-b626ebbb598f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-k7qfk"
Oct 30 20:09:57.113804 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:57.113786    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/17354614-7251-47e9-a513-b626ebbb598f-credential-socket\") pod \"maas-default-gateway-openshift-default-7f5667f86c-k7qfk\" (UID: \"17354614-7251-47e9-a513-b626ebbb598f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-k7qfk"
Oct 30 20:09:57.114172 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:57.114011    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/17354614-7251-47e9-a513-b626ebbb598f-workload-certs\") pod \"maas-default-gateway-openshift-default-7f5667f86c-k7qfk\" (UID: \"17354614-7251-47e9-a513-b626ebbb598f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-k7qfk"
Oct 30 20:09:57.114172 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:57.114128    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/17354614-7251-47e9-a513-b626ebbb598f-workload-socket\") pod \"maas-default-gateway-openshift-default-7f5667f86c-k7qfk\" (UID: \"17354614-7251-47e9-a513-b626ebbb598f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-k7qfk"
Oct 30 20:09:57.114310 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:57.114232    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/17354614-7251-47e9-a513-b626ebbb598f-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-7f5667f86c-k7qfk\" (UID: \"17354614-7251-47e9-a513-b626ebbb598f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-k7qfk"
Oct 30 20:09:57.115674 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:57.115654    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/17354614-7251-47e9-a513-b626ebbb598f-istio-envoy\") pod \"maas-default-gateway-openshift-default-7f5667f86c-k7qfk\" (UID: \"17354614-7251-47e9-a513-b626ebbb598f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-k7qfk"
Oct 30 20:09:57.115832 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:57.115812    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/17354614-7251-47e9-a513-b626ebbb598f-istio-podinfo\") pod \"maas-default-gateway-openshift-default-7f5667f86c-k7qfk\" (UID: \"17354614-7251-47e9-a513-b626ebbb598f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-k7qfk"
Oct 30 20:09:57.140336 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:57.140312    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rqd8d\" (UniqueName: \"kubernetes.io/projected/17354614-7251-47e9-a513-b626ebbb598f-kube-api-access-rqd8d\") pod \"maas-default-gateway-openshift-default-7f5667f86c-k7qfk\" (UID: \"17354614-7251-47e9-a513-b626ebbb598f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-k7qfk"
Oct 30 20:09:57.142885 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:57.142865    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/17354614-7251-47e9-a513-b626ebbb598f-istio-token\") pod \"maas-default-gateway-openshift-default-7f5667f86c-k7qfk\" (UID: \"17354614-7251-47e9-a513-b626ebbb598f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-k7qfk"
Oct 30 20:09:57.169597 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:57.169577    6275 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-k7qfk"
Oct 30 20:09:57.499196 ip-10-0-131-26 kubenswrapper[6275]: W1030 20:09:57.499166    6275 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod17354614_7251_47e9_a513_b626ebbb598f.slice/crio-b69c2d19cdc87336ea19304ebd03657abc83d2986545f0e49dbb6b0b462a4d18 WatchSource:0}: Error finding container b69c2d19cdc87336ea19304ebd03657abc83d2986545f0e49dbb6b0b462a4d18: Status 404 returned error can't find the container with id b69c2d19cdc87336ea19304ebd03657abc83d2986545f0e49dbb6b0b462a4d18
Oct 30 20:09:57.499744 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:57.499701    6275 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-k7qfk"]
Oct 30 20:09:57.501333 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:57.501300    6275 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Oct 30 20:09:57.501452 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:57.501379    6275 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Oct 30 20:09:57.501452 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:57.501444    6275 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Oct 30 20:09:57.656591 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:57.656561    6275 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="06c43bdd-ba3d-4400-bcef-38aa8900fab9" path="/var/lib/kubelet/pods/06c43bdd-ba3d-4400-bcef-38aa8900fab9/volumes"
Oct 30 20:09:58.000944 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:58.000902    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-k7qfk" event={"ID":"17354614-7251-47e9-a513-b626ebbb598f","Type":"ContainerStarted","Data":"4ce54f2e77930c427f821df668db327e80b088471af857a0320692acfa28b7e7"}
Oct 30 20:09:58.001127 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:58.000959    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-k7qfk" event={"ID":"17354614-7251-47e9-a513-b626ebbb598f","Type":"ContainerStarted","Data":"b69c2d19cdc87336ea19304ebd03657abc83d2986545f0e49dbb6b0b462a4d18"}
Oct 30 20:09:58.092883 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:58.092814    6275 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-k7qfk" podStartSLOduration=2.092793831 podStartE2EDuration="2.092793831s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:09:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:09:58.091666258 +0000 UTC m=+1308.553393122" watchObservedRunningTime="2026-10-30 20:09:58.092793831 +0000 UTC m=+1308.554520694"
Oct 30 20:09:58.175308 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:58.174891    6275 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-k7qfk"
Oct 30 20:09:58.175308 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:58.175009    6275 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-7f5667f86c-k7qfk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.122:15021/healthz/ready\": dial tcp 10.134.0.122:15021: connect: connection refused" start-of-body=
Oct 30 20:09:58.175308 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:58.175052    6275 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-k7qfk" podUID="17354614-7251-47e9-a513-b626ebbb598f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.122:15021/healthz/ready\": dial tcp 10.134.0.122:15021: connect: connection refused"
Oct 30 20:09:59.188436 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:59.185769    6275 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-7f5667f86c-k7qfk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.122:15021/healthz/ready\": dial tcp 10.134.0.122:15021: connect: connection refused" start-of-body=
Oct 30 20:09:59.188436 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:09:59.185841    6275 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-k7qfk" podUID="17354614-7251-47e9-a513-b626ebbb598f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.122:15021/healthz/ready\": dial tcp 10.134.0.122:15021: connect: connection refused"
Oct 30 20:10:00.192790 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:10:00.192754    6275 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-7f5667f86c-k7qfk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.122:15021/healthz/ready\": dial tcp 10.134.0.122:15021: connect: connection refused" start-of-body=
Oct 30 20:10:00.193179 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:10:00.192809    6275 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-k7qfk" podUID="17354614-7251-47e9-a513-b626ebbb598f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.122:15021/healthz/ready\": dial tcp 10.134.0.122:15021: connect: connection refused"
Oct 30 20:10:01.172596 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:10:01.172559    6275 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-7f5667f86c-k7qfk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.122:15021/healthz/ready\": dial tcp 10.134.0.122:15021: connect: connection refused" start-of-body=
Oct 30 20:10:01.180438 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:10:01.172833    6275 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-k7qfk" podUID="17354614-7251-47e9-a513-b626ebbb598f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.122:15021/healthz/ready\": dial tcp 10.134.0.122:15021: connect: connection refused"
Oct 30 20:10:02.181220 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:10:02.180773    6275 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-7f5667f86c-k7qfk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.122:15021/healthz/ready\": dial tcp 10.134.0.122:15021: connect: connection refused" start-of-body=
Oct 30 20:10:02.181220 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:10:02.180848    6275 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-k7qfk" podUID="17354614-7251-47e9-a513-b626ebbb598f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.122:15021/healthz/ready\": dial tcp 10.134.0.122:15021: connect: connection refused"
Oct 30 20:10:03.189438 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:10:03.188750    6275 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-7f5667f86c-k7qfk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.122:15021/healthz/ready\": dial tcp 10.134.0.122:15021: connect: connection refused" start-of-body=
Oct 30 20:10:03.189438 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:10:03.188808    6275 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-k7qfk" podUID="17354614-7251-47e9-a513-b626ebbb598f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.122:15021/healthz/ready\": dial tcp 10.134.0.122:15021: connect: connection refused"
Oct 30 20:10:04.170199 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:10:04.170160    6275 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-7f5667f86c-k7qfk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.122:15021/healthz/ready\": dial tcp 10.134.0.122:15021: connect: connection refused" start-of-body=
Oct 30 20:10:04.170466 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:10:04.170212    6275 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-k7qfk" podUID="17354614-7251-47e9-a513-b626ebbb598f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.122:15021/healthz/ready\": dial tcp 10.134.0.122:15021: connect: connection refused"
Oct 30 20:10:06.048335 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:10:06.048300    6275 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-ef633838-985mx"]
Oct 30 20:10:06.062761 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:10:06.061502    6275 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-ef633838-985mx"]
Oct 30 20:10:06.171306 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:10:06.171269    6275 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-7f5667f86c-k7qfk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.122:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 20:10:06.171484 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:10:06.171345    6275 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-k7qfk" podUID="17354614-7251-47e9-a513-b626ebbb598f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.122:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:10:07.213575 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:10:07.213538    6275 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-7f5667f86c-k7qfk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.122:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 20:10:07.214045 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:10:07.213594    6275 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-k7qfk" podUID="17354614-7251-47e9-a513-b626ebbb598f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.122:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:10:07.655429 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:10:07.655388    6275 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="3512c823-6e15-4af0-a335-94ea4301f98d" path="/var/lib/kubelet/pods/3512c823-6e15-4af0-a335-94ea4301f98d/volumes"
Oct 30 20:10:07.725645 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:10:07.725613    6275 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-k7qfk"
Oct 30 20:10:07.726049 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:10:07.726026    6275 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-k7qfk"
Oct 30 20:10:07.726813 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:10:07.726795    6275 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-k7qfk"
Oct 30 20:10:26.254194 ip-10-0-131-26 kubenswrapper[6275]: E1030 20:10:26.254152    6275 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-fwc77" containerName="extractor"
Oct 30 20:10:28.036149 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:10:28.036111    6275 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-ee93db57-hqf8x"]
Oct 30 20:10:28.048858 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:10:28.048832    6275 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-ee93db57-hqf8x"]
Oct 30 20:10:29.655704 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:10:29.655671    6275 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="c4ef2033-aec7-4a1d-adf4-b54c670655b0" path="/var/lib/kubelet/pods/c4ef2033-aec7-4a1d-adf4-b54c670655b0/volumes"
Oct 30 20:10:42.041703 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:10:42.041658    6275 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-1533e373-c74cs"]
Oct 30 20:10:42.051721 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:10:42.051689    6275 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-1533e373-c74cs"]
Oct 30 20:10:43.655975 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:10:43.655937    6275 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="17c0f963-82fe-4691-8950-ba4f9c5cf039" path="/var/lib/kubelet/pods/17c0f963-82fe-4691-8950-ba4f9c5cf039/volumes"
Oct 30 20:10:56.253921 ip-10-0-131-26 kubenswrapper[6275]: E1030 20:10:56.253883    6275 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-fwc77" containerName="extractor"
Oct 30 20:11:04.225551 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:11:04.225508    6275 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-7f5667f86c-mxxll container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.44:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 20:11:04.226208 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:11:04.226166    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-mxxll" podUID="b3c62e4b-11c3-45ba-9e82-274e66592e69" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.44:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:11:06.037175 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:11:06.037136    6275 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-bd10c754-fl2s9"]
Oct 30 20:11:06.049096 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:11:06.049067    6275 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-bd10c754-fl2s9"]
Oct 30 20:11:07.657193 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:11:07.657148    6275 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="a6f740eb-f44f-4992-b923-3a4e08ce0ffc" path="/var/lib/kubelet/pods/a6f740eb-f44f-4992-b923-3a4e08ce0ffc/volumes"
Oct 30 20:11:10.036814 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:11:10.036783    6275 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-fb73b5a9-97xhd"]
Oct 30 20:11:10.049431 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:11:10.049386    6275 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-fb73b5a9-97xhd"]
Oct 30 20:11:10.568498 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:11:10.568468    6275 scope.go:122] "RemoveContainer" containerID="43f04bf65176fd917842acc23b132b4c14b6c0253eb6f2e5e6ff6ae6f06e5086"
Oct 30 20:11:10.579064 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:11:10.579030    6275 scope.go:122] "RemoveContainer" containerID="5aff5e524b4212f56c176044fa6ac07478337806110f0d239ae2da3acca592e2"
Oct 30 20:11:10.590305 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:11:10.590288    6275 scope.go:122] "RemoveContainer" containerID="b37d0ef399e5a48573054aaadb877ec27adf74071af97ee8e64b3b907912ee4e"
Oct 30 20:11:10.599146 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:11:10.599115    6275 scope.go:122] "RemoveContainer" containerID="10744d2f8c53962545b4195f9dd6314d5c578544b4f7b673ed4af9239536b641"
Oct 30 20:11:10.607558 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:11:10.607538    6275 scope.go:122] "RemoveContainer" containerID="06c3d98df953f5effa394353fe86f952af5b52a033052e15693c11753b50b0a2"
Oct 30 20:11:11.655024 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:11:11.654987    6275 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="396012b6-77a0-48cf-ae34-1fb7aa45f214" path="/var/lib/kubelet/pods/396012b6-77a0-48cf-ae34-1fb7aa45f214/volumes"
Oct 30 20:11:26.254874 ip-10-0-131-26 kubenswrapper[6275]: E1030 20:11:26.254834    6275 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-fwc77" containerName="extractor"
Oct 30 20:11:27.038180 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:11:27.038146    6275 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-c16272d2-4k2d6"]
Oct 30 20:11:27.050859 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:11:27.050826    6275 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-c16272d2-4k2d6"]
Oct 30 20:11:27.655913 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:11:27.655877    6275 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="28444cd2-19ee-4c34-bb96-69c8d22feb2a" path="/var/lib/kubelet/pods/28444cd2-19ee-4c34-bb96-69c8d22feb2a/volumes"
Oct 30 20:11:30.036459 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:11:30.036426    6275 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-a475348d-4lhjg"]
Oct 30 20:11:30.049263 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:11:30.049236    6275 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-a475348d-4lhjg"]
Oct 30 20:11:31.655835 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:11:31.655799    6275 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="92ec4258-14ad-48b4-aca6-4716ebb37ec8" path="/var/lib/kubelet/pods/92ec4258-14ad-48b4-aca6-4716ebb37ec8/volumes"
Oct 30 20:11:50.035488 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:11:50.035449    6275 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-06b9ffc0-gn8wh"]
Oct 30 20:11:50.048301 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:11:50.048265    6275 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-06b9ffc0-gn8wh"]
Oct 30 20:11:51.656501 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:11:51.656474    6275 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="e879d637-cf0f-42f4-979f-2b3230566adb" path="/var/lib/kubelet/pods/e879d637-cf0f-42f4-979f-2b3230566adb/volumes"
Oct 30 20:11:53.035754 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:11:53.035716    6275 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-a7979478-fmqll"]
Oct 30 20:11:53.048711 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:11:53.048681    6275 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-a7979478-fmqll"]
Oct 30 20:11:53.655389 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:11:53.655355    6275 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="dab4f278-63ea-4343-9292-8b1c6cda24ee" path="/var/lib/kubelet/pods/dab4f278-63ea-4343-9292-8b1c6cda24ee/volumes"
Oct 30 20:11:56.254861 ip-10-0-131-26 kubenswrapper[6275]: E1030 20:11:56.254825    6275 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-fwc77" containerName="extractor"
Oct 30 20:12:10.647085 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:12:10.647050    6275 scope.go:122] "RemoveContainer" containerID="5819a342726608d4281edc073e212c131a161c9f7717a58aceac370b1a5665a7"
Oct 30 20:12:10.656597 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:12:10.656546    6275 scope.go:122] "RemoveContainer" containerID="02b7c3a38a90534a68c257a39467a9151e3021f2cb613b38ae23ffa1cf1d11e1"
Oct 30 20:12:10.665328 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:12:10.665304    6275 scope.go:122] "RemoveContainer" containerID="d989f5d11bc6d0d36019494128c9297505051dbe54dd89b845550a9605ca7352"
Oct 30 20:12:10.678048 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:12:10.678019    6275 scope.go:122] "RemoveContainer" containerID="db8545b14c445024bf7ec13e75956b562f80641333a7fb011fafe28eb7afa41c"
Oct 30 20:12:10.687702 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:12:10.687680    6275 scope.go:122] "RemoveContainer" containerID="71e3b30b0a4e9db23c724f202ba676ddc248495f9cb9629afcc0ba3d6b23aa50"
Oct 30 20:12:16.037133 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:12:16.037096    6275 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-cbe808b7-lzctx"]
Oct 30 20:12:16.049939 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:12:16.049912    6275 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-cbe808b7-lzctx"]
Oct 30 20:12:17.656784 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:12:17.656750    6275 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="d7fea45f-b700-4c5a-b101-3c37c7351729" path="/var/lib/kubelet/pods/d7fea45f-b700-4c5a-b101-3c37c7351729/volumes"
Oct 30 20:12:26.254344 ip-10-0-131-26 kubenswrapper[6275]: E1030 20:12:26.254257    6275 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-fwc77" containerName="extractor"
Oct 30 20:12:27.044563 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:12:27.044530    6275 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-b54cc4a5-ttvwv"]
Oct 30 20:12:27.056950 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:12:27.056921    6275 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-73085560-nwxrn"]
Oct 30 20:12:27.059012 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:12:27.058988    6275 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-b54cc4a5-ttvwv"]
Oct 30 20:12:27.060782 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:12:27.060757    6275 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-73085560-nwxrn"]
Oct 30 20:12:27.070696 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:12:27.070674    6275 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-8375ad3d-nz2zn"]
Oct 30 20:12:27.073146 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:12:27.073125    6275 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-8375ad3d-nz2zn"]
Oct 30 20:12:27.655922 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:12:27.655884    6275 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="0382c156-57ff-4ae5-afbb-d2c7683c8272" path="/var/lib/kubelet/pods/0382c156-57ff-4ae5-afbb-d2c7683c8272/volumes"
Oct 30 20:12:27.656398 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:12:27.656302    6275 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="7058df15-c069-4553-8453-46b806ffb18b" path="/var/lib/kubelet/pods/7058df15-c069-4553-8453-46b806ffb18b/volumes"
Oct 30 20:12:27.656705 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:12:27.656691    6275 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="b195a865-3ec2-4556-969e-161d7edfe96d" path="/var/lib/kubelet/pods/b195a865-3ec2-4556-969e-161d7edfe96d/volumes"
Oct 30 20:12:34.258570 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:12:34.258525    6275 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-7f5667f86c-mxxll container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.44:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 20:12:34.259086 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:12:34.258588    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-mxxll" podUID="b3c62e4b-11c3-45ba-9e82-274e66592e69" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.44:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:12:38.035732 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:12:38.035697    6275 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-bcdd07d8-w54ql"]
Oct 30 20:12:38.048734 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:12:38.048701    6275 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-bcdd07d8-w54ql"]
Oct 30 20:12:39.655819 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:12:39.655789    6275 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="4d8499e4-5a30-454c-b2e0-47f47651220f" path="/var/lib/kubelet/pods/4d8499e4-5a30-454c-b2e0-47f47651220f/volumes"
Oct 30 20:12:55.038859 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:12:55.038824    6275 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-6d58de42-bk9lp"]
Oct 30 20:12:55.051602 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:12:55.051572    6275 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-6d58de42-bk9lp"]
Oct 30 20:12:55.658600 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:12:55.658556    6275 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="80aca8dc-febd-440a-80e8-7216a642911c" path="/var/lib/kubelet/pods/80aca8dc-febd-440a-80e8-7216a642911c/volumes"
Oct 30 20:12:56.255675 ip-10-0-131-26 kubenswrapper[6275]: E1030 20:12:56.255635    6275 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-fwc77" containerName="extractor"
Oct 30 20:13:03.037923 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:13:03.037887    6275 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-7a9e878d-xhhls"]
Oct 30 20:13:03.050383 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:13:03.050357    6275 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-7a9e878d-xhhls"]
Oct 30 20:13:03.656362 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:13:03.656323    6275 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="2df32608-dcec-4946-acc6-957287e09fbb" path="/var/lib/kubelet/pods/2df32608-dcec-4946-acc6-957287e09fbb/volumes"
Oct 30 20:13:05.036358 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:13:05.036306    6275 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-dc2c5ee5-q2jfx"]
Oct 30 20:13:05.049112 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:13:05.049084    6275 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-dc2c5ee5-q2jfx"]
Oct 30 20:13:05.655291 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:13:05.655257    6275 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="328802e4-c003-41a2-a292-1f735cc8cec9" path="/var/lib/kubelet/pods/328802e4-c003-41a2-a292-1f735cc8cec9/volumes"
Oct 30 20:13:10.726509 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:13:10.726477    6275 scope.go:122] "RemoveContainer" containerID="23150de94504eb3d6e4943e9ae01a000643be0d05ffeeda3cd4df0aeb371ba19"
Oct 30 20:13:10.735252 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:13:10.735231    6275 scope.go:122] "RemoveContainer" containerID="dc52b908f14bc9b86b912855ec360cd02e3cd5a460475e5912aca5c13900c82f"
Oct 30 20:13:10.743509 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:13:10.743490    6275 scope.go:122] "RemoveContainer" containerID="5c960b55c9414229b7fdafcd3a290229387bd6c24584da7b1660910f7d7ce6cd"
Oct 30 20:13:10.751283 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:13:10.751267    6275 scope.go:122] "RemoveContainer" containerID="3c6feefcb98409d46dde5e2d50a81960b73bae9da01e3d3d62a33578f0e483e8"
Oct 30 20:13:10.758972 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:13:10.758949    6275 scope.go:122] "RemoveContainer" containerID="7ef93492d05a655eb7c8227e76299cd7b87efba426d463e8a0a7875c6c376f86"
Oct 30 20:13:26.255300 ip-10-0-131-26 kubenswrapper[6275]: E1030 20:13:26.255260    6275 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-fwc77" containerName="extractor"
Oct 30 20:13:32.035447 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:13:32.035398    6275 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-b4cf9b1f-5klgm"]
Oct 30 20:13:32.047865 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:13:32.047842    6275 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-b4cf9b1f-5klgm"]
Oct 30 20:13:32.385028 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:13:32.384938    6275 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-sgdlr"]
Oct 30 20:13:32.385202 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:13:32.385131    6275 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-sgdlr" podUID="4e8840f7-113f-409e-bba7-3f8ec2dabb56" containerName="discovery" containerID="cri-o://4a6fdcc22d0894973b6cdf7cf6d33721e8a6a5a782cbc3578e87b9ba6e8e8fb4" gracePeriod=30
Oct 30 20:13:32.637948 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:13:32.637888    6275 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-sgdlr"
Oct 30 20:13:32.692974 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:13:32.692947    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/4e8840f7-113f-409e-bba7-3f8ec2dabb56-istio-token\" (UniqueName: \"kubernetes.io/projected/4e8840f7-113f-409e-bba7-3f8ec2dabb56-istio-token\") pod \"4e8840f7-113f-409e-bba7-3f8ec2dabb56\" (UID: \"4e8840f7-113f-409e-bba7-3f8ec2dabb56\") "
Oct 30 20:13:32.693121 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:13:32.692990    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/4e8840f7-113f-409e-bba7-3f8ec2dabb56-local-certs\" (UniqueName: \"kubernetes.io/empty-dir/4e8840f7-113f-409e-bba7-3f8ec2dabb56-local-certs\") pod \"4e8840f7-113f-409e-bba7-3f8ec2dabb56\" (UID: \"4e8840f7-113f-409e-bba7-3f8ec2dabb56\") "
Oct 30 20:13:32.693121 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:13:32.693024    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/4e8840f7-113f-409e-bba7-3f8ec2dabb56-cacerts\" (UniqueName: \"kubernetes.io/secret/4e8840f7-113f-409e-bba7-3f8ec2dabb56-cacerts\") pod \"4e8840f7-113f-409e-bba7-3f8ec2dabb56\" (UID: \"4e8840f7-113f-409e-bba7-3f8ec2dabb56\") "
Oct 30 20:13:32.693121 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:13:32.693080    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/4e8840f7-113f-409e-bba7-3f8ec2dabb56-istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/4e8840f7-113f-409e-bba7-3f8ec2dabb56-istio-kubeconfig\") pod \"4e8840f7-113f-409e-bba7-3f8ec2dabb56\" (UID: \"4e8840f7-113f-409e-bba7-3f8ec2dabb56\") "
Oct 30 20:13:32.693285 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:13:32.693118    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/4e8840f7-113f-409e-bba7-3f8ec2dabb56-istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/4e8840f7-113f-409e-bba7-3f8ec2dabb56-istio-csr-dns-cert\") pod \"4e8840f7-113f-409e-bba7-3f8ec2dabb56\" (UID: \"4e8840f7-113f-409e-bba7-3f8ec2dabb56\") "
Oct 30 20:13:32.693285 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:13:32.693183    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/4e8840f7-113f-409e-bba7-3f8ec2dabb56-istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/4e8840f7-113f-409e-bba7-3f8ec2dabb56-istio-csr-ca-configmap\") pod \"4e8840f7-113f-409e-bba7-3f8ec2dabb56\" (UID: \"4e8840f7-113f-409e-bba7-3f8ec2dabb56\") "
Oct 30 20:13:32.693285 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:13:32.693269    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/4e8840f7-113f-409e-bba7-3f8ec2dabb56-kube-api-access-g6c67\" (UniqueName: \"kubernetes.io/projected/4e8840f7-113f-409e-bba7-3f8ec2dabb56-kube-api-access-g6c67\") pod \"4e8840f7-113f-409e-bba7-3f8ec2dabb56\" (UID: \"4e8840f7-113f-409e-bba7-3f8ec2dabb56\") "
Oct 30 20:13:32.693757 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:13:32.693724    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4e8840f7-113f-409e-bba7-3f8ec2dabb56-istio-csr-ca-configmap" pod "4e8840f7-113f-409e-bba7-3f8ec2dabb56" (UID: "4e8840f7-113f-409e-bba7-3f8ec2dabb56"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:13:32.695691 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:13:32.695666    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4e8840f7-113f-409e-bba7-3f8ec2dabb56-cacerts" pod "4e8840f7-113f-409e-bba7-3f8ec2dabb56" (UID: "4e8840f7-113f-409e-bba7-3f8ec2dabb56"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 20:13:32.695928 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:13:32.695901    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4e8840f7-113f-409e-bba7-3f8ec2dabb56-local-certs" pod "4e8840f7-113f-409e-bba7-3f8ec2dabb56" (UID: "4e8840f7-113f-409e-bba7-3f8ec2dabb56"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:13:32.696037 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:13:32.695930    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4e8840f7-113f-409e-bba7-3f8ec2dabb56-istio-kubeconfig" pod "4e8840f7-113f-409e-bba7-3f8ec2dabb56" (UID: "4e8840f7-113f-409e-bba7-3f8ec2dabb56"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 20:13:32.696779 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:13:32.696753    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4e8840f7-113f-409e-bba7-3f8ec2dabb56-istio-csr-dns-cert" pod "4e8840f7-113f-409e-bba7-3f8ec2dabb56" (UID: "4e8840f7-113f-409e-bba7-3f8ec2dabb56"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 20:13:32.696864 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:13:32.696839    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4e8840f7-113f-409e-bba7-3f8ec2dabb56-istio-token" pod "4e8840f7-113f-409e-bba7-3f8ec2dabb56" (UID: "4e8840f7-113f-409e-bba7-3f8ec2dabb56"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:13:32.696911 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:13:32.696864    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4e8840f7-113f-409e-bba7-3f8ec2dabb56-kube-api-access-g6c67" pod "4e8840f7-113f-409e-bba7-3f8ec2dabb56" (UID: "4e8840f7-113f-409e-bba7-3f8ec2dabb56"). InnerVolumeSpecName "kube-api-access-g6c67". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:13:32.794758 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:13:32.794732    6275 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/4e8840f7-113f-409e-bba7-3f8ec2dabb56-istio-csr-ca-configmap\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:13:32.794758 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:13:32.794757    6275 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g6c67\" (UniqueName: \"kubernetes.io/projected/4e8840f7-113f-409e-bba7-3f8ec2dabb56-kube-api-access-g6c67\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:13:32.794917 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:13:32.794767    6275 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4e8840f7-113f-409e-bba7-3f8ec2dabb56-istio-token\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:13:32.794917 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:13:32.794776    6275 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/4e8840f7-113f-409e-bba7-3f8ec2dabb56-local-certs\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:13:32.794917 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:13:32.794787    6275 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/4e8840f7-113f-409e-bba7-3f8ec2dabb56-cacerts\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:13:32.794917 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:13:32.794795    6275 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/4e8840f7-113f-409e-bba7-3f8ec2dabb56-istio-kubeconfig\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:13:32.794917 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:13:32.794802    6275 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/4e8840f7-113f-409e-bba7-3f8ec2dabb56-istio-csr-dns-cert\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:13:33.463157 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:13:33.463125    6275 generic.go:356] "Generic (PLEG): container finished" podID="4e8840f7-113f-409e-bba7-3f8ec2dabb56" containerID="4a6fdcc22d0894973b6cdf7cf6d33721e8a6a5a782cbc3578e87b9ba6e8e8fb4" exitCode=0
Oct 30 20:13:33.463634 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:13:33.463175    6275 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-sgdlr"
Oct 30 20:13:33.463634 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:13:33.463212    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-sgdlr" event={"ID":"4e8840f7-113f-409e-bba7-3f8ec2dabb56","Type":"ContainerDied","Data":"4a6fdcc22d0894973b6cdf7cf6d33721e8a6a5a782cbc3578e87b9ba6e8e8fb4"}
Oct 30 20:13:33.463634 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:13:33.463266    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-sgdlr" event={"ID":"4e8840f7-113f-409e-bba7-3f8ec2dabb56","Type":"ContainerDied","Data":"bf29d4f48417242054a9b8ebfe3745959bd2451cb546cdcbf35ebd175efbccdd"}
Oct 30 20:13:33.463634 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:13:33.463295    6275 scope.go:122] "RemoveContainer" containerID="4a6fdcc22d0894973b6cdf7cf6d33721e8a6a5a782cbc3578e87b9ba6e8e8fb4"
Oct 30 20:13:33.473925 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:13:33.473906    6275 scope.go:122] "RemoveContainer" containerID="4a6fdcc22d0894973b6cdf7cf6d33721e8a6a5a782cbc3578e87b9ba6e8e8fb4"
Oct 30 20:13:33.474182 ip-10-0-131-26 kubenswrapper[6275]: E1030 20:13:33.474160    6275 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4a6fdcc22d0894973b6cdf7cf6d33721e8a6a5a782cbc3578e87b9ba6e8e8fb4\": container with ID starting with 4a6fdcc22d0894973b6cdf7cf6d33721e8a6a5a782cbc3578e87b9ba6e8e8fb4 not found: ID does not exist" containerID="4a6fdcc22d0894973b6cdf7cf6d33721e8a6a5a782cbc3578e87b9ba6e8e8fb4"
Oct 30 20:13:33.474244 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:13:33.474196    6275 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4a6fdcc22d0894973b6cdf7cf6d33721e8a6a5a782cbc3578e87b9ba6e8e8fb4"} err="failed to get container status \"4a6fdcc22d0894973b6cdf7cf6d33721e8a6a5a782cbc3578e87b9ba6e8e8fb4\": rpc error: code = NotFound desc = could not find container \"4a6fdcc22d0894973b6cdf7cf6d33721e8a6a5a782cbc3578e87b9ba6e8e8fb4\": container with ID starting with 4a6fdcc22d0894973b6cdf7cf6d33721e8a6a5a782cbc3578e87b9ba6e8e8fb4 not found: ID does not exist"
Oct 30 20:13:33.533431 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:13:33.533399    6275 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-sgdlr"]
Oct 30 20:13:33.546260 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:13:33.546237    6275 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-sgdlr"]
Oct 30 20:13:33.663738 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:13:33.658175    6275 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="4e8840f7-113f-409e-bba7-3f8ec2dabb56" path="/var/lib/kubelet/pods/4e8840f7-113f-409e-bba7-3f8ec2dabb56/volumes"
Oct 30 20:13:33.663738 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:13:33.658823    6275 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="e6ac148d-3229-49ab-861f-7b79b60febc4" path="/var/lib/kubelet/pods/e6ac148d-3229-49ab-861f-7b79b60febc4/volumes"
Oct 30 20:13:44.036083 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:13:44.036041    6275 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-0dbf386e-g9v54"]
Oct 30 20:13:44.048724 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:13:44.048691    6275 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-0dbf386e-g9v54"]
Oct 30 20:13:45.654830 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:13:45.654789    6275 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="561556e4-1b94-4e88-8eed-f6bc003bbb91" path="/var/lib/kubelet/pods/561556e4-1b94-4e88-8eed-f6bc003bbb91/volumes"
Oct 30 20:13:56.253669 ip-10-0-131-26 kubenswrapper[6275]: E1030 20:13:56.253632    6275 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-fwc77" containerName="extractor"
Oct 30 20:13:58.053724 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:13:58.053691    6275 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-e456a47a-slmkd"]
Oct 30 20:13:58.066465 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:13:58.066409    6275 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-e456a47a-slmkd"]
Oct 30 20:13:59.661155 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:13:59.661121    6275 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="d866bc34-401f-412e-a16a-72328de246f4" path="/var/lib/kubelet/pods/d866bc34-401f-412e-a16a-72328de246f4/volumes"
Oct 30 20:14:07.047450 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:14:07.047399    6275 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-03fa6844-dx2t4"]
Oct 30 20:14:07.059977 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:14:07.059951    6275 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-03fa6844-dx2t4"]
Oct 30 20:14:07.655568 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:14:07.655526    6275 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="0a672bb2-1f1b-4ec3-a67f-28b288eaa651" path="/var/lib/kubelet/pods/0a672bb2-1f1b-4ec3-a67f-28b288eaa651/volumes"
Oct 30 20:14:10.800883 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:14:10.800851    6275 scope.go:122] "RemoveContainer" containerID="07a7ac7d7535d87e7d3610097af1ac4d9cda00bbe17fa4daf839a2aceb3425b6"
Oct 30 20:14:10.809680 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:14:10.809662    6275 scope.go:122] "RemoveContainer" containerID="87cfaf2aa3a663c77ebdb8ca8164ad49bf80789409dc5f3123feed1a45335d13"
Oct 30 20:14:10.817710 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:14:10.817694    6275 scope.go:122] "RemoveContainer" containerID="6664fecfdf89b53dee44d1d7627e20a3bb35d7927cc2dcd6a60bafea288ab55a"
Oct 30 20:14:10.825290 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:14:10.825271    6275 scope.go:122] "RemoveContainer" containerID="c1620a4325294ed952b14094e2a50820250ddb529ee33d3058358c29f400c047"
Oct 30 20:14:10.832724 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:14:10.832701    6275 scope.go:122] "RemoveContainer" containerID="f3a6652a093454add87f53cb6d0998d5d709ed07531c18e91fecd3ba9fc1e8e1"
Oct 30 20:14:10.840169 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:14:10.840148    6275 scope.go:122] "RemoveContainer" containerID="384092fc1005e98dcf66e2b687ba654c46bf3a90f9e3548b5668de57bb9968f3"
Oct 30 20:14:10.847488 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:14:10.847462    6275 scope.go:122] "RemoveContainer" containerID="124aa29fa9f29e01fd00543070e00a87e2aa990c1788484e2f8d51171fe2a077"
Oct 30 20:14:10.854855 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:14:10.854835    6275 scope.go:122] "RemoveContainer" containerID="6e874a0974e31f90fc0b5029c0a892b0eed64c39561797aeeb59c5277e72809d"
Oct 30 20:14:10.862067 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:14:10.862050    6275 scope.go:122] "RemoveContainer" containerID="ea0bd832eacde17de5f33c2c6e23844dad8e0f24fe7dba576381d1c3e2d6a4f2"
Oct 30 20:14:10.869221 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:14:10.869205    6275 scope.go:122] "RemoveContainer" containerID="6bc23c053f01f18f86151407718119ba712acd0f8751a4c20ed2f03f29992e19"
Oct 30 20:14:26.254832 ip-10-0-131-26 kubenswrapper[6275]: E1030 20:14:26.254786    6275 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-fwc77" containerName="extractor"
Oct 30 20:14:55.886023 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:14:55.885984    6275 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-single-main-a989da/simulator-single-main-a989da-kserve-8558dccd5b-rnn9g"]
Oct 30 20:14:55.886550 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:14:55.886388    6275 cpu_manager.go:414] "containerMap: removing container" podUID="4e8840f7-113f-409e-bba7-3f8ec2dabb56" containerName="discovery"
Oct 30 20:14:55.886550 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:14:55.886400    6275 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="4e8840f7-113f-409e-bba7-3f8ec2dabb56" containerName="discovery"
Oct 30 20:14:55.886550 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:14:55.886532    6275 memory_manager.go:365] "RemoveStaleState removing state" podUID="4e8840f7-113f-409e-bba7-3f8ec2dabb56" containerName="discovery"
Oct 30 20:14:55.889883 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:14:55.889856    6275 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-single-main-a989da/simulator-single-main-a989da-kserve-8558dccd5b-rnn9g"
Oct 30 20:14:55.906810 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:14:55.906787    6275 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-single-main-a989da\"/\"default-dockercfg-7cgt7\""
Oct 30 20:14:55.919848 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:14:55.919819    6275 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-single-main-a989da\"/\"openshift-service-ca.crt\""
Oct 30 20:14:55.919848 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:14:55.919821    6275 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-single-main-a989da\"/\"kube-root-ca.crt\""
Oct 30 20:14:55.922789 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:14:55.922765    6275 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-single-main-a989da/simulator-single-main-a989da-kserve-8558dccd5b-rnn9g"]
Oct 30 20:14:56.004248 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:14:56.004223    6275 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-single-main-a989da\"/\"simulator-single-main-a989da-kserve-self-signed-certs\""
Oct 30 20:14:56.025813 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:14:56.025785    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e5f5b836-3b42-4629-bfdc-1b29b076aef0-tls-certs\") pod \"simulator-single-main-a989da-kserve-8558dccd5b-rnn9g\" (UID: \"e5f5b836-3b42-4629-bfdc-1b29b076aef0\") " pod="e2e-models-e2e-worker-single-main-a989da/simulator-single-main-a989da-kserve-8558dccd5b-rnn9g"
Oct 30 20:14:56.025945 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:14:56.025831    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e5f5b836-3b42-4629-bfdc-1b29b076aef0-tmp-dir\") pod \"simulator-single-main-a989da-kserve-8558dccd5b-rnn9g\" (UID: \"e5f5b836-3b42-4629-bfdc-1b29b076aef0\") " pod="e2e-models-e2e-worker-single-main-a989da/simulator-single-main-a989da-kserve-8558dccd5b-rnn9g"
Oct 30 20:14:56.025945 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:14:56.025934    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e5f5b836-3b42-4629-bfdc-1b29b076aef0-home\") pod \"simulator-single-main-a989da-kserve-8558dccd5b-rnn9g\" (UID: \"e5f5b836-3b42-4629-bfdc-1b29b076aef0\") " pod="e2e-models-e2e-worker-single-main-a989da/simulator-single-main-a989da-kserve-8558dccd5b-rnn9g"
Oct 30 20:14:56.026074 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:14:56.025969    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e5f5b836-3b42-4629-bfdc-1b29b076aef0-dshm\") pod \"simulator-single-main-a989da-kserve-8558dccd5b-rnn9g\" (UID: \"e5f5b836-3b42-4629-bfdc-1b29b076aef0\") " pod="e2e-models-e2e-worker-single-main-a989da/simulator-single-main-a989da-kserve-8558dccd5b-rnn9g"
Oct 30 20:14:56.026074 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:14:56.025990    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-96hxp\" (UniqueName: \"kubernetes.io/projected/e5f5b836-3b42-4629-bfdc-1b29b076aef0-kube-api-access-96hxp\") pod \"simulator-single-main-a989da-kserve-8558dccd5b-rnn9g\" (UID: \"e5f5b836-3b42-4629-bfdc-1b29b076aef0\") " pod="e2e-models-e2e-worker-single-main-a989da/simulator-single-main-a989da-kserve-8558dccd5b-rnn9g"
Oct 30 20:14:56.026222 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:14:56.026195    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e5f5b836-3b42-4629-bfdc-1b29b076aef0-model-cache\") pod \"simulator-single-main-a989da-kserve-8558dccd5b-rnn9g\" (UID: \"e5f5b836-3b42-4629-bfdc-1b29b076aef0\") " pod="e2e-models-e2e-worker-single-main-a989da/simulator-single-main-a989da-kserve-8558dccd5b-rnn9g"
Oct 30 20:14:56.126990 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:14:56.126960    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e5f5b836-3b42-4629-bfdc-1b29b076aef0-model-cache\") pod \"simulator-single-main-a989da-kserve-8558dccd5b-rnn9g\" (UID: \"e5f5b836-3b42-4629-bfdc-1b29b076aef0\") " pod="e2e-models-e2e-worker-single-main-a989da/simulator-single-main-a989da-kserve-8558dccd5b-rnn9g"
Oct 30 20:14:56.127129 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:14:56.127005    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e5f5b836-3b42-4629-bfdc-1b29b076aef0-tls-certs\") pod \"simulator-single-main-a989da-kserve-8558dccd5b-rnn9g\" (UID: \"e5f5b836-3b42-4629-bfdc-1b29b076aef0\") " pod="e2e-models-e2e-worker-single-main-a989da/simulator-single-main-a989da-kserve-8558dccd5b-rnn9g"
Oct 30 20:14:56.127129 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:14:56.127112    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e5f5b836-3b42-4629-bfdc-1b29b076aef0-tmp-dir\") pod \"simulator-single-main-a989da-kserve-8558dccd5b-rnn9g\" (UID: \"e5f5b836-3b42-4629-bfdc-1b29b076aef0\") " pod="e2e-models-e2e-worker-single-main-a989da/simulator-single-main-a989da-kserve-8558dccd5b-rnn9g"
Oct 30 20:14:56.127247 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:14:56.127176    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e5f5b836-3b42-4629-bfdc-1b29b076aef0-home\") pod \"simulator-single-main-a989da-kserve-8558dccd5b-rnn9g\" (UID: \"e5f5b836-3b42-4629-bfdc-1b29b076aef0\") " pod="e2e-models-e2e-worker-single-main-a989da/simulator-single-main-a989da-kserve-8558dccd5b-rnn9g"
Oct 30 20:14:56.127247 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:14:56.127216    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e5f5b836-3b42-4629-bfdc-1b29b076aef0-dshm\") pod \"simulator-single-main-a989da-kserve-8558dccd5b-rnn9g\" (UID: \"e5f5b836-3b42-4629-bfdc-1b29b076aef0\") " pod="e2e-models-e2e-worker-single-main-a989da/simulator-single-main-a989da-kserve-8558dccd5b-rnn9g"
Oct 30 20:14:56.127357 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:14:56.127244    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-96hxp\" (UniqueName: \"kubernetes.io/projected/e5f5b836-3b42-4629-bfdc-1b29b076aef0-kube-api-access-96hxp\") pod \"simulator-single-main-a989da-kserve-8558dccd5b-rnn9g\" (UID: \"e5f5b836-3b42-4629-bfdc-1b29b076aef0\") " pod="e2e-models-e2e-worker-single-main-a989da/simulator-single-main-a989da-kserve-8558dccd5b-rnn9g"
Oct 30 20:14:56.127445 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:14:56.127405    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e5f5b836-3b42-4629-bfdc-1b29b076aef0-model-cache\") pod \"simulator-single-main-a989da-kserve-8558dccd5b-rnn9g\" (UID: \"e5f5b836-3b42-4629-bfdc-1b29b076aef0\") " pod="e2e-models-e2e-worker-single-main-a989da/simulator-single-main-a989da-kserve-8558dccd5b-rnn9g"
Oct 30 20:14:56.127515 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:14:56.127443    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e5f5b836-3b42-4629-bfdc-1b29b076aef0-tmp-dir\") pod \"simulator-single-main-a989da-kserve-8558dccd5b-rnn9g\" (UID: \"e5f5b836-3b42-4629-bfdc-1b29b076aef0\") " pod="e2e-models-e2e-worker-single-main-a989da/simulator-single-main-a989da-kserve-8558dccd5b-rnn9g"
Oct 30 20:14:56.127575 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:14:56.127553    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e5f5b836-3b42-4629-bfdc-1b29b076aef0-home\") pod \"simulator-single-main-a989da-kserve-8558dccd5b-rnn9g\" (UID: \"e5f5b836-3b42-4629-bfdc-1b29b076aef0\") " pod="e2e-models-e2e-worker-single-main-a989da/simulator-single-main-a989da-kserve-8558dccd5b-rnn9g"
Oct 30 20:14:56.129515 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:14:56.129483    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e5f5b836-3b42-4629-bfdc-1b29b076aef0-dshm\") pod \"simulator-single-main-a989da-kserve-8558dccd5b-rnn9g\" (UID: \"e5f5b836-3b42-4629-bfdc-1b29b076aef0\") " pod="e2e-models-e2e-worker-single-main-a989da/simulator-single-main-a989da-kserve-8558dccd5b-rnn9g"
Oct 30 20:14:56.129678 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:14:56.129663    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e5f5b836-3b42-4629-bfdc-1b29b076aef0-tls-certs\") pod \"simulator-single-main-a989da-kserve-8558dccd5b-rnn9g\" (UID: \"e5f5b836-3b42-4629-bfdc-1b29b076aef0\") " pod="e2e-models-e2e-worker-single-main-a989da/simulator-single-main-a989da-kserve-8558dccd5b-rnn9g"
Oct 30 20:14:56.154650 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:14:56.154571    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-96hxp\" (UniqueName: \"kubernetes.io/projected/e5f5b836-3b42-4629-bfdc-1b29b076aef0-kube-api-access-96hxp\") pod \"simulator-single-main-a989da-kserve-8558dccd5b-rnn9g\" (UID: \"e5f5b836-3b42-4629-bfdc-1b29b076aef0\") " pod="e2e-models-e2e-worker-single-main-a989da/simulator-single-main-a989da-kserve-8558dccd5b-rnn9g"
Oct 30 20:14:56.202511 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:14:56.202482    6275 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-single-main-a989da/simulator-single-main-a989da-kserve-8558dccd5b-rnn9g"
Oct 30 20:14:56.258365 ip-10-0-131-26 kubenswrapper[6275]: E1030 20:14:56.258201    6275 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-fwc77" containerName="extractor"
Oct 30 20:14:56.507201 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:14:56.507175    6275 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-single-main-a989da/simulator-single-main-a989da-kserve-8558dccd5b-rnn9g"]
Oct 30 20:14:56.508476 ip-10-0-131-26 kubenswrapper[6275]: W1030 20:14:56.508449    6275 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode5f5b836_3b42_4629_bfdc_1b29b076aef0.slice/crio-2b66ada6d8a1b16389f381f02e68b412f4a511850ac2f7286c138f7c60d1dd0f WatchSource:0}: Error finding container 2b66ada6d8a1b16389f381f02e68b412f4a511850ac2f7286c138f7c60d1dd0f: Status 404 returned error can't find the container with id 2b66ada6d8a1b16389f381f02e68b412f4a511850ac2f7286c138f7c60d1dd0f
Oct 30 20:14:56.942816 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:14:56.942733    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-single-main-a989da/simulator-single-main-a989da-kserve-8558dccd5b-rnn9g" event={"ID":"e5f5b836-3b42-4629-bfdc-1b29b076aef0","Type":"ContainerStarted","Data":"6fa193de87b5f6bb1b0cc357143add93e7d75de2914bc7b332605d09f7744212"}
Oct 30 20:14:56.942816 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:14:56.942781    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-single-main-a989da/simulator-single-main-a989da-kserve-8558dccd5b-rnn9g" event={"ID":"e5f5b836-3b42-4629-bfdc-1b29b076aef0","Type":"ContainerStarted","Data":"2b66ada6d8a1b16389f381f02e68b412f4a511850ac2f7286c138f7c60d1dd0f"}
Oct 30 20:14:56.994603 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:14:56.994554    6275 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-single-main-a989da/simulator-single-main-a989da-kserve-8558dccd5b-rnn9g" podStartSLOduration=1.9945404469999999 podStartE2EDuration="1.994540447s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:14:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:14:56.993000298 +0000 UTC m=+1607.454727160" watchObservedRunningTime="2026-10-30 20:14:56.994540447 +0000 UTC m=+1607.456267310"
Oct 30 20:14:57.202822 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:14:57.202755    6275 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-single-main-a989da/simulator-single-main-a989da-kserve-8558dccd5b-rnn9g"
Oct 30 20:15:00.149529 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:15:00.149498    6275 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-single-main-a989da-2988985wjcp6"]
Oct 30 20:15:00.153199 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:15:00.153177    6275 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-single-main-a989da-2988985wjcp6"
Oct 30 20:15:00.163259 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:15:00.163235    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/50f49ae8-d314-4a0e-988c-acc6f421a754-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-worker-single-main-a989da-2988985wjcp6\" (UID: \"50f49ae8-d314-4a0e-988c-acc6f421a754\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-single-main-a989da-2988985wjcp6"
Oct 30 20:15:00.163376 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:15:00.163357    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7bg6g\" (UniqueName: \"kubernetes.io/projected/50f49ae8-d314-4a0e-988c-acc6f421a754-kube-api-access-7bg6g\") pod \"maas-api-key-cleanup-e2e-worker-single-main-a989da-2988985wjcp6\" (UID: \"50f49ae8-d314-4a0e-988c-acc6f421a754\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-single-main-a989da-2988985wjcp6"
Oct 30 20:15:00.184343 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:15:00.184319    6275 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-single-main-a989da-2988985wjcp6"]
Oct 30 20:15:00.193913 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:15:00.193887    6275 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-scs2w\""
Oct 30 20:15:00.264375 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:15:00.264350    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/50f49ae8-d314-4a0e-988c-acc6f421a754-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-worker-single-main-a989da-2988985wjcp6\" (UID: \"50f49ae8-d314-4a0e-988c-acc6f421a754\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-single-main-a989da-2988985wjcp6"
Oct 30 20:15:00.264513 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:15:00.264449    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7bg6g\" (UniqueName: \"kubernetes.io/projected/50f49ae8-d314-4a0e-988c-acc6f421a754-kube-api-access-7bg6g\") pod \"maas-api-key-cleanup-e2e-worker-single-main-a989da-2988985wjcp6\" (UID: \"50f49ae8-d314-4a0e-988c-acc6f421a754\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-single-main-a989da-2988985wjcp6"
Oct 30 20:15:00.264999 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:15:00.264981    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/50f49ae8-d314-4a0e-988c-acc6f421a754-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-worker-single-main-a989da-2988985wjcp6\" (UID: \"50f49ae8-d314-4a0e-988c-acc6f421a754\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-single-main-a989da-2988985wjcp6"
Oct 30 20:15:00.294212 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:15:00.294192    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7bg6g\" (UniqueName: \"kubernetes.io/projected/50f49ae8-d314-4a0e-988c-acc6f421a754-kube-api-access-7bg6g\") pod \"maas-api-key-cleanup-e2e-worker-single-main-a989da-2988985wjcp6\" (UID: \"50f49ae8-d314-4a0e-988c-acc6f421a754\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-single-main-a989da-2988985wjcp6"
Oct 30 20:15:00.466225 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:15:00.466151    6275 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-single-main-a989da-2988985wjcp6"
Oct 30 20:15:00.767857 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:15:00.767833    6275 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-single-main-a989da-2988985wjcp6"]
Oct 30 20:15:00.769635 ip-10-0-131-26 kubenswrapper[6275]: W1030 20:15:00.769610    6275 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod50f49ae8_d314_4a0e_988c_acc6f421a754.slice/crio-9962d16577c53b7e6d468df666793253ef25a0af21e7bac709769e5663e0006e WatchSource:0}: Error finding container 9962d16577c53b7e6d468df666793253ef25a0af21e7bac709769e5663e0006e: Status 404 returned error can't find the container with id 9962d16577c53b7e6d468df666793253ef25a0af21e7bac709769e5663e0006e
Oct 30 20:15:00.964343 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:15:00.964314    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-single-main-a989da-2988985wjcp6" event={"ID":"50f49ae8-d314-4a0e-988c-acc6f421a754","Type":"ContainerStarted","Data":"9962d16577c53b7e6d468df666793253ef25a0af21e7bac709769e5663e0006e"}
Oct 30 20:15:01.971260 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:15:01.971177    6275 generic.go:356] "Generic (PLEG): container finished" podID="50f49ae8-d314-4a0e-988c-acc6f421a754" containerID="67617b6baca6e577263cdf96f5b87e22c97002986e8295ec4d8a4fdfd50d9ad9" exitCode=60
Oct 30 20:15:01.971648 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:15:01.971259    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-single-main-a989da-2988985wjcp6" event={"ID":"50f49ae8-d314-4a0e-988c-acc6f421a754","Type":"ContainerDied","Data":"67617b6baca6e577263cdf96f5b87e22c97002986e8295ec4d8a4fdfd50d9ad9"}
Oct 30 20:15:01.971648 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:15:01.971450    6275 scope.go:122] "RemoveContainer" containerID="67617b6baca6e577263cdf96f5b87e22c97002986e8295ec4d8a4fdfd50d9ad9"
Oct 30 20:15:02.978557 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:15:02.978490    6275 generic.go:356] "Generic (PLEG): container finished" podID="50f49ae8-d314-4a0e-988c-acc6f421a754" containerID="03d3ce9d51c7c3fd81425e2bcd6fa8918c0a98f63b5ff9c410d5e8b8199ef5cd" exitCode=60
Oct 30 20:15:02.978910 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:15:02.978584    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-single-main-a989da-2988985wjcp6" event={"ID":"50f49ae8-d314-4a0e-988c-acc6f421a754","Type":"ContainerDied","Data":"03d3ce9d51c7c3fd81425e2bcd6fa8918c0a98f63b5ff9c410d5e8b8199ef5cd"}
Oct 30 20:15:02.978910 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:15:02.978647    6275 scope.go:122] "RemoveContainer" containerID="67617b6baca6e577263cdf96f5b87e22c97002986e8295ec4d8a4fdfd50d9ad9"
Oct 30 20:15:02.978910 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:15:02.978836    6275 scope.go:122] "RemoveContainer" containerID="03d3ce9d51c7c3fd81425e2bcd6fa8918c0a98f63b5ff9c410d5e8b8199ef5cd"
Oct 30 20:15:02.979082 ip-10-0-131-26 kubenswrapper[6275]: E1030 20:15:02.979062    6275 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-worker-single-main-a989da-2988985wjcp6_odh-ai-gateway-infra(50f49ae8-d314-4a0e-988c-acc6f421a754)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-single-main-a989da-2988985wjcp6" podUID="50f49ae8-d314-4a0e-988c-acc6f421a754"
Oct 30 20:15:03.985815 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:15:03.985790    6275 scope.go:122] "RemoveContainer" containerID="03d3ce9d51c7c3fd81425e2bcd6fa8918c0a98f63b5ff9c410d5e8b8199ef5cd"
Oct 30 20:15:03.986201 ip-10-0-131-26 kubenswrapper[6275]: E1030 20:15:03.985982    6275 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-worker-single-main-a989da-2988985wjcp6_odh-ai-gateway-infra(50f49ae8-d314-4a0e-988c-acc6f421a754)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-single-main-a989da-2988985wjcp6" podUID="50f49ae8-d314-4a0e-988c-acc6f421a754"
Oct 30 20:15:06.203581 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:15:06.203540    6275 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-single-main-a989da/simulator-single-main-a989da-kserve-8558dccd5b-rnn9g"
Oct 30 20:15:06.221648 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:15:06.221620    6275 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-single-main-a989da/simulator-single-main-a989da-kserve-8558dccd5b-rnn9g"
Oct 30 20:15:07.012843 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:15:07.012815    6275 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-single-main-a989da/simulator-single-main-a989da-kserve-8558dccd5b-rnn9g"
Oct 30 20:15:10.927477 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:15:10.927445    6275 scope.go:122] "RemoveContainer" containerID="01767d5a810b557718fb39eb02da5c3f3d3f87d1fa95ecaf9a1329552cec4c1c"
Oct 30 20:15:10.936065 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:15:10.936046    6275 scope.go:122] "RemoveContainer" containerID="71299610d34ec54db12c15e96ad69c9ac98952c6b441a37cca8db3ea89a424e9"
Oct 30 20:15:10.943534 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:15:10.943509    6275 scope.go:122] "RemoveContainer" containerID="738fac76776e2b60c9f488cdc58a76bef6b91118212496b4cb510e3e22166786"
Oct 30 20:15:10.950623 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:15:10.950606    6275 scope.go:122] "RemoveContainer" containerID="362281d10c3782648e436c2486c334518bc0b1070f8ce9dcab60f7f377ae0dcd"
Oct 30 20:15:10.957748 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:15:10.957731    6275 scope.go:122] "RemoveContainer" containerID="7dbd178239c3e32a9705b054748fb5395d41d3cab2947042d51b87cda15d6d13"
Oct 30 20:15:17.649697 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:15:17.649662    6275 scope.go:122] "RemoveContainer" containerID="03d3ce9d51c7c3fd81425e2bcd6fa8918c0a98f63b5ff9c410d5e8b8199ef5cd"
Oct 30 20:15:18.058216 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:15:18.058190    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-single-main-a989da-2988985wjcp6" event={"ID":"50f49ae8-d314-4a0e-988c-acc6f421a754","Type":"ContainerStarted","Data":"6b960438ba8176481ef1caf9ea8d55f710e3304b6498082f6f5ba31b0ba1cfdf"}
Oct 30 20:15:18.104036 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:15:18.103992    6275 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-single-main-a989da-2988985wjcp6" podStartSLOduration=18.103978747 podStartE2EDuration="18.103978747s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:15:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:15:18.102472338 +0000 UTC m=+1628.564199202" watchObservedRunningTime="2026-10-30 20:15:18.103978747 +0000 UTC m=+1628.565705609"
Oct 30 20:15:19.064986 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:15:19.064956    6275 generic.go:356] "Generic (PLEG): container finished" podID="50f49ae8-d314-4a0e-988c-acc6f421a754" containerID="6b960438ba8176481ef1caf9ea8d55f710e3304b6498082f6f5ba31b0ba1cfdf" exitCode=60
Oct 30 20:15:19.065428 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:15:19.064992    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-single-main-a989da-2988985wjcp6" event={"ID":"50f49ae8-d314-4a0e-988c-acc6f421a754","Type":"ContainerDied","Data":"6b960438ba8176481ef1caf9ea8d55f710e3304b6498082f6f5ba31b0ba1cfdf"}
Oct 30 20:15:19.065428 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:15:19.065052    6275 scope.go:122] "RemoveContainer" containerID="03d3ce9d51c7c3fd81425e2bcd6fa8918c0a98f63b5ff9c410d5e8b8199ef5cd"
Oct 30 20:15:19.065428 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:15:19.065331    6275 scope.go:122] "RemoveContainer" containerID="6b960438ba8176481ef1caf9ea8d55f710e3304b6498082f6f5ba31b0ba1cfdf"
Oct 30 20:15:19.065644 ip-10-0-131-26 kubenswrapper[6275]: E1030 20:15:19.065619    6275 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 20s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-worker-single-main-a989da-2988985wjcp6_odh-ai-gateway-infra(50f49ae8-d314-4a0e-988c-acc6f421a754)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-single-main-a989da-2988985wjcp6" podUID="50f49ae8-d314-4a0e-988c-acc6f421a754"
Oct 30 20:15:19.120689 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:15:19.120663    6275 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-single-main-a989da-2988985wjcp6"]
Oct 30 20:15:20.211321 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:15:20.211295    6275 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-single-main-a989da-2988985wjcp6"
Oct 30 20:15:20.338786 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:15:20.338713    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/50f49ae8-d314-4a0e-988c-acc6f421a754-maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/50f49ae8-d314-4a0e-988c-acc6f421a754-maas-api-service-ca\") pod \"50f49ae8-d314-4a0e-988c-acc6f421a754\" (UID: \"50f49ae8-d314-4a0e-988c-acc6f421a754\") "
Oct 30 20:15:20.338786 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:15:20.338758    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/50f49ae8-d314-4a0e-988c-acc6f421a754-kube-api-access-7bg6g\" (UniqueName: \"kubernetes.io/projected/50f49ae8-d314-4a0e-988c-acc6f421a754-kube-api-access-7bg6g\") pod \"50f49ae8-d314-4a0e-988c-acc6f421a754\" (UID: \"50f49ae8-d314-4a0e-988c-acc6f421a754\") "
Oct 30 20:15:20.339055 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:15:20.339033    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/50f49ae8-d314-4a0e-988c-acc6f421a754-maas-api-service-ca" pod "50f49ae8-d314-4a0e-988c-acc6f421a754" (UID: "50f49ae8-d314-4a0e-988c-acc6f421a754"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:15:20.340677 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:15:20.340650    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/50f49ae8-d314-4a0e-988c-acc6f421a754-kube-api-access-7bg6g" pod "50f49ae8-d314-4a0e-988c-acc6f421a754" (UID: "50f49ae8-d314-4a0e-988c-acc6f421a754"). InnerVolumeSpecName "kube-api-access-7bg6g". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:15:20.439998 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:15:20.439971    6275 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/50f49ae8-d314-4a0e-988c-acc6f421a754-maas-api-service-ca\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:15:20.439998 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:15:20.439995    6275 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7bg6g\" (UniqueName: \"kubernetes.io/projected/50f49ae8-d314-4a0e-988c-acc6f421a754-kube-api-access-7bg6g\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:15:21.079291 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:15:21.079216    6275 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-single-main-a989da-2988985wjcp6"
Oct 30 20:15:21.079291 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:15:21.079250    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-single-main-a989da-2988985wjcp6" event={"ID":"50f49ae8-d314-4a0e-988c-acc6f421a754","Type":"ContainerDied","Data":"9962d16577c53b7e6d468df666793253ef25a0af21e7bac709769e5663e0006e"}
Oct 30 20:15:21.079534 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:15:21.079320    6275 scope.go:122] "RemoveContainer" containerID="6b960438ba8176481ef1caf9ea8d55f710e3304b6498082f6f5ba31b0ba1cfdf"
Oct 30 20:15:21.139174 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:15:21.139144    6275 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-single-main-a989da-2988985wjcp6"]
Oct 30 20:15:21.151691 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:15:21.151669    6275 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-single-main-a989da-2988985wjcp6"]
Oct 30 20:15:21.658298 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:15:21.658263    6275 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="50f49ae8-d314-4a0e-988c-acc6f421a754" path="/var/lib/kubelet/pods/50f49ae8-d314-4a0e-988c-acc6f421a754/volumes"
Oct 30 20:15:26.257065 ip-10-0-131-26 kubenswrapper[6275]: E1030 20:15:26.257021    6275 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-fwc77" containerName="extractor"
Oct 30 20:15:34.936020 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:15:34.935986    6275 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-single-main-a989da/simulator-single-main-a989da-kserve-8558dccd5b-rnn9g"]
Oct 30 20:15:49.955773 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:15:49.955709    6275 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-single-main-a989da/simulator-single-main-a989da-kserve-8558dccd5b-rnn9g" podUID="e5f5b836-3b42-4629-bfdc-1b29b076aef0" containerName="main" containerID="cri-o://6fa193de87b5f6bb1b0cc357143add93e7d75de2914bc7b332605d09f7744212" gracePeriod=45
Oct 30 20:15:50.002447 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:15:50.002404    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-single-main-a989da/simulator-single-main-a989da-kserve-8558dccd5b-rnn9g" podUID="e5f5b836-3b42-4629-bfdc-1b29b076aef0" containerName="main" probeResult="failure" output="Get \"https://10.134.0.123:8000/ready\": dial tcp 10.134.0.123:8000: connect: connection refused"
Oct 30 20:15:50.214216 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:15:50.214159    6275 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-single-main-a989da/simulator-single-main-a989da-kserve-8558dccd5b-rnn9g"
Oct 30 20:15:50.224207 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:15:50.224178    6275 generic.go:356] "Generic (PLEG): container finished" podID="e5f5b836-3b42-4629-bfdc-1b29b076aef0" containerID="6fa193de87b5f6bb1b0cc357143add93e7d75de2914bc7b332605d09f7744212" exitCode=0
Oct 30 20:15:50.224319 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:15:50.224212    6275 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-single-main-a989da/simulator-single-main-a989da-kserve-8558dccd5b-rnn9g"
Oct 30 20:15:50.224319 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:15:50.224252    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-single-main-a989da/simulator-single-main-a989da-kserve-8558dccd5b-rnn9g" event={"ID":"e5f5b836-3b42-4629-bfdc-1b29b076aef0","Type":"ContainerDied","Data":"6fa193de87b5f6bb1b0cc357143add93e7d75de2914bc7b332605d09f7744212"}
Oct 30 20:15:50.224319 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:15:50.224292    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-single-main-a989da/simulator-single-main-a989da-kserve-8558dccd5b-rnn9g" event={"ID":"e5f5b836-3b42-4629-bfdc-1b29b076aef0","Type":"ContainerDied","Data":"2b66ada6d8a1b16389f381f02e68b412f4a511850ac2f7286c138f7c60d1dd0f"}
Oct 30 20:15:50.224319 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:15:50.224310    6275 scope.go:122] "RemoveContainer" containerID="6fa193de87b5f6bb1b0cc357143add93e7d75de2914bc7b332605d09f7744212"
Oct 30 20:15:50.233798 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:15:50.233722    6275 scope.go:122] "RemoveContainer" containerID="6fa193de87b5f6bb1b0cc357143add93e7d75de2914bc7b332605d09f7744212"
Oct 30 20:15:50.234091 ip-10-0-131-26 kubenswrapper[6275]: E1030 20:15:50.234068    6275 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6fa193de87b5f6bb1b0cc357143add93e7d75de2914bc7b332605d09f7744212\": container with ID starting with 6fa193de87b5f6bb1b0cc357143add93e7d75de2914bc7b332605d09f7744212 not found: ID does not exist" containerID="6fa193de87b5f6bb1b0cc357143add93e7d75de2914bc7b332605d09f7744212"
Oct 30 20:15:50.234204 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:15:50.234099    6275 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6fa193de87b5f6bb1b0cc357143add93e7d75de2914bc7b332605d09f7744212"} err="failed to get container status \"6fa193de87b5f6bb1b0cc357143add93e7d75de2914bc7b332605d09f7744212\": rpc error: code = NotFound desc = could not find container \"6fa193de87b5f6bb1b0cc357143add93e7d75de2914bc7b332605d09f7744212\": container with ID starting with 6fa193de87b5f6bb1b0cc357143add93e7d75de2914bc7b332605d09f7744212 not found: ID does not exist"
Oct 30 20:15:50.288674 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:15:50.288643    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e5f5b836-3b42-4629-bfdc-1b29b076aef0-home\" (UniqueName: \"kubernetes.io/empty-dir/e5f5b836-3b42-4629-bfdc-1b29b076aef0-home\") pod \"e5f5b836-3b42-4629-bfdc-1b29b076aef0\" (UID: \"e5f5b836-3b42-4629-bfdc-1b29b076aef0\") "
Oct 30 20:15:50.288926 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:15:50.288738    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e5f5b836-3b42-4629-bfdc-1b29b076aef0-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e5f5b836-3b42-4629-bfdc-1b29b076aef0-tmp-dir\") pod \"e5f5b836-3b42-4629-bfdc-1b29b076aef0\" (UID: \"e5f5b836-3b42-4629-bfdc-1b29b076aef0\") "
Oct 30 20:15:50.288926 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:15:50.288772    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/e5f5b836-3b42-4629-bfdc-1b29b076aef0-tls-certs\" (UniqueName: \"kubernetes.io/secret/e5f5b836-3b42-4629-bfdc-1b29b076aef0-tls-certs\") pod \"e5f5b836-3b42-4629-bfdc-1b29b076aef0\" (UID: \"e5f5b836-3b42-4629-bfdc-1b29b076aef0\") "
Oct 30 20:15:50.288926 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:15:50.288817    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/e5f5b836-3b42-4629-bfdc-1b29b076aef0-kube-api-access-96hxp\" (UniqueName: \"kubernetes.io/projected/e5f5b836-3b42-4629-bfdc-1b29b076aef0-kube-api-access-96hxp\") pod \"e5f5b836-3b42-4629-bfdc-1b29b076aef0\" (UID: \"e5f5b836-3b42-4629-bfdc-1b29b076aef0\") "
Oct 30 20:15:50.288926 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:15:50.288844    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e5f5b836-3b42-4629-bfdc-1b29b076aef0-dshm\" (UniqueName: \"kubernetes.io/empty-dir/e5f5b836-3b42-4629-bfdc-1b29b076aef0-dshm\") pod \"e5f5b836-3b42-4629-bfdc-1b29b076aef0\" (UID: \"e5f5b836-3b42-4629-bfdc-1b29b076aef0\") "
Oct 30 20:15:50.289182 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:15:50.288922    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e5f5b836-3b42-4629-bfdc-1b29b076aef0-home" pod "e5f5b836-3b42-4629-bfdc-1b29b076aef0" (UID: "e5f5b836-3b42-4629-bfdc-1b29b076aef0"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:15:50.289182 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:15:50.288966    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e5f5b836-3b42-4629-bfdc-1b29b076aef0-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e5f5b836-3b42-4629-bfdc-1b29b076aef0-model-cache\") pod \"e5f5b836-3b42-4629-bfdc-1b29b076aef0\" (UID: \"e5f5b836-3b42-4629-bfdc-1b29b076aef0\") "
Oct 30 20:15:50.289182 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:15:50.289007    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e5f5b836-3b42-4629-bfdc-1b29b076aef0-tmp-dir" pod "e5f5b836-3b42-4629-bfdc-1b29b076aef0" (UID: "e5f5b836-3b42-4629-bfdc-1b29b076aef0"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:15:50.289352 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:15:50.289302    6275 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e5f5b836-3b42-4629-bfdc-1b29b076aef0-home\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:15:50.289352 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:15:50.289333    6275 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e5f5b836-3b42-4629-bfdc-1b29b076aef0-tmp-dir\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:15:50.289508 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:15:50.289336    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e5f5b836-3b42-4629-bfdc-1b29b076aef0-model-cache" pod "e5f5b836-3b42-4629-bfdc-1b29b076aef0" (UID: "e5f5b836-3b42-4629-bfdc-1b29b076aef0"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:15:50.291272 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:15:50.291246    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e5f5b836-3b42-4629-bfdc-1b29b076aef0-dshm" pod "e5f5b836-3b42-4629-bfdc-1b29b076aef0" (UID: "e5f5b836-3b42-4629-bfdc-1b29b076aef0"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:15:50.291498 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:15:50.291476    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e5f5b836-3b42-4629-bfdc-1b29b076aef0-tls-certs" pod "e5f5b836-3b42-4629-bfdc-1b29b076aef0" (UID: "e5f5b836-3b42-4629-bfdc-1b29b076aef0"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 20:15:50.291651 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:15:50.291633    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e5f5b836-3b42-4629-bfdc-1b29b076aef0-kube-api-access-96hxp" pod "e5f5b836-3b42-4629-bfdc-1b29b076aef0" (UID: "e5f5b836-3b42-4629-bfdc-1b29b076aef0"). InnerVolumeSpecName "kube-api-access-96hxp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:15:50.390309 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:15:50.390274    6275 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e5f5b836-3b42-4629-bfdc-1b29b076aef0-model-cache\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:15:50.390309 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:15:50.390301    6275 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e5f5b836-3b42-4629-bfdc-1b29b076aef0-tls-certs\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:15:50.390309 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:15:50.390310    6275 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-96hxp\" (UniqueName: \"kubernetes.io/projected/e5f5b836-3b42-4629-bfdc-1b29b076aef0-kube-api-access-96hxp\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:15:50.390556 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:15:50.390321    6275 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e5f5b836-3b42-4629-bfdc-1b29b076aef0-dshm\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:15:50.572346 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:15:50.572320    6275 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-single-main-a989da/simulator-single-main-a989da-kserve-8558dccd5b-rnn9g"]
Oct 30 20:15:50.579169 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:15:50.579147    6275 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-single-main-a989da/simulator-single-main-a989da-kserve-8558dccd5b-rnn9g"]
Oct 30 20:15:51.655674 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:15:51.655644    6275 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="e5f5b836-3b42-4629-bfdc-1b29b076aef0" path="/var/lib/kubelet/pods/e5f5b836-3b42-4629-bfdc-1b29b076aef0/volumes"
Oct 30 20:15:56.256580 ip-10-0-131-26 kubenswrapper[6275]: E1030 20:15:56.256543    6275 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-fwc77" containerName="extractor"
Oct 30 20:16:26.255038 ip-10-0-131-26 kubenswrapper[6275]: E1030 20:16:26.255000    6275 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-fwc77" containerName="extractor"
Oct 30 20:16:56.255141 ip-10-0-131-26 kubenswrapper[6275]: E1030 20:16:56.255098    6275 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-fwc77" containerName="extractor"
Oct 30 20:17:26.254379 ip-10-0-131-26 kubenswrapper[6275]: E1030 20:17:26.254337    6275 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-fwc77" containerName="extractor"
Oct 30 20:17:56.257485 ip-10-0-131-26 kubenswrapper[6275]: E1030 20:17:56.257436    6275 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-fwc77" containerName="extractor"
Oct 30 20:18:26.257736 ip-10-0-131-26 kubenswrapper[6275]: E1030 20:18:26.257650    6275 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-fwc77" containerName="extractor"
Oct 30 20:18:32.286030 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:18:32.285987    6275 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-single-main-5d6bba/simulator-single-main-5d6bba-kserve-7f655d6d46-srvlm"]
Oct 30 20:18:32.286626 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:18:32.286606    6275 cpu_manager.go:414] "containerMap: removing container" podUID="e5f5b836-3b42-4629-bfdc-1b29b076aef0" containerName="main"
Oct 30 20:18:32.286700 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:18:32.286629    6275 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="e5f5b836-3b42-4629-bfdc-1b29b076aef0" containerName="main"
Oct 30 20:18:32.286700 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:18:32.286657    6275 cpu_manager.go:414] "containerMap: removing container" podUID="50f49ae8-d314-4a0e-988c-acc6f421a754" containerName="cleanup"
Oct 30 20:18:32.286700 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:18:32.286664    6275 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="50f49ae8-d314-4a0e-988c-acc6f421a754" containerName="cleanup"
Oct 30 20:18:32.286700 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:18:32.286692    6275 cpu_manager.go:414] "containerMap: removing container" podUID="50f49ae8-d314-4a0e-988c-acc6f421a754" containerName="cleanup"
Oct 30 20:18:32.286700 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:18:32.286700    6275 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="50f49ae8-d314-4a0e-988c-acc6f421a754" containerName="cleanup"
Oct 30 20:18:32.286880 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:18:32.286720    6275 cpu_manager.go:414] "containerMap: removing container" podUID="50f49ae8-d314-4a0e-988c-acc6f421a754" containerName="cleanup"
Oct 30 20:18:32.286880 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:18:32.286727    6275 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="50f49ae8-d314-4a0e-988c-acc6f421a754" containerName="cleanup"
Oct 30 20:18:32.286880 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:18:32.286827    6275 memory_manager.go:365] "RemoveStaleState removing state" podUID="50f49ae8-d314-4a0e-988c-acc6f421a754" containerName="cleanup"
Oct 30 20:18:32.286880 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:18:32.286842    6275 memory_manager.go:365] "RemoveStaleState removing state" podUID="50f49ae8-d314-4a0e-988c-acc6f421a754" containerName="cleanup"
Oct 30 20:18:32.286880 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:18:32.286857    6275 memory_manager.go:365] "RemoveStaleState removing state" podUID="e5f5b836-3b42-4629-bfdc-1b29b076aef0" containerName="main"
Oct 30 20:18:32.290329 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:18:32.290308    6275 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-single-main-5d6bba/simulator-single-main-5d6bba-kserve-7f655d6d46-srvlm"
Oct 30 20:18:32.319544 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:18:32.319520    6275 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-single-main-5d6bba\"/\"kube-root-ca.crt\""
Oct 30 20:18:32.319673 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:18:32.319542    6275 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-single-main-5d6bba\"/\"simulator-single-main-5d6bba-kserve-self-signed-certs\""
Oct 30 20:18:32.319673 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:18:32.319545    6275 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-single-main-5d6bba\"/\"default-dockercfg-bs49k\""
Oct 30 20:18:32.319872 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:18:32.319859    6275 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-single-main-5d6bba\"/\"openshift-service-ca.crt\""
Oct 30 20:18:32.321998 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:18:32.321979    6275 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-single-main-5d6bba/simulator-single-main-5d6bba-kserve-7f655d6d46-srvlm"]
Oct 30 20:18:32.323528 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:18:32.323503    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5199d8f6-dbe7-4dfd-bdb2-1fc75a938bd2-dshm\") pod \"simulator-single-main-5d6bba-kserve-7f655d6d46-srvlm\" (UID: \"5199d8f6-dbe7-4dfd-bdb2-1fc75a938bd2\") " pod="e2e-models-e2e-worker-single-main-5d6bba/simulator-single-main-5d6bba-kserve-7f655d6d46-srvlm"
Oct 30 20:18:32.323628 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:18:32.323548    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5199d8f6-dbe7-4dfd-bdb2-1fc75a938bd2-tls-certs\") pod \"simulator-single-main-5d6bba-kserve-7f655d6d46-srvlm\" (UID: \"5199d8f6-dbe7-4dfd-bdb2-1fc75a938bd2\") " pod="e2e-models-e2e-worker-single-main-5d6bba/simulator-single-main-5d6bba-kserve-7f655d6d46-srvlm"
Oct 30 20:18:32.323628 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:18:32.323566    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5199d8f6-dbe7-4dfd-bdb2-1fc75a938bd2-tmp-dir\") pod \"simulator-single-main-5d6bba-kserve-7f655d6d46-srvlm\" (UID: \"5199d8f6-dbe7-4dfd-bdb2-1fc75a938bd2\") " pod="e2e-models-e2e-worker-single-main-5d6bba/simulator-single-main-5d6bba-kserve-7f655d6d46-srvlm"
Oct 30 20:18:32.323720 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:18:32.323649    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5199d8f6-dbe7-4dfd-bdb2-1fc75a938bd2-model-cache\") pod \"simulator-single-main-5d6bba-kserve-7f655d6d46-srvlm\" (UID: \"5199d8f6-dbe7-4dfd-bdb2-1fc75a938bd2\") " pod="e2e-models-e2e-worker-single-main-5d6bba/simulator-single-main-5d6bba-kserve-7f655d6d46-srvlm"
Oct 30 20:18:32.323782 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:18:32.323757    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-82brp\" (UniqueName: \"kubernetes.io/projected/5199d8f6-dbe7-4dfd-bdb2-1fc75a938bd2-kube-api-access-82brp\") pod \"simulator-single-main-5d6bba-kserve-7f655d6d46-srvlm\" (UID: \"5199d8f6-dbe7-4dfd-bdb2-1fc75a938bd2\") " pod="e2e-models-e2e-worker-single-main-5d6bba/simulator-single-main-5d6bba-kserve-7f655d6d46-srvlm"
Oct 30 20:18:32.323847 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:18:32.323830    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5199d8f6-dbe7-4dfd-bdb2-1fc75a938bd2-home\") pod \"simulator-single-main-5d6bba-kserve-7f655d6d46-srvlm\" (UID: \"5199d8f6-dbe7-4dfd-bdb2-1fc75a938bd2\") " pod="e2e-models-e2e-worker-single-main-5d6bba/simulator-single-main-5d6bba-kserve-7f655d6d46-srvlm"
Oct 30 20:18:32.425227 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:18:32.425205    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-82brp\" (UniqueName: \"kubernetes.io/projected/5199d8f6-dbe7-4dfd-bdb2-1fc75a938bd2-kube-api-access-82brp\") pod \"simulator-single-main-5d6bba-kserve-7f655d6d46-srvlm\" (UID: \"5199d8f6-dbe7-4dfd-bdb2-1fc75a938bd2\") " pod="e2e-models-e2e-worker-single-main-5d6bba/simulator-single-main-5d6bba-kserve-7f655d6d46-srvlm"
Oct 30 20:18:32.425333 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:18:32.425249    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5199d8f6-dbe7-4dfd-bdb2-1fc75a938bd2-home\") pod \"simulator-single-main-5d6bba-kserve-7f655d6d46-srvlm\" (UID: \"5199d8f6-dbe7-4dfd-bdb2-1fc75a938bd2\") " pod="e2e-models-e2e-worker-single-main-5d6bba/simulator-single-main-5d6bba-kserve-7f655d6d46-srvlm"
Oct 30 20:18:32.425333 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:18:32.425305    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5199d8f6-dbe7-4dfd-bdb2-1fc75a938bd2-dshm\") pod \"simulator-single-main-5d6bba-kserve-7f655d6d46-srvlm\" (UID: \"5199d8f6-dbe7-4dfd-bdb2-1fc75a938bd2\") " pod="e2e-models-e2e-worker-single-main-5d6bba/simulator-single-main-5d6bba-kserve-7f655d6d46-srvlm"
Oct 30 20:18:32.425479 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:18:32.425344    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5199d8f6-dbe7-4dfd-bdb2-1fc75a938bd2-tls-certs\") pod \"simulator-single-main-5d6bba-kserve-7f655d6d46-srvlm\" (UID: \"5199d8f6-dbe7-4dfd-bdb2-1fc75a938bd2\") " pod="e2e-models-e2e-worker-single-main-5d6bba/simulator-single-main-5d6bba-kserve-7f655d6d46-srvlm"
Oct 30 20:18:32.425479 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:18:32.425361    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5199d8f6-dbe7-4dfd-bdb2-1fc75a938bd2-tmp-dir\") pod \"simulator-single-main-5d6bba-kserve-7f655d6d46-srvlm\" (UID: \"5199d8f6-dbe7-4dfd-bdb2-1fc75a938bd2\") " pod="e2e-models-e2e-worker-single-main-5d6bba/simulator-single-main-5d6bba-kserve-7f655d6d46-srvlm"
Oct 30 20:18:32.425479 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:18:32.425377    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5199d8f6-dbe7-4dfd-bdb2-1fc75a938bd2-model-cache\") pod \"simulator-single-main-5d6bba-kserve-7f655d6d46-srvlm\" (UID: \"5199d8f6-dbe7-4dfd-bdb2-1fc75a938bd2\") " pod="e2e-models-e2e-worker-single-main-5d6bba/simulator-single-main-5d6bba-kserve-7f655d6d46-srvlm"
Oct 30 20:18:32.425766 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:18:32.425741    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5199d8f6-dbe7-4dfd-bdb2-1fc75a938bd2-home\") pod \"simulator-single-main-5d6bba-kserve-7f655d6d46-srvlm\" (UID: \"5199d8f6-dbe7-4dfd-bdb2-1fc75a938bd2\") " pod="e2e-models-e2e-worker-single-main-5d6bba/simulator-single-main-5d6bba-kserve-7f655d6d46-srvlm"
Oct 30 20:18:32.425898 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:18:32.425843    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5199d8f6-dbe7-4dfd-bdb2-1fc75a938bd2-tmp-dir\") pod \"simulator-single-main-5d6bba-kserve-7f655d6d46-srvlm\" (UID: \"5199d8f6-dbe7-4dfd-bdb2-1fc75a938bd2\") " pod="e2e-models-e2e-worker-single-main-5d6bba/simulator-single-main-5d6bba-kserve-7f655d6d46-srvlm"
Oct 30 20:18:32.425898 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:18:32.425883    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5199d8f6-dbe7-4dfd-bdb2-1fc75a938bd2-model-cache\") pod \"simulator-single-main-5d6bba-kserve-7f655d6d46-srvlm\" (UID: \"5199d8f6-dbe7-4dfd-bdb2-1fc75a938bd2\") " pod="e2e-models-e2e-worker-single-main-5d6bba/simulator-single-main-5d6bba-kserve-7f655d6d46-srvlm"
Oct 30 20:18:32.427717 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:18:32.427693    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5199d8f6-dbe7-4dfd-bdb2-1fc75a938bd2-dshm\") pod \"simulator-single-main-5d6bba-kserve-7f655d6d46-srvlm\" (UID: \"5199d8f6-dbe7-4dfd-bdb2-1fc75a938bd2\") " pod="e2e-models-e2e-worker-single-main-5d6bba/simulator-single-main-5d6bba-kserve-7f655d6d46-srvlm"
Oct 30 20:18:32.427869 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:18:32.427853    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5199d8f6-dbe7-4dfd-bdb2-1fc75a938bd2-tls-certs\") pod \"simulator-single-main-5d6bba-kserve-7f655d6d46-srvlm\" (UID: \"5199d8f6-dbe7-4dfd-bdb2-1fc75a938bd2\") " pod="e2e-models-e2e-worker-single-main-5d6bba/simulator-single-main-5d6bba-kserve-7f655d6d46-srvlm"
Oct 30 20:18:32.453961 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:18:32.453939    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-82brp\" (UniqueName: \"kubernetes.io/projected/5199d8f6-dbe7-4dfd-bdb2-1fc75a938bd2-kube-api-access-82brp\") pod \"simulator-single-main-5d6bba-kserve-7f655d6d46-srvlm\" (UID: \"5199d8f6-dbe7-4dfd-bdb2-1fc75a938bd2\") " pod="e2e-models-e2e-worker-single-main-5d6bba/simulator-single-main-5d6bba-kserve-7f655d6d46-srvlm"
Oct 30 20:18:32.604543 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:18:32.603506    6275 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-single-main-5d6bba/simulator-single-main-5d6bba-kserve-7f655d6d46-srvlm"
Oct 30 20:18:32.909845 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:18:32.909820    6275 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-single-main-5d6bba/simulator-single-main-5d6bba-kserve-7f655d6d46-srvlm"]
Oct 30 20:18:32.910880 ip-10-0-131-26 kubenswrapper[6275]: W1030 20:18:32.910855    6275 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5199d8f6_dbe7_4dfd_bdb2_1fc75a938bd2.slice/crio-8b86f6c0f3084166768bdecc12c0ed09e8a5cd440610d7a2b5dc2768f8bdc8f7 WatchSource:0}: Error finding container 8b86f6c0f3084166768bdecc12c0ed09e8a5cd440610d7a2b5dc2768f8bdc8f7: Status 404 returned error can't find the container with id 8b86f6c0f3084166768bdecc12c0ed09e8a5cd440610d7a2b5dc2768f8bdc8f7
Oct 30 20:18:33.126119 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:18:33.126083    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-single-main-5d6bba/simulator-single-main-5d6bba-kserve-7f655d6d46-srvlm" event={"ID":"5199d8f6-dbe7-4dfd-bdb2-1fc75a938bd2","Type":"ContainerStarted","Data":"bdcb907e495d8bc8cee1ba64ad656ace7587610af5e74ae724c8676742093885"}
Oct 30 20:18:33.126279 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:18:33.126128    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-single-main-5d6bba/simulator-single-main-5d6bba-kserve-7f655d6d46-srvlm" event={"ID":"5199d8f6-dbe7-4dfd-bdb2-1fc75a938bd2","Type":"ContainerStarted","Data":"8b86f6c0f3084166768bdecc12c0ed09e8a5cd440610d7a2b5dc2768f8bdc8f7"}
Oct 30 20:18:33.171627 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:18:33.171493    6275 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-single-main-5d6bba/simulator-single-main-5d6bba-kserve-7f655d6d46-srvlm" podStartSLOduration=1.171480453 podStartE2EDuration="1.171480453s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:18:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:18:33.169747367 +0000 UTC m=+1823.631474268" watchObservedRunningTime="2026-10-30 20:18:33.171480453 +0000 UTC m=+1823.633207316"
Oct 30 20:18:33.603777 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:18:33.603746    6275 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-single-main-5d6bba/simulator-single-main-5d6bba-kserve-7f655d6d46-srvlm"
Oct 30 20:18:42.603796 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:18:42.603759    6275 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-single-main-5d6bba/simulator-single-main-5d6bba-kserve-7f655d6d46-srvlm"
Oct 30 20:18:42.616222 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:18:42.616192    6275 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-single-main-5d6bba/simulator-single-main-5d6bba-kserve-7f655d6d46-srvlm"
Oct 30 20:18:43.190294 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:18:43.190266    6275 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-single-main-5d6bba/simulator-single-main-5d6bba-kserve-7f655d6d46-srvlm"
Oct 30 20:18:56.255557 ip-10-0-131-26 kubenswrapper[6275]: E1030 20:18:56.255518    6275 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-fwc77" containerName="extractor"
Oct 30 20:19:07.637742 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:19:07.637707    6275 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-single-main-5d6bba/simulator-single-main-5d6bba-kserve-7f655d6d46-srvlm"]
Oct 30 20:19:22.659248 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:19:22.659190    6275 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-single-main-5d6bba/simulator-single-main-5d6bba-kserve-7f655d6d46-srvlm" podUID="5199d8f6-dbe7-4dfd-bdb2-1fc75a938bd2" containerName="main" containerID="cri-o://bdcb907e495d8bc8cee1ba64ad656ace7587610af5e74ae724c8676742093885" gracePeriod=45
Oct 30 20:19:22.915446 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:19:22.915375    6275 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-single-main-5d6bba/simulator-single-main-5d6bba-kserve-7f655d6d46-srvlm"
Oct 30 20:19:22.958728 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:19:22.958705    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/5199d8f6-dbe7-4dfd-bdb2-1fc75a938bd2-home\" (UniqueName: \"kubernetes.io/empty-dir/5199d8f6-dbe7-4dfd-bdb2-1fc75a938bd2-home\") pod \"5199d8f6-dbe7-4dfd-bdb2-1fc75a938bd2\" (UID: \"5199d8f6-dbe7-4dfd-bdb2-1fc75a938bd2\") "
Oct 30 20:19:22.958815 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:19:22.958752    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/5199d8f6-dbe7-4dfd-bdb2-1fc75a938bd2-tls-certs\" (UniqueName: \"kubernetes.io/secret/5199d8f6-dbe7-4dfd-bdb2-1fc75a938bd2-tls-certs\") pod \"5199d8f6-dbe7-4dfd-bdb2-1fc75a938bd2\" (UID: \"5199d8f6-dbe7-4dfd-bdb2-1fc75a938bd2\") "
Oct 30 20:19:22.958815 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:19:22.958777    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/5199d8f6-dbe7-4dfd-bdb2-1fc75a938bd2-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5199d8f6-dbe7-4dfd-bdb2-1fc75a938bd2-model-cache\") pod \"5199d8f6-dbe7-4dfd-bdb2-1fc75a938bd2\" (UID: \"5199d8f6-dbe7-4dfd-bdb2-1fc75a938bd2\") "
Oct 30 20:19:22.958900 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:19:22.958840    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/5199d8f6-dbe7-4dfd-bdb2-1fc75a938bd2-dshm\" (UniqueName: \"kubernetes.io/empty-dir/5199d8f6-dbe7-4dfd-bdb2-1fc75a938bd2-dshm\") pod \"5199d8f6-dbe7-4dfd-bdb2-1fc75a938bd2\" (UID: \"5199d8f6-dbe7-4dfd-bdb2-1fc75a938bd2\") "
Oct 30 20:19:22.958900 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:19:22.958862    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/5199d8f6-dbe7-4dfd-bdb2-1fc75a938bd2-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5199d8f6-dbe7-4dfd-bdb2-1fc75a938bd2-tmp-dir\") pod \"5199d8f6-dbe7-4dfd-bdb2-1fc75a938bd2\" (UID: \"5199d8f6-dbe7-4dfd-bdb2-1fc75a938bd2\") "
Oct 30 20:19:22.958999 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:19:22.958906    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/5199d8f6-dbe7-4dfd-bdb2-1fc75a938bd2-kube-api-access-82brp\" (UniqueName: \"kubernetes.io/projected/5199d8f6-dbe7-4dfd-bdb2-1fc75a938bd2-kube-api-access-82brp\") pod \"5199d8f6-dbe7-4dfd-bdb2-1fc75a938bd2\" (UID: \"5199d8f6-dbe7-4dfd-bdb2-1fc75a938bd2\") "
Oct 30 20:19:22.959050 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:19:22.959013    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5199d8f6-dbe7-4dfd-bdb2-1fc75a938bd2-home" pod "5199d8f6-dbe7-4dfd-bdb2-1fc75a938bd2" (UID: "5199d8f6-dbe7-4dfd-bdb2-1fc75a938bd2"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:19:22.959098 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:19:22.959073    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5199d8f6-dbe7-4dfd-bdb2-1fc75a938bd2-model-cache" pod "5199d8f6-dbe7-4dfd-bdb2-1fc75a938bd2" (UID: "5199d8f6-dbe7-4dfd-bdb2-1fc75a938bd2"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:19:22.959251 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:19:22.959232    6275 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5199d8f6-dbe7-4dfd-bdb2-1fc75a938bd2-home\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:19:22.959321 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:19:22.959254    6275 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5199d8f6-dbe7-4dfd-bdb2-1fc75a938bd2-model-cache\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:19:22.959321 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:19:22.959262    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5199d8f6-dbe7-4dfd-bdb2-1fc75a938bd2-tmp-dir" pod "5199d8f6-dbe7-4dfd-bdb2-1fc75a938bd2" (UID: "5199d8f6-dbe7-4dfd-bdb2-1fc75a938bd2"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:19:22.961336 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:19:22.961295    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5199d8f6-dbe7-4dfd-bdb2-1fc75a938bd2-dshm" pod "5199d8f6-dbe7-4dfd-bdb2-1fc75a938bd2" (UID: "5199d8f6-dbe7-4dfd-bdb2-1fc75a938bd2"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:19:22.961570 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:19:22.961532    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5199d8f6-dbe7-4dfd-bdb2-1fc75a938bd2-tls-certs" pod "5199d8f6-dbe7-4dfd-bdb2-1fc75a938bd2" (UID: "5199d8f6-dbe7-4dfd-bdb2-1fc75a938bd2"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 20:19:22.961903 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:19:22.961877    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5199d8f6-dbe7-4dfd-bdb2-1fc75a938bd2-kube-api-access-82brp" pod "5199d8f6-dbe7-4dfd-bdb2-1fc75a938bd2" (UID: "5199d8f6-dbe7-4dfd-bdb2-1fc75a938bd2"). InnerVolumeSpecName "kube-api-access-82brp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:19:23.060647 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:19:23.060618    6275 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5199d8f6-dbe7-4dfd-bdb2-1fc75a938bd2-dshm\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:19:23.060647 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:19:23.060645    6275 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5199d8f6-dbe7-4dfd-bdb2-1fc75a938bd2-tmp-dir\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:19:23.060820 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:19:23.060655    6275 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-82brp\" (UniqueName: \"kubernetes.io/projected/5199d8f6-dbe7-4dfd-bdb2-1fc75a938bd2-kube-api-access-82brp\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:19:23.060820 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:19:23.060664    6275 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5199d8f6-dbe7-4dfd-bdb2-1fc75a938bd2-tls-certs\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:19:23.378393 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:19:23.378358    6275 generic.go:356] "Generic (PLEG): container finished" podID="5199d8f6-dbe7-4dfd-bdb2-1fc75a938bd2" containerID="bdcb907e495d8bc8cee1ba64ad656ace7587610af5e74ae724c8676742093885" exitCode=0
Oct 30 20:19:23.378557 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:19:23.378398    6275 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-single-main-5d6bba/simulator-single-main-5d6bba-kserve-7f655d6d46-srvlm"
Oct 30 20:19:23.378557 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:19:23.378403    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-single-main-5d6bba/simulator-single-main-5d6bba-kserve-7f655d6d46-srvlm" event={"ID":"5199d8f6-dbe7-4dfd-bdb2-1fc75a938bd2","Type":"ContainerDied","Data":"bdcb907e495d8bc8cee1ba64ad656ace7587610af5e74ae724c8676742093885"}
Oct 30 20:19:23.378557 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:19:23.378455    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-single-main-5d6bba/simulator-single-main-5d6bba-kserve-7f655d6d46-srvlm" event={"ID":"5199d8f6-dbe7-4dfd-bdb2-1fc75a938bd2","Type":"ContainerDied","Data":"8b86f6c0f3084166768bdecc12c0ed09e8a5cd440610d7a2b5dc2768f8bdc8f7"}
Oct 30 20:19:23.378557 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:19:23.378473    6275 scope.go:122] "RemoveContainer" containerID="bdcb907e495d8bc8cee1ba64ad656ace7587610af5e74ae724c8676742093885"
Oct 30 20:19:23.390514 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:19:23.390155    6275 scope.go:122] "RemoveContainer" containerID="bdcb907e495d8bc8cee1ba64ad656ace7587610af5e74ae724c8676742093885"
Oct 30 20:19:23.390747 ip-10-0-131-26 kubenswrapper[6275]: E1030 20:19:23.390726    6275 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bdcb907e495d8bc8cee1ba64ad656ace7587610af5e74ae724c8676742093885\": container with ID starting with bdcb907e495d8bc8cee1ba64ad656ace7587610af5e74ae724c8676742093885 not found: ID does not exist" containerID="bdcb907e495d8bc8cee1ba64ad656ace7587610af5e74ae724c8676742093885"
Oct 30 20:19:23.390808 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:19:23.390756    6275 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bdcb907e495d8bc8cee1ba64ad656ace7587610af5e74ae724c8676742093885"} err="failed to get container status \"bdcb907e495d8bc8cee1ba64ad656ace7587610af5e74ae724c8676742093885\": rpc error: code = NotFound desc = could not find container \"bdcb907e495d8bc8cee1ba64ad656ace7587610af5e74ae724c8676742093885\": container with ID starting with bdcb907e495d8bc8cee1ba64ad656ace7587610af5e74ae724c8676742093885 not found: ID does not exist"
Oct 30 20:19:23.433488 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:19:23.433457    6275 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-single-main-5d6bba/simulator-single-main-5d6bba-kserve-7f655d6d46-srvlm"]
Oct 30 20:19:23.446183 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:19:23.446157    6275 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-single-main-5d6bba/simulator-single-main-5d6bba-kserve-7f655d6d46-srvlm"]
Oct 30 20:19:23.655352 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:19:23.655282    6275 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="5199d8f6-dbe7-4dfd-bdb2-1fc75a938bd2" path="/var/lib/kubelet/pods/5199d8f6-dbe7-4dfd-bdb2-1fc75a938bd2/volumes"
Oct 30 20:19:26.256677 ip-10-0-131-26 kubenswrapper[6275]: E1030 20:19:26.256642    6275 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-fwc77" containerName="extractor"
Oct 30 20:19:49.260556 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:19:49.260520    6275 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-7f5667f86c-mxxll container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.44:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 20:19:49.261039 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:19:49.260664    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-mxxll" podUID="b3c62e4b-11c3-45ba-9e82-274e66592e69" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.44:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:19:56.254606 ip-10-0-131-26 kubenswrapper[6275]: E1030 20:19:56.254568    6275 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-fwc77" containerName="extractor"
Oct 30 20:20:24.184438 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:20:24.179513    6275 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-7f5667f86c-wtnz5 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.43:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 20:20:24.184438 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:20:24.179593    6275 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-wtnz5" podUID="286f2fb7-0dc1-4d1f-9bf5-20be2e0a31cf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.43:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:20:26.254229 ip-10-0-131-26 kubenswrapper[6275]: E1030 20:20:26.254191    6275 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-fwc77" containerName="extractor"
Oct 30 20:20:56.254352 ip-10-0-131-26 kubenswrapper[6275]: E1030 20:20:56.254311    6275 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-fwc77" containerName="extractor"
Oct 30 20:21:25.683046 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:21:25.682955    6275 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-f03629db-sbg4c"]
Oct 30 20:21:25.683647 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:21:25.683592    6275 cpu_manager.go:414] "containerMap: removing container" podUID="5199d8f6-dbe7-4dfd-bdb2-1fc75a938bd2" containerName="main"
Oct 30 20:21:25.683647 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:21:25.683615    6275 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="5199d8f6-dbe7-4dfd-bdb2-1fc75a938bd2" containerName="main"
Oct 30 20:21:25.683779 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:21:25.683750    6275 memory_manager.go:365] "RemoveStaleState removing state" podUID="50f49ae8-d314-4a0e-988c-acc6f421a754" containerName="cleanup"
Oct 30 20:21:25.683779 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:21:25.683765    6275 memory_manager.go:365] "RemoveStaleState removing state" podUID="5199d8f6-dbe7-4dfd-bdb2-1fc75a938bd2" containerName="main"
Oct 30 20:21:25.686929 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:21:25.686906    6275 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-f03629db-sbg4c"
Oct 30 20:21:25.707863 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:21:25.707835    6275 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-f03629db-sbg4c"]
Oct 30 20:21:25.718136 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:21:25.718116    6275 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\""
Oct 30 20:21:25.718136 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:21:25.718118    6275 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-scs2w\""
Oct 30 20:21:25.772481 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:21:25.772455    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/dd23cc22-6c3d-4e8a-ae55-d56bb8ff42d5-maas-api-xks-ca\") pod \"maas-api-revoke-sub-f03629db-sbg4c\" (UID: \"dd23cc22-6c3d-4e8a-ae55-d56bb8ff42d5\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-f03629db-sbg4c"
Oct 30 20:21:25.772624 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:21:25.772603    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/dd23cc22-6c3d-4e8a-ae55-d56bb8ff42d5-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-f03629db-sbg4c\" (UID: \"dd23cc22-6c3d-4e8a-ae55-d56bb8ff42d5\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-f03629db-sbg4c"
Oct 30 20:21:25.772672 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:21:25.772644    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mfgbv\" (UniqueName: \"kubernetes.io/projected/dd23cc22-6c3d-4e8a-ae55-d56bb8ff42d5-kube-api-access-mfgbv\") pod \"maas-api-revoke-sub-f03629db-sbg4c\" (UID: \"dd23cc22-6c3d-4e8a-ae55-d56bb8ff42d5\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-f03629db-sbg4c"
Oct 30 20:21:25.873791 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:21:25.873757    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/dd23cc22-6c3d-4e8a-ae55-d56bb8ff42d5-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-f03629db-sbg4c\" (UID: \"dd23cc22-6c3d-4e8a-ae55-d56bb8ff42d5\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-f03629db-sbg4c"
Oct 30 20:21:25.873920 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:21:25.873798    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mfgbv\" (UniqueName: \"kubernetes.io/projected/dd23cc22-6c3d-4e8a-ae55-d56bb8ff42d5-kube-api-access-mfgbv\") pod \"maas-api-revoke-sub-f03629db-sbg4c\" (UID: \"dd23cc22-6c3d-4e8a-ae55-d56bb8ff42d5\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-f03629db-sbg4c"
Oct 30 20:21:25.873920 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:21:25.873830    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/dd23cc22-6c3d-4e8a-ae55-d56bb8ff42d5-maas-api-xks-ca\") pod \"maas-api-revoke-sub-f03629db-sbg4c\" (UID: \"dd23cc22-6c3d-4e8a-ae55-d56bb8ff42d5\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-f03629db-sbg4c"
Oct 30 20:21:25.874578 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:21:25.874554    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/dd23cc22-6c3d-4e8a-ae55-d56bb8ff42d5-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-f03629db-sbg4c\" (UID: \"dd23cc22-6c3d-4e8a-ae55-d56bb8ff42d5\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-f03629db-sbg4c"
Oct 30 20:21:25.876276 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:21:25.876251    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/dd23cc22-6c3d-4e8a-ae55-d56bb8ff42d5-maas-api-xks-ca\") pod \"maas-api-revoke-sub-f03629db-sbg4c\" (UID: \"dd23cc22-6c3d-4e8a-ae55-d56bb8ff42d5\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-f03629db-sbg4c"
Oct 30 20:21:25.900180 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:21:25.900157    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mfgbv\" (UniqueName: \"kubernetes.io/projected/dd23cc22-6c3d-4e8a-ae55-d56bb8ff42d5-kube-api-access-mfgbv\") pod \"maas-api-revoke-sub-f03629db-sbg4c\" (UID: \"dd23cc22-6c3d-4e8a-ae55-d56bb8ff42d5\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-f03629db-sbg4c"
Oct 30 20:21:25.999128 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:21:25.999101    6275 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-f03629db-sbg4c"
Oct 30 20:21:26.254962 ip-10-0-131-26 kubenswrapper[6275]: E1030 20:21:26.254889    6275 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-fwc77" containerName="extractor"
Oct 30 20:21:26.298690 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:21:26.298667    6275 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-f03629db-sbg4c"]
Oct 30 20:21:26.300688 ip-10-0-131-26 kubenswrapper[6275]: W1030 20:21:26.300661    6275 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddd23cc22_6c3d_4e8a_ae55_d56bb8ff42d5.slice/crio-4e5d21f4e4e48db854cfa0b06b46fe4e70c239b1da081b996e2904213428d7cd WatchSource:0}: Error finding container 4e5d21f4e4e48db854cfa0b06b46fe4e70c239b1da081b996e2904213428d7cd: Status 404 returned error can't find the container with id 4e5d21f4e4e48db854cfa0b06b46fe4e70c239b1da081b996e2904213428d7cd
Oct 30 20:21:27.152209 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:21:27.152175    6275 generic.go:356] "Generic (PLEG): container finished" podID="dd23cc22-6c3d-4e8a-ae55-d56bb8ff42d5" containerID="a544fb1f270c6590451a983bdcbc688b38bd7643f7d9a30f9738afb501824dfe" exitCode=0
Oct 30 20:21:27.152614 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:21:27.152226    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-f03629db-sbg4c" event={"ID":"dd23cc22-6c3d-4e8a-ae55-d56bb8ff42d5","Type":"ContainerDied","Data":"a544fb1f270c6590451a983bdcbc688b38bd7643f7d9a30f9738afb501824dfe"}
Oct 30 20:21:27.152614 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:21:27.152272    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-f03629db-sbg4c" event={"ID":"dd23cc22-6c3d-4e8a-ae55-d56bb8ff42d5","Type":"ContainerStarted","Data":"4e5d21f4e4e48db854cfa0b06b46fe4e70c239b1da081b996e2904213428d7cd"}
Oct 30 20:21:28.289387 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:21:28.289361    6275 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-f03629db-sbg4c"
Oct 30 20:21:28.396719 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:21:28.396695    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/dd23cc22-6c3d-4e8a-ae55-d56bb8ff42d5-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/dd23cc22-6c3d-4e8a-ae55-d56bb8ff42d5-maas-api-xks-ca\") pod \"dd23cc22-6c3d-4e8a-ae55-d56bb8ff42d5\" (UID: \"dd23cc22-6c3d-4e8a-ae55-d56bb8ff42d5\") "
Oct 30 20:21:28.396848 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:21:28.396772    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/dd23cc22-6c3d-4e8a-ae55-d56bb8ff42d5-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/dd23cc22-6c3d-4e8a-ae55-d56bb8ff42d5-maas-api-openshift-ca\") pod \"dd23cc22-6c3d-4e8a-ae55-d56bb8ff42d5\" (UID: \"dd23cc22-6c3d-4e8a-ae55-d56bb8ff42d5\") "
Oct 30 20:21:28.396848 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:21:28.396836    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/dd23cc22-6c3d-4e8a-ae55-d56bb8ff42d5-kube-api-access-mfgbv\" (UniqueName: \"kubernetes.io/projected/dd23cc22-6c3d-4e8a-ae55-d56bb8ff42d5-kube-api-access-mfgbv\") pod \"dd23cc22-6c3d-4e8a-ae55-d56bb8ff42d5\" (UID: \"dd23cc22-6c3d-4e8a-ae55-d56bb8ff42d5\") "
Oct 30 20:21:28.397168 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:21:28.397143    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dd23cc22-6c3d-4e8a-ae55-d56bb8ff42d5-maas-api-openshift-ca" pod "dd23cc22-6c3d-4e8a-ae55-d56bb8ff42d5" (UID: "dd23cc22-6c3d-4e8a-ae55-d56bb8ff42d5"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:21:28.398686 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:21:28.398652    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dd23cc22-6c3d-4e8a-ae55-d56bb8ff42d5-maas-api-xks-ca" pod "dd23cc22-6c3d-4e8a-ae55-d56bb8ff42d5" (UID: "dd23cc22-6c3d-4e8a-ae55-d56bb8ff42d5"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 20:21:28.398797 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:21:28.398735    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dd23cc22-6c3d-4e8a-ae55-d56bb8ff42d5-kube-api-access-mfgbv" pod "dd23cc22-6c3d-4e8a-ae55-d56bb8ff42d5" (UID: "dd23cc22-6c3d-4e8a-ae55-d56bb8ff42d5"). InnerVolumeSpecName "kube-api-access-mfgbv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:21:28.498305 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:21:28.498282    6275 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/dd23cc22-6c3d-4e8a-ae55-d56bb8ff42d5-maas-api-openshift-ca\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:21:28.498396 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:21:28.498305    6275 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mfgbv\" (UniqueName: \"kubernetes.io/projected/dd23cc22-6c3d-4e8a-ae55-d56bb8ff42d5-kube-api-access-mfgbv\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:21:28.498396 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:21:28.498317    6275 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/dd23cc22-6c3d-4e8a-ae55-d56bb8ff42d5-maas-api-xks-ca\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:21:29.166567 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:21:29.166538    6275 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-f03629db-sbg4c"
Oct 30 20:21:29.166567 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:21:29.166554    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-f03629db-sbg4c" event={"ID":"dd23cc22-6c3d-4e8a-ae55-d56bb8ff42d5","Type":"ContainerDied","Data":"4e5d21f4e4e48db854cfa0b06b46fe4e70c239b1da081b996e2904213428d7cd"}
Oct 30 20:21:29.166816 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:21:29.166599    6275 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4e5d21f4e4e48db854cfa0b06b46fe4e70c239b1da081b996e2904213428d7cd"
Oct 30 20:21:38.400160 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:21:38.400123    6275 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-0165d7d2-f4p9k"]
Oct 30 20:21:38.400870 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:21:38.400580    6275 cpu_manager.go:414] "containerMap: removing container" podUID="dd23cc22-6c3d-4e8a-ae55-d56bb8ff42d5" containerName="revoke-keys"
Oct 30 20:21:38.400870 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:21:38.400594    6275 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="dd23cc22-6c3d-4e8a-ae55-d56bb8ff42d5" containerName="revoke-keys"
Oct 30 20:21:38.400870 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:21:38.400702    6275 memory_manager.go:365] "RemoveStaleState removing state" podUID="dd23cc22-6c3d-4e8a-ae55-d56bb8ff42d5" containerName="revoke-keys"
Oct 30 20:21:38.404097 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:21:38.404072    6275 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-0165d7d2-f4p9k"
Oct 30 20:21:38.425536 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:21:38.425513    6275 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-0165d7d2-f4p9k"]
Oct 30 20:21:38.435943 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:21:38.435925    6275 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\""
Oct 30 20:21:38.436213 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:21:38.436196    6275 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-scs2w\""
Oct 30 20:21:38.502085 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:21:38.502054    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/ad69749d-a0ad-4bc0-8e7d-62175d50f048-maas-api-xks-ca\") pod \"maas-api-revoke-sub-0165d7d2-f4p9k\" (UID: \"ad69749d-a0ad-4bc0-8e7d-62175d50f048\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-0165d7d2-f4p9k"
Oct 30 20:21:38.502219 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:21:38.502135    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7qrgg\" (UniqueName: \"kubernetes.io/projected/ad69749d-a0ad-4bc0-8e7d-62175d50f048-kube-api-access-7qrgg\") pod \"maas-api-revoke-sub-0165d7d2-f4p9k\" (UID: \"ad69749d-a0ad-4bc0-8e7d-62175d50f048\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-0165d7d2-f4p9k"
Oct 30 20:21:38.502289 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:21:38.502215    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/ad69749d-a0ad-4bc0-8e7d-62175d50f048-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-0165d7d2-f4p9k\" (UID: \"ad69749d-a0ad-4bc0-8e7d-62175d50f048\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-0165d7d2-f4p9k"
Oct 30 20:21:38.602713 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:21:38.602689    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/ad69749d-a0ad-4bc0-8e7d-62175d50f048-maas-api-xks-ca\") pod \"maas-api-revoke-sub-0165d7d2-f4p9k\" (UID: \"ad69749d-a0ad-4bc0-8e7d-62175d50f048\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-0165d7d2-f4p9k"
Oct 30 20:21:38.602841 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:21:38.602739    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7qrgg\" (UniqueName: \"kubernetes.io/projected/ad69749d-a0ad-4bc0-8e7d-62175d50f048-kube-api-access-7qrgg\") pod \"maas-api-revoke-sub-0165d7d2-f4p9k\" (UID: \"ad69749d-a0ad-4bc0-8e7d-62175d50f048\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-0165d7d2-f4p9k"
Oct 30 20:21:38.602841 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:21:38.602767    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/ad69749d-a0ad-4bc0-8e7d-62175d50f048-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-0165d7d2-f4p9k\" (UID: \"ad69749d-a0ad-4bc0-8e7d-62175d50f048\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-0165d7d2-f4p9k"
Oct 30 20:21:38.603316 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:21:38.603297    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/ad69749d-a0ad-4bc0-8e7d-62175d50f048-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-0165d7d2-f4p9k\" (UID: \"ad69749d-a0ad-4bc0-8e7d-62175d50f048\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-0165d7d2-f4p9k"
Oct 30 20:21:38.604951 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:21:38.604930    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/ad69749d-a0ad-4bc0-8e7d-62175d50f048-maas-api-xks-ca\") pod \"maas-api-revoke-sub-0165d7d2-f4p9k\" (UID: \"ad69749d-a0ad-4bc0-8e7d-62175d50f048\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-0165d7d2-f4p9k"
Oct 30 20:21:38.628239 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:21:38.628219    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7qrgg\" (UniqueName: \"kubernetes.io/projected/ad69749d-a0ad-4bc0-8e7d-62175d50f048-kube-api-access-7qrgg\") pod \"maas-api-revoke-sub-0165d7d2-f4p9k\" (UID: \"ad69749d-a0ad-4bc0-8e7d-62175d50f048\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-0165d7d2-f4p9k"
Oct 30 20:21:38.716875 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:21:38.716820    6275 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-0165d7d2-f4p9k"
Oct 30 20:21:39.016396 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:21:39.016370    6275 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-0165d7d2-f4p9k"]
Oct 30 20:21:39.017955 ip-10-0-131-26 kubenswrapper[6275]: W1030 20:21:39.017929    6275 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podad69749d_a0ad_4bc0_8e7d_62175d50f048.slice/crio-2b600df349ef864b145287734980d2fbcdf0d43c8c32ffbf38eb0d23278e79af WatchSource:0}: Error finding container 2b600df349ef864b145287734980d2fbcdf0d43c8c32ffbf38eb0d23278e79af: Status 404 returned error can't find the container with id 2b600df349ef864b145287734980d2fbcdf0d43c8c32ffbf38eb0d23278e79af
Oct 30 20:21:39.238342 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:21:39.238298    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-0165d7d2-f4p9k" event={"ID":"ad69749d-a0ad-4bc0-8e7d-62175d50f048","Type":"ContainerStarted","Data":"5eabd3a51314622fb521c7db4678dc7c196744d3ef2b804cab01ab876b49dc87"}
Oct 30 20:21:39.238484 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:21:39.238361    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-0165d7d2-f4p9k" event={"ID":"ad69749d-a0ad-4bc0-8e7d-62175d50f048","Type":"ContainerStarted","Data":"2b600df349ef864b145287734980d2fbcdf0d43c8c32ffbf38eb0d23278e79af"}
Oct 30 20:21:39.283277 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:21:39.283205    6275 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-sub-0165d7d2-f4p9k" podStartSLOduration=1.2831919520000001 podStartE2EDuration="1.283191952s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:21:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:21:39.281344526 +0000 UTC m=+2009.743071391" watchObservedRunningTime="2026-10-30 20:21:39.283191952 +0000 UTC m=+2009.744918817"
Oct 30 20:21:40.245115 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:21:40.245086    6275 generic.go:356] "Generic (PLEG): container finished" podID="ad69749d-a0ad-4bc0-8e7d-62175d50f048" containerID="5eabd3a51314622fb521c7db4678dc7c196744d3ef2b804cab01ab876b49dc87" exitCode=0
Oct 30 20:21:40.245507 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:21:40.245145    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-0165d7d2-f4p9k" event={"ID":"ad69749d-a0ad-4bc0-8e7d-62175d50f048","Type":"ContainerDied","Data":"5eabd3a51314622fb521c7db4678dc7c196744d3ef2b804cab01ab876b49dc87"}
Oct 30 20:21:41.381670 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:21:41.381640    6275 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-0165d7d2-f4p9k"
Oct 30 20:21:41.529579 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:21:41.529513    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/ad69749d-a0ad-4bc0-8e7d-62175d50f048-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/ad69749d-a0ad-4bc0-8e7d-62175d50f048-maas-api-openshift-ca\") pod \"ad69749d-a0ad-4bc0-8e7d-62175d50f048\" (UID: \"ad69749d-a0ad-4bc0-8e7d-62175d50f048\") "
Oct 30 20:21:41.529579 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:21:41.529554    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/ad69749d-a0ad-4bc0-8e7d-62175d50f048-kube-api-access-7qrgg\" (UniqueName: \"kubernetes.io/projected/ad69749d-a0ad-4bc0-8e7d-62175d50f048-kube-api-access-7qrgg\") pod \"ad69749d-a0ad-4bc0-8e7d-62175d50f048\" (UID: \"ad69749d-a0ad-4bc0-8e7d-62175d50f048\") "
Oct 30 20:21:41.529752 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:21:41.529738    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/ad69749d-a0ad-4bc0-8e7d-62175d50f048-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/ad69749d-a0ad-4bc0-8e7d-62175d50f048-maas-api-xks-ca\") pod \"ad69749d-a0ad-4bc0-8e7d-62175d50f048\" (UID: \"ad69749d-a0ad-4bc0-8e7d-62175d50f048\") "
Oct 30 20:21:41.529850 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:21:41.529830    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ad69749d-a0ad-4bc0-8e7d-62175d50f048-maas-api-openshift-ca" pod "ad69749d-a0ad-4bc0-8e7d-62175d50f048" (UID: "ad69749d-a0ad-4bc0-8e7d-62175d50f048"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:21:41.529978 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:21:41.529964    6275 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/ad69749d-a0ad-4bc0-8e7d-62175d50f048-maas-api-openshift-ca\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:21:41.531539 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:21:41.531515    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ad69749d-a0ad-4bc0-8e7d-62175d50f048-kube-api-access-7qrgg" pod "ad69749d-a0ad-4bc0-8e7d-62175d50f048" (UID: "ad69749d-a0ad-4bc0-8e7d-62175d50f048"). InnerVolumeSpecName "kube-api-access-7qrgg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:21:41.531699 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:21:41.531677    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ad69749d-a0ad-4bc0-8e7d-62175d50f048-maas-api-xks-ca" pod "ad69749d-a0ad-4bc0-8e7d-62175d50f048" (UID: "ad69749d-a0ad-4bc0-8e7d-62175d50f048"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 20:21:41.630636 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:21:41.630611    6275 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/ad69749d-a0ad-4bc0-8e7d-62175d50f048-maas-api-xks-ca\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:21:41.630636 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:21:41.630633    6275 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7qrgg\" (UniqueName: \"kubernetes.io/projected/ad69749d-a0ad-4bc0-8e7d-62175d50f048-kube-api-access-7qrgg\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:21:42.255468 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:21:42.255439    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-0165d7d2-f4p9k" event={"ID":"ad69749d-a0ad-4bc0-8e7d-62175d50f048","Type":"ContainerDied","Data":"2b600df349ef864b145287734980d2fbcdf0d43c8c32ffbf38eb0d23278e79af"}
Oct 30 20:21:42.255595 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:21:42.255477    6275 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-0165d7d2-f4p9k"
Oct 30 20:21:42.255595 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:21:42.255484    6275 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2b600df349ef864b145287734980d2fbcdf0d43c8c32ffbf38eb0d23278e79af"
Oct 30 20:21:49.415235 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:21:49.415201    6275 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-6b19338f-jmh5k"]
Oct 30 20:21:49.416039 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:21:49.416014    6275 cpu_manager.go:414] "containerMap: removing container" podUID="ad69749d-a0ad-4bc0-8e7d-62175d50f048" containerName="revoke-keys"
Oct 30 20:21:49.416143 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:21:49.416039    6275 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="ad69749d-a0ad-4bc0-8e7d-62175d50f048" containerName="revoke-keys"
Oct 30 20:21:49.416200 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:21:49.416166    6275 memory_manager.go:365] "RemoveStaleState removing state" podUID="ad69749d-a0ad-4bc0-8e7d-62175d50f048" containerName="revoke-keys"
Oct 30 20:21:49.419510 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:21:49.419490    6275 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-6b19338f-jmh5k"
Oct 30 20:21:49.440238 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:21:49.440214    6275 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-6b19338f-jmh5k"]
Oct 30 20:21:49.450706 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:21:49.450667    6275 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\""
Oct 30 20:21:49.450706 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:21:49.450697    6275 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-scs2w\""
Oct 30 20:21:49.493275 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:21:49.493242    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kjnm9\" (UniqueName: \"kubernetes.io/projected/ba2e4932-8d1c-4e9c-b12c-a643011489e3-kube-api-access-kjnm9\") pod \"maas-api-revoke-sub-6b19338f-jmh5k\" (UID: \"ba2e4932-8d1c-4e9c-b12c-a643011489e3\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-6b19338f-jmh5k"
Oct 30 20:21:49.493449 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:21:49.493280    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/ba2e4932-8d1c-4e9c-b12c-a643011489e3-maas-api-xks-ca\") pod \"maas-api-revoke-sub-6b19338f-jmh5k\" (UID: \"ba2e4932-8d1c-4e9c-b12c-a643011489e3\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-6b19338f-jmh5k"
Oct 30 20:21:49.493449 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:21:49.493297    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/ba2e4932-8d1c-4e9c-b12c-a643011489e3-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-6b19338f-jmh5k\" (UID: \"ba2e4932-8d1c-4e9c-b12c-a643011489e3\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-6b19338f-jmh5k"
Oct 30 20:21:49.594327 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:21:49.594301    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kjnm9\" (UniqueName: \"kubernetes.io/projected/ba2e4932-8d1c-4e9c-b12c-a643011489e3-kube-api-access-kjnm9\") pod \"maas-api-revoke-sub-6b19338f-jmh5k\" (UID: \"ba2e4932-8d1c-4e9c-b12c-a643011489e3\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-6b19338f-jmh5k"
Oct 30 20:21:49.594463 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:21:49.594333    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/ba2e4932-8d1c-4e9c-b12c-a643011489e3-maas-api-xks-ca\") pod \"maas-api-revoke-sub-6b19338f-jmh5k\" (UID: \"ba2e4932-8d1c-4e9c-b12c-a643011489e3\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-6b19338f-jmh5k"
Oct 30 20:21:49.594463 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:21:49.594356    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/ba2e4932-8d1c-4e9c-b12c-a643011489e3-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-6b19338f-jmh5k\" (UID: \"ba2e4932-8d1c-4e9c-b12c-a643011489e3\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-6b19338f-jmh5k"
Oct 30 20:21:49.595052 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:21:49.595029    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/ba2e4932-8d1c-4e9c-b12c-a643011489e3-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-6b19338f-jmh5k\" (UID: \"ba2e4932-8d1c-4e9c-b12c-a643011489e3\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-6b19338f-jmh5k"
Oct 30 20:21:49.596564 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:21:49.596541    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/ba2e4932-8d1c-4e9c-b12c-a643011489e3-maas-api-xks-ca\") pod \"maas-api-revoke-sub-6b19338f-jmh5k\" (UID: \"ba2e4932-8d1c-4e9c-b12c-a643011489e3\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-6b19338f-jmh5k"
Oct 30 20:21:49.619917 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:21:49.619893    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kjnm9\" (UniqueName: \"kubernetes.io/projected/ba2e4932-8d1c-4e9c-b12c-a643011489e3-kube-api-access-kjnm9\") pod \"maas-api-revoke-sub-6b19338f-jmh5k\" (UID: \"ba2e4932-8d1c-4e9c-b12c-a643011489e3\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-6b19338f-jmh5k"
Oct 30 20:21:49.731820 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:21:49.731771    6275 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-6b19338f-jmh5k"
Oct 30 20:21:50.037194 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:21:50.035730    6275 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-6b19338f-jmh5k"]
Oct 30 20:21:50.298606 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:21:50.298578    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-6b19338f-jmh5k" event={"ID":"ba2e4932-8d1c-4e9c-b12c-a643011489e3","Type":"ContainerStarted","Data":"c9b4bd39a9c340616190fac445386b9d92385f519a2431c49d4666cd0b58257b"}
Oct 30 20:21:51.304389 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:21:51.304356    6275 generic.go:356] "Generic (PLEG): container finished" podID="ba2e4932-8d1c-4e9c-b12c-a643011489e3" containerID="a941eea8a8ccac90488f100049540ecc937c57c34580ad6052b85b3d50e87503" exitCode=0
Oct 30 20:21:51.304805 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:21:51.304444    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-6b19338f-jmh5k" event={"ID":"ba2e4932-8d1c-4e9c-b12c-a643011489e3","Type":"ContainerDied","Data":"a941eea8a8ccac90488f100049540ecc937c57c34580ad6052b85b3d50e87503"}
Oct 30 20:21:52.436605 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:21:52.436581    6275 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-6b19338f-jmh5k"
Oct 30 20:21:52.519319 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:21:52.519291    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/ba2e4932-8d1c-4e9c-b12c-a643011489e3-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/ba2e4932-8d1c-4e9c-b12c-a643011489e3-maas-api-xks-ca\") pod \"ba2e4932-8d1c-4e9c-b12c-a643011489e3\" (UID: \"ba2e4932-8d1c-4e9c-b12c-a643011489e3\") "
Oct 30 20:21:52.519498 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:21:52.519402    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/ba2e4932-8d1c-4e9c-b12c-a643011489e3-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/ba2e4932-8d1c-4e9c-b12c-a643011489e3-maas-api-openshift-ca\") pod \"ba2e4932-8d1c-4e9c-b12c-a643011489e3\" (UID: \"ba2e4932-8d1c-4e9c-b12c-a643011489e3\") "
Oct 30 20:21:52.519498 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:21:52.519461    6275 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/ba2e4932-8d1c-4e9c-b12c-a643011489e3-kube-api-access-kjnm9\" (UniqueName: \"kubernetes.io/projected/ba2e4932-8d1c-4e9c-b12c-a643011489e3-kube-api-access-kjnm9\") pod \"ba2e4932-8d1c-4e9c-b12c-a643011489e3\" (UID: \"ba2e4932-8d1c-4e9c-b12c-a643011489e3\") "
Oct 30 20:21:52.519724 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:21:52.519704    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ba2e4932-8d1c-4e9c-b12c-a643011489e3-maas-api-openshift-ca" pod "ba2e4932-8d1c-4e9c-b12c-a643011489e3" (UID: "ba2e4932-8d1c-4e9c-b12c-a643011489e3"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:21:52.521334 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:21:52.521307    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ba2e4932-8d1c-4e9c-b12c-a643011489e3-maas-api-xks-ca" pod "ba2e4932-8d1c-4e9c-b12c-a643011489e3" (UID: "ba2e4932-8d1c-4e9c-b12c-a643011489e3"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 20:21:52.521583 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:21:52.521557    6275 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ba2e4932-8d1c-4e9c-b12c-a643011489e3-kube-api-access-kjnm9" pod "ba2e4932-8d1c-4e9c-b12c-a643011489e3" (UID: "ba2e4932-8d1c-4e9c-b12c-a643011489e3"). InnerVolumeSpecName "kube-api-access-kjnm9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:21:52.620091 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:21:52.620039    6275 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kjnm9\" (UniqueName: \"kubernetes.io/projected/ba2e4932-8d1c-4e9c-b12c-a643011489e3-kube-api-access-kjnm9\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:21:52.620091 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:21:52.620061    6275 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/ba2e4932-8d1c-4e9c-b12c-a643011489e3-maas-api-xks-ca\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:21:52.620091 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:21:52.620072    6275 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/ba2e4932-8d1c-4e9c-b12c-a643011489e3-maas-api-openshift-ca\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Oct 30 20:21:53.316142 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:21:53.316120    6275 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-6b19338f-jmh5k"
Oct 30 20:21:53.316275 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:21:53.316165    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-6b19338f-jmh5k" event={"ID":"ba2e4932-8d1c-4e9c-b12c-a643011489e3","Type":"ContainerDied","Data":"c9b4bd39a9c340616190fac445386b9d92385f519a2431c49d4666cd0b58257b"}
Oct 30 20:21:53.316275 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:21:53.316210    6275 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c9b4bd39a9c340616190fac445386b9d92385f519a2431c49d4666cd0b58257b"
Oct 30 20:21:56.256450 ip-10-0-131-26 kubenswrapper[6275]: E1030 20:21:56.256391    6275 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-fwc77" containerName="extractor"
Oct 30 20:22:12.442251 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:22:12.442219    6275 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-776cc66d47-bl2tv_b42eee11-4948-4d80-87c8-5343d07a0c5a/manager/0.log"
Oct 30 20:22:12.650987 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:22:12.650962    6275 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-module-controller-manager-5cfb77bf8c-d7bt4_a8ef00a1-8bb4-4fb2-b361-32260131472e/manager/0.log"
Oct 30 20:22:12.882231 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:22:12.882208    6275 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-6466c554d8-dzsl9_96ccbb74-7a9a-40d8-a63f-0f4f34624d51/manager/0.log"
Oct 30 20:22:13.472010 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:22:13.471984    6275 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-75bd89fdfc-8284h_9269c7aa-930c-4a33-a2e6-157e1d617757/server/0.log"
Oct 30 20:22:13.942364 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:22:13.942334    6275 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-observability-584f99c788-rzhh7_e79579e3-262a-48af-b264-b1fbb2268025/manager/0.log"
Oct 30 20:22:14.472342 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:22:14.472310    6275 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6f6c7b487f-9wrps_e79d3c32-fbe3-4b67-8772-de5e85f5451f/copy-manifests/0.log"
Oct 30 20:22:14.502188 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:22:14.502164    6275 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6f6c7b487f-9wrps_e79d3c32-fbe3-4b67-8772-de5e85f5451f/manager/1.log"
Oct 30 20:22:14.942848 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:22:14.942824    6275 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_usage-logs-tenancy-proxy-7d94f55f4b-pqsbj_c7ff9a1f-9026-493f-a87a-c9b96f593403/proxy/0.log"
Oct 30 20:22:15.414090 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:22:15.414064    6275 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6f6c7b487f-9wrps_e79d3c32-fbe3-4b67-8772-de5e85f5451f/manager/0.log"
Oct 30 20:22:16.431126 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:22:16.431097    6275 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-sub-0165d7d2-f4p9k_ad69749d-a0ad-4bc0-8e7d-62175d50f048/revoke-keys/0.log"
Oct 30 20:22:17.008096 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:22:17.008070    6275 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-sub-6b19338f-jmh5k_ba2e4932-8d1c-4e9c-b12c-a643011489e3/revoke-keys/0.log"
Oct 30 20:22:18.002694 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:22:18.002665    6275 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-sub-f03629db-sbg4c_dd23cc22-6c3d-4e8a-ae55-d56bb8ff42d5/revoke-keys/0.log"
Oct 30 20:22:18.187577 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:22:18.187541    6275 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-7cdbf6dc44-6gzlb_063c67e9-98a2-410d-84d9-26c97e78ec2d/postgres/0.log"
Oct 30 20:22:20.470505 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:22:20.470480    6275 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66c4fb575d-d7zvq_3d7702f4-3e67-4cc6-b8aa-78d6ef24deee/kuadrant-console-plugin/0.log"
Oct 30 20:22:23.405085 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:22:23.405047    6275 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-7f5667f86c-k7qfk_17354614-7251-47e9-a513-b626ebbb598f/istio-proxy/0.log"
Oct 30 20:22:24.242489 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:22:24.242455    6275 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-7f5667f86c-mxxll_b3c62e4b-11c3-45ba-9e82-274e66592e69/istio-proxy/0.log"
Oct 30 20:22:24.667430 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:22:24.667341    6275 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-7f5667f86c-wtnz5_286f2fb7-0dc1-4d1f-9bf5-20be2e0a31cf/istio-proxy/0.log"
Oct 30 20:22:26.253872 ip-10-0-131-26 kubenswrapper[6275]: E1030 20:22:26.253840    6275 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-fwc77" containerName="extractor"
Oct 30 20:22:38.675892 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:22:38.675861    6275 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-776cc66d47-bl2tv_b42eee11-4948-4d80-87c8-5343d07a0c5a/manager/0.log"
Oct 30 20:22:38.886216 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:22:38.886183    6275 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-module-controller-manager-5cfb77bf8c-d7bt4_a8ef00a1-8bb4-4fb2-b361-32260131472e/manager/0.log"
Oct 30 20:22:39.113344 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:22:39.113321    6275 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-6466c554d8-dzsl9_96ccbb74-7a9a-40d8-a63f-0f4f34624d51/manager/0.log"
Oct 30 20:22:39.581872 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:22:39.581846    6275 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-75bd89fdfc-8284h_9269c7aa-930c-4a33-a2e6-157e1d617757/server/0.log"
Oct 30 20:22:40.044004 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:22:40.043981    6275 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-observability-584f99c788-rzhh7_e79579e3-262a-48af-b264-b1fbb2268025/manager/0.log"
Oct 30 20:22:40.545299 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:22:40.545275    6275 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6f6c7b487f-9wrps_e79d3c32-fbe3-4b67-8772-de5e85f5451f/copy-manifests/0.log"
Oct 30 20:22:40.576652 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:22:40.576630    6275 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6f6c7b487f-9wrps_e79d3c32-fbe3-4b67-8772-de5e85f5451f/manager/1.log"
Oct 30 20:22:41.015558 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:22:41.015532    6275 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_usage-logs-tenancy-proxy-7d94f55f4b-pqsbj_c7ff9a1f-9026-493f-a87a-c9b96f593403/proxy/0.log"
Oct 30 20:22:42.017237 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:22:42.017211    6275 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-sub-0165d7d2-f4p9k_ad69749d-a0ad-4bc0-8e7d-62175d50f048/revoke-keys/0.log"
Oct 30 20:22:42.586331 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:22:42.586293    6275 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-sub-6b19338f-jmh5k_ba2e4932-8d1c-4e9c-b12c-a643011489e3/revoke-keys/0.log"
Oct 30 20:22:43.542626 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:22:43.542593    6275 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-sub-f03629db-sbg4c_dd23cc22-6c3d-4e8a-ae55-d56bb8ff42d5/revoke-keys/0.log"
Oct 30 20:22:43.719078 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:22:43.719051    6275 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-7cdbf6dc44-6gzlb_063c67e9-98a2-410d-84d9-26c97e78ec2d/postgres/0.log"
Oct 30 20:22:45.512378 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:22:45.512344    6275 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66c4fb575d-d7zvq_3d7702f4-3e67-4cc6-b8aa-78d6ef24deee/kuadrant-console-plugin/0.log"
Oct 30 20:22:48.169428 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:22:48.169395    6275 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-7f5667f86c-k7qfk_17354614-7251-47e9-a513-b626ebbb598f/istio-proxy/0.log"
Oct 30 20:22:48.994176 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:22:48.994144    6275 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-7f5667f86c-mxxll_b3c62e4b-11c3-45ba-9e82-274e66592e69/istio-proxy/0.log"
Oct 30 20:22:49.419849 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:22:49.419774    6275 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-7f5667f86c-wtnz5_286f2fb7-0dc1-4d1f-9bf5-20be2e0a31cf/istio-proxy/0.log"
Oct 30 20:22:56.255145 ip-10-0-131-26 kubenswrapper[6275]: E1030 20:22:56.255110    6275 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-fwc77" containerName="extractor"
Oct 30 20:23:26.254513 ip-10-0-131-26 kubenswrapper[6275]: E1030 20:23:26.254475    6275 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-fwc77" containerName="extractor"
Oct 30 20:23:56.255849 ip-10-0-131-26 kubenswrapper[6275]: E1030 20:23:56.255808    6275 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-fwc77" containerName="extractor"
Oct 30 20:24:20.500458 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:24:20.500402    6275 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-96mhd_90b35edf-4b09-41df-9374-a514d1417071/global-pull-secret-syncer/0.log"
Oct 30 20:24:21.742738 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:24:21.742711    6275 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-6lj57_2be7f3a3-8714-491c-8e10-c594d425069a/konnectivity-agent/0.log"
Oct 30 20:24:22.002860 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:24:22.002797    6275 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-131-26.ec2.internal_3a7534b7f1df1f6e6fe99f614d7ed61c/haproxy/0.log"
Oct 30 20:24:26.254618 ip-10-0-131-26 kubenswrapper[6275]: E1030 20:24:26.254583    6275 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-fwc77" containerName="extractor"
Oct 30 20:24:27.864895 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:24:27.864871    6275 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66c4fb575d-d7zvq_3d7702f4-3e67-4cc6-b8aa-78d6ef24deee/kuadrant-console-plugin/0.log"
Oct 30 20:24:29.853307 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:24:29.853263    6275 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_2ce2ec33-5684-425b-a0a5-31769367737f/alertmanager/0.log"
Oct 30 20:24:29.972622 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:24:29.972596    6275 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_2ce2ec33-5684-425b-a0a5-31769367737f/config-reloader/0.log"
Oct 30 20:24:30.096668 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:24:30.096641    6275 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_2ce2ec33-5684-425b-a0a5-31769367737f/kube-rbac-proxy-web/0.log"
Oct 30 20:24:30.213338 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:24:30.213284    6275 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_2ce2ec33-5684-425b-a0a5-31769367737f/kube-rbac-proxy/0.log"
Oct 30 20:24:30.334539 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:24:30.334516    6275 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_2ce2ec33-5684-425b-a0a5-31769367737f/kube-rbac-proxy-metric/0.log"
Oct 30 20:24:30.453127 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:24:30.453107    6275 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_2ce2ec33-5684-425b-a0a5-31769367737f/prom-label-proxy/0.log"
Oct 30 20:24:30.479645 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:24:30.479594    6275 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-must-gather-kc489/perf-node-gather-daemonset-cthf8"]
Oct 30 20:24:30.480122 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:24:30.480099    6275 cpu_manager.go:414] "containerMap: removing container" podUID="ba2e4932-8d1c-4e9c-b12c-a643011489e3" containerName="revoke-keys"
Oct 30 20:24:30.480122 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:24:30.480119    6275 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="ba2e4932-8d1c-4e9c-b12c-a643011489e3" containerName="revoke-keys"
Oct 30 20:24:30.480269 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:24:30.480236    6275 memory_manager.go:365] "RemoveStaleState removing state" podUID="ba2e4932-8d1c-4e9c-b12c-a643011489e3" containerName="revoke-keys"
Oct 30 20:24:30.483267 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:24:30.483249    6275 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-kc489/perf-node-gather-daemonset-cthf8"
Oct 30 20:24:30.506295 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:24:30.506265    6275 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-kc489/perf-node-gather-daemonset-cthf8"]
Oct 30 20:24:30.513456 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:24:30.513433    6275 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-kc489\"/\"default-dockercfg-zvbwx\""
Oct 30 20:24:30.513589 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:24:30.513476    6275 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-kc489\"/\"kube-root-ca.crt\""
Oct 30 20:24:30.513663 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:24:30.513618    6275 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-kc489\"/\"openshift-service-ca.crt\""
Oct 30 20:24:30.573389 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:24:30.573371    6275 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_2ce2ec33-5684-425b-a0a5-31769367737f/init-config-reloader/0.log"
Oct 30 20:24:30.625558 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:24:30.625537    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8384c8e5-97b8-4340-8ac9-1f7b726dc3b6-sys\") pod \"perf-node-gather-daemonset-cthf8\" (UID: \"8384c8e5-97b8-4340-8ac9-1f7b726dc3b6\") " pod="openshift-must-gather-kc489/perf-node-gather-daemonset-cthf8"
Oct 30 20:24:30.625658 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:24:30.625571    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5lf6z\" (UniqueName: \"kubernetes.io/projected/8384c8e5-97b8-4340-8ac9-1f7b726dc3b6-kube-api-access-5lf6z\") pod \"perf-node-gather-daemonset-cthf8\" (UID: \"8384c8e5-97b8-4340-8ac9-1f7b726dc3b6\") " pod="openshift-must-gather-kc489/perf-node-gather-daemonset-cthf8"
Oct 30 20:24:30.625658 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:24:30.625594    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/8384c8e5-97b8-4340-8ac9-1f7b726dc3b6-proc\") pod \"perf-node-gather-daemonset-cthf8\" (UID: \"8384c8e5-97b8-4340-8ac9-1f7b726dc3b6\") " pod="openshift-must-gather-kc489/perf-node-gather-daemonset-cthf8"
Oct 30 20:24:30.625658 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:24:30.625610    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8384c8e5-97b8-4340-8ac9-1f7b726dc3b6-lib-modules\") pod \"perf-node-gather-daemonset-cthf8\" (UID: \"8384c8e5-97b8-4340-8ac9-1f7b726dc3b6\") " pod="openshift-must-gather-kc489/perf-node-gather-daemonset-cthf8"
Oct 30 20:24:30.625778 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:24:30.625731    6275 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/8384c8e5-97b8-4340-8ac9-1f7b726dc3b6-podres\") pod \"perf-node-gather-daemonset-cthf8\" (UID: \"8384c8e5-97b8-4340-8ac9-1f7b726dc3b6\") " pod="openshift-must-gather-kc489/perf-node-gather-daemonset-cthf8"
Oct 30 20:24:30.726324 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:24:30.726302    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8384c8e5-97b8-4340-8ac9-1f7b726dc3b6-sys\") pod \"perf-node-gather-daemonset-cthf8\" (UID: \"8384c8e5-97b8-4340-8ac9-1f7b726dc3b6\") " pod="openshift-must-gather-kc489/perf-node-gather-daemonset-cthf8"
Oct 30 20:24:30.726410 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:24:30.726341    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5lf6z\" (UniqueName: \"kubernetes.io/projected/8384c8e5-97b8-4340-8ac9-1f7b726dc3b6-kube-api-access-5lf6z\") pod \"perf-node-gather-daemonset-cthf8\" (UID: \"8384c8e5-97b8-4340-8ac9-1f7b726dc3b6\") " pod="openshift-must-gather-kc489/perf-node-gather-daemonset-cthf8"
Oct 30 20:24:30.726410 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:24:30.726402    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8384c8e5-97b8-4340-8ac9-1f7b726dc3b6-sys\") pod \"perf-node-gather-daemonset-cthf8\" (UID: \"8384c8e5-97b8-4340-8ac9-1f7b726dc3b6\") " pod="openshift-must-gather-kc489/perf-node-gather-daemonset-cthf8"
Oct 30 20:24:30.726565 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:24:30.726456    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/8384c8e5-97b8-4340-8ac9-1f7b726dc3b6-proc\") pod \"perf-node-gather-daemonset-cthf8\" (UID: \"8384c8e5-97b8-4340-8ac9-1f7b726dc3b6\") " pod="openshift-must-gather-kc489/perf-node-gather-daemonset-cthf8"
Oct 30 20:24:30.726565 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:24:30.726494    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8384c8e5-97b8-4340-8ac9-1f7b726dc3b6-lib-modules\") pod \"perf-node-gather-daemonset-cthf8\" (UID: \"8384c8e5-97b8-4340-8ac9-1f7b726dc3b6\") " pod="openshift-must-gather-kc489/perf-node-gather-daemonset-cthf8"
Oct 30 20:24:30.726565 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:24:30.726556    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/8384c8e5-97b8-4340-8ac9-1f7b726dc3b6-proc\") pod \"perf-node-gather-daemonset-cthf8\" (UID: \"8384c8e5-97b8-4340-8ac9-1f7b726dc3b6\") " pod="openshift-must-gather-kc489/perf-node-gather-daemonset-cthf8"
Oct 30 20:24:30.726683 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:24:30.726577    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8384c8e5-97b8-4340-8ac9-1f7b726dc3b6-lib-modules\") pod \"perf-node-gather-daemonset-cthf8\" (UID: \"8384c8e5-97b8-4340-8ac9-1f7b726dc3b6\") " pod="openshift-must-gather-kc489/perf-node-gather-daemonset-cthf8"
Oct 30 20:24:30.726683 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:24:30.726591    6275 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/8384c8e5-97b8-4340-8ac9-1f7b726dc3b6-podres\") pod \"perf-node-gather-daemonset-cthf8\" (UID: \"8384c8e5-97b8-4340-8ac9-1f7b726dc3b6\") " pod="openshift-must-gather-kc489/perf-node-gather-daemonset-cthf8"
Oct 30 20:24:30.726683 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:24:30.726640    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/8384c8e5-97b8-4340-8ac9-1f7b726dc3b6-podres\") pod \"perf-node-gather-daemonset-cthf8\" (UID: \"8384c8e5-97b8-4340-8ac9-1f7b726dc3b6\") " pod="openshift-must-gather-kc489/perf-node-gather-daemonset-cthf8"
Oct 30 20:24:30.751229 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:24:30.751211    6275 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5lf6z\" (UniqueName: \"kubernetes.io/projected/8384c8e5-97b8-4340-8ac9-1f7b726dc3b6-kube-api-access-5lf6z\") pod \"perf-node-gather-daemonset-cthf8\" (UID: \"8384c8e5-97b8-4340-8ac9-1f7b726dc3b6\") " pod="openshift-must-gather-kc489/perf-node-gather-daemonset-cthf8"
Oct 30 20:24:30.796317 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:24:30.796291    6275 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-kc489/perf-node-gather-daemonset-cthf8"
Oct 30 20:24:30.846848 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:24:30.846815    6275 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-5dc8d7d89b-zvm7p_2a71410e-a1ce-479e-a9ea-261a4e41f6e3/kube-state-metrics/0.log"
Oct 30 20:24:30.961944 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:24:30.961917    6275 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-5dc8d7d89b-zvm7p_2a71410e-a1ce-479e-a9ea-261a4e41f6e3/kube-rbac-proxy-main/0.log"
Oct 30 20:24:31.079289 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:24:31.079236    6275 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-5dc8d7d89b-zvm7p_2a71410e-a1ce-479e-a9ea-261a4e41f6e3/kube-rbac-proxy-self/0.log"
Oct 30 20:24:31.104778 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:24:31.104751    6275 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-kc489/perf-node-gather-daemonset-cthf8"]
Oct 30 20:24:31.105629 ip-10-0-131-26 kubenswrapper[6275]: W1030 20:24:31.105604    6275 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod8384c8e5_97b8_4340_8ac9_1f7b726dc3b6.slice/crio-57f8ff6e7159dd72c95bc66dc8c9aa2d807d72250fb63c6b13441cc410f13a2a WatchSource:0}: Error finding container 57f8ff6e7159dd72c95bc66dc8c9aa2d807d72250fb63c6b13441cc410f13a2a: Status 404 returned error can't find the container with id 57f8ff6e7159dd72c95bc66dc8c9aa2d807d72250fb63c6b13441cc410f13a2a
Oct 30 20:24:31.332093 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:24:31.332035    6275 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-77f4f76594-k9gfv_e7fb91fc-bf9e-42c6-b440-7165063ae5ec/monitoring-plugin/0.log"
Oct 30 20:24:31.833479 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:24:31.833453    6275 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-lvg9n_dde165c4-1ada-4fd6-af53-32fd75286c79/node-exporter/0.log"
Oct 30 20:24:31.955026 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:24:31.954989    6275 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-lvg9n_dde165c4-1ada-4fd6-af53-32fd75286c79/kube-rbac-proxy/0.log"
Oct 30 20:24:32.071488 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:24:32.071466    6275 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-lvg9n_dde165c4-1ada-4fd6-af53-32fd75286c79/init-textfile/0.log"
Oct 30 20:24:32.113053 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:24:32.113002    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-kc489/perf-node-gather-daemonset-cthf8" event={"ID":"8384c8e5-97b8-4340-8ac9-1f7b726dc3b6","Type":"ContainerStarted","Data":"e0c8af624e5c0fb9554ea78d336fd66563c22b1f4f8e45bb38bbec27ef29de99"}
Oct 30 20:24:32.113053 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:24:32.113043    6275 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-kc489/perf-node-gather-daemonset-cthf8" event={"ID":"8384c8e5-97b8-4340-8ac9-1f7b726dc3b6","Type":"ContainerStarted","Data":"57f8ff6e7159dd72c95bc66dc8c9aa2d807d72250fb63c6b13441cc410f13a2a"}
Oct 30 20:24:32.113173 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:24:32.113098    6275 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-kc489/perf-node-gather-daemonset-cthf8"
Oct 30 20:24:32.157559 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:24:32.157517    6275 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-must-gather-kc489/perf-node-gather-daemonset-cthf8" podStartSLOduration=2.157505944 podStartE2EDuration="2.157505944s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 20:24:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:24:32.1559261 +0000 UTC m=+2182.617652963" watchObservedRunningTime="2026-10-30 20:24:32.157505944 +0000 UTC m=+2182.619232806"
Oct 30 20:24:32.552276 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:24:32.552248    6275 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-7bd7489957-bxr6q_20819707-689f-4b17-8762-802fd5152c71/kube-rbac-proxy-main/0.log"
Oct 30 20:24:32.667892 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:24:32.667868    6275 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-7bd7489957-bxr6q_20819707-689f-4b17-8762-802fd5152c71/kube-rbac-proxy-self/0.log"
Oct 30 20:24:32.788662 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:24:32.788634    6275 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-7bd7489957-bxr6q_20819707-689f-4b17-8762-802fd5152c71/openshift-state-metrics/0.log"
Oct 30 20:24:34.166813 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:24:34.166789    6275 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-75b4dc455f-q57jq_d6b46262-71f5-44de-a798-2ac90b936184/telemeter-client/0.log"
Oct 30 20:24:34.289087 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:24:34.289062    6275 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-75b4dc455f-q57jq_d6b46262-71f5-44de-a798-2ac90b936184/reload/0.log"
Oct 30 20:24:34.404819 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:24:34.404794    6275 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-75b4dc455f-q57jq_d6b46262-71f5-44de-a798-2ac90b936184/kube-rbac-proxy/0.log"
Oct 30 20:24:34.536747 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:24:34.536727    6275 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5f8f546c56-w96tg_6b02f882-10f6-47c4-84a0-8c07533bbb7d/thanos-query/0.log"
Oct 30 20:24:34.653188 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:24:34.653169    6275 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5f8f546c56-w96tg_6b02f882-10f6-47c4-84a0-8c07533bbb7d/kube-rbac-proxy-web/0.log"
Oct 30 20:24:34.770791 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:24:34.770771    6275 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5f8f546c56-w96tg_6b02f882-10f6-47c4-84a0-8c07533bbb7d/kube-rbac-proxy/0.log"
Oct 30 20:24:34.890138 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:24:34.890076    6275 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5f8f546c56-w96tg_6b02f882-10f6-47c4-84a0-8c07533bbb7d/prom-label-proxy/0.log"
Oct 30 20:24:35.004818 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:24:35.004796    6275 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5f8f546c56-w96tg_6b02f882-10f6-47c4-84a0-8c07533bbb7d/kube-rbac-proxy-rules/0.log"
Oct 30 20:24:35.122111 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:24:35.122066    6275 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5f8f546c56-w96tg_6b02f882-10f6-47c4-84a0-8c07533bbb7d/kube-rbac-proxy-metrics/0.log"
Oct 30 20:24:38.127842 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:24:38.127813    6275 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-kc489/perf-node-gather-daemonset-cthf8"
Oct 30 20:24:42.710782 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:24:42.710736    6275 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-kmppx_4d52cf11-23b8-4b48-92ec-009845eea77f/dns/0.log"
Oct 30 20:24:42.830037 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:24:42.830013    6275 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-kmppx_4d52cf11-23b8-4b48-92ec-009845eea77f/kube-rbac-proxy/0.log"
Oct 30 20:24:43.192299 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:24:43.192268    6275 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-krr87_34dfa231-fa1a-400c-82b4-6ee85859d7c4/dns-node-resolver/0.log"
Oct 30 20:24:44.642900 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:24:44.642872    6275 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-2swph_423e0100-284b-48b9-bd4c-3b74005976d2/node-ca/0.log"
Oct 30 20:24:46.130495 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:24:46.130454    6275 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-7f5667f86c-k7qfk_17354614-7251-47e9-a513-b626ebbb598f/istio-proxy/0.log"
Oct 30 20:24:46.405779 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:24:46.405694    6275 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-7f5667f86c-mxxll_b3c62e4b-11c3-45ba-9e82-274e66592e69/istio-proxy/0.log"
Oct 30 20:24:46.547733 ip-10-0-131-26 kubenswrapper[6275]: I1030 20:24:46.547703    6275 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-7f5667f86c-wtnz5_286f2fb7-0dc1-4d1f-9bf5-20be2e0a31cf/istio-proxy/0.log"